TalentAQ

TalentAQ

Data Engineer

EngineeringFull Time15+ yearsJersey City, New jersey

Required Skills
7 skills

Python
PySpark
AWS
Apache Spark
Kafka
Snowflake
Palantir

Job Description

<p>We are seeking a skilled Data Engineer to join our team and contribute to building and maintaining robust data pipelines. As a Data Engineer, you will play a crucial role in designing, developing, and implementing scalable data solutions using cutting-edge technologies.</p><p>Key Responsibilities:<br/>* Design and develop ETL processes to transform raw data into usable formats.<br/>* Build and maintain data pipelines for data ingestion and processing.<br/>* Collaborate with data scientists and analysts to understand data requirements.<br/>* Ensure data quality and consistency across all data systems.<br/>* Monitor and troubleshoot data pipeline performance.</p><p>Required Skills:<br/>* Proficiency in Python and PySpark.<br/>* Experience with AWS cloud services.<br/>* Knowledge of data warehousing solutions like Snowflake.<br/>* Familiarity with Apache Kafka.</p>

We are seeking a skilled Data Engineer to join our team and contribute to building and maintaining robust data pipelines. As a Data Engineer, you will play a crucial role in designing, developing, and implementing scalable data solutions using cutting-edge technologies.

Key Responsibilities:
* Design and develop ETL processes to transform raw data into usable formats.
* Build and maintain data pipelines for data ingestion and processing.
* Collaborate with data scientists and analysts to understand data requirements.
* Ensure data quality and consistency across all data systems.
* Monitor and troubleshoot data pipeline performance.

Required Skills:
* Proficiency in Python and PySpark.
* Experience with AWS cloud services.
* Knowledge of data warehousing solutions like Snowflake.
* Familiarity with Apache Kafka.

Similar Jobs

10000 jobs available

Information Technology3+ yearsRemote
AWS
S3
Redshift
+7 more
Engineering8-12 years
ETL Testing
Cloud Migration
Python
+5 more

AWS Data Engineer

10 positions
Engineering8-12 years
ETL Testing
Cloud Migration
Python
+5 more
Data EngineeringContract5-10 yearsRemote
SQL
Hadoop
Spark
+6 more
Data & Analytics9-11 years
AWS
Databricks
Python
+1 more
Data ScienceContract4+ years
Snowflake
SQL
Python
+2 more