TalentAQ

TalentAQ

Data Engineer

EngineeringFull Time15+ yearsJersey City, New jersey

Required Skills
7 skills

Python
PySpark
AWS
Apache Spark
Kafka
Snowflake
Palantir

Job Description

<p>We are seeking a skilled Data Engineer to join our team and contribute to building and maintaining robust data pipelines. As a Data Engineer, you will play a crucial role in designing, developing, and implementing scalable data solutions using cutting-edge technologies.</p><p>Key Responsibilities:<br/>* Design and develop ETL processes to transform raw data into usable formats.<br/>* Build and maintain data pipelines for data ingestion and processing.<br/>* Collaborate with data scientists and analysts to understand data requirements.<br/>* Ensure data quality and consistency across all data systems.<br/>* Monitor and troubleshoot data pipeline performance.</p><p>Required Skills:<br/>* Proficiency in Python and PySpark.<br/>* Experience with AWS cloud services.<br/>* Knowledge of data warehousing solutions like Snowflake.<br/>* Familiarity with Apache Kafka.</p>

We are seeking a skilled Data Engineer to join our team and contribute to building and maintaining robust data pipelines. As a Data Engineer, you will play a crucial role in designing, developing, and implementing scalable data solutions using cutting-edge technologies.

Key Responsibilities:
* Design and develop ETL processes to transform raw data into usable formats.
* Build and maintain data pipelines for data ingestion and processing.
* Collaborate with data scientists and analysts to understand data requirements.
* Ensure data quality and consistency across all data systems.
* Monitor and troubleshoot data pipeline performance.

Required Skills:
* Proficiency in Python and PySpark.
* Experience with AWS cloud services.
* Knowledge of data warehousing solutions like Snowflake.
* Familiarity with Apache Kafka.

Similar Jobs

10000 jobs available

Data & AnalyticsFull Time2-7 years
SQL
Python
Apache Airflow
+14 more
Engineering5+ yearsRemote
Python
SQL
AWS
+8 more
EngineeringContractRemote
Spark
PySpark
Snowflake
+1 more
Data Engineering12+ years
Data Bricks
AWS
SnowFlakes
+18 more
Engineering5+ years
AWS Glue
AWS Lambda
AWS S3
+11 more
DataWorks
Engineering3+ years
SQL
Python
ETL
+6 more