TalentAQ

TalentAQ

Data Engineer

EngineeringFull Time15+ yearsJersey City, New jersey

Required Skills
7 skills

Python
PySpark
AWS
Apache Spark
Kafka
Snowflake
Palantir

Job Description

<p>We are seeking a skilled Data Engineer to join our team and contribute to building and maintaining robust data pipelines. As a Data Engineer, you will play a crucial role in designing, developing, and implementing scalable data solutions using cutting-edge technologies.</p><p>Key Responsibilities:<br/>* Design and develop ETL processes to transform raw data into usable formats.<br/>* Build and maintain data pipelines for data ingestion and processing.<br/>* Collaborate with data scientists and analysts to understand data requirements.<br/>* Ensure data quality and consistency across all data systems.<br/>* Monitor and troubleshoot data pipeline performance.</p><p>Required Skills:<br/>* Proficiency in Python and PySpark.<br/>* Experience with AWS cloud services.<br/>* Knowledge of data warehousing solutions like Snowflake.<br/>* Familiarity with Apache Kafka.</p>

We are seeking a skilled Data Engineer to join our team and contribute to building and maintaining robust data pipelines. As a Data Engineer, you will play a crucial role in designing, developing, and implementing scalable data solutions using cutting-edge technologies.

Key Responsibilities:
* Design and develop ETL processes to transform raw data into usable formats.
* Build and maintain data pipelines for data ingestion and processing.
* Collaborate with data scientists and analysts to understand data requirements.
* Ensure data quality and consistency across all data systems.
* Monitor and troubleshoot data pipeline performance.

Required Skills:
* Proficiency in Python and PySpark.
* Experience with AWS cloud services.
* Knowledge of data warehousing solutions like Snowflake.
* Familiarity with Apache Kafka.

Similar Jobs

10000 jobs available

Data Engineering4-8 yearsRemote
SQL
ETL
Snowflake
+11 more
Data EngineeringContract
Azure
Data Engineer
Databricks
+15 more
CGI
EngineeringFull-Time8-11 years
Python
PySpark
SQL
+10 more
EngineeringContract2 years
DM architecture
data modeling
governance
+14 more
Data & AnalyticsFull Time9+ years
Data Engineering
Business Systems Analysis
Big Data
+27 more
Nityo Infotech Corp.
EngineeringContract9 years
DevSecOps
SonarQube
SonaType
+15 more