TalentAQ

TalentAQ

Data Engineer

EngineeringFull Time15+ yearsJersey City, New jersey

Required Skills
7 skills

Python
PySpark
AWS
Apache Spark
Kafka
Snowflake
Palantir

Job Description

<p>We are seeking a skilled Data Engineer to join our team and contribute to building and maintaining robust data pipelines. As a Data Engineer, you will play a crucial role in designing, developing, and implementing scalable data solutions using cutting-edge technologies.</p><p>Key Responsibilities:<br/>* Design and develop ETL processes to transform raw data into usable formats.<br/>* Build and maintain data pipelines for data ingestion and processing.<br/>* Collaborate with data scientists and analysts to understand data requirements.<br/>* Ensure data quality and consistency across all data systems.<br/>* Monitor and troubleshoot data pipeline performance.</p><p>Required Skills:<br/>* Proficiency in Python and PySpark.<br/>* Experience with AWS cloud services.<br/>* Knowledge of data warehousing solutions like Snowflake.<br/>* Familiarity with Apache Kafka.</p>

We are seeking a skilled Data Engineer to join our team and contribute to building and maintaining robust data pipelines. As a Data Engineer, you will play a crucial role in designing, developing, and implementing scalable data solutions using cutting-edge technologies.

Key Responsibilities:
* Design and develop ETL processes to transform raw data into usable formats.
* Build and maintain data pipelines for data ingestion and processing.
* Collaborate with data scientists and analysts to understand data requirements.
* Ensure data quality and consistency across all data systems.
* Monitor and troubleshoot data pipeline performance.

Required Skills:
* Proficiency in Python and PySpark.
* Experience with AWS cloud services.
* Knowledge of data warehousing solutions like Snowflake.
* Familiarity with Apache Kafka.

Similar Jobs

10000 jobs available

Data Structures
Algorithms
Distributed Systems
+20 more
Engineering5-8 years
Java
Spring Boot
Microservices architecture
+12 more
Skillventory
Data Science6+ years
Python
SQL
PySpark
+8 more
Skillventory
Data Science5+ years
machine learning
statistical models
Python
+7 more
EngineeringContract6+ years
AWS
Data Engineer
Cloud
Magnus Technology Solutions
Data Engineering
Java
QA
DevOps
+2 more