We are seeking a skilled Data Engineer to join our team and contribute to building and maintaining robust data pipelines. As a Data Engineer, you will play a crucial role in designing, developing, and implementing scalable data solutions using cutting-edge technologies.
Key Responsibilities:
* Design and develop ETL processes to transform raw data into usable formats.
* Build and maintain data pipelines for data ingestion and processing.
* Collaborate with data scientists and analysts to understand data requirements.
* Ensure data quality and consistency across all data systems.
* Monitor and troubleshoot data pipeline performance.
Required Skills:
* Proficiency in Python and PySpark.
* Experience with AWS cloud services.
* Knowledge of data warehousing solutions like Snowflake.
* Familiarity with Apache Kafka.
10000 jobs available