Job Overview
We are seeking a highly skilled and experienced Senior Big Data Engineer to join our team. As a Senior Big Data Engineer, you will be responsible for designing, developing, and maintaining our big data infrastructure. You will work closely with data scientists and other engineers to ensure the scalability, reliability, and performance of our big data platform.
Key Responsibilities
- Design and implement big data solutions using Apache Spark, Hive, and other big data technologies.
- Develop and maintain data pipelines for data ingestion, processing, and storage.
- Optimize big data infrastructure for performance and scalability.
- Troubleshoot and resolve issues related to big data infrastructure.
- Collaborate with data scientists and other engineers to develop and deploy machine learning models.
Required Skills
- Apache Spark
- Hive
- Apache Iceberg
- Medallion framework