Job Overview

We are seeking a highly skilled Senior Data Engineer to design, develop, and maintain our data infrastructure. The ideal candidate will have extensive experience in building and optimizing data pipelines, ensuring data quality, and supporting data-driven decision-making across the organization.

Key Responsibilities

• Design and implement scalable ETL processes using Azure Data Factory, Azure Synapse, and Azure Databricks.
• Develop and maintain data models and schemas in Snowflake, AWS Redshift, SQL Server, and PostgreSQL.
• Utilize Python, PySpark, and SQL to process and analyze large datasets.
• Implement CI/CD pipelines using Azure DevOps, GitHub Actions, and Terraform.
• Ensure data governance and compliance using Azure Purview and Unity Catalog.

Required Skills

• Proficiency in Azure Data Factory, Azure Synapse, and Azure Databricks.
• Strong experience with Python, PySpark, and SQL.
• Solid understanding of ETL/ELT processes and tools.