TalentAQ

TalentAQ

Data Engineer

Data & AnalyticsFull Time2-7 yearsHyderabad, Telangana

Required Skills
17 skills

SQL
Python
Apache Airflow
Luigi
Spark
Hadoop
Hive
AWS
GCP
Azure
Redshift
BigQuery
Snowflake
Docker
Kubernetes
Kafka
Flink

Job Description

We seek a skilled Data Engineer to join our team and help build, maintain, and optimize data pipelines and architectures. You will work closely with data scientists, analysts, and software developers to ensure data availability, reliability, and performance for business-critical systems. Key Responsibilities: Design, construct, install, and maintain scalable and reliable data pipelines. Develop and optimize ETL (Extract, Transform, Load) processes. Build and maintain data architectures including databases, data warehouses, and large-scale processing systems. Collaborate with data scientists and analysts to understand data needs and deliver high-quality datasets. Ensure data quality, integrity, security, and compliance with governance standards. Monitor and troubleshoot data pipeline performance and reliability issues. Automate data validation and monitoring tasks. Document data workflows, processes, and infrastructure. Evaluate new data engineering tools and technologies.
We seek a skilled Data Engineer to join our team and help build, maintain, and optimize data pipelines and architectures. You will work closely with data scientists, analysts, and software developers to ensure data availability, reliability, and performance for business-critical systems. Key Responsibilities: Design, construct, install, and maintain scalable and reliable data pipelines. Develop and optimize ETL (Extract, Transform, Load) processes. Build and maintain data architectures including databases, data warehouses, and large-scale processing systems. Collaborate with data scientists and analysts to understand data needs and deliver high-quality datasets. Ensure data quality, integrity, security, and compliance with governance standards. Monitor and troubleshoot data pipeline performance and reliability issues. Automate data validation and monitoring tasks. Document data workflows, processes, and infrastructure. Evaluate new data engineering tools and technologies.

Similar Jobs

10000 jobs available

Data EngineeringContract5-10 yearsRemote
SQL
Hadoop
Spark
+6 more
EngineeringFull-TimeRemote
Python
SQL
Linux
+12 more
EngineeringContract10 years
Data LakeHouse
Kubernetes
AWS
+38 more
BigQuery
Cloud Storage
Python
+10 more
Engineering5-8 years
Java
Spring Boot
Microservices architecture
+12 more
Data ScienceFull Time15-30 yearsRemote
Python
R
SQL
+13 more