TalentAQ

TalentAQ

Data Architect

EngineeringContract10 yearsCharlotte

Required Skills
41 skills

Data LakeHouse
Kubernetes
AWS
Distributed Systems
Microservice architecture
Containers
EMR
EKS
Hadoop
Spark
Hudi
Kafka
Kinesis
Git
GitHub Actions
IAM
API Gateway
Lambda
Step Functions
Lake formation
Glue
Athena
S3
Apache Flink
PostgreSQL
SQL
RDS
Python
Java
Terraform
Helm
Kafka Schema Registry
CloudTrail
SNS
SQS
CloudWatch
Aurora
Redshift
Iceberg
Vault
AWS Secrets manager

Job Description

Must have experience with similar platform engineering/management solutions: Building/optimizing Data LakeHouse with Open Table formats Kubernetes deployments/cluster administration Transitioning on-premise big data platforms to scalable cloud-based platforms like AWS Distributed Systems, Microservice architecture, and containers Cloud Streaming use cases in Big Data Ecosystems (e.g., EMR, EKS, Hadoop, Spark, Hudi, Kafka/Kinesis) Must have hands-on experience with below tech stack: Must have experience with below tech stack: Git Hib and Git Hub Actions AWS o IAM o API Gateway o Lambda o Step Functions o Lake formation o EKS & Kubernetes o Glue: Catalog, ETL, Crawler o Athena o Lambda o S3 (Strong foundational concepts like object data store vs block data store, encryption/decryption, storage tiers etc) Apache Hudi Apache Flink PostgreSQL and SQL RDS (Relational Database Services). Python Java Terraform Enterprise o Must be able to explain what TF is used for o Understand and explain basic principles (e.g. modules, providers, functions) o Must be able to write and debug TF Helpful tech stack experience would include: Helm, Kafka and Kafka Schema Registry, AWS Services: CloudTrail, SNS, SQS, CloudWatch, Aurora, EMR, Redshift, Iceberg, Vault, AWS Secrets manager
Must have experience with similar platform engineering/management solutions: Building/optimizing Data LakeHouse with Open Table formats Kubernetes deployments/cluster administration Transitioning on-premise big data platforms to scalable cloud-based platforms like AWS Distributed Systems, Microservice architecture, and containers Cloud Streaming use cases in Big Data Ecosystems (e.g., EMR, EKS, Hadoop, Spark, Hudi, Kafka/Kinesis) Must have hands-on experience with below tech stack: Must have experience with below tech stack: Git Hib and Git Hub Actions AWS o IAM o API Gateway o Lambda o Step Functions o Lake formation o EKS & Kubernetes o Glue: Catalog, ETL, Crawler o Athena o Lambda o S3 (Strong foundational concepts like object data store vs block data store, encryption/decryption, storage tiers etc) Apache Hudi Apache Flink PostgreSQL and SQL RDS (Relational Database Services). Python Java Terraform Enterprise o Must be able to explain what TF is used for o Understand and explain basic principles (e.g. modules, providers, functions) o Must be able to write and debug TF Helpful tech stack experience would include: Helm, Kafka and Kafka Schema Registry, AWS Services: CloudTrail, SNS, SQS, CloudWatch, Aurora, EMR, Redshift, Iceberg, Vault, AWS Secrets manager

Similar Jobs

10000 jobs available

EngineeringFull-TimeRemote
Python
SQL
Linux
+12 more
Apache Kafka
Apache NiFi
Apache Flink
+12 more
Engineering8-12 years
ETL Testing
Cloud Migration
Python
+5 more

AWS Data Engineer

10 positions
Engineering8-12 years
ETL Testing
Cloud Migration
Python
+5 more
EngineeringContract10+ years
S4 hana
SQL
Python
+18 more
EngineeringContract5-7 years
AWS architecture
AWS Services
Architecture
+23 more