TalentAQ

TalentAQ

Data Architect

EngineeringContract10 yearsCharlotte

Required Skills
41 skills

Data LakeHouse
Kubernetes
AWS
Distributed Systems
Microservice architecture
Containers
EMR
EKS
Hadoop
Spark
Hudi
Kafka
Kinesis
Git
GitHub Actions
IAM
API Gateway
Lambda
Step Functions
Lake formation
Glue
Athena
S3
Apache Flink
PostgreSQL
SQL
RDS
Python
Java
Terraform
Helm
Kafka Schema Registry
CloudTrail
SNS
SQS
CloudWatch
Aurora
Redshift
Iceberg
Vault
AWS Secrets manager

Job Description

Must have experience with similar platform engineering/management solutions: Building/optimizing Data LakeHouse with Open Table formats Kubernetes deployments/cluster administration Transitioning on-premise big data platforms to scalable cloud-based platforms like AWS Distributed Systems, Microservice architecture, and containers Cloud Streaming use cases in Big Data Ecosystems (e.g., EMR, EKS, Hadoop, Spark, Hudi, Kafka/Kinesis) Must have hands-on experience with below tech stack: Must have experience with below tech stack: Git Hib and Git Hub Actions AWS o IAM o API Gateway o Lambda o Step Functions o Lake formation o EKS & Kubernetes o Glue: Catalog, ETL, Crawler o Athena o Lambda o S3 (Strong foundational concepts like object data store vs block data store, encryption/decryption, storage tiers etc) Apache Hudi Apache Flink PostgreSQL and SQL RDS (Relational Database Services). Python Java Terraform Enterprise o Must be able to explain what TF is used for o Understand and explain basic principles (e.g. modules, providers, functions) o Must be able to write and debug TF Helpful tech stack experience would include: Helm, Kafka and Kafka Schema Registry, AWS Services: CloudTrail, SNS, SQS, CloudWatch, Aurora, EMR, Redshift, Iceberg, Vault, AWS Secrets manager
Must have experience with similar platform engineering/management solutions: Building/optimizing Data LakeHouse with Open Table formats Kubernetes deployments/cluster administration Transitioning on-premise big data platforms to scalable cloud-based platforms like AWS Distributed Systems, Microservice architecture, and containers Cloud Streaming use cases in Big Data Ecosystems (e.g., EMR, EKS, Hadoop, Spark, Hudi, Kafka/Kinesis) Must have hands-on experience with below tech stack: Must have experience with below tech stack: Git Hib and Git Hub Actions AWS o IAM o API Gateway o Lambda o Step Functions o Lake formation o EKS & Kubernetes o Glue: Catalog, ETL, Crawler o Athena o Lambda o S3 (Strong foundational concepts like object data store vs block data store, encryption/decryption, storage tiers etc) Apache Hudi Apache Flink PostgreSQL and SQL RDS (Relational Database Services). Python Java Terraform Enterprise o Must be able to explain what TF is used for o Understand and explain basic principles (e.g. modules, providers, functions) o Must be able to write and debug TF Helpful tech stack experience would include: Helm, Kafka and Kafka Schema Registry, AWS Services: CloudTrail, SNS, SQS, CloudWatch, Aurora, EMR, Redshift, Iceberg, Vault, AWS Secrets manager

Similar Jobs

10000 jobs available

EngineeringContract5+ years
AWS
S3
DynamoDB
+14 more
Java
Python
Spring Boot
+24 more
Smartworkit Services
Data Engineering6+ years
AWS
S3
Glue
+11 more
EngineeringFull-Time6+ years
React.js
Node.js
AWS
+24 more
EngineeringFull-Time6+ years
React.js
Node.js
AWS
+24 more
Data & AnalyticsFull Time2-7 years
SQL
Python
Apache Airflow
+14 more