AWS Data Engineer

TeamLease Services

Not disclosedHyderabad (On-site)
Posted: 7d agoOpening: 1

Skills Required

Key skills are marked withstar
  • Key skillAWS
  • Key skillAmazon EC2
  • Key skillAmazon VPC
  • IAM
  • Amazon S3
  • AWS Lambda
  • Terraform
  • AWS CloudFormation
  • Linux
  • CloudWatch
  • Amazon RDS
  • Networking
  • Docker
  • Amazon EKS
  • CI/CD

Job Description

We are looking for an experienced AWS Data Engineer with strong expertise in AWS data engineering, big data technologies, and cloud-native data platforms. The candidate will be responsible for designing, developing, and maintaining scalable data pipelines, implementing data integration solutions, and building enterprise data warehouses and data marts using AWS Redshift.The ideal candidate should have hands-on experience with Python, PySpark, Apache Spark, Kafka, MQTT, and Airflow orchestration, along with strong SQL and data modeling skills.Key ResponsibilitiesDesign, develop, and maintain scalable data pipelines using AWS cloud services.Build and optimize data processing workflows using Python, PySpark, and Apache Spark.Develop and manage enterprise data warehouses and data marts using Amazon Redshift.Implement real-time and streaming data ingestion pipelines using Apache Kafka and MQTT.Develop and manage ETL/ELT workflows for integrating data from multiple sources.Implement workflow orchestration and scheduling using Apache Airflow.Design and maintain analytical data models to support business intelligence and reporting.Write complex SQL queries and optimize database performance.Work with cloud-native AWS technologies to build reliable, scalable, and high-performance data solutions.Ensure data quality, consistency, security, and pipeline reliability.Collaborate with architects, analysts, and cross-functional teams to deliver data engineering solutions.Required Skills & Technical ExpertiseStrong hands-on experience in AWS Data Engineering.Good experience with Python and PySpark programming.Strong knowledge of Apache Spark and distributed data processing.Experience with Amazon Redshift, enterprise data warehouses, and data marts.Hands-on experience with Apache Kafka and MQTT for data streaming and ingestion.Experience in Apache Airflow for workflow orchestration and pipeline scheduling.Strong SQL skills, including query writing and performance optimization.Experience in ETL/ELT development and analytical data modeling.Understanding of cloud-native architecture and scalable data pipeline design.Good to HaveExperience with AWS services such as S3, Glue, Lambda, EMR, Kinesis, and CloudWatch.Knowledge of data lake and data lakehouse architectures.Experience with real-time data processing and event-driven architectures.Understanding of CI/CD, Git, and deployment automation.Experience with data governance, data quality, and monitoring frameworks.

Graduate

Similar Jobs (35108)

Application Tech Support Practitioner

Accenture

Not disclosedBengaluru

Skills required:

Cloud Platforms, AWS, Microsoft Azure, Troubleshooting, Linux, Networking, Cloud Monitoring, Customer Support, Incident Management, Shell Scripting, Python, Identity & Access Management, Cloud Databases, Ticketing Systems, Root Cause Analysis

Senior Verification Engineer | High-Performance Computing & Graphics

AMD

Not disclosedHyderabad

Skills required:

High Performance Computing, Parallel Computing, MPI, OpenMP, C++, CUDA, Linux, Slurm, Cluster Management, Performance Optimization, Python, Fortran, GPU Programming, Shell Scripting, Networking

Custom Software Engineer

Accenture

Not disclosedBengaluru

Skills required:

Programming, Data Structures & Algorithms, System Design, Object-Oriented Programming, Java, Python, JavaScript, SQL, REST APIs, Git, Unit Testing, Cloud Platforms, Docker, CI/CD, Debugging

Custom Software Engineer

Accenture

Not disclosedBengaluru

Skills required:

Programming, Data Structures & Algorithms, System Design, Object-Oriented Programming, Java, Python, JavaScript, SQL, REST APIs, Git, Unit Testing, Cloud Platforms, Docker, CI/CD, Debugging

Custom Software Engineer

Accenture

Not disclosedBengaluru

Skills required:

Programming, Data Structures & Algorithms, System Design, Object-Oriented Programming, Java, Python, JavaScript, SQL, REST APIs, Git, Unit Testing, Cloud Platforms, Docker, CI/CD, Debugging

Custom Software Engineer

Accenture

Not disclosedBengaluru

Skills required:

Programming, Data Structures & Algorithms, System Design, Object-Oriented Programming, Java, Python, JavaScript, SQL, REST APIs, Git, Unit Testing, Cloud Platforms, Docker, CI/CD, Debugging

Data Platform Engineer

Accenture

Not disclosedBengaluru

Skills required:

Data Platform Engineering, Python, SQL, Apache Spark, Kafka, Kubernetes, Airflow, Cloud Platforms, Infrastructure as Code, Terraform, Data Lakes, Snowflake, Databricks, Data Governance, CI/CD

Data Platform Engineer

Accenture

Not disclosedBengaluru

Skills required:

Data Platform Engineering, Python, SQL, Apache Spark, Kafka, Kubernetes, Airflow, Cloud Platforms, Infrastructure as Code, Terraform, Data Lakes, Snowflake, Databricks, Data Governance, CI/CD

Custom Software Engineer

Accenture

Not disclosedBengaluru

Skills required:

Programming, Data Structures & Algorithms, System Design, Object-Oriented Programming, Java, Python, JavaScript, SQL, REST APIs, Git, Unit Testing, Cloud Platforms, Docker, CI/CD, Debugging

Custom Software Engineer

Accenture

Not disclosedBengaluru

Skills required:

Programming, Data Structures & Algorithms, System Design, Object-Oriented Programming, Java, Python, JavaScript, SQL, REST APIs, Git, Unit Testing, Cloud Platforms, Docker, CI/CD, Debugging

View All 35108 Jobs