Data Engineer

Zensar Technologies

Not disclosedIndia (On-site)
Posted: 13d agoOpening: 1

Skills Required

Key skills are marked withstar
  • Key skillData Engineering
  • Key skillSQL
  • Key skillPython
  • ETL
  • Data Pipelines
  • Apache Spark
  • Airflow
  • Data Warehousing
  • Data Modeling
  • Cloud Platforms
  • Kafka
  • dbt
  • Snowflake
  • AWS
  • Git

Job Description

Key Responsibilities
  • Design, develop, and support batch and incremental data ingestion pipelines into the data lake.
  • Develop and optimize complex SQL queries, data transformations, and ETL workflows.
  • Build, maintain, and monitor Airflow DAGs for orchestration and workflow automation.
  • Analyze and troubleshoot data quality, data reconciliation, and pipeline execution issues.
  • Perform end-to-end data lineage analysis and trace data from source systems to downstream consumers.
  • Debug data discrepancies by investigating source systems, transformation logic, and target datasets.
  • Support data migration and modernization initiatives from legacy platforms to cloud-based data platforms.
  • Work closely with business stakeholders, architects, and upstream/downstream teams to understand data requirements.
  • Validate data completeness, accuracy, and consistency across multiple systems.
  • Participate in production support activities and resolve data-related incidents within SLA timelines.
  • Develop reusable data engineering components and recommend process improvements.

Required Skills

Strong Expertise

  • SQL / PL/SQL
    • Complex joins, CTEs, analytical functions
    • Query optimization and performance tuning
    • Data modeling and database concepts
  • BigQuery
    • Query development and optimization
    • Partitioning and clustering concepts
    • Data loading and transformation techniques
  • ETL/Data Engineering
    • Data ingestion patterns (Batch and Incremental)
    • Data transformations and validations
    • Data quality checks and reconciliation

Good to Have

  • Apache Airflow
    • Developing and troubleshooting DAGs
    • Scheduling, monitoring, and dependency management
  • Python
    • Basic to intermediate scripting
    • Data processing and automation
  • Cloud Platforms (Preferably GCP)
    • Cloud Storage
    • BigQuery
    • Composer/Airflow

Similar Jobs (35175)

Software Engineer - SnowFlake

YASH Technologies

Not disclosedBengaluru

Skills required:

Programming, Data Structures & Algorithms, System Design, Object-Oriented Programming, Java, Python, JavaScript, SQL, REST APIs, Git, Unit Testing, Cloud Platforms, Docker, CI/CD, Debugging

Sr. Software Engineer-LIMS

YASH Technologies

Not disclosedPune

Skills required:

Programming, Data Structures & Algorithms, System Design, Object-Oriented Programming, Java, Python, JavaScript, SQL, REST APIs, Git, Unit Testing, Cloud Platforms, Docker, CI/CD, Debugging

Intermediate Applications Developer

UPS

Not disclosedChennai

Skills required:

Cloud Platforms, AWS, Microsoft Azure, Python, Java, Node.js, Serverless Architecture, Microservices, REST APIs, Docker, Kubernetes, Infrastructure as Code, CI/CD, Cloud Databases, Git

Intermediate Applications Developer

UPS

Not disclosedChennai

Skills required:

Cloud Platforms, AWS, Microsoft Azure, Python, Java, Node.js, Serverless Architecture, Microservices, REST APIs, Docker, Kubernetes, Infrastructure as Code, CI/CD, Cloud Databases, Git

Intermediate Applications Developer

UPS

Not disclosedChennai

Skills required:

Backend Development, Java, Python, Node.js, REST APIs, SQL, Database Design, Spring Boot, Microservices, NoSQL, Authentication, Caching, Git, Docker, Unit Testing

intermediate Application Developer

UPS

Not disclosedPune

Skills required:

Programming, Java, Python, C#, JavaScript, SQL, Object-Oriented Programming, REST APIs, Web Development, Database Design, Git, Unit Testing, Debugging, Software Development Life Cycle, Agile Methodologies

Full Stack Google AI Engineer

Hindustan Unilever

Not disclosedBengaluru

Skills required:

JavaScript, TypeScript, React, Node.js, Python, REST APIs, GraphQL, SQL, NoSQL, System Design, Microservices, Docker, Cloud Platforms, CI/CD, Unit Testing

Embedded Systems - Automation Test Engineer

YASH Technologies

Not disclosedIndia

Skills required:

Embedded Systems, Embedded C, C++, Microcontrollers, RTOS, Firmware Development, Hardware-Software Integration, Communication Protocols, Embedded Linux, Device Drivers, ARM Architecture, Circuit Debugging, Oscilloscope, Python, Git

Sr. Data Analyst - MS Excel

YASH Technologies

Not disclosedIndore

Skills required:

Data Analysis, SQL, Excel, Python, Power BI, Tableau, Data Visualization, Statistics, Data Cleaning, Dashboards, Reporting, Pandas, Google Sheets, Storytelling with Data, Stakeholder Management

Module Lead - Azure Databricks

YASH Technologies

Not disclosedBengaluru

Skills required:

Technical Leadership, Software Development, Code Review, Module Design, Mentoring, Agile Methodologies, Estimation, Task Allocation, Java, SQL, Unit Testing, Stakeholder Management, Git, Delivery Management

View All 35175 Jobs