Data Engineer

Zensar Technologies

Not disclosedIndia (On-site)
Posted: 13d agoOpening: 1

Skills Required

Key skills are marked withstar
  • Key skillData Engineering
  • Key skillSQL
  • Key skillPython
  • ETL
  • Data Pipelines
  • Apache Spark
  • Airflow
  • Data Warehousing
  • Data Modeling
  • Cloud Platforms
  • Kafka
  • dbt
  • Snowflake
  • AWS
  • Git

Job Description

Key Responsibilities

  • Design, develop, and support batch and incremental data ingestion pipelines into the data lake.
  • Develop and optimize complex SQL queries, data transformations, and ETL workflows.
  • Build, maintain, and monitor Airflow DAGs for orchestration and workflow automation.
  • Analyze and troubleshoot data quality, data reconciliation, and pipeline execution issues.
  • Perform end-to-end data lineage analysis and trace data from source systems to downstream consumers.
  • Debug data discrepancies by investigating source systems, transformation logic, and target datasets.
  • Support data migration and modernization initiatives from legacy platforms to cloud-based data platforms.
  • Work closely with business stakeholders, architects, and upstream/downstream teams to understand data requirements.
  • Validate data completeness, accuracy, and consistency across multiple systems.
  • Participate in production support activities and resolve data-related incidents within SLA timelines.
  • Develop reusable data engineering components and recommend process improvements.

Required Skills

Strong Expertise

  • SQL / PL/SQL
    • Complex joins, CTEs, analytical functions
    • Query optimization and performance tuning
    • Data modeling and database concepts
  • BigQuery
    • Query development and optimization
    • Partitioning and clustering concepts
    • Data loading and transformation techniques
  • ETL/Data Engineering
    • Data ingestion patterns (Batch and Incremental)
    • Data transformations and validations
    • Data quality checks and reconciliation

Good to Have

  • Apache Airflow
    • Developing and troubleshooting DAGs
    • Scheduling, monitoring, and dependency management
  • Python
    • Basic to intermediate scripting
    • Data processing and automation
  • Cloud Platforms (Preferably GCP)
    • Cloud Storage
    • BigQuery
    • Composer/Airflow

Preferred Candidate Profile

  • Strong analytical and problem-solving skills.
  • Ability to independently investigate and resolve data issues.
  • Good communication and stakeholder management skills.
  • Experience in cloud data lake or warehouse environments.
  • Exposure to customer, transactional, or enterprise-scale datasets is preferred.

Screening Focus Areas

  1. Advanced SQL/PLSQL
  2. ETL & Data Pipeline Design
  3. BigQuery Concepts
  4. Data Debugging & Root Cause Analysis
  5. Airflow DAG Development
  6. Python Basics
  7. Data Migration & Data Validation
  8. Source-to-Target Traceability and Data Lineage

Must Have: SQL/PLSQL, BigQuery/Cloud Data Warehouse, ETL, Data Analysis & Debugging
Good to Have: Airflow DAG Development, Python, GCP Services

 

Kafka, Pub/Sub optional

Similar Jobs (35176)

Software Engineer - SnowFlake

YASH Technologies

Not disclosedBengaluru

Skills required:

Programming, Data Structures & Algorithms, System Design, Object-Oriented Programming, Java, Python, JavaScript, SQL, REST APIs, Git, Unit Testing, Cloud Platforms, Docker, CI/CD, Debugging

Sr. Software Engineer-LIMS

YASH Technologies

Not disclosedPune

Skills required:

Programming, Data Structures & Algorithms, System Design, Object-Oriented Programming, Java, Python, JavaScript, SQL, REST APIs, Git, Unit Testing, Cloud Platforms, Docker, CI/CD, Debugging

Intermediate Applications Developer

UPS

Not disclosedChennai

Skills required:

Cloud Platforms, AWS, Microsoft Azure, Python, Java, Node.js, Serverless Architecture, Microservices, REST APIs, Docker, Kubernetes, Infrastructure as Code, CI/CD, Cloud Databases, Git

Intermediate Applications Developer

UPS

Not disclosedChennai

Skills required:

Cloud Platforms, AWS, Microsoft Azure, Python, Java, Node.js, Serverless Architecture, Microservices, REST APIs, Docker, Kubernetes, Infrastructure as Code, CI/CD, Cloud Databases, Git

Intermediate Applications Developer

UPS

Not disclosedChennai

Skills required:

Backend Development, Java, Python, Node.js, REST APIs, SQL, Database Design, Spring Boot, Microservices, NoSQL, Authentication, Caching, Git, Docker, Unit Testing

intermediate Application Developer

UPS

Not disclosedPune

Skills required:

Programming, Java, Python, C#, JavaScript, SQL, Object-Oriented Programming, REST APIs, Web Development, Database Design, Git, Unit Testing, Debugging, Software Development Life Cycle, Agile Methodologies

Full Stack Google AI Engineer

Hindustan Unilever

Not disclosedBengaluru

Skills required:

JavaScript, TypeScript, React, Node.js, Python, REST APIs, GraphQL, SQL, NoSQL, System Design, Microservices, Docker, Cloud Platforms, CI/CD, Unit Testing

Embedded Systems - Automation Test Engineer

YASH Technologies

Not disclosedIndia

Skills required:

Embedded Systems, Embedded C, C++, Microcontrollers, RTOS, Firmware Development, Hardware-Software Integration, Communication Protocols, Embedded Linux, Device Drivers, ARM Architecture, Circuit Debugging, Oscilloscope, Python, Git

Sr. Data Analyst - MS Excel

YASH Technologies

Not disclosedIndore

Skills required:

Data Analysis, SQL, Excel, Python, Power BI, Tableau, Data Visualization, Statistics, Data Cleaning, Dashboards, Reporting, Pandas, Google Sheets, Storytelling with Data, Stakeholder Management

Module Lead - Azure Databricks

YASH Technologies

Not disclosedBengaluru

Skills required:

Technical Leadership, Software Development, Code Review, Module Design, Mentoring, Agile Methodologies, Estimation, Task Allocation, Java, SQL, Unit Testing, Stakeholder Management, Git, Delivery Management

View All 35176 Jobs
Data Engineer at Zensar Technologies