DE&A - Senior Data Engineer (CDAI)

Zensar Technologies

Not disclosedBengaluru (On-site)
Posted: 13d agoOpening: 1

Skills Required

Key skills are marked withstar
  • Key skillData Engineering
  • Key skillSQL
  • Key skillPython
  • ETL
  • Data Pipelines
  • Apache Spark
  • Airflow
  • Data Warehousing
  • Data Modeling
  • Cloud Platforms
  • Kafka
  • dbt
  • Snowflake
  • AWS
  • Git

Job Description

Core Skills & Experience
• Strong hands-on experience designing, building, and optimizing enterprise-scale data pipelines, data architecture, and data products for performance, scalability, and efficient AI agent consumption.
• Deep expertise in Starburst/Trino and distributed SQL, including query optimization, materialized views (MVs), data modeling, storage design, and tuning data products for low-latency, high-concurrency AI agent access.
• Strong experience optimizing data storage, partitioning, indexing, file formats, and materialization strategies to improve query performance, data freshness, and cost efficiency.
• Hands-on development experience with Apache Spark using Scala and/or Python/PySpark, including migrating complex, SQL-intensive transformations to distributed processing frameworks to improve data curation speed and efficiency.
• Strong ability to evaluate and redesign data processing workflows, selecting the appropriate technologies and execution patterns across SQL, Spark, and other processing frameworks to optimize performance.
• Experience with RDBMS technologies and modern lakehouse architecture, preferably Apache Iceberg, including table design, partitioning, compaction, and data lifecycle optimization.
• Understanding of integration patterns across NiFi, Kafka, Spark, RDBMS, and lakehouse platforms for efficient batch and real-time data processing.
• Strong software engineering practices, including CI/CD, automated testing, source control, infrastructure automation, observability, and production support.
• Experience with data governance, metadata management, lineage, data quality, and secure data access in enterprise environments.

NA

Similar Jobs (35141)

Software Engineer - SnowFlake

YASH Technologies

Not disclosedBengaluru

Skills required:

Programming, Data Structures & Algorithms, System Design, Object-Oriented Programming, Java, Python, JavaScript, SQL, REST APIs, Git, Unit Testing, Cloud Platforms, Docker, CI/CD, Debugging

Sr. Software Engineer-LIMS

YASH Technologies

Not disclosedPune

Skills required:

Programming, Data Structures & Algorithms, System Design, Object-Oriented Programming, Java, Python, JavaScript, SQL, REST APIs, Git, Unit Testing, Cloud Platforms, Docker, CI/CD, Debugging

Intermediate Applications Developer

UPS

Not disclosedChennai

Skills required:

Cloud Platforms, AWS, Microsoft Azure, Python, Java, Node.js, Serverless Architecture, Microservices, REST APIs, Docker, Kubernetes, Infrastructure as Code, CI/CD, Cloud Databases, Git

Intermediate Applications Developer

UPS

Not disclosedChennai

Skills required:

Cloud Platforms, AWS, Microsoft Azure, Python, Java, Node.js, Serverless Architecture, Microservices, REST APIs, Docker, Kubernetes, Infrastructure as Code, CI/CD, Cloud Databases, Git

Full Stack Google AI Engineer

Hindustan Unilever

Not disclosedBengaluru

Skills required:

JavaScript, TypeScript, React, Node.js, Python, REST APIs, GraphQL, SQL, NoSQL, System Design, Microservices, Docker, Cloud Platforms, CI/CD, Unit Testing

Intermediate Applications Developer

UPS

Not disclosedChennai

Skills required:

Backend Development, Java, Python, Node.js, REST APIs, SQL, Database Design, Spring Boot, Microservices, NoSQL, Authentication, Caching, Git, Docker, Unit Testing

intermediate Application Developer

UPS

Not disclosedPune

Skills required:

Programming, Java, Python, C#, JavaScript, SQL, Object-Oriented Programming, REST APIs, Web Development, Database Design, Git, Unit Testing, Debugging, Software Development Life Cycle, Agile Methodologies

Module Lead - Azure Databricks

YASH Technologies

Not disclosedBengaluru

Skills required:

Technical Leadership, Software Development, Code Review, Module Design, Mentoring, Agile Methodologies, Estimation, Task Allocation, Java, SQL, Unit Testing, Stakeholder Management, Git, Delivery Management

Module Lead - IBM Cognos TM1

YASH Technologies

Not disclosedBengaluru

Skills required:

Technical Leadership, Software Development, Code Review, Module Design, Mentoring, Agile Methodologies, Estimation, Task Allocation, Java, SQL, Unit Testing, Stakeholder Management, Git, Delivery Management

Sr. Data Analyst - Qliksense

YASH Technologies

Not disclosedBengaluru

Skills required:

Data Analysis, SQL, Excel, Python, Power BI, Tableau, Data Visualization, Statistics, Data Cleaning, Dashboards, Reporting, Pandas, Google Sheets, Storytelling with Data, Stakeholder Management

View All 35141 Jobs