Senior Databricks Developer

Persistent Systems

7-12 YrsNot disclosedPune (On-site)
Posted: 4hr agoOpening: 1

Skills Required

Key skills are marked withstar
  • Key skillDatabricks
  • Key skillApache Spark
  • Key skillPySpark
  • Delta Lake
  • Python
  • SQL
  • Data Pipelines
  • Unity Catalog
  • Microsoft Azure
  • AWS
  • Lakehouse Architecture
  • Structured Streaming
  • MLflow
  • Data Modeling
  • Airflow

Job Description

About Persistent We are an AI-led, platform-driven Digital Engineering and Enterprise Modernization partner, combining deep technical expertise and industry experience to help our clients anticipate what’s next. Our offerings and proven solutions create a unique competitive advantage for our clients by giving them the power to see beyond and rise above. We work with many industry-leading organizations across the world, including 18 of the Fortune 50 companies, 7 of the 10 top US banks, 9 of the 10 technology companies, and numerous innovators across the healthcare ecosystem. Our disruptor’s mindset, commitment to client success, and agility to thrive in the dynamic environment have enabled us to sustain our growth momentum. Persistent has been recognized across top industry platforms for innovation, leadership, and inclusion. We have delivered 26 sequential quarters of growth with $487.6M in Q2 FY27 revenue, up 7.8% Q-o-Q and 20.0% Y-o-Y. Our 29,500+ global team members, located in 21 countries, have been instrumental in helping the market leaders transform their industries. We received five awards at the ISG (Information Services Group) Provider Lens™ Awards 2026 and, for the second year in a row, were awarded the Growth Honor of the Year at the Everest Group Elevate 2026. About Position: We are seeking an experienced Senior Databricks Developer with 7 to 12 years of experience in Data Engineering, Analytics, and Modern Data Platforms. The ideal candidate will have strong hands-on expertise in Databricks, PySpark, Delta Lake, and cloud-based data ecosystems. This role involves designing and optimizing large-scale data pipelines, driving performance improvements, implementing scalable Lakehouse architectures, and delivering enterprise-grade data solutions across cloud environments. Role: Senior Databricks Developer Location: All Persistent Locations Experience: 7 to 12 Years Job Type: Full-Time Employment What You'll Do: Design, develop, and maintain scalable ETL/ELT pipelines using Databricks, PySpark, SQL, and Notebooks. Build and manage data processing workflows across Bronze, Silver, and Gold layers using Delta Lake architecture. Develop and optimize batch and real-time streaming data pipelines using Structured Streaming. Perform Spark performance tuning, cluster optimization, and cost optimization to improve platform efficiency. Implement robust data quality, validation, and monitoring frameworks across data pipelines. Integrate Databricks solutions with cloud-native services across Azure, AWS, or GCP environments. Collaborate with data architects, analysts, business stakeholders, and engineering teams to deliver scalable data solutions. Troubleshoot and resolve issues related to data pipelines, clusters, jobs, and runtime environments. Implement CI/CD best practices using Git and deployment automation tools. Ensure adherence to security, governance, and compliance standards across data platforms. Drive platform modernization initiatives and recommend best practices for scalable data engineering. Expertise You'll Bring: 7 to 12 years of experience in Data Engineering, Big Data, Analytics, and Modern Data Platforms. Strong hands-on expertise in Databricks, PySpark, Spark SQL, and Delta Lake. Experience delivering multiple end-to-end Databricks implementations in enterprise environments. Deep understanding of distributed computing concepts and Spark architecture. Strong expertise in cluster management, job orchestration, workload optimization, and performance tuning. Experience designing and supporting large-scale batch and streaming data processing solutions. Proficiency in SQL and data modeling concepts. Strong knowledge of Data Lake, Lakehouse, and modern Data Warehouse architectures. Experience with Azure, AWS, or GCP, including cloud-native data services. Knowledge of CI/CD pipelines, Git-based version control, and automated deployment practices. Strong troubleshooting and problem-solving skills with the ability to resolve complex production issues. Excellent communication, stakeholder management, and collaboration skills. Ability to mentor junior engineers and provide technical leadership across projects. Benefits: Competitive salary and benefits package Culture focused on talent development with quarterly growth opportunities and company-sponsored higher education and certifications Opportunity to work with cutting-edge technologies Employee engagement initiatives such as project parties, flexible work hours, and Long Service awards Annual health check-ups Insurance coverage: group term life, personal accident, and Mediclaim hospitalization for self, spouse, two children, and parents Values-Driven, People-Centric & Inclusive Work Environment: Persistent is dedicated to fostering diversity and inclusion in the workplace. We invite applications from all qualified individuals, including those with disabilities, and regardless of gender or gender preference. We welcome diverse candidates from all backgrounds. We support hybrid work and flexible hours to fit diverse lifestyles. Our office is accessibility-friendly, with ergonomic setups and assistive technologies to support employees with physical disabilities. If you are a person with disabilities and have specific requirements, please inform us during the application process or at any time during your employment Let's unleash your full potential at Persistent - persistent.com/careers "Persistent is an Equal Opportunity Employer and prohibits discrimination and harassment of any kind."

Similar Jobs (35045)

Acquisition Manager-Product GRA_Sales_0434_7429_1018334

Kotak Mahindra Bank

Not disclosedHyderabad

Skills required:

Growth Product Management, User Acquisition, Onboarding Optimization, Funnel Optimization, Experimentation, A/B Testing, Product Analytics, SEO Awareness, Referral Programs, Attribution, Conversion Rate Optimization, SQL, Marketing Collaboration, Data Analysis, Product Roadmapping

Product Manager_MNC_0719_1419_1086696

Kotak Mahindra Bank

Not disclosedMumbai

Skills required:

Product Management, Product Roadmapping, Product Strategy, User Research, Requirements Gathering, User Stories, Agile Methodologies, Product Analytics, A/B Testing, Stakeholder Management, Go-to-Market Strategy, Prioritization Frameworks, Data Analysis, Wireframing, Jira

Relationship Manager_Loan Against Property_0412_3548_1099861_HRR

Kotak Mahindra Bank

Not disclosedJaipur

Skills required:

Relationship Management, Client Acquisition, Cross-Selling, Customer Needs Analysis, Portfolio Management, Financial Products, Customer Service, Account Management, Negotiation, KYC Process, Regulatory Compliance, CRM Software, Target Achievement, Communication

Relationship Manager_Loan Against Property_0412_3548_1099861_HRR

Kotak Mahindra Bank

Not disclosedJaipur

Skills required:

Relationship Management, Client Acquisition, Cross-Selling, Customer Needs Analysis, Portfolio Management, Financial Products, Customer Service, Account Management, Negotiation, KYC Process, Regulatory Compliance, CRM Software, Target Achievement, Communication

Relationship Manager - Commercial Vehicles_Small Commercial Vehicle

Kotak Mahindra Bank

Not disclosedIndia

Skills required:

Relationship Management, Client Acquisition, Cross-Selling, Customer Needs Analysis, Portfolio Management, Financial Products, Customer Service, Account Management, Negotiation, KYC Process, Regulatory Compliance, CRM Software, Target Achievement, Communication

Relationship Manager_Commercial Vehicle (CV)-Saral

Kotak Mahindra Bank

Not disclosedIndia

Skills required:

Relationship Management, Client Acquisition, Cross-Selling, Customer Needs Analysis, Portfolio Management, Financial Products, Customer Service, Account Management, Negotiation, KYC Process, Regulatory Compliance, CRM Software, Target Achievement, Communication

Relationship Officer-SBE_Small Business Enterprise_0412_2618_1042905

Kotak Mahindra Bank

Not disclosedAhmedabad

Skills required:

Relationship Management, Customer Service, Account Management, Cross-Selling, Customer Retention, Issue Resolution, Customer Needs Analysis, CRM Software, Product Knowledge, Follow-Up Management, Upselling, Communication, Negotiation, Documentation

Gold Loan Relationship Officer_LOANS AGAINST GOLD_0405_1296_1090378

Kotak Mahindra Bank

Not disclosedMumbai

Skills required:

Loan Processing, Loan Products, Credit Assessment Basics, Eligibility Assessment, Customer Needs Analysis, Credit Documentation, KYC Process, Loan Origination, Regulatory Compliance, Relationship Management, Cross-Selling, Customer Service, Communication

Product Manager - Fx_TREASURY-FOREX MERCHANT_0408_1314_1052914

Kotak Mahindra Bank

Not disclosedMumbai

Skills required:

Product Management, Product Roadmapping, Product Strategy, User Research, Requirements Gathering, User Stories, Agile Methodologies, Product Analytics, A/B Testing, Stakeholder Management, Go-to-Market Strategy, Prioritization Frameworks, Data Analysis, Wireframing, Jira

Personal Banker-Outbound_BRANCH BANKING_0468_4692_1012888

Kotak Mahindra Bank

Not disclosedIndia

Skills required:

Personal Banking, Retail Banking Products, Relationship Management, Cross-Selling, CASA Sales, Customer Needs Analysis, Investment Products, Insurance Products, KYC Process, Regulatory Compliance, Customer Service, Target Achievement, Communication

View All 35045 Jobs
Senior Databricks Developer at Persistent Systems