AWS Databricks Architect -Sr Staff

Qualcomm

Not disclosedHyderabad (On-site)
Posted: 12d agoOpening: 1

Skills Required

Key skills are marked withstar
  • Key skillDatabricks
  • Key skillApache Spark
  • Key skillPySpark
  • Delta Lake
  • Python
  • SQL
  • Data Pipelines
  • Unity Catalog
  • Microsoft Azure
  • AWS
  • Lakehouse Architecture
  • Structured Streaming
  • MLflow
  • Data Modeling
  • Airflow

Job Description


Company:

Qualcomm India Private Limited

Job Area:

Information Technology Group, Information Technology Group > IT Data Engineer

General Summary:

The Databricks Architect will be responsible for technical decision-making, code quality, and the successful delivery of complex data projects using Delta Lake, Unity Catalog, and Mosaic AI. The Databricks Architect/Lead owns the end-to-end strategy for data ingestion, storage, and analytics and serve as a liaison between business stakeholders and engineering teams, ensuring that the platform is secure, cost-optimized, and capable of supporting advanced AI/ML workloads.

Key Responsibilities
• Lakehouse Design: Architect end-to-end data solutions using the Medallion Architecture (Bronze/Silver) and Delta Lake.
• Platform Governance: Implement and manage Unity Catalog for centralized data governance, fine-grained access control, and lineage tracking.
• Technical Leadership: Lead and mentor cross-functional teams of data engineers; conduct code reviews and define engineering best practices in Python, PySpark, and SQL.
• Optimization & Performance: Drive cost-efficiency by tuning Spark jobs, managing cluster policies, and leveraging serverless compute and auto-scaling.
• DevOps & DataOps Integration: Integrate Databricks workflows into CI/CD pipelines using tools like Databricks Asset Bundles, Terraform, and Azure DevOps or GitHub.
• AI/ML Support: Provide architectural guidance for integrating machine learning models, including feature engineering and model deployment via MLflow.
• Deep hands-on technical understanding in building complex data models for supporting various analytics needs
• Comfortable in working with cross-functional teams such as Data Engineering, Analytics, SMEs and Business stakeholders
• Passion to understand complex existing footprint of data solutions and build out the strategy for migrating to Databricks medallion architecture
• Accountability and Ownership of the delivery in driving the projects to completion

• 14+ years of experience in data management, data engineering, or data science roles, with at least 7 years in building enterprise level data models as part of data modernization and DW migration efforts.
• 8+ years of work experience with Data Structures and algorithms
• 8+ years of work experience with programming (e.g., Java, Python)
• 8+ years of work experience with SQL or NoSQL Databases
• 3+ years of work experience in a role requiring interaction with senior leadership, leading modernization of Data platforms.

Bachelor's or Master's degree in Computer Science, Data Science, Information Technology, or a related field.
• Strong understanding and hands-on experience with lakehouse medallion data architecture and govenance
• Proven implementation experience with migrating legacy DW data models to 3-layer medallion architecture.
• Strong passion in exploring GenAI based solutions for documenting the existing DW footprint and build out strategic data model for Databricks platform
• Experience with machine learning, artificial intelligence, and predictive analytics is a plus.
• Excellent leadership, communication, and collaboration skills in a global hybrid delivery model
• Strong problem-solving skills with strategic thought process and self-initiative and proctive soft skills

Minimum Qualifications:

• 7+ years of IT-related work experience with a Bachelor's degree in Computer Engineering, Computer Science, Information Systems or a related field.
OR
9+ years of IT-related work experience without a Bachelor’s degree.

• 5+ years of work experience with programming (e.g., Java, Python).
• 3+ years of work experience with SQL or NoSQL Databases.
• 3+ years of work experience with Data Structures and algorithms.

Applicants: Qualcomm is an equal opportunity employer. If you are an individual with a disability and need an accommodation during the application/hiring process, rest assured that Qualcomm is committed to providing an accessible process. You may e-mail  or call Qualcomm's toll-free number found here. Upon request, Qualcomm will provide reasonable accommodations to support individuals with disabilities to be able participate in the hiring process. Qualcomm is also committed to making our workplace accessible for individuals with disabilities. (Keep in mind that this email address is used to provide reasonable accommodations for individuals with disabilities. We will not respond here to requests for updates on applications or resume inquiries).

Qualcomm expects its employees to abide by all applicable policies and procedures, including but not limited to security and other requirements regarding protection of Company confidential information and other confidential and/or proprietary information, to the extent those requirements are permissible under applicable law.

To all Staffing and Recruiting Agencies: Our Careers Site is only for individuals seeking a job at Qualcomm. Staffing and recruiting agencies and individuals being represented by an agency are not authorized to use this site or to submit profiles, applications or resumes, and any such submissions will be considered unsolicited. Qualcomm does not accept unsolicited resumes or applications from agencies. Please do not forward resumes to our jobs alias, Qualcomm employees or any other company location. Qualcomm is not responsible for any fees related to unsolicited resumes/applications.

If you would like more information about this role, please contact Qualcomm Careers.

Similar Jobs (35117)

Data Engineer

Accenture

Not disclosedBengaluru

Skills required:

Data Engineering, SQL, Python, ETL, Data Pipelines, Apache Spark, Airflow, Data Warehousing, Data Modeling, Cloud Platforms, Kafka, dbt, Snowflake, AWS, Git

Data Engineer

Accenture

Not disclosedBengaluru

Skills required:

Data Engineering, SQL, Python, ETL, Data Pipelines, Apache Spark, Airflow, Data Warehousing, Data Modeling, Cloud Platforms, Kafka, dbt, Snowflake, AWS, Git

Data Engineer

Accenture

Not disclosedBengaluru

Skills required:

Data Engineering, SQL, Python, ETL, Data Pipelines, Apache Spark, Airflow, Data Warehousing, Data Modeling, Cloud Platforms, Kafka, dbt, Snowflake, AWS, Git

Data Engineer

Accenture

Not disclosedBengaluru

Skills required:

Data Engineering, SQL, Python, ETL, Data Pipelines, Apache Spark, Airflow, Data Warehousing, Data Modeling, Cloud Platforms, Kafka, dbt, Snowflake, AWS, Git

Data Engineer

Accenture

Not disclosedBengaluru

Skills required:

Data Engineering, SQL, Python, ETL, Data Pipelines, Apache Spark, Airflow, Data Warehousing, Data Modeling, Cloud Platforms, Kafka, dbt, Snowflake, AWS, Git

Data Engineer

Accenture

Not disclosedBengaluru

Skills required:

Data Engineering, SQL, Python, ETL, Data Pipelines, Apache Spark, Airflow, Data Warehousing, Data Modeling, Cloud Platforms, Kafka, dbt, Snowflake, AWS, Git

Data Platform Engineer

Accenture

Not disclosedBengaluru

Skills required:

Data Platform Engineering, Python, SQL, Apache Spark, Kafka, Kubernetes, Airflow, Cloud Platforms, Infrastructure as Code, Terraform, Data Lakes, Snowflake, Databricks, Data Governance, CI/CD

Data Platform Engineer

Accenture

Not disclosedBengaluru

Skills required:

Data Platform Engineering, Python, SQL, Apache Spark, Kafka, Kubernetes, Airflow, Cloud Platforms, Infrastructure as Code, Terraform, Data Lakes, Snowflake, Databricks, Data Governance, CI/CD

Application Tech Support Practitioner

Accenture

Not disclosedBengaluru

Skills required:

Cloud Platforms, AWS, Microsoft Azure, Troubleshooting, Linux, Networking, Cloud Monitoring, Customer Support, Incident Management, Shell Scripting, Python, Identity & Access Management, Cloud Databases, Ticketing Systems, Root Cause Analysis

Custom Software Engineer

Accenture

Not disclosedBengaluru

Skills required:

Programming, Data Structures & Algorithms, System Design, Object-Oriented Programming, Java, Python, JavaScript, SQL, REST APIs, Git, Unit Testing, Cloud Platforms, Docker, CI/CD, Debugging

View All 35117 Jobs
AWS Databricks Architect -Sr Staff at Qualcomm