Product Manager On-Device & Edge AI

Sarvam AI

Not disclosedBengaluru (On-site)
Posted: 12d agoOpening: 1

Skills Required

Key skills are marked withstar
  • Key skillAI Product Management
  • Key skillMachine Learning
  • Key skillLarge Language Models
  • Generative AI
  • Product Roadmapping
  • Model Evaluation
  • Data Strategy
  • Prompt Engineering
  • Responsible AI
  • User Research
  • Experimentation
  • Technical Fluency
  • Stakeholder Management
  • Product Analytics
  • Agile Methodologies

Job Description

About Sarvam

Sarvam is building the bedrock of Sovereign AI for India. The company is developing India's full-stack sovereign AI platform, building across research, models, infrastructure and applications with a singular focus on making AI genuinely work for India. Sarvam works with leading enterprises and public institutions and is backed by Lightspeed, Peak XV, and Khosla Ventures. Sarvam partners with India's leading brands, including Tata Capital, SBI Life, CRED, IDFC, and LIC.

About the Role

Sarvam is our on-device AI product line — purpose-built for enterprise deployments where data sovereignty, low latency, and offline reliability are non-negotiable. We're looking for a Product Manager who understands enterprise AI deeply: the IT admin personas, the procurement cycles, the compliance requirements, and the day-to-day friction that determines whether an AI tool gets embedded into workflows or quietly abandoned.

You'll own the product roadmap for drive B2B GTM alignment, and run iterative experiments to build stickiness in enterprise workflows. You'll work closely with engineering, sales, and customer success to define what enterprise-grade AI looks like when it runs on-device, at the edge, and inside a customer's own security perimeter.

You will co-own as a Full Stack product builder the most ambitious on-device AI problem in India building sovereign models that run at the silicon level across devices. You will be embedded with silicon partners like Qualcomm, Intel, HP, Apple, NVIDIA etc turning research breakthroughs into production-grade optimisations that serve 1.5b indians at min latency. You will architect the Product motion from tuning to agentic orchestration and client deployment, this is not a feature team, it is a platform-defining role. If you want to build the infrastructure layer that makes AI truly accessible across every laptop, phone, glasses and car in India, please apply!

What You'll Do

• Own the product roadmap for Sarvam, from on-device inference to enterprise deployment and fleet management

• Define and prioritise features for IT admin personas — MDM integration, device provisioning, policy enforcement, and enterprise authentication (including Microsoft ecosystem)

• Drive B2B GTM alignment by working with sales and customer success to translate customer pain points into product requirements

• Run iterative experiments in enterprise deployments to identify and improve workflow stickiness and adoption

• Design and ship features for multi-tenant SaaS architecture, including tenant isolation, access controls, and admin tooling

• Define requirements for HITL (human-in-the-loop) and agentic workflows, ensuring enterprise-grade reliability and auditability

• Work across security and compliance requirements — data residency, enterprise auth (SSO, SAML, SCIM), and regulatory standards relevant to enterprise AI

• Collaborate with engineering on API design and integration patterns for enterprise tooling and partner ecosystems

• Define and track product metrics that measure enterprise engagement, retention, and workflow depth

What We're Looking For

• 4–8 years of product management experience, with significant time in enterprise SaaS or B2B AI products

• Demonstrable experience with on-device or edge AI products, or IT fleet management and enterprise device management

• Strong understanding of enterprise authentication and identity — Microsoft ecosystem (Entra ID, Intune, Azure AD), SSO, SAML, or SCIM

• Experience running structured product experiments and using data to drive roadmap decisions in enterprise contexts

• Ability to work directly with IT admin and enterprise buyer personas — understanding their workflows, constraints, and decision criteria

• Comfort with technical depth: APIs, security and compliance requirements, and multi-tenant SaaS architecture

• Background in Computer Science or Electrical Engineering preferred

Bonus Points

• Experience with HITL workflows or agentic AI product design

• Prior exposure to data residency, sovereign cloud, or on-premise enterprise AI deployments

• Familiarity with MDM/UEM platforms (Jamf, Intune, or equivalent)

• Experience working on AI products in regulated industries (BFSI, healthcare, or government)

• Background that combines technical depth with business or GTM exposure

Why Sarvam?

Sarvam is a fast-moving, high talent-density team building full-stack AI for India, working on problems that push the frontiers of AI with real population-scale impact.

• Work alongside researchers, engineers, builders, and business leaders who move fast and hold each other to a very high bar

• High ownership and high impact, from day one

• Everything we do is AI-first, from the way we build and ship to the way we think about problems

• You can work on problems that could change how an entire country learns, works, and communicates

If you want to work on problems at the frontier of AI in India, Sarvam is the place to be.

Similar Jobs (35067)

Product Manager_MNC_0719_1419_1086696

Kotak Mahindra Bank

Not disclosedMumbai

Skills required:

Product Management, Product Roadmapping, Product Strategy, User Research, Requirements Gathering, User Stories, Agile Methodologies, Product Analytics, A/B Testing, Stakeholder Management, Go-to-Market Strategy, Prioritization Frameworks, Data Analysis, Wireframing, Jira

Product Manager - Fx_TREASURY-FOREX MERCHANT_0408_1314_1052914

Kotak Mahindra Bank

Not disclosedMumbai

Skills required:

Product Management, Product Roadmapping, Product Strategy, User Research, Requirements Gathering, User Stories, Agile Methodologies, Product Analytics, A/B Testing, Stakeholder Management, Go-to-Market Strategy, Prioritization Frameworks, Data Analysis, Wireframing, Jira

Tech Product Manager 2_Digital Banking Kotak 811_0434_8147_1077291

Kotak Mahindra Bank

Not disclosedIndia

Skills required:

Product Management, Digital Products, Product Roadmapping, User Stories, Agile Methodologies, Product Analytics, User Experience, A/B Testing, Web & Mobile Platforms, Requirements Gathering, Stakeholder Management, Data Analysis, Go-to-Market Strategy, Jira, Digital Transformation

Acquisition Manager-Product GRA_Sales_0434_7429_1018334

Kotak Mahindra Bank

Not disclosedHyderabad

Skills required:

Growth Product Management, User Acquisition, Onboarding Optimization, Funnel Optimization, Experimentation, A/B Testing, Product Analytics, SEO Awareness, Referral Programs, Attribution, Conversion Rate Optimization, SQL, Marketing Collaboration, Data Analysis, Product Roadmapping

Business Relationship Manager - WC_Working Capital_0412_2618_1050131

Kotak Mahindra Bank

Not disclosedAhmedabad

Skills required:

Working Capital Management, Cash Conversion Cycle Optimization, Receivables Management, Payables Optimization, Inventory Optimization, Cash Flow Forecasting, Supply Chain Finance, Working Capital Facilities, Team Leadership, Process Improvement, Stakeholder Management, Executive Reporting

Business Relationship Manager - WC_Working Capital_0412_0871_1048768

Kotak Mahindra Bank

Not disclosedSurat

Skills required:

Working Capital Management, Cash Conversion Cycle Optimization, Receivables Management, Payables Optimization, Inventory Optimization, Cash Flow Forecasting, Supply Chain Finance, Working Capital Facilities, Team Leadership, Process Improvement, Stakeholder Management, Executive Reporting

Business Relationship Manager - WC_Working Capital_0412_1508_1039045

Kotak Mahindra Bank

Not disclosedMumbai

Skills required:

Working Capital Management, Cash Conversion Cycle Optimization, Receivables Management, Payables Optimization, Inventory Optimization, Cash Flow Forecasting, Supply Chain Finance, Working Capital Facilities, Team Leadership, Process Improvement, Stakeholder Management, Executive Reporting

Premier Acquisition Manager-Business Banking_Sales_0412_0963_1088654

Kotak Mahindra Bank

Not disclosedIndia

Skills required:

User Acquisition, Performance Marketing, Paid Media, Google Ads, Meta Ads, Customer Acquisition Cost Optimization, Funnel Optimization, Attribution, A/B Testing, Marketing Analytics, Budget Management, Conversion Rate Optimization, Affiliate Marketing, Data Analysis, Stakeholder Management

Portfolio Relationship Manager - SBE_Small Business

Kotak Mahindra Bank

Not disclosedJodhpur

Skills required:

Enterprise Business Management, Strategic Account Management, Revenue Growth, Business Planning, Solution Selling, Executive Relationship Building, P&L Management, Negotiation, Stakeholder Management, Account Planning, Sales Forecasting, Team Leadership, Contract Renewals, CRM Software

Customer Assistance Manager_CREDIT CARD_0233_4673_1008925_HRR

Kotak Mahindra Bank

Not disclosedDelhi

Skills required:

Credit Management, Credit Risk Assessment, Credit Policy, Financial Statement Analysis, Credit Limit Management, Collections Management, Customer Due Diligence, Risk Mitigation, Team Leadership, ERP Systems, Stakeholder Management, Reporting

View All 35067 Jobs
Product Manager On-Device & Edge AI at Sarvam AI