MidFull TimeEN
NEOLYTIX
Job Description
AI Platform Engineer – Cloud & Healthcare
Location
Gurugram, India (Hybrid)
Employment Type
Full-Time
About Neolytix
Neolytix is a US-based healthcare technology and services company with 220+ employees across Chicago, Gurugram, and Manila. We serve 270+ provider organizations across revenue cycle management, credentialing, medical coding, and AI-enabled services. We are in an active phase of building proprietary technology platforms that sit at the intersection of healthcare operations and artificial intelligence.
This role sits at the center of that build — owning the infrastructure that makes AI safe, compliant, and usable across our internal teams and client-facing products.
The Role
We are hiring an AI Platform Engineer to own the build, configuration, and ongoing operation of our HIPAA-compliant AI infrastructure layer. This is not an application development role — it is an infrastructure and integration role. The architecture decisions are made; we need someone who can execute with precision, document rigorously, and serve as the internal expert who keeps the platform running and evolving as our AI usage grows.
You will work directly with our IT Operations and Compliance leads, and you will integrate with our product engineering team as AI capabilities are embedded into our clinical and revenue cycle products.
This is a foundational hire. The person in this role will help determine how AI gets used across the entire organization.
What You Will Own
AI Gateway Infrastructure
Deploy, configure, and maintain a self-hosted AI gateway running on Azure App Services
Implement routing logic, per-team and per-user rate limits, and budget kill-switch controls
Manage model provider integrations across multiple AI APIs from a single gateway layer
PHI/PII Redaction Pipeline
Build and maintain an NLP-based PHI detection and redaction layer that intercepts all prompts before routing to any external model provider
Configure entity recognizers for healthcare-specific PHI patterns (names, MRNs, DOBs, diagnoses)
Ensure fail-closed behavior — if redaction fails, the request does not proceed
Identity & Access
Implement SSO federation via Azure Entra ID — all AI gateway access tied to existing corporate identity
Configure cross-cloud IAM federation between Azure and AWS so model API access uses no long-lived static credentials
Maintain IAM groups, access policies, and least-privilege controls across both cloud environments
Observability & Cost Management
Deploy and maintain a self-hosted LLM observability platform on Azure Container Apps
Build dashboards tracking usage by team, user, and cost center
Configure tiered budget alerting with automated notifications and hard stops
Maintain audit-grade API logs forwarded to our SIEM environment for compliance evidence
Product Integration
Connect our AI gateway to workflows within our proprietary clinical platform (InCredibly) as AI features are developed
Support the internal Intelligent Automation team in connecting their workflows to the AI infrastructure layer
Serve as the internal expert on what is safe, compliant, and feasible when product teams propose AI features
What We Are Looking For
Must-Have
3+ years of cloud infrastructure experience spanning Azure and AWS
Hands-on Azure experience: App Services, Container Apps, Entra ID / SSO configuration
AWS experience: IAM, OIDC federation, API access management, CloudTrail or equivalent audit logging
Python proficiency — configuration, pipeline scripting, environment management
Experience deploying or configuring open-source AI gateway or proxy tooling (LiteLLM or equivalent)
Experience with NLP-based PII/PHI detection frameworks (Microsoft Presidio or equivalent)
Experience self-hosting observability platforms (LangFuse, Langsmith, or similar)
Comfort with HIPAA data handling requirements — you understand why data must not leave the environment unredacted
Strong Advantage
Experience in a healthcare or regulated data environment
Infrastructure-as-code experience (Terraform or Azure Bicep)
Secrets management via Azure Key Vault or equivalent
Prior exposure to HITRUST, SOC 2, or similar compliance frameworks from a technical evidence perspective
Experience integrating AI capabilities into enterprise SaaS products
Who You Are
You prefer precise, well-documented infrastructure over clever engineering
You treat compliance constraints as design inputs, not afterthoughts
You can explain what you built to a non-technical compliance officer and to a senior engineer — clearly, differently
You have built things that ran in production without requiring constant hand-holding
Compensation & Structure
Attribute
Detail
Title
AI Platform Engineer (Senior)
Grade / Level
Senior Individual Contributor
Employment Type
Full Time
Location
Gurugram, India (Hybrid — 3 days/week in office preferred)
Reports To
IT Operations Lead (Ramit) with dotted line to CEO
Working Hours
India hours with occasional US overlap required (Chicago, CST)
About This Opportunity
Neolytix is at an inflection point — moving from a services company to a technology-enabled services company with proprietary platforms. The person in this role will be one of a small number of engineers who determine what that technology layer looks like. The work is real, the mandate is clear, and the infrastructure you build will be used in production by a healthcare company serving millions of patients.
