SeniorFull TimeEN
Role Summary
We are seeking a Senior AI Engineer specialized in Microsoft Azure to lead the design, development, and deployment of agentic AI systems and enterprise-grade GenAI platforms. You will serve as a technical leader—defining architecture patterns (including Model Context Protocol – MCP), building RAG and LLMOps foundations, and ensuring solutions meet financial-services-grade security, compliance, and reliability standards.
Key Responsibilities
Agentic AI Architecture & Development
Design and implement agentic AI solutions (autonomous workflows, multi-agent systems, tool-use) using Azure OpenAI / Azure AI Studio and Semantic Kernel/Lang Chain/Lang Graph.
Define and enforce architecture patterns for agents, tools, memory, and MCP integrations.
Implement schema-constrained prompting, output validation, and guardrails to reduce hallucinations and enforce safety.
GenAI Pipelines & RAG
Build modular pipelines for ingestion, transformation, and orchestration across LLMs, embedding services, vector stores, SQL sources, and APIs.
Develop hybrid RAG using Azure AI Search (vector & hybrid) plus structured sources (e.g., Azure SQL/SQL MI, Synapse, APIs).
Implement post-retrieval re-ranking, chunking strategies, feedback/DPO-based ranking, and caching (KV) for latency & cost control.
Monitor performance and quality with Langfuse/Prompt Flow traces, Azure Monitor, and Prometheus/Grafana.
AI Platform & Services
Architect platform components: embedding pipelines, vector stores (Azure AI Search vectors, Cosmos DB with vector support, Redis/pgvector on Azure), document intelligence (Azure Document Intelligence / OCR), and metadata extraction.
Define API standards and integration patterns (REST/GraphQL/gRPC) backed by Azure API Management.
Cloud Architecture & Infrastructure (Azure-first)
Lead cloud architecture on Azure for scalability, security, and cost: AKS, Azure Functions, Event Hubs (Kafka-compatible), Service Bus, Data Lake Storage Gen2, Blob Storage, Key Vault, Private Link/VNet.
Productionize models using Azure Machine Learning (model registry, managed endpoints, Prompt Flow, MLflow integration).
Establish infrastructure standards for containerization (Docker), orchestration (AKS / ARO-OpenShift), monitoring, and MLOps/LLMOps.
Engineering Excellence & Leadership
Lead design reviews, code reviews, and CI/CD (GitHub Actions or Azure DevOps) with automated prompt tests, guardrail tests, and regression suites.
Mentor AI engineers; build internal best practices and knowledge assets.
Define SLOs/SLAs and implement proactive alerting, rate-limits, and fallbacks.
Stakeholder & Governance
Translate business requirements into technical designs with AI Product Owners and domain stakeholders.
Partner with Security, Risk, and Enterprise Architecture on standards, privacy, and Responsible AI practices (e.g., Azure Content Safety).
Required Skills & Qualifications
Education
Bachelor’s/master’s in computer science, AI/ML, Data/Software Engineering, or related field.
Experience
10+ years in software/data/ML engineering, including hands-on production delivery of AI/ML solutions.
3+ years delivering GenAI/LLM and RAG systems in production (Azure preferred).
Proven leadership of complex technical initiatives in enterprise or financial services environments.
Technical Skills (Azure-Focused)
LLMs & GenAI: Azure OpenAI (GPT, vision, embeddings), model selection, prompt engineering, function/tool calling, LLMOps (prompt versioning, evaluation, output validation).
Orchestration: Semantic Kernel, Lang Chain/LangGraph, tool routing, multi-hop workflows, MCP.
RAG & Vectors: Azure AI Search (hybrid+vector), Cosmos DB vectors/Redis/pgvector, FAISS/Qdrant (self-hosted on AKS).
Data & Ingestion: Azure Document Intelligence (Form Recognizer/OCR), Cognitive Services, Azure Data Factory/Synapse pipelines, APIs/SQL; layout-aware parsing & chunking.
MLOps: Azure ML (registries, pipelines, endpoints), MLflow, feature/model/version management, A/B and shadow deployments.
Cloud & Infra: AKS/ARO, Docker, Event Hubs (Kafka), Service Bus, Functions, API Management, Key Vault, Monitor, Log Analytics, Application Insights, Managed Identities, VNet/Private Link.
Programming: Python (advanced); experience with Transformers, Sentence Transformers, PyTorch.
Services & APIs: REST/gRPC design, auth (Entra ID/OAuth2), RBAC, multi-tenant patterns; caching and rate limiting.
Observability: Azure Monitor, Prometheus/Grafana, Langfuse or equivalent.
Industry & Governance
Experience in financial services with understanding of regulatory, model risk management, security, privacy, and auditability requirements.
