Senior Program Manager, Agentic Ai

About the role and teamThe Uber Localization Team is seeking a Senior Operations Program Manager(Multilingual GenAI PgM) to lead the evolution of our multilingual operations through Agenticworkspace using the Large Language Models (LLMs).In this role, you will designing and building the end-to-end ML strategy for the Localizationoperation team, with a focus on selecting and experimenting the best LLM model forintegrating into production workflows. You will evaluate, select, and operationalize LLMsolutions (including hybrid approaches) across high-resource languages (HRLs), low-resourcelanguages (LRLs), and low resources content types, leveraging Google Cloud Platform (GCP)services (e.g., Vertex AI, AutoML Translation, BigQuery) or any cloud providers to balancequality, scalability, latency, and cost.You will partner closely with Localization, Engineering, Product, and MLOps/LLMOps teams totranslate experimental capabilities into production-grade systems, while ensuringmeasurable impact on translation quality, turnaround time, and cost efficiencyWhat you'll doML/GenAI Strategy & EvaluationDefine model selection strategy by use case (HRL vs LRL, real-time vs offline, high-risk vs low-risk content). Run experiments (prompting, fine-tuning, RAG, glossary constraints) and translate findings into production recommendations.Select and evaluate LLM models or hybrid approaches using structured frameworks (e.g., BLEU, COMET, human eval, task success metrics).Evaluate and benchmark GCP-native models and services alongside externalvendors, making recommendations based on quality, latency, and costOperational Pipeline OwnershipDesign and operate localization pipelines and leveraging GCP services (e.g., Vertex AI for model hosting/evaluation, AutoML Translation, TLLM, Cloud Functions, BigQuery) to enable scalable, production-grade LLM workflows.Build and optimize pipelines for throughput, latency, and cost efficiency, including fallback strategies.Drive automation (scripting,