Principal AI Architect - M365 IC3 Team (Intelligent Conversation and Communications Cloud)

Overview We are looking for a Principal AI Architect to help define, build, and scale the evaluation systems that shape the future of AI products. This role sits at the intersection of engineering, applied science, product architecture, and AI evaluation. The ideal candidate has deep technical judgment, strong systems thinking, hands-on experience evaluating LLMs, and the ability to translate emerging AI capabilities into reliable product experiences. This role is especially important for agentic AI systems, where product behavior is often nondeterministic, context-dependent, and difficult to evaluate with traditional testing alone.…