
• Translate open-ended questions about agent quality, reliability, and production behavior into measurable success criteria, evaluation strategies, technical workstreams, architecture decisions, and delivery milestones. • Design and deliver distributed evaluation and developer-feedback workflows that connect agent traces, automated evaluations, human feedback, and production failures with scoring, regression testing, quality gates, and prioritized engineering improvements. • Built production diagnostic agents that integrate APIs, databases, notebooks, observability systems, and enterprise tooling to gather evidence, generate root-cause hypotheses, recommend actions, and support operational workflows from problem definition through production adoption. • Establish evaluation-driven engineering practices for assessing agent behavior, identifying failure modes, measuring production readiness, and converting findings into actionable improvements for engineering teams. Key areas: Agentic AI, AI evaluation, LLM reliability, developer platforms, MCP, A2A, LangGraph, OpenAI SDK, RAG, distributed systems, observability, and enterprise AI.



