evaluated behavior of GPT-6 Astra and upcoming models in Codex across agentic coding, connectors, CUA, and memory/compaction; calibrated reasoning for token efficiency. iterated toward a secure, reliable eval environment by stabilizing failure-prone runs, shortening evaluation turnaround, and safeguarding agent behavior. helped incubate an agent-driven evaluation system to accelerate R&D.

improved coding agent reliability with better context and failure analysis; explored training lower-cost subagents with multi-agent RL.

worked on early-stage LLM development behind initial Apple Intelligence launches, including Writing Tools and Reply Suggestions.

sequential recommendation and retrieval; AutoML