About the Role

You'll own complex, time-sensitive data and evaluation programs for frontier AI labs and internal teams at HUD. This role sits at the intersection of technical program management, data operations, and vendor coordination—turning ambiguous technical asks into executable programs and ensuring the resulting data genuinely improves LLM and agent evaluation. You'll build the processes, tooling, and operating rhythms that let HUD scale reliably.

What You'll Do

• Own data and evaluation programs end-to-end, from scoping and requirements gathering through production, QA, delivery, and retrospective.
• Translate ambiguous requests from AI labs and internal teams into clear specifications with defined milestones, owners, dependencies, and acceptance criteria.
• Maintain and improve data quality procedures using quantitative signals and qualitative inspection, including analysis of task coverage, difficulty, and reward distributions.
• Manage external vendors throughout the delivery lifecycle and improve delivery pipelines at scale.
• Streamline logistics behind data production by improving workflows, documentation, automation, and cross-functional handoffs.
• Partner with research, platform, and marketplace teams to translate learnings into product improvements.

What We're Looking For

• Experience owning complex technical programs in AI/ML, data operations, support engineering, applied research, or similarly cross-functional environments.
• Strong quantitative and qualitative judgment about data—ability to move between aggregate metrics and individual examples to assess dataset quality and representativeness.
• Experience maintaining and improving complex processes, especially in project delivery or data contexts.
• Demonstrated ability to bring structure to ambiguous problems, maintain momentum through changing requirements, and make sound tradeoffs without perfect specifications.
• Strong written and verbal communication skills; ability to turn messy technical information into clear decisions and next steps.
• Experience with RLHF, reinforcement-learning environments, agent evaluations, human-in-the-loop data pipelines, or expert data collection.
• Background supporting frontier AI labs, technical enterprise customers, or research teams with urgent, evolving requirements.
• Early-stage startup experience and comfort working independently in fast-paced environments.

Compensation & Benefits

Competitive compensation, 100% covered medical, dental, and vision insurance, lunch and dinner in-office, company-wide holiday break (Christmas Eve through New Year's Day) on top of PTO, Equinox membership, 401k, commuter benefits, and unlimited access to AI tools including ChatGPT, Claude, and Cursor.

Location

Offices in San Francisco or Singapore with openness to remote candidates who can maintain 70–80% time zone overlap with either location. Visa sponsorship and relocation support provided for strong full-time candidates to the US or Singapore.