Product Manager, Evaluation

The Team

At Learning Commons, we operate at the intersection of technology, research, and philanthropy. We pair product development with grantmaking to scale proven teaching and learning practices for the benefit of every learner. We aim to bring learning science into the tools educators and students use every day.

The Opportunity

As a Product Manager on the Evaluators team, you'll own the dataset annotation and evaluator development pipeline that helps EdTech developers build better products. You'll partner with data scientists, engineers, learning scientists, and researchers to create high-quality evaluators grounded in learning science.

What You'll Do

• Own the annotation-to-evaluator pipeline: Manage the end-to-end process from identifying pedagogical constructs through dataset creation, model training, and evaluator validation; balance accuracy requirements with delivery timelines.
• Shape evaluator roadmap and prioritization: Conduct discovery with EdTech developers building literacy and content generation tools to understand which evaluators deliver the most value; provide input on prioritization based on impact, feasibility, and strategic alignment.
• Make strategic tradeoffs between accuracy and velocity: Partner with data scientists to set appropriate accuracy thresholds for different evaluator types; decide when to ship, iterate, or restart based on performance against baselines.
• Translate learning science into product specifications: Work with learning scientists to convert pedagogical frameworks for literacy instruction into clear, measurable evaluation criteria; write detailed specs that guide annotation and model development.
• Optimize and scale the annotation workflow: Identify opportunities to improve annotator efficiency, reduce ambiguity in guidelines, and increase inter-rater reliability; document learnings to enable expansion into new subject areas.

What You'll Bring

• 3-5 years of product management experience: A track record of shipping products, with direct experience working on AI/ML products, data annotation pipelines, or model evaluation workflows.
• Strong technical foundation in AI/ML: Comfort discussing annotation methodologies, model performance metrics, accuracy thresholds, inter-rater reliability, and evaluation frameworks with data scientists; ability to understand technical tradeoffs and make informed product decisions.
• Exceptional communication and storytelling skills: Ability to translate complex technical and pedagogical concepts into clear narratives for different audiences; skilled at building alignment across diverse stakeholders and making compelling cases for prioritization decisions.
• Self-directed execution mindset: Thrives in ambiguous, frontier environments where playbooks don't exist; takes initiative to identify problems, propose solutions, and drive outcomes; comfortable making decisions with incomplete information and learning through iteration.
• Customer-centric approach: Passion for understanding developer needs through direct engagement and feedback loops; commitment to building products that solve real problems; driven by mission-oriented work in education.

Compensation

The Redwood City, CA base pay range for a new hire in this role is $190,000 - $261,800. New hires are typically hired into the lower portion of the range, enabling employee growth in the range over time. Actual placement in range is based on job-related skills and experience, as evaluated throughout the interview process.

Better Together

This role is a hybrid position requiring you to be onsite for at least 60% of the working month, approximately 3 days a week, with specific in-office days determined by the team’s manager.

Benefits for the Whole You

• Provides a generous employer match on employee 401(k) contributions to support planning for the future.
• Paid time off to volunteer at an organization of your choice.
• Funding for select family-forming benefits.
• Relocation support for employees who need assistance moving.