Math Expert (Remote)

About the job

• Role: Math Expert (Remote)
• Location: 100% Remote (Global)
• Compensation: USD 73.29 per hour

Why This Role Exists

One of our clients, a leading AI research organization, is working to improve the quality, usefulness, and reliability of general-purpose conversational AI systems. These systems are used across a wide range of professional and everyday contexts, and their effectiveness depends on clear reasoning, accuracy, and helpful explanations.

In mathematics-related use cases, AI systems must demonstrate rigorous formal reasoning, conceptual clarity, and mathematical correctness. This project focuses on evaluating and improving how models reason about mathematical problems, explanations, and proofs across both foundational and advanced areas of mathematics.

What You’ll Do

• Write and refine prompts to guide AI model behavior in mathematical contexts
• Evaluate large language model (LLM) responses to mathematics-related queries for correctness, rigor, and logical coherence
• Verify mathematical claims, derivations, and proofs using deep domain expertise
• Conduct fact-checking using authoritative public sources and mathematical knowledge
• Annotate model responses by identifying strengths, weaknesses, and factual or conceptual errors
• Assess clarity, structure, and suitability of explanations for different audience levels
• Ensure outputs align with expected conversational standards and evaluation guidelines
• Apply consistent evaluation frameworks, benchmarks, and taxonomies across tasks

Who You Are

• PhD in Mathematics or a closely related field
• Demonstrated expertise in Probability & Statistics, with experience in one or more of the following areas:
• Algebra & Number Theory
• Calculus & Analysis
• Geometry & Topology
• Discrete Mathematics, Logic & Computation
• Comfortable working with large language models and understanding real-world usage patterns
• Excellent written communication skills with the ability to explain complex concepts clearly
• Strong attention to detail and ability to identify subtle logical or conceptual issues
• Experience reviewing, editing, or evaluating technical or academic writing

Nice-to-Have Specialties

• Prior experience with RLHF, model evaluation, or data annotation
• Teaching, mentoring, or explaining mathematics to non-expert audiences
• Familiarity with structured evaluation rubrics, benchmarks, or review frameworks

What Success Looks Like

• You consistently identify inaccuracies or weak reasoning in mathematical AI outputs
• Your feedback improves rigor, correctness, and clarity of model responses
• You deliver reliable, reproducible evaluation artifacts that strengthen AI performance
• The client’s AI systems are trusted in mathematical contexts due to your rigorous evaluations