About the job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .
Position: Software Engineering Expert
Type: Contract
Compensation: $60–$90/hour
Location: Remote
Commitment: 35 hours/week
Role Responsibilities
- Design realistic, multi-step software engineering challenges to push the limits of today's best AI coding agents.
- Build reference solutions using Python with clear, verifiable answers.
- Work with AI coding assistants to identify their strengths and weaknesses in your workflow.
- Review tasks from fellow experts, providing feedback on clarity, correctness, and difficulty.
- Analyze AI agent failures to help the research team understand task challenges.
Qualifications
Must-Have
- MSc or PhD in computer science or a related STEM field, or equivalent practical experience.
- 1+ years of experience in research, research-engineering, or software engineering.
- Strong skills in Python scripting and debugging.
- Fluency with Git , IDEs, and standard software development workflows.
- Ability to work independently on open-ended problems.
Preferred
- Experience with AI coding assistants , prompt engineering, or agent workflows.
- Past experience in AI training, model evaluation, or benchmark/task authoring.
Resources & Support
- For details about the interview process and platform information, please check:
- For any help or support, reach out to:
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
Originally posted on Himalayas