24 Mag

Remote | Software Engineer (AI Model Trajectory Annotation) — Up to $130/hr

  • 24 Mag

Job Description

We are sharing a specialised part-time consulting opportunity for experienced front-end software engineers interested in contributing to frontier AI research. This role supports high-impact collaborations with leading AI labs focused on improving how advanced AI systems perform real-world client-side web development tasks.

Experts will help build high-quality training datasets by designing coding tasks and evaluation rubrics related to modern front-end development workflows. These datasets help AI models better understand user interface behavior, application interactivity, and client-side architecture.

Key Responsibilities

Design realistic prompts for client-side web applications, games, tools, or simulations
Create structured evaluation rubrics that measure frontend implementation quality
Ensure rubric items are binary (pass/fail) and verifiable through code and screenshots
Develop evaluation criteria covering UI correct

We are sharing a specialised part-time consulting opportunity for experienced software engineers interested in contributing to frontier AI research. This role supports high-impact collaborations with leading AI labs focused on improving how advanced AI systems reason about real-world coding tasks.

Experts will contribute to building high-quality training datasets by reviewing and annotating software engineering problem-solving trajectories derived from real open-source repositories. These annotations help improve AI models reasoning, debugging capabilities, and technical decision-making processes.

Key Responsibilities

Review model-generated code trajectories based on real software engineering tasks
Reconstruct step-by-step reasoning explaining how a solution evolves
Annotate debugging logic, decision points, and technical problem-solving strategies
Use full task context (codebase, issues, test cases) to infer plausible reasoning steps
Ensure annotations reflect realistic developer thinking and technical accuracy
Maintain consistency and clarity across structured reasoning annotations

Ideal Profile

Strong candidates may have:

2+ years of professional software engineering experience
Hands-on experience debugging and solving issues in real codebases
Strong proficiency in programming languages such as:

  • Python
  • JavaScript / TypeScript
  • or other common open-source languages

Additional qualities include:

Familiarity with version control workflows (Git, pull requests, issue tracking)
Ability to explain technical reasoning clearly in written form
Strong analytical thinking and structured problem-solving skills

Project Timeline

Start Date: Immediate
Duration: 1–2 months
Commitment:

  • Part-time (15–25 hours per week)
  • Optional scaling up to ~40 hours/week depending on availability

Location Requirements

Candidates should be based in one of the following regions:

United States, Canada, United Kingdom, Austria, Belgium, France, Germany, Liechtenstein, Luxembourg, Monaco, Netherlands, Switzerland, Bulgaria, Czech Republic, Hungary, Moldova, Poland, Romania, or Slovakia.

Why This Opportunity

Contribute directly to cutting-edge AI research
Help improve AI models reasoning on real-world coding tasks
Work with datasets derived from real open-source repositories
Flexible remote work with competitive compensation

Contract Details

Independent contractor role
Fully remote with flexible scheduling
Compensation ranges up to $70–$130/hr depending on expertise and project scope
Weekly payments via Stripe or Wise
Projects may extend depending on performance and project needs

About the Platform

This opportunity is available through a leading AI-driven work platform.