[Hiring] Software Engineer (Code QA) @24-MAG
Role Description We are sharing a specialised part-time consulting opportunity for software engineers with strong coding, debugging, technical writing, and code review skills. This role supports high-impact research collaborations with leading AI laboratories focused on improving advanced AI systems through evaluation datasets that assess reasoning quality, explanation quality, and technical judgment in coding-related interactions. Selected professionals will help craft realistic developer prompts, create authentic code-related evaluation scenarios, write high-quality technical responses, and contribute to improving how next-generation AI systems reason through software engineering questions.
Key Responsibilities
- Prompt & Scenario Development
- Craft realistic developer prompts across multiple categories such as code review, debugging, error diagnosis, configuration, and related engineering tasks.
- Source and adapt content from real pull requests to create authentic coding scenarios.
- Structure prompts with all necessary context inline, including code snippets, logs, error messages, or requirements.
- Technical Response Writing
- Write clear, technically accurate model responses that demonstrate strong reasoning and explanation quality.
- Contribute to evaluation materials designed to assess natural-language reasoning rather than only executable correctness.
- Help create high-quality question-and-answer datasets for coding-related interactions.
- Engineering Quality & Review
- Apply software engineering judgment across debugging, testing, and code validation contexts.
- Support quality and realism in technical scenarios used for AI evaluation.
- Help ensure prompts and responses reflect real-world developer workflows and standards.
Qualifications
- 2+ years of experience in software engineering, technical research, or educational content development.
- Bachelor's degree or higher in Software Engineering, Computer Science, or a related field.
- Strong proficiency in languages such as Python, JavaScript, Java, or C++.
- Experience with debugging, testing, and validating code.
- Strong technical writing ability and attention to detail.
- Ability to communicate software reasoning clearly and accurately.
Preferred Qualifications
- Advanced degree in Software Engineering, Computer Science, or a related field.
- Experience reviewing code or creating technically rigorous engineering content.
- Familiarity with real-world developer workflows such as pull requests, debugging, and issue analysis.
- Comfort working in structured, research-oriented technical environments.
- Ability to produce high-quality outputs in flexible, remote, project-based settings.
Benefits
- Contribute to cutting-edge AI research focused on software reasoning and technical judgment.
- Apply real-world engineering expertise to high-impact evaluation dataset development.
- Help improve how advanced AI systems respond to realistic coding and debugging questions.
- Flexible remote work with competitive compensation.
Contract Details
- Independent contractor role.
- Fully remote with flexible scheduling.
- Compensation range of $70–$120 per hour.
- Typical commitment of 15–25 hours per week, with flexibility up to 40 hours per week.
- Project duration of approximately 1–2 months.
- Weekly payments via Stripe or Wise.
- Projects may be extended, shortened, or concluded early depending on project needs and performance.
- Work will not involve access to confidential or proprietary information from any employer, client, or institution.
- Please note: We are unable to support H1-B or STEM OPT candidates at this time.
- Start date: Immediate.
- Location requirements: United Kingdom, United States, Canada, Australia, New Zealand, Austria, Belgium, France, Germany, Liechtenstein, Luxembourg, Monaco, Netherlands, Switzerland, Bulgaria, Czech Republic, Hungary, Moldova, Poland, Romania, or Slovakia.
About the Platform This opportunity is available through a leading AI-driven work platform that connects domain experts with frontier AI research projects. Experts contribute to improving advanced AI systems by providing specialised expertise across software engineering, technical reasoning, evaluation workflows, and domain-specific problem solving. Apply tot his job Apply To this Job