hero
Glynn Capital
55
companies
1,980
Jobs

Code Reviewer for LLM Data Training (C Programming)

SuperAnnotate

SuperAnnotate

India
Posted on May 6, 2025

About the Role

We are looking for a Code Reviewer with expertise in C to join our AI training QA team. You will be responsible for auditing annotator evaluations of AI-generated responses written in C. Your role will be to ensure technical correctness, instruction adherence, proof-of-work validation, and consistent application of evaluation rubrics.

Responsibilities

  • Audit annotator evaluations of AI-generated C responses
  • Verify if responses follow prompt requirements regarding procedural structure, memory management, and correct syntax in C.
  • Evaluate C code for correctness, performance, security, and readability
  • Run and validate proof-of-work code submitted by annotators to confirm functionality
  • Review annotator-submitted Loom videos to assess evaluation and testing accuracy
  • Ensure responses align with instruction-following expectations including style, tone, and clarity
  • Identify and document errors, omissions, or rating inconsistencies
  • Provide clear, constructive QA feedback based on rubric and guideline criteria
  • Collaborate with internal teams for clarifications on complex or ambiguous items

Required Qualifications

  • 5–7+ years of experience in C development, QA, or code review
  • Strong understanding of core C concepts and development best practices
  • Experience with debugging, testing tools, and code execution environments
  • Strong analytical and critical thinking skills
  • Excellent written communication for documenting evaluations and feedback
  • English proficiency at B2, C1, C2, or Native level

Preferred Qualifications

  • Experience with AI/LLM workflows, human-in-the-loop QA, or model evaluation
  • Familiarity with structured code evaluation processes and rubrics
  • Experience using QA/annotation platforms such as SuperAnnotate

Why Join Us

Join a forward-thinking team shaping how AI learns to understand and write C code. Your expertise will directly influence the quality, reliability, and instructional value of AI-generated content. This is a fully remote role offering flexible hours, milestone-based structure, and competitive compensation.