QA Specialist – AI Chatbot Response Evaluations - Remoto

Role Overview:

We are looking for a QA Specialist with strong Kotlin expertise to audit Data Annotator evaluations of AI-generated Kotlin code responses. You will verify instruction-following, code correctness, and proof-of-work testing. This role requires a strong eye for detail and a deep understanding of Kotlin best practices in mobile and backend development contexts.

Responsibilities:

• Review and audit evaluations of AI-generated Kotlin code provided by annotators.
• Validate that annotators correctly apply rubrics for instruction-following and code accuracy.
• Test Kotlin code snippets and verify the functionality, readability, and correctness of annotator-submitted proof-of-work.
• Identify logical flaws, missed requirements, or misjudged evaluations.
• Provide clear, actionable feedback to annotators to improve quality and consistency.
• Collaborate with QA leads and contribute to refining evaluation guidelines.

Required Qualifications:

• 5–7+ years of professional experience with Kotlin in software development, QA, or code review roles.
• Deep understanding of Kotlin syntax, type system, OOP principles, and Android or backend application design.
• Experience validating code functionality, testing logic, and refactoring.
• Familiarity with Kotlin testing tools, IDEs (e.g., IntelliJ), and modern development workflows.
• Excellent analytical and written communication skills.
• English proficiency at B2, C1, C2, or Native level.

Preferred Qualifications:

• Experience working with annotation QA, LLM-generated content, or RLHF pipelines.
• Familiarity with Android architecture patterns, coroutines, or Kotlin multiplatform projects.
• Ability to provide constructive feedback in ambiguous or edge-case coding tasks.

Contract Type: Freelance/Contract/Part-Time

Why Join Us?

Become part of an innovative team at the forefront of AI technology. Your QA expertise will play an essential role in creating accurate, reliable, and safe AI solutions.Fully remote with flexible hours and milestone-based structure. Competitive compensation based on project deliverables.

If you are an experienced QA specialist or code reviewer with strong skills and a keen eye for detail in evaluating AI-generated content, we encourage you to apply.

#Kotlin #QA #CodeReview #AI #LLM #AndroidDevelopment #RemoteJobs #TechHiring #Freelance

APPLY HERE: https://docs.google.com/forms/d/e/1FAIpQLScco9QSY5fZDwrapWRRQM8DgF3poyfLYcgGgwAJyjAeCVGRzg/viewform?pli=1