Moonfire Private Limited ATS(Application Tracking System)
Training Programs · Unpaid - with Free Training Certificate

Warning: how to apply

  • Do not email your résuméAnything sent to support@moonfiregroup.com is disqualified automatically.
  • Do not call us about openingsCandidates who call directly are disqualified.
  • Apply only hereUse this careers portal for every application.
All open roles
PAID JOB AI Prompt Engineering Full Time On-site

LLM Evaluation and Prompt QA Engineer

Nagpur, India 3–6 yrs ₹10,00,000 – ₹18,00,000 / year Posted 4d ago

Moonfire is hiring a LLM Evaluation and Prompt QA Engineer for an on-site paid role in Nagpur, India. Make sure AI features are good before users see them. You will build evaluation suites, run red-team style tests and give product teams honest, data-backed answers on quality.

What you will do

  • Design test sets and scoring methods for LLM features
  • Automate regression runs whenever prompts or models change
  • Probe for bias, unsafe output and prompt-injection weaknesses
  • Report results clearly to product and engineering

What we are looking for

  • 3 to 6 years in QA, data or ML evaluation
  • Python and test-automation skills
  • Analytical mindset and attention to detail
  • Works on site at our Nagpur office

Role details

  • Level: Mid. This is a mid-level role for engineers and specialists with solid experience.
  • Location and work mode: Nagpur, India. On-site: you will work from our Nagpur office with your team.
  • Pay: ₹10–18 LPA. Every Moonfire role and internship is paid.

How to apply

Select Apply now, upload your resume and complete the short form. Moonfire never charges candidates any fee at any stage.

Skills we're looking for

LLM Evaluation QA Python Test Automation Red Teaming Metrics Prompt Testing Data Analysis

Quick answers

Where is the LLM Evaluation and Prompt QA Engineer role based?
It is based in Nagpur, India.
Is the LLM Evaluation and Prompt QA Engineer role remote?
No. This is an on-site role, worked from the office.
What does the LLM Evaluation and Prompt QA Engineer role pay?
Pay is ₹10,00,000 – ₹18,00,000 / year. This is a paid job at Moonfire.
How much experience does the LLM Evaluation and Prompt QA Engineer role need?
Moonfire is looking for 3 to 6 years of relevant experience.
What skills does the LLM Evaluation and Prompt QA Engineer role require?
LLM Evaluation, QA, Python, Test Automation, Red Teaming, Metrics, Prompt Testing, Data Analysis.
How do I apply for the LLM Evaluation and Prompt QA Engineer role?
Select Apply now on this page, upload your resume and submit the short form. Moonfire never charges candidates any fee for a job, interview or offer. Apply only through this website.