Module Lead, Data Science (LLM-as-a-judge)

Noida1mo ago

Seniority: Lead

About the role

BOLD is seeking a senior professional to implement and run Testing and Quality Assurance specifically designed for AI-driven products and Data Science workflows. In this role, you will bridge the gap between traditional software testing and modern machine learning evaluation. You have a great team management and organizational skills. You’ll have a broad mastery of capabilities, techniques, technologies and tools in the Testing and QA domains. You’ll be handling QA teams of various sizes and expertise. ABOUT THIS TEAM The Data Science department at BOLD is responsible for discovering patterns and trends in datasets to get insights, creating predictive algorithms and data models, improving the quality of data or product offerings by utilizing machine learning techniques, distributing suggestions to other teams and top management, and using data tools such as Python and SQL. The Data Science team actively collaborates with other vertical teams such as Engineering, Portals, BI, Product, Legal. Most of the projects are focused around problems that require a mix of natural language processing and machine learning. Some of the active projects are resume parsing, ranking, summary generation, data quality and scoring, content generation, job recommendations, and conversion analysis. Apart from the business initiatives, the team also explores state of the art methods and keeps them up to to date with technology. WHAT YOU’LL DO  <ul> <li>Develop and own the QA strategy for AI-driven features, focusing on model accuracy, data drift, and performance metrics (Precision, Recall, F1-score).</li> <li>Implement state-of-the-art AI tools (e.g., GitHub Copilot, or custom LLM agents) to automate test case generation, code analysis, and synthetic data creation.</li> <li>Oversee the testing of Generative AI outputs, implementing "LLM-as-a-judge" frameworks to evaluate hallucination rates, toxicity, and prompt adherence.</li> <li>Develop and own BOLD’s quality framework from product development through to production</li> <li>Should be able to drive the initiatives (both Business and QA) in his area along with needed smooth coordination across the board to ensure a timely achievement of goal.</li> <li>Take part in Requirement Analysis, Sprint planning, Bug triage meetings.</li> <li>Liaise with product, development, and infrastructure teams to collaborate on delivery of high quality, high performance, and high availability applications</li> <li>Develop quality scripts with needed coverage to ensure defect free releases.</li> <li>Manage and mentor team members to maximize output and efficiency and promote a team culture of quality and fun</li> <li>Motivate, Encourage, Guide Teams maintaining equilibrium and satisfaction level.</li> <li>Give technical/logical solutions to problems faced by the teams and remove hurdles blocking releases.</li> <li>Evaluate and suggest new tools and technologies</li> </ul> WHAT YOU’LL NEED <ul> <li>Solid understanding of the Machine Learning lifecycle (EDA, Training, Evaluation, Deployment).</li> <li>Experience using LLMs (GPT, Claude, Llama) and AI-coding assistants to accelerate the testing lifecycle.</li> <li>Experience in a high volume, high throughput web/ecommerce environment.</li> <li>Hands-on experience with UI/API automation (Selenium, Playwright, or Cypress) integrated with AI-driven healing capabilities.</li> <li>Experience with web service technology like XML, REST, SOAP</li> <li>Knowledge on any of the query language like SQL, JQL etc.</li> <li>Experience in testing complex web and mobile apps.</li> <li>Strong application architecture and technical knowledge</li> <li>Strong knowledge of web concepts, including web performance infrastructure.</li> <li>Able to play the role of a scrum master, with strong coordination skills</li> <li>Knowhow of basic UX standards, SEO/ SEM concepts and key tracking matrices</li> <li>Strong communication skills </li> </ul> EXPERIENCE-  <ul> <li>Module Lead, QA (AI/ML & Automation)- 5 years+</li> </ul>  <div class="content-conclusion">About Bold We Transform Work Lives As an established global organization, BOLD helps people find jobs. Our story is one of growth, success, and professional fulfillment. We create digital products that have empowered millions of people in 180 countries to build stronger resumes, cover letters, and CVs. The result of our work helps people interview confidently, finding the right job in less time. Our employees are experts, learners, contributors, and creatives. We Celebrate And Promote Diversity And Inclusion We value our position as an Equal Opportunity Employer. We hire based on qualifications, merit, and our business needs. We don't discriminate regarding race, color, religion, gender, pregnancy, national origin or citizenship, ancestry, age, physical or mental disability, veteran status, sexual orientation, gender identity or expression, marital status, genetic information, or any other applicable characteristic protected by law. Under San Francisco's Fair Chance Ordinance, qualified applicants with arrest and conviction records will be considered for the position.</div>

753,000+ hidden jobs like this

livecareer and thousands of companies post here first — often days before LinkedIn or Indeed. Your first 5 applications are free; go Pro to apply without limits.

Everything Pro unlocks:

Unlimited applications — free stops at 5
Track every application in one place
Apply straight to the source, one click
Save & organize roles you love
Roles pulled from company boards before the big sites

Weekly

$9.99

$4.99/week

For an active search. Cancel anytime.

Get Weekly

Monthly

$24.99

$12.99/month

The smart pick. Save 35% vs weekly.

Get Monthly

Lifetime

$99

$49.99once

Pay once. Every future feature, forever.

Get Lifetime