Senior-Staff Data Scientist (LLM)

<p><span style="font-size: 12pt; font-family: helvetica, arial, sans-serif;"><strong>Who is our client?</strong></span></p> <p><span style="font-size: 12pt; font-family: helvetica, arial, sans-serif;">Our client is a large-scale technology organization with a strong focus on engineering, data, and AI. They are continuing to invest in AI/ML platform capabilities that enable teams to build, operate, and scale machine learning and intelligent applications more effectively.</span></p> <p>&nbsp;</p> <p><span style="font-family: helvetica, arial, sans-serif; font-size: 12pt;"><strong>About the Role</strong></span></p> <p><span style="font-size: 12pt; font-family: helvetica, arial, sans-serif;">This role is for a senior individual contributor who will lead the design and improvement of LLM-powered solutions in a production environment. You will work on complex user-facing AI systems, drive experimentation and model improvement, and collaborate closely with cross-functional teams to turn ambiguous problems into practical, scalable solutions.</span></p> <p><span style="font-family: helvetica, arial, sans-serif; font-size: 12pt;">*Relocation sponsorship is provided</span></p> <h1><span style="font-size: 12pt; font-family: helvetica, arial, sans-serif;">Responsibilities</span></h1> <ul> <li style="font-size: 12pt; font-family: helvetica, arial, sans-serif;"><span style="font-size: 12pt; font-family: helvetica, arial, sans-serif;">Lead the development and enhancement of LLM-based solutions for complex, real-world use cases</span></li> <li style="font-size: 12pt; font-family: helvetica, arial, sans-serif;"><span style="font-size: 12pt; font-family: helvetica, arial, sans-serif;">Translate open-ended product or user problems into clear data science approaches, experiments, and deliverable outcomes</span></li> <li style="font-size: 12pt; font-family: helvetica, arial, sans-serif;"><span style="font-size: 12pt; font-family: helvetica, arial, sans-serif;">Design, test, and refine prompts, retrieval strategies, evaluation frameworks, and model behaviors to improve quality and reliability</span></li> <li style="font-size: 12pt; font-family: helvetica, arial, sans-serif;"><span style="font-size: 12pt; font-family: helvetica, arial, sans-serif;">Build robust experimentation methods to assess model performance and compare alternative approaches</span></li> <li style="font-size: 12pt; font-family: helvetica, arial, sans-serif;"><span style="font-size: 12pt; font-family: helvetica, arial, sans-serif;">Work closely with product, engineering, analytics, and other technical teams to define priorities and drive implementation</span></li> <li style="font-size: 12pt; font-family: helvetica, arial, sans-serif;"><span style="font-size: 12pt; font-family: helvetica, arial, sans-serif;">Take ownership of solution quality across the lifecycle, from early exploration through deployment and iteration</span></li> <li style="font-size: 12pt; font-family: helvetica, arial, sans-serif;"><span style="font-size: 12pt; font-family: helvetica, arial, sans-serif;">Use data-driven methods to identify opportunities for model improvement, user impact, and system optimization</span></li> <li style="font-size: 12pt; font-family: helvetica, arial, sans-serif;"><span style="font-size: 12pt; font-family: helvetica, arial, sans-serif;">Contribute to the design of scalable AI workflows, including evaluation pipelines, monitoring approaches, and feedback loops</span></li> <li style="font-size: 12pt; font-family: helvetica, arial, sans-serif;"><span style="font-size: 12pt; font-family: helvetica, arial, sans-serif;">Help define best practices for production-grade LLM development, experimentation, and operational performance</span></li> <li style="font-size: 12pt; font-family: helvetica, arial, sans-serif;"><span style="font-size: 12pt; font-family: helvetica, arial, sans-serif;">Communicate findings, trade-offs, and recommendations clearly to both technical and non-technical stakeholders</span></li> <li style="font-size: 12pt; font-family: helvetica, arial, sans-serif;"><span style="font-size: 12pt; font-family: helvetica, arial, sans-serif;">Support strategic decisions on model quality, scalability, performance, and long-term maintainability</span></li> <li style="font-size: 12pt; font-family: helvetica, arial, sans-serif;"><span style="font-size: 12pt; font-family: helvetica, arial, sans-serif;">Provide senior-level guidance in solving ambiguous AI problems with practical and measurable outcomes</span></li> </ul> <h1><span style="font-size: 12pt; font-family: helvetica, arial, sans-serif;">Qualifications</span></h1> <ul> <li style="font-size: 12pt; font-family: helvetica, arial, sans-serif;"><span style="font-size: 12pt; font-family: helvetica, arial, sans-serif;">Proven experience in a Senior Data Scientist, Applied Scientist, ML Engineer, or similar role, with strong ownership of end-to-end ML or LLM initiatives</span></li> <li style="font-size: 12pt; font-family: helvetica, arial, sans-serif;"><span style="font-size: 12pt; font-family: helvetica, arial, sans-serif;">Strong hands-on experience with LLMs in production settings, including experimentation, evaluation, iteration, and quality improvement</span></li> <li style="font-size: 12pt; font-family: helvetica, arial, sans-serif;"><span style="font-size: 12pt; font-family: helvetica, arial, sans-serif;">Solid background in machine learning, statistics, and data science fundamentals</span></li> <li style="font-size: 12pt; font-family: helvetica, arial, sans-serif;"><span style="font-size: 12pt; font-family: helvetica, arial, sans-serif;">Experience applying quantitative methods to solve complex product or system problems at scale</span></li> <li style="font-size: 12pt; font-family: helvetica, arial, sans-serif;"><span style="font-size: 12pt; font-family: helvetica, arial, sans-serif;">Strong coding ability and practical experience working closely with software engineering teams in production environments</span></li> <li style="font-size: 12pt; font-family: helvetica, arial, sans-serif;"><span style="font-size: 12pt; font-family: helvetica, arial, sans-serif;">Experience building or improving systems that involve prompt design, retrieval, ranking, response quality assessment, or model evaluation</span></li> <li style="font-size: 12pt; font-family: helvetica, arial, sans-serif;"><span style="font-size: 12pt; font-family: helvetica, arial, sans-serif;">Strong understanding of experimentation design, success metrics, offline and online evaluation, and performance analysis</span></li> <li style="font-size: 12pt; font-family: helvetica, arial, sans-serif;"><span style="font-size: 12pt; font-family: helvetica, arial, sans-serif;">Comfortable working with ambiguity and shaping loosely defined problems into structured analytical approaches</span></li> <li style="font-size: 12pt; font-family: helvetica, arial, sans-serif;"><span style="font-size: 12pt; font-family: helvetica, arial, sans-serif;">Able to communicate complex technical ideas clearly and influence cross-functional stakeholders</span></li> <li style="font-size: 12pt; font-family: helvetica, arial, sans-serif;"><span style="font-size: 12pt; font-family: helvetica, arial, sans-serif;">Experience operating in fast-paced, product-driven environments with high expectations for quality and execution</span></li> <li style="font-size: 12pt; font-family: helvetica, arial, sans-serif;"><span style="font-size: 12pt; font-family: helvetica, arial, sans-serif;">Advanced degree in a relevant field such as Computer Science, Machine Learning, Statistics, Mathematics, Engineering, or a related quantitative discipline is preferred</span></li> </ul>