Staff+ Software Engineer, Backend and Infra

<h1>Staff+ Software Engineer, Backend and Infra</h1> <p>Haize Labs takes AI-based applications from proof-of-concept to production. We eliminate risk and improve the reliability of LLM-based applications by <em>haizing </em>them – i.e. rigorously, proactively, and continuously fuzz-testing them.</p> <p>We are looking for a talented and experienced backend + infrastructure engineer to help build out our AI reliability platform. You will play a foundational role in designing and driving forward the core technology that puts our cutting-edge AI research in the hands of customers, empowering them to build AI applications that are trustworthy, robust, and ready for production.</p> <p>This is an opportunity to directly influence how AI applications are tested, verified, and deployed by everyone from frontier AI labs to massive enterprises across a wide range of industries.</p> <h3><strong>In this role, you will:</strong></h3> <ul> <li>Design and build scalable infrastructure and systems to orchestrate tens of thousands of LLM calls per second, powering functionality like model evaluations, red team attacks, runtime guardrails, and more</li> <li>Collaborate closely with the research team and deploy innovative new models to build industry-leading AI reliability tooling</li> <li>Interface directly with customers to understand and address their pain points, design intuitive new user workflows that streamline their journey, and guide them on the evaluation methodology Haize has pioneered</li> <li>Act as a technical leader across the organization, mentoring top talent and helping set technical direction and vision for the company</li> <li>Develop and uphold processes and best practices that reinforce the operational excellence of our team</li> </ul> <h3><strong>You may be a good fit if you:</strong></h3> <ul> <li>Have 7+ years of industry experience, including 3+ years leading large initiatives as an engineer or manager</li> <li>Have a proven track record of designing, building, and scaling complex distributed systems that solve critical business problems</li> <li>Have strong proficiency in one or more backend programming languages (e.g. Python, Go, Rust)</li> <li>Are deeply knowledgeable about modern cloud infrastructure, including technologies like Kubernetes and Terraform, and platforms like AWS, GCP, and Azure</li> <li>Have a strong understanding of relational and NoSQL databases (we use Postgres, MongoDB, and Redis, among others)</li> <li>Take a pragmatic, outcomes-focused approach to solving ambiguous technical and business problems</li> <li>Are passionate about building products and platforms that feel magical to use</li> </ul> <h3><strong>Strong candidates may also:</strong></h3> <ul> <li>Have experience doing applied AI/ML</li> <li>Have strong familiarity with security and privacy best practices</li> <li>Have built and/or operated large scale, GPU-based model training and serving infrastructure</li> <li>Have experience working on multi-datacenter, cloud-agnostic systems</li> </ul> <h3><strong>Logistics</strong></h3> <ul> <li><strong>Education requirement:</strong> Bachelor’s degree in Computer Science, Computer Engineering, relevant technical field, or equivalent practical experience.</li> <li><strong>Location policy:</strong> 6 days a week, in person, in NYC.</li> <li><strong>US visa sponsorship:</strong> If you are exceptional, we will sponsor.</li> </ul> <h3><strong>Compensation</strong></h3> <p>$200,000 – $300,000 annual salary + equity + benefits</p> <h3><strong>About us</strong></h3> <p>At Haize, we're not here to write GPT wrappers or get rich quick off the AI bubble. We're here to solve the hardest problem in AI: making it safe, reliable, and production-ready.&nbsp;</p> <p>Since our company's inception in 2024, we've amassed amazing customers including OpenAI, Anthropic, AI21, and more. We've developed best-in-class tooling for evaluation, dynamic testing, red-teaming, observability, and continuous “robustification” of AI applications. And we’re backed + advised by the founders of Cognition, Hugging Face, Weights and Biases, Nous, Etched, Okta, and Replit, as well as C-suite execs from Google, Stripe, Databricks, Robinhood, and more.</p> <p>Our core team is exceptionally well-suited to accomplish our mission. We’ve turned down opportunities like Stanford PhD programs and Y Combinator in order to pursue this goal, and we have experience doing AI research and engineering at places like Harvard, MIT, Citadel, Datadog, and McKinsey QuantumBlack (to name a few).</p> <p>We can only serve our mission with an incredibly talented and hard-working team, and we hope that includes you. Come to Haize to push yourself, learn fast, experience excellence, grow with each other, and pursue your life's work.</p>