Engineering Leader

<p><span style="font-family: arial, helvetica, sans-serif; font-size: 12pt;"><strong>About TrueFoundry</strong></span><br><br>Every production AI system whether it's powering customer support, writing code, analyzing financial data, or diagnosing medical conditions needs the same foundational infrastructure.A way to route between models. A way to manage tools and integrate them securely. A way to orchestrate agents and enforce governance. A unified compute layer to run it all.</p> <p><strong>That infrastructure layer is being built right now.</strong></p> <p>We're TrueFoundry, and we're building it. We're looking for our&nbsp;<strong data-start="1102" data-end="1125">Engineering Leader!</strong></p> <h2><span style="font-family: arial, helvetica, sans-serif; font-size: 12pt;"><strong>The Problem We're Solving</strong></span></h2> <p>Companies are moving beyond simple chatbots to production agentic systems. These systems route between OpenAI, Anthropic, Google, and self-hosted models. They integrate dozens of tools via protocols like MCP. They orchestrate multi-agent workflows where agents coordinate with other agents.</p> <p>The infrastructure to support this doesn't exist yet. You can't just duct-tape together a few API calls and call it production-ready.</p> <p>You need a control plane that handles:</p> <ul> <li>Intelligent routing with observability, cost policies, and fallback logic</li> <li>Centralized tool and MCP server management with security and lifecycle controls</li> <li>Agent orchestration with governance and guardrails</li> <li>A unified compute layer to run self-hosted models, custom tools, and agents</li> </ul> <p>We've built two products to solve this:</p> <p><strong>AI Gateway</strong> is the control plane of five composable components (Prompts, LLM Gateway, MCP Gateway, Guardrails, Agent Gateway) that handle routing, orchestration, and governance.</p> <p><strong>AI Deploy</strong> is a compute layer of a Kubernetes-based platform that abstracts ML workloads as standard software primitives, so everything runs on unified infrastructure.</p> <p>We're Series A, backed by Intel Capital and Sequoia. Companies like CVS, Mastercard, Siemens, Paytm, Synopsys, and Zscaler run production AI workloads on our platform.</p> <p data-start="1082" data-end="1181">We’re looking for a <strong data-start="1102" data-end="1125">Engineering Leader</strong> to lead the Core Platform organization responsible for:</p> <ul data-start="1183" data-end="1331"> <li data-start="1183" data-end="1211"> <p data-start="1185" data-end="1211">AI Gateway (Control Plane)</p> </li> <li data-start="1212" data-end="1250"> <p data-start="1214" data-end="1250">AI Deploy (Unified Compute Platform)</p> </li> <li data-start="1251" data-end="1331"> <p data-start="1253" data-end="1331">Distributed orchestration, routing, governance, and infrastructure scalability</p> </li> </ul> <p data-start="1333" data-end="1441">This role is not about managing tickets.<br data-start="1373" data-end="1376">It’s about building the technical backbone of the agentic AI era.</p> <p data-start="1443" data-end="1581">You will work directly with the founders to shape architecture, scale engineering teams, and ensure we build a category-defining platform.</p> <p data-start="1443" data-end="1581"><strong>What You Will Own:</strong></p> <h2 data-start="1607" data-end="1656">1. Platform Architecture &amp; Technical Direction</h2> <ul data-start="1657" data-end="1953"> <li data-start="1657" data-end="1734"> <p data-start="1659" data-end="1734">Define and evolve the architecture for distributed, multi-tenant AI systems</p> </li> <li data-start="1735" data-end="1803"> <p data-start="1737" data-end="1803">Drive long-term scalability, reliability, and performance strategy</p> </li> <li data-start="1804" data-end="1877"> <p data-start="1806" data-end="1877">Ensure AI Gateway and AI Deploy evolve cohesively as a unified platform</p> </li> <li data-start="1878" data-end="1953"> <p data-start="1880" data-end="1953">Maintain high technical standards across control plane and compute layers</p> </li> </ul> <h2 data-start="1955" data-end="1985">2. Engineering Organization</h2> <ul data-start="1986" data-end="2226"> <li data-start="1986" data-end="2051"> <p data-start="1988" data-end="2051">Build and lead a high-caliber team of Staff/Principal engineers</p> </li> <li data-start="2052" data-end="2078"> <p data-start="2054" data-end="2078">Hire across US and India</p> </li> <li data-start="2079" data-end="2167"> <p data-start="2081" data-end="2167">Establish strong design review, architecture review, and incident management processes</p> </li> <li data-start="2168" data-end="2226"> <p data-start="2170" data-end="2226">Develop future technical leaders within the organization</p> </li> </ul> <h2 data-start="2228" data-end="2263">3. Execution at Startup Velocity</h2> <ul data-start="2264" data-end="2493"> <li data-start="2264" data-end="2325"> <p data-start="2266" data-end="2325">Balance long-term architecture with rapid product iteration</p> </li> <li data-start="2326" data-end="2369"> <p data-start="2328" data-end="2369">Identify and mitigate scaling risks early</p> </li> <li data-start="2370" data-end="2433"> <p data-start="2372" data-end="2433">Drive operational excellence for enterprise-grade deployments</p> </li> <li data-start="2434" data-end="2493"> <p data-start="2436" data-end="2493">Ensure high availability, resilience, and cost efficiency</p> </li> </ul> <h2 data-start="2495" data-end="2534">4. Customer &amp; Enterprise Credibility</h2> <ul data-start="2535" data-end="2725"> <li data-start="2535" data-end="2609"> <p data-start="2537" data-end="2609">Act as senior technical leadership in enterprise discussions when needed</p> </li> <li data-start="2610" data-end="2655"> <p data-start="2612" data-end="2655">Oversee escalations for complex deployments</p> </li> <li data-start="2656" data-end="2725"> <p data-start="2658" data-end="2725">Translate enterprise requirements into scalable platform primitives</p> </li> </ul> <h2 data-start="2727" data-end="2759">5. Cross-Functional Alignment</h2> <ul data-start="2760" data-end="2944"> <li data-start="2760" data-end="2825"> <p data-start="2762" data-end="2825">Partner with the CTO on roadmap prioritization and architecture</p> </li> <li data-start="2826" data-end="2877"> <p data-start="2828" data-end="2877">Work closely with Product and Outcome Engineering</p> </li> <li data-start="2878" data-end="2944"> <p data-start="2880" data-end="2944">Align infrastructure investments with long-term product strategy</p> </li> </ul> <h3><strong>Why Join TrueFoundry?</strong></h3> <ul> <li>Work directly with <strong>ex-Facebook engineers</strong> and <strong>founders from IIT Kharagpur, UC Berkeley, and Y Combinator alumni</strong>.</li> <li>First-hand exposure to building and scaling a <strong>deep-tech startup</strong>—insights you’ll carry if you want to start your own one day.</li> <li>Be part of a <strong>fearlessly experimental culture</strong> focused on customer success and long-term impact.</li> </ul> <p>Flexible hours, learning credits, and the opportunity to work <strong>shoulder-to-shoulder with the co-founders</strong> (Abhishek &amp; Nikunj).</p>