Staff Technical Lead for Inference & ML Performance

<p>fal is the generative media ecosystem powering the next generation of AI products. We build the infrastructure, tools, and model access that teams need to move from idea to production, and do it at scale without compromise. For developers and enterprises, fal is the foundation that makes generative media not just possible, but practical: a unified platform where high-performance inference, orchestration, and observability come together to unlock new categories of AI-native products.</p> <p>As generative media reshapes industries across a market projected to grow by hundreds of billions over the next decade, fal is becoming the ecosystem that ambitious teams build on.</p> <h3>Why this role matters</h3> <p>You’ll shape the future of fal’s inference engine and ensure our generative models achieve best-in-class performance. Your work directly impacts our ability to rapidly deliver cutting-edge creative solutions to users, from individual creators to global brands.</p> <div class="notion-selectable notion-sub_header-block" data-block-id="248230f2-245e-80c4-9432-c327160e3c29"> <div> <h3 data-content-editable-leaf="true">What you'll do</h3> </div> </div> <div class="notion-selectable notion-table-block" data-block-id="248230f2-245e-804a-9686-d93c65d94b09"> <div> <div data-content-editable-void="true"> <div class="notion-scroller horizontal"> <div class="notion-table-content"> <div class="notion-selectable notion-table-block" data-block-id="248230f2-245e-804a-9686-d93c65d94b09"> <div> <div> <div class="notion-selectable notion-table-block notion-table-tbody-selectable" data-block-id="248230f2-245e-804a-9686-d93c65d94b09"> <div> <table> <tbody> <tr class="notion-table-row"> <th> <div class="notion-table-cell"> <div class="notion-table-cell-text" data-content-editable-leaf="true">Day-to-day</div> </div> </th> <th> <div class="notion-table-cell"> <div class="notion-table-cell-text" data-content-editable-leaf="true">What success looks like</div> </div> </th> </tr> <tr class="notion-table-row"> <td> <div class="notion-table-cell"> <div class="notion-table-cell-text" data-content-editable-leaf="true"><span class="notion-enable-hover" data-token-index="0">Set technical direction.</span> Guide your team (kernels, applied performance, ML compilers, distributed inference) to build high-performance inference solutions.</div> </div> </td> <td> <div class="notion-table-cell"> <div class="notion-table-cell-text" data-content-editable-leaf="true">fal’s inference engine consistently outperforms industry benchmarks in throughput, latency, and efficiency.</div> </div> </td> </tr> <tr class="notion-table-row"> <td> <div class="notion-table-cell"> <div class="notion-table-cell-text" data-content-editable-leaf="true"><span class="notion-enable-hover" data-token-index="0">Hands-on IC leadership.</span> Personally contribute to critical inference performance enhancements and optimizations.</div> </div> </td> <td> <div class="notion-table-cell"> <div class="notion-table-cell-text" data-content-editable-leaf="true">You regularly ship code that significantly improves model serving performance.</div> </div> </td> </tr> <tr class="notion-table-row"> <td> <div class="notion-table-cell"> <div class="notion-table-cell-text" data-content-editable-leaf="true"><span class="notion-enable-hover" data-token-index="0">Collaborate closely with research &amp; applied ML teams.</span> Influence model inference strategies and deployment techniques.</div> </div> </td> <td> <div class="notion-table-cell"> <div class="notion-table-cell-text" data-content-editable-leaf="true">Seamless integration of inference innovations rapidly moves from research to production deployment.</div> </div> </td> </tr> <tr class="notion-table-row"> <td> <div class="notion-table-cell"> <div class="notion-table-cell-text" data-content-editable-leaf="true"><span class="notion-enable-hover" data-token-index="0">Drive advanced performance optimizations.</span> Implement model parallelism, kernel optimization, and compiler strategies.</div> </div> </td> <td> <div class="notion-table-cell"> <div class="notion-table-cell-text" data-content-editable-leaf="true">Performance bottlenecks are quickly identified and eliminated, dramatically enhancing inference speed and scalability.</div> </div> </td> </tr> <tr class="notion-table-row"> <td> <div class="notion-table-cell"> <div class="notion-table-cell-text" data-content-editable-leaf="true"><span class="notion-enable-hover" data-token-index="0">Mentor and scale your team.</span> Coach and expand your team of performance-focused engineers.</div> </div> </td> <td> <div class="notion-table-cell"> <div class="notion-table-cell-text" data-content-editable-leaf="true">Your team independently innovates, proactively solves complex performance challenges, and consistently levels up their skills.</div> </div> </td> </tr> </tbody> </table> </div> </div> </div> </div> </div> </div> </div> </div> </div> </div> <h3>You might be a fit if you</h3> <ul> <li>Are deeply experienced in ML performance optimization. You've optimized inference for large-scale generative models in production environments.</li> <li>Understand the full ML performance stack. From PyTorch, TensorRT, TransformerEngine, Triton to CUTLASS kernels, you’ve navigated and optimized them all.</li> <li>Know inference inside-out. Expert-level familiarity with advanced inference techniques: quantization, kernel authoring, compilation, model parallelism (TP, context/sequence parallel, expert parallel), distributed serving and profiling.</li> <li>Lead from the front. You're a respected IC who enjoys getting hands-on with the toughest problems, demonstrating excellence to inspire your team.</li> <li>Thrive in cross-functional collaboration. Comfortable interfacing closely with applied ML teams, researchers, and stakeholders.</li> </ul> <h3>Nice-to-haves</h3> <ul> <li>Experience building inference engines specifically for diffusion and generative media models</li> <li>Track record of industry-leading performance improvements (papers, open-source contributions, benchmarks)</li> <li>Leadership experience in scaling technical teams</li> </ul> <h3>What you'll get</h3> <p>One of the highest impact roles at one of the fastest growing companies (revenue is growing 40% MoM, we are 60x+ RR compared to last year, raised Series A/B/C within the last 12 months) with a world changing vision: hyperscaling human creativity.</p> <p>Sound like your calling? Share your proudest optimization breakthrough, open-source contribution, or performance milestone with us. Let's set new standards for inference performance, together.</p>