Back to all jobs
Fireworks AI logo

Member of Technical Staff

Fireworks AI
New York3d ago
Seniority
Staff

About the role

<div class="content-intro"><h2><strong>About Us:</strong></h2> <p data-start="107" data-end="729">At Fireworks, we’re building the future of generative AI infrastructure. Our platform delivers the highest-quality models with the fastest and most scalable inference in the industry. We’ve been independently benchmarked as the leader in LLM inference speed and are driving cutting-edge innovation through projects like our own function calling and multimodal models. Fireworks is a Series C company valued at $4 billion and backed by top investors including Benchmark, Sequoia, Lightspeed, Index, and Evantic. We’re an ambitious, collaborative team of builders, founded by veterans of Meta PyTorch and Google Vertex AI.</p></div><h2 class="font-claude-response-body break-words whitespace-normal"><strong>The Role:</strong></h2> <p class="font-claude-response-body break-words whitespace-normal">As a Training Infrastructure Engineer, you'll design, develop, and maintain large-scale backend and cloud-native infrastructure to support distributed machine learning training, inference, and data processing pipelines for our generative AI platform. You'll architect scalable, resilient backend infrastructure, lead technical design discussions, mentor engineers, and establish best practices for large-scale machine learning systems.</p> <h2 class="font-claude-response-body break-words whitespace-normal"><strong>Key Responsibilities:</strong></h2> <ul class="[li_&amp;]:mb-0 [li_&amp;]:mt-1 [li_&amp;]:gap-1 [&amp;:not(:last-child)_ul]:pb-1 [&amp;:not(:last-child)_ol]:pb-1 list-disc flex flex-col gap-1 pl-8 mb-3"> <li class="font-claude-response-body whitespace-normal break-words pl-2">Architect and build scalable, resilient backend infrastructure to support distributed training, inference, and data processing pipelines</li> <li class="font-claude-response-body whitespace-normal break-words pl-2">Lead technical design discussions, mentor engineers, and establish best practices for large-scale machine learning systems</li> <li class="font-claude-response-body whitespace-normal break-words pl-2">Design and implement core backend services with a focus on efficiency and low latency</li> <li class="font-claude-response-body whitespace-normal break-words pl-2">Drive infrastructure optimization initiatives for compute cost, storage lifecycle management, and network performance</li> <li class="font-claude-response-body whitespace-normal break-words pl-2">Collaborate with machine learning, DevOps, and product teams to translate research and product requirements into robust infrastructure solutions</li> <li class="font-claude-response-body whitespace-normal break-words pl-2">Evaluate and integrate cloud-native and open-source technologies such as Kubernetes, Ray, Kubeflow, and MLFlow to enhance platform reliability</li> <li class="font-claude-response-body whitespace-normal break-words pl-2">Own end-to-end systems from design to deployment, emphasizing reliability, fault tolerance, and operational excellence</li> </ul> <h2 class="font-claude-response-body break-words whitespace-normal"><strong>Minimum Qualifications:</strong></h2> <ul class="[li_&amp;]:mb-0 [li_&amp;]:mt-1 [li_&amp;]:gap-1 [&amp;:not(:last-child)_ul]:pb-1 [&amp;:not(:last-child)_ol]:pb-1 list-disc flex flex-col gap-1 pl-8 mb-3"> <li class="font-claude-response-body whitespace-normal break-words pl-2">Bachelor's degree or equivalent in Computer Science or related field plus four (4) years of experience in software engineering or related role</li> <li class="font-claude-response-body whitespace-normal break-words pl-2">4 years of experience designing, building, and optimizing large-scale backend infrastructure and distributed data systems (e.g., PostgreSQL, MySQL, DynamoDB, Apache Spark, Apache Flink, Apache Kafka) in cloud environments (AWS, GCP, Azure, or equivalent), including cloud-native platforms, core infrastructure components, and optimization techniques (caching, indexing, sharding, replication, transactions, ACID)</li> <li class="font-claude-response-body whitespace-normal break-words pl-2">4 years of experience with major server-side programming languages and frameworks (e.g., Python, C++, Go, TypeScript)</li> <li class="font-claude-response-body whitespace-normal break-words pl-2">4 years of experience writing technical design documentation, leading cross-functional projects, and collaborating with cross-functional teams to achieve business impact</li> <li class="font-claude-response-body whitespace-normal break-words pl-2">3 years of experience developing and maintaining data processing and API systems, including client-server communication frameworks (e.g., gRPC, Thrift)</li> <li class="font-claude-response-body whitespace-normal break-words pl-2">3 years of experience conducting A/B testing and scientific experimentation (e.g., Statsig, Meta Deltoid, Optimizely) to measure software impact</li> <li class="font-claude-response-body whitespace-normal break-words pl-2">3 years of experience conducting coding interviews and providing systematic feedback for engineering candidates</li> <li class="font-claude-response-body whitespace-normal break-words pl-2">2 years of experience with cloud-native tools and infrastructure, such as Docker and Kubernetes</li> <li class="font-claude-response-body whitespace-normal break-words pl-2">2 years of experience defining and implementing data-driven metrics to support company or team goals</li> </ul> <p class="font-claude-response-body break-words whitespace-normal"><strong>How to Apply:</strong> Submit resume and apply online at <a class="underline underline underline-offset-2 decoration-1 decoration-current/40 hover:decoration-current focus:decoration-current" href="http://www.fireworks.ai/careers">http://www.fireworks.ai/careers</a> and search for job by title.</p> <p class="font-claude-response-body break-words whitespace-normal">Fireworks AI is an equal-opportunity employer. We celebrate diversity and are committed to creating an inclusive environment for all innovators.</p><div class="content-pay-transparency"><div class="pay-input"><div class="description"><p>Total compensation for this role also includes meaningful equity in a fast-growing startup, along with a competitive salary and comprehensive benefits package. Base salary is determined by a range of factors including individual qualifications, experience, skills, interview performance, market data, and work location. The listed salary range is intended as a guideline and may be adjusted.</p></div><div class="title">Base Pay Range (Plus Equity)</div><div class="pay-range"><span>$175,000</span><span class="divider">&mdash;</span><span>$220,000 USD</span></div></div></div><div class="content-conclusion"><h2><strong>Why Fireworks AI?</strong></h2> <ul> <li>Solve Hard Problems: Tackle challenges at the forefront of AI infrastructure, from low-latency inference to scalable model serving.</li> <li>Build What’s Next: Work with bleeding-edge technology that impacts how businesses and developers harness AI globally.</li> <li>Ownership &amp; Impact: Join a fast-growing, passionate team where your work directly shapes the future of AI—no bureaucracy, just results.</li> <li>Learn from the Best: Collaborate with world-class engineers and AI researchers who thrive on curiosity and innovation.</li> </ul> <p><em>Fireworks AI is an equal-opportunity employer. We celebrate diversity and are committed to creating an inclusive environment for all innovators.</em></p></div>

Perks & benefits

  • Equity Compensation

755,000+ hidden jobs like this

Fireworks AI and thousands of companies post here first — often days before LinkedIn or Indeed. Your first 5 applications are free; go Pro to apply without limits.

Everything Pro unlocks:

  • Unlimited applications — free stops at 5
  • Track every application in one place
  • Apply straight to the source, one click
  • Save & organize roles you love
  • Roles pulled from company boards before the big sites

Weekly

$9.99
$4.99/week

For an active search. Cancel anytime.

Most popular

Monthly

$24.99
$12.99/month

The smart pick. Save 35% vs weekly.

Lifetime

$99
$49.99once

Pay once. Every future feature, forever.