Back to all jobs

About the role
<div class="content-intro"><p>Our mission is to transform how people and machines work together to push the boundaries of human productivity. A leader in Industrial AI, Augury helps the world’s manufacturers leverage real-time production insights to drive new levels of efficiency. Combining predictive and prescriptive AI technology with industry expertise, production teams can proactively address alerts, minimize downtime, reduce asset costs, and maximize yield and capacity. Our customers achieve payback in six months or less, enabling global scale. We're looking for team members excited to partner with the world's manufacturers and build the future of production together.</p></div><p><span style="font-size: 12pt;">You are a Senior AI Software Engineer looking to join a GenAI Infrastructure team and build production-grade GenAI capabilities and the infrastructure behind them. You will be a hands-on engineer focused on AI agents, RAG pipelines, tool-calling workflows, backend services, data access layers, evaluation, observability, and reusable GenAI infrastructure used across product teams. You will not be focused solely on model research or prompt design. Instead, you will be a strong software engineer who can design, build, ship, and operate reliable AI-powered systems in production.</span></p>
<p><span style="font-size: 12pt;"><strong>A Day In Your Life </strong></span></p>
<ul>
<li style="font-size: 12pt;"><span style="font-size: 12pt;">Build reusable infrastructure, SDKs, and internal frameworks for AI-powered product capabilities.</span></li>
<li style="font-size: 12pt;"><span style="font-size: 12pt;">Design and implement AI agents, RAG flows, tool-calling workflows, and LLM orchestration pipelines.</span></li>
<li style="font-size: 12pt;"><span style="font-size: 12pt;">Build production-grade GenAI services, APIs, and backend infrastructure.</span></li>
<li style="font-size: 12pt;"><span style="font-size: 12pt;">Integrate LLM workflows with internal microservices, data platforms, vector search, and event-driven systems.</span></li>
<li style="font-size: 12pt;"><span style="font-size: 12pt;">Design secure data-access patterns that enforce authorization, tenant separation, and user-level scope.</span></li>
<li style="font-size: 12pt;"><span style="font-size: 12pt;">Implement evaluation, tracing, monitoring, and quality-control mechanisms for GenAI systems.</span></li>
<li style="font-size: 12pt;"><span style="font-size: 12pt;">Improve latency, reliability, fallback behavior, cost efficiency, and production readiness.</span></li>
<li style="font-size: 12pt;"><span style="font-size: 12pt;">Work on customer-facing AI experiences, including conversational and proactive agentic product flows.</span></li>
<li style="font-size: 12pt;"><span style="font-size: 12pt;">Collaborate with backend engineers, product managers, data engineers, AI/ML engineers, and domain experts.</span></li>
</ul>
<p><span style="font-size: 12pt;"><strong>You Will Bring</strong></span></p>
<ul>
<li style="font-size: 12pt;"><span style="font-size: 12pt;">6+ years of professional software engineering experience.</span></li>
<li style="font-size: 12pt;"><span style="font-size: 12pt;">Strong Python development skills.</span></li>
<li style="font-size: 12pt;"><span style="font-size: 12pt;">Strong backend engineering background, including APIs, services, integrations, or microservices.</span></li>
<li style="font-size: 12pt;"><span style="font-size: 12pt;">Proven experience designing, shipping, or operating LLM-powered applications or GenAI systems.</span></li>
<li style="font-size: 12pt;"><span style="font-size: 12pt;">Experience with RAG, AI agents, tool/function calling, prompt orchestration, evaluation, and observability.</span></li>
<li style="font-size: 12pt;"><span style="font-size: 12pt;">Experience with microservices, distributed systems, and production backend architecture.</span></li>
<li style="font-size: 12pt;"><span style="font-size: 12pt;">Strong understanding of system design, reliability, security, scalability, latency, and maintainability.</span></li>
<li style="font-size: 12pt;"><span style="font-size: 12pt;">Ability to work with complex data models and expose them safely through AI systems.</span></li>
<li style="font-size: 12pt;"><span style="font-size: 12pt;">Ability to operate in ambiguous technical areas and turn prototypes into production-ready systems.</span></li>
<li style="font-size: 12pt;"><span style="font-size: 12pt;">Strong communication skills and ability to explain technical decisions clearly.</span></li>
</ul>
<p><span style="font-size: 12pt;"><strong>Preferred Qualifications</strong></span></p>
<ul>
<li style="font-size: 12pt;"><span style="font-size: 12pt;">Experience with LangChain, LangGraph, or LangSmith.</span></li>
<li style="font-size: 12pt;"><span style="font-size: 12pt;">Experience with Go, MongoDB, Databricks, Kubernetes, Docker, REST APIs, vector search, or event-driven systems.</span></li>
<li style="font-size: 12pt;"><span style="font-size: 12pt;">Experience with Azure OpenAI, Gemini, or similar LLM platforms.</span></li>
<li style="font-size: 12pt;"><span style="font-size: 12pt;">Experience building or using knowledge graphs, GraphRAG, or graph databases such as Neo4j.</span></li>
<li style="font-size: 12pt;"><span style="font-size: 12pt;">Experience building multi-agent systems or orchestrating multiple specialized agents/tools in production.</span></li>
<li style="font-size: 12pt;"><span style="font-size: 12pt;">Experience building internal platforms, SDKs, developer tools, or shared engineering infrastructure.</span></li>
<li style="font-size: 12pt;"><span style="font-size: 12pt;">Experience with authorization, data segregation, multi-tenant systems, or user-level data scoping.</span></li>
<li style="font-size: 12pt;"><span style="font-size: 12pt;">Experience in industrial, IoT, predictive maintenance, manufacturing, or operational-data domains.</span></li>
</ul>
<p><span style="font-size: 12pt;"><strong>What Success Looks Like</strong></span></p>
<ul>
<li style="font-size: 12pt;"><span style="font-size: 12pt;">You build reusable infrastructure that accelerates GenAI development across teams.</span></li>
<li style="font-size: 12pt;"><span style="font-size: 12pt;">You ship reliable GenAI capabilities that run in production.</span></li>
<li style="font-size: 12pt;"><span style="font-size: 12pt;">You improve how AI agents retrieve data, call tools, enforce permissions, and generate grounded responses.</span></li>
<li style="font-size: 12pt;"><span style="font-size: 12pt;">You contribute to practical standards around GenAI architecture, evaluation, monitoring, security, and deployment.</span></li>
</ul>
<p><span style="font-size: 12pt;"><strong>Perks</strong></span></p>
<ul>
<li style="font-size: 12pt;"><span style="font-size: 12pt;">Stock options</span></li>
<li style="font-size: 12pt;"><span style="font-size: 12pt;">Paid parental leave</span></li>
<li style="font-size: 12pt;"><span style="font-size: 12pt;">Flex PTO</span></li>
</ul><div class="content-conclusion"><p>Augury is a people-first organization. We believe in fostering an inclusive environment in which employees feel encouraged to share their unique perspectives, leverage their strengths, and act authentically. We know that diverse teams are strong teams, and we welcome those from all backgrounds and varying experiences. We are committed to providing employees with a work environment free of discrimination and harassment. We believe that diversity is more than just good intentions, and we are committed to creating an inclusive environment for all employees.</p>
<p>Augury is a proud equal opportunity employer, we strive to create a work environment in which everyone, all applicants, employees, customers, guests, and vendors feel safe and comfortable. We commit to maintain a workplace that is free of any type of harassment and does not tolerate anyone intimidating, humiliating, or hurting others. We prohibit willful discrimination based on age, gender, ethnicity, race, color, religion, political opinions, sexual orientation, sexual identity or expression, military or veteran status, disability or any other characteristic protected by law.</p></div>
Perks & benefits
- Paid Time Off
- Equity Compensation
741,000+ hidden jobs like this
Augury and thousands of companies post here first — often days before LinkedIn or Indeed. Your first 5 applications are free; go Pro to apply without limits.
Everything Pro unlocks:
- Unlimited applications — free stops at 5
- Track every application in one place
- Apply straight to the source, one click
- Save & organize roles you love
- Roles pulled from company boards before the big sites