Back to all jobs
F
Senior Applied AI Engineer
Function Health
CanadaRemote1w ago
- Employment
- Full-time
- Seniority
- Senior
About the role
Company Overview:
Role:
Impact You'll Drive:
- Put a concierge doctor in every member's pocket: an agent that reasons over a lifetime of labs, imaging, and wearable signals and tells them what to do next.
- Turn our longitudinal health dataset into decisions, not dashboards, so members act on their health rather than just view it.
- Make health AI that people trust with their lives: every recommendation earns its way past evaluation gates and clinician review before it reaches a member.
- Catch what a once-a-year physical misses, surfacing the early signal across 160+ biomarkers before it becomes a diagnosis.
Key Responsibilities:
- Architect and build stateful, graph-based agent workflows with tool use, planning, and memory.
- Integrate LLMs and multimodal models via structured I/O (JSON Schema, Pydantic validators) and function/tool calling.
- Build high-reliability APIs and streaming services for real-time inference, speech, and vision.
- Own production readiness: tracing, logging, metrics, rate limiting, circuit breakers, and SLOs
- Stand up eval pipelines: offline golden sets, LLM-as-judge with human rubrics, online A/B, and regression tests in CI.
- Implement retrieval and memory: hybrid search, vector and graph retrieval, semantic caches, and long-horizon context.
- Optimize cost/latency: model routing, prompt and tool selection, quantization, and KV cache/prefill strategies.
- Partner cross-functionally to translate research into robust production systems and iterate quickly behind evaluation gates.
- Mentor engineers through design docs and architecture decisions.
Qualifications/Skills:
- 1+ years building agentic AI systems; 6+ years as a full-stack or ML engineer, building production backends or ML systems in Python, Go, or similar.
- Fluency with agentic orchestration (e.g., LangGraph, PydanticAI, DSPy, LlamaIndex) and tool/function calling.
- Experience integrating frontier LLMs and multimodal models via managed APIs or self-hosted serving.
- Strong with API design and backend frameworks (FastAPI, Flask) and event-driven architectures.
- Data systems expertise with PostgreSQL, including token streaming and throughput tuning.
- Retrieval and memory: vector databases (pgvector, Pinecone, Weaviate, Milvus), hybrid search, and graph/knowledge storage.
- Production evals: LLM-as-judge, human-in-the-loop, rubric design, and CI-integrated regression tests.
- Observability and SRE: OpenTelemetry traces, metrics, structured logs, SLOs, dashboards, and on-call triage.
- Cloud-native delivery: Kubernetes, Terraform, Docker, GPU scheduling/autoscaling on AWS or GCP.
- CI/CD proficiency with GitHub Actions and test automation for prompts, tools, and agents.
- Clear, concise communication and high ownership in fast-paced environments.
Nice to Haves:
- Real-time multimodal systems: streaming ASR, low-latency TTS, WebRTC, and vision pipelines.
- RAG expertise beyond basics: Graph RAG, multi-hop retrieval, sub-agents, query planning, and freshness policies.
- Safety and governance: policy-as-code, red-teaming, PII handling, audit logs, and role-based tool authorization.
- Regulated data experience (HIPAA, SOC 2, GDPR) and data residency controls.
- Personalization at inference time, long-term memory agents, session state, and episodic memory stores.
- Experience with consumer-scale AI apps, high-traffic systems, or on-device/edge acceleration (WebGPU).
To be a strong fit, you also need:
- Ruthless Prioritization:
- We don’t let perfect get in the way of progress.
- We move quickly to drive value, not perfection.
- We prioritize what drives impact.
- We never compromise on standards of excellence.
- Member-First, Always:
- We design and deliver like we’re caring for someone we love.
- We create calendar, actionable, human experience.
- We prioritize responsiveness, peace of mind, and outcomes.
- We empower members with truth, clarity, and care.
- One Team, Moving Fast:
- We are aligned in purpose, prioritization, and speed.
- We gather diverse perspectives to make informed decisions.
- We clear paths for each other and move fast together.
- We communicate clearly and respectfully, rallying around shared goals.
- Radical Ownership, Relentless Execution:
- We don’t just ship– we own outcomes and drive results.
- We act with urgency and precision
- We anticipate, initiate, and follow through.
- We meet challenges with grit and pragmatism.
- We embrace new tech to deliver better outcomes.
- Mission Over Ego:
- We are ruthlessly aligned to our mission - and leave ego at the door.
- We disagree and commit.
- We don't tolerate politics or withholding information.
- We operate with honesty, transparency, and respect.
- Sustained Integrity in Every Detail:
- We earn trust by obsessing over accuracy, quality, and clarity in everything we do.
- We prioritize clinical precision - data must be right.
- We sweat the details because outcomes depend on them.
Why You'll Love Working With Us:
764,000+ hidden jobs like this
Function Health and thousands of companies post here first — often days before LinkedIn or Indeed. Your first 5 applications are free; go Pro to apply without limits.
Everything Pro unlocks:
- Unlimited applications — free stops at 5
- Track every application in one place
- Apply straight to the source, one click
- Save & organize roles you love
- Roles pulled from company boards before the big sites