Senior AI Graph Compiler Engineer

About Modular

About the role:

What you will do:

• Design and develop compiler optimizations to improve inference efficiency across CPUs, GPUs, and ML accelerators, including kernel fusion, memory planning, and shape optimization.
• Compile large-scale application workloads onto heterogeneous hardware: map hardware-agnostic graphs of computational operators onto hardware-specific graphs of devices and nodes.
• Collaborate with the kernels, serving, and Mojo compiler teams to implement core technologies that deliver end-to-end performance across a variety of heterogeneous hardware platforms.
• Write design documents for new features and drive for alignment on designs with cross-functional teams.
• Collaborate with the customer success team and engage with customers to understand their performance requirements and use cases.

What you bring to the table:

• 5+ years of software engineering experience.
• Proficiency in C++.
• Experience working with compilers for machine learning frameworks.
• Creativity and curiosity for solving complex problems, a team-oriented attitude that enables you to work well with others.

Helpful but not required:

• Knowledge of and experience working with MLIR and LLVM.
• Experience with ML parallel / distributed programming, heterogeneous ML computation, and/or code generation.
• Knowledge of basic ML implementation and modeling techniques and familiarity with ML frameworks like PyTorch, JAX, or TensorFlow.

What Modular brings to the table:

• Amazing Team. We are a progressive and agile team with some of the industry’s best engineering and product leaders.
• World-class Benefits. In order to attract the best, we need to offer the best. Premier insurance plans, up to 5% 401k matching, flexible paid time off, and more are available to you! Please note that specific benefit packages may vary based on your location.
• Competitive Compensation. We offer very strong compensation packages, including stock options. We want people to be focused on their best work and believe in tailoring compensation plans to meet the needs of our workforce. 
• Team Building Events. We organize regular team onsites and local meetups in Los Altos, CA as well as different cities. Traveling 2-4 times a year is expected for all roles.