Research Scientist/Engineer, Efficient ML Systems

About Goaly

About the Role

Core Responsibilities

• Research efficient ML systems: Invent and evaluate algorithms and system techniques that improve LLM and agentic RL training and inference efficiency (memory, compute, communication, and stability).
• Scale agentic RL: Design and optimize large-scale agentic RL pipelines, including asynchronous training, experience management, reward modeling, and long-horizon stability.
• End-to-end experimentation: Design large-scale experiments spanning model architecture, training algorithms, distributed systems, and hardware-aware optimization.
• System-aware research: Prototype research ideas directly in training and inference stacks (e.g., parallelism strategies, attention kernels, RL training pipelines) and validate them at scale.
• Production & publication: Translate successful ideas into production-ready systems and/or publish them at top-tier conferences with full internal support.

Requirements

• Ph.D. or Master's degree in CS, AI, Systems, or related fields (Exceptional undergraduates with strong research capabilities may be considered).
• Strong foundation in LLM or large-scale ML training, including Transformers, attention mechanisms, distributed training, and optimization methods.
• Experience or strong interest in agentic RL or large-scale reinforcement learning systems, including stability, scalability, or long-horizon training challenges.
• Demonstrated interest in efficiency-focused research, such as training acceleration, memory optimization, parallelism, kernels, or RL system robustness.
• Proficient in PyTorch or JAX. Clean coding style and strong command of Python.
• Adaptability: A fast learner with a strong sense of responsibility, capable of wearing multiple hats and handling cross-stack challenges.

Bonus Points

• First-author publications at top conferences (NeurIPS, ICML, ICLR, CVPR, ACL).
• High-star open-source projects on Hugging Face or Gold/Silver medals in Kaggle competitions.