Performance Modeling Engineer

<p>Etched was founded on the belief that new hardware will be needed to run human- and superhuman-level artificial intelligence. Our ASIC systems deliver orders of magnitude higher performance than conventional AI chips. Etched is actively developing <a href="https://www.etched.com/">Sohu</a>, an ASIC exclusively for transformers, which will enable products that would be impossible with GPUs, like <a href="https://twitter.com/Etched/status/1852089772329869436">real-time video generation models</a> and extremely deep chain-of-thought reasoning. And we're bringing this technology to market in months, not years. Sohu is hard-coded for individual model architectures and only supports transformers, but has an order of magnitude more throughput and lower latency than a B200.&nbsp;</p> <p>&nbsp;</p> <p><strong>WHAT YOU’LL DO</strong></p> <ul> <li><strong>Develop and own SoC functional models</strong> from architecture to deployment, including integration with infrastructure, thorough testing, and debugging.</li> <li>Collaborate closely with <strong>architecture, RTL design, design verification, emulation, and software teams</strong> to ensure alignment and performance.</li> <li><strong>Innovate tooling and infrastructure</strong> to enhance usability and effectiveness for internal and external partners.</li> <li>Optimize model and infrastructure performance, ensuring scalability for real-world AI workloads.</li> <li>Create software that is <strong>well-documented, maintainable, and reusable</strong>, ensuring longevity and ease of future development.</li> <li>Simulate performance of existing and upcoming state-of-the-art (SOTA) Transformer models on our ASIC architecture vs other alternatives (GPUs, TPUs etc)</li> </ul> <p><strong>WE’RE LOOKING FOR ENGINEERS WITH:</strong></p> <ul> <li>Expert knowledge in <strong>functional modeling</strong> of ASICs (TPUs, GPUs, CPUs, or equiv. accelerators)</li> <li>Strong command of C++ for modeling with Python familiarity for scripting and automation.</li> <li>Insights bridging simulation to analysis of complex systems involving multiple domains (e.g., physical link IO / memory / chip firmware / system software / overall performance).</li> <li>High interest in learning transformer architecture, developing insight into AI hardware/software co-design.</li> <li>Passion for AI and a desire to push performance and efficiency boundaries.</li> </ul> <p><strong>Machine learning experience is not required. </strong>This role will provide opportunities to ramp on relevant ML concepts on the job.</p> <p>Minimum qualifications:</p> <ul> <li>Bachelor's degree or equivalent practical experience.</li> <li>5 years of experience in software development with data structures/algorithms.</li> <li>5 years of experience developing and testing software models/simulations of shipping ASICs.</li> <li>3 years of experience modeling SoC relevant technologies (DRAM, HBM, I2C, SPI, PCIe, etc.).</li> </ul> <p>Preferred qualifications:</p> <ul> <li>Master’s or PhD degree Computer Science, or a related technical field.</li> <li>Experience in computer architecture, SoC design, and RTL languages.</li> <li>Experience solving ambiguous problems.</li> <li>Excellent verbal and written communication skills.</li> </ul> <p>&nbsp;</p> <p><strong>If you're a talented software engineer who's excited to shape the future of AI, we encourage you to apply!</strong></p> <p><strong>To Apply:</strong></p> <p>Please visit our website at <a href="https://www.etched.com/careers">etched.com/careers</a> to submit your resume and cover letter.</p> <p><strong>Location:</strong> Cupertino, California</p> <p><br><br><br></p>