ML Kernel Performance Engineer, AWS Neuron, Annapurna Labs The Annapurna Labs team at Amazon Web Services (AWS) builds AWS Neuron, the software development kit used to accelerate deep learning and generative AI workloads on Amazon’s custom machine learning accelerators, Inferentia and Trainium. The Acceleration Kernel Library team focuses on maximizing performance for AWS’s custom ML accelerators by crafting high-performance kernels for ML functions at the hardware-software boundary.Key ResponsibilitiesDesign and implement high-performance compute kernels for ML operations, leveraging the Neuron architecture and programming models.Analyze and optimize kernel-level performance across multiple generations of Neuron hardware.Conduct detailed performance analysis using profiling tools to identify and resolve bottlenecks.Implement compiler optimizations such as fusion, sharding, tiling, and scheduling.Work directly with customers to enable and optimize their ML models on AWS accelerators.Collaborate across compiler, runtime, framework, and hardware teams to develop innovative kernel optimization techniques.A Day in the LifeCreate metrics, implement automation, and resolve the root cause of software defects.Build high-impact solutions for a large customer base.Participate in design discussions, code reviews, and communicate with internal and external stakeholders.Work cross-functionally to influence business decisions with technical input.Operate in a fast-paced, startup-like development environment focusing on the most critical work.Basic Qualifications3+ years of non-internship professional software development experience.2+ years of non-internship design or architecture experience for new and existing systems.Familiarity with at least one programming language.Preferred Qualifications3+ years of full software development life cycle experience, including coding standards, code reviews, source control, build processes, testing, and operations.Bachelor’s degree in computer science or an equivalent field.Amazon is an equal opportunity employer and does not discriminate on the basis of protected veteran status, disability, or other legally protected status. If you have a disability and need a workplace accommodation or adjustment during the application and hiring process, please refer to Amazon’s accommodations information. Salary and benefits are competitive and can include sign‑on payments, restricted stock units, and health insurance, among other resources.#J-18808-Ljbffr