AI Framework Engineer Job Listing at AMD in Shanghai, Shanghai (Job ID 80392-en-us)

Description

WHAT YOU DO AT AMD CHANGES EVERYTHING 

At AMD, our mission is to build great products that accelerate next-generation computing experiences—from AI and data centers, to PCs, gaming and embedded systems. Grounded in a culture of innovation and collaboration, we believe real progress comes from bold ideas, human ingenuity and a shared passion to create something extraordinary. When you join AMD, you'll discover the real differentiator is our culture. We push the limits of innovation to solve the world's most important challenges—striving for execution excellence, while being direct, humble, collaborative, and inclusive of diverse perspectives. Join us as we shape the future of AI and beyond.  Together, we advance your career.  

THE ROLE: 

AMD is looking for an influential software engineer who is passionate about improving the performance of key applications and benchmarks. You will be a member of a core team of incredibly talented industry specialists and will work with the very latest hardware and software technology.  

THE PERSON: 

The ideal candidate should be passionate about software engineering and possess leadership skills to drive sophisticated issues to resolution. Able to communicate effectively and work optimally with different teams across AMD.  

KEY RESPONSIBILITIES: 

• Work closely with customers on AI related workload measurement, enabling, and optimizations, particularly for AMD server GPU products.
• Optimize and refine AI models and algorithms to improve performance and accuracy with AMD AI software stack, plus serving framework like vLLM and SGLang.
• Collaborate with software engineers, product teams, and researchers to integrate algorithms into products and systems.
• Conduct simulations, tests, and experiments to test algorithm functionality and effectiveness.
• Stay informed of software and hardware trends and innovations, especially pertaining to algorithms and architecture 
• Debugging/fix existing issues and research alternative, more efficient ways to accomplish the same work  
• Participating in new ASIC and hardware bring ups.

PREFERRED EXPERIENCE: 

• Strong object-oriented programming background, C/C++, python preferred 

• Familiar with popular AI frameworks like vllm, sglang, Megatron. Experience in model and pipeline optimization work based on these frameworks. Big plus for including the pull requests in resume.
• Familiar with AI operations libraries, like flashInfer, tensorRT-LLM, CUTLASS, Aiter(AMD) etc. Used and customized ops from above libraries.
• Familiar with Triton compiler backend, on top of llir/ASM program with explicit layout, pipeline optimization. Has experience with the implementation of Triton/Gluon kernels.

ACADEMIC CREDENTIALS: 

• Master's degree in Computer Science, Computer Engineering, Electrical Engineering, or equivalent; Bachelor degree in these majors plus 3 year of experience.

LOCATION:

Shanghai

#LI-VC1

Benefits offered are described:  AMD benefits at a glance.

AMD does not accept unsolicited resumes from headhunters, recruitment agencies, or fee-based recruitment services. AMD and its subsidiaries are equal opportunity, inclusive employers and will consider all applicants without regard to age, ancestry, color, marital status, medical condition, mental or physical disability, national origin, race, religion, political and/or third-party affiliation, sex, pregnancy, sexual orientation, gender identity, military or veteran status, or any other characteristic protected by law.   We encourage applications from all qualified candidates and will accommodate applicants' needs under the respective laws throughout all stages of the recruitment and selection process.

AMD may use Artificial Intelligence to help screen, assess or select applicants for this position.  AMD's “Responsible AI Policy” is available here.

This posting is for an existing vacancy.