Machine Learning System Software Architect

  • Baidu
  • Sunnyvale, California
  • 04/04/2026
Full time Information Technology Telecommunications Software Engineer

Job Description

Overview

Sunnyvale,CA

We're looking forward to you joining us to collaborate, contribute, and revolutionize AI silicon and system. We're seeking a world-class Machine Learning System Software Architect to join our SoC team at Baidu's Sunnyvale office. The successful candidate will be a motivated self-starter who will thrive in this highly technical environment. Your job responsibilities will help the team to architect and create high-performance machine learning system software and build the distributed AI training system by connecting thousands of Kunlun Accelerators and servers.

Responsibilities
  • Create differentiated architectural innovations for Baidu's Kunlun AI SoC roadmap. Architect, simulate, and design machine learning solutions for our AI products.
  • Develop system-level ML architectures that push performance, power, and latency boundaries; collaborate with teammates to optimize hardware and software for maximum performance.
  • Monitor industrial and academic trends in artificial intelligence and determine intersections with roadmaps. Drive partnerships for access to advanced AI technologies.
  • Evaluate the power, performance, and cost of prospective architecture and subsystems. Build scalable tools for modeling and performance evaluation.
  • Engage with system and application software engineers to optimize the entire hardware/software stack.
  • Work with SoC design, verification, and validation engineers to execute the architecture.
Qualifications
  • Knowledge of Machine Learning market, technological and business trends, software ecosystem, and emerging applications.
  • Proven track record of 5+ years architecting software solutions for Machine Learning, acceleration and optimization, especially in large distributed training systems and HPC.
  • Experience with deep learning frameworks: TensorFlow/PyTorch/PaddlePaddle, etc.
  • Strong track record of outreach to ML researchers and application developers.
  • Experience with CPUs, GPUs, memory systems, and accelerators.
  • Experience with performance simulation and modeling in C++.
  • MS or PhD in Electrical or Computer Engineering.
  • Excellent communication skills in both English and Chinese.
Culture Fit
  • Mission alignment: We provide the best possible platform to accomplish this great mission.
  • Self-directed: We work best with people who are driven, motivated, and aspire to greatness.
  • Hungry to learn: We are eager to see you learn new skills and grow.
  • Team orientation: We work in small, fast-moving teams and pursue big goals together.

LI-DNI

Apply for this job

Interested in building your career at Baidu USA? Please apply through Baidu USA careers channels.