Skip to main content

Software Engineer

Technology
Haystack
San Jose, United States3 weeks agoUntil 12/12/2026
Full time

Job description

We're hiring on behalf of a Haystack partner!

The Role

  • Design, implement, test, deploy, and maintain innovative software solutions for a next-generation compiler.
  • Optimize the performance of complex machine learning models on custom AI hardware.
  • Collaborate with chip architects, runtime engineers, and ML application teams to ensure seamless model deployment.
  • Work with open-source software tools to pioneer advanced ML workload optimization.
  • Develop new features to enhance the performance and usability of the compiler for global developers.
  • Solve challenging compiler optimization problems for various ML model families, including large language models and diffusion models.

What You'll Need

  • 3+ years of professional software development experience.
  • 2+ years of experience in designing or architecting new and existing systems.
  • Proficiency in object-oriented programming languages such as C++ or Java.
  • Experience with compiler design or building ML models using ML frameworks on accelerators is preferred.
  • Familiarity with technologies like OpenXLA, StableHLO, or MLIR is a plus.
  • Experience with modern build systems like Bazel or CMake is beneficial.

What's On Offer

  • Competitive annual salary ($165,200 - $223,600) plus potential for sign-on bonuses and stock units.
  • Comprehensive benefits package including health insurance, 401(k) matching, paid time off, and parental leave.
  • Opportunity to work on cutting-edge AI hardware and software solutions.
  • A collaborative and supportive team environment with a focus on mentorship and career growth.

Apply via Haystack today!

Keywords
monthsOfExperience: 36OCamlBazelCMakeCHIPJavaUsability

Interested in this role?