122 job opportunities for inference infrastructure in United States updated today
job offers found
· Page 1 / 7Responsibilities About the Team The Inference Infrastructure team is the creator and open-source maintainer of AIBrix, a Kubernetes-native control plane for large-scale LLM inference. We are part of ByteDance’s Core Compute Infrastructure organization, responsible for designing and operating the pla
About Abridge Abridge was founded in 2018 with the mission of powering deeper understanding in healthcare. Our AI-powered platform was purpose-built for medical conversations, improving clinical documentation efficiencies while enabling clinicians to focus on what matters most—their patients. Our en
About Armadin Armadin is an AI-native cybersecurity company building the ultimate attacker: an autonomous, agentic AI system that continuously finds and eliminates exploitable risk before adversaries do. We are redefining cybersecurity for the era of AI-driven Hyperattacks, deploying a fleet of spec
About Cartesia Our mission is to build the next generation of AI: ubiquitous, interactive intelligence that runs wherever you are. Today, not even the best models can continuously process and reason over a year-long stream of audio, video and text—1B text tokens, 10B audio tokens and 1T video tokens
Responsibilitie About the Team The Inference Infrastructure team is the creator and open-source maintainer of AIBrix, a Kubernetes-native control plane for large-scale LLM inference. We are part of ByteDance's Core Compute Infrastructure organization, responsible for designing and operating the plat
*About Rivian** Rivian is on a mission to keep the world adventurous forever. This goes for the emissions-free Electric Adventure Vehicles we build, and the curious, courageous souls we seek to attract. As a company, we constantly challenge what’s possible, never simply accepting what has always bee
Tech Lead Software Engineer - AI Inference Infrastructure Location: San Jose Team: Infrastructure Employment Type: Regular Job Code: A201019 Share this listing: Responsibilities Design and build large-scale, container-based cluster management and orchestration systems with extreme performance, scala
A cutting-edge AI company in San Francisco seeks an Inference Engineering Manager to lead a team dedicated to building scalable AI infrastructure. This role involves developing APIs, architecting inference systems, and enhancing reliability. Candidates should have over 5 years of engineering experie
DatologyAIAbout the Company Models are what they eat. But a large portion of training compute is wasted training on data that are already learned, irrelevant, or even harmful, leading to worse models that cost more to train and deploy. At DatologyAI, we've built a state of the art data curation suite to autom
CohereA leading AI platform provider in New York seeks a Member of Technical Staff to develop and deploy large language models. You will ensure high availability and low latency for AI applications, working in a collaborative environment. Required skills include extensive engineering experience, knowledge
AbridgeAbout Abridge Abridge was founded in 2018 with the mission of powering deeper understanding in healthcare. Our AI-powered platform was purpose-built for medical conversations, improving clinical documentation efficiencies while enabling clinicians to focus on what matters most—their patients. Our en
General MotorsSenior ML Infrastructure Engineer, Inference Platform page is loaded## Senior ML Infrastructure Engineer, Inference Platformremote type: Hybridlocations: Sunnyvale, California, United States of America: Austin, Texas, United States of America: Mountain View, California, United States of America: War
RivianOverview Rivian is on a mission to keep the world adventurous forever. This goes for the emissions-free Electric Adventure Vehicles we build, and the curious, courageous souls we seek to attract. As a company, we constantly challenge what's possible, never simply accepting what has always been done.
ByteDanceResponsibilitie About the Team The Inference Infrastructure team is the creator and open-source maintainer of AIBrix, a Kubernetes-native control plane for large-scale LLM inference. We are part of ByteDance's Core Compute Infrastructure organization, responsible for designing and operating the plat
DatologyAIAbout the Company Models are what they eat. But a large portion of training compute is wasted training on data that are already learned, irrelevant, or even harmful, leading to worse models that cost more to train and deploy. At DatologyAI, we've built a state of the art data curation suite to autom
Who are we? Our mission is to scale intelligence to serve humanity. We’re training and deploying frontier models for developers and enterprises who are building AI systems to power magical experiences like content generation, semantic search, RAG, and agents. We believe that our work is instrumental
AbridgeMachine Learning Infrastructure Engineer Join to apply for the Machine Learning Infrastructure Engineer role at Abridge . Base pay range $179,000.00/yr - $248,000.00/yr About Abridge Abridge was founded in 2018 with the mission of powering deeper understanding in healthcare. Our AI‑powered platform
ByteDanceResponsibilitie About the Team The Inference Infrastructure team is the creator and open-source maintainer of AIBrix, a Kubernetes-native control plane for large-scale LLM inference. We are part of ByteDance's Core Compute Infrastructure organization, responsible for designing and operating the plat
ByteDanceResponsibilitie About the Team The Inference Infrastructure team is the creator and open-source maintainer of AIBrix, a Kubernetes-native control plane for large-scale LLM inference. We are part of ByteDance's Core Compute Infrastructure organization, responsible for designing and operating the plat
A dynamic AI company is seeking an Infrastructure Software Engineer in San Francisco to build and maintain components of an ML inference platform. The successful candidate will develop infrastructure components using Python and Go, manage Kubernetes deployments, and enhance monitoring systems for mo
$59,000 – $94,000per year
Estimation confidence: High
Estimate based on market data. Actual salaries may vary depending on experience, company, and location.
View full salary data →Find inference infrastructure job offers in the top cities in United States
