17 job opportunities for speculative decoding in United States updated today
job offers found
*About The Role** Together AI is building the Inference Platform that powers the world's most advanced generative AI models. Your role will be a critical bridge between cutting-edge research and real-world applications, focusing on making translating our internal model training research to productio
We optimize and benchmark GenAI inference on NVIDIA's latest accelerators, defining the industry’s performance standards across language models, video generation, and speech workloads. We work directly within TensorRT-LLM, SGLang, and vLLM, building the tools that evaluate serving performance at sca
MandolinAbout Mandolin Nearly every disease will become treatable in our lifetimes. Mandolin is laying the clinical and financial infrastructure to get groundbreaking treatments to patients faster, powered by AI agents. Mandolin partners closely with the largest healthcare institutions in the US, covering m
About Fluidstack At Fluidstack, we’re building the infrastructure for abundant intelligence. We partner with top AI labs, governments, and enterprises - including Mistral, Poolside, Black Forest Labs, Meta, and more - to unlock compute at the speed of light. We’re working with urgency to make AGI a
Meta is seeking Research Interns to join our AI Solutions and Automation (ASA) Team. The ASA AI Exploration Team is a dynamic, applied research group focused on rapid exploration, post-training, and deployment of SOTA GenAI techniques. We are seeking individuals passionate in areas such as post-trai
Unity South APAC (SEA, ANZ, IND Subcont.)The opportunity Generative AI has spent the last few years mastering pixels and prose. Unity is here to make it move. We are seeking a visionary Director, Multi-Modal AI to lead the charge in transforming "dream pixels"—static AI hallucinations—into Dream Games. This is a zero-to-one leadership oppo
Unity South APAC (SEA, ANZ, IND Subcont.)The opportunity Generative AI has spent the last few years mastering pixels and prose. Unity is here to make it move. We are seeking a visionary Director, Multi-Modal AI to lead the charge in transforming "dream pixels"—static AI hallucinations—into Dream Games. This is a zero-to-one leadership oppo
The opportunity Generative AI has spent the last few years mastering pixels and prose. Unity is here to make it move. We are seeking a visionary Director, Multi-Modal AI to lead the charge in transforming "dream pixels"—static AI hallucinations—into Dream Games. This is a zero-to-one leadership oppo
The opportunity Generative AI has spent the last few years mastering pixels and prose. Unity is here to make it move. We are seeking a visionary Director, Multi-Modal AI to lead the charge in transforming "dream pixels"—static AI hallucinations—into Dream Games. This is a zero-to-one leadership oppo
Advanced Micro Devices, IncWHAT YOU DO AT AMD CHANGES EVERYTHING At AMD, our mission is to build great products that accelerate next-generation computing experiences—from AI and data centers, to PCs, gaming and embedded systems. Grounded in a culture of innovation and collaboration, we believe real progress comes from bold id
BasetenAbout Baseten Baseten powers mission-critical inference for the world's most dynamic AI companies, like Cursor, Notion, OpenEvidence, Abridge, Clay, Gamma and Writer. By uniting applied AI research, flexible infrastructure, and seamless developer tooling, we enable companies operating at the frontie
BasetenAbout Baseten Baseten powers mission-critical inference for the world's most dynamic AI companies, like Cursor, Notion, OpenEvidence, Abridge, Clay, Gamma and Writer. By uniting applied AI research, flexible infrastructure, and seamless developer tooling, we enable companies operating at the frontie
DecagonAbout Decagon Decagon is the leading conversational AI platform empowering every brand to deliver concierge customer experiences. Our technology enables industry-defining enterprises like Avis Budget Group, Block’s Cash App and Square, Chime, Oura Health, and Hunter Douglas to deploy AI agents that
GlobalLogicJob Description: Hands on with designing end to end scalable ML system Hands on with implementation of scalable ML system. Proven ownership across entire or partial ML and MLOps lifecycle: Evaluation Techniques, Machine Learning Algorithms, Statistical Modeling, End to end deployment, Metric generat
AWS Neuron is the complete software stack for the AWS Inferentia and Trainium cloud-scale machine learning accelerators. This role is for a senior software engineer in the Machine Learning Inference Applications team. This role is responsible for development and performance optimization of core buil
MoonlakeIntroducing Moonlake, AI for creating world simulations. Scope of Work Training efficiency Dataloaders, fusion, activation remat, gradient checkpointing. FSDP/ZeRO/tensor+pipeline parallel; NCCL tuning. GPU + kernel performance Nsight profiling, Triton/CUDA kernels, fused ops. Flash-attention–style
MoonlakeIntroducing Moonlake, AI for creating world simulations. Mission: Improve Throughput, Latency, & Cost - deploying our models 2–10× faster & cheaper without quality regressions. Scope of Work: - GPU performance: CUDA/Triton kernels, FlashAttention family, paged attention, CUDA Graphs. - Serving stack
$40,000 – $63,000/year
Estimation confidence: Low
Estimate based on market data. Actual salaries may vary depending on experience, company, and location.
View full salary data →Find speculative decoding job offers in the top cities in United States