Senior Inference Systems Engineer – KV Cache Optimization Lightbits is seeking an exceptional Senior Inference Systems Engineer to build advanced infrastructure that improves LLM inference performance through KV cache optimization, offloading, streaming, compression, and scheduling. In this role, yo