Member of Technical Staff (Model Quantization & Inference)

Apply on YC · Original job listing

• Role: Engineering / AI engineer
• Experience: Any (new grads ok)
• Visa: US citizenship/visa not required

About Lamb Labs

At Lamb Labs, we're building a new AI chip: the Model Processing Unit (MPU).

Modern AI inference is constrained by the cost of moving model weights between memory and compute. We're taking a fundamentally different approach: aggressively compressing and optimizing language models so that their weights and computation can be encoded directly into silicon.

We're developing extremely low-bit language models and custom hardware architectures together, with the goal of making inference orders of magnitude faster and more energy-efficient.

We're a small, research-driven team working at the intersection of machine learning, compilers and computer architecture. We care about fundamental ideas, rigorous experimentation and turning research into working systems.

The Role

We're looking for an exceptional ML engineer or researcher to work on some of the hardest problems in low-bit language model inference.

You'll help develop the models and algorithms that make our hardware architecture possible.

Our focus is on pushing language models to extremely low precision, particularly 1–2-bit weights, while preserving as much model quality as possible. But this goes well beyond weight quantization.

You'll work across activation quantization, KV-cache optimization, attention, numerical representations, training and fine-tuning, and the broader challenges of running highly compressed language models efficiently.

We're not looking for someone who simply knows how to use existing quantization libraries. We want someone who understands these methods deeply, can identify their limitations, and can develop better ones.