Firehose

Filtered to tagged “model deployment” · clear filters

All PeopleCompaniesPapersPodcastsHacker News

Browse by tag

18 NOV 2026 · Meta

As ML ecosystems grow to a large number of production models, the bottleneck is no longer inventing new techniques to improve these models, but rather shipping them reliably and efficiently across a fragmented model space, creating a rising…

3 AUG 2026 · Podcast · Latent Space: The AI Engineer Podcast

In this episode, Philip Kiely and Ali Taha from Baseten discuss the complexities and innovations in inference engineering for large AI models. They cover topics including model deployment, speculative decoding, quantization, hardware optimi…