Skip to content
Regolo Logo
Self‑Hosting & DevOps
10 min read

DFlash: x3 LLM inference speed – guide and codes

DFlash is a new block-diffusion based speculative decoding technique that speeds up large language model (LLM) inference by predicting multiple tokens in parallel. Unlike…

Alex Genovese
Read article
Ready to scale? Get Free Regolo Credits!