· Updated
The cache reduction would have been a problem on FL1 — but Cloudflare's FL2, a Rust rewrite of its request handling layer, does not depend on large shared caches and scales nearly linearly with core count. Running FL2 on Turin 9965 in production, Cloudflare achieved up to 2x throughput versus Gen 12 within latency SLAs, along with 50% better performance per watt.
Teams on Cloudflare Workers and its global edge network will see the benefit as Gen 13 deploys worldwide — twice the compute capacity at current latency budgets.
Cloudflare’s Gen 13 servers double our compute throughput by rethinking the balance between cache and cores. Moving to high-core-count AMD EPYC ™ Turin CPUs, we traded large L3 cache for raw compute density. By running our new Rust-based FL2 stack, we completely mitigated the latency penalty to unlock twice the performance. https://t.co/1KNDtooLXm
More like this
CloudflareFeb 20
Zyphra5d ago
VercelFeb 18
MetaFeb 24