Tous les systèmes opérationnels · 40+ PoPsHébergement depuis 2010
INTERKVM HOST SRL·AS 25198
Accueil/Blog/Dedicated Servers
Thème Dedicated Servers

Articles Dedicated Servers.

Tous les articles Dedicated Servers du blog ZetServers — 36 articles.

Thème
Dedicated Servers
Articles
36

LLM inference on CPU: sizing a server by memory bandwidth

Generating a token means reading the model's active weights once, so a CPU server's speed ceiling is its memory bandwidth divided by the model's size. The arithmetic, the catch in prompt processing, why two sockets are not twice as fast, and the workloads a big-memory EPYC box genuinely suits.

·Dedicated Servers

EPYC vs Xeon: choosing the CPU in a dedicated server

What you can rent is not this year's Xeon against this year's EPYC but an eight-year spread of generations at prices seven times apart. Per-core speed, memory bandwidth, PCIe lanes and price per core — and which of those differences your workload can actually feel.

·Dedicated Servers
Tweaksv1
Theme