Tutti i sistemi operativi · 40+ PoPHosting dal 2010
INTERKVM HOST SRL·AS 25198
Home/Blog/Dedicated Servers
Tema Dedicated Servers

Articoli su Dedicated Servers.

Tutti gli articoli su Dedicated Servers nel blog ZetServers — 23 articoli.

Tema
Dedicated Servers
Articoli
23

LLM inference on CPU: sizing a server by memory bandwidth

Generating a token means reading the model's active weights once, so a CPU server's speed ceiling is its memory bandwidth divided by the model's size. The arithmetic, the catch in prompt processing, why two sockets are not twice as fast, and the workloads a big-memory EPYC box genuinely suits.

·Dedicated Servers

EPYC vs Xeon: choosing the CPU in a dedicated server

What you can rent is not this year's Xeon against this year's EPYC but an eight-year spread of generations at prices seven times apart. Per-core speed, memory bandwidth, PCIe lanes and price per core — and which of those differences your workload can actually feel.

·Dedicated Servers

Saturating a 100 Gbps port: what has to be true first

The port is the easy part — it is lit in an afternoon. Then the machine behind it has to produce 12.5 gigabytes every second, and each layer between the disk and the wire gets a chance to be the reason it does not. The arithmetic, in the order it fails.

·Network
Tweaksv1
Theme