Key features
- 4× NVIDIA GeForce RTX 4090 24 GB GDDR6X – 96 GB of graphics memory in total
- AMD EPYC 7542 processor (32 cores / 64 threads) and 256 GB of DDR4 ECC memory, expandable to 512 GB
- 4U rack form factor, two synchronised 2 kW power supplies, 2× 10 GbE and IPMI remote management
- Made to order – we build you a new unit from components we have in stock
- Supplied with pre-installed software for whatever you want to run on the server – it is ready to work as soon as you switch it on
Configuration
| Component |
Specification |
| Graphics cards |
4× NVIDIA GeForce RTX 4090 24 GB GDDR6X (PCIe 4.0 x16) |
| Processor |
AMD EPYC 7542 (32C/64T, 225 W) |
| Motherboard |
ASRock Rack ROMED8-2T (7× PCIe 4.0 x16, 8× DDR4 ECC, 2× 10 GbE, IPMI) |
| Memory |
256 GB DDR4-2666 ECC RDIMM (expandable to 512 GB) |
| Drive |
2 TB NVMe M.2 (PCIe 4.0) |
| Power supply |
2× 2 kW ATX, synchronised (4 kW in total) |
| Chassis and cooling |
4U rack, 120 mm fans with front-to-back airflow |
| Power draw |
approx. 2,200 W at full load (cards 4× 450 W, processor 225 W) |
| Availability |
Made to order – we build you a new unit (components in stock) |
Who it is for
For companies that want to run language models in-house – an internal chatbot, an assistant or working with company documents (RAG). Your data never leaves your company and you pay no monthly fees for cloud GPUs. 96 GB of graphics memory is enough for models of around 70 billion parameters in quantised form (e.g. Llama 3.3 70B), several smaller models at once, fine-tuning (LoRA/QLoRA) of 7–34-billion-parameter models, and image and video generation (FLUX.1, SDXL). In our test, Llama 3.3 70B (AWQ, 4-bit) reached up to 179 tokens per second with 32 concurrent requests. When the server is not busy with your jobs, it can mine cryptocurrencies on its graphics cards.
Pre-installation, testing and service
We agree in advance what will run on the server (e.g. Ubuntu, CUDA, Docker, vLLM, ComfyUI) and prepare it precisely for your task. Before handover, we test the server for 72 hours under full load. We have the components in stock – we build a new server from them and test it, usually within 7–14 working days of quote approval. We keep key spare parts in stock in Prague and provide on-site service and part replacement within 24/48 hours. The warranty is 24 months. We can adjust memory, drives or network cards to suit your needs.
Operation and placement
The server belongs in a rack or technical room with good cooling and a circuit that can handle roughly 2.3 kW. Don't want to deal with space, noise and cooling? We can place the server in our hosting at the data centre – terms agreed individually.