The server is specifically designed for intensive AI tasks. With a 24-core AMD EPYC™ 9224 processor offering up to 48 threads, a maximum boost frequency of up to 3.7 GHz and a base clock speed of 2.5 GHz, the server can efficiently handle complex AI computations and analysis. Featuring 64MB L3 cache and support for up to 4800MT/s DDR5 memory across 12 memory channels, this AMD EPYC™ 9004 Series processor delivers high data throughput of up to 460.8GB/s, ideal for data-intensive applications. The two Nvidia RTX 6000 ADA graphics cards, each with 48GB of GDDR6 memory and a 384-bit memory interface that offers 960GB/s throughput, are specifically designed for AI computing using the Ada Lovelace architecture with 18,176 CUDA cores.
The overall configuration of the server is tailored for high performance and efficiency, and the server has a large storage capacity with 2 × 3.84 TB SSD for fast data storage and retrieval and 2 × 20 TB HDD for data archiving. The 2×10Gb/s network connection ensures fast and reliable data transfer for demanding applications. In addition, the server has plenty of slots for memory and storage expansion, making it easy to upgrade in the future.