An enthusiast is planning a home AI server and wants to install eight GPUs. The main problem lies in the limited number of PCIe slots available on motherboards, especially those with FCLGA4710 sockets, which often do not exceed six slots.

Risers and Alternative Connections

To overcome this limitation, the use of risers is explored. Risers allow GPUs to be connected to the motherboard via alternative connections, potentially even via USB. The discussion aims to clarify how these components work together to expand the number of GPUs supported.

Hardware Considerations

Configuring a system with a high number of GPUs requires careful planning of power and cooling, as well as managing the physical space inside the server. The use of risers can also affect the performance of the GPUs, depending on the available bandwidth and the quality of the components used. For those evaluating on-premise deployments, there are trade-offs to consider carefully (see /llm-onpremise on AI-RADAR).