Category: How TO

  • Dell PowerEdge R740xd Build Guide: Complete Hardware & Storage Configuration

    Dell PowerEdge R740xd Build Guide: Complete Hardware & Storage Configuration

    In this post I’ll be diving deep into building and configuring the Dell PowerEdge R740xd server. This will naturally build upon the R740 guide and include configuring hardware like flex bays and mid bays. The R740xd is essentially the R740 with more storage capabilities. This means a lot more storage bays in the front as well as support for storage in the rear and inside the chassis itself.

    There are 2 chassis variations for the R740xd. One variation supports 12 large form factor drives through the front. The other supports 24 SFF drives. Both of these variations feature completely different backplanes. This is worth noting because it completely changes the type of cable you’ll need to install the supported flex bay or mid bay.

    All of this will be covered in the guide.

    Let’s start with the absolute bare minimum hardware requirements. As you verify the presence of the core hardware we’ll move on to specific configurations.

    Essential Components

    Before installing individual components it is important to identify the hardware required to turn the chassis into a functioning server. This section covers the major components that should be installed and verified before moving on to the rest of the build.

    The goal is to start with a bare chassis and ensure that you have everything necessary to power on the system, recognize the installed hardware, access the storage devices, and eventually install an operating system.

    Because the R740xd was available in several different storage and expansion configurations, the exact components required will depend on the chassis configuration you are building. In particular, the motherboard, storage backplane, cables, risers, storage controller, processors, memory, cooling system, and power supplies must be matched to the specific R740xd configuration.

    Motherboard

    The motherboard should already be installed in the chassis and securely fastened in place. It serves as the central connection point for nearly all of the server’s hardware.

    The processors and memory modules are installed directly onto the motherboard, while the power supplies connect to the system through the rear of the chassis. PCIe risers attach to the motherboard to provide expansion slots, and the storage backplane connects to the system board and, depending on the configuration, to a PERC RAID controller or HBA. The hot-swap fan modules also connect to the motherboard.

    Before installing additional components, make sure the motherboard is properly seated and secured inside the chassis. A loose, incorrectly installed, or damaged system board can prevent the server from powering on or cause individual hardware components to malfunction.

    Storage Backplane and Cables

    The storage backplane is one of the most important components of the R740xd because the server was designed around multiple high-density storage configurations. Depending on the chassis, the R740xd can use different combinations of 2.5-inch or 3.5-inch drive bays, as well as configurations that support additional internal or rear-mounted storage.

    The backplane provides the electrical and data connections between the installed drives and the rest of the server. It also supplies power to the drive bays and contains the connectors required to interface with the system board and storage controller.

    The exact backplane and cabling required will depend on the R740xd configuration.

    Click here for 12 bay configuration

    Backplane for the R740xd 12 Bay chassis

    This is the the backplane for the 12 bay configuration. If you will be using a mini mono controller you’ll need this cable. If you’re using a PCIe controller you’ll need dell part number 0787PR. The backplane will also need the following signal cable and power cable. These cables connect it to the motherboard.

    Click here for 24 bay configuration

    The 24 bay SFF variation will of course have its own backplane and also different cables that will connect it to the motherboard and storage controller. Make sure the backplane is present. If you have a mini mono storage controller this is the cable you’ll need. If you have a PCIe controller you’ll need this one. Be sure both the BP signal cable and the BP power cable are present and attached from the backplane to the motherboard.

    Cooling

    The Dell PowerEdge R740xd uses a combination of hot-swappable fan modules, processor heatsinks, and an air shroud to maintain proper operating temperatures throughout the chassis. These components work together to move air through the server and remove heat from the processors, memory, storage controllers, PCIe cards, and other heat-producing hardware.

    The exact cooling requirements depend on how the R740xd is configured. Processor TDP, storage configuration, PCIe expansion cards, and the installation of additional storage such as a rear flex bay can all affect the thermal requirements of the system.

    Fan Modules

    The fan modules are the primary active cooling components in the R740xd. The individual fans install into an assembly cage, which is then installed into the chassis as a complete unit. Like other Dell PowerEdge systems, the R740xd uses orange fan housings to identify hot-swappable components.

    Fan assembly cage for the Dell PowerEdge R740xd
    The fan modules install into this assembly cage before the complete assembly is installed in the chassis.

    The R740xd is available with both standard-performance and high-performance fan modules. The appropriate fan configuration depends on the processors and other hardware installed in the server.

    High-performance fans may be required when the system is equipped with higher-TDP processors or other hardware that generates additional heat. Certain R740xd storage and expansion configurations can also increase the cooling requirements. For example, configurations using a rear flex bay require high-performance fans.

    When building an R740xd from an empty chassis, the fan type should therefore be determined from the complete hardware configuration rather than from the chassis alone. Installing standard-performance fans in a configuration that requires high-performance cooling can cause the fans to operate at higher speeds and may result in increased noise or thermal warnings.

    Number of Fan Modules

    The R740xd uses six fan modules as its primary chassis cooling system. All six fan positions should be populated for normal operation.

    The server monitors the fan modules and adjusts fan speed according to the thermal requirements of the system. Missing or incorrectly installed fans can result in system warnings, logged hardware events, and increased fan speeds from the remaining modules. Before powering on a completed R740xd build, verify that all six fan modules are installed and properly seated.

    High-performance fan module for the Dell PowerEdge R740xd
    A high-performance fan module for the R740 and R740xd

    Processor Heatsinks

    Each installed processor requires a compatible heatsink. A two-processor R740xd therefore requires two heatsinks. Dell offered both 1U standard-performance and high-performance heatsinks, along with a larger 2U high-performance heatsink designed specifically for the R740/R740xd platform.

    Standard heatsinks are lower-profile aluminum designs, while high-performance heatsinks provide greater thermal capacity and use a copper contact surface to improve heat transfer from the processor.

    The heatsink must be matched to the processor and overall system configuration. Higher-TDP processors may require a high-performance heatsink and corresponding fan configuration.

    Each heatsink also includes a black plastic retention clip on its underside. The clip helps secure the processor against the heatsink and maintains the proper position during installation. The retention clip is part of the heatsink assembly and should remain installed.

    High-performance 2U heatsinks for the Dell PowerEdge R740xd

    The R740xd can use three general heatsink configurations: standard-performance 1U heatsinks, high-performance 1U heatsinks, and the larger 2U high-performance heatsink. Certain storage configurations may require the 1U low profile heatsinks. For example, the installation of a midbay is not possible with 2U heatsinks so the 1U variation must be used instead.

    Click to see standard-performance 1U heatsinks

    Standard-performance 1U heatsinks

    Click to see high-performance 1U heatsinks

    High-performance 1U heatsinks

    Air Shroud

    The final major component of the R740xd cooling system is the air shroud. The shroud sits over the motherboard and directs airflow from the fan assembly through the areas containing the processors, memory modules, and other heat-producing components.

    The air shroud is an important part of the server’s thermal design. Operating the R740xd without the shroud can disrupt the intended airflow path and reduce cooling performance. It should therefore be installed before normal operation of the server. A mid bay will require the removal of the air shroud.

    Servers configured with a GPU will use a different air shroud. 

    Air shroud for the Dell PowerEdge R740xd

    The fan modules, processor heatsinks, and air shroud work together as a complete thermal-management system. Before powering on an R740xd assembled from an empty chassis, verify that the appropriate fan modules and heatsinks are installed, all fan positions are populated, and the air shroud is securely in place.

    Risers

    The R740xd supports a wide range of PCIe riser configurations. Several riser positions are available, and some positions have multiple variations that provide different combinations of PCIe slot width, physical card height, and card length.

    The correct riser configuration depends on the hardware being installed in the server. A particular riser may provide additional PCIe slots but may also interfere with other components or storage options. This is especially important on the R740xd because configurations such as rear flex bays can occupy space that would otherwise be available for certain risers.

    Riser selection can also affect the installation of storage controllers, network adapters, HBAs, GPUs, and other PCIe expansion cards. Some riser variations provide only low-profile slots, while others provide full-height slots capable of accepting larger expansion cards.

    Expansion Card Riser PCIe Slot Height Length Link
    Riser 1A Slot 1 Full Height Full Length x16
    Slot 3 Full Height Half Length x16
    Riser 1B Slot 1 Full Height Full Length x8
    Slot 2 Full Height Full Length x8
    Slot 3 Full Height Half Length x8
    Riser 1D Slot 1 Full Height Full Length x16
    Slot 2 Full Height Full Length x8
    Slot 3 Full Height Half Length x8
    Riser 2A or 2E Slot 4 Full Height Full Length x16
    Slot 5 Full Height Full Length x8
    Slot 6 Low Profile Half Length x8
    Riser 2B Slot 4 Low Profile Half Length x8
    Riser 2C Slot 4 Low Profile Half Length x16
    Riser 3A or 3B Slot 7 Full Height Full Length x8
    Slot 8 Full Height Full Length x16

    Riser 1

    The R740xd can use several variations of Riser 1. Riser 1A, 1B, and 1D provide different combinations of PCIe slot widths and should be selected according to the expansion cards being installed.

    Riser 1A

    Dell PowerEdge R740xd Riser 1A

    Click to see Riser 1B

    Dell PowerEdge R740xd Riser 1B

    Click to see Riser 1D

    Dell PowerEdge R740xd Riser 1D

    Riser 2

    Riser 2 is available in several configurations, including full-height Riser 2A/2E and low-profile Riser 2B and 2C configurations.

    Riser 2A/2E provides three expansion slots, including two x8 slots and an x16 slot. This is the full-height option and is suitable when the available chassis space allows the installation of full-height expansion cards.

    The low-profile Riser 2B and 2C configurations provide an alternative when chassis space is limited or when another component occupies the area normally used by the full-height riser. This is particularly relevant on the R740xd when installing certain rear storage or flex-bay configurations.

    When selecting a Riser 2 configuration for an R740xd build, consider the complete hardware configuration rather than selecting the riser solely based on the number of PCIe slots it provides. Storage expansion, rear flex bays, PCIe cards, and card height can all affect which Riser 2 configuration can be installed.

    Riser 2 for the Dell PowerEdge R740xd

    Click to see Riser 2B

    Riser 2B for the Dell PowerEdge R740xd

    Click to see Riser 2C

    Riser 2C for the Dell PowerEdge R740xd

    Riser 3A and 3B

    Riser 3 provides two additional PCIe slots at the rear of the server. The available slots provide different PCIe link widths, with Slot 7 providing an x8 connection and Slot 8 providing an x16 connection.

    Riser 3 for the Dell PowerEdge R740xd

    Building the Server

    Once you have confirmed that the R740xd chassis contains the required hardware, you can begin assembling the system. Before installing every component, it is useful to perform an initial power-on test using only the hardware required for the server to complete POST.

    This approach makes troubleshooting easier because there are fewer components to check if the server fails to start or reports a hardware error.

    At a minimum, the system will need:

    • At least one compatible CPU
    • At least one compatible memory module
    • At least one power supply

    Additional hardware such as the storage backplane, PERC or HBA controller, PCIe risers, network adapters, and storage drives can then be installed and tested as the build progresses.

    Required Tools

    Tools needed to build a Dell PowerEdge R740xd

    Fortunately, assembling a Dell PowerEdge R740xd does not require a large collection of specialized tools. Before beginning the build, you should have a Phillips #2 screwdriver, a T30 Torx bit, thermal paste, and either an electric air blower or a can of compressed air available.

    The R740xd can operate with a single processor, but doing so limits some of the server’s functionality. Certain PCIe slots and other system resources are connected to CPU2 and will not be available when the second processor is not installed. If you plan to install additional PCIe expansion cards, verify the slot configuration and CPU requirements before deciding to build the server with only one processor.

    Installing the Processors

    The R740xd has two processor sockets located near the center of the motherboard, identified as CPU1 and CPU2. Depending on the condition of the chassis, the sockets may already contain processors and heatsinks, or they may be covered by protective CPU socket covers.

    If you are installing a processor into a previously used system, first remove the existing heatsink and processor if necessary. If the socket is empty, remove the protective socket cover before installing the CPU. Pay close attention to the orientation markings on both the processor and socket. The processor can only be installed in one orientation. Attempting to install it incorrectly can damage the delicate socket contacts and potentially render the motherboard unusable.

    Before installing the processor, inspect the socket and remove any dust or debris using compressed air or an electric air blower. Avoid touching the socket contacts.

    Empty Dell PowerEdge R740xd CPU socket

    Take particular care when working around the processor sockets. The contacts inside the LGA socket are extremely delicate and can be bent by improper handling. Hold the processor by its edges and make sure it is correctly oriented before lowering it into the socket.

    You can also install the CPU onto the heatsink first. This is the often recommended approach. I do take some issue with this method. Having built thousands of servers I’ve seen the black plastic retainer clips become brittle over time from years of heat exposure. Unless the retainer clip is brand new I would not trust it to properly secure the CPU into place. If you flip it over there’s a good chance the CPU comes right out of the clips – potentially damaging the CPU or worse yet – the pins on the socket itself.

    Installing a processor in a Dell PowerEdge R740xd

    Applying thermal paste to a Dell PowerEdge R740xd processor

    Installing the heatsink on a Dell PowerEdge R740xd processor

    If you are building a dual-processor system, repeat the procedure for CPU2. Both processors should be from the same supported processor generation and should be installed according to Dell’s processor compatibility requirements.

    Installing the Memory

    The R740xd has six memory channels per processor, with two DIMM slots available on each channel. A system with two processors therefore has 24 DIMM slots in total, with 12 slots assigned to each processor.

    The DIMM slots are arranged into primary and secondary positions. The primary slots (the white slots) should be populated before the secondary slots. When installing memory, use the appropriate primary DIMM locations for the number of modules being installed rather than simply filling the slots from left to right.

    For best memory performance, distribute DIMMs across as many memory channels as possible. In a dual-processor system, memory should also be distributed evenly between CPU1 and CPU2 whenever practical.

    For example, if you have four identical DIMMs to install in a dual-processor R740xd, a balanced configuration is to install two DIMMs on CPU1 and two DIMMs on CPU2, using the primary memory slots. In this configuration, the DIMMs would be installed in A1, A2, B1, and B2.

    Dell uses A to identify the memory slots associated with CPU1 and B to identify the slots associated with CPU2. If you have difficulty locating the DIMM slots, the memory layout is printed on your servers air shroud.

    When adding memory to an existing configuration, try to maintain matching DIMM capacity, rank characteristics, speed, and memory type across corresponding channels. The R740xd supports DDR4 ECC RDIMMs and LRDIMMs, but RDIMMs and LRDIMMs should not be mixed within the same system.

    Click here to view the R740xd memory channel mapping
    CPU (Socket) Memory Channel Primary DIMM (1 DPC) Secondary DIMM (2 DPC)
    Socket 01 (CPU1) Channel 0 A1 A7
    Channel 1 A2 A8
    Channel 2 A3 A9
    Channel 3 A4 A10
    Channel 4 A5 A11
    Channel 5 A6 A12
    Socket 02 (CPU2) Channel 0 B1 B7
    Channel 1 B2 B8
    Channel 2 B3 B9
    Channel 3 B4 B10
    Channel 4 B5 B11
    Channel 5 B6 B12

    For example, with four identical DIMMs, two modules can be installed on CPU1 in A1 and A2, while the other two are installed on CPU2 in B1 and B2. This distributes the memory evenly between the two processors while using the primary DIMM positions.

    Installing memory in a Dell PowerEdge R740xd

    Installing the NDC

    The Network Daughter Card (NDC) provides the R740xd with its integrated network interfaces. Dell offered several NDC options with different port types and network speeds, so the exact interfaces available depend on the NDC installed in the server.

    The installation procedure is the same for the different NDC options.

    Begin by removing Riser 2. Removing the riser provides access to the proprietary Dell mezzanine connector used by the NDC.

    NDC installation point on a Dell PowerEdge R740xd

    Installing an NDC in a Dell PowerEdge R740xd
    First guide the port side of the NDC through the opening at the rear of the chassis. Then press the NDC firmly into the motherboard’s mezzanine connector. Secure the card using the two blue plastic screws and reinstall Riser 2.

    Installing a RAID or HBA Controller

    If you are installing storage drives in the R740xd, you will generally need a compatible RAID controller or HBA to connect the drives to the operating system. The exact controller and cabling requirements depend on the storage configuration and backplane installed in the server.

    An HBA normally presents the physical drives directly to the operating system, leaving storage management to the operating system or storage software. A RAID controller, on the other hand, can combine physical drives into RAID virtual disks. Some Dell PERC controllers can also be configured for non-RAID or HBA-style operation, depending on the specific controller and firmware.

    The R740xd can use both PCIe PERC/HBA controllers and Dell’s proprietary internal Mini PERC/Mini Mono controllers. Although both types ultimately provide access to the server’s storage devices, they connect to the system differently.

    A PCIe controller is installed into one of the server’s PCIe risers. The appropriate riser and PCIe slot depend on the controller and the overall configuration of the R740xd.

    The Mini PERC/Mini Mono controller uses a proprietary connection to the motherboard and therefore does not occupy a conventional PCIe expansion slot. This can be useful when the available PCIe slots are needed for network adapters, HBAs, GPUs, or other expansion cards. However, the Mini controller can impose restrictions on which riser configurations can be installed.

    The storage backplane and SAS/PCIe cabling must match the controller and chassis configuration. The R740xd was produced in several storage configurations, including 12 × 3.5-inch LFF and 24 × 2.5-inch SFF configurations, as well as configurations with additional mid-bay, rear-bay, or NVMe storage. A cable that fits a connector is not necessarily the correct cable for a particular configuration.

    For example, the 12 × 3.5-inch LFF configuration can use different SAS cables depending on whether the system uses a PCIe PERC, Mini PERC, or additional mid-bay storage. The 24 × 2.5-inch SFF configuration uses a different backplane and corresponding cabling. Verify the backplane, controller, and cable part numbers before installing the storage controller.

    Click for PCIe RAID/HBA instructions

    PCIe RAID controller installation point in a Dell PowerEdge R740xd This is the PCIe installation area for the storage controller. If an NDC needs to be installed, install the NDC first because accessing the NDC requires removal of Riser 2. Before installing the controller, verify that the correct SAS cable for your R740xd backplane and storage configuration is routed to the controller location.

    Connecting a SAS cable to a PCIe RAID controller Connecting the storage cable to the controller before installing the controller into the PCIe slot can make installation easier, particularly when access to the connector is limited after the card is installed.

    Aligning a PCIe RAID controller in a Dell PowerEdge R740xd Align the controller with the appropriate PCIe slot. The exact slot depends on the riser installed in your R740xd configuration. Make sure the blue PCIe retention clip is in the outward position before inserting the card.

    Installing a PCIe RAID controller in a Dell PowerEdge R740xd Firmly insert the controller into the PCIe slot and then return the blue retention clip to its locked position.

    Click for Mini PERC/Mini Mono RAID/HBA instructions

    Mini PERC installation point for a Dell PowerEdge R740xd This is the installation point for the Mini PERC/Mini Mono storage controller. The proprietary interposer located beneath the PERC cable is required for compatible Mini PERC controllers. Because the Mini controller occupies space associated with certain riser configurations, verify riser compatibility before selecting this option.

    Installing a Mini PERC controller in a Dell PowerEdge R740xd Slide the edge of the Mini PERC controller underneath the black plastic brackets and align the controller with the proprietary connector. Secure the storage cable to the controller contacts.

    Securing a Mini PERC controller in a Dell PowerEdge R740xd Secure the Mini PERC controller using the two mounting screws and a Phillips #2 screwdriver.

    NVME configuration

    This is where the R740xd deviates from its R740 predecessor. The R740xd 24 bay supports up to 12 NVME drives with the proper cabling and NVME controllers.

    Please note – NVME is only supported on the 24 bay chassis variation. The R740xd 12 bay backplane does not have the required connectors for NVME.

    Click here for NVME configuration instructions

    First make sure you have the 24 bay backplane otherwise none of the following steps are going to work. This particular configuration enables NVME support on the last 12 SFF drive bays of the 24 bay model.

    To complete these steps you will need the following 3 cables:

    And 3 of the following NVME controllers:

    As well as the following risers:

    • Riser 1A or 1D
    • Riser 2A
    • Riser 3A

    One end of the cable will connect to the backplane and then route to an NVME controller installed in a x16 slot in one of the risers. This is why it’s crucial to have the appropriate risers with the correct x16 slots installed.

    The first cable will connect to ports A0/B0 on the backplane and route to an NVME controller in riser 1.

    The second cable will connect to ports A1/B1 and connect to an NVME controller in riser 2.

    The third cable will connect to ports A2/B2 and connect to an NVME controller in riser 3.

    There are 6 connectors in total. Below you will see 4 of them. These are connectors A0/B0 and A1/B1. The connectors for A2/B2 are under the SAS expander and difficult to photograph. When cabling it helps to disconnect all other cables and physically remove the backplane from position. The cables are much easier to install if the backplane is slightly jostled out of place and at an angle. Reinstall the backplane once the cables are firmly connected.

    R740xd NVME backplane connections

    These cables will route along the right side of the chassis to the risers:

    R740xd nvme cable route

    They will connect to the NVME controllers:

    R740xd nvme cables connected to the NVME controller/extender

    The final NVME cable routes to the left of the chassis to riser 3:

    R740xd NVME cable A2/B2 to riser 3

    Extra storage configurations

    The R740xd can accept extra storage configurations in the rear and inside the chassis. In the rear you have options to install either a x4 SFF or a x2 LFF flex bay. In the chassis you have the option to install a x4 LFF mid bay. All variations of the R740xd support such configurations.

    Click here for rear flex bay installation instructions

    There are a few prerequisites before you attempt to purchase/install a rear flex bay.

    The first consideration is your specific chassis. The 12 Bay LFF and 24 Bay SFF chassis use the same flex bays but use different cables to attach them to the backplane. A cable designed for the 12 bay will not work with the 24 bay.

    The second consideration is regarding risers 2 and 3. Both of them must be removed in order to install the flex bay. You’re essentially trading PCIe slots for more storage space with such configuration. You can however install riser 2B or 2C. These are low profile risers that can sit under the flex bay while still providing a single x8 or x16 PCIe slot.

    The required power cable and signal cable will be the same regardless of chassis variation.

    Installing is quite simple. Remove risers 2 and 3 first. What you’re left with is a gaping hole in the rear of the chassis:

    R740xd rear flex bay installation

    Align the flex bay and slot it into position:

    Installing the rear flex bay

    Connect the power and signal cables to the motherboard:

    R740xd rear flex bay power and signal cables

    Route the SAS storage cable from the flex bay to the primary backplane:

    Rear flex bay cable

     

    Click for mid bay installation instructions

    The R740xd also supports a x4 LFF mid bay. The setup is similar to the rear flex bay. There are 3 primary cables you’ll need to complete the installation. The first cable is the SAS storage cable which connects the mid bay to the primary backplane.

    The exact cable you’ll need depends on your backplane:

    The other 2 cables are the following signal cable as well as the power cable. These will attach directly from the mid bay to the motherboard.

    You will also require the low profile heatsinks. The mid bay will not fit with the high performance 2U heatsinks installed.

    Installing can be a bit of a pain but be patient.

    It is helpful to flip the mid bay upside down like this:

    Installing the R740xd mid bay

    In this position you can plug in the signal cable, the power cable, and route the SAS cable to the backplane. The chassis has a specific channel that allows you to properly route the SAS cable on the side. Stuff the cable in the channel as best you can. The mid bay will not be able to slot into place if the cable is in the way.

    Once the cables are plugged in flip the mid bay over and align the notches on the mid bay with the slots on the chassis. Make note of the alignment arrows:

    R740xd mid bay side slot view

    Any drives you put in will require caddies. The drives are first installed into the caddies and then the caddies install into the mid bay.

    Lower the handles into their flat position when done:

    Mid bay installation complete

    Installing the Power Supplies

    The final major component to install is the power supply. The R740xd has two hot-swappable power supply bays located at the rear of the chassis.

    Power supplies slide directly into the rear of the chassis. You can install them from the rear of the server or reach over the chassis from the top if the server is already positioned on a workbench.

    Align the power supply with its bay and slide it firmly into place. Apply slightly more pressure as the PSU reaches the end of the bay to ensure that its connector fully engages with the server’s internal power distribution system.

    Installing a power supply in a Dell PowerEdge R740xd

    Power supplies installed in a Dell PowerEdge R740xd

    For normal redundant operation, install two compatible power supplies. The two PSUs should be matched appropriately for the server configuration. The required wattage depends on the processors, storage devices, PCIe expansion cards, and other hardware installed in the R740xd.

    When building an R740xd from an empty chassis, verify the PSU wattage and efficiency rating before installation rather than assuming that any R740xd power supply will be suitable for every configuration.

    Further reading:

    R740xd compatible power supplies

    R740xd compatible storage drives

    R740xd compatible network daughter cards

    R740xd compatible memory DIMMs

     

  • Rebranding Dell PowerEdge E560F to R640

    Rebranding Dell PowerEdge E560F to R640

    A Dell PowerEdge E560F is functionally the same as a PowerEdge R640. It is possible to rebrand the E560F to appear like it is really an R640. This is purely cosmetic and doesn’t effect the function of the server.

    First start by obtaining the correct board service utility / ID Module. This is the file that worked for me but you may have to experiment with different ID modules depending on your server.

    rebranding-dell-e560f

    After downloading you must extract the .PM file from the exe using a utility like 7zip.

    Extract PM file with 7zip

    After the PM file has been obtained upload it directly through iDRAC.

    Upload to iDRAC

    Manually reboot the system once the job is in the queue.

    You will see the process of rebranding begin to take place.

    System rebranding

    After the server reboots itself you will see the new R640 branding.

    R640 branding

     

  • Dell PowerEdge R440 8 Bay SFF Build Configuration and Guide

    Dell PowerEdge R440 8 Bay SFF Build Configuration and Guide

    The Dell PowerEdge R440 is a 1U server designed for Intel Xeon Scalable processors. The platform is available in several storage and PCIe configurations. The server we’ll focus on today is the Dell PowerEdge R440 8 Bay Small Form Factor, which supports up to eight 2.5-inch SAS or SATA drives through the front drive bays.

    This guide covers the major components required to assemble an R440 8 Bay from an empty chassis, including the motherboard, storage backplane and cabling, cooling system, and PCIe risers.

    Essential Components

    Before you begin assembling an R440 8 Bay from an empty chassis, it is important to identify the hardware required to turn the chassis into a functioning server. This section covers the major components that should be installed and verified before moving on to the rest of the build.

    The goal is to start with a bare chassis and make sure you have everything necessary to power the system on, recognize the installed hardware, and eventually install an operating system.

    For a complete list of compatible R440 parts and components see this page. 

    Motherboard

    The motherboard should already be installed in the chassis and securely fastened in place. It serves as the central connection point for the server’s processors, memory, storage, expansion cards, cooling system, and power delivery.

    The processors and memory modules are installed directly onto the motherboard, while the power supplies connect through the rear of the chassis to the R440 power distribution board. PCIe risers attach to the motherboard to provide expansion slots, and the front storage backplane connects to the system board and storage controller. The hot-swap fan modules also connect directly to the motherboard.

    Before installing additional components, make sure the motherboard is properly seated and secured inside the chassis.

    Backplane and Cables

    Backplane for the Dell PowerEdge R440 8 Bay SFF server

    The front storage backplane is a critical component of the R440 8 Bay configuration. It provides the connections required for the front-mounted drives to communicate with the server’s storage controller while also supplying power to the drive bays.

    The backplane requires the appropriate signal and power connections, along with the SAS connection to the RAID or HBA controller. This is the required signal cable for the backplane. The signal cable connects the backplane to the motherboard.

    The power cable for the backplane is supplied by the power distribution board. 

    For the 8 Bay SFF backplane you’ll need this SAS cable if you’ll be using a standard PCIe RAID or HBA controller from Dell. There is also a cable compatible with the H750 controller. The H750 has a different connector compared to controllers like the H730P or the H740P.  Select the right cable for your particular controller.

    Please note – the R440 does not support a Dell mini mono RAID/HBA controller like many other platforms in the same generation.

    Before proceeding with the build, inspect the backplane and verify that all required signal, power, and storage-controller connections are present and properly seated.

    Cooling

    Standard cooling fan for the Dell PowerEdge R440

    The R440 uses a combination of fan modules, processor heatsinks, and an air shroud to maintain proper operating temperatures. These components work together to move airflow through the 1U chassis and remove heat from the processors, memory, and other internal hardware.

    The R440 uses 6 fans to push air through the system. These fans are not hot swappable nor are they modular like the fan design of the R640. The fans connect to the motherboard via cable and the system should be powered off if you need to change them. The fans come in both a standard and high performance variation.

    The processors also require compatible heatsinks. A system with two processors will require two heatsinks. On the R440 the heatsinks for CPU1 and CPU2 are not interchangeable. This is the heatsink for CPU1 and this is the heatsink for CPU2.

    The final major cooling component is the air shroud. Positioned over the motherboard, the shroud directs airflow from the fan modules through the processor and memory areas. Operating the server without the appropriate shroud can disrupt the intended airflow pattern and reduce cooling performance.

    The fan modules, processor heatsinks, and air shroud should all be considered essential parts of the R440’s thermal management system.

    Risers

    Primary riser for the Dell PowerEdge R440 server

    The R440 has a relatively simple PCIe riser system compared with larger PowerEdge platforms. There are 2 different chassis variations. One variation supports a single full-height riser in the rear (see picture above.) The other chassis variation supports 2 low-profile risers in the rear. Both variations support the internal riser designed for a PCIe RAID/HBA controller.

    The following build guide will be focused on the chassis variation with the full-height riser.

    If I ever get access to the 2 riser chassis I will update the guide.

    Here is a breakdown of general riser terminology:

    • LP (Low Profile) refers to the height of the expansion card.
    • FH (Full Height) refers to the taller standard-height card.
    • HL (Half Length) refers to the front-to-back length of the card.

    For example, an FHHL card is full-height and half-length, while an LPHL card is low-profile and half-length.

    Another note if you have the 2 rear low-profile riser chassis – the left and right low-profile risers are not interchangeable. Although both accept low-profile, half-length cards, they are different assemblies and connect to different processor PCIe resources.

    Building the server

    You will need the following tools to complete this build:

    • Torque #30
    • Phillips #2
    • Compressed air
    • thermal paste

    Installing the processors

    Remove the lid to the server and remove the air shroud. Remove the heatsink of CPU1 to expose the CPU socket. Press inward on the blue plastic retaining clips. Do not be alarmed if they snap off or break. This is common after years of heat exposure and they aren’t entirely necessary.

    Visually inspect the CPU pins. None of them should be bent. Blow out any dust or debris with a can of compressed air or electric blower.

    Carefully place the CPU in the socket. Make sure the arrow on the CPU is oriented with the arrow on the motherboard.

    Apply thermal paste. Please excuse my messy application on this one (:

    Place the heatsink over the CPU and press firmly until you hear the black plastic CPU retaining bracket snap into place. Screw down with a T30 bit.

    Follow the same procedure above to install CPU2.

    Installing memory

    Dell went with a curious memory arrangement for the R440. There are 10 DIMM slots assigned to CPU1 yet only 6 assigned to CPU2. The memory configuration rules remain similar to other servers of the same platform – spread your memory across as many channels as possible and mirror the configuration across both processors. If you populate DIMM A1 be sure to populate DIMM B1 (for a 2 CPU configuration) The R440 has a total of 6 channels per CPU. Each channel is represented by the white DIMM slots. Secondary slots for the channel are represented by the black slots. Always populate the white slots first.

    Here I have just 2 sticks of RAM so I’ll populate DIMMs A1 and B1. You could just as easily populate DIMMs A2 and B2. The point is to mirror the configuration and use as many channels as possible.

    Installing memory on Dell PowerEdge R440

    Click to see PowerEdge R440 channel layout

    CPU1:

    • A1 / A7 = Channel 0
    • A2 / A8 = Channel 1
    • A3 = Channel 2
    • A4 / A9 = Channel 3
    • A5 / A10 = Channel 4
    • A6 = Channel 5

    CPU2:

    • B1 = Channel 0
    • B2 = Channel 1
    • B3 = Channel 2
    • B4 = Channel 3
    • B5 = Channel 4
    • B6 = Channel 5

    Installing the RAID/HBA controller

    Near the center left of the chassis you will see the low profile internal riser. This where the storage controller will install. The storage controller will need a low profile bracket. I find it is easier to first remove the internal riser, connect the storage cable to the storage controller, install the controller into riser, and finally install the riser back on the motherboard.

    The first thing you need to do is ensure the storage cable is properly plugged into the backplane and routed in a way that reaches the internal riser.

    2 mini SAS HD connectors labeled A0 and B0 connect to the backplane:

    The cable routes through this part of the server.

    Remove the riser. There is a small blue locking mechanism that must be switched before removing.

    Install the controller into the riser.

    Plug in the SAS cable:

    Reinstall the riser:

    Installing the LOM/OCP riser

    The R440 supports various compatible OCP network cards that DELL (somewhat confusingly) calls the LOM riser. The card installs into the OCP mezzanine port at the rear of the server.

    Remove the riser(s) to access the installation point:

    Remove any screws present in the mounting holes:

    Line up the connectors. The card will have holes that align with the blue pegs seen on the motherboard:

    Insert the ports through the rear bracket and then snap the card into place. Secure the card with 2 screws using a phillips #2 bit:

    Installing the rear riser(s)

    Now that the OCP networking card is installed you can reinstall the riser. As mentioned in the beginning, the particular chassis in this guide is setup for a single full-height riser. There is also a chassis variation that has 2 low-profile risers rather than one full-height.

    Now is the time to install any PCIe devices you’d like:

    Take note of the alignment peg:

    Snap the riser into place:

    If you do not have any risers or you do not require any additional PCIe slots, you can install the rear filler in place of the risers. This ensures proper air flow and prevents debris from entering the server where it can restrict airflow or cause damage.

    Rear filler for the R440

    Installing the power supplies

    The power supplies install in the rear of the server:

    Complete build photo

    At this point reinstall the air shroud. The build is done and should look similar to the image below:

    R440 complete build and configuration

     

     

     

     

  • Dell PowerEdge R940 8 Bay SFF Configuration and Build Guide

    Dell PowerEdge R940 8 Bay SFF Configuration and Build Guide

    This guide documents the process of building a Dell PowerEdge R940 from an empty chassis. We’ll cover the processors, memory, processor expansion module, storage backplane, cabling, cooling, risers, network adapter, RAID/HBA controller, and power supplies required to turn a bare chassis into a functioning server.

    Before you begin assembling an R940, it is important to identify the hardware required to turn the chassis into a functioning server. This section covers the major components that should be installed and verified before moving on to the rest of the build.

    The goal is to start with a bare chassis and make sure you have everything necessary to power the system on, recognize the installed hardware, and eventually install an operating system.

    Motherboard

    The motherboard should already be installed in the chassis and securely fastened in place. It serves as the central connection point for nearly all of the server’s hardware. The R940 processor expansion module or mezzanine will also plug in to the motherboard through a set of 2 or 4 cables depending on the configuration.

    The R940 is a four-socket 4U server, so the system board provides connections for up to four Intel Xeon Scalable processors along with their associated memory. 2 of the processors install directly on the motherboard. The other 2 will install onto the expansion module.

    Before installing additional components, make sure the motherboard is properly seated and secured inside the chassis. A loose or incorrectly installed system board can prevent the server from powering on or cause other hardware to malfunction.

    Processor expansion module

    R940 processor expansion module

    If you will be installing all 4 processors you will need the processor expansion module. This part may also be referred to as the mezzanine. The module will expand the system to support an additional 2 processors. This is a required part if you want to enable your system with the maximum number of CPUs. You can configure the R940 as 2 processor system. This will require a different set of cables then what is required to enable a system with 4 processors.

    This expansion module requires 4 of these cables. These are called UPI cables. They connect to the primary motherboard.

    The last cable required by the PEM is the clock cable. This looks like a mini SAS HD cable but it functions more like a signal cable for the multi-CPU architecture of the R940 rather than a storage cable.

    Backplane and Cables

    The storage backplane is another critical component of the R940. It provides the connections that allow the front-mounted drives to communicate with the server’s storage controller while also supplying power to the drive bays.

    Dell manufactured multiple variations of this server. This is the backplane for the 8 bay SFF model. 

    The backplane will have 2 cables that connect it to the motherboard. One of these cables is a signal cable. The other is a power cable.

    If you’re installing a RAID or HBA controller you will also require the following cable. This is the PCIe SAS storage cable that connects the backplane to the storage controller. It is specific to the 8 Bay SFF backplane.

    Before proceeding with the build, inspect the backplane and confirm that all required signal, power, and storage-controller connections are present and properly seated. These connections are essential for the server to detect and communicate with the installed drives.

    Cooling

    R940 standard performance fan

    The R940 uses a combination of hot-swappable fan modules, processor heatsinks, and an air shroud to maintain proper operating temperatures throughout the system. These components work together to move air through the 4U chassis and remove heat from the processors, memory, storage components, and PCIe hardware. The fans install into the following assembly cage. 

    The fan modules are a particularly important part of the R940’s cooling system because the server can contain up to four processors and a large number of expansion and storage components. The correct fan configuration therefore depends on the hardware installed in the system.

    Unlike a smaller 1U or 2U PowerEdge server, the R940’s cooling requirements need to be considered alongside the processor configuration, memory population, PCIe cards, storage configuration, and other installed hardware.

    The processors also require compatible heatsinks. Because the R940 supports up to four processors, a fully populated four-CPU configuration requires four processor heatsinks.

    The appropriate heatsink should be matched to the processor and system configuration. Each heatsink must be properly secured to maintain adequate contact with the processor and allow heat to be transferred into the chassis airflow.

    The final major component of the R940’s cooling system is the air shroud. Positioned over the motherboard, the shroud helps channel airflow from the fan modules through the areas containing the processors, memory, and other heat-producing components.

    Operating the server without the appropriate air shroud can disrupt the intended airflow pattern and reduce cooling performance.

    The fans, processor heatsinks, and air shroud all work together as part of the R940’s thermal management system. Before powering on a server assembled from an empty chassis, verify that the appropriate fan modules and heatsinks are installed and that the air shroud is securely in place.

    Risers

    The R940 has a substantially more extensive PCIe expansion system than the R740 because of its larger 4U chassis and four-processor design. This means many of your PCIe devices will plug in directly to the motherboard rather than the risers. If you have the processor expansion module installed the system does support up to 2 risers assuming you’re running a 4 CPU configuration.

    There is a left riser and a right riser. These plug into the processor expansion module and add an additional 6 PCIe x16 slots to the system. These risers are connected to CPU3 and CPU4 so please ensure you have those processors installed onto the expansion module.

    Please note the riser links above are technically part numbers for the PCB. Also required are the left riser assembly cage and right assembly cage. The PCB attaches to these metal cages. These usually come together as a pair on the second hand market but the distinction is worth noting.

    Building the server

    Once you have all the required components you can begin assembling the server. Aside from the server components there are a number of tools you will need to complete the assembly.

    Required tools:

    • Torque bit #30
    • Phillips #2
    • Compressed air
    • Thermal paste

    Installing CPU 1 and 2

    Remove the lid of the R940 to expose the inner components. Your server may have the processor expansion module already installed. If this is case, first remove the risers. Then pull up on the handle and lift the expansion module into an upright position. This will allow you to access processors 1 and 2 located beneath the module. You can also remove the expansion module entirely.

    R940 with mezzanine removed

    You will also need to remove the fan assembly cage:

    Removing the R940 fan assembly cage

    Remove the heatsinks to expose the CPU socket. Take this opportunity to inspect the CPU pins for damage and to blow out any dust or debris with an electric blower or compressed air.

    Align the arrow on the corner of the CPU with the arrow on the motherboard and carefully place the CPU in the socket. You can also install the CPU into the heatsink first. I prefer this method. Often times the black plastic CPU retaining brackets become brittle from years of heat exposure. When you flip the heatsink over to install it over the socket, the CPU can fall out and damage the pins.

    Apply thermal paste:

    Finally, snap on the heatsink and tighten down the T30 screws.

    Installing the memory

    Each CPU in the PowerEdge 940 has 12 memory slots. The population rules are similar to other Dell servers. The main idea is spreading the memory across as many channels as possible and mirroring the configuration across CPUs. Always populate the white slots first. Each white slot represents a channel. Only after populating the white slots can you begin populating the black slots which represent the second DIMM for the channel. If you populate A1 it’s best practice to populate B1. Because this is a 4 CPU system you will also have slots labeled C and D. These will be located on the processor expansion module.

    R940 memory population chart

    DIMMs per CPU CPU 1 CPU 2 CPU 3 CPU 4 Total (4 CPUs)
    1 DIMM A1 B1 C1 D1 4 DIMMs
    2 DIMMs A1, A2 B1, B2 C1, C2 D1, D2 8 DIMMs
    4 DIMMs A1, A2, A4, A5 B1, B2, B4, B5 C1, C2, C4, C5 D1, D2, D4, D5 16 DIMMs
    6 DIMMs A1, A2, A3, A4, A5, A6 B1, B2, B3, B4, B5, B6 C1, C2, C3, C4, C5, C6 D1, D2, D3, D4, D5, D6 24 DIMMs
    8 DIMMs A1, A2, A4, A5, A7, A8, A10, A11 B1, B2, B4, B5, B7, B8, B10, B11 C1, C2, C4, C5, C7, C8, C10, C11 D1, D2, D4, D5, D7, D8, D10, D11 32 DIMMs
    12 DIMMs A1–A12 B1–B12 C1–C12 D1–D12 48 DIMMs

    R940 channel layout

    Channel CPU 1 CPU 2 CPU 3 CPU 4
    Channel 0 A1 / A7 B1 / B7 C1 / C7 D1 / D7
    Channel 1 A2 / A8 B2 / B8 C2 / C8 D2 / D8
    Channel 2 A3 / A9 B3 / B9 C3 / C9 D3 / D9
    Channel 3 A4 / A10 B4 / B10 C4 / C10 D4 / D10
    Channel 4 A5 / A11 B5 / B11 C5 / C11 D5 / D11
    Channel 5 A6 / A12 B6 / B12 C6 / C12 D6 / D12

    Installing the NDC

    On the R940 the NDC first installs into this bracket. The bracket (also called the rNDC bracket) then interfaces with the mezzanine port on the motherboard.

    R940 NDC mounting bracket

    Installing a RAID/HBA controller

    The RAID or HBA controller will also install in the rear of the server directly in a PCIe slot. Be sure you have the correct SAS cable. This cable will route from the 8 bay SFF backplane, to the left side of the chassis, and finally to the rear expansion slots. You will need a full height bracket for any PCIe card you have.

    This is the required cable. One end will plug into the backplane. The other end goes to the storage controller.

    R940 8 Bay SFF SAS storage cable

    The rear expansion ports are locked in by a black plastic mechanism. Slide the mechanism and then lift. Once the card is installed lock the mechanism back into place.

    Installing the processor expansion module

    Now it’s time to install the mezzanine for processors 3 and 4. Because it blocks the installation path for the other components it is best to install this piece last. Populate the processors and memory in the exact same way you did for processors 1 and 2. You can do this when the module is out of the server or you can install the module first and then put in the processors and memory.

    Before you install the module you should plug in the required UPI cables. Installing the module first will make plugging these cables in more difficult than it needs to be. There are 4 in total. The connection only goes in one way so make sure you orient them properly. On the motherboard you will see connectors for UPI cables A, B, C, and D.

    In the image below you will see the 4 UPI cables. Also make note of the clock cable. 

    Dell PowerEdge R940 UPI cables

    With the clock and UPI cables plugged in it’s time to install the processor expansion module.

    Lift the module using the handle on the front and guide it down to its installation point. On the rear corners of the module you will see the hinging mechanism. This latches on to the chassis.

    At the bottom make sure you have the following component installed. When rotated down into position the expansion board comes into contact with these 2 small chips:

    Small chip that connects the processor expansion module to the motherboard.

    Make sure the expansion board can easily hinge up and down. You shouldn’t encounter any resistance except from the weight of the board itself.

    Now plug in the UPI cables that you previously attached to the motherboard. They are assigned letters. Simply match up the letters. You will notice the cables cross over each other. It is helpful to have the expansion board in its fully upright position while plugging in the cables. 

    Plugging the UPI cables into the expansion board

    Once you have the cables plugged in carefully bring the expansion board down to its natural sitting position.

    Installing the risers

    One of the last components to install are the risers. These plug in to the processor expansion module. There is a left riser and a right riser. Both have a gear-like mechanism that pulls them up or down into position and securely connects them to the riser connector.

    Installing power supplies

    Last and certainly not least are the power supplies. They slide in through the rear of the chassis like most PowerEdge servers.

    Installing R940 power supplies

    Final picture

    Here is the complete build. I do believe there is an air shroud that can be installed but I didn’t have one on hand for this particular server.

    R940 complete build

     

  • HP DL 360 G10 10 Bay Premium Configuration and Build Guide

    HP DL 360 G10 10 Bay Premium Configuration and Build Guide

    The HPE ProLiant DL360 Gen10 Premium 10-Bay SFF is a unique configuration equipped with an NVMe backplane that provides NVMe support across all 10 front drive bays. With the installation of a Smart Array controller, the first 8 drive bays become “universal,” supporting SAS, SATA, or NVMe drives, while bays 9 and 10 remain NVMe-only.

    In this guide, we’ll go through a complete build of this server, covering everything from installing the processors and memory to the RAID controller, Smart Array battery, network daughter card, risers, PCIe cards, storage and NVMe cabling, and power supplies.

    Essential Components

    Before you begin assembling an HPE ProLiant DL360 Gen10 10-Bay SFF Premium server from an empty chassis, it is important to identify the hardware required to turn the chassis into a functioning server. This configuration is different from the standard 8-bay DL360 Gen10 because it uses a 10-SFF premium backplane and dedicated NVMe hardware to provide a combination of SAS, SATA, and NVMe storage support.

    The goal of this section is to identify the major components that should be installed and verified before moving on to the rest of the build. Starting with the bare chassis, you will need to install and configure the motherboard, processors, memory, storage backplane and cabling, cooling system, Smart Array controller, network daughter card, PCIe risers, expansion cards, and power supplies.

    Motherboard

    The motherboard should already be installed in the chassis and securely fastened in place. It serves as the central connection point for the server’s processors, memory, storage, expansion cards, networking hardware, cooling system, and power delivery.

    The processors and memory modules are installed directly onto the system board. PCIe risers connect to the motherboard and provide expansion slots for network adapters, storage controllers, and other PCIe devices. The front storage backplane connects to the appropriate storage controller and NVMe hardware through dedicated cabling.

    The DL360 Gen10 also uses a network daughter card, which installs directly into the system board and provides the server’s integrated network interfaces. The hot-plug fan modules connect to the motherboard through dedicated fan connectors.

    Before installing the remaining components, make sure the motherboard is properly seated and secured inside the chassis. A loose or incorrectly installed system board can prevent the server from powering on or cause individual components to malfunction.

    Backplane and Cables

    NVME backplane for the HP DL 360 G10 server

    The 10-SFF premium backplane is one of the most important components in this particular DL360 Gen10 configuration. HPE identifies the 10-SFF NVMe/SAS/SATA backplane as spare part 875556-001.

    This backplane provides the physical connections for all ten front drive bays. Unlike a standard 8-SFF SAS/SATA configuration, the premium configuration is designed to provide both traditional SAS/SATA storage and direct NVMe connectivity.

    The ten drive bays are divided into two functional groups. Bays 1 through 8 can support a mixture of NVMe and SAS drives, while bays 9 and 10 are NVMe-only when the 10-SFF NVMe/SAS backplane option is installed.

    This makes the first eight bays effectively universal from a drive-type perspective, provided the appropriate storage controller and NVMe connections are installed. The final two bays are dedicated to NVMe storage.

    The backplane requires several different cable connections depending on the storage configuration. HPE’s cabling documentation identifies separate connections between the backplane, the Smart Array controller, and the NVMe riser. For the 10-SFF configuration, HPE lists dedicated cables for the NVMe connections (see below) as well as a separate SAS cable for the connection to the Smart Array controller.

    For the premium configuration, particular attention should be paid to the individual cable types and their port assignments. The cables can look similar, but each cable is designed for a specific connection between the backplane, controller, or NVMe riser.

    There are 3 different cables you’ll need to connect the NVME backplane to the NVME riser.

    Click to see picture of NVME cable for Port 1

    The first set of NVME cables for the HP DL 360 G10 NVME server

    Click to see picture of NVME cable for Port 2

    Click to see picture of NVME cable for ports 3, 4, and 5

    NVME cables ports 3, 4 and 5

    The Smart Array controller provides the SAS/SATA storage connection, while the NVMe drives use dedicated PCIe connectivity. HPE’s DL360 Gen10 cabling documentation specifically includes configurations for a 10-SFF NVMe backplane connected to an NVMe riser and for the 10-SFF premium backplane connected to the P824i-p Smart Array controller.

    Before proceeding with the rest of the build, inspect the backplane and confirm that the required backplane power cable, SAS, and NVMe connections are present. Verify each cable against its intended port before installation.

    Correct cabling is particularly important on this configuration. A drive can be physically installed in a bay but still remain unavailable to the operating system if the corresponding storage controller or NVMe PCIe connection has not been properly connected.

    For a complete 10-bay configuration, the storage system should therefore be treated as two interconnected subsystems:

    • SAS/SATA storage — connected through the Smart Array controller.
    • NVMe storage — connected through the dedicated NVMe PCIe/riser connections.

    The exact cable arrangement depends on the controller and NVMe configuration being built, so the individual cable part numbers and port assignments should be verified before installation.

    Cooling

    The DL360 Gen10 uses a combination of hot-plug fan modules, processor heatsinks, and an air baffle to maintain proper operating temperatures throughout the 1U chassis.

    The fan modules are individually installed into the chassis and connect to the system board through dedicated fan connections. HPE identifies the DL360 Gen10 fan modules as hot-plug components, allowing individual fan modules to be replaced without removing the entire server from service.

    The processor heatsink mounts directly above each Intel Xeon Scalable processor and transfers heat away from the CPU into the airflow generated by the fan modules. The air baffle directs airflow through the processor, memory, and other internal components.

    The DL360 Gen10 has different cooling configurations depending on the installed processors and hardware. For higher-power processors and configurations with increased thermal requirements, HPE offers the DL360 Gen10 High Performance Heat Sink Kit (873591-001) and High Performance Fan Kit (871244-B21).

    For a 10-bay NVMe configuration, cooling should be treated as an important part of the overall build rather than an optional finishing component. NVMe drives, high-power processors, storage controllers, and PCIe expansion cards can all contribute to the thermal load inside the 1U chassis.

    Before powering on the completed server, make sure the appropriate fan modules, processor heatsinks, and air baffle are installed and that all required fan connections are properly seated.

    Risers

    NVME riser for the HP DL 360 G10 server

    The DL360 Gen10 uses several different PCIe riser configurations depending on the intended hardware. The risers provide expansion slots for Smart Array controllers, network adapters, NVMe hardware, GPUs, and other PCIe devices.

    The 10-SFF NVMe configuration is particularly important because it uses a dedicated NVMe riser to provide the PCIe connectivity required by the front NVMe drives. HPE’s QuickSpecs identifies a 5-port 10-SFF NVMe Riser Kit, which provides connections for up to ten NVMe SSDs. This riser is included with certain 10-SFF chassis configurations and the 10-SFF Premium Backplane Kit.

    The DL360 Gen10 also supports other riser configurations, including an x16/x8 primary riser, a low-profile x16 riser, and other PCIe configurations. The correct riser depends on the chassis configuration and the expansion hardware being installed.

    When building a 10-bay premium server from an empty chassis, it is therefore important not to assume that any DL360 Gen10 riser will work with the configuration. The NVMe riser and its associated cabling are specifically required for the front NVMe storage connections.

    The riser board installs into its corresponding riser cage and connects to dedicated PCIe connectors on the system board. Before installing an expansion card, verify that the riser provides the required PCIe slot type, lane width, physical height, and electrical connectivity.

    For this particular build, the riser configuration should be established before installing the Smart Array controller, NVMe cabling, and other PCIe expansion cards. This helps ensure that each card is installed in the correct position and that there is sufficient room for the required cabling.

    Building the server

    Assuming you have all the required components listed above we can begin adding components.

    Before starting, also ensure you have the following tools:

    • T30 bit
    • T20 bit
    • T10 bit
    • Phillips #2 bit
    • Compressed air
    • Thermal paste

    Installing the processors

    Open the lid to expose the inner components and remove the heatsinks or CPU covers. It is first necessary to inspect the pins prior to installing the other components. If for whatever reason the CPU pins are damaged you should highly consider not continuing the build, especially if the server will be going into any serious production environment.

    Remove the heatsink to expose the CPU socket. Blow out any dust or debris with the compressed air:

    HP DL 360 G10 CPU socket

    Place CPU in the socket. If you prefer you can install the processor on the heatsink and then just install the heatsink. I have found sometimes the CPU can slip out of the black plastic bracket and damage the CPU pins, so I like to install the CPU into the socket first, and then install the heatsink next. Be sure to orient the arrow on the CPU with the arrow on the motherboard.

    Installing CPU in the socket

    Apply thermal paste:

    Applying thermal paste to the CPU

    Install the heatsink. You will need the T30 bit for this:

    Installing the memory

    For this build I have 8 DIMMs in total. I’ll assign 4 to CPU1 and 4 to CPU2. In general you want to populate the white DIMMs first before populating the black dimms. Because I have 4 DIMMs per CPU I will populate DIMM slots 3, 5, 8, and 10. If you have a different amount consult the memory population guidelines below.

    Click here for memory population guidelines
    Number of DIMM(s)
    to populate per cpu
    DL 360 G10 memory population guidelines
    Ch 6 Ch 5 Ch 4 Ch 1 Ch 2 Ch 3
    1 8
    2 8 10
    3 8 10 12
    4 3 5 8 10
    5 3 5 8 10 12
    6 1 3 5 8 10 12
    7 1 3 5 7 8 10 12
    8 3 4 5 6 7 8 9 10
    9 1 3 5 7 8 9 10 11 12
    10 1 3 4 5 6 7 8 9 10 12
    11 1 3 4 5 6 7 8 9 10 11 12
    12 1 2 3 4 5 6 7 8 9 10 11 12

    Installing the smart array battery

    At this point I like to install the smart array battery. This is the battery that maintains the RAID controller cache in the event of a power outage. Start by removing any cables attached to the backplane. If your server already has the full set of NVME and SAS cables installed, these have to be removed in order to install the battery. You will also need to remove the fans (at least the center fan.)

    Installing the Smart Array Raid controller

    The smart array controller is what will allow the server to recognize SAS and SATA drives. The NVME cables alone will only support NVME drives. In order for the drive bays to be truly universal (supporting SAS, SATA, and NVME) you must have both the smart array controller and NVME cables installed.

    It is best to install the Smart Array controller with the cables removed from the system. The controller will sit under the cables and it’s a lot easier to install prior to NVME cable installation. It is also helpful to remove the risers although not completely necessary.

    This controller has a proprietary connection to the motherboard as seen here:

    There are 2 holes in the controller. Line them up with the blue pegs on the board. Tighten down the screws.

    Plug in the Mini SAS cables if you have the cable installed already. We’ll cover installing the cables in the next section.

    NVME and SAS cabling

    Now it’s time to install the cables. The first cable you want to install is the blue Mini SAS cable shown above. This attaches from the backplane and then to the smart array controller.

    This is the installation location on the backplane. Route it along the right side of the chassis. It will make a 90 degree left turn before the riser and plug in to the smart array controller.

    Installing mini sas cable

    Mini SAS cable connection for smart array controller

    Now that the mini SAS cable is plugged in it’s time to install the NVME cables. These cables will plug into the backplane and route to the rear of the server where they will be plugged into the dedicated NVME riser. Cables that plug in to ports 1 and 2 on the backplane will route to the right side of the server. NVME cables port 3, 4, and 5 will route to the left.

    NVME cables port 1 and 2:

    Here you can see how the cables route along the edge of the chassis:

    NVME cables port 3, 4, and 5

    Now for the last set of cables. These install into their respective ports on the backplane like ports 1 and 2. These cables however will route to the left side of the chassis.

    Installing NVME riser and plugging in cables

    All of these cables now plug in to the NVME riser.

    Installing NDC

    The NDC will install below riser 1. Remove riser 1 and remove any blank slot fillers prior to installation of NDC.

    Installing PCIe card

    With the riser removed it’s time to install any PCIe cards you have. The primary riser has a full height and half height slot available. Here I will install a card in the full height slot:

    Installing power supplies

    The very last thing to do is install the power supplies.

    Cleaning up

    Prior to powering on for the first time ensure everything is in its place. If you removed the fans during installation reinstall them. Ensure all cables are properly routed and neatly tucked in to the side channels. If they’re not, it may be difficult getting the lid back on. If you’ve determined that everything is in order, plug in the power supplies and power the server for the first time.