Cisco UCS C480 M5, Installation And Service Manual

Page 1: ...tion and Service Guide First Published 2017 10 12 Last Modified 2018 06 08 Americas Headquarters Cisco Systems Inc 170 West Tasman Drive San Jose CA 95134 1706 USA http www cisco com Tel 408 526 4000 800 553 NETS 6387 Fax 408 527 0883 ...

Page 2: ...e encouraged to try to correct the interference by using one or more of the following measures Reorient or relocate the receiving antenna Increase the separation between the equipment and receiver Connect the equipment into an outlet on a circuit different from that to which the receiver is connected Consult the dealer or an experienced radio TV technician for help Modifications to this product no...

Page 3: ...ew This chapter provides a summary overview of the Cisco UCS C480 M5 server External Features This topic shows the external features of the server Cisco UCS C480 M5 Server Front Panel Features For definitions of LED states see Front Panel LEDs on page 29 Figure 1 Cisco UCS C480 M5 Server Front Panel Cisco UCS C480 M5 Server Installation and Service Guide 1 ...

Page 4: ...ves Front NVMe drives are not supported in a single CPU module system Bays 11 12 13 14 support SAS SATA drives only 9 Identification button LED 2 Right bay module supports either Optional DVD drive module Drive bays 17 24 shown Bays 17 18 23 24 support SAS SATA or NVMe drives Front NVMe drives are not supported in a single CPU module system Bays 19 20 21 22 support SAS SATA drives only 10 System s...

Page 5: ...el LEDs on page 32 Figure 2 Cisco UCS C480 M5 Server Rear Panel Rear identification button LED 7 Serial port COM 1 DB 9 connector 1 USB 3 0 ports three 8 VGA video port DB 15 connector 2 Power supplies 1 4 hot swappable redundant as 2 2 default or 3 1 See Power Specifications on page 128 for specifications and supported options 9 Not used at this time 3 Threaded holes for dual hole grounding lug 1...

Page 6: ...e related items The Technical Specifications Sheets for all versions of this server which include supported component part numbers are at Cisco UCS Servers Technical Specifications Sheets scroll down to Technical Specifications Serviceable Components Inside the Main Chassis on page 5 Serviceable Components Inside a CPU Module on page 8 Serviceable Components Inside an I O Module on page 9 Cisco UC...

Page 7: ...iceable Components Inside the Main Chassis Figure 3 Serviceable Component Locations Inside the Main Chassis Cisco UCS C480 M5 Server Installation and Service Guide 5 Overview Serviceable Component Locations ...

Page 8: ... drive bays 1 8 Bays 1 2 7 8 support SAS SATA or NVMe drives Front NVMe drives are not supported in a single CPU module system Bays 3 4 5 6 support SAS SATA drives only An NVMe only front drive module is available that supports up to 8 NVMe SSDs You cannot mix this NVMe only module with SAS SATA modules or change module types in the field Note 15 Position of the supercap unit RAID backup for the r...

Page 9: ... page 89 PCIe slot 12 is not available when the auxiliary internal drive cage is used because of internal clearance 8 Power supplies 1 4 hot swappable redundant as 2 2 default or 3 1 All power supplies in the system must be identical no mixing 19 PCIe slot 11 Default slot for rear RAID controller whenthe rear drive module is used with SAS SATA drives In systems with only one CPU module slot 11 is ...

Page 10: ...s in lower bay 1 CPU 4 and heatsink when module is in upper bay 2 The CPUs in CPU module 1 must be identical with the CPUs in CPU module 2 no mixing Note 1 Release levers for module two each module 5 DIMM sockets controlled by CPU 2 or 4 channels G H J K L M See DIMM Population Rules and Memory Performance Guidelines on page 108 for DIMM slot numbering 2 Cisco UCS C480 M5 Server Installation and S...

Page 11: ...le Figure 5 Serviceable Component Locations Inside an I O Module RTC battery vertical socket 3 Micro SD card socket 1 Mini storage module connector Supports either an SD card carrier with two SD card slots or an M 2 SSD carrier with two SATA M 2 SSD slots 2 Summary of Server Features The following table lists a summary of server features Description Feature Four rack unit 4RU chassis Chassis Cisco...

Page 12: ...gh the 1 Gb dedicated management port the 1 Gb 10 Gb Ethernet LAN ports or a Cisco virtual interface card Baseboard management The network and management I O ports for this server are on a removeable I O module One 10 100 1000 Ethernet dedicated management port RJ 45 connector One 10 100 1000 Ethernet private inter chassis port RJ 45 connector Two 1 Gb 10 Gb BASE T Ethernet LAN ports RJ 45 connect...

Page 13: ... a total of 24 front loading drive bays All 24 front drive bays support SAS SATA drives Each of the 3 drive bay modules have 4 bays that support NVMe SSDs for a total of 12 bays that support NVMe SSDs An NVMe only front drive module is available that supports up to 8 NVMe SSDs You cannot mix this NVMe only module with SAS SATA modules or change module types in the field Note Storage front panel Th...

Page 14: ...Ie slot 11 or 10 When NVMe SSDs are populated in the auxiliary drive bays you must have an NVMe switch card in PCIe slot 10 For a detailed list of storage controller options see Supported Storage Controllers and Cables on page 133 Storage management The server supports the following options when RAID cards are installed There is a bracket on the chassis wall for a supercap unit that backs up a fro...

Page 15: ...ries Servers for important safety information Note IMPORTANT SAFETY INSTRUCTIONS This warning symbol means danger You are in a situation that could cause bodily injury Before you work on any equipment be aware of the hazards involved with electrical circuitry and be familiar with standard practices for preventing accidents Use the statement number provided at the end of each warning to locate its ...

Page 16: ...ning This equipment must be grounded Never defeat the ground conductor or operate the equipment in the absence of a suitably installed ground conductor Contact the appropriate electrical inspection authority or an electrician if you are uncertain that suitable grounding is available Statement 1024 Warning For Nordic countries Norway Finland Sweden and Denmark this system must be installed in a Res...

Page 17: ...er use the following guidelines Plan your site configuration and prepare the site before installing the server See the Cisco UCS Site Preparation Guide for the recommended site planning tasks Ensure that there is adequate space around the server to allow for accessing the server and for adequate airflow The airflow in this server is from front to back Ensure that the air conditioning meets the the...

Page 18: ...ons to ensure that the system remains stable The following guidelines are provided to ensure your safety This unit should be mounted at the bottom of the rack if it is the only unit in the rack When mounting this unit in a partially filled rack load the rack from the bottom to the top with the heaviest component at the bottom of the rack If the rack is provided with stabilizing devices install the...

Page 19: ...ing Mechanism Inside of Front End Securing plate shown pulled back to the open position 3 Front mounting pegs 1 Rack post between mounting pegs and opened securing plate 2 Step 3 Install the outer slide rails into the rack a Align one slide rail assembly front end with the front rack post holes that you want to use The slide rail front end wraps around the outside of the rack post and the mounting...

Page 20: ...uipment damage Caution a Align the rear ends of the inner rails that are attached to the server sides with the front ends of the empty slide rails on the rack b Push the inner rails into the slide rails on the rack until they stop at the internal stops c Slide the inner rail release clip toward the rear on both inner rails and then continue pushing the server into the rack until its front slam lat...

Page 21: ...est from server attaches to end of stationary outer slide rail 1 Rear of server 4 CMA tab on arm closest to the server attaches to end of inner slide rail attached to server 2 Step 2 Slide the CMA tab that is closest to the server over the end of the inner rail that is attached to the server Slide the tab over the end of the rail until it clicks and locks Step 3 Pull out the width adjustment slide...

Page 22: ...e metal button on the outside of the tab and pivot the tab 180 degrees so that it points toward the rear of the server Figure 10 Reversing the CMA Metal button on outside of tab 2 CMA tab on end of width adjustment slider 1 Initial Server Setup This section describes how to power on the server assign an IP address and connect to server management when using the server in standalone mode To use the...

Page 23: ...r dedicated management LAN To configure the system remotely you must have a DHCP server on the same network as the system Your DHCP server must be preconfigured with the range of MAC addresses for this server node The MAC address is printed on a label that is on the pull out asset tag on the front panel This server node has a range of six MAC addresses assigned to the Cisco IMC The MAC address pri...

Page 24: ...hree of the following four categories English uppercase letters A through Z English lowercase letters a through z Base 10 digits 0 through 9 Non alphabetic characters _ Step 4 Continue with Setting Up the System With the Cisco IMC Configuration Utility on page 23 Connecting to the Server Remotely For Setup This procedure requires the following equipment One RJ 45 Ethernet cable that is connected t...

Page 25: ...st time that you enter the Cisco IMC Configuration Utility you are prompted to change the default password The default password is password The Strong Password feature is enabled Note The following are the requirements for Strong Password The password can have minimum 8 characters maximum 14 characters The password must not contain the user s name The password must contain characters from three of...

Page 26: ...Active standby or Active active settings Active active default All Ethernet ports are utilized simultaneously The Shared LOM EXT mode must use only this NIC redundancy setting Shared LOM and Cisco Card modes can each use either Active standby or Active active settings Step 3 Choose whether to enable DHCP for dynamic network settings or to enter static network settings Before you enable DHCP you mu...

Page 27: ...enable DHCP the dynamically assigned IP and MAC addresses are displayed on the console screen during bootup Note What to do next Use a browser and the IP address of the Cisco IMC to connect to the Cisco IMC management interface The IP address is based upon the settings that you made either a static address or the address assigned by your DHCP server The factory default username for the server is a...

Page 28: ...by NIC redundancy setting in the following step See also the required VIC Slot setting below This server has the following NIC redundancy settings that you can choose from None The Ethernet ports operate independently and do not fail over if there is a problem This setting can be used only with the Dedicated NIC mode Active standby If an active Ethernet port fails traffic fails over to a standby p...

Page 29: ...ove see the Cisco UCS C Series Documentation Roadmap Accessing the System BIOS Step 1 Enter the BIOS Setup Utility by pressing the F2 key when prompted during bootup The version and build of the current BIOS are displayed on the Main page of the utility Note Step 2 Use the arrow keys to select the BIOS menu page Step 3 Highlight the field to be modified by using the arrow keys Step 4 Press Enter t...

Page 30: ...Cisco UCS C480 M5 Server Installation and Service Guide 28 Installing the Server Accessing the System BIOS ...

Page 31: ...nts Inside the Main Chassis on page 44 Replacing Components Inside a CPU Module on page 94 Replacing Components Inside an I O Module on page 111 Service DIP Switches on page 118 Status LEDs and Buttons This section contains information for interpreting LED states Front Panel LEDs Figure 11 Front Panel LEDs Table 2 Front Panel LEDs Definition of States States LED Name Cisco UCS C480 M5 Server Insta...

Page 32: ...ched At least one CPU is faulty At least one DIMM is faulty At least one drive in a RAID configuration failed Amber blinking The server is in a critical fault state For example Boot failure Fatal processor and or bus error detected Over temperature condition System health 3 Green All power supplies are operating normally Amber steady One or more power supplies are in a degraded operational state A...

Page 33: ...id state drive SSD drive tray LEDs have different behavior than SAS SATA drive trays Note 8 SAS Off There is no hard drive in the hard drive tray no access no fault Green The hard drive is ready Green blinking The hard drive is reading or writing data SAS SATA drive activity LED 9 SAS Off The drive is not in use and can be safely removed Green The drive is in use and functioning properly Green bli...

Page 34: ...ive is idle Green steady The drive is spinning up a disk Green blinking The drive is accessing data DVD drive activity optional DVD module not shown Rear Panel LEDs Figure 12 Rear Panel LEDs Table 3 Rear Panel LEDs Definition of States States LED Name Off Link speed is 100 Mbps Amber Link speed is 1 Gbps Green Link speed is 10 Gbps 1 Gb 10 Gb Ethernet link speed on both LAN1 and LAN2 These ports a...

Page 35: ...wer on Amber blinking Warning threshold detected but 12 V main power on Amber solid Critical error detected 12 V main power off for example over current over voltage or over temperature failure Power supply status one LED each power supply unit 6 Internal Diagnostic LEDs The system has the following internal fault LEDs to help with identifying a failing component Each chassis fan module has a faul...

Page 36: ...RE TO SEE FAULTS 2 Preparing For Component Installation This section includes information and tasks that help prepare the server for component installation Required Equipment For Service Procedures The following tools and equipment are used to perform the procedures in this chapter T 30 Torx driver supplied with replacement CPUs for heatsink removal Cisco UCS C480 M5 Server Installation and Servic...

Page 37: ... Shutting Down Using the Power Button Step 1 Check the color of the Power button LED Amber The server is already in standby mode and you can safely remove power Green The server is in main power mode and must be shut down before you can safely remove power Step 2 Invoke either a graceful shutdown or a hard shutdown To avoid data loss or damage to your operating system you should always invoke a gr...

Page 38: ...raceful shutdown and the server goes to standby mode which is indicated by an amber Power button LED Step 3 If a service procedure instructs you to completely remove power from the server disconnect all power cords from the power supplies in the server Shutting Down Using The Cisco UCS Manager Equipment Tab You must log in with user or admin privileges to perform this task Step 1 In the Navigation...

Page 39: ...ompletely remove power from the server disconnect all power cords from the power supplies in the server Removing the Server Top Cover Step 1 Remove the top cover a If the cover latch is locked use a screwdriver to turn the lock 90 degrees counterclockwise to unlock it b Lift on the end of the latch that has the green finger grip The cover is pushed back to the open position as you lift the latch c...

Page 40: ...ed without shutting down and removing power from the server This type of replacement has two varieties hot swap and hot plug Hot swap replacement You do not have to shut down the component in the software or operating system This applies to the following components SAS SATA hard drives SAS SATA solid state drives Cooling fan modules Power supplies when redundant as 2 2 or 1 1 Cisco UCS C480 M5 Ser...

Page 41: ...ecifications Sheets for all versions of this server which include supported component part numbers are at Cisco UCS Servers Technical Specifications Sheets scroll down to Technical Specifications Serviceable Components Inside the Main Chassis on page 40 Serviceable Components Inside a CPU Module on page 43 Serviceable Components Inside an I O Module on page 44 Cisco UCS C480 M5 Server Installation...

Page 42: ...Components Inside the Main Chassis Figure 15 Serviceable Component Locations Inside the Main Chassis Cisco UCS C480 M5 Server Installation and Service Guide 40 Maintaining the Server Serviceable Component Locations ...

Page 43: ...bays 1 8 Bays 1 2 7 8 support SAS SATA or NVMe drives Front NVMe drives are not supported in a single CPU module system Bays 3 4 5 6 support SAS SATA drives only An NVMe only front drive module is available that supports up to 8 NVMe SSDs You cannot mix this NVMe only module with SAS SATA modules or change module types in the field Note 15 Position of the supercap unit RAID backup for the rear RAI...

Page 44: ...9 PCIe slot 12 is not available when the auxiliary internal drive cage is used because of internal clearance 8 Power supplies 1 4 hot swappable redundant as 2 2 default or 3 1 All power supplies in the system must be identical no mixing 19 PCIe slot 11 Default slot for rear RAID controller whenthe rear drive module is used with SAS SATA drives In systems with only one CPU module slot 11 is not sup...

Page 45: ...wer bay 1 CPU 4 and heatsink when module is in upper bay 2 The CPUs in CPU module 1 must be identical with the CPUs in CPU module 2 no mixing Note 1 Release levers for module two each module 5 DIMM sockets controlled by CPU 2 or 4 channels G H J K L M See DIMM Population Rules and Memory Performance Guidelines on page 108 for DIMM slot numbering 2 Cisco UCS C480 M5 Server Installation and Service ...

Page 46: ...ard carrier with two SD card slots or an M 2 SSD carrier with two SATA M 2 SSD slots 2 Replacing Components Inside the Main Chassis Blank faceplates and cover panels serve three important functions they prevent exposure to hazardous voltages and currents inside the chassis they contain electromagnetic interference EMI that might disrupt other equipment and they direct the flow of cooling air throu...

Page 47: ...n operate with one or two CPU modules If you have only one CPU module populate lower bay 1 first If no CPU module is present in upper bay 2 you must insert a blank filler module or the system will not boot The following restrictions apply when using only a two CPU configuration CPU module 2 is not present The maximum number of DIMMs is 24 only CPU 1 and CPU 2 memory channels Some PCIe slots are un...

Page 48: ...t LED 3 Ejector levers two each CPU module 1 CPU module power status LED 2 Step 3 If you are moving CPUs from the old CPU module to the new CPU module see Moving an M5 Generation CPU on page 103 Step 4 If you are moving DIMMs from the old CPU module to the new CPU module perform the following steps a Open the ejector lever at each end of the DIMM slot and pick the DIMM straight up from the old CPU...

Page 49: ...ation Guidelines The front drives in the server are installed into three removable drive bay modules Figure 19 Drive Bay Numbering SAS SATA NVMe drive bay modules UCSC C480 8HDD Left drive bay module Bays 1 2 7 8 support SAS SATA or NVMe drives bays 3 4 5 6 support SAS SATA drives only Front NVMe drives are not supported in a system with only one CPU module Note Center drive bay module Bays 9 10 1...

Page 50: ...Up UEFI Mode Booting in the BIOS Setup Utility Step 1 Enter the BIOS setup utility by pressing the F2 key when prompted during bootup Step 2 Go to the Boot Options tab Step 3 Set UEFI Boot Options to Enabled Step 4 Under Boot Option Priorities set your OS installation media such as a virtual DVD as your Boot Option 1 Step 5 Go to the Advanced tab Step 6 Select LOM and PCIe Slot Configuration Step ...

Page 51: ... hot swappable Note Step 1 Remove the drive that you are replacing or remove a blank drive tray from the bay a Press the release button on the face of the drive tray b Grasp and open the ejector lever and then pull the drive tray out of the slot c If you are replacing an existing drive remove the four drive tray screws that secure the drive to the tray and then lift the drive out of the tray Step ...

Page 52: ...ives You do not have to shut down the server or drive to replace SAS SATA hard drives or SSDs because they are hot swappable Note Rear SAS SATA Drive Population Guidelines The server supports an internal rear drive module that holds up to eight 2 5 inch drives Cisco UCS C480 M5 Server Installation and Service Guide 50 Maintaining the Server Replacing Rear Internal SAS SATA Drives ...

Page 53: ... is when you create a logical volume it must contain all SAS SATA hard drives or all SAS SATA SSDs See also 4K Sector Format SAS SATA Drives Considerations on page 48 Note Figure 21 Internal Drive Module Bays Top View Rear SAS SATA Drive Requirements Observe these requirements The optional rear drive module UCSC C480 8HDD The rear drive module requires minimum Cisco IMC and BIOS 3 1 3 or later The...

Page 54: ...as described in Removing the Server Top Cover on page 37 Step 2 Remove the drive that you are replacing or remove a blank drive tray from the bay a Press the release button on the face of the drive tray b Grasp and open the ejector lever and then pull the drive tray up out of the bay c If you are replacing an existing drive remove the four drive tray screws that secure the drive to the tray and th...

Page 55: ...t insertion and hot removal must be enabled in the system BIOS See Enabling Hot Plug Support in the System BIOS on page 55 Note OS surprise removal is not supported OS informed hot insertion and hot removal are supported on all supported operating systems except VMware ESXi Note Cisco UCS C480 M5 Server Installation and Service Guide 53 Maintaining the Server Replacing Front Loading NVMe SSDs ...

Page 56: ... C480 8HDD SAS SATA NVMe drive bay modules that support up to four NVMe drives each Left drive bay module Bays 1 2 7 8 support SAS SATA or NVMe drives bays 3 4 5 6 support SAS SATA drives only Front NVMe drives are not supported in a single CPU module system Center drive bay module Bays 9 10 15 16 support SAS SATA or NVMe drives bays 11 12 13 14 support SAS SATA drives only Front NVMe drives are n...

Page 57: ...HHHL form factor SSDs in the same system but the same partner brand must be used For example two Intel NVMe SFF 2 5 inch SSDs and two HGST HHHL form factor SSDs is an invalid configuration A valid configuration is two HGST NVMe SFF 2 5 inch SSDs and two HGST HHHL form factor SSDs UEFI boot is supported in all supported operating systems Hot insertion and hot removal are supported in all supported ...

Page 58: ...hut down the drive and then observe the drive tray LED Green The drive is in use and functioning properly Do not remove Green blinking the driver is unloading following a shutdown command Do not remove Off The drive is not in use and can be safely removed b Press the release button on the face of the drive tray c Grasp and open the ejector lever and then pull the drive tray out of the slot d Remov...

Page 59: ...is initializing following hot plug insertion Green The drive is in use and functioning properly Figure 24 Replacing a Drive in a Drive Tray Drive tray screws two on each side 3 Ejector lever 1 Drive removed from drive tray 4 Release button 2 Cisco UCS C480 M5 Server Installation and Service Guide 57 Maintaining the Server Replacing a Front Loading NVMe SSD ...

Page 60: ...state drives SSDs in the internal rear drive bay module Rear NVMe SSD Population Guidelines The server supports an rear internal drive bay module that holds up to eight 2 5 inch drives When using NVMe drives the eight drives must be all NVMe no mixing with SAS SATA drives is allowed When populating drives add drives to the lowest numbered bays first Keep an empty drive blanking tray in any unused ...

Page 61: ... form factor SSDs is an invalid configuration A valid configuration is two HGST NVMe SFF 2 5 inch SSDs and two HGST HHHL form factor SSDs UEFI boot is supported in all supported operating systems Hot insertion and hot removal are supported in all supported operating systems except VMWare ESXi Replacing a Rear Internal NVMe Drive This topic describes how to replace 2 5 inch form factor NVMe SSDs in...

Page 62: ...new drive a Place a new drive in the empty drive tray and install the four drive tray screws b With the ejector lever on the drive tray open insert the drive tray into the empty drive bay c Push the tray into the slot until it touches the backplane and then close the ejector lever to lock the drive in place Step 4 Observe the drive tray LED and wait until it returns to solid green before accessing...

Page 63: ...placing half height half length HHHL form factor NVMe SSDs in the PCIe slots HHHL SSD Population Guidelines Observe the following population guidelines when installing HHHL form factor NVMe SSDs Dual CPU Module systems You can populate up to 12 HHHL form factor SSDs using PCIe slots 1 12 Cisco UCS C480 M5 Server Installation and Service Guide 61 Maintaining the Server Replacing HHHL Form Factor NV...

Page 64: ...the PCIe bus You can combine NVMe SFF 2 5 or 3 5 inch SSDs and HHHL form factor SSDs in the same system but the same partner brand must be used For example two Intel NVMe SFF 2 5 inch SSDs and two HGST HHHL form factor SSDs is an invalid configuration A valid configuration is two HGST NVMe SFF 2 5 inch SSDs and two HGST HHHL form factor SSDs Replacing HHHL NVMe Drives Step 1 Prepare the server for...

Page 65: ... the PCIe slots Push the wire locking latching back to the forward locked position Step 4 Replace the top cover to the server Step 5 Reconnect power cords to all power supplies and then allow the server to boot to standby power mode indicated when the front panel Power button LED lights amber Step 6 Fully power on the server by pressing the Power button Figure 27 PCIe Slot Hinged Retainer Bars Wir...

Page 66: ...the front of the chassis e Pull the module and its attached interposer board out the front of the chassis and then set it aside Step 6 Install a new drive module a Insert the new module with attached interposer into the opening in the chassis front b Gently slide the module into the opening ensuring that the connector on the end of the interposer board engages with the socket on the chassis midpla...

Page 67: ...Figure 28 Front Drive Bay Module Securing Screws CPU Modules Removed Cisco UCS C480 M5 Server Installation and Service Guide 65 Maintaining the Server Replacing a Front Drive Bay Module ...

Page 68: ...earance If you cannot safely view and access the component remove the server from the rack Caution c Remove the top cover from the server as described in Removing the Server Top Cover on page 37 Step 2 Remove all CPU modules from the chassis to provide clearance a Grasp the two ejector levers on the module and pinch their latches to release the levers b Rotate both levers to the outside at the sam...

Page 69: ...er button Step 9 If your server is running in standalone mode use the Cisco UCS Host Upgrade Utility to update the controller firmware and program the correct suboem id for the controller For servers running in standalone mode only After you replace front controller hardware UCSC RAID M5HD you must run the Cisco UCS Host Upgrade Utility HUU to update the controller firmware even if the firmware Cu...

Page 70: ...ed 1 Metal retainer plate securing screws 2 Replacing the Front RAID Supercap Unit This server supports installation of up to two supercap units one for a front RAID controller and one for a rear RAID controller The front supercap unit mounts to a bracket on the inner chassis wall below the CPU modules Cisco UCS C480 M5 Server Installation and Service Guide 68 Maintaining the Server Replacing the ...

Page 71: ...midplane connectors c Pull the module straight out from the chassis and then set it on an antistatic surface Step 3 Remove an existing supercap unit a Disconnect the supercap cable from the existing supercap b Lift gently on the top securing tab that holds the supercap unit to its bracket c Lift the supercap unit free of the bracket and set it aside Step 4 Install a new supercap unit a Lift gently...

Page 72: ...Figure 30 Front Supercap Bracket Location Below CPU Modules Cisco UCS C480 M5 Server Installation and Service Guide 70 Maintaining the Server Replacing the Front RAID Supercap Unit ...

Page 73: ...Cisco UCS C480 M5 Server Installation and Service Guide 71 Maintaining the Server Replacing the Front RAID Supercap Unit ...

Page 74: ...ffuser Lift straight up on the diffuser and set it aside It is not necessary to remove the rear supercap unit from the diffuser c Disconnect any cable from a RAID controller or NVMe switch card from the module connectors d Loosen the two screws that secure the module to the chassis e Grasp the module at each end and lift up evenly to disengage its connector from the socket on the motherboard Step ...

Page 75: ...ivs are installed in the rear drive module 1 Two drive module securing screws 5 Diffuser alignment points against the chassis mid brace 2 Rear RAID supercap unit location on the inside surface of the diffuser 3 Replacing an Air Diffuser on the Rear Drive Module The air diffuser UCSC BAFF C480 M5 must be installed on the rear drive module when SAS SATA hard drives or solid state drives are installe...

Page 76: ...its clip and set it aside Do not disconnect the supercap cable Step 3 Install the new air diffuser a Set the supercap unit into the clip on the inside of the air diffuser and push gently until it clicks in place and is secured b Position SAS and supercap cables so that they do not interfere with the diffuser installation Cables must route out the rear of the diffuser c Set the air diffuser in plac...

Page 77: ...ID Supercap Unit This server supports installation of up to two supercap units one for a front RAID controller and one for a rear RAID controller The rear supercap unit mounts to a clip on the air diffuser that wraps around the internal drive module The supercap provides approximately three years of backup for the disk write back cache DRAM in the case of a sudden power loss by offloading the cach...

Page 78: ...assis mid brace b Remove the supercap unit from the clip that is on the inside of the air diffuser c Disconnect the supercap cable from the rear RAID controller Step 3 Install a new supercap a Set the new supercap unit into the clip on the inside of the air diffuser and push gently until it clicks in place and is secured b Connect the supercap cable to the rear RAID controller card c Position SAS ...

Page 79: ...ntroller card for control of up to eight internal SAS SATA drives in the optional auxiliary drive module The default slot for a rear RAID controller is PCIe slot 11 However in a single CPU module system slot 11 is not supported In this case install the rear RAID controller in PCIe slot 10 and install the required blank filler to PCIe slot 11 to ensure adequate air flow Note For detailed informatio...

Page 80: ...ingertips to pull back on the wire locking latches at each end of the retainer bar and then hinge the bar open to expose the tops of the PCIe slots See Replacing a PCIe Card on page 91 c Open the card s blue ejector lever to unseat it from the slot d Pull both ends of the card vertically to disengage the card from the socket and then set it aside Step 3 Install a new rear RAID controller card a Ca...

Page 81: ... NVMe switch card in PCIe slot 10 A PCIe cable connects the switch card to the drive bay module backplane If a rear NVMe switch card is used it must be installed in PCIe slot 10 Note Step 1 Prepare the server for component installation a Shut down and remove power from the server as described in Shutting Down and Removing Power From the Server on page 35 b Slide the server out the front of the rac...

Page 82: ... corners of the card to seat its connector in the socket c Fully close the blue ejector lever on the card to lock the card into the socket d Connect the PCIe cable CBL AUX NVME M5 from the internal drive module backplane to the new switch card e Close the hinged retainer bar over the top of the PCIe slots Use your fingertips to pull back on the wire locking latches at each end of the retainer bar ...

Page 83: ...sting fan module a Slide the server out the front of the rack far enough so that you can remove the top cover You might have to detach cables from the rear panel to provide clearance If you cannot safely view and access the component remove the server from the rack Caution b Remove the top cover from the server as described in Removing the Server Top Cover on page 37 c Grasp and squeeze the fan mo...

Page 84: ...s powered on because of the potential for data loss Caution Step 1 Remove an existing internal USB drive a Shut down and remove power from the server as described in Shutting Down and Removing Power From the Server on page 35 b Slide the server out the front of the rack far enough so that you can remove the top cover You might have to detach cables from the rear panel to provide clearance If you c...

Page 85: ...andby power mode indicated when the front panel Power button LED lights amber Step 4 Fully power on the server by pressing the Power button Figure 37 Internal USB 2 0 Socket Location Location of horizontal USB socket on motherboard 1 Enabling or Disabling the Internal USB Port The factory default is that all USB ports on the server are enabled However the internal USB port can be enabled or disabl...

Page 86: ...isting TPM in the server you can install TPM 2 0 If the TPM 2 0 becomes unresponsive reboot the server Installing and Enabling a TPM Field replacement of a TPM is not supported you can install a TPM after factory only if the server does not already have a TPM installed Note This topic contains the following procedures which must be followed in this order when installing and enabling a TPM 1 Instal...

Page 87: ... hole that is adjacent to the TPM socket c Push down evenly on the TPM to seat it in the motherboard socket d Install the single one way screw that secures the TPM to the motherboard Step 3 Replace the cover to the server Step 4 Reconnect power cords to all power supplies and then allow the server to boot to standby power mode indicated when the front panel Power button LED lights amber Step 5 Ful...

Page 88: ...ed Step 3 Continue with Enabling the Intel TXT Feature in the BIOS on page 86 Enabling the Intel TXT Feature in the BIOS Intel Trusted Execution Technology TXT provides greater protection for information that is used and stored on the business server A key aspect of that protection is the provision of an isolated execution environment and associated sections of memory where operations can be condu...

Page 89: ...ave to detach cables from the rear panel to provide clearance If you cannot safely view and access the component remove the server from the rack Caution c Remove the top cover from the server as described in Removing the Server Top Cover on page 37 Step 2 Remove an existing intrusion switch a Disconnect the intrusion switch cable from the socket on the motherboard b Use a 1 Phillips head screwdriv...

Page 90: ... rack or remove the server cover Note See also Power Specifications on page 128 for more information about the supported power supplies See also Rear Panel LEDs on page 32 for information about the power supply LEDs Replacing AC Power Supplies Do not mix power supply types or wattages in the server All power supplies must be identical Note Step 1 Remove the power supply that you are replacing or a...

Page 91: ...Cisco PCIe cards not qualified or sold by Cisco are the responsibility of the customer Although Cisco will always stand behind and support the C Series rack mount servers customers using standard off the shelf third party cards must go to the third party card vendor for support if any issue with that particular card occurs Note PCIe Slot Specifications and Restrictions The server provides 12 PCIe ...

Page 92: ...Support NCSI Support Card Height Rear Panel Opening Maximum Card Length Connector Length Electrical Lane Width Slot Number Yes primary slot Yes Yes Full height Full length x24 connector Gen 3 x16 1 Cisco UCS C480 M5 Server Installation and Service Guide 90 Maintaining the Server PCIe Slot Specifications and Restrictions ...

Page 93: ... Control of the PCIe sockets is divided between the CPUs that are present in the system Some PCIe slots are not available if your system does not have CPU module 2 installed If your system has four CPUs all PCIe slots are supported If your system has only two CPUs CPU module 2 is not present see the following table for the PCIe slots that are supported PCIe Slots Controlled by CPU Module 2 CPUs 3 ...

Page 94: ...PCIe slots b Pull both ends of the card vertically to disengage the card from the socket and then set it aside Step 3 Install a new PCIe card a Carefully align the card edge with the socket while you align the card s rear tab with the rear panel opening b Push down on both corners of the card to seat its edge connector in the socket c Close the hinged retainer bar over the top of the PCIe slots Us...

Page 95: ...ion see also the Installation For Cisco UCS Manager Integration on page 161 for details about supported configurations cabling and other requirements Table 5 VIC Support and Considerations in This Server Minimum Cisco IMC Firmware Primary Slot For Cisco Card NIC Mode Primary Slot For Cisco UCS Manager Integration Slots That Support VICs How Many Supported in Server VIC 3 1 2 PCIe 1 PCIe 1 PCIe 1 8...

Page 96: ...and Heatsinks This section contains information for replacing CPUs and heatsinks inside a CPU module CPU Configuration Rules The CPUs in this server install to sockets inside one or two removable CPU modules Each CPU module has two CPU sockets The system numbers the CPUs in CPU module 1 the lower bay as CPU 1 and CPU 2 The system numbers the CPUs in CPU module 2 the upper bay as CPU 3 and CPU 4 Fi...

Page 97: ... 5 8 9 10 Only four double wide GPUs are supported in PCIe slots 1 2 8 and 10 No front NVMe drives are supported The optional NVMe only drive bay module UCSC C480 8NVME is not supported If a rear RAID controller is used it must be installed in PCIe slot 10 rather than the default slot 11 A blank filler must be installed in slot 11 Tools Required For CPU Replacement You need the following tools and...

Page 98: ...LED on the front of the CPU module is off before removing the module Note a Grasp the two ejector levers on the front of the CPU module and pinch their latches to release the levers b Rotate both levers to the outside at the same time to evenly disengage the module from the midplane connectors c Pull the module straight out from the chassis and then set it on an antistatic surface Step 3 Remove th...

Page 99: ...om the CPU assembly the CPU assembly includes the CPU and the plastic CPU carrier a Place the heatsink with CPU assembly so that it is oriented upside down as shown in the following figure Note the thermal interface material TIM breaker location TIM BREAKER is stamped on the CPU carrier next to a small slot Cisco UCS C480 M5 Server Installation and Service Guide 97 Maintaining the Server Replacing...

Page 100: ...e TIM breaker slot Use caution to avoid damaging the heatsink surface Note d Gently rotate the screwdriver to lift up on the CPU until the TIM on the heatsink separates from the CPU Do not allow the screwdriver tip to touch or damage the green CPU substrate Note e Pinch the CPU carrier clip at the corner opposite the TIM breaker and push up to disengage the clip from its slot in the heatsink corne...

Page 101: ... with extreme care to avoid damaging pins Caution Figure 46 CPU Assembly Tool CPU Assembly and Heatsink Alignment Features Angled corner on heatsink pin 1 alignment feature 4 CPU assembly tool 1 Triangle cut into plastic carrier pin 1 alignment feature 5 CPU assembly CPU in plastic carrier frame 2 Angled corner on CPU assembly tool pin 1 alignment feature 6 Heatsink 3 Step 6 Apply new TIM to the h...

Page 102: ...re even coverage Figure 47 Thermal Interface Material Application Pattern Step 7 With the CPU assembly on the CPU assembly tool set the heatsink onto the CPU assembly Note the Pin 1 alignment features for correct orientation Push down gently until you hear the corner clips of the CPU carrier click onto the heatsink corners In the following step use extreme care to avoid touching or damaging the CP...

Page 103: ...tsink nuts in the order shown on the heatsink label 1 2 3 4 The captive nuts must be fully tightened so that the leaf springs on the CPU socket lie flat Note Step 9 Return the CPU module to the chassis a With the two ejector levers open align the CPU module with an empty bay b Push the module into the bay until it engages with the midplane connectors and is flush with the chassis front c Rotate bo...

Page 104: ... EX Heat sink cleaning kit UCSX HSCK Scenario 3 You have a damaged CPU carrier the plastic frame around the CPU CPU Carrier UCS M5 CPU CAR 1 flat head screwdriver for separating the CPU from the heatsink Heatsink cleaning kit UCSX HSCK Thermal interface material TIM kit for M5 servers UCS CPU TIM A CPU heatsink cleaning kit is good for up to four CPU and heatsink cleanings The cleaning kit contain...

Page 105: ...tect the socket pins from damage during shipping You must transfer these covers to the system that you are returning as described in this procedure Caution Step 1 When moving an M5 CPU to a new server you do not have to separate the heatsink from the CPU Perform the following steps a Use a T 30 Torx driver to loosen the four captive nuts that secure the assembly to the board standoffs Alternate lo...

Page 106: ...ers from the new system to the system that you are returning a Remove the socket covers from the replacement system Grasp the two recessed finger grip areas marked REMOVE and lift straight up Keep a firm grasp on the finger grip areas at both ends of the cover Do not make contact with the CPU socket pins Note Cisco UCS C480 M5 Server Installation and Service Guide 104 Maintaining the Server Moving...

Page 107: ... the cover except the two points described Pressing elsewhere might damage the socket pins Caution c Press down on the two circular markings next to the word INSTALL that are closest to the two threaded posts see the following figure Press until you feel and hear a click You must press until you feel and hear a click to ensure that the dust covers do not come loose during shipping Note Cisco UCS C...

Page 108: ...oard align the assembly over the CPU socket as shown below Note the alignment features The pin 1 angled corner on the heatsink must align with the pin 1 angled corner on the CPU socket The CPU socket posts must align with the guide holes in the assembly Cisco UCS C480 M5 Server Installation and Service Guide 106 Maintaining the Server Moving an M5 Generation CPU ...

Page 109: ...ur captive nuts that secure the heatsink to the board standoffs Alternate tightening the heatsink nuts evenly so that the heatsink remains level while it is lowered Tighten the heatsink nuts in the order shown on the heatsink label 1 2 3 4 The captive nuts must be fully tightened so that the leaf springs on the CPU socket lie flat Note Replacing Memory DIMMs DIMMs and their sockets are fragile and...

Page 110: ... the CPU module board When a CPU module is in bay 1 the lower bay the system numbers the CPUs as CPU 1 and CPU 2 When a CPU module is in bay 2 the upper bay the system numbers the CPUs as CPU 3 and CPU 4 Figure 53 DIMM Slot Numbering DIMM Population Rules Observe the following guidelines when installing or replacing DIMMs for maximum performance Each CPU supports six memory channels CPU 1 3 suppor...

Page 111: ...ed by any one CPU is 768 GB To populate the 12 DIMM slots with more than 768 GB of combined memory you must use a high memory CPU that has a PID that ends with an M for example UCS CPU 6134M All DIMMs must be DDR4 DIMMs that support ECC Non buffered UDIMMs and non ECC DIMMs are not supported Memory mirroring reduces the amount of memory available by 50 percent because only one of the two populated...

Page 112: ...ault LED directly in front of the DIMM socket See Internal Diagnostic LEDs on page 33 for the locations of these LEDs Step 1 Caution Never remove a CPU module without shutting down and removing power from the server Prepare the server for component removal a Shut down and remove power from the server as described in Shutting Down and Removing Power From the Server on page 35 You do not have to pul...

Page 113: ...upplies and then allow the server to boot to standby power mode indicated when the front panel Power button LED lights amber Step 7 Fully power on the server by pressing the Power button Verify that the power LED on the front of the CPU module returns to solid green Note Replacing Components Inside an I O Module When handling server components handle them only by carrier edges and use an electrost...

Page 114: ...erver out of the rack or remove the server cover because the I O module is accessible from the rear of the server Note Step 2 Remove an I O module from the chassis a Disconnect any cables from the ports on the I O module b Push down on the locking clip on the I O module s ejector handle and then hinge the handle upward to disengage the module s connector from the chassis midplane c Pull the module...

Page 115: ...There is one socket for a Micro SD card on the I O module board Never remove a CPU module without shutting down and removing power from the server Caution Step 1 Prepare the server for component removal a Shut down and remove power from the server as described in Shutting Down and Removing Power From the Server on page 35 You do not have to pull the server out of the rack or remove the server cove...

Page 116: ...c Hinge the ejector handle down until it sits flat and its locking clip clicks The module face mst be flush with the rear panel of the chassis d Reconnect cables to the ports on the I O module Step 6 Reconnect power cords to all power supplies and then allow the server to boot to standby power mode indicated when the front panel Power button LED lights amber Step 7 Fully power on the server by pre...

Page 117: ...hinge the handle upward to disengage the module s connector from the chassis midplane c Pull the module straight out from the chassis and then set it on an antistatic surface Step 3 Remove a carrier from its socket a Locate the mini storage module carrier b Push outward on the securing clips that holds each end of the carrier c Lift both ends of the carrier to disengage it from the socket on the m...

Page 118: ... indicated when the front panel Power button LED lights amber Step 7 Fully power on the server by pressing the Power button Replacing an SD Card in a Mini Storage Carrier For SD This topic describes how to remove and replace an SD card in a mini storage carrier for SD UCS MSTOR SD The carrier has one SD card socket on its top and one socket on its underside Population Rules For Mini Storage SD Car...

Page 119: ... 2 UCS MSTOR M2 The carrier has one M 2 SSD socket on its top and one socket on its underside Population Rules For Mini Storage M 2 SSDs You can use one or two M 2 SSDs in the carrier M 2 slot 1 is on the top side of the carrier M 2 slot 2 is on the underside of the carrier the same side as the carrier s motherboard connector If you use the server s embedded software RAID controller with M 2 SATA ...

Page 120: ...t the new M 2 SSD connector end into the socket on the carrier with its label side facing up b Press the M 2 SSD flat against the carrier c Install the single screw that secures the end of the M 2 SSD to the carrier Step 4 Install the mini storage module carrier back into the server and then power it on as described in Replacing a Mini Storage Module Carrier on page 115 Service DIP Switches This s...

Page 121: ...ge 7 10 Reset Cisco IMC to factory defaults 6 11 Reset Cisco IMC password to default 3 14 Clear CMOS 2 15 Recover BIOS 1 16 Password clear Using the Clear Password Switch Positions 1 16 You can use this switch to clear the administrator password Cisco UCS C480 M5 Server Installation and Service Guide 119 Maintaining the Server Using the Clear Password Switch Positions 1 16 ...

Page 122: ...ver to standby power mode Step 9 Remove AC power cords from the server to remove all power Step 10 Remove the top cover from the server Step 11 Move the DIP switch back to its default off position If you do return the switch back to the default open position the password is cleared every time you power cycle the server Note Step 12 Replace the top cover to the server Step 13 Reconnect power cords ...

Page 123: ... and then remove the USB drive from the server During the BIOS update Cisco IMC shuts down the server and the screen goes blank for about 10 minutes Do not unplug the power cords during this update Cisco IMC powers on the server after the update is complete Note Procedure 2 Use BIOS Recovery Switch and recovery cap File Step 1 Download the BIOS update package and extract it to a temporary location...

Page 124: ...position If you do not return the switch to the default open position after recovery completion you see the prompt Please remove the recovery jumper Note Step 13 Replace the top cover to the server Step 14 Reconnect power cords to all power supplies and then allow the server to boot to standby power mode Step 15 Fully power on the server to main power by pressing the Power button Using the Clear C...

Page 125: ...ault Switch Positions 6 11 You can use this Cisco IMC debug switch to force the Cisco IMC password back to the default Step 1 Shut down and remove power from the server as described in Shutting Down and Removing Power From the Server on page 35 Disconnect power cords from all power supplies Step 2 Slide the server out the front of the rack far enough so that you can remove the top cover You might ...

Page 126: ... 4 Locate DIP switch block SW1 and the switch for pins 7 10 see Figure 57 Location of DIP Switches on Chassis Motherboard on page 119 Step 5 Move the DIP switch from position 7 to the closed on position Step 6 Reinstall the top cover and reconnect AC power cords to the server The server powers up to standby power mode indicated when the Power LED on the front panel is amber You do not have to retu...

Page 127: ...ode indicated when the Power LED on the front panel is amber You do not have to return the server to main power for the change to take effect Only Cisco IMC the BMC must reboot The change takes effect after Cisco IMC finishes booting When you next log in to Cisco IMC you see a message similar to the following Boot from alternate image debug functionality is enabled CIMC will boot from alternate im...

Page 128: ...Cisco UCS C480 M5 Server Installation and Service Guide 126 Maintaining the Server Using the Boot Alternate Cisco IMC Image Switch Positions 8 9 ...

Page 129: ...128 Physical Specifications The following table lists the physical specifications for the server versions Table 8 Physical Specifications Specification Description 7 0 in 177 8 mm 4 rack unit 4RU Height 19 0 in 482 6 mm Width 31 0 in 830 0 mm Depth length including front handles and power supplies 146 lb 66 2 Kg Maximum weight fully loaded chassis Environmental Specifications The following table l...

Page 130: ...mum configuration 70 5 dBA Sound pressure level Measure A weighted per ISO7779 LpAm dBA Minimum configuration 7 08 bels Typical configuration 7 67 bels Maximum configuration 8 24 bels Sound power Power Specifications Do not mix power supply types or wattages in the server Both power supplies must be identical Note You can get more specific power information for your exact server configuration by u...

Page 131: ...ciency 80Plus Platinum certified Efficiency rating RSP2 Form factor IEC320 C14 Input connector Power Cord Specifications Each power supply in the server has a power cord Standard power cords or jumper power cords are available for connection to the server The shorter jumper power cords for use in racks are available as an optional alternative to the standard power cords Only the approved power cor...

Page 132: ...ael 2 5 8 2 CAB 250V 10A CN AC power cord 250 V 10 A PR China 2 3 7 5 CAB ACTW AC power cord 250 V 10 A Taiwan 2 5 8 2 CAB 9K10A AU AC power cord 250 V 10 A 3112 plug Australia 2 5 8 2 CAB 250V 10A ID AC power Cord 250 V 10 A India 2 5 8 2 CAB 9K10A SW AC power cord 250 V 10 A MP232 plug Switzerland 2 5 8 2 CAB 250V 10A BR AC power Cord 250 V 10 A Brazil Cisco UCS C480 M5 Server Installation and S...

Page 133: ...3 AC power cord NEMA L6 20 to C13 connectors 2 5 8 2 CAB 9K10A IT AC power cord 250 V 10 A CEI 23 16 VII plug Italy NA NA R2XX DMYMPWRCORD No power cord PID option for ordering server with no power cord Cisco UCS C480 M5 Server Installation and Service Guide 131 Server Specifications Server Specifications ...

Page 134: ...Cisco UCS C480 M5 Server Installation and Service Guide 132 Server Specifications Server Specifications ...

Page 135: ...front and rear Optionally the server has a software based SATA RAID controller embedded in the system that you can use to control two internal M 2 SATA SSDs NVMe PCIe SSDs cannot be controlled by a SAS SATA RAID controller Note This server supports the RAID controller options and cable requirements shown in the following table Required SAS Cables Optional Supercap Backup RAID Levels Maximum Drives...

Page 136: ...ears of backup for the disk write back cache DRAM in the case of a sudden power loss by offloading the cache to the NAND flash For supercap unit replacement instructions see Replacing the Front RAID Supercap Unit on page 68 Write CachePolicyforCisco12GSASModularRAIDControllers For this server and other Cisco Generation M5 servers the default write cache policy for the Cisco Modular RAID controller...

Page 137: ...Modular SAS RAID Controller With 4 GB Cache UCSC RAID M5HD This hardware RAID option can control up to 24 front loading SAS SATA drives The card plugs into a dedicated horizontal socket on the drive midplane SAS SATA cables are used to connect the controller to the backplanes of the front drive modules 1 Cable card connectors A1 and A2 to the two connectors on front drive module 1 2 Cable card con...

Page 138: ...W RAID controller Note Embbeded SATA RAID Requirements The embedded SATA RAID controller requires the following items The embedded SATA RAID controller must be enabled in the server BIOS If you ordered the server with embedded SATA RAID it is enabled at the factory M 2 mini storage module with two SATA M 2 SSDs The software RAID controller requires UEFI boot mode Legacy boot mode is not supported ...

Page 139: ...ead the sSATA controller is automatically disabled Each controller is listed separately in the BIOS You can enable or disable the controllers in the BIOS See Enabling SATA Mode on page 137 Enabling SATA Mode This procedure uses the server s BIOS Setup Utility Step 1 Set the SATA mode a Boot the server and press F2 when prompted to enter the BIOS Setup utility b Choose the Advanced tab and then cho...

Page 140: ...SR drivers for the following supported operating systems Microsoft Windows Server Red Hat Enterprise Linux RHEL SUSE Linux Enterprise Server SLES For the specific supported OS versions see the Hardware and Software Compatibility Matrix for your server release Downloading the MegaSR Drivers The MegaSR drivers are included in the C Series driver ISO for your server and OS Step 1 Find the drivers ISO...

Page 141: ...he server if the server does not have a DVD drive installed and then insert the first Windows installation disk into the DVD drive Skip to Step 6 To install from remote ISO log in to the server s Cisco IMC interface and continue with the next step Step 4 Launch a Virtual KVM console window and click the Virtual Media tab a Click Add Image and browse to select your remote Windows installation ISO f...

Page 142: ...t image for the embedded MegaRAID stack The LSI MegaSR drivers that Cisco provides for Red Hat Linux and SUSE Linux are for the original GA versions of those distributions The drivers do not support updates to those OS kernels Note Preparing Physical Thumb Drive for Linux This topic describes how to prepare physical Linux thumb drive from the driver image files This procedure requires a CD or DVD ...

Page 143: ...tance for the sSATA embedded controller LSI Software RAID Configuration Utility sSATA Step 1 Prepare the dud img file using one of the following methods To install from physical disk use the procedure in Preparing Physical Thumb Drive for Linux on page 140 then continue with step 4 To install from virtual disk download the Cisco UCS C Series drivers ISO as described in Downloading the MegaSR Drive...

Page 144: ...inux dd blacklist isci blacklist ahci nodmraid noprobe ata1 noprobe ata2 Note Step 9 Press Enter The prompt asks whether you have a driver disk Step 10 Use the arrow key to choose Yes and then press Enter Step 11 Choose fd0 to indicate that you have a disk with the driver on it Step 12 Do one of the following actions f you prepared the dud img file on a physical thumb drive insert the thumb drive ...

Page 145: ...kstation Step 3 Start the Linux driver installation using one of the following methods To install from local media connect an external USB DVD drive to the server if the server does not have a DVD drive installed and then insert the first RHEL installation disk into the drive Then continue with Step 6 To install from remote ISO log in to the server s Cisco IMC interface Then continue with the next...

Page 146: ... wizard to complete the installation Step 16 Reboot the target server For More RAID Utility Information The Broadcom utilities have help documentation for more information about using the utilities For basic information about RAID and for using the utilities for the RAID controller cards that are supported in Cisco servers see the Cisco UCS Servers RAID Guide For hardware SAS MegaRAID configuratio...

Page 147: ...d P Series GPUs on page 149 Installing Drivers to Support the GPU Cards on page 158 Server Firmware Requirements The following table lists the minimum server firmware versions for the supported GPU cards Cisco IMC BIOS Minimum Version Required GPU Card 3 1 2 NVIDIA Tesla M10 3 1 2 NVIDIA Tesla P40 3 1 2 NVIDIA Tesla P100 12GB 3 1 2 NVIDIA Tesla P100 16GB 3 1 2 AMD FirePro S7150 X2 3 1 2c NVIDIA Te...

Page 148: ...f slots available for GPUs might be reduced because of the other cards installed in the server For example if present the NVMe switch card must be installed in slot 10 Use the UCS power calculator at the following link to determine the power needed based on your server configuration http ucspowercalc cisco com Do not mix different brands or models of GPU cards in the server NVIDIA M Series GPUs ca...

Page 149: ...rver Related Policies Configuring BIOS Settings Step 3 In the section of your profile for PCI Configuration BIOS Settings set Memory Mapped IO Above 4GB Config to one of the following Disabled Does not map 64 bit PCI devices to 64 GB or greater address space Enabled Maps I O of 64 bit PCI devices to 64 GB or greater address space Platform Default The policy uses the value for this attribute contai...

Page 150: ...X2 35 C 95 0 F NVIDIA Tesla M10 35 C 95 0 F NVIDIA Tesla M60 35 C 95 0 F NVIDIA Tesla P40 35 C 95 0 F NVIDIA Tesla P100 12GB 35 C 95 0 F NVIDIA Tesla P100 16GB Differs by number of GPUs installed Four or less GPUs installed 35 C 95 0 F More than four GPUs installed 32 C 89 6 F NVIDIA Tesla V100 16 GB For NVIDIA GPUs The NVIDIA GPU card might be shipped with two power cables a straight cable and a ...

Page 151: ... in the socket c Close the hinged retainer bar over the top of the PCIe slots Use your fingertips to pull back on the wire locking latches at each end of the retainer bar and then hinge it closed to secure the tops of the PCIe slots Push the wire locking latching back to the forward locked position d Connect the GPU card power cable to the front of the GPU card and to the motherboard power connect...

Page 152: ...D Licenses on page 155 NVIDIA GRID License Server Overview The NVIDIA M Series GPUs combine Tesla and GRID functionality when the licensed GRID features such as GRID vGPU and GRID Virtual Workstation are enabled These features are enabled during OS boot by borrowing a software license that is served over the network from the NVIDIA GRID License Server virtual appliance The license is returned to t...

Page 153: ...tion Extended Registering Your Product Activation Keys With NVIDIA After your order is processed NVIDIA sends you a Welcome email that contains your product activation keys PAKs and a list of the types and quantities of licenses that you purchased Step 1 Select the Log In link or the Register link if you do not already have an account The NVIDIA Software Licensing Center License Key Registration d...

Page 154: ...the latest information about your release http www nvidia com Platform Requirements for NVIDIA GRID License Server The hosting platform can be a physical or a virtual machine NVIDIA recommends using a host that is dedicated only to running the License Server The hosting platform must run a supported Windows OS The hosting platform must have a constant IP address The hosting platform must have at l...

Page 155: ...ironment and an Apache Tomcat installation You must install both separately before installing the License Server on Linux Step 1 Verify that Java was installed with your Linux installation Use the following command java version If no Java version is displayed use your Linux package manager to install with the following command sudo yum install java Step 2 Use your Linux package manager to install ...

Page 156: ...sing Portal Step 1 Access the GRID License Server Management Interface in a browser Step 2 In the left side License Server panel select Configuration The License Server Configuration panel opens Next to Server host ID a pull down menu lists the possible Ethernet MAC addresses Step 3 Select your License Server s MAC address from the Server host ID pull down It is important to use the same Ethernet ...

Page 157: ...icenses Features that require GRID licensing run at reduced capability until a GRID license is acquired Acquiring a GRID License on Windows Step 1 Open the NVIDIA Control Panel using one of the following methods Right click on the Windows desktop and select NVIDIA Control Panel from the menu Open Windows Control Panel and double click the NVIDIA Control Panel icon Step 2 In the NVIDIA Control Pane...

Page 158: ...below GRID vGPU 1 GRID Virtual Workstation 2 Step 5 Restart the nvidia gridd service sudo service nvidia gridd restart The service automatically acquires the license edition that you specified in the FeatureType line You can confirm this in var log messages After you configure licensing settings in the NVIDIA Control Panel the settings persist across reboots Note Sample configuration file etc nvid...

Page 159: ...or by any OS or hypervisor running on the server Note Using gpumodeswitch The command line utility gpumodeswitch can be run in the following environments Windows 64 bit command prompt requires administrator permissions Linux 32 64 bit shell including Citrix XenServer dom0 requires root permissions Consult NVIDIA product release notes for the latest information on compatibility with compute and gra...

Page 160: ...erver Software in the right hand column Step 4 Click the name of your model of server in the right hand column Step 5 Click Unified Computing System UCS Server Firmware Step 6 Click the release number Step 7 Click Download Now to download the ucs server platform huu version_number iso file Step 8 Verify the information on the next page and then click Proceed With Download Step 9 Continue through t...

Page 161: ...downloads requires NVIDIA login https nvidia flexnetoperations com NVIDIA public driver area http www nvidia com Download index aspx AMD http support amd com en us download Step 4 Restart the server Step 5 Check that the virtual machine is able to recognize the GPU card In Windows use the Device Manager and look under Display Adapters Cisco UCS C480 M5 Server Installation and Service Guide 159 GPU...

Page 162: ...Cisco UCS C480 M5 Server Installation and Service Guide 160 GPU Card Installation GPU Card Installation ...

Page 163: ...ere Cisco UCS C Series Server Integration with UCS Manager Configuration Guides Refer to the guide that is for the version of Cisco UCS Manager that you are using Also refer to the release notes for Cisco UCS Manager software and C Series Cisco IMC software for any special considerations regarding integration in your release Cisco UCS Manager Release Notes Cisco C Series Software Release Notes Cis...

Page 164: ...Cisco UCS C480 M5 Server Installation and Service Guide 162 Installation For Cisco UCS Manager Integration Installation For Cisco UCS Manager Integration ...