Sun Microsystems APOLLO OC48, Installation And User Manual

Page 1: ...an Antonio Road Palo Alto CA 94303 4900 U S A 650 960 1300 Send comments about this document to docfeedback sun com Sun OC48 Packet Over Sonet Adapter Installation and User s Guide Part No 806 6323 10...

Page 2: ...osystems Inc 901 San Antonio Road Palo Alto CA 94303 4900 Etats Unis Tous droits r serv s Ce produit ou document est distribu avec des licences qui en restreignent l utilisation la copie la distributi...

Page 3: ...not approved by Sun Microsystems Inc may void the authority granted to the user by the FCC to operate this equipment FCC Class B Notice This device complies with Part 15 of the FCC Rules Operation is...

Page 4: ...This Class A digital apparatus complies with Canadian ICES 003 Cet appareil num rique de la classe A est conforme la norme NMB 003 du Canada ICES 003 Class B Notice Avis NMB 003 Classe B This Class B...

Page 5: ...Regulatory Compliance Statements v BSMI Class A Notice The following statement is applicable to products shipped to Taiwan and marked as Class A on the product compliance label...

Page 6: ...vi Sun OC48 Packet Over Sonet Adapter Installation and User s Guide December 2001...

Page 7: ...kV Direct 8 kV Air EN61000 4 3 3 V m EN61000 4 4 1 kV AC Power Lines 0 5 kV Signal and DC Power Lines EN61000 4 5 1 kV AC Line Line and Outdoor Signal Lines 2 kV AC Line Gnd 0 5 kV DC Power Lines EN61...

Page 8: ...viii Sun OC48 Packet Over Sonet PCI Adapter Installation and User s Guide December 2001...

Page 9: ...ng the Adapter Hardware 5 Connectors Cables and LEDs 5 To Install the Adapter Hardware 7 To Connect the Fiber Optic Cable 8 To Verify the Installation 10 Booting the System 10 Installing the Driver So...

Page 10: ...ftware 27 5 Network Configuration and Cabling For SRP 29 Configuring the Driver 30 To Configure the SRP Configuration Files 30 Connecting the Fiber Optic Cables for SRP 32 To Connect the Fiber Optic C...

Page 11: ...Contents xi Technical Specifications 48 Physical Characteristics 48 Power Requirements 48 B Receive Load Balancing 49 C SRP Conventions 53 Three Node Ring Example 55...

Page 12: ...xii Sun OC48 Packet Over Sonet Adapter Installation and User s Guide December 2001...

Page 13: ...of Keys for PCI Slots 22 FIGURE 4 3 Detail of the SRP Clock Cables Connecting Two Sun OC48 Packet Over Sonet Adapters 23 FIGURE 4 4 Detail of the Copper 16 pin Connectors of the SRP Data Cable 24 FIGU...

Page 14: ...xiv Sun OC48 Packet Over Sonet Adapter Installation and User s Guide December 2001...

Page 15: ...ates for SRP 20 TABLE 4 3 Common OC 48 LED States and Labels 21 TABLE 4 4 Files and Directories on the CD ROM 26 TABLE 6 1 Driver Parameter Status and Descriptions 38 TABLE 6 2 Interrupt Blanking Para...

Page 16: ...xvi Sun OC48 Packet Over Sonet Adapter Installation and User s Guide December 2001...

Page 17: ...and a copper SRP data cable connect these adapters to each other In both cases Sun OC48 Packet Over Sonet adapters are connected to a SONET with fiber optic cables How This Book Is Organized Chapter 1...

Page 18: ...ver Sonet adapter Appendix A lists the specifications for the Sun OC48 Packet Over Sonet adapter Using UNIX Commands This document does not contain information on basic UNIX commands and procedures su...

Page 19: ...n computer output su Password AaBbCc123 Book titles new words or terms words to be emphasized Read Chapter 6 in the User s Guide These are called class options You must be superuser to do this Command...

Page 20: ...ng Sun Documentation Fatbrain com an Internet professional bookstore stocks select product documentation from Sun Microsystems Inc For a list of documents and how to order them visit the Sun Documenta...

Page 21: ...rdware Overview The Sun OC48 Packet Over Sonet adapter is available either as a single adapter for a Point to Point PPP network or in a pair for use in dual counter rotating SONET rings running Spatia...

Page 22: ...many high performance applications as for example in Metropolitan Area Networks MAN The card has two ports One optical port connects to a SONET ring A single card uses only the optical port in PPP mod...

Page 23: ...lity The card supports two protocols Point to Point Protocol PPP and Spatial Re use Protocol SRP EPCI 66 MHz 64 bit interface conforms to PCI 2 1 Spec Full size PCI 11 inch card with 3 3 5V signaling...

Page 24: ...4 Sun OC48 Packet Over Sonet Adapter Installation and User s Guide December 2001...

Page 25: ...ber Optic Cable on page 8 Installing the Driver Software on page 11 To Verify the Installation on page 10 Booting the System on page 10 Installing the Adapter Hardware This section contains a detailed...

Page 26: ...d User s Guide December 2001 FIGURE 2 1 Front Panel for the Sun OC48 Packet Over Sonet Adapter Note The SRP LEDs are not used for PPP TABLE 2 1 describes the common OC 48 LEDs Copper 16 pin connector...

Page 27: ...e system for installation of an I O adapter 2 Holding the PCI adapter by the edges unpack it and place it on an antistatic surface Place an anti static wrist strap on your wrist and attach it to the s...

Page 28: ...adapter does not seat properly when you apply even pressure remove the adapter and carefully reinstall it again 7 Secure the adapter to the PCI slot using the screw you removed in Step 8 Detach the wr...

Page 29: ...Cover FIGURE 2 4 shows a detail of the SC connector and the dust cover FIGURE 2 4 Detail of the SC Connector and Dust Cover 3 Match the cable connectors with the connectors on the Sun OC48 Packet Over...

Page 30: ...command to list the system devices You should see the full path name of the network devices similar to the example below In this example the network 4 device is the Sun OC48 Packet Over Sonet adapter...

Page 31: ...o a CD ROM drive that is connected to your system If your system is running Volume Manager it should automatically mount the CD ROM to the cdrom cdrom0 directory If your system is not running Volume M...

Page 32: ...he following packages are available 1 SUNWipsm Sun OC 48 Packet Over Sonet Man Pages sparc 1 0 REV 2001 11 19 21 03 2 SUNWipsut Sun OC 48 Packet Over Sonet Utilities to configure network sparc 1 0 REV...

Page 33: ...are you must create a etc ips ips cf file for the adapter s SONET interface To Edit the Network Configuration Files 1 As superuser use the grep command to search the etc path_to_inst file for ips inte...

Page 34: ...the comments inside the file The example above uses the instance ips0 Verify that in your system the instance number corresponds to device a11 4 Copy etc ppp options ips template to etc ppp options i...

Page 35: ...unipsinit command to configure the Sun OC48 Packet Over Sonet adapter in the mode based on the etc ips ips cf configuration file 7 Start the PPP daemon Use the following command to start the PPP daemo...

Page 36: ...16 Sun OC48 Packet Over Sonet Adapter Installation and User s Guide December 2001...

Page 37: ...nts for SRP Installation on page 17 Installing the Adapter Hardware on page 18 Connectors Cables and LEDs on page 18 To Install the Adapter Hardware on page 21 To Install the SRP Clock and Data Cables...

Page 38: ...e and Software Requirements System Sun Fire and other compatible systems Operating Environment Solaris 8 10 01 and subsequent compatible releases in 64 bit kernel mode PCI Slots Each system must have...

Page 39: ...SRP LEDs One Sun OC48 Packet Over Sonet adapter is assigned the primary role Side A and the other adapter is the Mate Side B This is reflected in the Primary LED One of the two adapters will have the...

Page 40: ...er LED is on when the adapter is linked to an OC 48 port on either a switch or another Sun OC48 Packet Over Sonet adapter When the software is working the three LEDs labeled Tx transmit Rx receive and...

Page 41: ...two 66 MHz 64 bit PCI slots FIGURE 4 2 shows a detail of two PCI slots The slot on the top is a 66 MHz slot The slot on the bottom is a 33 MHz slot Note that the key in the 66 MHz slot matches with t...

Page 42: ...einstall it again 7 Secure the adapter to the PCI slot using the screw you removed in Step 4 8 Repeat Steps 1 7 to install the second Sun OC48 Packet Over Sonet adapter 9 Detach the wrist strap Follow...

Page 43: ...er board s input FIGURE 4 3 Detail of the SRP Clock Cables Connecting Two Sun OC48 Packet Over Sonet Adapters Caution Do not use any metal tools to attach or detach the two SRP data cables 2 Connect t...

Page 44: ...e following section describes how to verify that the adapter is correctly installed To Verify the Installation After you have installed the two Sun OC48 Packet Over Sonet adapters but before you boot...

Page 45: ...e If you do not see the device listed check that the adapter is properly seated and if necessary reinstall the adapter Booting the System After verifying the adapter installation follow the steps in t...

Page 46: ...un OC48 Packet Over Sonet 1 0 CD If your system is running Volume Manager it should automatically mount the CD ROM to the cdrom cdrom0 directory If your system is not running Volume Manager mount the...

Page 47: ...ges are available 1 SUNWipsm Sun OC 48 Packet Over Sonet Man Pages sparc 1 0 REV 2001 11 19 21 03 2 SUNWipsut Sun OC 48 Packet Over Sonet Utilities to configure network sparc 1 0 REV 2001 11 19 21 03...

Page 48: ...28 Sun OC48 Packet Over Sonet Adapter Installation and User s Guide December 2001...

Page 49: ...s for SRP after the adapters are installed in your system This chapter contains the following sections Configuring the Driver on page 30 To Configure the SRP Configuration Files on page 30 Connecting...

Page 50: ...e a11 devices 2 Determine the instance number of the primary card Determine the instance numbers by the following method Using Step 1 above find the instances for the two a11 devices and use them for...

Page 51: ...t the srp options ipsN file ip addr add the IP address for the SRP node for example 192 12 25 30 mtu the maximum mtu value is 9196 bytes netmask add the netmask value such as 255 255 255 0 broadcast a...

Page 52: ...and the Mate card For clarity consider the Primary card Side A and the Mate card Side B 2 Locate the Primary card and the Mate card for the neighbor node For clarity consider the Primary card Side A a...

Page 53: ...5 Match the cable connectors with the connectors on the Sun OC48 Packet Over Sonet adapter front panel Note Connect the primary card Side A on this SRP node to the mate connection Side B on the neighb...

Page 54: ...d state unless wrap state is expected ipsconfig i ips0 top Topology Map for Interface SRP0 Topology pkt sent every 20 sec next pkt after 11 sec Nodes on the ring 3 Hops outer ring Optimal MAC Address...

Page 55: ...IP Stack 1 Plumb the IP stack 2 Execute the ifconfig command to verify the plumb etc init d sunips start ifconfig a ips0 flags 1000843 UP BROADCAST RUNNING MULTICAST IPv4 mtu 9196 index 20inet 192 12...

Page 56: ...36 Sun OC48 Packet Over Sonet Adapter Installation and User s Guide December 2001...

Page 57: ...r controls the OC48 Packet Over Sonet devices The ips driver is attached to the UNIX pci name property pci108e a11 for the OC48 Packet Over Sonet adapter 108e is the vendor ID and a11 is the PCI devic...

Page 58: ...ka_tim Read and write Interrupt blanking values ips_iblankb_pkt Read and write Interrupt blanking values ips_iblankb_tim Read and write Interrupt blanking values ips_iblankc_pkt Read and write Interru...

Page 59: ...umber of clock ticks have elapsed since the last packet was serviced on INTA A value of zero indicates no time blanking Default 0 ips_iblankb_pkt 0 to 8191 Interrupt after this number of packets have...

Page 60: ...blanking Default 0 ips_iblankd_pkt 0 to 8191 Interrupt after this number of packets have arrived since the last packet was serviced on INTD A value of zero indicates no packet blanking Default 0 ips_i...

Page 61: ...aced into Queue0 All TCP packets will be parsed and load balanced according to the policy set into the ips_txpolicy parameter When Tx load balancing is disabled all packets default to queue 0 ips_txpo...

Page 62: ...rs Number of errors in incoming packets ifspeed Interface speed in bits per second inits Number of times the initialization function is called interrupts Number of times interrupts are asserted ipacke...

Page 63: ...Number of PPP control packets received pppctlxmt Number of PPP control packets transmitted promisc Promiscuous mode setting protocol Protocol setting rbytes Number of bytes received rbytes64 Number o...

Page 64: ...ips_instance can only accept a multiple of 4 including 0 ndd dev ips name to get set read only ips_instance read and write ips_iblanka_pkt read and write ips_iblanka_tim read and write ips_iblankb_pkt...

Page 65: ...a particular device In the example above the device instances are from a Sun OC48 Packet Over Sonet adapter The instance numbers are in bold for clarity 2 Use the instance number to select the device...

Page 66: ...46 Sun OC48 Packet Over Sonet Adapter Installation and User s Guide December 2001...

Page 67: ...ections Fiber Optic Connector on page 47 Technical Specifications on page 48 Physical Characteristics on page 48 Power Requirements on page 48 Fiber Optic Connector TABLE A 1 lists the characteristics...

Page 68: ...uirements Feature Specification PCI slot 66 MHz PCI slot only PCI data address width 64 bit PCI modes Master slave 2 488 GBit s 1300 nm single mode 2 488 GBit s Distance Up to 2 kilometers Dimension M...

Page 69: ...ds a match the queue number for that entry is the base queue number to use for receiving the packets This queue number will be further modified according to the policy of the entry Add the VIP table e...

Page 70: ...ort number of this packet is 32763 0x7FFB then the resulting target queue will be This packet will be delivered to Queue 3 The CPU that runs this particular queue will handle the interrupt processing...

Page 71: ...All VIP entries are specified in the ips cf configuration file To disable the Receive Load Balancing feature simply not to specify any vipentry in the ips cf configuration file The default setup is w...

Page 72: ...52 Sun OC48 Packet Over Sonet Adapter Installation and User s Guide December 2001...

Page 73: ...SRP Data Cable FIGURE C 1 illustrates an SRP node FIGURE C 1 SRP Node In normal operation the host can post packets to either the Primary or the Mate card depending on the Topology When the host need...

Page 74: ...packet from the Inner Ring the host posts the packet to the Mate Adapter Side B the Mate Adapter will then forward the packet to the Primary Adapter and the Primary Adapter will then send the packet o...

Page 75: ...without any forwarding Both Primary and Mate can transmit and receive packets from either Outer or Inner ring simultaneously Three Node Ring Example This section shows a three node ring example illust...

Page 76: ...3 Hops outer ring Optimal MAC Address IP Addr Wrapped 0 08 00 20 e5 de 90 192 12 25 25 No 1 SIDE A 08 00 20 e5 de 92 192 12 25 35 No 2 SIDE B 08 00 20 e5 de 8a 192 12 25 30 No Hops inner ring Optimal...

Page 77: ...No 2 SIDE B 08 00 20 e5 de 90 192 12 25 25 No Hops inner ring Optimal MAC Address IP Addr Wrapped 0 08 00 20 e5 de 92 192 12 25 35 No 2 SIDE A 08 00 20 e5 de 8a 192 12 25 30 No 1 SIDE B 08 00 20 e5 de...

Page 78: ...58 Sun OC48 Packet Over Sonet Adapter Installation and User s Guide December 2001...