manualshive.com logo in svg

IBM RELEASE 7.3, Management Manual


Share
Download
background image

9.3.2.  Viewing the Central Log (Delogging)

HPSS provides the ability to retrieve and examine HPSS log records as a means of analyzing the activity 
and behavior of HPSS. The retrieval and log record conversion process is referred to as “delogging.” 
Delogging is the process of retrieving specific records from the HPSS central log files (which is in binary 
format), converting the records to a readable text format, and sending the resulting text to a local UNIX 
file.

To effectively view log records, the user should know what kinds of activities or behaviors are of 
interest. Since it is possible to configure log policies to include almost all activity in HPSS, in most cases 
it will be easier to examine and analyze logs by filtering out any records that are not of interest. The 

hpss_delog

 utility allows selective filtering of log records based on start time, end time, server 

descriptive name, log record type, user name, principal, authentication mechanism, and authenticator 
name.

The central log file names available for delogging are logfile01 and logfile02. These files reside in the 
directory name specified in the Log Daemon configuration entry. To determine whether a message of 
interest is in a log file, open the associated 

Log File Information

 window (Section 9.4: 

Log Files

Information 

on page 300) to obtain the start and end times of the log file and compare them with the 

message timestamp.

If log files that have been archived to HPSS are to be delogged, they will reside in a date-based directory 
structure in HPSS: /log/yyyy/mm/dd. To determine the log times for an archived log file, list the log files. 
The timestamp of the time when the file was archived to HPSS is appended to the end of the log file 
name. The format of the archive file names is logfile01_yyyymmddhhmm or logfile02_yyyymmddhhmm.

Use the 

hpss_delog

 utility to convert the logfile01, logfile02, or archived log file retrieved from HPSS. 

Please see the 

hpss_delog

 man page for full usage information and examples.

9.4.  Log Files Information

HPSS Management Guide

November 2009

Release 7.3 (Revision 1.0)

300

Summary of Contents for RELEASE 7.3

Page 1: ...HPSS Management Guide High Performance Storage System Release 7 3 November 2009 Revision 1 0 HPSS Management Guide November 2009 Release 7 3 Revision 1 0 1...

Page 2: ...on UT Battelle nor any of their employees makes any warranty express or implied or assumes any liability or responsibility for the accuracy completeness or usefulness of any information apparatus prod...

Page 3: ...ating a Location Policy 27 2 4 2 Location Policy Configuration Window 27 2 4 3 Deleting a Location Policy 28 2 5 Restricting user access to HPSS 28 2 5 1 Restricted Users Window 29 Chapter 3 Using SSM...

Page 4: ...3 1 SM Server Connection Status Indicator 59 3 9 3 2 HPSS Status 60 3 9 3 3 HPSS Statistics 61 3 9 3 4 Menu Tree 62 3 9 3 5 File Menu 62 3 9 3 6 View Menu 62 3 9 4 SSM Information Windows 63 3 9 4 1...

Page 5: ...ation Parameters on IRIX Solaris and Linux 106 5 1 3 1 1 Setting Up Remote Movers with mkhpss 108 5 1 3 1 2 Mover Configuration to Support Local File Transfer 108 5 1 1 Physical Volume Repository PVR...

Page 6: ...Down an HPSS Server 151 5 1 2 Shutting Down All HPSS Servers 152 5 1 3 Halting an HPSS Server 152 5 1 4 Shutting Down the SSM Server 152 5 1 5 Shutting Down the Startup Daemon 153 5 1 6 Stopping the P...

Page 7: ...2 6 5 4 Deleting a Purge Policy 193 6 6 File Families 193 6 6 1 File Family Configuration 194 6 6 2 Changing a File Family 194 6 6 3 Deleting a File Family 194 Chapter 7 Device and Drive Management 19...

Page 8: ...1 Forcing Migration 259 8 4 2 Forcing Purge 259 8 4 3 Repacking and Reclaiming Volumes 259 8 4 3 1 Repack Virtual Volumes Window 260 8 4 3 2 Reclaim Virtual Volumes Window 262 8 5 Volume Management 2...

Page 9: ...1 Controlling the System Manager Log Message Cache 305 9 6 4 2 Controlling Log Messages Displayed by hpssgui and hpssadm 306 Chapter 10 Filesets and Junctions 308 10 1 Filesets Junctions List 308 10 2...

Page 10: ...Accounting Files 337 13 2 3 2 Accounting Intervals and Charges 338 Chapter 14 User Interfaces 339 14 1 Client API Configuration 339 14 2 FTP PFTP Daemon Configuration 341 14 3 HPSS VFS Interface Confi...

Page 11: ...ry Copies 362 15 3 1 1 2 Without Secondary Copies 363 15 3 1 2 Cleanup Totally Damaged Disk or Tape 364 15 4 DB2 Monitoring 365 15 5 DB2 Space Shortage 365 15 5 1 DMS Table Spaces 366 15 5 2 SMS Table...

Page 12: ...2 Solaris System Parameters 107 Table 3 Linux System Parameters 108 Table 1 Auto Restart Count Values 151 Table 1 Server Reinitialization Behavior 154 Table 2 Recommended Settings for Tape Devices 201...

Page 13: ...d be typed at a command line will be proceeded by a percent sign and be presented in a boldface courier font sample command Any text preceded by a pound sign should be considered comment lines This is...

Page 14: ...HPSS Management Guide November 2009 Release 7 3 Revision 1 0 14...

Page 15: ...g the SSM GUI for the First Time The HPSS system is ready to be configured using SSM once the HPSS software is installed on the node and the HPSS infrastructure components are configured In order to s...

Page 16: ...87 5 Create global configuration Section 4 1 Global Configuration Window on page 72 6 Configure MVR devices and PVL drives Section 7 1 Configure a New Device Drive on page 196 7 Configure file famili...

Page 17: ...t up Backup for DB2 and Other Infrastructure Chapter 15 Backup and Recovery on page 356 3 Set up High Availability if desired HPSS Installation Guide Chapter 3 HPSS Planning 4 Optionally configure sup...

Page 18: ...igured drives are unlocked Storage Classes Verify that all storage classes are defined and each has sufficient free storage space Verify that each storage class that will be migrated and purged is con...

Page 19: ...nsfer rates If necessary redefine the associated storage class definition to enhance the throughput performance The characteristics fields Transfer Rate Latency etc in the storage class and class of s...

Page 20: ...ransfer rates should be close to the speed of the underlying hardware The actual hardware speeds can be obtained from their specifications and by testing directly from the operating system e g using d...

Page 21: ...tion is provided purely for reference Each of the files below is stored by default in var hpss etc auth conf authz conf These files define which shared libraries provide implementations of the authent...

Page 22: ...thentication mechanism hpss_unix_user used to manage users in the HPSS password file var hpss etc passwd hpss_unix_group used to manage users in the HPSS groups file var hpss etc group hpss_unix_passw...

Page 23: ...nistrative tasks if the LDAP authorization mechanism is used 2 1 2 3 1 LDAP Administrative Tasks Working with Principals Creating a principal A principal is an entity with credentials like a user or a...

Page 24: ...owing command at the hpss_ldap_admin prompt group remove principal gid gid name name uuid uuid You may supply any of the arguments listed to select the group from which the named principal will be rem...

Page 25: ...via credentials provided by the caller then uses the configured authorization mechanism to retrieve the details of the caller that determine the access granted Once the identity and authorization inf...

Page 26: ...an HPSS operator Operators may open most SSM windows and can perform all SSM control functions except for HPSS configuration Security is applied both at the window level and the field level A user mus...

Page 27: ...Once a location policy is created or updated it will not take effect until all local Location Servers are started or reinitialized The Reinitialize button on the Servers list window Section 5 1 Server...

Page 28: ...tion Server Local HPSS Site Identification HPSS ID The UUID for this HPSS installation Local Site Name The descriptive name of the HPSS installation Advice Pick a name to uniquely describe the HPSS sy...

Page 29: ...fective restart the Core Server press the Reload List button on the Restricted Users SSM window or REINIT the Core Server NOTE The file should be configured on the system where the root Core Server is...

Page 30: ...access Realm Name The name of the HPSS realm that encompasses the restricted user User ID The identifier number of the restricted user Realm ID The identifier number which identifies the realm which e...

Page 31: ...est queue size is defined in the Request Queue Size field on the Interface Controls tab of the System Manager s Core Server Configuration window Section 5 1 1 2 Interface Controls on page 92 This is t...

Page 32: ...PCs is equal to Thread Pool Size then the thread pool for the interface is currently full Active RPCs should never be greater than Thread Pool Size When it reaches Thread Pool Size then the new RPCs w...

Page 33: ...on and Startup of hpssgui and hpssadm below Following are steps for quickly configuring and starting an SSM GUI client 1 Use the hpssuser utility to create an SSM user with admin authority See Section...

Page 34: ...cation ensures that a user is who they claim to be relative to the system Authorization defines the user s rights and permissions within the system Like other components of HPSS SSM authenticates its...

Page 35: ...isms may be enabled if desired Next select the Security Controls tab If Kerberos authentication is desired make certain one of the Authentication Service Configurations is set to use a Mechanism of KR...

Page 36: ...by the hpssuser utility with no further modification required This section explains how the authorization levels are stored internally and how they may be viewed for debugging or modified The SSM adm...

Page 37: ...an SSM user is removed any existing SSM sessions for that user will continue to work access won t be denied until the SSM user attempts to start a new SSM session Likewise if the SSM user s security...

Page 38: ...it can be copied and used elsewhere but care should be taken to keep it secure 3 3 2 3 2 Keytabs for UNIX Authentication hpss_unix_keytab The hpss_unix_keytab utility may be used to generate a keytab...

Page 39: ...pssgui and hpssadm scripts can be directed to use an alternate SSM configuration file with the m option The default SSM configuration file contains comments describing each of the available parameters...

Page 40: ...Security mechanism HPSS_SSM_UNIX_REALM u UNIX Realm Table 2 HPSSGUI Specific Options File Option Command Line Option Functionality HPSSGUI_LOOK_AND_FEEL F Look and feel HPSSGUI_MO_RATE M How long hpss...

Page 41: ...ease see the opt hpss config templates login conf template file for details 3 3 3 2 krb5 conf For Use with Kerberos Authentication Only The krb5 conf file is the Kerberos configuration file which allo...

Page 42: ...ails 3 3 5 SSM Desktop Client Packaging A full installation of HPSS is not needed on machines used only for executing hpssgui or hpssadm These machines referred to here as SSM client machines only req...

Page 43: ...on 3 3 5 2 Manual SSM Client Packaging and Installation This section describes the manual installation of the necessary client files required to execute the hpssgui or hpssadm program on the user s de...

Page 44: ...on page 42 for a description of the Help Files A writable directory is required for hpssgui or hpssadm session logs if these are desired The session log is an ASCII file that stores messages generated...

Page 45: ...en on that client could also be compromised The client machine may become a point of vulnerability and access to the other machines behind the firewall A third disadvantage is that tunneling can be co...

Page 46: ...hpssgui script resides If FTP is used to copy the file make sure the copy is done in binary mode If the file is installed in a different directory specify it to the hpssgui script with the P option or...

Page 47: ...r of the desired column to sort the list by the items in that column The column header will become highlighted and will display an up or down arrow to indicate the direction of the sort Click the colu...

Page 48: ...ssm ssmuser hpssgui CustomMetalTheme primary3 COLOR hpss ssm ssmuser hpssgui CustomMetalTheme secondary1 COLOR hpss ssm ssmuser hpssgui CustomMetalTheme secondary2 COLOR hpss ssm ssmuser hpssgui Cust...

Page 49: ...same results as entering 1kb The entered value must fall with the acceptable numeric ranges for the specified field Some text fields which accept integer values can accept the values in decimal octal...

Page 50: ...ation windows when a new configuration record is being created After the configuration fields are appropriately completed click the Add button to save the data and create the new record When the Add o...

Page 51: ...ltip If there are status messages to view rolling the mouse over the status bar without clicking gives a tooltip that says Click mouse in status bar to view messages If there are no status messages th...

Page 52: ...below for detailed information on SSM help 3 7 Help Menu Overview The Help Menu provides access to online help that is pertinent to the window being displayed The Help menu is available on all SSM dat...

Page 53: ...l a job Servers Opens the Servers window which displays information on all configured HPSS servers This window can also be used to perform server related operations such as configuration startup shutd...

Page 54: ...is submenu lists the options available for viewing statistics for the System Manager and the user client session System Manager Statistics Opens the SSM System Manager Statistics window to view statis...

Page 55: ...down This submenu provides a quick way to send a shutdown request to any server other than the Startup Daemon If you want to shutdown a particular server or set of servers use the Shutdown or Force Ha...

Page 56: ...configuration and management of the classes of service Servers Opens the Servers list window which will facilitate server configuration and management Global Opens the Global Configuration window all...

Page 57: ...word Enter the password for the user ID OK Attempt to contact the System Manager and authenticate the user If the attempt is successful the HPSS Health and Status widow will open Otherwise an error me...

Page 58: ...ui windows The HPSS System Name and System Manager Version are not displayed when the About HPSS window is requested from the HPSS Login window These two pieces of information are not available until...

Page 59: ...logs out It provides the main menu and displays information about the overall status of HPSS The HPSS Health and Status window is composed of several high level components each of which is discussed...

Page 60: ...atus due to communication problems or other difficulties Suspect There may or may not be a problem Minor A problem has been encountered by the server or device but it does not significantly affect the...

Page 61: ...ee Section 3 10 SSM List Preferences on page 69 for more information on the sick list mode For PVR Cartridge Thresholds the button will display a message dialog with information about the PVRs that ha...

Page 62: ...e hidden from view by selecting the View menu item and unchecking the Menu Tree checkbox 3 9 3 5 File Menu All SSM data windows have the File menu See Section 3 6 Common Window Elements on page 50 for...

Page 63: ...atistics section of the HPSS Health and Status window Menu Tree Toggle the Menu Tree menu option to hide or view the Menu Tree section of the HPSS Health and Status window 3 9 4 SSM Information Window...

Page 64: ...Field Descriptions Start Time The time the System Manager was started Uptime The elapsed clock time since the System Manager was started HPSS Management Guide November 2009 Release 7 3 Revision 1 0 64...

Page 65: ...threads to handle all the current RPCs some are having to wait in the queue and the queue is getting dangerously close to overflowing at which point any new RPCs will be rejected Thread Pool Size The...

Page 66: ...using the Dhpss ssm SMConnections Java command line option Current Connection Count The number of client connections currently being handled by the System Manager Current Client Count The number of c...

Page 67: ...alls The number of RPCs that the client has made to the System Manager RPC Waits The number of RPCs that the client has currently waiting in the System Manager These are the RPCs which are active and...

Page 68: ...unt of time that the user has been connected to the System Manager This is the time that has elapsed since the login was successful Time of Last Successful RPC Call The time that the last RPC call was...

Page 69: ...Service Devices Drives File Families Filesets Junctions Hierarchies Logging Policies Migration Policies Purge Policies PVL Jobs Restricted Users RTM Summary Servers SM Clients Storage Classes Active S...

Page 70: ...columns that have a limited set of display values The checkbox filters are grouped by column name and contain a checkbox for each allowed value If the checkbox is selected then all rows containing th...

Page 71: ...essed via its parent SSM List window i e it is not available when the Preferences window is accessed from the Configure menu Show List Brings the window to which these preferences apply to the foregro...

Page 72: ...the first step of configuration be the partial definition of subsystems The subsystems should be defined at this point except for their Gatekeeper and Default COS information The Global Configuration...

Page 73: ...eal HPSS server Once this new policy is created it may be selected as the Default Log Policy Alternately you may skip this step until after one or more server specific log policies are created Then a...

Page 74: ...UID associated with the user Can change UID if has Delete Perm on Security ACL If checked then when a user is listed with delete permission in the security ACL of the CORE server that owns the object...

Page 75: ...on page 76 Administration Buttons Accounting Status Opens the Accounting Status window which displays the status and statistics from the last accounting run See Section 13 2 2 1 Generating an Account...

Page 76: ...n 4 2 3 1 Create Storage Subsystem Metadata on page 79 2 Create the Storage Subsystem Configuration Section 4 2 3 2 Create Storage Subsystem Configuration on page 79 3 Create the Storage Subsystem Ser...

Page 77: ...Subsystem ID A unique positive integer ID for the storage subsystem This field may only be set at create time The default value is the last configured subsystem ID number plus 1 The default subsystem...

Page 78: ...until the Core Server and Migration Purge Server associated with the subsystem have been recycled When new Classes of Service are added the initial allowed state for that COS is determined by the curr...

Page 79: ...ame for the new storage subsystem SSM will automatically choose the name Subsystem N where N is the subsystem ID selected by SSM The name of the new storage subsystem may be changed by the administrat...

Page 80: ...eper Specific Configuration on page 98 for instructions on configuring the Gatekeeper Be sure to assign this Gatekeeper to the appropriate storage subsystem by choosing it from the Gatekeeper selectio...

Page 81: ...ecified storage subsystems See Section 6 1 1 Configured Storage Classes Window on page 157 for more information 4 2 4 Modifying a Storage Subsystem If modifications are made to an existing Storage Sub...

Page 82: ...h step see the corresponding instructions under Section 4 2 2 Creating a New Storage Subsystem on page 76 1 Delete all storage resources assigned to the subsystem s Core Server See Section 8 2 1 Delet...

Page 83: ...0 SSM List Preferences on page 69 for more information At times the server list may update quite frequently with new Status or Opstate information If you select either of these columns for sorting ser...

Page 84: ...d to execute and is running should have a Connected status If its status is anything other than Connected excluding the transient status values one of the following actions should be taken If the serv...

Page 85: ...to a shutdown halt request Suspect The server may have a problem Minor The server encountered a problem that does not seriously affect the HPSS operation Major The server encountered a problem that m...

Page 86: ...elected servers The System Manager will notify the Startup Daemon to start the selected servers Reinitialize Send a reinitialize command to the selected servers Note that not all HPSS servers support...

Page 87: ...server configuration tasks Create New Allows an administrator to configure a new server by selecting a server type and then filling in a new server configuration This control is actually not a button...

Page 88: ...very type of server has a specific configuration section The following types of servers have a server specific configuration section in the Server Configuration window Core Server Gatekeeper Log Clien...

Page 89: ...en the Servers list window click Create New and select a server type This opens a Server Configuration window with default values for the selected server type Make the desired customizations to the wi...

Page 90: ...Type The type of the HPSS Server Server Subtype The subtype of the selected server This field is only used by the PVR servers to specify the type of PVR e g STK Storage Subsystem Name of the HPSS Stor...

Page 91: ...such servers are eventually closed so that the server uses no connections at all If the server should need a connection at some later time one will be created Creating database connections is a fairly...

Page 92: ...1 2 Tuning the System Manager RPC Thread Pool and Request Queue Sizes on page 31 for information on tuning the RPC thread pool and request queue sizes for the System Manager Interfaces The informatio...

Page 93: ...authentication mechanism to use when passing identity information in communications to HPSS components KRB5 indicates that the server will useKerberos 5 authentication UNIX indicates that the server...

Page 94: ...s or both successes and failures be logged For each audit event type selecting Failure causes only failures to be logged selecting Total logs every audit event of that type and selecting neither cause...

Page 95: ...og message type and for information on the System Default Logging Policy The Log Policy section of the Server Configuration window is common to all servers In the example window above the server displ...

Page 96: ...olicy is defined on the Global Configuration Window Refer to Section 4 1 Global Configuration Window on page 72 If no server specific log policy is defined for the server the server uses the System De...

Page 97: ...provided the COS change request will be dropped after it has failed the configured number of times Tape Dismount Delay seconds The amount of time in seconds a mounted tape volume will remain idle bef...

Page 98: ...purged If this variable is not present in the environment the server s default value is 60 seconds HPSS_CORE_TAPE_CACHE_IDLE_TIME Adjusts the time in seconds a tape s in memory cache entries can rema...

Page 99: ...tekeeper startup If a site wishes to make use of the Site Policy Pathname file then the site will need to add code to the Gatekeeping Site Interface library to read the Site Policy Pathname file and i...

Page 100: ...tions running on the node on which this instance of the Log Client is running This option is provided as a convenience feature All HPSS messages will be written to a central log if Log Daemon is speci...

Page 101: ...port number for communication between the Log Client and the Log Daemon The default value is 8100 Ensure that the port number assigned does not conflict with any other application on the node The por...

Page 102: ...t a migration report file name The full file name will consist of this string with a date string and subsystem ID appended to it If this field is left blank no migration reports will be generated If a...

Page 103: ...If the Mover is running remotely this field must correspond to a network interface on the remote node whereas the Execute Hostname set in the Mover s basic configuration corresponds to a network inter...

Page 104: ...for Remote Mover on page 106 5 1 3 1 1 System Configuration Parameters on IRIX Solaris and Linux on page 106 5 1 3 1 1 etc services etc inetd conf and etc xinetd d To invoke the remote part of the Mov...

Page 105: ...erver_args var hpss etc mvr_ek The specified port will be one greater than the port listed as the TCP Listen Port in the Mover s type specific configuration For example the port value in the example c...

Page 106: ...files are required passwd group The ieee_802_addr file contains the hardware address of the host It may be created using the opt hpss config get_802_addr program This program requires no arguments The...

Page 107: ...fo_semmsl 512 Maximum number of semaphores per set shmsys shminfo_shmmax 8388608 Maximum shared memory segment size will allow up to a 2MB Mover buffer size Linux Linux system parameters which affect...

Page 108: ...nism field For Kerberos complete the remaining fields on the window and push the Configure Security Services button to set up the required files For Unix there is nothing further to configure on this...

Page 109: ...f the paths in this list then the transfer will proceed otherwise the Mover will not transfer the file The format of this file is simply a list of paths one per line gpfs local globalfilesystem In the...

Page 110: ...Check In Retry The number of seconds the PVR will wait before asking the robot if a requested shelf tape has been checked in The PVR will continue checking at this interval until the tape is checked...

Page 111: ...f distance from the cartridge to the drive This method has the effect of distributing a striped tape mount across as many controllers as possible for the best performance It also will try to pick cont...

Page 112: ...he PVL is recycled Characteristics Flags for the PVR ismounts If ON the PVL will delay the dismounting of a tape cartridge until the drive is required by another job or until the Dismount Delay time l...

Page 113: ...n send commands to the robot at the same time as HPSS through the additional device special file If the robot is placed in pause mode by an operator an alarm will appear on the HPSS operator window Al...

Page 114: ...ue in this field will change the mount behavior to periodically retry the mount until the specified time limit is exceeded Once exceeded an error is generated and the mount request is canceled If the...

Page 115: ...arm is servicing it User needs to set the Server Name and Client Name which are case sensitive in the AML PVR Server Configuration panel to establish the connectivity between the HPSS software and the...

Page 116: ...to this HPSS PVR This may or may not be the total cartridge capacity of the library a site might use part of the library for some other HPSS PVR or for some non HPSS application The PVR uses the Cart...

Page 117: ...used by the PVL to determine the number of minutes that dismounts are delayed after the last data access Retry Mount Time Limit The default value for this field is 1 When the default value 1 is used i...

Page 118: ...ounted The SMC device special file is not available to other tape management programs Additional device special files may be created for other programs The LTO PVR requires an SMC device special file...

Page 119: ...ault value for this field is 1 When the default value 1 is used if an error is encountered during a PVR mount operation the mount will pend and be retried every 5 minutes Setting a value in this field...

Page 120: ...has been calculated the drive with the lowest score is selected for the mount If two or more drives tie for the lowest score one drive is selected at random The score is calculated as follows Score W...

Page 121: ...drive is automatically locked by the PVL The only mount errors that apply are those set through the Retry Mount Time Limit mechanism The Drive Error Count field in the PVL Drive Information records t...

Page 122: ...cumentation files describing the files in the bin directory are located in the HPSS_PATH stk doc directory Refer to these doc files for additional information Similarly Linux binaries and script files...

Page 123: ...re are the valid choices ACSLS Release Number Remote Host Version Number 3 x 2 4 x 3 5 x 6 x 4 Enter Remote Host Version ACSAPI_PACKET_VERSION 4 Starting opt hpss stk bin mini_el Attempting startup of...

Page 124: ...artridges must first be exported If deleting a PVR configuration all injected cartridges must either be exported or moved to another PVR If deleting a Gatekeeper remove all references to that Gatekeep...

Page 125: ...tem Manager is unable to contact the server Field Descriptions Server ID The UUID for the server Server Name The descriptive name of the server Operational State The Operational State of the server Th...

Page 126: ...are Normal Warning Minor Problem Major Problem and Critical Security Status The server s security status Possible values are Normal Warning Minor Problem Major Problem and Critical Software Status The...

Page 127: ...se them immediately in the current execution There are server specific information windows for the following servers Core Server Gatekeeper Location Server Migration Purge Server Mover Physical Volume...

Page 128: ...The amount of time in seconds a mounted tape will be held in a client s session before become eligible to be handed off to another client that wishes to use the tape PVL Max Connection Wait seconds T...

Page 129: ...l Volumes managed by this Core Server Total Tape Virtual Volumes The number of Tape Virtual Volumes managed by this Core Server Tape Aggregates The number of tape aggregates managed by this Core Serve...

Page 130: ...any unprintable characters are detected in these new names an error will be returned Printable characters are defined as all characters in the range from 0x20 to 0x7e inclusive in the 7 bit ASCII char...

Page 131: ...atistics from the gk_admin_ServerSetAttrs API This API is called by the SSM System Manager when the Gatekeeper s Basic Server Information window is opened Get Gatekeeper Server Info Statistics from th...

Page 132: ...recycled so that the Core Server can learn which request types need to include Gatekeeping services 5 1 1 1 Location Server Information Window The Location Server Information window displays statistic...

Page 133: ...e Core Server manages This field is the interval in seconds between successive queries Maximum Volumes for Whole File Migration The limit for the number of tape volumes mounted simultaneously for each...

Page 134: ...s that the Mover has handled since the last time this field was cleared Click on the Reset button to the right of the field to reset the value to zero Number of Bytes Moved The number of bytes of data...

Page 135: ...he library for some other HPSS PVR or for some non HPSS application The PVR uses the Cartridge Capacity field and the Cartridge Alarm Threshold field to determine when to send an alarm that the total...

Page 136: ...rive for a tape mount operation The three values are essentially weights that are used to compute an overall score for each possible drive After the score has been calculated the drive with the lowest...

Page 137: ...use the symbolic library name defined in etc ibmatl conf The environment variable HPSS_3494_COMMAND_DEVICE will override the value entered in this field Only use the environment variable when using o...

Page 138: ...ethod has the effect of distributing a striped tape mount across as many controllers as possible for the best performance It also will try to pick controllers that are currently driving a minimum numb...

Page 139: ...ter Shelf Tape Check In Alarm The PVR will periodically log alarm messages when a requested shelf tape has not been checked in This field specifies the number of minutes between alarms This field is o...

Page 140: ...tered during a PVR mount operation the mount will pend and be retried every 5 minutes Setting a value in this field will change the mount behavior to periodically retry the mount until the specified t...

Page 141: ...he total number of cartridge slots in the library dedicated to this HPSS PVR This may or may not be the total cartridge capacity of the library a site might use part of the library for some other HPSS...

Page 142: ...it mechanism The Drive Error Count field in the PVL Drive Information records the number of consecutive errors on a drive by drive basis To turn off the automatic drive disable feature set the Drive E...

Page 143: ...s of distance from the cartridge to the drive This method has the effect of distributing a striped tape mount across as many controllers as possible for the best performance It also will try to pick c...

Page 144: ...val until the tape is checked in This field applies only if the Support Shelf Tape checkbox is selected The retry value must be 30 or greater Shelf Tape Check In Alarm The PVR will periodically log al...

Page 145: ...mary List window was last updated Time Updated Of all the RTM requests records with this ID this field holds the age of the request most recently updated by its server The time delta is the age or tim...

Page 146: ...ds with this ReqId this field holds the age of the oldest when the snapshot was taken Newest_UpdateTimeDelta Of all the RTM requests records with this ReqId this field holds the age of the request mos...

Page 147: ...erver type Not all fields for a particular server specific ReqInfo structure will be displayed Only those fields that have valid data in them for the particular state of the RTM request will be displa...

Page 148: ...esMoved The number of bytes that have been moved for this request as known by the storage server The Mover ReqInfo structure may contain any or none of the following fields InitialTransferOffset The o...

Page 149: ...window where rc hpss is running When using the o option one should ensure that the HPSSLOG environment variable is not set to stdout in the env conf file since this is likely to severely degrade HPSS...

Page 150: ...or hpssadm man page For best performance it is recommended that the SSM graphical user interface GUI be installed on the SSM user s desktop machine However authorized SSM users can invoke the hpssgui...

Page 151: ...ministrative halt or shutdown is not considered to be an abnormal termination and a server will not be automatically restarted The following Auto Restart Count values may be set Table 1 Auto Restart C...

Page 152: ...cting System Manager from the Shutdown submenu of the Operations menu The SSM client sessions will detect that the SSM System Manager has been shutdown and will then inform the user of the event 5 1 3...

Page 153: ...use the d option of rc hpss su opt hpss bin rc hpss d stop 5 1 6 Stopping the Prerequisite Software To stop the prerequisite software use the p option of rc hpss su opt hpss bin rc hpss p stop This w...

Page 154: ...ration metadata and reset its internal representation of those values In many cases reinitialization is all that is needed to cause a server to start using a new configuration In other cases it may be...

Page 155: ...Restricted User list in memory Releases the in memory cache of File Family Ids allowing it to be reconstructed If a file family has been removed from the list of defined families this step causes it...

Page 156: ...ion all of the servers that rely on these settings should be restarted to make sure they agree 5 1 Forcing an SSM Connection When the status of the server s connection with SSM is UP UNCONNECTED selec...

Page 157: ...ing Configure from the Health and Status window This will display a drop down menu Select Storage Space from this menu This will display another drop down menu Select Storage Classes from this menu Se...

Page 158: ...cted in the Storage Classes list or the selected storage class does not have a purge policy Subsystem Thresholds Opens either a disk or tape subsystem threshold configuration window as appropriate for...

Page 159: ...er assigned to the storage class Storage Class Name The descriptive name of the storage class Storage Class Type The type of the storage class Disk Migration Policy The migration policy associated wit...

Page 160: ...total space in the storage class The threshold may be disabled by setting the value to 100 percent Optimum Access Size The optimal transmission size to be used for a transfer request using this storag...

Page 161: ...ia Block Size Selection for some recommendations VV Block Size VVBS The virtual volume block size is the number of bytes written to an element of a striped VV before the data stream moves to the next...

Page 162: ...the product of the Stripe Length SL and the Max Multiplier MAXMULT Min Segments in VV MINSVV The minimum number of segments in a virtual volume This value is calculated as the VV SIZE VVSIZE paramete...

Page 163: ...me The descriptive name of the storage class Storage Class Type The type of the storage class Tape Migration Policy The migration policy associated with this storage class or None if no migration is d...

Page 164: ...files being written in the storage class to a small number of tapes reducing the number of tape mounts The number of tape drives used to write files in the storage class will be limited to approximate...

Page 165: ...ansfer speed in kilobytes per second KB sec which can be achieved by devices corresponding to Media Type Advice This field is used in calculating a reasonable setting for Seconds Between Tape Marks SB...

Page 166: ...ength is the PV Section Length times the Stripe Width SW 6 1 4 Storage Class Subsystem Thresholds These windows allow the user to manage storage class space thresholds which are specific to a storage...

Page 167: ...e Core Server and Migration Purge Server for those subsystems must be recycled to make the changes effective Field Descriptions Storage Class ID The ID of the storage class to which these subsystem sp...

Page 168: ...rage subsystem row from the Subsystem List The selected storage subsystem information will be displayed in the lower panel Pressing the Set To Defaults button will commit the changes to the selected s...

Page 169: ...orage subsystems Columns in the list include Subsys ID The ID of the selected storage subsystem Subsys Name The name of the selected storage subsystem Warning The current warning threshold value for t...

Page 170: ...recreated with the new desired values Take care to either remove migration and purge policies that are no longer needed or reassign them to the revised storage class Because a number of servers cache...

Page 171: ...ass above it in the hierarchy two different storage classes in the hierarchy may not both migrate to the same storage class This window allows you to manage storage hierarchies It lists all currently...

Page 172: ...t in addition to defining the hierarchy the appropriate migration policies must be configured for each storage class in the hierarchy Without the proper migration policies neither migration nor duplic...

Page 173: ...he Storage Class Configuration window corresponding to the storage class name to the left of the button 6 2 3 Changing a Storage Hierarchy Definition A storage hierarchy definition can be changed by b...

Page 174: ...th and Status window then selecting the Storage Space submenu and then selecting the Classes of Service submenu item Field Description Default Class of Service The default class of service This is dis...

Page 175: ...ns Class ID The unique integer ID for the COS Any positive 32 bit integer value Class Name The descriptive name of the COS A character string up to 31 bytes in length The default value is Class of Ser...

Page 176: ...ifying HINTS_FORCE_MAX_SSEG in the file creation hints If the application does not force the segment size to be the max size and it does not provide hints telling the core server the file size then th...

Page 177: ...ata at the top level of the storage hierarchy and only if the storage class at the top level is disk Truncation of the final segment is controlled by the NOTRUNC_FINAL_SEG flag in the bitfile descript...

Page 178: ...Append If ON files in this COS can have new data appended to them subject to the permissions on each individual file This button may only be ON if the Write button is also ON If the Write button is O...

Page 179: ...urned off which will allow the client to do the polling Changing the Auto Stage Retry flag has no adverse side effects It is recommended that this flag be enabled for all COS s using multiple copies T...

Page 180: ...ng COS change request is currently being processed by one of the Core Server s COS change threads In this case the user should attempt to reissue the request later 6 4 Migration Policies A migration p...

Page 181: ...for that storage class must be restarted in order for the policy to take effect When HPSS needs to apply a migration policy to a subsystem it first searches for a matching subsystem policy If none is...

Page 182: ...window with default values Create Tape Opens a Tape Migration Policy window with default values Configure Opens the selected migration policy for editing Delete Deletes the selected migration policy...

Page 183: ...licy To bring up the configuration for an existing policy select the policy from the list and click on the Configure button Field Descriptions Policy Name The descriptive name of the migration policy...

Page 184: ...SW TMS Hier1 LevelA SW TMS Hier1 LevelB SW TMS Hier2 LevelA SW TMS Hier2 LevelB SW TMS Hiern Levelx SW TMS Hiern Levely For example an HPSS system that has a disk storage class which migrates to a ta...

Page 185: ...of files that should be put in a single tape aggregate If there are less than this many files to migrate they will be migrated at a later time Max Files in Aggregate Maximum number of files that shoul...

Page 186: ...icy from the list and click on the Configure button Field Descriptions Policy Name The descriptive name of the migration policy Policy ID A unique ID associated with the migration policy Runtime Inter...

Page 187: ...other criteria A storage class configured with a migration policy using Migrate Volumes will not be considered as a valid alternate copy from which to retry a failed read or stage operation No storag...

Page 188: ...e 81 6 4 2 3 Changing a Migration Policy To update an existing basic migration policy select the policy from the Migration Policies list window and press the Configure button The Disk or Tape Migratio...

Page 189: ...chies A basic purge policy must be assigned to all disk storage classes that require purge services This basic policy determines the purge parameters for the storage class across all storage subsystem...

Page 190: ...e policy to take effect Field Descriptions Purge Policy List columns The columns provide the same information that can be found on the Purge Policies window in the following section Configuration Butt...

Page 191: ...icy If none is found HPSS uses the basic policy You can consider the basic policy to be the default for all subsystems which do not have policies of their own After changing any purge policy informati...

Page 192: ...the purge record was created the Migration Completion Time Alternately the selection of files for purging may be based on the time the file was created the File Creation Time or the time the file was...

Page 193: ...icy to be deleted Be sure to recycle Core Servers and Migration Purge Servers after deleting a Purge Policy To delete a purge policy select the policy from the Purge Policies window and press the Dele...

Page 194: ...ily Family Name The descriptive name for this file family The name should be unique among all file families in this HPSS installation The default value is File Family ID 6 6 2 Changing a File Family T...

Page 195: ...HPSS Management Guide November 2009 Release 7 3 Revision 1 0 195...

Page 196: ...etadata can be updated dynamically via the PVL Drive Information window and there are some device attributes for which the configuration metadata is not updated dynamically but the server in memory va...

Page 197: ...ned associated Mover if it was UP during the failed retries and or to reinitialize the abandoned associated PVR if it was UP during the failed retries before the device drive can be used Likewise a pr...

Page 198: ...ssociated with this device drive Any positive 32 bit integer value Device Type The type of device over which data will move Mover The name of the Mover that controls the device Advice A single Mover c...

Page 199: ...the Bytes on Device value cannot be greater than the actual size of the underlying device less the Starting Offset value If this value is modified after the disk has been imported into HPSS it must be...

Page 200: ...equests with many source descriptors specifying locations spread sparsely down the tape This is supported only by the IBM SCSI tape device driver SAN3P transfer Enabled disk only If ON SAN3P data tran...

Page 201: ...plied with the Atape driver or using the library console Typically the first drive is located at location 257 for a single frame library For IBM 3494 robots The Drive Address configuration entries cor...

Page 202: ...aged tape drives Mounted Volume disk only The 8 character name of the volume mounted on the disk drive Drive Pool ID tape only If non zero positive integer value the Drive Pool ID will restrict this d...

Page 203: ...cted from the list Note that some of the fields in the table may not be visible depending on the Column View menu settings Field Descriptions ID The unique device drive ID number defined when the devi...

Page 204: ...ly unsupported PVR Mover Notify Pending The PVL needs to notify the associated PVR and Mover that the drive has been created or deleted PVR Notify Pending The PVL needs to notify the associated PVR th...

Page 205: ...lected devices serves no functional purpose When the device is locked the information is not transferred to the PVL and thus the PVL will continue to schedule the associated PVL drive see Lock button...

Page 206: ...over or PVL to clear its error states Note that this does nothing either in hardware or software to actually repair an error condition Also if you mark a drive repaired when it still has a problem the...

Page 207: ...ted PVR s for tape are UP However there are some drive attributes for which the configuration metadata can be updated dynamically via the PVL Drive Information window and there are some device attribu...

Page 208: ...vices and drives are deleted dynamically This means that they must be deleted while the system is UP Specifically the PVL must be UP additionally it is expected that the associated Mover and associate...

Page 209: ...tus may be monitored via several SSM windows When a device drive experiences a problem the PVL and or the Mover issues one or more alarms to inform SSM users of the problem and to notify SSM of the ch...

Page 210: ...HPSS Management Guide November 2009 Release 7 3 Revision 1 0 210...

Page 211: ...f the disk logical volume at which the Mover will begin using the volume The space preceding the offset will not be used by HPSS Mover The descriptive name of the Mover which controls the device Admin...

Page 212: ...s SCSI 2 Logical Block Addresses Advice If SCSI 2 LBAs and the SCSI LOCATE command Locate Support are supported by the device HPSS will calculate tape read addresses based on known LBAs and relative a...

Page 213: ...es are presented as a list of flag descriptions for each flag which is currently ON See the State field description above for a list of potential values Volume Flags Flags which further describe that...

Page 214: ...7 2 2 PVL Drive Information Window HPSS Management Guide November 2009 Release 7 3 Revision 1 0 214...

Page 215: ...HPSS Management Guide November 2009 Release 7 3 Revision 1 0 215...

Page 216: ...nt directly to the PVL and thus are effective immediately Thus the changes are dynamic Field Descriptions Drive ID The ID number unique to this drive The same ID number also refers to the correspondin...

Page 217: ...is in the midst of shutting itself down because of a fatal error Unknown The state of the device is not known to SSM this is usually caused by the PVL being down or disconnected from SSM Usage State I...

Page 218: ...ds the number of consecutive Drive Errors set via the Retry Mount Time Limit mechanism which have occurred on the drive When the number of errors equal or exceed the PVR Drive Error Limit the drive wi...

Page 219: ...shed by specifying HPSS_IOD_SUBFUNC_DRIVE_POOL for the SubFunction and the Drive Pool ID for the Argument in the ReqSpecInfo structure of the IOD Refer to the HPSS Programmer s Reference I O Supplemen...

Page 220: ...locking a Drive The Administrative State of the drive must be unlocked to allow HPSS to make use of a device drive Before unlocking a drive ensure that its hardware is functional and is fully configur...

Page 221: ...ve State to Mark Repaired Repairing the state of a device drive is only an instruction to the server to reset the displayed device drive state value It does not correct any underlying problems that mi...

Page 222: ...HPSS Management Guide November 2009 Release 7 3 Revision 1 0 222...

Page 223: ...g a tape cartridge or disk volume to the PVL and labeling it with an HPSS volume label Importing also makes the volume known to the PVR and PVL and creates the appropriate metadata records Cleaning ca...

Page 224: ...e ACSLS System Administrator s Guide for procedures to enter cartridges Cartridges may be entered into the STK silo through various means including Using the enter command of ACSLS StorageTek s robot...

Page 225: ...tten or checked The PVL will attempt to evenly distribute the work across the specified number of tape drives The administrator should consider the current and expected demand for tape drives of the t...

Page 226: ...were successful then the 38th volume in the Volume List caused the failure When the Max Number of Drives is greater than 1 the SSM System Manager effectively starts multiple import jobs equal to Max N...

Page 227: ...me name to the Volume List set the Fill Count and the Fill Increment each to 1 and type the volume name into the Volume Label field The volume name will be added to the Volume List To automatically ge...

Page 228: ...type will cause the HPSS label to be re written if an existing HPSS or Foreign label already exists provided it is for the same Volume ID this allows tapes to be re written in newer drives e g tapes...

Page 229: ...ted highlighted in the Volume list clicking on this button will remove them from the list Note that this does not actually delete anything from HPSS Import Begins the volume import using the displayed...

Page 230: ...different density Tape Not Imported Label Written Tape Imported Label Written Tape Imported HPSS always attempts to read a label at the beginning of a tape when performing an import Some tape drives...

Page 231: ...to restart a partially completed import after fixing the cause of the error which terminated the first request by clicking the Import button again There is no need to remove the already imported volum...

Page 232: ...l Count 6 Fill Increment 2000 Volume Label AA7329 Labels automatically inserted into Volume List AA7329 AA9329 AB1329 AB3329 AB5329 AB7329 The filling will not occur and an error will be displayed if...

Page 233: ...The total number of disks to be imported This is an informational field reflecting the number of volume names generated in the Volume List and is not directly editable Volume List A list of volume lab...

Page 234: ...The choice of storage sub system determines the Core Server that will be used Ensure that the PVL and the appropriate Core Server are running before initiating a Create Storage Resources request Also...

Page 235: ...1 Create Tape Resources Window This window is used to create tape storage resources tape virtual volumes in a Core Server The tapes must first be imported to the appropriate PVL The names of the volum...

Page 236: ...o alphabetic columns and vice versa Example Fill Count 6 Fill Increment 2000 Volume Label AA7329 Labels automatically inserted into Volume List table AA7329 AA9329 AB1329 AB3329 AB5329 AB7329 Once the...

Page 237: ...lphanumeric characters The Fill Increment is added to the least significant portion of a volume label to generate a new label Volume Label The next label that will be generated and inserted into the t...

Page 238: ...type the volume name into the Volume Label field The volume name will be added to the Volume List To automatically generate a list of volume names in the Volume List set the Fill Count to the desired...

Page 239: ...re Server that will process the create request and in which the disk storage resources will be created The Storage Class field must be filled in before selecting a Core Server VVs To Create The number...

Page 240: ...list of labels Clear All This button clears the Volume list and Volume Label field Create Resources Begins the process of creating HPSS storage resources using the displayed data A start message is d...

Page 241: ...deleted The Delete Resources operation may be performed on either retired or non retired volumes Successful deletions result in the removal of the Core Server s metadata records from the appropriate s...

Page 242: ...t each one larger than the previous entry by the specified Fill Increment Example Fill Count 6 Fill Increment 10 Volume Label AA0070 Labels automatically inserted into Volume List AA0070 AA0080 AA0090...

Page 243: ...ctly into this list but must construct it using one of the three methods described above You can select one or more labels from the list for the purpose of removing them from the list see Clear Select...

Page 244: ...ut output I O stations and can then be manually removed SCSI When an HPSS tape export command is issued the cartridges will be placed in the input output I O slot and can then be manually removed STK...

Page 245: ...entry methods may be repeated multiple times on the same window to add additional volumes to the list All three entry methods or any combination of them may be used in succession on the same window To...

Page 246: ...is executing Enter the name of the file in the File Containing Volume List field The volume names from the file will be added to the Volume List The entire list of volumes is sent to the System Manage...

Page 247: ...of the three ways described above Use the scrollbar to move up and down the list of labels You can select one or more labels from the list for the purpose of deleting them from the list see Clear Sel...

Page 248: ...gned Volumes are assigned to a storage class by the Create Resources operation The information displayed in this window is obtained from the MPS which obtains part of it from the Core Servers The Migr...

Page 249: ...is exceeded For tape a threshold is defined as a count of free virtual volumes When the number of free volumes drops below a threshold level the threshold is exceeded Possible values are OK The stora...

Page 250: ...control options These are Start If the migration state is Waiting this starts the migration and puts it into the Running state This does not guarantee that any files will be migrated only that files w...

Page 251: ...ge class See Section 8 4 3 2 Reclaim Virtual Volumes Window on page 262 for details This button is only enabled for tape storage classes Information Buttons Storage Class Info Opens the MPS Storage Cl...

Page 252: ...virtual volumes VVs Second the disk window reports Space Used while the tape window reports Percent Used Third the disk window shows purge status while the tape window does not Since an MPS is specifi...

Page 253: ...the total capacity of the storage class in bytes Free Space For disk storage classes this reports the unused capacity of the storage class in bytes Space Used The percent of storage space in the stor...

Page 254: ...ing A migration on this storage class is in progress Waiting Migration is not taking place at this time The start of the next migration is waiting until criteria specified in the migration policy are...

Page 255: ...pended Purging on this storage class has been suspended Start Time The date and time when the most recent purge run started It may still be running End Time The date and time when the last purge run c...

Page 256: ...tape window reports space in terms of virtual volumes VVs Second the disk window reports Space Used while the tape window reports Percent Used Third the disk window shows purge status while the tape...

Page 257: ...er of free volumes in this storage class drops below this level the MPS will send a critical alarm to SSM Note that the disk threshold reaches the warning level when the percent of used space rises ab...

Page 258: ...Dealing with a Space Shortage If free space warning thresholds are exceeded in a storage class HPSS will warn the administrator with messages in the Alarms and Events window Before the available stor...

Page 259: ...Active Storage Classes window to force the start of a purge run for one or more storage classes From the Active Storage Classes window select one or more purgeable storage classes and then click on t...

Page 260: ...he repack man page When the repack process completes successfully the Number of Active Segments in the volume s display will be zero and the VV Condition will be EMPTY Note that tape volumes in EOM Co...

Page 261: ...ble in the family a new blank volume will be chosen and assigned to the family If Not in a family is selected volumes not assigned to any file family will become candidates for repack Volumes that hav...

Page 262: ...storage class Tape volumes that meet the repack criteria will be repacked Status messages are displayed on the status bar at the start and end of the repack 8 4 3 2 Reclaim Virtual Volumes Window Thi...

Page 263: ...e utility 8 5 Volume Management This section describes how to monitor and manage PVL volumes PVR cartridges and Core Server Disk and Tape volumes 8 5 1 Lookup Cartridges Volumes Window This window all...

Page 264: ...f the PVR that owns the cartridge corresponding to the volume being viewed This field is applicable only to tape volumes and is always blank for disk volumes Allocated Client The descriptive name of t...

Page 265: ...ontains HPSS Foreign The volume has an ANSI label but the owner field is something other than HPSS None The volume has no label A volume in this state is not usable by HPSS It should be exported and r...

Page 266: ...HPSS Management Guide November 2009 Release 7 3 Revision 1 0 266...

Page 267: ...ng it the Mounts Since Maintenance field can be reset The Maintenance Date field can also be reset Note that resetting one field does not affect the other The third operation involves resetting the Mo...

Page 268: ...Mounts In Service The number of times the cartridge has been mounted by HPSS since it was imported Mounts Since Maintenance The number of times the cartridge has been mounted since its last maintenan...

Page 269: ...re Slot The slot address Unit Panel Row and Column for the cartridge These fields are valid only if Location Type is Slot and the PVR supports this STK and AML The fields will be zero when it s not va...

Page 270: ...ional state In RW condition the volume can be read and written but new disk storage segments may not be created on the volume In RO condition the volume can be read but not written New storage segment...

Page 271: ...of bytes on the disk virtual volume that are not assigned to storage segments Free Space is initially set to the value of Usable Length then decremented and incremented by the size of disk storage seg...

Page 272: ...ts are created on the volume they are created at a length that will be a multiple of this value VV Block Size The virtual volume block size This is the number of bytes written from a data stream to an...

Page 273: ...a type Dev ID The ID of the device the physical volume is mounted on Mvr IP Addr The IP address of the Mover that operates this physical volume Mvr The descriptive name of the Mover that operates this...

Page 274: ...f the first physical volume that is a part of the tape virtual volume The entire virtual volume can be referred to by this name VV Condition This is the administrative control for the tape virtual vol...

Page 275: ...e drop down menu and then pressing the Update button Changes Pending If there are any VV Condition changes for this volume pending in the Core server Changes Pending will be Yes with a red bullet Othe...

Page 276: ...and is decremented as storage segments are written It is not incremented when storage segments are deleted Because of the variable compressibility of data written to tapes this value may behave stran...

Page 277: ...tape volume expressed as an HPSS Relative Stripe Address Less Commonly Used Data Tab File Family The family to which the volume is assigned if any If it is not assigned to a family it is assigned to...

Page 278: ...ce source not found for a description of the subfields of this field Current Writing Segment The detailed description of the tape storage segment ID associated with the segment that is found at the en...

Page 279: ...s useful for emptying a disk through attrition Disk volumes can be emptied more quickly by setting the Condition to RW then purging or repacking the disk Volumes in RW condition can be changed to any...

Page 280: ...be done in a single update of the Core Server Disk Volume or Core Server Tape Volume window Note that tapes do not need to be in EOM condition to be retired The Retire flag can be cleared if necessar...

Page 281: ...al volumes to the list All three entry methods or any combination of them may be used in succession on the same window To add a single volume name to the Volume List set the Fill Count and the Fill In...

Page 282: ...Volume List field The volume names from the file will be added to the Volume List Each cartridge in the list is sent to the System Manager as a separate move request If an error occurs on a request S...

Page 283: ...resets Fill Count and Fill Increment to 1 Clear Selected If one or more cartridges are selected highlighted in the Volume List clicking on this button will remove them from the list Note that this doe...

Page 284: ...lection will be highlighted You may select only one job at a time The fields displayed in the table as identified in the title line column headings are shown below ID A unique number assigned to each...

Page 285: ...are being ejected from a PVR for export jobs only In Use All volumes required for the job are mounted and ready for use Deferred Dismount Dismount for cartridges will be delayed Tape Check In The job...

Page 286: ...t of type scratch Overwrite Import A media import of type overwrite Export A media export Move A cartridge being moved to a new PVR Relabel A cartridge being relabeled Sync Mount A synchronous mount D...

Page 287: ...The job is waiting for a volume to be mounted Mounted All volumes required for the job are mounted Tape Check In The job is waiting for the cartridge to be checked in Tape Check Out The job is waitin...

Page 288: ...nsfer The PVL will retry the unload command until the I O completes and the device reservation is freed Once a volume has been successfully unloaded all I O operations directed to the device will fail...

Page 289: ...off line storage to a tape library Field Descriptions PVR The descriptive name of the PVR that owns the cartridge Cart ID The six character label identifying the cartridge to be inserted into the robo...

Page 290: ...eceived SSM may bring up the Tape Mount Requests window automatically if it is not currently displayed This behavior is disabled by deselecting the Auto Popup checkbox To open the window manually sele...

Page 291: ...insertion HPSS will not select a retired volume to receive a new storage segment In every other way retired volumes behave normally Storage segments on retired disk volumes can be read and written nor...

Page 292: ...uld probably create only one volume at first in order to check its characteristics If they are not as desired the volume can be deleted and steps one and two can be repeated It is not necessary to cre...

Page 293: ...HPSS Management Guide November 2009 Release 7 3 Revision 1 0 293...

Page 294: ...e location specified by HPSS LOGGER syslog or stdout if the logger isn t running available The HPSS logging facility is comprised of two types of servers Log Clients and the Log Daemon Log Clients run...

Page 295: ...fter changing any log policy information including the Default Log Policy the appropriate Log Clients must be reinitialized to make the changes effective The Log Clients associated with a particular p...

Page 296: ...Servers window Section 5 1 1 1 Log Policy on page 95 Log policies for a server can also be deleted from the same window by pressing the Use Default Log Policy button Field Descriptions Default Logging...

Page 297: ...cute on host A then only the Log Client which runs on host A needs to be reinitialized Mover log policies are managed differently if you modify the log policy for a Mover that Mover itself must be rei...

Page 298: ...s record types be selected for all servers while they are running normally Core Servers and Movers should also log Debug messages and additional record types for debugging purposes should be selected...

Page 299: ...ing a log policy ensure that no servers are configured to use it Otherwise the log policy deletion could result in loss of important log messages After deleting a log policy the Log Clients supporting...

Page 300: ...tion mechanism and authenticator name The central log file names available for delogging are logfile01 and logfile02 These files reside in the directory name specified in the Log Daemon configuration...

Page 301: ...art Time The time and date when the logfile was marked In Use Stop Time The time and date when the logfile was last In Use State The state of the logfile Possible states are In Use the file is current...

Page 302: ...ported If neither the Local Logfile option nor the Syslog option is specified no local logging will occur to a local log file If the Log Daemon option is not specified no messages from the HPSS server...

Page 303: ...ecting the message and pressing the Alarm Event Info button to bring up the Alarm Event Information window Field Descriptions This list displays a column for each field shown on the Alarm Event Inform...

Page 304: ...d the message Routine Name of the function that was executing when the message was logged Client PID Process ID of the process that logged the message Client Node ID Name of the host where the message...

Page 305: ...tion on the problem as follows Use the alarm message number to look up the alarm information in the HPSS Error Messages Reference Manual For each documented message the manual provides more detailed i...

Page 306: ...nd Events window but they should be accessible from the delog utility This means that there can be gaps in the list displayed in the Alarms and Events window if the System Manager is shut down and res...

Page 307: ...ularly the messages displayed by the hpssgui Alarms and Events window will constantly be moving downward at set intervals This can make it difficult to select a specific message if the window is updat...

Page 308: ...d no other filesets will ever be created 10 1 Filesets Junctions List This window displays information about the filesets and junctions that are configured in the HPSS system From this window detailed...

Page 309: ...set Junction Name The name of a junction that points to this fileset This field may be blank if there are no junctions configured to point to this fileset Parent Fileset The name of the fileset in whi...

Page 310: ...SSM automatically generates a fileset ID for the new fileset After a fileset has successfully been created a junction will need to be created to get to the new fileset name space from the root node f...

Page 311: ...rs are themselves displayed as two backslashes Trailing null i e zero bytes are not displayed To modify this field enter data in the same format Printable characters except for the backslash can be en...

Page 312: ...window Monitor menu select Filesets Junctions to display the Filesets Junctions List select one or more filesets then press the Detail button Any changes made to fields on this window are sent directl...

Page 313: ...If checked the fileset cannot be written to or updated in fact it is not possible to set any of the attributes except the Fileset State attribute User Data This field is available for storing up to 1...

Page 314: ...ept for the Dismiss button Note that only empty filesets may be deleted Freeze Clicking on this checkbox freezes the window in other words all automatic updates to the window are suspended Toggling th...

Page 315: ...persistent UNIX mount points Although HPSS allows junctions to any directory this window can only be used to create junctions to directories that are also filesets Field Descriptions Fileset ID The I...

Page 316: ...eljunction man page To delete a junction using SSM select the junction s to be deleted from the Filesets Junctions List and press the Delete Junction button You will be asked to confirm the deletion w...

Page 317: ...ould otherwise be very difficult to isolate and display 11 1 Files Directories Window This window is reached through Monitor Lookup HPSS Objects Files Directories The pathname of either an HPSS file o...

Page 318: ...File Directory Information window a button labeled Show Bitfile ID will appear at the bottom of the window Pressing this button will cause the Storage Object ID window to appear Field Descriptions Pa...

Page 319: ...t and DotDot Creation Time Time and date that the file or directory was created Modify Time Time and date that the metadata associated with the file or directory was last modified Last Written Time Th...

Page 320: ...ets have three access states read write and destroyed If a fileset allows reading a check mark is displayed in the box labeled Read If a fileset allows data to be written a check mark is displayed in...

Page 321: ...ilesetStateFlags x x FilesetType x x GID x x GroupPerms x x LinkCount x ModePerms x x Name x x OpenCount x OptionFlags x OtherPerms x x ReadCount x SubSystemId x x TimeCreated x x TimeLastRead x x Tim...

Page 322: ...f the server which manages the object This must be entered in the indicated format HPSS utility programs that display SOIDs should present this field in the correct format Type This is a collection of...

Page 323: ...o get good performance with tape aggregation there are several things to consider First there need to be a sufficient number of files ready to migrate If migration runs too often or if the HPSS system...

Page 324: ...creen Edit any other tape aggregation related fields on that screen as needed If MPS is running you must also tell it to reread the Disk Migration Policy HPSS Management Guide November 2009 Release 7...

Page 325: ...suser man page for more information Ensure that the Core Server is up and running before adding the FTP User ID The hpssuser utility will not be able to create the user s home directory if the Core Se...

Page 326: ...ation you MUST supply the nohome option when adding a user using the all flag 13 1 1 2 Add a UNIX User ID The hpssuser utility can be used to create UNIX identities and to create unix keytabs by using...

Page 327: ...rincipal 13 1 1 4 Add an LDAP User ID Invoke the hpssuser utility as follows to add an LDAP User ID hpssuser add user ldap The utility will prompt the user for the required data Following is an exampl...

Page 328: ...ty on page 26 for more information on SSM user security Invoke the hpssuser utility as follows to add an SSM User ID hpssuser add user ssm The utility will prompt the user for the required data Follow...

Page 329: ...r info uid 300 gid 210 home home user1 shell bin ksh fullname Test User ssm user info admin perms rwxcidt operator perms r c t SSM client security ACL entry rwxcidt user 300 user1 10000 HPSS_REALM NAM...

Page 330: ...users for HPSS usage or not The accounting policy may be created using the Accounting Policy window select this window by clicking Accounting on the Policies submenu of the Configure menu on the HPSS...

Page 331: ...e is Bytes Status Message Interval The number of seconds between status messages sent to SSM by the Accounting utility during an accounting run A non zero value less than 10 will be treated as 10 A va...

Page 332: ...formation for that storage subsystem Before creating an accounting report you must create and fully configure an Accounting Policy The initial Accounting Policy should be set up before any files are c...

Page 333: ...fter a successful run Total Length of Files Total length of all bitfiles in the storage subsystem Set after a successful run Bytes Transferred Total bytes transferred for the storage subsystem during...

Page 334: ...vice If a class of service is configured to stage bitfiles on open then all file accesses will occur in the storage class at the top of the hierarchy The total amount of data transferred Transferred i...

Page 335: ...rom its original location 13 2 3 Accounting Procedures The amount of work needed to support accounting varies according to the style of accounting used whether or not Account Validation is being used...

Page 336: ...onal information beyond that maintained in the Account Validation table it will need to create a local site defined Account Map For example some sites may need to keep track of a department or company...

Page 337: ...are handled through the normal utilities that set up and modify users and UIDs A basic set of site developed utilities are described in more detail below Add a user and account New entries can be made...

Page 338: ...he for several minutes after it has changed For this reason changes to a user s accounting data may not appear in an accounting report until this period of time has elapsed Those changes which are sti...

Page 339: ...that non numeric strings will be interpreted as zero By default these messages will go to the standard output stream but see HPSS_API_DEBUG_PATH HPSS_API_DEBUG_PATH specifies the destination of debug...

Page 340: ...ens which would return EINPROGRESS to indicate that the file is being staged will be retried using HPSS_API_RETRIES and HPSS_API_BUSY_DELAY to control the number and timing of retries while a value of...

Page 341: ...ust be performed prior to using the FTP user interface to transfer HPSS data 1 Verifying the FTP Initial Configuration 2 Configuring the FTP Daemon Syslog 3 Defining the FTP Access 4 Creating FTP User...

Page 342: ...ator to customize appropriately The pound sign at the beginning of a line indicates a comment Options are enabled by removing the comment symbol and conversely disabled by introducing this symbol Some...

Page 343: ...on_stage to 1 wait forever for a SC with no stage set would make little sense wait_on_stage stage code Define users as being guests which means they cannot cd out of their own subdirectory guestgroup...

Page 344: ...r FTP users disconnected at d indicates that shutdown will be 1 28 94 at 16 00 with users disconnected at 15 30 and sessions denied at 14 40 the 120 indicates 1 hour 20 minutes The when clauses may b...

Page 345: ...gistry depending on which authentication mechanism is enabled In addition the entry for the hpssftp user must contain a home directory defined to be a non NULL value Anonymous FTP users will have the...

Page 346: ...wned by the mount command The Mount Helper calls the mount system call which in turn drills down to the Kernel Module to do kernel mount processing The mount helper also spawns one or more HPSS VFS Da...

Page 347: ...PPORT on USE_PTHREAD_25 on 14 3 3 2 Compiling Building As root cd to opt hpss and then compile the HPSS Client API source code Do not include the fs package in this step that is complied separately ma...

Page 348: ...sion kernel fs hpssfs hpssfs ko HPSS VFS Device Special File dev hpssfs0 HPSS VFS Daemon sbin hpssfsd HPSS VFS Mount Helper sbin mount hpssfs 14 3 3 4 Client API Pre Requisite VFS is dependent upon th...

Page 349: ...command exited with status 0 Untar the client config bundle generated on the Core Server machine under the var hpss etc directory Make sure that all the appropriate var hpss etc keytab files are copi...

Page 350: ...8 admin_server abilene clearlake ibm com 749 domain_realm fully qualified hostname all caps fully qualified hostname There must be a user named hpssfs on the client machine and hpssfs s uid and gid mu...

Page 351: ...d file system An example of a command to mount a HPSS root directory tree is as follows mount t hpssfs LOCAL tmnt o cos 5 In the above example the t hpssfs option refers to the VFS Interface filesyste...

Page 352: ...eet specific usage scenarios The following table lists the mount options which can be specified either via the mount command using the o option or via etc fstab Table 5 HPSS VFS Interface Mount Option...

Page 353: ...n first access This consumes resources so care must be taken not to make this too large Configuring this to typical file access patterns will speed access when large enough to cache future requests sa...

Page 354: ...hpssfs mounted entries An example of a mounted hpssfs entry is as follows hpssfs 2553 2554 on tmnt type hpssfs rw noauto san dio ip eth2 cos 96 where 2553 is the HPSS VFS Daemon process ID 2554 is the...

Page 355: ...sts 14 5 Additional VFS Notes 14 5 1 Building an RPM Package After setting up VFS on a machine the admin can build a RPM package to distribute to other client machines The HPSS Client API must still b...

Page 356: ...ilities for DB2 While DB2 has sophisticated backup and recovery abilities it is fundamentally the responsibility of the HPSS administrator to ensure that these facilities are configured and working co...

Page 357: ...s RUNSTATS is a DB2 process that analyzes the tables and produces statistics that are vital to DB2 s performance Without good statistics DB2 may create very inefficient database access plans that resu...

Page 358: ...backup history in each backup so it can determine which images and logs are necessary Assuming an automated method is used for backup storage and retrieval it can also fetch the images and restore fro...

Page 359: ...decide how best to recover your DB2 database or damaged container 15 2 HPSS System Environmental Backup The HPSS administrator must also ensure that the HPSS system environment is backed up on a regu...

Page 360: ...files related to it are placed in a single directory var hpss krb5kdc If you configured Kerberos manually you ll need to determine the file locations yourself The files that should be backed up are C...

Page 361: ...a particular drive a drive that requires cleaning If the suspect volume is a tape try to get it mounted on a number of drives during the repack effort Sometimes a tape will fail on one drive but can...

Page 362: ...attempts to repack the damaged volume have failed Run recover which looks for a secondary copy If found recover purges all the segments on the damaged volume and attempts to reconstruct the volume da...

Page 363: ...dary copy of the data exists the system administrator cannot use the recover utility to recover the data In this case the system administrator should make every attempt to repack the damaged volumes I...

Page 364: ...to clean up all storage resources that point to the damaged volume s without even attempting a repack To perform this type of clean up procedure the recover utility can be executed with the x option...

Page 365: ...runs that subsystem The configuration settings for these monitors are found in the global and subsystem configurations The interval at which the monitors run and the thresholds at which they send ala...

Page 366: ...l you see the Table Spaces folder 2 Right click the table space you wish to add the container to and select Alter from the pop up menu 3 Select the Containers tab click Add complete the information an...

Page 367: ...HPSS Management Guide November 2009 Release 7 3 Revision 1 0 367...

Page 368: ...will not re initialize a tape that has been retired retire Marks a disk or tape volume as read only and not reclaimable remove Deletes empty disk and tape volumes from the Core Server s metadata then...

Page 369: ...age classes PVL jobs and volumes and to display alarms and events It may be run interactively or in batch mode hpssgui Starts the Graphical User Interface program which is the primary administrative i...

Page 370: ...ree disk_allocation_stat Calculates and displays statistics on disk usage and fragmentation for disk storage classes ftp DIS2 COM PFTP Daemon This is a portable version of a standard UNIX FTP daemon w...

Page 371: ...nd tape storage maps showdiskmaps Sends a command to the Core Server in the selected storage subsystem to dump its in memory disk space allocation maps then displays that information on standard outpu...

Page 372: ...HPSS Management Guide November 2009 Release 7 3 Revision 1 0 372...

Page 373: ...tecture attribute When referring to a managed object an attribute is one discrete piece of information or set of related information within that object attribute change When referring to a managed obj...

Page 374: ...es with similar logical characteristics and performance requirements together A Class of Service is supported by an underlying hierarchy of storage classes cluster The unit of storage space allocation...

Page 375: ...ms device and drive are often used interchangeably EFS External File System ERA Extended Registry Attribute ESCON Enterprise System Connection event A log record message type used to log informational...

Page 376: ...he gatekeeping site policy code Gatekeeping Site Policy The gatekeeping shared library code written by the site to monitor and throttle create open and or stage requests GB Gigabyte 230 GECOS The comm...

Page 377: ...Reply Structures used to send control information about data movement requests in HPSS and about the success or failure of the requests IP Internet Protocol IRIX SGI s implementation of UNIX junction...

Page 378: ...r specific logging policies LRU Least Recently Used LS Location Server LTO Linear Tape Open A half inch open tape technology developed by IBM HP and Seagate MAC Mandatory Access Control managed object...

Page 379: ...Name Service performs access verification and provides the Portable Operating System Interface POSIX name space The set of name object pairs managed by the HPSS Core Server NERSC National Energy Resea...

Page 380: ...lock A lock applied to a bitfile which prohibits the bitfile from being purged PV Physical Volume PVL Physical Volume Library PVM Physical Volume Manager PVR Physical Volume Repository RAID Redundant...

Page 381: ...ork addresses SMC SCSI Medium Changer SMIT System Management Interface Tool SNL Sandia National Laboratories SOID Storage Object ID An internal HPSS storage object identifier that uniquely identifies...

Page 382: ...the Core Server to keep track of allocated storage space storage segment An HPSS object managed by the Core Server to provide abstract storage for a bitfile or parts of a bitfile Storage Service The p...

Page 383: ...sactions until the transaction is either committed or aborted Once the transaction commits all changes to data are guaranteed to be permanent TTY Teletypewriter UDA User defined Attribute UDP User Dat...

Page 384: ...HPSS Management Guide November 2009 Release 7 3 Revision 1 0 384...

Page 385: ...r s Guide November 2009 Release 6 2 20 IBM 3494 Tape Library Dataserver Operator s Guide GA32 0280 02 21 IBM AIX Version 4 3 Installation Guide SC23 4112 01 22 IBM SCSI Device Drivers Installation and...

Page 386: ...y Physical Volume Library Deadlock Avoidance in a Striped Media Environment from the 1995 IEEE MSS Symposium courtesy of the IEEE Computer Society Press 37 R Grossman X Qin W Xu H Hulen and T Tyler An...

Page 387: ...nowledge Cornell Information Technologies of Cornell University for providing assistance with naming service and transaction management evaluations and for joint developments of the Name Service In ad...

Page 388: ...HPSS Management Guide November 2009 Release 7 3 Revision 1 0 388...

Reviews:

No comments

Related manuals for RELEASE 7.3

NEC Versa 2730M Manual preview
Versa 2730M
Brand: NEC Pages: 4
ACRONIS DISK DIRECTOR SUITE 10 User Manual preview
DISK DIRECTOR SUITE 10
Brand: ACRONIS Pages: 127
Paradyne OPENLANE User Manual preview
OPENLANE
Brand: Paradyne Pages: 86
Ulead DVD MOVIEFACTORY 3 User Manual preview
DVD MOVIEFACTORY 3
Brand: Ulead Pages: 78
Vaisala Veriteq viewLinc 3.6 Administrator'S Manual preview
Veriteq viewLinc 3.6
Brand: Vaisala Pages: 122
Cabletron Systems 7C03 MMAC SmartSWITCH User Manual preview
7C03 MMAC SmartSWITCH
Brand: Cabletron Systems Pages: 150
KapLogic Aegis2.2x Installation Manual preview
Aegis2.2x
Brand: KapLogic Pages: 24
Paradyne Jetstream CPX-1000 User Manual preview
Jetstream CPX-1000
Brand: Paradyne Pages: 240
Oki B6100n Administration Manual preview
B6100n
Brand: Oki Pages: 106
Xerox FreeFlow 701P45570 Integration Manual preview
FreeFlow 701P45570
Brand: Xerox Pages: 12
Blackberry PRD-07630-011 - Enterprise Server - PC Manual preview
PRD-07630-011 - Enterprise Server - PC
Brand: Blackberry Pages: 69
HP StorageWorks 64 - SAN Director Switch Cli Reference Manual preview
StorageWorks 64 - SAN Director Switch
Brand: HP Pages: 160
HP StorageWorks 8/24 - SAN Switch Hardware Reference Manual preview
StorageWorks 8/24 - SAN Switch
Brand: HP Pages: 110
HP StorageWorks 4/8 - SAN Switch Release Note preview
StorageWorks 4/8 - SAN Switch
Brand: HP Pages: 42
HP StorageWorks 8/8 - SAN Switch Release Note preview
StorageWorks 8/8 - SAN Switch
Brand: HP Pages: 54
Native Instruments AbbeyRoad 60s User Manual preview
AbbeyRoad 60s
Brand: Native Instruments Pages: 26
HP PROBOOK 4730S Specifications preview
PROBOOK 4730S
Brand: HP Pages: 3
HP Presario SR1100 - Desktop PC Technical Specifications preview
Presario SR1100 - Desktop PC
Brand: HP Pages: 1

Brands by name

Popular brands

Load more brands