This is Google's cache of http://www.experts-exchange.com/OS/Unix/Q_21595510.html. It is a snapshot of the page as it appeared on 25 Sep 2008 04:54:19 GMT. The current page could have changed in the meantime. Learn more

Full version
These terms only appear in links pointing to this page: http www experts exchange com os unix q_21595510 html  
Operating system crash

Advertisement

10.14.2005 at 11:19AM PDT, ID: 21595510
[x]
Attachment Details
7.0

Operating system crash

What are the most important things we need to troubleshoot when a server goes down or a system crashes? What do we need to do to bring it backup? Consider Redhat Linux or hp-ux
Question Stats
Zone: OS
Question Asked By: zkaiserm
Solution Provided By: Panjandrum
Participating Experts: 3
Solution Grade: A
Views: 8
Translate:
Loading Advertisement...
10.15.2005 at 12:41AM PDT, ID: 15090565
 
10.15.2005 at 02:11AM PDT, ID: 15090704

Rank: Guru

 
10.17.2005 at 05:37AM PDT, ID: 15098700
 
10.17.2005 at 05:47AM PDT, ID: 15098784
 
10.17.2005 at 05:55AM PDT, ID: 15098846
 
10.17.2005 at 06:34AM PDT, ID: 15099192

Rank: Guru

 
10.17.2005 at 11:11AM PDT, ID: 15101670
 
10.17.2005 at 11:46AM PDT, ID: 15101944
 
10.17.2005 at 02:35PM PDT, ID: 15103341
 
 
 
Microsoft
  • Applications
  • Development
  • Hardware
  • Internet Protocols
  • OS
  • Windows Security
Apple
  • Hardware
  • Networking
  • Operating Systems
  • Programming
  • Software
Internet
  • Anti Spam
  • Anti-Spyware
  • Anti-Virus
  • Chat / IM
  • Email Clients
  • File Sharing
  • New Net Users
  • Search Engines
  • Web Browsers
  • Web Development
  • Web Servers
  • WebTrends / Stats
Gamers
  • Action / Adventure
  • Computer Games
  • Consoles
  • Emulators
  • Game Programming
  • Misc
  • Online / MMORPG
  • Puzzle
  • Role Playing
  • Sports
  • Strategy
  • Tips
Digital Living
  • Apple
  • Automotive
  • Digital Music
  • Gaming World
  • Hardware
  • Home Security
  • Networking Hardware
  • New Net Users
  • New Users
  • Software
Virus & Spyware
  • Anti Spam
  • Anti-Spyware
  • Anti-Virus
  • Cell Phones
  • Encryption
  • Hardware Firewalls
  • HijackThis
  • IDS
  • Internet
  • Operating Systems
  • Operating Systems Security
  • Software Firewalls
  • Vulnerabilities
  • WebApplications
Hardware
  • Apple
  • Components
  • Desktops
  • Displays / Monitors
  • Embedded Hardware
  • Handhelds / PDAs
  • Laptops/Notebooks
  • Misc
  • Networking Hardware
  • New Users
  • Peripherals
  • Servers
  • Storage
Software
  • Business Management
  • CYGWIN
  • Database
  • Development
  • Firewalls
  • Industry Specific
  • Internet / Email
  • Message Queue
  • Misc
  • MultiMedia Applications
  • Network Management
  • Office / Productivity
  • OS
  • OS/2 Apps
  • Page Layout
  • Photos / Graphics
  • Quality Assurance
  • Security
  • Server Software
  • System Utilities
  • Virtualization
  • VMware
  • Voice Recognition
  • Web Development
ITPro
  • Anti Spam
  • Anti-Spyware
  • Anti-Virus Apps
  • Apple Hardware
  • Chat / IM
  • Consulting
  • Devices
  • Displays / Monitors
  • Email Clients
  • Encryption
  • File Sharing
  • Firewalls
  • IDS
  • Laptops & Notebooks
  • Networking
  • Networking Hardware
  • Operating Systems Security
  • OS
  • Peripherals
  • Search Engines
  • Servers
  • Storage
  • Vulnerabilities
  • Web Browsers
  • Web Computing
  • Web Servers
  • WebApplications
  • WebTrends / Stats
Developer
  • Application Servers
  • Content Management
  • CYGWIN
  • Database
  • Dev Tools
  • File Sharing
  • Game Programming
  • Industry Specific
  • Office / Productivity
  • Programming
  • Protocols
  • Search Engines
  • Web Browsers
  • Web Development
  • Web Servers
  • WebTrends / Stats
Storage
  • Backup / Restore
  • Disaster Recovery
  • Grid
  • Hard Drives
  • Misc
  • Remote Access
  • Removable Backup Media
  • Servers
  • Storage Technology
OS
  • Apple
  • AS / 400
  • BeOS
  • Development
  • Linux
  • MainFrame OS
  • Microsoft
  • Miscellaneous
  • OS / 2
  • Security
  • Unix
  • VMS / OpenVMS
  • VMware
Database
  • 4GL
  • Berkeley DB
  • Clarion
  • Contact Management
  • Data Manipulation
  • DB2
  • dBase
  • Filemaker Pro
  • FoxPro
  • GIS & GPS
  • Informix
  • Interbase / Firebird
  • InterSystems Cache
  • LDAP
  • Miscellaneous
  • MS Access
  • MS SQL Server
  • MUMPS
  • MySQL Server
  • OLAP
  • Oracle
  • PostgreSQL
  • Reporting
  • SAS
  • Siebel
  • Software
  • SQLBase
  • Sybase
Security
  • Anti Spam
  • Anti-Spyware
  • Anti-Virus
  • Chat / IM
  • Digital Forensics
  • Email Clients
  • Encryption
  • File Sharing
  • IDS
  • Misc
  • Operating Systems Security
  • Software Firewalls
  • VPN
  • Vulnerabilities
  • Web Browsers
  • WebApplications
Programming
  • Algorithms
  • Automation
  • Database
  • Editors IDEs
  • Game
  • Handhelds / PDAs
  • Installation
  • Languages
  • Misc
  • Multimedia Programming
  • Open Source
  • Processor Platforms
  • Project Management
  • Signal Processing
  • System / Kernel
  • Theory
Web Development
  • Authoring
  • Blogs
  • Components
  • Digital Camera Software
  • Document Imaging
  • Fonts
  • Illustration
  • Images
  • Images and Photos
  • Internet Marketing
  • Miscellaneous
  • Scripting
  • Search Engines
  • Software
  • Web Frameworks
  • Web Graphics
  • Web Languages/Standards
  • Web Servers
  • Web Services
  • WebApplications
  • WebTrends / Stats
Networking
  • Apple Networking
  • Application Servers
  • Backup / Restore
  • Broadband
  • Content Management
  • Email Servers
  • File Servers
  • Grid
  • ISPs & Hosting
  • Java Editors & IDEs
  • Linux Networking
  • Message Queue
  • Misc
  • Network Management
  • Networking Hardware
  • Novell Netware
  • Operating Systems
  • OS / 2
  • Protocols
  • Removable Backup Media
  • Security
  • Servers
  • Storage Technology
  • System Utilities
  • Telecommunications
  • Unix Networking
  • Web Computing
  • Web Servers
  • Windows Networking
  • Wireless
Other
  • Automotive
  • Business Travel
  • Community Support
  • Expert Lounge
  • Lounge
  • Math / Science
  • Miscellaneous
  • New Net Users
  • Philosophy / Religion
  • Politics
  • Puzzles / Riddles
  • URLs
Community Support
  • Announcements
  • Beta Feedback
  • CleanUp
  • EE Bugs
  • Feedback
  • General
  • Input
  • New to EE
  • New Topics
  • Suggestions
 
10.15.2005 at 12:41AM PDT, ID: 15090565
- try to boot it up. If does not boot up, use the recent backup.

- read /var/adm/syslog/syslog.log file for errors/warnings to see what's happening in the system.

- send /var/adm/crash directory to HP for analysis.

- analyze what could have cause the crash. there could be many factors . power, heat, fan, hardware failure,old patches so on an so fourth.

Shiv

Assisted Solution
 
10.15.2005 at 02:11AM PDT, ID: 15090704

Rank: Guru

> a server goes down
It does not
 
10.17.2005 at 05:37AM PDT, ID: 15098700
TROUBLESHOOTING boot problems:

      a.) Entry_init status= -4 (Unrecoverable H/W error)
            * Booting from wrong disk
            * Bad LIF area (rebuild using support media)
            * Bad hard disk or other hardware issue
                  
      b.) Bad LIF magic
            * Booting from wrong disk
            * Bad LIF area (rebuild using support media)
            * Bad hard disk or other hardware issue

      c.) stand/vmunix: cannot open or not executable
            * Get to isl and run the command hpux ls -l / (does vmunix exist)
                             NOTE: If it doesn't exist then use support media
            * Try hpux /stand/vmunix.prev from isl
            
      d.) If system hangs after the kernel loads or panics
            * Try booting in single user mode (hpux -is)
            * Try booting in maintenance mode (hpux -lm)
                  NOTE: activate vg00 and see what happens.
            * Try hpux /stand/vmunix.prev

      e.) init: warning: bad shell "/usr/bin/ksh" for root
            * mount /usr and /var and vi /etc/passwd and fix the root line and
               change it to /sbin/sh.
            * check permissions on /etc/passwd (444 root:sys)

      f.) init: command respawning to rapidly
            * check /etc/rc.config.d for a file that doesn't belong in the
               directory or an incorrect modification to an existing file.
               Add the following to the top of the /etc/rc.config script:
                               set -x then execute the script {. /etc/rc.config}
                  NOTE: Need to boot to single user mode.

      g.) System boots in single user mode
            * Check /etc/inittab file (1st line -> init:3:initdefault:)
            * Check the AUTO file (lifcp /dev/rdsk/cxtxdx:AUTO -)
Accepted Solution
 
10.17.2005 at 05:47AM PDT, ID: 15098784
Log files to check after panic

/etc/shutdownlog
/var/adm/syslog/OLDsyslog.log - look for errors
/var/adm/crash/crash.X/INDEX - panic string is on the line begining with panic
/var/tombstones/ts99 - copy of chasis codes

Reboot after panic: , isr.ior (notice the space around the ",")
This is usually a hardware problem but check the ts99 to make sure valid data is present
grep -i timestamp /var/tombstones/ts99
If the timestamp is current then hardware needs to analyze the ts99 file
If No valid timestamp comes back then software needs to analyze the dump

Reboot after panic: HPMC
HPMC (High Priority Machine Check) - Hardware cause
 
10.17.2005 at 05:55AM PDT, ID: 15098846
One thing to remember on a HP-UX system/hardware

If the system is powered on and it's passes it's selftest the problem is always related to Software.
If the system doesn't pass it selftest you need to go to minimal configuration if you cannot determine the exact cause of the problem.
So if you have a 4 CPU system, remove all but one. Same with memory, I/O cards, powersupplies, etc...

HW problems on a HP-UX server are logged in the GSP/MP ==> Ctrl+B to access it and then check the entrances with show logs.
If you cannot determine the cause of this, HP will definately ask for this information to troubleshoot.

 
10.17.2005 at 06:34AM PDT, ID: 15099192

Rank: Guru

zkaiserm, this sounds like a homework, please read
http:/help.jsp#hi56
http:/help.jsp#hi130
 and tell us what you have done so far, and where you need help in your solutions.

Experts, please stop commenting until zkaiserm clrified the question.

{{ ahoffmann EE Page Editor }}
 
10.17.2005 at 11:11AM PDT, ID: 15101670
The question is more like a general question with no right/wrong answer but it doesn't botter me at all.

It's just a way of working, and if Kaiser wants to know what the most effectice way is for troubleshooting a crashed system or bringing it back online then he is entitled for an answer, especially when he pays for it, homework or not.

That's my opinion.
 
10.17.2005 at 11:46AM PDT, ID: 15101944
I've removed the off-topic comments; I know that everyone has read all of them.

zkaiserm,

Please understand that EE is very sensitive about the issue of doing homework for students; by the rules of the site, not only does the person asking that someone else do his/her homework run afoul of the rules, but so does the person who actually does the homework. Think of it as the person who offers a bribe and the person who takes it -- both are equally guilty.

Many of the participants in this thread have been around a long time, and have seen a lot of questions that are similar to yours that have, in fact, turned out to be homework assignments. That's not a reflection on you, but it IS why the first comment in this thread mentioned it.

As to why you weren't first sent an email, it's quite simple: neither the Moderators nor the Page Editors have access to your email address (see the Privacy Policy link below). Leaving a comment in the question also serves notice to others who might not be as familiar with EE's rules that there might be a reason to not answer it. Please don't take it personally -- it happens almost every day here.

Netminder
Site Admin
 
10.17.2005 at 02:35PM PDT, ID: 15103341
Panjandrum,
   Thanks for your support. I hope others do understand that these are not my home work questions. These are real "real" time questions. I hope this wont happen with any others who come to this site in the quest for knowledge.


Thanks,
Kaiser
 
 
20071212-EE-VQP-20 - Google