My Sun 5.6 Server reboots every 2-3 days and stops on OK prompt with Panic messages as below, Pl. anybody can suggest how to decode Panic messages to determine the root cause of problem?? Server has very low CPU/Mem utilization , not out of swap space, and already replaced CPU and memory of server Jan 10 17:03:42 TEST-IVR unix: panic[cpu0]/thread=0x30041e80: mutex_enter: bad mutex, lp=6120820 owner=80a0a020 thread=30041e80 type=15 tsid=280 Jan 10 17:03:42 TEST-IVR unix: BAD TRAP: cpu=0 type=0x10 rp=0x10400940 addr=0x10006820 mmu_fsr=0x0 Jan 10 17:03:42 TEST-IVR unix: sched: illegal instruction fault: PANIC [CPU0] / Thread=0xb00: Kernel Panic at Trap level 2, Trap Reason 0x2 TL=0x1 TT=0x68 TICK=0xd8f TPC=0x310 TnPC=0x314 TSTATE=0xe06 TL=0x2 TT=0x68 TICK=0xcc9 TPC=0x718 TnPC=0x71C TSTATE=0x507 BAD TRAP: CPU=0 type=0x31 rp=0xab0 addr=0x88 mmu_fsr=0x0 Sched:trap type=0x31 BAD Trap:cpu=0 type-0x34 rp=0xc48 addr-0x5d7 mmu_fsr=0x0 Sched: alignment error Sanjeev Pabbi [Network Analyst] 407 ETR ,Toronto,Canada

I would ask what your kernel patch level is at. At times that error can be pointed at CPU or ram, but there are patches that need to be installed to do better error reporting and cache scrubbing, please let me know what version your kernel patch is at. Thanks

Hi, Being a beginner Not sure what do u mean by kernel patch level or how would i check that , here is what I see with showrev -p command, # showrev -p Patch: 105181-05 Obsoletes: 105636-01, 105776-01 Requires: Incompatibles: Pack ages: SUNWcsr, SUNWcar, SUNWheah Patch: 106173-02 Obsoletes: Requires: 105181-05 Incompatibles: Packages: SUNWc sr Patch: 106171-01 Obsoletes: Requires: 105181-05 Incompatibles: Packages: SUNWc sr Patch: 106170-02 Obsoletes: Requires: 105181-05 Incompatibles: Packages: SUNWc sr, SUNWhea Patch: 106169-02 Obsoletes: Requires: 105181-05 Incompatibles: Packages: SUNWc sr, SUNWcar Patch: 106168-02 Obsoletes: Requires: 105181-05 Incompatibles: Packages: SUNWc sr, SUNWcar Patch: 105836-02 Obsoletes: Requires: 105181-05 Incompatibles: Packages: SUNWc sr Patch: 105742-03 Obsoletes: Requires: 105181-05 Incompatibles: Packages: SUNWc sr Patch: 105604-05 Obsoletes: Requires: 105181-05 Incompatibles: Packages: SUNWc sr, SUNWcar, SUNWhea Patch: 105600-05 Obsoletes: Requires: 105181-05 Incompatibles: Packages: SUNWc sr, SUNWhea Patch: 105222-03 Obsoletes: Requires: 105181-05 Incompatibles: Packages: SUNWc sr, SUNWcar, SUNWhea Patch: 105651-06 Obsoletes: Requires: 105181-05, 105222-02, 105223-02, 105492-0 2, 105600-02, 105604-03, 105742-02, 105795-02, 105836-02, 106168-01, 106169-01, 106170-01, 106171-01, 106172-01, 106173-01 Incompatibles: Packages: SUNWcsr, SU NWcar, SUNWhea Patch: 105401-09 Obsoletes: 105524-01 Requires: Incompatibles: Packages: SUNWc sr, SUNWarc, SUNWnisu Patch: 105847-01 Obsoletes: Requires: Incompatibles: Packages: SUNWcsr Patch: 105845-01 Obsoletes: Requires: Incompatibles: Packages: SUNWcsr Patch: 105797-02 Obsoletes: Requires: Incompatibles: Packages: SUNWcsr Patch: 105786-03 Obsoletes: Requires: Incompatibles: Packages: SUNWcsr Patch: 105780-01 Obsoletes: Requires: Incompatibles: Packages: SUNWcsr Patch: 105778-01 Obsoletes: Requires: Incompatibles: Packages: SUNWcsr Patch: 105720-03 Obsoletes: Requires: Incompatibles: Packages: SUNWcsr Patch: 105693-03 Obsoletes: Requires: Incompatibles: Packages: SUNWcsr Patch: 105572-03 Obsoletes: Requires: Incompatibles: Packages: SUNWcsr Patch: 105564-02 Obsoletes: Requires: Incompatibles: Packages: SUNWcsr Patch: 105529-01 Obsoletes: Requires: Incompatibles: Packages: SUNWcsr Patch: 105528-01 Obsoletes: Requires: Incompatibles: Packages: SUNWcsr Patch: 105490-04 Obsoletes: Requires: Incompatibles: Packages: SUNWcsr, SUNWa rc, SUNWbtool, SUNWhea, SUNWtoo, SUNWosdem, SUNWxcu4 Patch: 105486-02 Obsoletes: Requires: Incompatibles: Packages: SUNWcsr Patch: 105379-03 Obsoletes: Requires: Incompatibles: Packages: SUNWcsr Patch: 105214-01 Obsoletes: Requires: Incompatibles: Packages: SUNWcsr Patch: 106323-01 Obsoletes: Requires: Incompatibles: Packages: SUNWcsr Patch: 105654-03 Obsoletes: Requires: Incompatibles: Packages: SUNWcsr Patch: 105924-03 Obsoletes: 105610-04 Requires: Incompatibles: Packages: SUNWc sr, SUNWpd Patch: 105401-20 Obsoletes: 105524-01 Requires: Incompatibles: Packages: SUNWc sr, SUNWarc, SUNWnisu Patch: 105181-15 Obsoletes: 105214-01, 105636-01, 105776-01, 106031-02, 106308-0 1 Requires: Incompatibles: Packages: SUNWcsr, SUNWcar, SUNWhea Patch: 105604-08 Obsoletes: Requires: 105181-05 Incompatibles: Packages: SUNWc sr, SUNWcar, SUNWhea Patch: 105379-05 Obsoletes: Requires: Incompatibles: Packages: SUNWcsr Patch: 105621-17 Obsoletes: 105393-11, 105686-02, 105845-01, 106064-01, 106075-0 1, 106033-01 Requires: Incompatibles: Packages: SUNWcsr, SUNWarc, SUNWhea, SUN Wnisu Patch: 105395-06 Obsoletes: 105518-01, 105736-01 Requires: Incompatibles: Pack ages: SUNWcsr, SUNWnisu Patch: 105786-08 Obsoletes: Requires: Incompatibles: Packages: SUNWcsr Patch: 105720-08 Obsoletes: Requires: Incompatibles: Packages: SUNWcsr Patch: 105924-10 Obsoletes: 105610-04 Requires: Incompatibles: Packages: SUNWc sr, SUNWcar, SUNWpd Patch: 105490-07 Obsoletes: Requires: Incompatibles: Packages: SUNWcsr, SUNWa rc, SUNWbtool, SUNWhea, SUNWtoo, SUNWosdem, SUNWxcu4 Patch: 105797-06 Obsoletes: Requires: Incompatibles: Packages: SUNWcsr Patch: 105600-07 Obsoletes: Requires: 105181-05 Incompatibles: Packages: SUNWc sr, SUNWhea Patch: 105529-08 Obsoletes: Requires: Incompatibles: Packages: SUNWcsr Patch: 105564-03 Obsoletes: Requires: Incompatibles: Packages: SUNWcsr Patch: 105780-04 Obsoletes: Requires: Incompatibles: Packages: SUNWcsr Patch: 106639-03 Obsoletes: Requires: Incompatibles: Packages: SUNWcsr Patch: 106216-01 Obsoletes: Requires: Incompatibles: Packages: SUNWcar Patch: 106031-02 Obsoletes: Requires: Incompatibles: Packages: SUNWcar Patch: 106495-01 Obsoletes: Requires: Incompatibles: Packages: SUNWesu, SUNWt oo Patch: 105802-03 Obsoletes: Requires: Incompatibles: Packages: SUNWtltk Patch: 105802-08 Obsoletes: 106480-01 Requires: Incompatibles: Packages: SUNWt ltk Patch: 106084-01 Obsoletes: Requires: Incompatibles: Packages: SUNWxildh Patch: 105633-05 Obsoletes: Requires: Incompatibles: Packages: SUNWxwfnt, SUN Wxwplt, SUNWxwcft, SUNWxwslb Patch: 105633-29 Obsoletes: Requires: Incompatibles: Packages: SUNWxwfnt, SUN Wxwplt, SUNWxwcft, SUNWxwslb Patch: 105618-01 Obsoletes: Requires: Incompatibles: Packages: SUNWxwplt Patch: 105400-02 Obsoletes: Requires: Incompatibles: Packages: SUNWxwplt Patch: 106183-03 Obsoletes: Requires: 105181-05, 105222-02, 105223-02, 105492-0 2, 105600-02, 105604-03, 105651-03, 105742-02, 105795-02, 105836-02, 106168-01, 106169-01, 106170-01, 106171-01, 106172-01, 106173-01 Incompatibles: Packages: SUNWarc, SUNWhea Patch: 105621-02 Obsoletes: Requires: Incompatibles: Packages: SUNWarc Patch: 105405-01 Obsoletes: Requires: Incompatibles: Packages: SUNWarc Patch: 105210-05 Obsoletes: Requires: Incompatibles: Packages: SUNWarc Patch: 105210-22 Obsoletes: Requires: Incompatibles: Packages: SUNWarc Patch: 105405-02 Obsoletes: Requires: Incompatibles: Packages: SUNWarc Patch: 106569-01 Obsoletes: Requires: Incompatibles: Packages: SUNWarc Patch: 105284-25 Obsoletes: Requires: Incompatibles: Packages: SUNWmfrun Patch: 105464-01 Obsoletes: Requires: Incompatibles: Packages: SUNWxwopt, SUN Wxwman Patch: 105464-02 Obsoletes: Requires: Incompatibles: Packages: SUNWxwopt, SUN Wxwman Patch: 105669-02 Obsoletes: Requires: Incompatibles: Packages: SUNWdtbas Patch: 105630-01 Obsoletes: Requires: Incompatibles: Packages: SUNWdtbas Patch: 105160-02 Obsoletes: Requires: Incompatibles: Packages: SUNWdtbas Patch: 105669-08 Obsoletes: Requires: Incompatibles: Packages: SUNWdtbas Patch: 106242-02 Obsoletes: Requires: Incompatibles: Packages: SUNWdtbas Patch: 105416-01 Obsoletes: Requires: Incompatibles: Packages: SUNWaccu Patch: 107492-01 Obsoletes: Requires: Incompatibles: Packages: SUNWaccu Patch: 106193-01 Obsoletes: Requires: Incompatibles: Packages: SUNWadmap Patch: 105800-01 Obsoletes: Requires: Incompatibles: Packages: SUNWadmap Patch: 105800-05 Obsoletes: Requires: 106125-05 Incompatibles: Packages: SUNWa dmap, SUNWadmc Patch: 106193-03 Obsoletes: 106350-01 Requires: Incompatibles: Packages: SUNWa dmap Patch: 106317-01 Obsoletes: Requires: Incompatibles: Packages: SUNWadmc Patch: 105363-05 Obsoletes: Requires: Incompatibles: Packages: SUNWxfb Patch: 106123-01 Obsoletes: Requires: Incompatibles: Packages: SUNWdoc Patch: 106123-04 Obsoletes: Requires: Incompatibles: Packages: SUNWdoc Patch: 106262-01 Obsoletes: Requires: Incompatibles: Packages: SUNWman Patch: 106261-01 Obsoletes: Requires: Incompatibles: Packages: SUNWman Patch: 106260-01 Obsoletes: Requires: Incompatibles: Packages: SUNWman Patch: 106219-01 Obsoletes: Requires: Incompatibles: Packages: SUNWman Patch: 105390-02 Obsoletes: Requires: Incompatibles: Packages: SUNWman Patch: 105959-01 Obsoletes: Requires: Incompatibles: Packages: SUNWpppk Patch: 105421-01 Obsoletes: Requires: Incompatibles: Packages: SUNWapppr Patch: 106561-01 Obsoletes: Requires: Incompatibles: Packages: SUNWapppu Patch: 105472-02 Obsoletes: Requires: Incompatibles: Packages: SUNWatfsu Patch: 105472-07 Obsoletes: Requires: Incompatibles: Packages: SUNWatfsu Patch: 106648-01 Obsoletes: Requires: Incompatibles: Packages: SUNWolrte, SUN Wolslb Patch: 106649-01 Obsoletes: Requires: Incompatibles: Packages: SUNWolrte Patch: 105837-02 Obsoletes: Requires: Incompatibles: Packages: SUNWdtdte Patch: 105703-03 Obsoletes: Requires: Incompatibles: Packages: SUNWdtdte Patch: 105558-04 Obsoletes: Requires: 107434-01 Incompatibles: Packages: SUNWd tdte, SUNWdtdst Patch: 105837-03 Obsoletes: Requires: Incompatibles: Packages: SUNWdtdte Patch: 105703-13 Obsoletes: Requires: Incompatibles: Packages: SUNWdtdte Patch: 105566-01 Obsoletes: Requires: Incompatibles: Packages: SUNWdtdmn Patch: 105566-07 Obsoletes: Requires: Incompatibles: Packages: SUNWdtdmn, SUN Wdtdst Patch: 106138-01 Obsoletes: Requires: Incompatibles: Packages: SUNWoldst Patch: 105497-01 Obsoletes: Requires: Incompatibles: Packages: SUNWoldst Patch: 106222-01 Obsoletes: Requires: Incompatibles: Packages: SUNWoldst Patch: 106650-03 Obsoletes: Requires: 106648-01, 106649-01 Incompatibles: Pack ages: SUNWoldst Patch: 105377-03 Obsoletes: Requires: Incompatibles: Packages: SUNWbcp Patch: 105492-02 Obsoletes: Requires: 105181-05 Incompatibles: Packages: SUNWc g6 Patch: 105798-03 Obsoletes: Requires: Incompatibles: Packages: SUNWcpr Patch: 106112-01 Obsoletes: Requires: Incompatibles: Packages: SUNWdtdst Patch: 106025-01 Obsoletes: Requires: Incompatibles: Packages: SUNWdtdst Patch: 105558-01 Obsoletes: Requires: Incompatibles: Packages: SUNWdtdst Patch: 105338-07 Obsoletes: Requires: Incompatibles: Packages: SUNWdtdst, SUN Wdthev, SUNWdtma Patch: 107434-01 Obsoletes: Requires: Incompatibles: Packages: SUNWdtdst Patch: 106112-04 Obsoletes: Requires: 105669-07 Incompatibles: Packages: SUNWd tdst Patch: 106027-01 Obsoletes: Requires: Incompatibles: Packages: SUNWdtwm Patch: 105743-01 Obsoletes: Requires: Incompatibles: Packages: SUNWfns Patch: 105223-04 Obsoletes: Requires: 105181-05 Incompatibles: Packages: SUNWh ea Patch: 105705-02 Obsoletes: Requires: Incompatibles: Packages: SUNWhea Patch: 105568-13 Obsoletes: Requires: 105210-11 Incompatibles: Packages: SUNWh ea Patch: 106172-02 Obsoletes: Requires: 105181-05 Incompatibles: Packages: SUNWh md Patch: 105795-03 Obsoletes: Requires: 105181-05 Incompatibles: Packages: SUNWh md, SUNWhmdu Patch: 105795-05 Obsoletes: Requires: 105181-05 Incompatibles: Packages: SUNWh md, SUNWhmdu Patch: 105362-08 Obsoletes: Requires: Incompatibles: Packages: SUNWm64, SUNWm 64cf, SUNWm64w Patch: 105362-23 Obsoletes: Requires: Incompatibles: Packages: SUNWm64, SUNWm 64cf, SUNWm64w Patch: 106064-01 Obsoletes: Requires: Incompatibles: Packages: SUNWnisu Patch: 105562-01 Obsoletes: Requires: Incompatibles: Packages: SUNWnisu Patch: 105552-02 Obsoletes: Requires: Incompatibles: Packages: SUNWnisu Patch: 105403-01 Obsoletes: Requires: Incompatibles: Packages: SUNWnisu Patch: 105562-03 Obsoletes: Requires: Incompatibles: Packages: SUNWnisu Patch: 106271-05 Obsoletes: Requires: Incompatibles: Packages: SUNWnisu Patch: 105403-02 Obsoletes: Requires: Incompatibles: Packages: SUNWnisu Patch: 106235-03 Obsoletes: Requires: Incompatibles: Packages: SUNWpcu, SUNWp su Patch: 105741-02 Obsoletes: Requires: Incompatibles: Packages: SUNWpd Patch: 105580-05 Obsoletes: Requires: Incompatibles: Packages: SUNWpd, SUNWpd u Patch: 105741-05 Obsoletes: Requires: Incompatibles: Packages: SUNWpd Patch: 105580-13 Obsoletes: Requires: Incompatibles: Packages: SUNWpd, SUNWpd u Patch: 105637-01 Obsoletes: Requires: Incompatibles: Packages: SUNWpmu Patch: 106029-01 Obsoletes: Requires: Incompatibles: Packages: SUNWsprot, SUN Wxcu4t Patch: 106125-02 Obsoletes: Requires: Incompatibles: Packages: SUNWswmt Patch: 106125-07 Obsoletes: Requires: Incompatibles: Packages: SUNWswmt Patch: 105426-01 Obsoletes: Requires: Incompatibles: Packages: SUNWtnfc Patch: 105407-01 Obsoletes: Requires: Incompatibles: Packages: SUNWvolu Patch: 105990-01 Obsoletes: Requires: Incompatibles: Packages: SUNWxcu4 Patch: 105189-02 Obsoletes: Requires: Incompatibles: Packages: SUNWxi18n Patch: 106040-11 Obsoletes: 105189-03 Requires: Incompatibles: Packages: SUNWx i18n, SUNWxim Patch: 106040-03 Obsoletes: Requires: Incompatibles: Packages: SUNWxim Patch: 105361-03 Obsoletes: Requires: Incompatibles: Packages: SUNWxilvl Sanjeev Pabbi [Network Analyst] spabbi@407etr.com 407 ETR ,Toronto,Canada

<<<<<<< Problem Resolved >>>>>>> <<<<<<<<<<<<<<<<>>>>>>>>>>>>>>>> I guess it turned out to be a "Memory issue", although we already replaced memory earlier too, but probably with wrong Part Number last time. Thanks to evrybody who responded ...... Sanjeev Pabbi Sanjeev Pabbi [Network Analyst] spabbi@407etr.com 407 ETR ,Toronto,Canada