The errors seen "PCIE Fatal Uncorrectable error" indicate a HW issue, and since this Kernel Panic / Unexpected reboot has been reoccurring based on the event history (Not a one-time / transient issue). The suggestion from TAC was that we proceed with an RMA.
\
show logging onboard stack-trace
Module: 1
\
Switch OBFL Log: Enabled
\
**************************************************************
STACK TRACE GENERATED AT Fri Jun 20 23:16:50 2025 UTC
\
**************************************************************
\
<0>[ 4036.888917] ahci 0000:00:1f.2: Checking PCIE Errors in device
<0>[ 4036.958562] ahci 0000:00:1f.2: RER: PCIE Non-Fatal Uncorrectable error
<0>[ 4037.037614] ahci 0000:00:1f.2: RER: PCIE Fatal Uncorrectable error
..
<0>[ 4037.112637] i801_smbus 0000:00:1f.3: Checking PCIE Errors in device
<0>[ 4037.188526] i801_smbus 0000:00:1f.3: RER: PCIE Fatal Uncorrectable error
<6>[ 4037.269656] i801_smbus 0000:00:1f.3: RER: PCIE Correctable error
..
<0>[ 4037.702614] ahci 0000:00:1f.2: Checking PCIE Errors in device
<0>[ 4037.772259] ahci 0000:00:1f.2: RER: PCIE Non-Fatal Uncorrectable error
<0>[ 4037.851311] ahci 0000:00:1f.2: RER: PCIE Fatal Uncorrectable error
\
show system internal kernel nvram-messages previous
[ 4036.000655] RER: Unknown device caused PCIE ERROR. Check all
[ 4036.069440] ivb_uncore 0000:00:00.0: Checking PCIE Errors in device
[ 4036.145460] pcieport 0000:00:01.0: Checking PCIE Errors in device
[ 4036.219407] pcieport 0000:00:01.1: Checking PCIE Errors in device
[ 4036.293347] pcieport 0000:00:01.2: Checking PCIE Errors in device
[ 4036.367292] pcieport 0000:00:1c.0: Checking PCIE Errors in device
[ 4036.441225] pcieport 0000:00:1c.1: Checking PCIE Errors in device
[ 4036.515164] pcieport 0000:00:1c.2: Checking PCIE Errors in device
[ 4036.589097] pcieport 0000:00:1c.3: Checking PCIE Errors in device
[ 4036.663035] ehci-pci 0000:00:1d.0: Checking PCIE Errors in device
[ 4036.736839] ehci-pci 0000:00:1d.0: RER: PCIE Non-Fatal Uncorrectable error
[ 4036.820180] pci 0000:00:1f.0: Checking PCIE Errors in device
[ 4036.888917] ahci 0000:00:1f.2: Checking PCIE Errors in device
[ 4036.958562] ahci 0000:00:1f.2: RER: PCIE Non-Fatal Uncorrectable error
[ 4037.037614] ahci 0000:00:1f.2: RER: PCIE Fatal Uncorrectable error
[ 4037.112637] i801_smbus 0000:00:1f.3: Checking PCIE Errors in device
[ 4037.188526] i801_smbus 0000:00:1f.3: RER: PCIE Fatal Uncorrectable error
[ 4037.269788] pci 0000:00:1f.6: Checking PCIE Errors in device
[ 4037.338523] pci 0000:00:1f.7: Checking PCIE Errors in device
[ 4037.407252] pci 0000:01:00.0: Checking PCIE Errors in device
[ 4037.475999] pci 0000:01:00.1: Checking PCIE Errors in device
[ 4037.544743] igb 0000:01:00.2: Checking PCIE Errors in device
[ 4037.613488] pci 0000:01:00.3: Checking PCIE Errors in device
[ 4037.682230] pci 0000:01:00.4: Checking PCIE Errors in device
[ 4037.750975] cctrl 0000:02:00.0: Checking PCIE Errors in device
[ 4037.821785] pci 0000:03:00.0: Checking PCIE Errors in device
[ 4037.890516] cctrl-mi 0000:04:00.0: Checking PCIE Errors in device
[ 4037.968079] nxos_panic: Kernel panic - not syncing: Unexpected SERR
\
- Same crash / Kernel Panic has occurred multiple times in the past:
\
show logging onboard internal reset-reason
Module: 1
\
Switch OBFL Log: Enabled
Last log in OBFL was written at time Fri Jul 18 11:47:01 2025
\
Reset Reason for this card:
Image Version : 9.3(13)
Reset Reason (LCM): Unknown (0) at time Fri Jun 20 23:19:42 2025
Reset Reason (SW): Kernel Panic (19) at time Fri Jun 20 23:16:43 2025
Reset Reason (HW): Watchdog Timeout (32) at time Fri Jun 20 23:19:42 2025
Last log in OBFL was written at time Fri Jun 20 23:10:52 2025
\
Reset Reason for this card:
Image Version : 9.3(13)
Reset Reason (LCM): Unknown (0) at time Fri Jun 20 22:11:19 2025
Reset Reason (SW): Kernel Panic (19) at time Fri Jun 20 22:08:19 2025
Reset Reason (HW): Watchdog Timeout (32) at time Fri Jun 20 22:11:19 2025
Last log in OBFL was written at time Fri Jun 20 22:02:26 2025
\
Reset Reason for this card:
Image Version : 9.3(13)
Reset Reason (LCM): Unknown (0) at time Fri Jun 20 21:02:53 2025
Reset Reason (SW): Kernel Panic (19) at time Fri Jun 20 20:59:57 2025
Reset Reason (HW): Watchdog Timeout (32) at time Fri Jun 20 21:02:53 2025
Last log in OBFL was written at time Fri Jun 20 20:54:04 2025
\
Reset Reason for this card:
Image Version : 9.3(13)
Reset Reason (LCM): Unknown (0) at time Fri Jun 20 19:54:32 2025
Reset Reason (SW): Kernel Panic (19) at time Fri Jun 20 19:51:35 2025
Reset Reason (HW): Watchdog Timeout (32) at time Fri Jun 20 19:54:32 2025
Last log in OBFL was written at time Fri Jun 20 19:18:24 2025
\
Reset Reason for this card:
Image Version : 9.3(13)
Reset Reason (LCM): Unknown (0) at time Wed Jun 18 20:12:43 2025
Reset Reason (SW): Kernel Panic (19) at time Wed Jun 18 20:09:45 2025
Reset Reason (HW): Watchdog Timeout (32) at time Wed Jun 18 20:12:43 2025
Last log in OBFL was written at time Wed Jun 18 19:29:52 2025
\
Reset Reason for this card:
Image Version : 9.3(13)
Reset Reason (LCM): Unknown (0) at time Mon May 26 05:15:06 2025
Reset Reason (SW): Kernel Panic (19) at time Mon May 26 05:12:09 2025
Reset Reason (HW): Watchdog Timeout (32) at time Mon May 26 05:15:06 2025
Last log in OBFL was written at time Mon May 26 04:48:52 2025
\
Reset Reason for this card:
Image Version : 9.3(13)
Reset Reason (LCM): Unknown (0) at time Sat Nov 23 15:02:14 2024
Reset Reason (SW): Kernel Panic (19) at time Sat Nov 23 14:59:20 2024
Reset Reason (HW): Watchdog Timeout (32) at time Sat Nov 23 15:02:14 2024
Last log in OBFL was written at time Sat Nov 23 14:53:25 2024
\
Reset Reason for this card:
Image Version : 9.3(13)
Reset Reason (LCM): Unknown (0) at time Sat Nov 23 13:53:52 2024
Reset Reason (SW): Kernel Panic (19) at time Sat Nov 23 13:51:00 2024
Reset Reason (HW): Watchdog Timeout (32) at time Sat Nov 23 13:53:52 2024
Last log in OBFL was written at time Sat Nov 23 13:45:38 2024
\
Reset Reason for this card:
Image Version : 9.3(13)
Reset Reason (LCM): Unknown (0) at time Sat May 18 09:41:24 2024
Reset Reason (SW): Unknown (0)
Reset Reason (HW): Watchdog Timeout (32) at time Sat May 18 09:41:24 2024
\
Behaviour matching defect CSCwi30218
Comments