1056 lines
46 KiB
JSON
1056 lines
46 KiB
JSON
{
|
||
"xid_errors": {
|
||
"8": {
|
||
"name": "GPU Stopped Responding",
|
||
"severity": "critical",
|
||
"description": "GPU가 응답을 중단했습니다. 하드웨어 결함 또는 드라이버 문제일 수 있습니다.",
|
||
"action": "1) GPU 드라이버를 최신 버전으로 업데이트\n2) GPU 전원 케이블 재연결 확인\n3) PCIe 슬롯 변경 후 테스트\n4) 반복 시 RMA(교체) 요청"
|
||
},
|
||
"13": {
|
||
"name": "Graphics Engine Exception",
|
||
"severity": "critical",
|
||
"description": "그래픽 엔진에서 예외가 발생했습니다. GPU 코어 또는 메모리 결함 가능성.",
|
||
"action": "1) GPU 드라이버 재설치\n2) GPU 클럭 주파수를 기본값으로 리셋\n3) 시스템 BIOS에서 PCIe Gen 설정 확인\n4) 반복 시 GPU 교체 검토"
|
||
},
|
||
"31": {
|
||
"name": "GPU Memory Page Fault",
|
||
"severity": "critical",
|
||
"description": "GPU 메모리 페이지 폴트. 메모리 손상 또는 드라이버 버그 가능성.",
|
||
"action": "1) ECC 메모리 상태 확인 (nvidia-smi -q -d ECC)\n2) GPU 드라이버 업데이트\n3) CUDA 버전 호환성 확인\n4) ECC 에러 누적 시 GPU 메모리 교체/RMA"
|
||
},
|
||
"32": {
|
||
"name": "Invalid or Corrupted Push Buffer",
|
||
"severity": "warning",
|
||
"description": "손상된 푸시 버퍼 감지. 드라이버 또는 애플리케이션 문제.",
|
||
"action": "1) 실행 중인 GPU 워크로드 확인\n2) 드라이버 버전 업데이트\n3) 특정 애플리케이션에서만 발생 시 해당 앱 업데이트"
|
||
},
|
||
"38": {
|
||
"name": "Driver Firmware Mismatch",
|
||
"severity": "warning",
|
||
"description": "드라이버와 펌웨어 버전 불일치.",
|
||
"action": "1) nvidia-smi로 드라이버/펌웨어 버전 확인\n2) GPU 드라이버를 펌웨어와 호환되는 버전으로 업데이트\n3) 필요 시 GPU 펌웨어 업데이트"
|
||
},
|
||
"43": {
|
||
"name": "GPU Stopped Processing",
|
||
"severity": "critical",
|
||
"description": "GPU 처리가 중단됨. 심각한 하드웨어 또는 드라이버 문제.",
|
||
"action": "1) 시스템 재부팅 후 재현 여부 확인\n2) dmesg에서 관련 커널 에러 확인\n3) GPU 온도 및 전력 상태 점검\n4) 벤더사 기술지원 요청 권장"
|
||
},
|
||
"45": {
|
||
"name": "GPU Preemption Failure",
|
||
"severity": "warning",
|
||
"description": "GPU 선점 실패. 특정 워크로드에서 타임아웃 발생.",
|
||
"action": "1) 실행 중인 GPU 컴퓨트 작업 확인\n2) TDR(Timeout Detection and Recovery) 설정 조정\n3) 드라이버 업데이트"
|
||
},
|
||
"48": {
|
||
"name": "Double Bit ECC Error",
|
||
"severity": "critical",
|
||
"description": "수정 불가능한 Double Bit ECC 에러 발생. GPU 메모리 물리적 손상.",
|
||
"action": "1) nvidia-smi -q -d ECC로 에러 위치 확인\n2) GPU 리셋 시도 (nvidia-smi -r)\n3) 즉시 RMA(교체) 요청 - 하드웨어 결함 확정"
|
||
},
|
||
"61": {
|
||
"name": "GPU Fallen Off the Bus",
|
||
"severity": "critical",
|
||
"description": "GPU가 PCIe 버스에서 분리됨. 전원 또는 물리적 연결 문제.",
|
||
"action": "1) GPU 전원 케이블(6핀/8핀) 재연결\n2) PCIe 슬롯 물리적 접촉 상태 확인\n3) PSU 전력 용량 점검\n4) 다른 PCIe 슬롯에서 테스트\n5) 반복 시 라이저 카드/메인보드 점검"
|
||
},
|
||
"62": {
|
||
"name": "GPU ECC Page Retirement",
|
||
"severity": "warning",
|
||
"description": "ECC 에러로 인한 메모리 페이지 은퇴 처리.",
|
||
"action": "1) nvidia-smi -q -d RETIRED_PAGES로 은퇴 페이지 수 확인\n2) 은퇴 페이지가 임계값 이상이면 GPU 교체 검토\n3) 정기적으로 모니터링 필요"
|
||
},
|
||
"63": {
|
||
"name": "ECC Page Retirement: Double Bit",
|
||
"severity": "critical",
|
||
"description": "Double Bit ECC 에러로 인한 페이지 은퇴. 심각한 메모리 손상.",
|
||
"action": "1) 즉시 GPU 워크로드 중단\n2) nvidia-smi -q -d RETIRED_PAGES 확인\n3) GPU RMA(교체) 요청 필수"
|
||
},
|
||
"64": {
|
||
"name": "ECC Page Retirement Failure",
|
||
"severity": "critical",
|
||
"description": "ECC 에러 페이지 은퇴 실패. 더 이상 은퇴할 수 있는 페이지가 없음.",
|
||
"action": "1) GPU 즉시 교체 필요\n2) 데이터 무결성 확인\n3) 벤더사 긴급 RMA 요청"
|
||
},
|
||
"69": {
|
||
"name": "GPU Access to System Memory Failed",
|
||
"severity": "warning",
|
||
"description": "GPU에서 시스템 메모리 접근 실패. IOMMU 또는 드라이버 문제.",
|
||
"action": "1) BIOS에서 IOMMU/VT-d 설정 확인\n2) 드라이버 업데이트\n3) 시스템 RAM 에러 여부 확인 (memtest)"
|
||
},
|
||
"79": {
|
||
"name": "GPU Fallen Off the Bus (Fatal)",
|
||
"severity": "critical",
|
||
"description": "GPU가 PCIe 버스에서 완전히 분리됨. Xid 61의 치명적 버전.",
|
||
"action": "1) 시스템 즉시 셧다운\n2) GPU 물리적 장착 상태 및 전원 케이블 점검\n3) PCIe 슬롯/라이저 카드 교체 테스트\n4) 벤더사 현장 점검 요청"
|
||
},
|
||
"92": {
|
||
"name": "High Single-bit ECC Error Rate",
|
||
"severity": "warning",
|
||
"description": "단일 비트 ECC 에러 빈도가 높음. 메모리 노후화 징후.",
|
||
"action": "1) ECC 에러 카운트 모니터링\n2) GPU 메모리 클럭 다운 테스트\n3) 에러율 증가 추세 시 선제적 GPU 교체 검토"
|
||
},
|
||
"94": {
|
||
"name": "Contained ECC Error",
|
||
"severity": "info",
|
||
"description": "격리된 ECC 에러. 자동으로 수정되었으나 모니터링 필요.",
|
||
"action": "1) 정기적으로 ECC 카운터 모니터링\n2) 빈도가 증가하면 경고 단계로 상향"
|
||
},
|
||
"95": {
|
||
"name": "Uncontained ECC Error",
|
||
"severity": "critical",
|
||
"description": "격리되지 않은 ECC 에러. 데이터 손상 가능성.",
|
||
"action": "1) 즉시 워크로드 중단\n2) GPU 리셋 및 ECC 상태 확인\n3) 데이터 무결성 검증\n4) GPU 교체 권장"
|
||
},
|
||
"119": {
|
||
"name": "GPU Recovery Action",
|
||
"severity": "info",
|
||
"description": "GPU 복구 작업 수행됨. 일시적 에러에서 자동 복구.",
|
||
"action": "1) 빈도가 낮으면 정상 운영\n2) 자주 발생 시 드라이버 업데이트 또는 GPU 점검"
|
||
},
|
||
"1": {
|
||
"name": "ROBUST_CHANNEL_FIFO_ERROR_FIFO_METHOD",
|
||
"severity": "critical",
|
||
"description": "[Catalog] Unused",
|
||
"action": "Immediate Action: CONTACT_SUPPORT\nTrigger Conditions: N/A; Unused"
|
||
},
|
||
"2": {
|
||
"name": "ROBUST_CHANNEL_FIFO_ERROR_SW_METHOD",
|
||
"severity": "critical",
|
||
"description": "[Catalog] Unused",
|
||
"action": "Immediate Action: CONTACT_SUPPORT\nTrigger Conditions: N/A; Unused"
|
||
},
|
||
"3": {
|
||
"name": "ROBUST_CHANNEL_FIFO_ERROR_UNK_METHOD",
|
||
"severity": "critical",
|
||
"description": "[Catalog] Unused",
|
||
"action": "Immediate Action: CONTACT_SUPPORT\nTrigger Conditions: N/A; Unused"
|
||
},
|
||
"4": {
|
||
"name": "ROBUST_CHANNEL_FIFO_ERROR_CHANNEL_BUSY",
|
||
"severity": "critical",
|
||
"description": "[Catalog] Unused",
|
||
"action": "Immediate Action: CONTACT_SUPPORT\nTrigger Conditions: N/A; Unused"
|
||
},
|
||
"5": {
|
||
"name": "ROBUST_CHANNEL_FIFO_ERROR_RUNOUT_OVERFLOW",
|
||
"severity": "critical",
|
||
"description": "[Catalog] Unused",
|
||
"action": "Immediate Action: CONTACT_SUPPORT\nTrigger Conditions: N/A; Unused"
|
||
},
|
||
"6": {
|
||
"name": "ROBUST_CHANNEL_FIFO_ERROR_PARSE_ERR",
|
||
"severity": "critical",
|
||
"description": "[Catalog] Unused",
|
||
"action": "Immediate Action: CONTACT_SUPPORT\nTrigger Conditions: N/A; Unused"
|
||
},
|
||
"7": {
|
||
"name": "ROBUST_CHANNEL_FIFO_ERROR_PTE_ERR",
|
||
"severity": "critical",
|
||
"description": "[Catalog] Unused",
|
||
"action": "Immediate Action: CONTACT_SUPPORT\nTrigger Conditions: N/A; Unused"
|
||
},
|
||
"9": {
|
||
"name": "ROBUST_CHANNEL_GR_ERROR_INSTANCE",
|
||
"severity": "critical",
|
||
"description": "[Catalog] Unused",
|
||
"action": "Immediate Action: CONTACT_SUPPORT\nTrigger Conditions: N/A; Unused"
|
||
},
|
||
"10": {
|
||
"name": "ROBUST_CHANNEL_GR_ERROR_SINGLE_STEP",
|
||
"severity": "critical",
|
||
"description": "[Catalog] Unused",
|
||
"action": "Immediate Action: CONTACT_SUPPORT\nTrigger Conditions: N/A; Unused"
|
||
},
|
||
"11": {
|
||
"name": "ROBUST_CHANNEL_GR_ERROR_MISSING_HW",
|
||
"severity": "warning",
|
||
"description": "[Catalog] Invalid or corrupted push buffer stream",
|
||
"action": "Immediate Action: RESTART_APP\nInvestigatory Action: CHECK_APP/CUDA"
|
||
},
|
||
"12": {
|
||
"name": "ROBUST_CHANNEL_GR_ERROR_SW_METHOD",
|
||
"severity": "critical",
|
||
"description": "[Catalog] Unused",
|
||
"action": "Immediate Action: CONTACT_SUPPORT\nTrigger Conditions: N/A; Unused"
|
||
},
|
||
"14": {
|
||
"name": "ROBUST_CHANNEL_FAKE_ERROR",
|
||
"severity": "info",
|
||
"description": "[Catalog] Unused",
|
||
"action": "Immediate Action: IGNORE\nInvestigatory Action: CONTACT_SUPPORT\nTrigger Conditions: Fake or injected error from userspace"
|
||
},
|
||
"15": {
|
||
"name": "ROBUST_CHANNEL_SCANLINE_TIMEOUT",
|
||
"severity": "critical",
|
||
"description": "[Catalog] Unused",
|
||
"action": "Immediate Action: CONTACT_SUPPORT\nTrigger Conditions: N/A; Unused"
|
||
},
|
||
"16": {
|
||
"name": "ROBUST_CHANNEL_VBLANK_CALLBACK_TIMEOUT",
|
||
"severity": "critical",
|
||
"description": "[Catalog] Unused",
|
||
"action": "Immediate Action: CONTACT_SUPPORT\nInvestigatory Action: CONTACT_SUPPORT\nTrigger Conditions: N/A; Unused"
|
||
},
|
||
"17": {
|
||
"name": "ROBUST_CHANNEL_PARAMETER_ERROR",
|
||
"severity": "critical",
|
||
"description": "[Catalog] Unused",
|
||
"action": "Immediate Action: CONTACT_SUPPORT\nTrigger Conditions: N/A; Unused"
|
||
},
|
||
"18": {
|
||
"name": "ROBUST_CHANNEL_BUS_MASTER_TIMEOUT_ERROR",
|
||
"severity": "critical",
|
||
"description": "[Catalog] Unused",
|
||
"action": "Immediate Action: CONTACT_SUPPORT\nTrigger Conditions: N/A; Unused"
|
||
},
|
||
"19": {
|
||
"name": "ROBUST_CHANNEL_DISP_MISSED_NOTIFIER",
|
||
"severity": "critical",
|
||
"description": "[Catalog] Unused",
|
||
"action": "Immediate Action: CONTACT_SUPPORT\nTrigger Conditions: N/A; Unused"
|
||
},
|
||
"20": {
|
||
"name": "ROBUST_CHANNEL_MPEG_ERROR_SW_METHOD",
|
||
"severity": "critical",
|
||
"description": "[Catalog] Unused",
|
||
"action": "Immediate Action: CONTACT_SUPPORT\nTrigger Conditions: N/A; Unused"
|
||
},
|
||
"21": {
|
||
"name": "ROBUST_CHANNEL_ME_ERROR_SW_METHOD",
|
||
"severity": "critical",
|
||
"description": "[Catalog] Unused",
|
||
"action": "Immediate Action: CONTACT_SUPPORT\nTrigger Conditions: N/A; Unused"
|
||
},
|
||
"22": {
|
||
"name": "ROBUST_CHANNEL_VP_ERROR_SW_METHOD",
|
||
"severity": "critical",
|
||
"description": "[Catalog] Unused",
|
||
"action": "Immediate Action: CONTACT_SUPPORT\nTrigger Conditions: N/A; Unused"
|
||
},
|
||
"23": {
|
||
"name": "ROBUST_CHANNEL_RC_LOGGING_ENABLED",
|
||
"severity": "critical",
|
||
"description": "[Catalog] Unused",
|
||
"action": "Immediate Action: CONTACT_SUPPORT\nTrigger Conditions: N/A; Unused"
|
||
},
|
||
"24": {
|
||
"name": "ROBUST_CHANNEL_GR_SEMAPHORE_TIMEOUT",
|
||
"severity": "critical",
|
||
"description": "[Catalog] Unused",
|
||
"action": "Immediate Action: CONTACT_SUPPORT\nTrigger Conditions: N/A; Unused"
|
||
},
|
||
"25": {
|
||
"name": "ROBUST_CHANNEL_GR_ILLEGAL_NOTIFY",
|
||
"severity": "warning",
|
||
"description": "[Catalog] Invalid or illegal push buffer stream",
|
||
"action": "Immediate Action: RESTART_APP\nInvestigatory Action: CHECK_APP/CUDA"
|
||
},
|
||
"26": {
|
||
"name": "ROBUST_CHANNEL_FIFO_ERROR_FBISTATE_TIMEOUT",
|
||
"severity": "critical",
|
||
"description": "[Catalog] Unused",
|
||
"action": "Immediate Action: CONTACT_SUPPORT\nTrigger Conditions: N/A; Unused"
|
||
},
|
||
"27": {
|
||
"name": "ROBUST_CHANNEL_VP_ERROR",
|
||
"severity": "critical",
|
||
"description": "[Catalog] Unused",
|
||
"action": "Immediate Action: CONTACT_SUPPORT\nTrigger Conditions: N/A; Unused"
|
||
},
|
||
"28": {
|
||
"name": "ROBUST_CHANNEL_VP2_ERROR",
|
||
"severity": "critical",
|
||
"description": "[Catalog] Unused",
|
||
"action": "Immediate Action: CONTACT_SUPPORT\nTrigger Conditions: N/A; Unused"
|
||
},
|
||
"29": {
|
||
"name": "ROBUST_CHANNEL_BSP_ERROR",
|
||
"severity": "critical",
|
||
"description": "[Catalog] Unused",
|
||
"action": "Immediate Action: CONTACT_SUPPORT\nTrigger Conditions: N/A; Unused"
|
||
},
|
||
"30": {
|
||
"name": "ROBUST_CHANNEL_BAD_ADDR_ACCESS",
|
||
"severity": "critical",
|
||
"description": "[Catalog] Unused",
|
||
"action": "Immediate Action: CONTACT_SUPPORT\nTrigger Conditions: N/A; Unused"
|
||
},
|
||
"33": {
|
||
"name": "ROBUST_CHANNEL_SEC_ERROR",
|
||
"severity": "critical",
|
||
"description": "[Catalog] Unused",
|
||
"action": "Immediate Action: CONTACT_SUPPORT\nTrigger Conditions: N/A; Unused"
|
||
},
|
||
"34": {
|
||
"name": "ROBUST_CHANNEL_MSVLD_ERROR",
|
||
"severity": "critical",
|
||
"description": "[Catalog] Unused",
|
||
"action": "Immediate Action: CONTACT_SUPPORT\nTrigger Conditions: N/A; Unused"
|
||
},
|
||
"35": {
|
||
"name": "ROBUST_CHANNEL_MSPDEC_ERROR",
|
||
"severity": "critical",
|
||
"description": "[Catalog] Unused",
|
||
"action": "Immediate Action: CONTACT_SUPPORT\nTrigger Conditions: N/A; Unused"
|
||
},
|
||
"36": {
|
||
"name": "ROBUST_CHANNEL_MSPPP_ERROR",
|
||
"severity": "critical",
|
||
"description": "[Catalog] Unused",
|
||
"action": "Immediate Action: CONTACT_SUPPORT\nTrigger Conditions: N/A; Unused"
|
||
},
|
||
"37": {
|
||
"name": "ROBUST_CHANNEL_FECS_ERR_UNIMP_FIRMWARE_METHOD",
|
||
"severity": "info",
|
||
"description": "[Catalog] Driver firmware error",
|
||
"action": "Immediate Action: IGNORE\nInvestigatory Action: CHECK_APP/CUDA"
|
||
},
|
||
"39": {
|
||
"name": "ROBUST_CHANNEL_CE0_ERROR",
|
||
"severity": "warning",
|
||
"description": "[Catalog] Copy Engine Exception",
|
||
"action": "Immediate Action: RESTART_APP\nInvestigatory Action: CONTACT_SUPPORT"
|
||
},
|
||
"40": {
|
||
"name": "ROBUST_CHANNEL_CE1_ERROR",
|
||
"severity": "warning",
|
||
"description": "[Catalog] Copy Engine Exception",
|
||
"action": "Immediate Action: RESTART_APP\nInvestigatory Action: CONTACT_SUPPORT"
|
||
},
|
||
"41": {
|
||
"name": "ROBUST_CHANNEL_CE2_ERROR",
|
||
"severity": "warning",
|
||
"description": "[Catalog] Copy Engine Exception",
|
||
"action": "Immediate Action: RESTART_APP\nInvestigatory Action: CONTACT_SUPPORT"
|
||
},
|
||
"42": {
|
||
"name": "ROBUST_CHANNEL_VIC_ERROR",
|
||
"severity": "critical",
|
||
"description": "[Catalog] Unused",
|
||
"action": "Immediate Action: CONTACT_SUPPORT\nTrigger Conditions: N/A; Unused"
|
||
},
|
||
"44": {
|
||
"name": "ROBUST_CHANNEL_GR_FAULT_DURING_CTXSW",
|
||
"severity": "info",
|
||
"description": "[Catalog] Graphics Engine fault during context switch",
|
||
"action": "Immediate Action: IGNORE\nInvestigatory Action: CONTACT_SUPPORT"
|
||
},
|
||
"46": {
|
||
"name": "ROBUST_CHANNEL_GPU_TIMEOUT_ERROR",
|
||
"severity": "info",
|
||
"description": "[Catalog] GPU stopped processing",
|
||
"action": "Immediate Action: RESET_GPU\nInvestigatory Action: CONTACT_SUPPORT"
|
||
},
|
||
"47": {
|
||
"name": "ROBUST_CHANNEL_NVENC0_ERROR",
|
||
"severity": "critical",
|
||
"description": "[Catalog] Unused",
|
||
"action": "Immediate Action: CONTACT_SUPPORT\nTrigger Conditions: N/A; Unused"
|
||
},
|
||
"49": {
|
||
"name": "SILENT_RUNNING_CONSTANT_LEVEL_SET_BY_REGISTRY",
|
||
"severity": "critical",
|
||
"description": "[Catalog] Unused",
|
||
"action": "Immediate Action: CONTACT_SUPPORT\nTrigger Conditions: N/A; Unused"
|
||
},
|
||
"50": {
|
||
"name": "SILENT_RUNNING_LEVEL_TRANSITION_DUE_TO_RC_ERROR",
|
||
"severity": "critical",
|
||
"description": "[Catalog] Unused",
|
||
"action": "Immediate Action: CONTACT_SUPPORT\nTrigger Conditions: N/A; Unused"
|
||
},
|
||
"51": {
|
||
"name": "SILENT_RUNNING_STRESS_TEST_FAILURE",
|
||
"severity": "critical",
|
||
"description": "[Catalog] Unused",
|
||
"action": "Immediate Action: CONTACT_SUPPORT\nTrigger Conditions: N/A; Unused"
|
||
},
|
||
"52": {
|
||
"name": "SILENT_RUNNING_LEVEL_TRANS_DUE_TO_TEMP_RISE",
|
||
"severity": "critical",
|
||
"description": "[Catalog] Unused",
|
||
"action": "Immediate Action: CONTACT_SUPPORT\nTrigger Conditions: N/A; Unused"
|
||
},
|
||
"53": {
|
||
"name": "SILENT_RUNNING_TEMP_REDUCED_CLOCKING",
|
||
"severity": "critical",
|
||
"description": "[Catalog] Unused",
|
||
"action": "Immediate Action: CONTACT_SUPPORT\nTrigger Conditions: N/A; Unused"
|
||
},
|
||
"54": {
|
||
"name": "SILENT_RUNNING_PWR_REDUCED_CLOCKING",
|
||
"severity": "warning",
|
||
"description": "[Catalog] Auxiliary power is not connected to the GPU board",
|
||
"action": "Immediate Action: CHECK_MECHANICALS\nInvestigatory Action: CONTACT_SUPPORT"
|
||
},
|
||
"55": {
|
||
"name": "SILENT_RUNNING_TEMPERATURE_READ_ERROR",
|
||
"severity": "critical",
|
||
"description": "[Catalog] Unused",
|
||
"action": "Immediate Action: CONTACT_SUPPORT\nTrigger Conditions: N/A; Unused"
|
||
},
|
||
"56": {
|
||
"name": "DISPLAY_CHANNEL_EXCEPTION",
|
||
"severity": "critical",
|
||
"description": "[Catalog] Unused",
|
||
"action": "Immediate Action: CONTACT_SUPPORT\nTrigger Conditions: N/A; Unused"
|
||
},
|
||
"57": {
|
||
"name": "FB_LINK_TRAINING_FAILURE_ERROR",
|
||
"severity": "critical",
|
||
"description": "[Catalog] Unused",
|
||
"action": "Immediate Action: CONTACT_SUPPORT\nTrigger Conditions: N/A; Unused"
|
||
},
|
||
"58": {
|
||
"name": "FB_MEMORY_ERROR",
|
||
"severity": "critical",
|
||
"description": "[Catalog] Unused",
|
||
"action": "Immediate Action: CONTACT_SUPPORT\nTrigger Conditions: N/A; Unused"
|
||
},
|
||
"59": {
|
||
"name": "PMU_ERROR",
|
||
"severity": "critical",
|
||
"description": "[Catalog] Unused",
|
||
"action": "Immediate Action: CONTACT_SUPPORT\nTrigger Conditions: N/A; Unused"
|
||
},
|
||
"60": {
|
||
"name": "ROBUST_CHANNEL_SEC2_ERROR",
|
||
"severity": "warning",
|
||
"description": "[Catalog] Video processor exception",
|
||
"action": "Immediate Action: RESTART_APP\nInvestigatory Action: INVESTIGATE_SW"
|
||
},
|
||
"65": {
|
||
"name": "ROBUST_CHANNEL_NVENC1_ERROR",
|
||
"severity": "critical",
|
||
"description": "[Catalog] Unused",
|
||
"action": "Immediate Action: CONTACT_SUPPORT\nTrigger Conditions: N/A; Unused"
|
||
},
|
||
"66": {
|
||
"name": "ROBUST_CHANNEL_FECS_ERR_REG_ACCESS_VIOLATION",
|
||
"severity": "info",
|
||
"description": "[Catalog] Illegal access by driver",
|
||
"action": "Immediate Action: IGNORE\nInvestigatory Action: INVESTIGATE_SW"
|
||
},
|
||
"67": {
|
||
"name": "ROBUST_CHANNEL_FECS_ERR_VERIF_VIOLATION",
|
||
"severity": "info",
|
||
"description": "[Catalog] Illegal access by driver",
|
||
"action": "Immediate Action: IGNORE\nInvestigatory Action: CONTACT_SUPPORT"
|
||
},
|
||
"68": {
|
||
"name": "ROBUST_CHANNEL_NVDEC0_ERROR",
|
||
"severity": "warning",
|
||
"description": "[Catalog] NVDEC0 Exception",
|
||
"action": "Immediate Action: RESTART_APP\nInvestigatory Action: CONTACT_SUPPORT"
|
||
},
|
||
"70": {
|
||
"name": "ROBUST_CHANNEL_CE3_ERROR",
|
||
"severity": "warning",
|
||
"description": "[Catalog] CE3: Unknown Error",
|
||
"action": "Immediate Action: RESTART_APP\nInvestigatory Action: CONTACT_SUPPORT"
|
||
},
|
||
"71": {
|
||
"name": "ROBUST_CHANNEL_CE4_ERROR",
|
||
"severity": "warning",
|
||
"description": "[Catalog] CE4: Unknown Error",
|
||
"action": "Immediate Action: RESTART_APP\nInvestigatory Action: CONTACT_SUPPORT"
|
||
},
|
||
"72": {
|
||
"name": "ROBUST_CHANNEL_CE5_ERROR",
|
||
"severity": "warning",
|
||
"description": "[Catalog] CE5: Unknown Error",
|
||
"action": "Immediate Action: RESTART_APP\nInvestigatory Action: CONTACT_SUPPORT"
|
||
},
|
||
"73": {
|
||
"name": "ROBUST_CHANNEL_NVENC2_ERROR",
|
||
"severity": "critical",
|
||
"description": "[Catalog] Unused",
|
||
"action": "Immediate Action: CONTACT_SUPPORT\nTrigger Conditions: N/A; Unused"
|
||
},
|
||
"74": {
|
||
"name": "NVLINK_ERROR",
|
||
"severity": "info",
|
||
"description": "[Catalog] NVLINK Error",
|
||
"action": "Immediate Action: WORKFLOW_NVLINK_ERR\nInvestigatory Action: CONTACT_SUPPORT\nTrigger Conditions: This event is logged when the GPU detects that a problem with a connection from the GPU to another GPU or NVSwitch over NVLink. A GPU reset or node reboot is needed to clear this error. \n\nThis event may indicate a hardware failure with the link itself, or may indicate a problem with the device at the remote end of the link. For example, if a GPU fails, another GPU connected to it over NVLink may report an Xid 74 simply because the link went down as a result. \n\nThe nvidia-smi nvlink command can provide additional details on NVLink errors, and connection information on the links. \n\nIf this error is seen repeatedly and GPU reset or node reboot fails to clear the condition, contact your hardware vendor for support."
|
||
},
|
||
"75": {
|
||
"name": "ROBUST_CHANNEL_CE6_ERROR",
|
||
"severity": "warning",
|
||
"description": "[Catalog] CE6: Unknown Error",
|
||
"action": "Immediate Action: RESTART_APP\nInvestigatory Action: CONTACT_SUPPORT"
|
||
},
|
||
"76": {
|
||
"name": "ROBUST_CHANNEL_CE7_ERROR",
|
||
"severity": "warning",
|
||
"description": "[Catalog] CE7: Unknown Error",
|
||
"action": "Immediate Action: RESTART_APP\nInvestigatory Action: CONTACT_SUPPORT"
|
||
},
|
||
"77": {
|
||
"name": "ROBUST_CHANNEL_CE8_ERROR",
|
||
"severity": "warning",
|
||
"description": "[Catalog] CE8: Unknown Error",
|
||
"action": "Immediate Action: RESTART_APP\nInvestigatory Action: CONTACT_SUPPORT"
|
||
},
|
||
"78": {
|
||
"name": "VGPU_START_ERROR",
|
||
"severity": "warning",
|
||
"description": "[Catalog] vGPU Start Error",
|
||
"action": "Immediate Action: UPDATE_SWFW\nInvestigatory Action: UPDATE_SWFW"
|
||
},
|
||
"80": {
|
||
"name": "PBDMA_PUSHBUFFER_CRC_MISMATCH",
|
||
"severity": "warning",
|
||
"description": "[Catalog] Corrupted data sent to GPU",
|
||
"action": "Immediate Action: RESTART_APP\nInvestigatory Action: CHECK_APP/CUDA"
|
||
},
|
||
"81": {
|
||
"name": "ROBUST_CHANNEL_VGA_SUBSYSTEM_ERROR",
|
||
"severity": "critical",
|
||
"description": "[Catalog] Unused",
|
||
"action": "Immediate Action: CONTACT_SUPPORT\nTrigger Conditions: N/A; Unused"
|
||
},
|
||
"82": {
|
||
"name": "ROBUST_CHANNEL_NVJPG0_ERROR",
|
||
"severity": "warning",
|
||
"description": "[Catalog] NVJPG0 Error",
|
||
"action": "Immediate Action: RESTART_APP\nInvestigatory Action: CONTACT_SUPPORT"
|
||
},
|
||
"83": {
|
||
"name": "ROBUST_CHANNEL_NVDEC1_ERROR",
|
||
"severity": "warning",
|
||
"description": "[Catalog] NVDEC1 Error",
|
||
"action": "Immediate Action: RESTART_APP\nInvestigatory Action: CONTACT_SUPPORT"
|
||
},
|
||
"84": {
|
||
"name": "ROBUST_CHANNEL_NVDEC2_ERROR",
|
||
"severity": "warning",
|
||
"description": "[Catalog] NVDEC2 Error",
|
||
"action": "Immediate Action: RESTART_APP\nInvestigatory Action: CONTACT_SUPPORT"
|
||
},
|
||
"85": {
|
||
"name": "ROBUST_CHANNEL_CE9_ERROR",
|
||
"severity": "warning",
|
||
"description": "[Catalog] CE9: Unknown Error",
|
||
"action": "Immediate Action: RESTART_APP\nInvestigatory Action: CONTACT_SUPPORT"
|
||
},
|
||
"86": {
|
||
"name": "ROBUST_CHANNEL_OFA0_ERROR",
|
||
"severity": "warning",
|
||
"description": "[Catalog] OFA Exception",
|
||
"action": "Immediate Action: RESTART_APP\nInvestigatory Action: CONTACT_SUPPORT"
|
||
},
|
||
"87": {
|
||
"name": "NVTELEMETRY_DRIVER_REPORT",
|
||
"severity": "critical",
|
||
"description": "[Catalog] Unused",
|
||
"action": "Immediate Action: CONTACT_SUPPORT\nTrigger Conditions: N/A; Unused"
|
||
},
|
||
"88": {
|
||
"name": "ROBUST_CHANNEL_NVDEC3_ERROR",
|
||
"severity": "warning",
|
||
"description": "[Catalog] NVDEC3 Error",
|
||
"action": "Immediate Action: RESTART_APP\nInvestigatory Action: CONTACT_SUPPORT"
|
||
},
|
||
"89": {
|
||
"name": "ROBUST_CHANNEL_NVDEC4_ERROR",
|
||
"severity": "warning",
|
||
"description": "[Catalog] NVDEC4 Error",
|
||
"action": "Immediate Action: RESTART_APP\nInvestigatory Action: CONTACT_SUPPORT"
|
||
},
|
||
"90": {
|
||
"name": "LTC_ERROR",
|
||
"severity": "critical",
|
||
"description": "[Catalog] Unused",
|
||
"action": "Immediate Action: CONTACT_SUPPORT\nTrigger Conditions: N/A; Unused"
|
||
},
|
||
"91": {
|
||
"name": "RESERVED_XID",
|
||
"severity": "critical",
|
||
"description": "[Catalog] Unused",
|
||
"action": "Immediate Action: CONTACT_SUPPORT\nTrigger Conditions: N/A; Unused"
|
||
},
|
||
"93": {
|
||
"name": "INFOROM_ERASE_LIMIT_EXCEEDED",
|
||
"severity": "info",
|
||
"description": "[Catalog] Non-fatal violation of provisioned InfoROM wear limit",
|
||
"action": "Immediate Action: IGNORE\nInvestigatory Action: CONTACT_SUPPORT\nTrigger Conditions: This event is logged when the GPU driver fails to update the InfoROM due to violation of the provisioned InfoROM wear limit that was set for the GPU using NVFlash using nvflash --=elsessionstart.\n\nIn most cases this is not indicative of a driver or flash failure, but rather the intentional use of the InfoROM wear protection feature as set by NVFlash.\n\nRecovery steps:\nThe GPU can be recovered from Xid 93 by clearing InfoROM erase limit using ./nvflash –-elsessionclear. If clearing the limit using nvflash doesn’t help, report the issue to NVIDIA."
|
||
},
|
||
"96": {
|
||
"name": "ROBUST_CHANNEL_NVDEC5_ERROR",
|
||
"severity": "warning",
|
||
"description": "[Catalog] NVDEC5 Error",
|
||
"action": "Immediate Action: RESTART_APP\nInvestigatory Action: CONTACT_SUPPORT"
|
||
},
|
||
"97": {
|
||
"name": "ROBUST_CHANNEL_NVDEC6_ERROR",
|
||
"severity": "warning",
|
||
"description": "[Catalog] NVDEC6 Error",
|
||
"action": "Immediate Action: RESTART_APP\nInvestigatory Action: CONTACT_SUPPORT"
|
||
},
|
||
"98": {
|
||
"name": "ROBUST_CHANNEL_NVDEC7_ERROR",
|
||
"severity": "warning",
|
||
"description": "[Catalog] NVDEC7 Error",
|
||
"action": "Immediate Action: RESTART_APP\nInvestigatory Action: CONTACT_SUPPORT"
|
||
},
|
||
"99": {
|
||
"name": "ROBUST_CHANNEL_NVJPG1_ERROR",
|
||
"severity": "warning",
|
||
"description": "[Catalog] NVJPG1 Error",
|
||
"action": "Immediate Action: RESTART_APP\nInvestigatory Action: CONTACT_SUPPORT"
|
||
},
|
||
"100": {
|
||
"name": "ROBUST_CHANNEL_NVJPG2_ERROR",
|
||
"severity": "warning",
|
||
"description": "[Catalog] NVJPG2 Error",
|
||
"action": "Immediate Action: RESTART_APP\nInvestigatory Action: CONTACT_SUPPORT"
|
||
},
|
||
"101": {
|
||
"name": "ROBUST_CHANNEL_NVJPG3_ERROR",
|
||
"severity": "warning",
|
||
"description": "[Catalog] NVJPG3 Error",
|
||
"action": "Immediate Action: RESTART_APP\nInvestigatory Action: CONTACT_SUPPORT"
|
||
},
|
||
"102": {
|
||
"name": "ROBUST_CHANNEL_NVJPG4_ERROR",
|
||
"severity": "warning",
|
||
"description": "[Catalog] NVJPG4 Error",
|
||
"action": "Immediate Action: RESTART_APP\nInvestigatory Action: CONTACT_SUPPORT"
|
||
},
|
||
"103": {
|
||
"name": "ROBUST_CHANNEL_NVJPG5_ERROR",
|
||
"severity": "warning",
|
||
"description": "[Catalog] NVJPG5 Error",
|
||
"action": "Immediate Action: RESTART_APP\nInvestigatory Action: CONTACT_SUPPORT"
|
||
},
|
||
"104": {
|
||
"name": "ROBUST_CHANNEL_NVJPG6_ERROR",
|
||
"severity": "warning",
|
||
"description": "[Catalog] NVJPG6 Error",
|
||
"action": "Immediate Action: RESTART_APP\nInvestigatory Action: CONTACT_SUPPORT"
|
||
},
|
||
"105": {
|
||
"name": "ROBUST_CHANNEL_NVJPG7_ERROR",
|
||
"severity": "warning",
|
||
"description": "[Catalog] NVJPG7 Error",
|
||
"action": "Immediate Action: RESTART_APP\nInvestigatory Action: CONTACT_SUPPORT"
|
||
},
|
||
"106": {
|
||
"name": "SMBPBI_TEST_MESSAGE",
|
||
"severity": "info",
|
||
"description": "[Catalog] SMBPBI Test Message",
|
||
"action": "Immediate Action: IGNORE\nInvestigatory Action: IGNORE"
|
||
},
|
||
"107": {
|
||
"name": "SMBPBI_TEST_MESSAGE_SILENT",
|
||
"severity": "info",
|
||
"description": "[Catalog] SMBPBI Test Message Silent",
|
||
"action": "Immediate Action: IGNORE\nInvestigatory Action: IGNORE"
|
||
},
|
||
"108": {
|
||
"name": "NVLINK_REMOTE_TRANSLATION_ERROR",
|
||
"severity": "info",
|
||
"description": "[Catalog] Unused",
|
||
"action": "Immediate Action: IGNORE\nInvestigatory Action: XID_137_FLOW\nTrigger Conditions: N/A; Unused"
|
||
},
|
||
"109": {
|
||
"name": "ROBUST_CHANNEL_CTXSW_TIMEOUT_ERROR",
|
||
"severity": "info",
|
||
"description": "[Catalog] Context Switch Timeout Error",
|
||
"action": "Immediate Action: RESET_GPU\nInvestigatory Action: CONTACT_SUPPORT"
|
||
},
|
||
"110": {
|
||
"name": "SEC_FAULT_ERROR",
|
||
"severity": "info",
|
||
"description": "[Catalog] Security Fault Error",
|
||
"action": "Immediate Action: RESET_GPU\nInvestigatory Action: INVESTIGATE_SW\nTrigger Conditions: This event should be uncommon unless there is a hardware failure. To recover, revert any recent system hardware modifications and cold reset the system. If this fails to correct the issue, contact your hardware vendor for assistance."
|
||
},
|
||
"111": {
|
||
"name": "BUNDLE_ERROR_EVENT",
|
||
"severity": "critical",
|
||
"description": "[Catalog] Unused",
|
||
"action": "Immediate Action: CONTACT_SUPPORT\nTrigger Conditions: N/A; Unused"
|
||
},
|
||
"112": {
|
||
"name": "DISP_SUPERVISOR_ERROR",
|
||
"severity": "critical",
|
||
"description": "[Catalog] Unused",
|
||
"action": "Immediate Action: CONTACT_SUPPORT\nTrigger Conditions: N/A; Unused"
|
||
},
|
||
"113": {
|
||
"name": "DP_LT_FAILURE",
|
||
"severity": "critical",
|
||
"description": "[Catalog] Unused",
|
||
"action": "Immediate Action: CONTACT_SUPPORT\nTrigger Conditions: N/A; Unused"
|
||
},
|
||
"114": {
|
||
"name": "HEAD_RG_UNDERFLOW",
|
||
"severity": "critical",
|
||
"description": "[Catalog] Unused",
|
||
"action": "Immediate Action: CONTACT_SUPPORT\nTrigger Conditions: N/A; Unused"
|
||
},
|
||
"115": {
|
||
"name": "CORE_CHANNEL_REGS",
|
||
"severity": "critical",
|
||
"description": "[Catalog] Unused",
|
||
"action": "Immediate Action: CONTACT_SUPPORT\nTrigger Conditions: N/A; Unused"
|
||
},
|
||
"116": {
|
||
"name": "WINDOW_CHANNEL_REGS",
|
||
"severity": "critical",
|
||
"description": "[Catalog] Unused",
|
||
"action": "Immediate Action: CONTACT_SUPPORT\nTrigger Conditions: N/A; Unused"
|
||
},
|
||
"117": {
|
||
"name": "CURSOR_CHANNEL_REGS",
|
||
"severity": "critical",
|
||
"description": "[Catalog] Unused",
|
||
"action": "Immediate Action: CONTACT_SUPPORT\nTrigger Conditions: N/A; Unused"
|
||
},
|
||
"118": {
|
||
"name": "HEAD_REGS",
|
||
"severity": "critical",
|
||
"description": "[Catalog] Unused",
|
||
"action": "Immediate Action: CONTACT_SUPPORT\nTrigger Conditions: N/A; Unused"
|
||
},
|
||
"120": {
|
||
"name": "GSP_ERROR",
|
||
"severity": "info",
|
||
"description": "[Catalog] GSP Error",
|
||
"action": "Immediate Action: RESET_GPU\nInvestigatory Action: INVESTIGATE_SW\nTrigger Conditions: These events (119/120) may be logged when an error occurs in code running on the GSP core of the GPU and/or a timeout occurs while waiting for the GSP core of the GPU to respond to an RPC message. A GPU reset or node power cycle may be needed if the error persists. If this problem reoccurs after a power cycle, follow the NVIDIA GPU Debug Guidelines document for additional debugging steps."
|
||
},
|
||
"121": {
|
||
"name": "C2C_ERROR",
|
||
"severity": "info",
|
||
"description": "[Catalog] C2C Error",
|
||
"action": "Immediate Action: IGNORE\nInvestigatory Action: CONTACT_SUPPORT\nTrigger Conditions: This event may occur when the GPU driver has observed corrected errors on the C2C NVLink connection to a Grace CPU. These errors are corrected by the system and have no operational impact. Resetting the GPU at an available service window will allow the GPU to retrain the link.\nNOTE: repeat errors may be reported; VBIOS 97.00.90.00.00 may provide some relief from that condition"
|
||
},
|
||
"122": {
|
||
"name": "SPI_PMU_RPC_READ_FAIL",
|
||
"severity": "critical",
|
||
"description": "[Catalog] Unused",
|
||
"action": "Immediate Action: CONTACT_SUPPORT\nTrigger Conditions: N/A; Unused"
|
||
},
|
||
"123": {
|
||
"name": "SPI_PMU_RPC_WRITE_FAIL",
|
||
"severity": "critical",
|
||
"description": "[Catalog] Unused",
|
||
"action": "Immediate Action: CONTACT_SUPPORT\nTrigger Conditions: N/A; Unused"
|
||
},
|
||
"124": {
|
||
"name": "SPI_PMU_RPC_ERASE_FAIL",
|
||
"severity": "critical",
|
||
"description": "[Catalog] Unused",
|
||
"action": "Immediate Action: CONTACT_SUPPORT\nTrigger Conditions: N/A; Unused"
|
||
},
|
||
"125": {
|
||
"name": "INFOROM_FS_ERROR",
|
||
"severity": "critical",
|
||
"description": "[Catalog] Unused",
|
||
"action": "Immediate Action: CONTACT_SUPPORT\nTrigger Conditions: N/A; Unused"
|
||
},
|
||
"126": {
|
||
"name": "ROBUST_CHANNEL_CE10_ERROR",
|
||
"severity": "warning",
|
||
"description": "[Catalog] CE10: Unknown Error",
|
||
"action": "Immediate Action: RESTART_APP\nInvestigatory Action: CONTACT_SUPPORT"
|
||
},
|
||
"127": {
|
||
"name": "ROBUST_CHANNEL_CE11_ERROR",
|
||
"severity": "warning",
|
||
"description": "[Catalog] CE11: Unknown Error",
|
||
"action": "Immediate Action: RESTART_APP\nInvestigatory Action: CONTACT_SUPPORT"
|
||
},
|
||
"128": {
|
||
"name": "ROBUST_CHANNEL_CE12_ERROR",
|
||
"severity": "warning",
|
||
"description": "[Catalog] CE12: Unknown Error",
|
||
"action": "Immediate Action: RESTART_APP\nInvestigatory Action: CONTACT_SUPPORT"
|
||
},
|
||
"129": {
|
||
"name": "ROBUST_CHANNEL_CE13_ERROR",
|
||
"severity": "warning",
|
||
"description": "[Catalog] CE13: Unknown Error",
|
||
"action": "Immediate Action: RESTART_APP\nInvestigatory Action: CONTACT_SUPPORT"
|
||
},
|
||
"130": {
|
||
"name": "ROBUST_CHANNEL_CE14_ERROR",
|
||
"severity": "warning",
|
||
"description": "[Catalog] CE14: Unknown Error",
|
||
"action": "Immediate Action: RESTART_APP\nInvestigatory Action: CONTACT_SUPPORT"
|
||
},
|
||
"131": {
|
||
"name": "ROBUST_CHANNEL_CE15_ERROR",
|
||
"severity": "warning",
|
||
"description": "[Catalog] CE15: Unknown Error",
|
||
"action": "Immediate Action: RESTART_APP\nInvestigatory Action: CONTACT_SUPPORT"
|
||
},
|
||
"132": {
|
||
"name": "ROBUST_CHANNEL_CE16_ERROR",
|
||
"severity": "warning",
|
||
"description": "[Catalog] CE16: Unknown Error",
|
||
"action": "Immediate Action: RESTART_APP\nInvestigatory Action: CONTACT_SUPPORT"
|
||
},
|
||
"133": {
|
||
"name": "ROBUST_CHANNEL_CE17_ERROR",
|
||
"severity": "warning",
|
||
"description": "[Catalog] CE17: Unknown Error",
|
||
"action": "Immediate Action: RESTART_APP\nInvestigatory Action: CONTACT_SUPPORT"
|
||
},
|
||
"134": {
|
||
"name": "ROBUST_CHANNEL_CE18_ERROR",
|
||
"severity": "warning",
|
||
"description": "[Catalog] CE18: Unknown Error",
|
||
"action": "Immediate Action: RESTART_APP\nInvestigatory Action: CONTACT_SUPPORT"
|
||
},
|
||
"135": {
|
||
"name": "ROBUST_CHANNEL_CE19_ERROR",
|
||
"severity": "warning",
|
||
"description": "[Catalog] CE19: Unknown Error",
|
||
"action": "Immediate Action: RESTART_APP\nInvestigatory Action: CONTACT_SUPPORT"
|
||
},
|
||
"136": {
|
||
"name": "ALI_TRAINING_FAIL",
|
||
"severity": "info",
|
||
"description": "[Catalog] Link Training Failed",
|
||
"action": "Immediate Action: RESET_GPU\nInvestigatory Action: INVESTIGATE_LINK_SI"
|
||
},
|
||
"137": {
|
||
"name": "NVLINK_PRIV_ERR",
|
||
"severity": "info",
|
||
"description": "[Catalog] NVLink Privilege Error",
|
||
"action": "Immediate Action: IGNORE\nInvestigatory Action: XID_137_FLOW\nTrigger Conditions: This event is logged when a fault is reported by the remote MMU, such as when an illegal NVLink peer-to-peer access is made by an applicable unit on the chip. Typically these are application-level bugs, but can also be driver bugs or hardware bugs.\n\nWhen this event is logged, NVIDIA recommends the following: #. Run the application in cuda-gdb or the Compute Sanitizer memcheck tool , or #. Run the application with CUDA_DEVICE_WAITS_ON_EXCEPTION=1 and then attach later with cuda-gdb, or #. File a bug if the previous two come back inconclusive to eliminate potential NVIDIA driver or hardware bug."
|
||
},
|
||
"138": {
|
||
"name": "ROBUST_CHANNEL_DLA_ERROR",
|
||
"severity": "critical",
|
||
"description": "[Catalog] Unused",
|
||
"action": "Immediate Action: CONTACT_SUPPORT\nTrigger Conditions: N/A; Unused"
|
||
},
|
||
"139": {
|
||
"name": "ROBUST_CHANNEL_OFA1_ERROR",
|
||
"severity": "warning",
|
||
"description": "[Catalog] OFA1 Error",
|
||
"action": "Immediate Action: RESTART_APP\nInvestigatory Action: CONTACT_SUPPORT"
|
||
},
|
||
"140": {
|
||
"name": "UNRECOVERABLE_ECC_ERROR_ESCAPE",
|
||
"severity": "info",
|
||
"description": "[Catalog] ECC Unrecovered Error",
|
||
"action": "Immediate Action: RESET_GPU\nInvestigatory Action: CONTACT_SUPPORT\nTrigger Conditions: This event may occur when the GPU driver has observed uncorrectable errors in GPU memory, in such a way as to interrupt the GPU driver’s ability to mark the pages for dynamic page offlining or row remapping. Reset the GPU, and if the problem persists, contact your hardware vendor for support."
|
||
},
|
||
"141": {
|
||
"name": "ROBUST_CHANNEL_FAST_PATH_ERROR",
|
||
"severity": "info",
|
||
"description": "[Catalog] CUDA Fast Path Error",
|
||
"action": "Immediate Action: IGNORE\nInvestigatory Action: CONTACT_SUPPORT"
|
||
},
|
||
"142": {
|
||
"name": "ROBUST_CHANNEL_NVENC3_ERROR",
|
||
"severity": "critical",
|
||
"description": "[Catalog] NVENC3 Error",
|
||
"action": "Immediate Action: CONTACT_SUPPORT"
|
||
},
|
||
"143": {
|
||
"name": "GPU_INIT_ERROR",
|
||
"severity": "info",
|
||
"description": "[Catalog] GPU Initialization Error",
|
||
"action": "Immediate Action: RESET_GPU\nInvestigatory Action: CONTACT_SUPPORT"
|
||
},
|
||
"144": {
|
||
"name": "NVLINK_SAW_ERROR",
|
||
"severity": "info",
|
||
"description": "[Catalog] NVLINK: SAW Error",
|
||
"action": "Immediate Action: WORKFLOW_NVLINK5_ERR\nInvestigatory Action: WORKFLOW_NVLINK5_ERR"
|
||
},
|
||
"145": {
|
||
"name": "NVLINK_RLW_ERROR",
|
||
"severity": "info",
|
||
"description": "[Catalog] NVLINK: RLW Error",
|
||
"action": "Immediate Action: WORKFLOW_NVLINK5_ERR\nInvestigatory Action: WORKFLOW_NVLINK5_ERR"
|
||
},
|
||
"146": {
|
||
"name": "NVLINK_TLW_ERROR",
|
||
"severity": "info",
|
||
"description": "[Catalog] NVLINK: TLW Error",
|
||
"action": "Immediate Action: WORKFLOW_NVLINK5_ERR\nInvestigatory Action: WORKFLOW_NVLINK5_ERR"
|
||
},
|
||
"147": {
|
||
"name": "NVLINK_TREX_ERROR",
|
||
"severity": "info",
|
||
"description": "[Catalog] NVLINK: TREX Error",
|
||
"action": "Immediate Action: WORKFLOW_NVLINK5_ERR\nInvestigatory Action: WORKFLOW_NVLINK5_ERR"
|
||
},
|
||
"148": {
|
||
"name": "NVLINK_NVLPW_CTRL_ERROR",
|
||
"severity": "info",
|
||
"description": "[Catalog] NVLINK: NVLPW_CTRL Error",
|
||
"action": "Immediate Action: WORKFLOW_NVLINK5_ERR\nInvestigatory Action: WORKFLOW_NVLINK5_ERR"
|
||
},
|
||
"149": {
|
||
"name": "NVLINK_NETIR_ERROR",
|
||
"severity": "info",
|
||
"description": "[Catalog] NVLINK: NETIR Error",
|
||
"action": "Immediate Action: WORKFLOW_NVLINK5_ERR\nInvestigatory Action: WORKFLOW_NVLINK5_ERR"
|
||
},
|
||
"150": {
|
||
"name": "NVLINK_MSE_ERROR",
|
||
"severity": "info",
|
||
"description": "[Catalog] NVLINK: MSE Error",
|
||
"action": "Immediate Action: WORKFLOW_NVLINK5_ERR\nInvestigatory Action: WORKFLOW_NVLINK5_ERR"
|
||
},
|
||
"151": {
|
||
"name": "ROBUST_CHANNEL_KEY_ROTATION_ERROR",
|
||
"severity": "warning",
|
||
"description": "[Catalog] Key rotation Error",
|
||
"action": "Immediate Action: RESTART_VM\nInvestigatory Action: CONTACT_SUPPORT"
|
||
},
|
||
"152": {
|
||
"name": "ROBUST_CHANNEL_DLA_SMMU_ERROR",
|
||
"severity": "info",
|
||
"description": "[Catalog] DLA SMMU Error",
|
||
"action": "Immediate Action: IGNORE\nInvestigatory Action: CONTACT_SUPPORT"
|
||
},
|
||
"153": {
|
||
"name": "ROBUST_CHANNEL_DLA_TIMEOUT",
|
||
"severity": "info",
|
||
"description": "[Catalog] DLA timeout Error",
|
||
"action": "Immediate Action: IGNORE\nInvestigatory Action: CONTACT_SUPPORT"
|
||
},
|
||
"154": {
|
||
"name": "GPU_RECOVERY_ACTION_CHANGED",
|
||
"severity": "info",
|
||
"description": "[Catalog] GPU Recovery Action Changed",
|
||
"action": "Immediate Action: XID_154\nInvestigatory Action: N/A Informational only regarding another Xid\nTrigger Conditions: \"Xid 154 will be seen in conjunction with other Xids and summarizes the recovery action required for other Xids. \nThe string will be similar to \"\"Xid 154 GPU recovery action changed from 0x0 (None) to 0x2 (Node Reboot Required)\"\" where the expected values of the text are: \"\"None\"\", \"\"Drain P2P\"\", \"\"Drain and Reset\"\", \"\"GPU Reset Required\"\", \"\"Node Reboot Required\"\". \""
|
||
},
|
||
"155": {
|
||
"name": "NVLINK_SW_DEFINED_ERROR",
|
||
"severity": "info",
|
||
"description": "[Catalog] NVLINK: SW Defined Error",
|
||
"action": "Immediate Action: RESET_GPU\nInvestigatory Action: INVESTIGATE_SW_USER\nTrigger Conditions: Link down events which are flagged as “intentional” (including transitions to SLEEP) will trigger this Xid"
|
||
},
|
||
"156": {
|
||
"name": "RESOURCE_RETIREMENT_EVENT",
|
||
"severity": "info",
|
||
"description": "[Catalog] Resource Retirement Event",
|
||
"action": "Immediate Action: RESET_GPU\nInvestigatory Action: IGNORE"
|
||
},
|
||
"157": {
|
||
"name": "RESOURCE_RETIREMENT_FAILURE",
|
||
"severity": "info",
|
||
"description": "[Catalog] Resource Retirement Failure",
|
||
"action": "Immediate Action: IGNORE\nInvestigatory Action: CONTACT_SUPPORT\nTrigger Conditions: No possible repairs are possible due to lack of resources. You may still run workloads or Apps, but may experience the same Xid again."
|
||
},
|
||
"158": {
|
||
"name": "GPU_FATAL_TIMEOUT",
|
||
"severity": "info",
|
||
"description": "[Catalog] GPU Fatal Timeout",
|
||
"action": "Immediate Action: RESET_GPU\nInvestigatory Action: CONTACT_SUPPORT"
|
||
},
|
||
"159": {
|
||
"name": "ROBUST_CHANNEL_CHI_NON_DATA_ERROR",
|
||
"severity": "warning",
|
||
"description": "[Catalog] CHI Non-Data Error",
|
||
"action": "Immediate Action: CHECK_UVM\nInvestigatory Action: SYMPATHETIC_REPORT_SOLO\nTrigger Conditions: May be seen on any C2C link-connected GPU."
|
||
},
|
||
"160": {
|
||
"name": "CHANNEL_RETIREMENT_EVENT",
|
||
"severity": "info",
|
||
"description": "[Catalog] Channel Retirement Event",
|
||
"action": "Immediate Action: IGNORE\nInvestigatory Action: INVESTIGATE_SW"
|
||
},
|
||
"161": {
|
||
"name": "CHANNEL_RETIREMENT_FAILURE",
|
||
"severity": "info",
|
||
"description": "[Catalog] Channel Retirement Failure",
|
||
"action": "Immediate Action: IGNORE\nInvestigatory Action: INVESTIGATE_SW"
|
||
},
|
||
"162": {
|
||
"name": "PSHC_REENGAGED",
|
||
"severity": "info",
|
||
"description": "[Catalog] Power Smoothing HW Circuitry capability reengaged",
|
||
"action": "NVIDIA 공식 문서에서 해당 XID 코드를 확인하세요."
|
||
},
|
||
"163": {
|
||
"name": "PSHC_DISENGAGED",
|
||
"severity": "info",
|
||
"description": "[Catalog] Power Smoothing HW Circuitry capability disengaged",
|
||
"action": "Trigger Conditions: No GPU reset required. If power smoothing functionality is desired, the customer needs to resolve the thermal events. If disabled due to timeout, reload the driver or reset the GPU."
|
||
},
|
||
"164": {
|
||
"name": "PSHC_LOW_LIFETIME",
|
||
"severity": "info",
|
||
"description": "[Catalog] Power Smoothing HW Circuitry low lifetime reached",
|
||
"action": "Trigger Conditions: Monitor power swings and expect to replace GPUs if power smoothing is desired.\nPower smoothing functionality will be disabled soon. Investigate if power swings are acceptable, and if not, take action."
|
||
},
|
||
"165": {
|
||
"name": "PSHC_ZERO_LIFETIME",
|
||
"severity": "info",
|
||
"description": "[Catalog] Power Smoothing HW Circuitry lifetime exhausted",
|
||
"action": "Trigger Conditions: Replace GPUs if power swings are not acceptable, and power smoothing is desired. Power smoothing will be disabled by the driver and power swings will occur. Analyze datacenter infrastructure to ensure ability to absorb power swings."
|
||
},
|
||
"166": {
|
||
"name": "NVLINK_SECURE_CRYPTO_ERR",
|
||
"severity": "info",
|
||
"description": "[Catalog] CC traffic seen prior to link properly being configured for encrypted traffic",
|
||
"action": "Trigger Conditions: Applicable to CC (confidential computing) mode only."
|
||
},
|
||
"167": {
|
||
"name": "PCIE_FATAL_TIMEOUT",
|
||
"severity": "info",
|
||
"description": "[Catalog] PCIE_FATAL_TIMEOUT",
|
||
"action": "NVIDIA 공식 문서에서 해당 XID 코드를 확인하세요."
|
||
},
|
||
"168": {
|
||
"name": "REDUCED_GPU_MEMORY_CAPACITY",
|
||
"severity": "info",
|
||
"description": "[Catalog] Errors found in WPR (write protected region)",
|
||
"action": "Trigger Conditions: Should only be seen when ECC is disabled. \nEither ECC should be enabled (to enable row-remapping) or boot re-attempted with shifted WPR. "
|
||
},
|
||
"169": {
|
||
"name": "SEC2_HALT_ERROR",
|
||
"severity": "info",
|
||
"description": "[Catalog] Internal micro-controller halt",
|
||
"action": "NVIDIA 공식 문서에서 해당 XID 코드를 확인하세요."
|
||
},
|
||
"170": {
|
||
"name": "NVLINK_SECURE_OTHER",
|
||
"severity": "info",
|
||
"description": "[Catalog] Interrupt seen in CC mode",
|
||
"action": "Trigger Conditions: Applicable to CC (confidential computing) mode only."
|
||
},
|
||
"171": {
|
||
"name": "UNCORRECTABLE_DRAM_ERROR",
|
||
"severity": "info",
|
||
"description": "[Catalog] Additional to Xid 48 providing more details on particulars of fault to differentiate DRAM/SRAM",
|
||
"action": "NVIDIA 공식 문서에서 해당 XID 코드를 확인하세요."
|
||
},
|
||
"172": {
|
||
"name": "UNCORRECTABLE_SRAM_ERROR",
|
||
"severity": "info",
|
||
"description": "[Catalog] Additional to Xid 48 providing more details on particulars of fault to differentiate DRAM/SRAM",
|
||
"action": "NVIDIA 공식 문서에서 해당 XID 코드를 확인하세요."
|
||
}
|
||
},
|
||
"severity_levels": {
|
||
"critical": {
|
||
"label": "심각",
|
||
"color": "red",
|
||
"emoji": "🔴",
|
||
"description": "즉각적인 조치가 필요합니다. 서비스 중단 또는 하드웨어 손상 위험."
|
||
},
|
||
"warning": {
|
||
"label": "경고",
|
||
"color": "orange",
|
||
"emoji": "🟡",
|
||
"description": "주의가 필요합니다. 방치 시 심각한 문제로 발전 가능."
|
||
},
|
||
"info": {
|
||
"label": "정보",
|
||
"color": "green",
|
||
"emoji": "🟢",
|
||
"description": "참고 사항입니다. 정기 모니터링 권장."
|
||
}
|
||
}
|
||
} |