GPUd release notes (2025-12-18T08:34:39Z)
Welcome to this new release!
What's Changed
- [LEP-3205] fix(components/nvidia): handle "GPU requires reset" NVML error to set suggested actions by @gyuho in https://github.com/leptonai/gpud/pull/1133
- [LEP-3196] feat(nvml): mark h100/h200 fabric state as supported by @gyuho in https://github.com/leptonai/gpud/pull/1131
- [LEP-2916] feat(cmd/gpud): add control plane flag overrides by @gyuho in https://github.com/leptonai/gpud/pull/1138
- [LEP-3107] feat(host): replace "uptime -s" with boottime syscall for reboot store by @gyuho in https://github.com/leptonai/gpud/pull/1122
- [LEP-2852] feat(pkg/asn): implement fallback for as lookup by @gyuho in https://github.com/leptonai/gpud/pull/1112
- [LEP-1995] feat(eventstore, metadata): drop unused table references since v0.5 (safe to drop) by @gyuho in https://github.com/leptonai/gpud/pull/1123
- nits(pkg/host): remove unnecessary cpu name fallback in favor of upstream gopsutil by @gyuho in https://github.com/leptonai/gpud/pull/1121
- [LEP-3269] fix(nvidia/fabric-manager): consider GPU device count for fabric state checks for H100/H200/GB200 by @gyuho in https://github.com/leptonai/gpud/pull/1140
- [LEP-3114] feat(custom-plugins): drop unused/deprecated plugin "type" field from Spec by @gyuho in https://github.com/leptonai/gpud/pull/1124
- [LEP-2892] feat(nvidia/xid): extract sub code/XID for XID 144-150 by @gyuho in https://github.com/leptonai/gpud/pull/1120
- [LEP-3109] fix(pkg/disk): handle raid/md devices, recursive lsblk parse for more depth by @gyuho in https://github.com/leptonai/gpud/pull/1111
- [LEP-3108] feat(infiniband): move code to components/infiniband package (no more under nvidia-query package) by @gyuho in https://github.com/leptonai/gpud/pull/1128
- [LEP-3195] [LEP-3196] feat(cmd/gpud): add --gpu-uuids-with-gpu-lost, --gpu-uuids-with-gpu-requires-reset, --gpu-uuids-with-fabric-state-health-summary-unhealthy flags for testing by @gyuho in https://github.com/leptonai/gpud/pull/1139
- [LEP-3112] feat(cmd/gpud): remove "gpud login" command in favor of "gpud up", remove/move unused code by @gyuho in https://github.com/leptonai/gpud/pull/1125
- nits(tailscale/derpmap): sync more derp servers by @gyuho in https://github.com/leptonai/gpud/pull/1132
- dep(go.mod): pin docker to v26.1.5, and update docker/containerd to latest stable in Dockerfile by @gyuho in https://github.com/leptonai/gpud/pull/1135
- [LEP-2947] feat(nvlink): support global nvlink states thresholds by @gyuho in https://github.com/leptonai/gpud/pull/1087
- [LEP-2905] feat(nvidia/infiniband): make ib port drop event more persistent, rename more packages to nvidia/ by @gyuho in https://github.com/leptonai/gpud/pull/1110
- [LEP-1876] [LEP-3195] feat(nvidia/hw-slowdown): retain threshold exceeded events until set healthy by @gyuho in https://github.com/leptonai/gpud/pull/1057
- [LEP-3113] feat(nvidia/xid,sxid): stop persisting SetHealthy events by @gyuho in https://github.com/leptonai/gpud/pull/1126
- [LEP-3115] fix(pkg/host): do not attempt to create table everytime we load reboot events store by @gyuho in https://github.com/leptonai/gpud/pull/1127
- [LEP-2836] feat(gossip/machine-info): include tailscale/containerd versions by @gyuho in https://github.com/leptonai/gpud/pull/1143
- [LEP-3363] fix(nvidia/fabric-manager): mark H100 with PCIe product not supporting fabric manager by @gyuho in https://github.com/leptonai/gpud/pull/1147
- [LEP-3336] feat(session/login): show login failures in "gpud status" by @gyuho in https://github.com/leptonai/gpud/pull/1145
- [LEP-2916] feat(gpud run): perform login when --token flag value (optional) by @gyuho in https://github.com/leptonai/gpud/pull/1148
- [LEP-3329] fix(nvidia/fabric-manager): do not skip activeness check when fabric state is supported by @gyuho in https://github.com/leptonai/gpud/pull/1151
- fix(components/containerd): remove "ok" prefix when unhealthy by @gyuho in https://github.com/leptonai/gpud/pull/1152
- chore(deps): bump golang.org/x/crypto from 0.36.0 to 0.45.0 by @dependabot[bot] in https://github.com/leptonai/gpud/pull/1150
- doc(pkg/login): document success/failure cases with error code by @gyuho in https://github.com/leptonai/gpud/pull/1157
- [LEP-3348] feat(gpud): optionally set data dir for testing (vs. /var/lib/gpud) by @gyuho in https://github.com/leptonai/gpud/pull/1153
- fix(gpud/run): do not overwrite session token in metadata by @gyuho in https://github.com/leptonai/gpud/pull/1159
- [LEP-3422] feat(nvidia/nvlink): log when threshold is exceeded by @gyuho in https://github.com/leptonai/gpud/pull/1158
- Fix note on install script architecture support by @martbhell in https://github.com/leptonai/gpud/pull/1161
- feat(*): add SECURITY.md and THIRD-PARTY.txt by @gyuho in https://github.com/leptonai/gpud/pull/1166
- feat(nvidia/xid): set health state Unhealthy (not Degraded) for first occurrences of xid 65 + 94 by @gyuho in https://github.com/leptonai/gpud/pull/1165
- [LEP-3499] [LEP-3539] [LEP-3540] fix(nvidia/xid): separate sub-code fatality for XID 144-150, better reason message by @gyuho in https://github.com/leptonai/gpud/pull/1160
- [LEP-3519] [LEP-3422] feat(gpud/run): add "--skip-session-update-config" flag by @gyuho in https://github.com/leptonai/gpud/pull/1162
- [LEP-3306] feat(disk, memory): log warn level when threshold exceeds in case of node pressure eviction by @gyuho in https://github.com/leptonai/gpud/pull/1163
- fix(ci): bump up golangci-lint to latest by @gyuho in https://github.com/leptonai/gpud/pull/1168
- ci: create helm dedicated workflow by @giuliocalzo in https://github.com/leptonai/gpud/pull/1169
- ci: remove external actions by @giuliocalzo in https://github.com/leptonai/gpud/pull/1173
- remove: golangci lint binary (unused) by @gyuho in https://github.com/leptonai/gpud/pull/1176
- [LEP-3596] fix(machine-info): prioritize IMDS private IP over NIC interfaces by @gyuho in https://github.com/leptonai/gpud/pull/1171
- [LEP-3613] fix(disk): handle trailing "/" for NFS/mount checks by @gyuho in https://github.com/leptonai/gpud/pull/1172
- [LEP-3348] perf(README): explain high read I/O in small machines by @gyuho in https://github.com/leptonai/gpud/pull/1146
- feat(container/docker): document how to vend source code of dependencies by @gyuho in https://github.com/leptonai/gpud/pull/1177
- [LEP-3581] fix(nvidia/memory): sysinfo fallback for DGX Spark (GB10) by @gyuho in https://github.com/leptonai/gpud/pull/1170
- [LEP-2916] feat(helm/gpud): support label reader, fix mounts (optional) by @gyuho in https://github.com/leptonai/gpud/pull/1149
- [LEP-3642] [LEP-3661] [LEP-3662] [LEP-3698] [LEP-3699] fix(nvidia/xid): fix NVLink Non-fatal events incorrectly reported as Fatal, fix XID 144-150 reboot handling by @gyuho in https://github.com/leptonai/gpud/pull/1174
- feat(gpud): support --db-in-memory for local database by @gyuho in https://github.com/leptonai/gpud/pull/1178
- [LEP-3196] feat(nvidia/fabric-manager): no overwrite health state, add "gpud run --gpu-product-name" flag by @gyuho in https://github.com/leptonai/gpud/pull/1175
- fix(gpud-manager/controllers): skip file already closed errors when logging by @gyuho in https://github.com/leptonai/gpud/pull/1179
- fix(nvidia/infiniband): handle ACCESS_REG kernel error in mlx device query, allow device exclusion by @gyuho in https://github.com/leptonai/gpud/pull/1167
- [LEP-3779] fix(gpud up): re-use login token (when specified) to following "gpud run" (only for db-in-memory mode) by @gyuho in https://github.com/leptonai/gpud/pull/1181
New Contributors
- @martbhell made their first contribution in https://github.com/leptonai/gpud/pull/1161
- @giuliocalzo made their first contribution in https://github.com/leptonai/gpud/pull/1169
Full Changelog: https://github.com/leptonai/gpud/compare/v0.8.0...v0.9.0