Hello,
During this weekend, I completely reset my NAS, using the latest firmware: h6.0.3564 Build 20260723.
During the installation before the reset, the new nvkernerdriver drivers installed themselves.
Following the reset, it was impossible to restart a model on Ollama; in the end, it worked after a reboot (following the installation of the Nvidia drivers). Despite everything, this morning, it was again impossible to launch a model on the GPU.
Like this weekend, I had the presence of these errors in “dmesg”:
[59082.857111] NVRM: nvCheckOkFailedNoLog: Check failed: Out of memory [NV_ERR_NO_MEMORY] (0x00000051) returned from _memdescAllocInternal(pMemDesc) @ mem_desc.c:1353
[59082.871729] NVRM: faultbufCtrlCmdMmuFaultBufferRegisterNonReplayBuf_IMPL: Error allocating client shadow fault buffer for non-replayable faults
[59083.013898] NVRM: nvCheckOkFailedNoLog: Check failed: Out of memory [NV_ERR_NO_MEMORY] (0x00000051) returned from _memdescAllocInternal(pMemDesc) @ mem_desc.c:1353
[59083.028519] NVRM: faultbufCtrlCmdMmuFaultBufferRegisterNonReplayBuf_IMPL: Error allocating client shadow fault buffer for non-replayable faults
[59083.568050] NVRM: nvCheckOkFailedNoLog: Check failed: Out of memory [NV_ERR_NO_MEMORY] (0x00000051) returned from _memdescAllocInternal(pMemDesc) @ mem_desc.c:1353
[59083.582684] NVRM: faultbufCtrlCmdMmuFaultBufferRegisterNonReplayBuf_IMPL: Error allocating client shadow fault buffer for non-replayable faults
[59083.638931] NVRM: nvCheckOkFailedNoLog: Check failed: Out of memory [NV_ERR_NO_MEMORY] (0x00000051) returned from _memdescAllocInternal(pMemDesc) @ mem_desc.c:1353
[59083.653570] NVRM: faultbufCtrlCmdMmuFaultBufferRegisterNonReplayBuf_IMPL: Error allocating client shadow fault buffer for non-replayable faults
[59084.839297] NVRM: nvCheckOkFailedNoLog: Check failed: Out of memory [NV_ERR_NO_MEMORY] (0x00000051) returned from _memdescAllocInternal(pMemDesc) @ mem_desc.c:1353
[59084.853921] NVRM: faultbufCtrlCmdMmuFaultBufferRegisterNonReplayBuf_IMPL: Error allocating client shadow fault buffer for non-replayable faults
A restart of the Ollama container was not enough to find a functional card. I had to restart the NAS.
Since the reset, I have finally been able to properly install a VM, without any error in the virtual switch.
But this undeniably leads to a waste of time, and backups must be managed properly.
During my research this weekend to get my graphics card to work, I came across this post; I have a limited desire to follow its recommendations: Getting GPU-Accelerated PaddlePaddle Working in Docker on QNAP NAS
Unless QNAP improves the sitation