GPU for AI Qumagie etc

English Compatibility
1

Hi, I have tried rtx 3060 and rtx 1070 and qnap shows it, but can’t get to utilize it for AI Qsirch a d Qmagie. I am about to order a rtx 2000 ADA, but I want to make sure it will work and. We run TS-2888x. Anyone here can advise?

Thanks,

Hrvije

2

Hi Hrvije,

QuMagie: does not yet support external graphics card acceleration.

Qsirch: the latest LLM w/ RAG can support on-premise graphics card. Can you updated to the latest QTS version.

Qsirch 5.6.0 (or later)

  • 64-bit x86 and 64-bit ARM-based NAS

  • QTS 5.0.1 (or later) or QuTS hero h5.0.1 (or later)

  • Minimum 2GB RAM (4GB RAM recommended for optimum performance.)

AI-powered enterprise search with RAG | QNAP

NVIDIA 2000 ADA is soon to be EOL in few months and replaced by RTX Pro 2000 Blackwell.

The current NVIDIA GPU Kernel Driver v5.2.9.3451 Build 20260327 does not yet support RTX Pro 2000 Blackwell. We’re working on the new driver and will be testing RTX Pro 2000 Blackwell for TS-2888X later for compatibility.

3

Hello Hrvije

Also could you please check those setting below ?

  1. Control Panel → Hardware → Hardware Resource
    Please choose “QTS Mode” if you need to accelerate in RAG search

image
image1920×869 190 KB

  1. The screen shot or information in Qsirch setting page
    For my example, it shown LLM Core is missing
    image
    image1920×843 146 KB
4

Hi,

Thanks for your answer. I have tried 3060 rtx and 1070 and it shows there, but I can’t asign it to any app. I have ordered P2200, which I believe should work out of the shelf.

Thanks,

Hrvoje

5

I did what you said, and turned it to QTS mode, but Qmagie or Qsirch use the GPU, only the CPU. Is that due to 1070 and 3060 aren’t on the comp list?

6

Hi Hrvoje

Could you please confirm the version of the NVIDIA driver on your machine?

image
image1920×856 172 KB

7

01
011075×703 85.3 KB

8

Hi Hrvoje

So can you see this page in Qsirch ?

image
image1920×843 146 KB

image
image2544×1080 239 KB

9

Yes, I got it to work. But shouldn’t gpu be set to QTS mode for AI work? Will there be any benefit to using P2200 wuadro vs 1070/3060?

01
011062×1231 141 KB

10

It looks great. You can choose some small LLM models to test, such as Qwen3.5 4B or Gemma3 1B.

Also, I think the RTX 3060 is better for AI or LLM tasks.

11

Thanks! So P2200 will not help?

12

Also, in the QuMagie AI features, it says that Object Recognition uses GPU, but it doesn’t. How can I make it use the GPU to speed things up?

13

A 2022 ADA Gen GPU is EOL? It’s still or sale in brand new DELL workstations… are you sure it’s not just end of sale/production ?

I know they put non RTX cards (1080TI for instance) on the EOL life-cycle, but that card is 9 years old

14

NVIDIA Quadro P2200 is also working but I compare their spec, I think RTX 3060 is much better for AI because newer GPU architecture & higher GPU freq & more VRAM.

15

RTX 2000 Ada isn’t EOL yet, but soon. So if you can wait a few more months, I think the new generation of Blackwell is better cost-effective.

16

Hi Hrvoje

One possibility is that QuMagie limits the number of submissions for this part to avoid impacting system operation. Since your machine’s performance is so high that the system’s processing speed far exceeds the QuMagie submission speed, it might not be immediately apparent that the GPU is being used.

To confirm this hypothesis, I suggest submitting a request to our HelpDesk so our R&D team can further investigate.

https://www.qnap.com/en/how-to/tutorial/article/how-to-use-the-helpdesk-app-to-solve-issues-and-provide-feedback

17

Hi,

How are you getting GPU to work with Qsirch for RAG search?
My NAS is TS-873A with QuTS Hero 5.2.9 and has RTX3050 6G set in QTS mode (as per your screenshots), but Qsirch insists that the GPU must be set to Container Station mode. If I set my only GPU to the Container mode, I will lose it everywhere else (hardware transcoding, etc.).
All apps and firmware are on their latest versions.

image
image812×460 99 KB

image
image1197×368 79.2 KB