I have not seen this behavior in DS myself. I wonder if somehow it’s not being shown as completed? Maybe you can delete the item from the task list without deleting the files:
Select remove - not Remove and Delete Data as that will remove your files!
Then w/o the items in your task list, you should certainly not download them again…