Delete registry ... to install the program later on, you can leave the remnants of the removed app. That's because future installations of the program could use the data—they don't have to start from ...

Windows won't let you delete, move, or rename a file if a program is using it. Frustratingly, it also won't tell you which program is using the file so that you can solve the problem.