You can already remove media from the library via 3 dots then hide from library.
Duplicate handling is hard without proper hashes and even more when dealing with multiple providers and choosing the one to use to play.
But you do not need to have them duplicate, you remove the local copy and use offline cache in Symfonium to be able to play them when offline.
This simplifies everything a lot.