This is a bug on Plex side, ExoPlayer download in chunks and may trigger multiple connections, Plexamp use another system.
Unfortunately this is not API based to appear there, so I do not think there’s an API to remove from there. The app just access a download url then can cancel the download. Plex does not detect that the url is no more accessed and do not remove it.