You're not missing anything. You're trying to do something that is not "normal" by design.
As a rule, USB devices can only be monitored from the system they are installed on. There are ways, but I need to understand your exact needs. Would remote desktopping into that system from the remote system be sufficient for you?