Yes, that is one of the use cases for the product. You would use the Serial Bridge profile.
You could just set one end as A TCP sever and one end as TCP client which is all serial bridge does anyway.
Having them on the same L2 network will make things easy too.
Also, note that some serial products do not handle the few ms latency that adapters like these introduce so keep that in mind when fault finding.