Have you setup the Kasm Server aspect[0]. That is, not just the container workspace, but you can have Kasm connect to a separate actual server via RDP, or VNC; not a docker container workspace. In this manner, Kasm has completely replaced Guacamole for me.
[0] https://kasmweb.com/