Hi @kulwik,
I'm glad I was able to help you solve this issue. The best way to rotate the controller only is to select the controller and switch the manipulation mode to 'rotate' and it should have some handles that allow you to rotate the controller to your desired orientation.
Best,
El