Change the X to whatever button number you want each button to be. For example, my enable hotkey button is “8” which is my SELECT button on my PS2 controller, and my menu_toggle_btn is “4” which corresponds to my L2 button. This means that when i hold SELECT and then press L2 at the same time, the RetroArch options menu comes up. Under the Video section, you can change your screen rotation on the fly.
Additionally, for a bit of extra functionality you can also use the line
input_exit_emulator_btn = “X”
This will allow you to hold your hotkey then press another designated button to quit your ROM and go back to the frontend.
I can’t say wether it will or won’t for definate because i simply do not use vice on my particular build. However, what i can say is that the RetroArch config menu works in everything on my unit, including Cave Story. This leads me to believe its a universal menu and operates independantly of the actual emulator itself.
Either way, you’re just going to have to try it and find out that way. It’s not like its going to do any harm to your unit if it doesnt, just add functionality to your other emulators.
Could you post you .cfg file online or attache it somehow so I could take a look. I did try what you said but it didn’t work. I would like to see how you have yours configured. I did set the rotation by 90 in the file for the video and it did flip the display but only for cave story.