Clicking App Designer buttons with a separately (non-mouse) controlled cursor?

I am making an app in App Designer that involves a user initiating the program and controlling its settings with a mouse, but once the active phase of the program starts they will be clicking on boxes with a flight stick. During this phase the flight stick will be controlling a custom 'cursor' that is separate from the mouse cursor. The boxes change position on the screen, so retrieving their position and using that to calculate their dimensions on the screen to interact with the custom cursor will be challenging, but possible. I am looking for a cleaner solution.

Is there any way to 'splice' into the Button_Pushed events that the pre-built buttons in App Designer have with a non-mouse activator that is still constrained by the GUI of said button?

Answer 1

[Amit Dhakite]

Hi Thomas,

As per my understanding, you want to get hold of “Button_Pushed” events with a non-mouse activator such as a flight stick.

The built in buttons responds to the mouse events, but not for the non-mouse activators. However, there are few workarounds you can try:

1. Add a button in the app designer, and in its callback, try to read the values of the flight stick. After reading the values of the flight stick, you can perform the necessary actions.
2. If you don't want to click on a button, you can use "timer()" function to continuously check the inputs from the flight stick, and once you get the desired input from the flight stick, you can perform the necessary actions.

For further information about “timer()” function, kindly refer to the following link:

https://www.mathworks.com/help/matlab/ref/timer.html