Consistent input controls design

[tracygardner]

Consistent input controls design: Shared behaviour patterns across keyboard, touch and controllers.

• Refactor and improve existing input handing for buttons
• Clickable object discovery on mobile/touch/keyboard. You get a cursor change on desktop but this isn't visible to other users. Interactable icon added to closest interactable object for free camera and player following camera.
• On click behaviour for games controllers? Should this be like E in some platforms where getting close to an object pops up an option. Should we map to an existing key so it works with one of the game controller buttons? Key mappings
• On click behaviour for keyboard users. Do they need a way to move the cursor or an alternative like E? Went with an alternative like E to avoid the need to have a cursor in the center of the screen.
• Refactor and improve existing camera behaviour
• Moving the babylon js camera when on touchscreen. Add buttons for full interaction. (Page up / down etc on desktop)
• Test adaptive input devices

[tracygardner]

Now you can control the camera with the onscreen buttons in with the default camera. Previously this required keyboard shortcuts and you could only rotate the camera on mobile.

[tracygardner]

The fly camera is available on mobile with the touch controls. You can detach the camera from the player with the gizmo and fly around.

[tracygardner]

A new input manager handles inputs and actions for all inputs (mouse, keyboard, touch, games controller, XR) making it easier to make things consistent.

[tracygardner]

Default inputs are consistent across input devices to make the camera control make sense with the on screen buttons.

Button 1/1/R/Triangle/Y (camera up)
Button 2/2/E/Circle/B (interact)
Button 3/3/F/ Square/X (camera down)
Button 4/4/Space/Cross/A (no default mapping)

R is above F on a keyboard. Triangle is above Square is PS controller. Y is above X on Quest XR controller.

[tracygardner]

An icon shows when near the nearest interactable object in view. Placeholder icon design to be refined later.

[tracygardner]

Interact behaviour added for Button 2/2/e/gamepad circle/XR button B. Actvities the interactable object that currently has an interaction icon.