Controller Integration - Tap Simulation (Android)
I would like to request basic, native Xbox controller integration into the mobile application - the simple tap action is all I am looking for.
I am currently working for ABC Studios International and utilizing Adobe XD to produce the apps which appear within the show. Usually this work would occur in post production, however I am trying to encourage a more active use of this software in my local screen industry.
An example of an application is a simple phone call interaction. The character receives a call, picks up and hangs up. In most cases the talent can simply interact with these applications via touch, however sometimes the phone needs to be triggered externally by a crew member; for instance when they receive a call on their phone which is sitting in their car or on a table or when an action has to occur at the precise moment the director calls for it.
To achieve this I have been connecting an Xbox controller to the mobiles, via Bluetooth, and running a custom string through the Android app 'Automate' which simulates a tap when the 'A' button is pressed.
Unfortunately this is not a fool proof solution, and frequently runs into bugs or crashes. On set conditions change drastically and in most cases I am not the person operating these mobile XD interactions; they are often operated by crew members with little experience with this type of software or technology in general.
Unfortunately if an Adobe XD mobile application doesn't work once or twice out of a hundred times, it will be rejected by the onset crew and labelled 'too hard'. I do not wish to see this happen in my local industry, as it would stop me from using Adobe XD in the future.
If native integration of a simple 'tap' interaction via an Xbox controller was possible, I believe this would eliminate most, if not all, of the issues I am currently having on set.
The show I am working on is now in it's first week of shoot and just moments ago I encountered the first case of my solution not working. Please contact me if possible as I would love to discuss this.
Adobe XD is perfect for this use case in film and tv and has already assisted me on multiple productions. Crew's love it and are excited by the tech when it works. It has allowed us to achieve more sophisticated interactions and visuals already.
Thanks for your time!