Right now, it’s only possible to use the controller from the VR set. But I noticed a latency in the use of these controllers with the Oculus Quest.

With a support for xbox or ps controllers, that would reduce the latency (I notice a real difference in games support both the Touch and Xbox controller).