mediapipe - How to Implement System-Wide Hand Tracking on Android Using Snapdragon XR1? - Stack Overflow

I am working on a project to replace touch input with hand tracking for system-wide interactions (e.g.,

I am working on a project to replace touch input with hand tracking for system-wide interactions (e.g., scrolling, swiping, opening apps) on an Android device powered by Snapdragon XR1. I want to enable this functionality at the system level, so it works on the home screen and across all apps, not just within a specific application.

What I Want to Achieve:

  • Detect and track hand movements using the device's camera.
  • Map hand gestures to system input events (e.g., swipe, scroll, tap).
  • Inject these input events into the Android system so they can be recognized by the home screen and other apps.

I’ve looked into using a foreground service to handle hand tracking in the background, but I’m unsure which layer of the Android architecture (e.g., HAL, Linux Kernel, or Android Framework) would be the most appropriate for this implementation. I’m confused about whether to:

  • Modify the Android Framework Layer to create a custom system service.

  • Work at the HAL Layer for hardware-specific optimizations (e.g., using Snapdragon XR1's DSP/GPU).

  • Modify the Linux Kernel Layer for low-level hardware access.

发布者:admin,转转请注明出处:http://www.yc00.com/questions/1745264625a4619380.html

相关推荐

发表回复

评论列表(0条)

  • 暂无评论

联系我们

400-800-8888

在线咨询: QQ交谈

邮件:admin@example.com

工作时间:周一至周五,9:30-18:30,节假日休息

关注微信