PressPen
PressPen is a 3D input stylus combining pressure measurement and computer vision pose tracking algorithm. With the development and commercialization of AR/VR technology, various companies have distributed a variety of 3D input devices while developers have developed a large amount of interactive applications for them. However, there are two defects of present 3D input devices: 1. Complexity in setting up a working space; 2. Unclearness in expressing the intensity of user intension. From the perspective of those disadvantages, the work proposed PressPen, which use single web camera to track the position and rotation of the stylus, which allow users set up working space easily, and is embedded with a Bluetooth pressure sensor, which allows user intension determination.
To be more specific, to track the pose of the pen, a combination of approximate pose estimation (APE) and inter-frame corner tracking (ICT) is used in the tracking algorithm. Then the C++ algorithm is exported to be used in C# (Unity3d). As for pressure measurement, Unity3d use Bluetooth interface to obtain the pressure data transmitted from pen, which measures pressure by pressure sensor and broadcast it with Bluetooth module. Integrating both pose tracking and pressure measurement, PressPen library provides developers APIs to obtain pose and pressure value information of every frame. What’s more, the work contains two interactive applications to demonstrate the functionality of PressPen.
Source Code: https://github.com/neconeconeco/PressPen