What we did:We built Itsy-Bits, a fabrication pipeline for 3D printing and recognizing tangibles on capacitive touchscreens with a footprint as small as a fingertip.
What we found:We found that Itsy-Bits can reliably identify and locate multiple 3D-printed shapes in different sizes with a shape accuracy of 95.63% and a mean rotation error of 6.53°.
Takeaway:Our approach enables the creation of highly individualized tangible user interfaces, enhancing interaction on the most common form factors of touchscreens.
Abstract
Tangibles on capacitive touchscreens are a promising approach to overcome the limited expressiveness of touch input. While research has suggested many approaches to detect tangibles, the corresponding tangibles are either costly or have a considerable minimal size. This makes them bulky and unattractive for many applications. At the same time, they obscure valuable display space for interaction. To address these shortcomings, we contribute Itsy-Bits: a fabrication pipeline for 3D printing and recognition of tangibles on capacitive touchscreens with a footprint as small as a fingertip. Each Itsy-Bit consists of an enclosing 3D object and a unique conductive 2D shape on its bottom. Using only raw data of commodity capacitive touchscreens, Itsy-Bits reliably identifies and locates a variety of shapes in different sizes and estimates their orientation. Through example applications and a technical evaluation, we demonstrate the feasibility and applicability of Itsy-Bits for tangibles with small footprints.
Video
Playing videos on this website requires sharing information with YouTube and
accepting cookies.
We built Trilaterate, a fabrication pipeline that enables users to 3D print custom objects capable of detecting hover, touch, and force interactions through embedded capacitive sensors.
We designed and built two interaction concepts, Bring Your Own Information and Bring Your Own Tool, utilizing 3D printed tangible objects for enhanced interaction on touch-enabled surfaces.