# Hand Tracking

> A headset that sees your hands. You tap and pinch with no controller.

**Field:** Design  
**Category:** 3D & Immersive  
**Also known as:** Hand Tracking (XR), Controller-Free Input, Hand Input

## Think of it like

It is like a mirror that copies your hands. Then you can touch things in a game.

## Definition

Hand tracking lets a headset see your hands and use them as input. Cameras watch your hands and work out where each finger joint is. You can then poke, pinch, grab and swipe with no controller. A pinch often works like a click. It feels natural, but there is nothing to feel when you touch, and hands can be out of the cameras' view.

## Example

In Emma's design app, a pinch picks a color and a pull stretches a box. Nobody needs a manual to try it.

## Why it matters

It removes the controller, so new users start at once. It also changes how big and how near buttons must be.

## Common mistake

Making small buttons that need exact taps. Hands shake and there is no touch feedback, so make targets large.

## Three principles

- **Cameras see hands.** Every finger joint is tracked.
- **Pinch to click.** Simple, common gestures.
- **Big targets.** No touch, so allow for shake.

## Related terms

- [Passthrough](https://learn.benibix.com/term/design/passthrough)
- [Head-Mounted Display (HMD)](https://learn.benibix.com/term/design/head-mounted-display)
- [Spatial Design](https://learn.benibix.com/term/design/spatial-design)
- [Mixed Reality (MR)](https://learn.benibix.com/term/design/mixed-reality)
- [Touch Target Size](https://learn.benibix.com/term/design/touch-target-size)

![A headset seen from the side. Cameras on its front point at the room, and the room appears on the screen inside. Cameras on its underside point down at a hand, with dots on each finger joint and a pinch marked as a click.](https://learn.benibix.com/diagrams/des5-headset-sensing.svg)

---

Source: https://learn.benibix.com/term/design/hand-tracking
Author: Behnia Zarei (a developer in Vienna, Austria, who builds and teaches data, AI and business intelligence at BENIBIX)
Publisher: BENIBIX Learn (https://learn.benibix.com/)
Last updated: 2026-11-17
Licence: CC BY 4.0 (https://creativecommons.org/licenses/by/4.0/). Quote freely with attribution.
