Manual Deskterity: An Exploration of Simultaneous Pen + Touch Direct Input
Manual Deskterity is a prototype digital drafting table that supports both pen and touch input. We explore a division of labor between pen and touch that flows from natural human skill and differentiation of roles of the hands. We also explore the simultaneous use of pen and touch to support novel compound gestures. We advocate a division of labor between pen and touch: the pen writes, touch manipulates, and the combination of pen+touch yields new tools. This articulates how our system interprets unimodal pen, unimodal touch, and multimodal pen + touch inputs, respectively. We contribute novel pen + touch gestures that leverage the strengths of both pen and touch; utilizing both modalities to complement one another also enables us to largely sidestep the weaknesses inherent in each modality as well.
Microsoft Surface Tablet PC pen touch multi-touch ink drafting table Research handwriting notebook gesture input sketching drawing content creation Ken Hinckley
