User Interaction Methods and Digital Interactivity
How Users Communicate with Devices
Every time you tap a screen, speak a command, click a mouse button or press a key, you are using an interaction method — a way of sending instructions to a device. The exam requires you to know the five named interaction methods, their advantages and disadvantages, and which contexts each one suits. This topic is one of the least well-answered despite the methods being listed directly in the specification. This lesson treats them as the central topic and builds in the vocabulary to justify each choice in a scenario.
The Five User Interaction Methods
Gesture input uses finger movements on a touchscreen — swiping, pinching, tapping, holding and rotating. It is fast and intuitive for experienced users, enables natural manipulation of content (zoom, rotate, pan), and requires no separate input device. Disadvantages: it requires a touchscreen, it can be inaccurate for users with motor impairments, and gestures that are not visible or labelled (such as a three-finger swipe) can be difficult to discover or learn.
Keyboard input is fast and accurate for text entry and commands. Touch-typists can enter text much faster than any voice or gesture method. Keyboards support shortcuts (copy, paste, undo) that speed up workflows significantly. Disadvantages: keyboards usually need a stable surface; they are unsuitable in hands-free contexts (cooking, surgery, driving) or when sterile conditions must be maintained (an operating theatre touchscreen is cleanable; a keyboard collects bacteria in the gaps between keys).
Mouse input offers high precision — a skilled user can click tiny interface elements accurately, making it ideal for complex desktop software such as graphic design tools or data analysis dashboards. Disadvantages: a mouse requires a flat surface, a desk and a trained hand. It is less suitable for portable or on-the-move devices and may be inconvenient where an interface is designed for direct touch.
Touch input uses finger contact with a touchscreen. It is direct and intuitive — tapping an icon feels like physically pressing a button. Touch is the dominant interaction method on smartphones and tablets. Disadvantages: it requires a clean surface and clean dry hands to register accurately; it can leave fingerprints on the screen; small interface elements are hard to tap precisely; and prolonged touch interaction on a vertical screen (such as a smartboard) causes arm fatigue.
Voice input allows hands-free control — ideal for contexts where the user cannot or should not look at or touch a screen. A driver asking a navigation system for directions, a chef asking a smart speaker for a timer, or a surgeon requesting data in an operating theatre all benefit from voice interaction. Disadvantages: voice input is unreliable in noisy environments (a busy restaurant, a factory floor), can raise privacy concerns (the device must always be listening for a wake word), and may not work well for users with accents, speech impairments or quiet voices.
The five user interaction methods are: gesture (touchscreen, natural but requires touch hardware), keyboard (fast text entry, unsuitable hands-free), mouse (precise, requires flat surface), touch (direct, intuitive, small targets imprecise), voice (hands-free, unreliable in noisy environments). Context determines which is most suitable — there is no single “best” method.
Exam questions give a context and ask you to select and justify an interaction method. Work through the constraints of the scenario. An ATM in a public space: touch is suitable (direct, single-purpose task, no keyboard needed for PIN if a numerical touchpad is used); voice is unsuitable (public setting, privacy risk, noisy environment). A kitchen smart speaker: voice is ideal (cook’s hands may be wet or covered in food, eyes focused on the cooking); touch or gesture are unsuitable for the same reason. A graphic design workstation: mouse is best (pixel-level precision needed for editing); touch is unsuitable (not accurate enough for fine manipulation). A hospital patient kiosk: touch is suitable (simple form-based interaction, no keyboard needed); gesture may be unsuitable if the patient has motor impairments — large buttons suit this context better.
The Internet of Everything (IoE) — Digital Interactivity
The Internet of Everything (IoE) connects not just computers and phones but everyday physical devices — smart bulbs, fitness trackers, industrial sensors, cars, fridges — to the internet and to each other. The spec requires you to know two types of IoE digital interactivity: device-to-device and human-to-device.
Device-to-device interactivity (also called machine-to-machine, or M2M) is communication between devices without human involvement. A fitness tracker automatically sends step count and heart rate data to a smartphone app. A smart thermostat detects that the house is empty using a linked door sensor and adjusts the heating automatically. A factory machine reports its performance data to a central monitoring system every few seconds. The human set up the system originally, but the ongoing data exchange is automatic.
Human-to-device interactivity in the IoE is when a person directly controls or communicates with a connected device. Asking a smart speaker to play music, unlocking a smart lock via a smartphone app, or adjusting the temperature on a smart thermostat using a voice command are all examples. The interaction uses the five methods covered earlier — voice, touch, gesture — but the device is part of the wider IoE network rather than a standalone computer.
The spec also requires you to know how digital devices in the IoE can be tailored to meet the needs of the end user. This links back to the accessibility demographics from Lesson 11. Examples: a smart TV can be configured to display larger subtitles for a hard-of-hearing user; a smart speaker can be set to respond more slowly and clearly for users with cognitive processing needs; a wearable medical monitor can alert a caregiver automatically when a reading goes outside a safe range (device-to-device), removing the need for the patient to remember to check a screen.
Tailoring might also mean physical adaptations: a large-button TV remote for users with reduced dexterity, voice-only control for users who cannot use their hands, or haptic feedback (vibration) for users who are visually impaired and cannot see on-screen confirmation of an action.
Device-to-device (M2M): automated data exchange between connected devices with no human involvement — e.g. fitness tracker syncing data to a phone app. Human-to-device: a person directly controls or communicates with a connected IoE device — e.g. using a smartphone app to unlock a smart lock.