Apple
Designing voice-first experiences at scale
Overview
As voice interfaces began emerging as a new way for users to interact with technology, Apple faced the challenge of creating experiences that felt natural, intuitive, and useful across a growing ecosystem of devices.
Working across product, UX, and engineering teams, we contributed to initiatives focused on how users communicate with voice-driven systems, how requests are interpreted, and how information is returned across mobile, desktop, tablet, and wearable experiences.
The work helped establish foundational patterns for voice interactions that would influence how users engage with intelligent assistants across the Apple ecosystem.
The challenge
Traditional software relies on buttons, menus, and navigation. Voice introduces an entirely different challenge: users can ask the same question in dozens of different ways while expecting a single, accurate outcome.
The team needed to determine how users naturally phrase requests, how intent should be interpreted, how responses should be structured, how interactions differ across devices, how users recover when a request fails, and how information should be presented within Apple's ecosystem — work that required close collaboration across product, UX, engineering, and research.
Our approach
Understanding human language
Studied how users naturally asked questions and requested actions, designing for intent rather than rigid command structures.
- Common request patterns
- Variations of the same intent
- User expectations and failure scenarios
- Opportunities to simplify interactions
Intent & command architecture
Helped establish frameworks that mapped many different phrasings to the same outcome — flexible, natural interactions with a consistent experience.
Data & response workflows
Designed the workflows behind every answer, so the experience stayed consistent no matter how a user interacted.
- How requests were processed
- How data was retrieved and structured information interpreted
- How responses were generated
- How users received answers across devices
Multi-device experience design
Made voice interactions feel natural across very different environments, each with its own context, screen size, and input methods.
- Mobile devices
- Tablets
- Desktop systems
- Wearable technology
Prototyping & validation
Rapidly tested concepts through iterative prototyping and staged rollouts, improving usability and reliability by continuously learning.
- Validate assumptions early
- Identify failure points
- Improve response quality
- Gather real-world user feedback
Results
- Voice-first interaction design
- Intent recognition workflows
- Multi-device user experiences
- Structured response systems
- User research and validation
- Cross-functional product development
The bottom line
The project demonstrated how product, UX, and engineering teams can work together to transform complex technical capabilities into experiences that feel simple and intuitive for users — scalable voice frameworks supporting a wide range of requests across devices.
Why it matters
Building AI-powered experiences requires more than machine learning models. Success depends on understanding user behavior, designing effective workflows, validating assumptions, and creating systems that scale across products and platforms.
The Apple engagement demonstrated the value of multidisciplinary teams working across research, product strategy, user experience, and engineering to bring emerging technologies to market.
This is the same philosophy behind Jetty Logic today: bringing product, design, engineering, and AI expertise together to transform complex technology into usable customer experiences.
Want this kind of pod on your team?
Book a discovery sprint and we'll map the highest-leverage place for senior engineers to plug in.