Now You Can Run OpenAI’s Whisper on Apple Watches

Argmax released WhisperKit, a software package which enables OpenAI's Whisper speech recognition model to operate on Apple Watches. This integration leverages Apple's CoreML framework, making it possible to use Whisper on other Apple devices using the framework.

The software facilitates the implementation of speech recognition in WatchOS applications by harnessing the Apple Neural Engine for real-time voice data processing. Released under the MIT license, WhisperKit is designed for systems running macOS 14.0 or later and Xcode 15.0 or later. 

Developers can incorporate WhisperKit into their Xcode projects, offering flexibility with audio formats and model selection. Another user went ahead and integrated the Whisperkit with his Vision Pro headset to transcribe his voice. 

Founded in 2020, Argmax Inc. specializes in fields like Natural Language Processing, Recommendation Systems, and Computer Vision. WhisperKit stands as an open-source project, encouraging contributions from developers to enhance its functionality and adaptability.

By making WhisperKit available, Argmax aims to broaden the accessibility of speech recognition technology across Apple's ecosystem, facilitating its integration into applications.

Recent work has advanced the use of large language models on devices such as Apple Watches, aiming for local processing of complex tasks. This approach aims to decrease latency, improve privacy, and enhance user interaction. 

Devices like the Rabbit R1 and Humane Ai Pin are notable for integrating AI in distinct ways. The Rabbit R1 uses a model for interfacing directly with user interfaces, while the Humane Ai Pin employs an AI-based operating system for quick service access without needing activation words, focusing on privacy and user initiation. These devices move the use of AI in smaller devices for more tailored and efficient use of the technology.