SI Agent News
ConfirmedResearch

Apple launches study to test AI health tool accuracy

Apple is partnering with OpenEvidence to study how 200,000 people interact with AI-generated medical information.

Ink and watercolour: picture for the story 'Apple launches study to test AI health tool accuracy'
AI-made ink and watercolour for this story. No real people or products are shown.
200,000total study participants

The short version

Why it matters

This research helps determine if AI can provide safe, reliable health information to the general public. It sets a framework for how tech companies might balance personalized health data with clinical accuracy.

A new approach to health AI

Apple has officially launched a new research initiative called the Apple Health AI Usage Study. The company wants to gain a deeper understanding of how people actually interact with conversational AI tools when they have questions about their health. By observing these interactions, Apple hopes to learn how useful and helpful the AI's responses truly are in real-world scenarios.

To ensure the information provided is reliable, Apple is collaborating with OpenEvidence. This is a clinical AI platform that healthcare professionals use to find medical information. The platform generates answers based on high-quality sources, such as the New England Journal of Medicine, rather than general internet data.

The primary goal of this project is to improve the design and functionality of AI-powered health tools. Apple wants to ensure that these technologies can deliver health information that is not only accurate but also easy for everyday users to understand and act upon. As Sumbul Desai, MD, Apple’s vice president of Health and Fitness, noted, the study is a way to understand how people evaluate health AI in everyday life.

How the study works

Participants in the study will use a dedicated iOS app to ask various health-related questions. Once the AI provides a response, the users will be asked to rate that answer based on specific criteria. These criteria include how accurate the information is, how much detail it provides, and how relevant it is to the user's specific query.

The app is designed to provide easily understandable responses that include links to peer-reviewed clinical sources. This allows users to verify the information provided by the AI against established medical literature. While the app supports text-based prompts and allows for dictation via the iOS keyboard, it is not integrated with Siri or Apple Intelligence.

To participate, users must be at least 21 years old and based in the United States. The app requires an iPhone 15 Pro running iOS 26 or later to function. Although it does not use Apple Intelligence, the hardware and software requirements ensure a consistent experience for the 200,000 people Apple is looking to enroll.

Personal data and privacy

During the enrollment process, participants are given the option to share their Apple HealthKit data with the study. This data can include personal metrics such as physical activity levels, sleep patterns, or clinical lab results. Sharing this information allows the AI to provide responses that include more context about the user's own personal health history.

Apple has emphasized that privacy is a major priority for this research project. The company states that it has taken specific measures to ensure that all user information remains confidential throughout the study. They have also clarified that the data collected from these participants will not be used to train any AI models.

By keeping the data separate from model training, Apple aims to build trust with users who may be hesitant to share sensitive medical information. The focus remains on using the data to improve the tool's ability to provide relevant information rather than expanding the capabilities of the underlying technology for other purposes.

The path toward trusted tools

The insights gathered from this study are intended to advance the broader scientific conversation regarding health technology. By collecting feedback from a large group of people, Apple can identify where AI tools succeed and where they fall short in communicating complex medical topics. This feedback loop is essential for creating tools that feel safe and reliable for the general public.

The study represents a move toward more

Enrollment and hardware requirements

The study is currently open for enrollment, and Apple is seeking up to 200,000 people to contribute to the research. Interested participants can download the new app now to begin the process. The app provides a structured way for users to interact with the AI and provide the necessary ratings to help the company evaluate the tool's performance.

To be eligible for the study, participants must be at least 21 years old and reside in the United States. While the application does not utilize Apple Intelligence, it does have specific hardware requirements. Users must have an iPhone 15 Pro running iOS 26 or later to participate in the research and access the app's features.

Scientific rigor and clinical grounding

Apple is framing this initiative as a commitment to responsible innovation. According to Sumbul Desai, MD, Apple’s vice president of Health and Fitness, the company believes that progress in this field must start with scientific rigor and clinical grounding. This approach ensures that the technology is developed with a focus on safety and medical accuracy.

The ultimate goal of the study is to contribute to a broader scientific conversation about how technology and health intersect. By gathering these insights, Apple aims to ensure that as technology continues to evolve, they can build trusted tools. These tools are intended to genuinely support people on their personal health journeys by providing reliable information.

Sources and links

Liked it? Say why

Add a line for other readers.

No account needed. We never show your email. Comments with links, ads or abuse are held and not shown. Your comment shows after a quick check.

Listen to the AI Wire headlines

Listen to the AI Wire

Listen to our daily AI shows every morning: on your commute, in the shower, wherever you are

Listen to the daily shows

First reported by The Verge · Read the original. Written by the SI Agent News Desk from the reporting above.Written with AI from the source above. Every number is checked against the source. Spot a mistake? Corrections.

More AI news