Apple launches study to test AI health tool accuracy
Apple is partnering with OpenEvidence to study how 200,000 people interact with AI-generated medical information.

The short version
- The study involves up to 200,000 U.S. participants aged 21 and older.
- Participants will rate AI responses on accuracy, detail, and relevance.
- The app provides links to peer-reviewed clinical sources for every answer.
- Data collected from the study will not be used to train AI models.
Why it matters
This research helps determine if AI can provide safe, reliable health information to the general public. It sets a framework for how tech companies might balance personalized health data with clinical accuracy.
A new approach to health AI
Apple has officially launched a new research initiative called the Apple Health AI Usage Study. The company wants to gain a deeper understanding of how people actually interact with conversational AI tools when they have questions about their health. By observing these interactions, Apple hopes to learn how useful and helpful the AI's responses truly are in real-world scenarios.
To ensure the information provided is reliable, Apple is collaborating with OpenEvidence. This is a clinical AI platform that healthcare professionals use to find medical information. The platform generates answers based on high-quality sources, such as the New England Journal of Medicine, rather than general internet data.
The primary goal of this project is to improve the design and functionality of AI-powered health tools. Apple wants to ensure that these technologies can deliver health information that is not only accurate but also easy for everyday users to understand and act upon. As Sumbul Desai, MD, Apple’s vice president of Health and Fitness, noted, the study is a way to understand how people evaluate health AI in everyday life.
How the study works
Participants in the study will use a dedicated iOS app to ask various health-related questions. Once the AI provides a response, the users will be asked to rate that answer based on specific criteria. These criteria include how accurate the information is, how much detail it provides, and how relevant it is to the user's specific query.
The app is designed to provide easily understandable responses that include links to peer-reviewed clinical sources. This allows users to verify the information provided by the AI against established medical literature. While the app supports text-based prompts and allows for dictation via the iOS keyboard, it is not integrated with Siri or Apple Intelligence.
To participate, users must be at least 21 years old and based in the United States. The app requires an iPhone 15 Pro running iOS 26 or later to function. Although it does not use Apple Intelligence, the hardware and software requirements ensure a consistent experience for the 200,000 people Apple is looking to enroll.
Personal data and privacy
During the enrollment process, participants are given the option to share their Apple HealthKit data with the study. This data can include personal metrics such as physical activity levels, sleep patterns, or clinical lab results. Sharing this information allows the AI to provide responses that include more context about the user's own personal health history.
Apple has emphasized that privacy is a major priority for this research project. The company states that it has taken specific measures to ensure that all user information remains confidential throughout the study. They have also clarified that the data collected from these participants will not be used to train any AI models.
By keeping the data separate from model training, Apple aims to build trust with users who may be hesitant to share sensitive medical information. The focus remains on using the data to improve the tool's ability to provide relevant information rather than expanding the capabilities of the underlying technology for other purposes.
The path toward trusted tools
The insights gathered from this study are intended to advance the broader scientific conversation regarding health technology. By collecting feedback from a large group of people, Apple can identify where AI tools succeed and where they fall short in communicating complex medical topics. This feedback loop is essential for creating tools that feel safe and reliable for the general public.
The study represents a move toward more
Enrollment and hardware requirements
The study is currently open for enrollment, and Apple is seeking up to 200,000 people to contribute to the research. Interested participants can download the new app now to begin the process. The app provides a structured way for users to interact with the AI and provide the necessary ratings to help the company evaluate the tool's performance.
To be eligible for the study, participants must be at least 21 years old and reside in the United States. While the application does not utilize Apple Intelligence, it does have specific hardware requirements. Users must have an iPhone 15 Pro running iOS 26 or later to participate in the research and access the app's features.
Scientific rigor and clinical grounding
Apple is framing this initiative as a commitment to responsible innovation. According to Sumbul Desai, MD, Apple’s vice president of Health and Fitness, the company believes that progress in this field must start with scientific rigor and clinical grounding. This approach ensures that the technology is developed with a focus on safety and medical accuracy.
The ultimate goal of the study is to contribute to a broader scientific conversation about how technology and health intersect. By gathering these insights, Apple aims to ensure that as technology continues to evolve, they can build trusted tools. These tools are intended to genuinely support people on their personal health journeys by providing reliable information.
Sources and links
- ReportingThe Verge: the article we sourced
Liked it? Say why
Add a line for other readers.
No account needed. We never show your email. Comments with links, ads or abuse are held and not shown. Your comment shows after a quick check.
Listen to the AI Wire headlines
Listen to the AI WireListen to our daily AI shows every morning: on your commute, in the shower, wherever you are
Listen to the daily showsFirst reported by The Verge · Read the original. Written by the SI Agent News Desk from the reporting above.Written with AI from the source above. Every number is checked against the source. Spot a mistake? Corrections.
