Enhancing Autism Research with Apple Vision Pro: Developing Software for Data Collection
Abstract:
Bibliography/Citations:
No additional citationsAdditional Project Information
Project files
Research Plan:
Current research:
Phase 1: Pilot Application Development
Objective:
Develop a pilot application using Apple Vision Pro to collect attention data for analyzing attentional patterns.
Activities:
1.1 Conduct a literature review on attentional patterns in individuals with ASD and the use of technology for data collection.
1.2 Utilize Xcode beta on MacOS to create a test immersive application using SwiftUI and RealityKit, testing it on the Apple Vision Pro device.
1.3 Develop a pilot app specifically designed to measure user attention in a 3D immersive space.
1.4 Collaborate with ASD researchers to design a research experiment aimed at collecting attention data from users.
1.5 Pilot test the application with a small sample of individuals to assess usability and feasibility.
1.4 Refine the application based on feedback and initial testing results.
Further Research:
Phase 2: Algorithm Development
Objective:
Develop algorithms for the classification of attentional patterns using machine learning techniques.
Activities:
2.1 Gather and preprocess attention data collected by the pilot application, collaborating with ASD researchers to obtain data from both ASD patients and normal controls.
2.2 Explore a variety of machine learning algorithms suitable for effectively classifying attentional patterns.
2.3 Train and validate the machine learning models using labeled data acquired from individuals with ASD.
2.4 Evaluate the sensitivity and accuracy of the developed algorithms for diagnosis.
2.5 Conduct a comparative analysis of the results obtained with existing methodologies.
2.6 Prepare and publish reports detailing the findings.
Phase 3: Experiment Design and Collaboration
Objective:
Collaborate with ASD researchers to design experiments utilizing Apple Vision Pro for improving the early diagnosis and classification of ASD.
Activities:
3.1 Establish communication and collaboration with Dr. Xuejun Kong, an ASD investigator from Havard Medical School/ and her research team.
3.2 Integrate findings from Phases 1 and 2 into the experimental design.
3.3 Develop experiments specifically aimed at utilizing Apple Vision Pro to enhance the early diagnosis and classification of ASD, incorporating attentional patterns and spatial data.
3.4 Obtain ethical approvals and permissions necessary for conducting the experiments.
Questions and Answers
Initial project questions
1. What was the major objective of your project and what was your plan to achieve it?
a. Was that goal the result of any specific situation, experience, or problem you encountered?
b. Were you trying to solve a problem, answer a question, or test a hypothesis?
The major objective of my project is to enhance the early diagnosis and classification of ASD by leveraging innovative technology and advanced methodologies, ultimately aiming to help individuals with ASD.
2. What were the major tasks you had to perform in order to complete your project?
a. For teams, describe what each member worked on.
My project comprises three phases, with the current focus on phase one. In this initial phase, the major task is to develop software for the collection of attention data.
3. What is new or novel about your project?
a. Is there some aspect of your project's objective, or how you achieved it that you haven't done before?
b. Is your project's objective, or the way you implemented it, different from anything you have seen?
c. If you believe your work to be unique in some way, what research have you done to confirm that it is?
My project aims to improve the early diagnosis and classification of ASD through the utilization of innovative technology (Apple Vision Pro) and advanced methodologies (machine learning), with the ultimate goal of aiding individuals with ASD. The novelty of my project lies in both its objective and its implementation approach. I achieve this by employing innovative thinking and by adopting a unique approach that, to my knowledge, has not been previously explored. Particularly, the use of Apple Vision Pro, launched in February of this year, represents a novel approach in the field of ASD diagnosis and classification. Extensive research has confirmed the uniqueness of my approach, as there is limited or no existing literature on the utilization of this technology for this specific purpose.
4. What was the most challenging part of completing your project?
a. What problems did you encounter, and how did you overcome them?
b. What did you learn from overcoming these problems?
The most challenging aspect of creating a pilot application in my project was developing the program to collect attention data from Apple Vision Pro. I encountered various obstacles during this process, prompting me to conduct extensive research and experiment with different approaches. Through perseverance and an open-minded approach, I learned the importance of utilizing diverse resources and employing creative thinking to overcome challenges effectively.
5. If you were going to do this project again, are there any things you would you do differently the next time?
If I were to start this project again, I would make a few adjustments to my approach. First, I would prioritize learning Apple Xcode, SwiftUI, and RealityKit, and familiarize myself with Apple programming and testing environments prior to the arrival of Apple Vision Pro. This would allow me to allocate more time to work on the project effectively from the start. Additionally, I would actively seek to enhance collaboration with ASD researchers right from the beginning. Their invaluable insights and expertise could offer valuable guidance and greatly enrich the project's outcomes.
6. Did working on this project give you any ideas for other projects?
Yes, working on this project has sparked ideas for future endeavors. For instance, developing the pilot app for collecting attention data from Apple Vision Pro has led me to explore immersive technology applications in education and therapy for individuals with ASD. I'm now considering projects for interactive educational tools and therapeutic interventions using similar technology. Additionally, collaborating with ASD researchers has inspired my interest in healthcare technology, particularly in leveraging advanced technologies like artificial intelligence for diagnostics and interventions across various health conditions.
7. How did COVID-19 affect the completion of your project?
There was no impact.