Hi, this is Wayne again with a topic “This Pixel has a hidden health feature”.
Three: nine two, five, four six repeat uh. I don’t remember this. Is the google pixel four? It has a 5.7 inch oled display a snapdragon 855 processor and it can track your pupils on a sub-millimeter level, with a reported median error of three and a half percent. Okay, this video isn’t really about a three-year-old phone. If you want to watch that review, we did one.
You can still check it out. If you want to this, video is about the camera in this phone, however, and how researchers at ucsd are using it to do more than just unlock it with their face instead they’re, seeing if it can measure your pupil size, which the hope could potentially screen for Neurological diseases like alzheimer’s – this is all really interesting to me, because when we talk about health and tech, usually the conversation is around newer devices like wearables, which not everyone has. So i wanted to find out more about this technology, which again is on an older phone and exactly what other health monitoring can be done with the device you may already have. My name is colin barry. I’M a second year phd student at uc, san diego in the electrical and computer engineering department, and most of our work here is focused around using ubiquitous technology, so smartphones, wearables and things that we already have around us to do health-based computation. So i’m just wondering how does pointing a smartphone camera in your eye tell you anything about neurological diseases like alzheimer’s.
It can be difficult to understand why the eye would be. You know a metric for different neurological diseases and first, i guess to tell you a little bit about the measurement. That measurement is really just the size of your pupil. Now, if you don’t know, the pupil is the dark center of your eye that expands and contracts. It’S just like a camera iris that lets in more or less light, depending on how wide the iris is open, but our pupils can tell more of a story than just how bright it is outside.
So it’s not just a quick snapshot of the eye. Actually, it’s recording your response to specific tasks. These are correlated with neurological diseases because of the connections within the brain between certain brain regions associated mostly with fight-or-flight response, and so what the people is doing is basically giving scientists sort of a window into the brain and seeing how we can non-invasively identify different traits Or different cognitive impairments by the dysfunction or the function of your pupil response, in other words, how your pupil responds to certain tasks can tell scientists a lot about your cognitive health.
So how does this app allow them to do that? The way the app works is that it’s going to be using the facial recognition system because it includes near infrared cameras, so these cameras are recording in a non-visible range. It’S not the same colors and things that we and you will see when we look around, and this is especially important for people measurements, because some people have dark brown eyes because of the melanin in their eyes, uh and the difference between their black people and their Dark iris is going to be very minimal in the visible spectrum, but when you look at it in the infrared spectrum – uh it’s you know almost basically black and white between the two and that’s how we’re able to get these submillimeter measurements of the people. There’S. Actually, a lot of work going on at ucsd when it comes to unlocking the technology in your smartphone for health applications, there’s a huge sort of library of different measurements that you can take with a smartphone, and a lot of work needs to be done to have These measurements sort of validated and have them not only validated by themselves validated across many smartphone models. Many smartphone models is a key point here too, because not all smartphones have ir cameras. The pixel actually lost them after the four now viren, and i aren’t in the age demographic that collins research group is studying, but he was still nice enough to lead us through our own pupil exams, which was pretty easy for the most part. One.
If you need to blink now repeat six nine one, seven, four, two eight: maybe we should do it in creation. This is getting harder. So the app isn’t designed to show us what it’s recording colin, collects the data and reads it back at the lab, which will look like this a chart showing our people changing size over time and this somewhat creepy video of my eyeball.
Now, if that doesn’t seem like much getting, this information is actually pretty hard. So, generally of people, the pupilometry measurements are done in clinical lab in very controlled settings with specialty devices called pupilometers. They can cost upwards of nine or ten thousand dollars, which is a huge limiting factor, especially for a lot of clinics. Now colin isn’t suggesting that your pixel 4 is going to replace a 10 000 machine, there’s still a long way to go to find out. If this approach is accurate enough to be useful, what he is doing here is called a feasibility study.
It’S meant to figure out what could be possible. The vision is that, hopefully, people can use these. You know smartphone based measurements to have people take their measurements at home outside of the clinic, and then the doctors can use that to understand whether they need to take more measurements in the clinic.
That accessibility is important. Not everyone has access to a clinic with this machine, but a lot of people do have smartphones, which is good, but still not a perfect solution. Yeah, so smartphones are going to be more widely used than wearables, so you got some potential for more access there. Nicole wetzman is a health reporter here at the verge who’s covered tons of stories on the intersection of healthcare and technology.
I think that digital divide issues are always going to be relevant when you’re, looking at adding health products to a digital device, because just because someone has a smartphone doesn’t mean that they have the background and experience to be able to use it to the fullest extent Of its capabilities, you see this happening with, like the telemedicine space during the pandemic. Just because someone has a computer in their home doesn’t mean that they’re going to be able to access a telehealth service. Maybe that’s because they don’t they don’t know how to download the application or the application is not available in the language that they speak or they don’t have reliable internet access or they don’t have a quiet space to make that kind of happen. When we’re meeting with participants a lot of what we do is actually just explaining how to use the phone – and you know how to touch on a touch screen, how to turn the phone on this is something that colin and nicole are acutely aware of.
There are a lot of health apps out there claiming to do a lot of things, but there’s no guarantee that the public is going to know how to use them correctly and some populations they’ll get left out of using them completely. That’S why the type of research that colin and other scientists do is important. This isn’t about rushing to get the latest feature out on the newest flagship device, it’s more about. How do we take these pretty incredible devices that we already have and find out how much good we can do with them for the most people now, we’ll still have to wait and see if colin and his team’s research pans out, and even if it does, that’s Not the end of the story, like does a company like google, decide to buy this research or recreate it, or does this actually become developed as a legit clinical tool used by doctors in conjunction with traditional devices, they’re both pretty intriguing options that could grant more access To more people yeah, i think that simplification of screening can be can be useful.
You know leveraging the technology at our disposal, you know smartphones are really ubiquitous and if those can have um important health applications, then it’s you know, i think, really useful to try to to investigate that, to the fullest extent that we can like. Let’S see what we can do with this huge thanks to colin barry from ucsd for sharing his research with us, they’re doing really cool things over there with the tech that we use every day and thanks to nicole for giving us the greater context on healthcare in Tech be sure to check out her writing on theverge.com, so yeah pixel 4 still impressing three years later, not bad .