Hi, this is Wayne again with a topic “Google I/O: 9 BIG Gemini on Android announcements you need to know!”.
Google have just finished day one of Google iio and, as we expected, it was very Gemini Nano and AI heavy in general, and actually one of the biggest taglines from this was reimagining Android with AI and there’s a lot of talk about how Gemini Nano is getting Better in the coming months, so what we thought we’d do it just put together a quick video that can give you all the highlights of what we think is the most important things that came out of day. One of Google IO, the star of the show, was Gemini Nano on Android and how Google are making it even better and actually now making it more context aware which basically Bally means it can provide you with information about what is happening on the screen and there’s Two parts of this: what Google calls static and dynamic suggestions, so we’ll talk about the dynamic suggestions in a second but we’ll start with the static suggestions and in the Google keynote. They showed a lot of pickle ball in this, not that I even know what pickle ball is, but it was a star of what you can do with Gemini Nano now Gemini Nano can just sit on top of what you’re doing so. You don’t lose context when you’re actually using the AI functions. Interestingly as well.
Now, what you can do is use Gemini to drag and drop. So this just means, if you’re using Gemini, to generate an image inside messages or an email. You can drag and drop the image that it create straight into images or that email – and this is really cool, because the one thing about AI at the moment is that I feel like you – have to have too many steps to actually achieve what you want to Do so taking out the step of having to go from one app to another and having it overlay? What you’re already in, I think is really neat another way that Gemini Nano has becoming a little bit more context. Aware now is being able to use it inside things such as YouTube.
So if you were looking at a video that is explaining a tutorial, I don’t know, I’m fixing as syn or as Google want to talk about playing pickle ball. You can use the as this video function and Gemini. Nano will search that video for that specific request that you asked and it will bring up exactly that part of the video which I just think is really cool cuz. It means you don’t have to start now.
Wasting time watching a 20 minute video for you to find that 3 4 second piece that you actually really need we’re, also getting the exact same feature on PDFs as well, and this feature is US, ask PDF so again, if you have a 48 page PDF, you Can use the ask PDF function with Gemini Nano to search for a specific part of that PDF, and this will work on all PDFs but annoyingly. This is only going to be able to work if you’re subscribed to Gemini Advanced. So everything that I just spoke to about was a static suggestion, but now we’ll move on to the dynamic suggestions, and essentially what this means is that now Gemini Nano will start to prompt you for things before you need to interact with it.
So, for example, if you inside m Mees – and you are having a discussion about going for a coffee Gemini, Nano will give you a dynamic suggestion for something like Google Maps, where it can show you your closest place, to go and get a coffee and again. This is a cool little update because it just eliminates an extra step of you having to do that searching yourself. All these Dynamic suggestions are done on device locally until you initiate something.
So if you click a Google map suggestion, it will then go to the cloud and get that information, but all the static suggestions that we spoke about earlier on. They are all all done on device and there’s no official date of when this will be rolling out. Yet from Google, but it is coming so it’s something that you might want to keep your eyes peeled for. Let’S have a little look at Circle to search now. Google have said that over 100 million devices currently are being used with circle to search and hopefully, by the end of 2024, the end of this year. They want to add another 100 million to get to 200 million devices using Circle to search, and today you can go and use this right now.
They introduce Circle to search with homework. Google mentioned that more people than ever are using tablets and their phones to do homework, which kind of makes sense. So that’s why they’ve added homework help with circle to search this works exactly the same as Circle to search would work. But if you stuck on a maths problem, you would do that Circle to search around the equation that you might be stuck on.
Then you’ll get a step-by-step instruction to solve a range of physics and math word problems without even leaving that page. That you’re working on and Google showed this on physics problems but said that it will be rolling out to more complex problems involving symbolic formulas, diagrams graphs and a little bit more later on in the year. I like this because it doesn’t just give you the answer. It shows you exactly how you get to the answer, and this is something that is available now, so you can go and try it.
So, let’s all go off and just solve maths completely. Another thing that Google announced with Gemini Nano is a scam call alert that will work on Pixel 8 pros and the s24 series. Google did some research and said that a trillion dollars every single year is lost to scam calls.
So this feature might be quite useful for quite a few people and what it will do is it will listen to your phone call in real time on device and if it detects that this might be a scam call you’ll hear like a notification, sound and see A notification pop up and it’ll listen out for certain phrases like if you’re on the phone to what is meant to be your bank. If it asks for your PIN or it asks you to pay with gift cards, that’s when it’ll realize that this could be a scam call like I mention this happens on device. So only your phone has access to that call information. It doesn’t go anywhere else, but this is one of those features that’s not available just yet, but it’ll be rolling out a little bit later in the year, and finally, Google announced that the pixel 99’s will debut a more powerful version of Gemini Nano later on. In the year and interestingly, Google said that this new version needs more powerful Hardware to run.
So if you have an older pixel, essentially a pixel, 8 or older, then it looks unlikely that you’ll get this. What they did show off of this more powerful Gemini Nano coming later in the year was an upgraded version to their tback feature. Now, if you don’t know what TalkBack is it’s essentially a screen reader and tells people who are impaired visually? What is on the screen and it can describe images, and it does it fairly well at the moment, but it’s not as good as it could be. You can see an example here of it, describing in really good detail what can be seen in the image and, like I said, TalkBack does do this at the moment and it does an okay job, but the new TalkBack feature it can see an image as essentially A human would see that image and can describe it exact, exactly how you would describe it to a friend to give you a much clearer picture of what is being seen on the screen again.
This is one of those features that is not available, yet it will be available later on in the year. When you see the release of the Google pixel 99’s like we expected, though Google’s keynote was very heavy on Gemini Nano and AI in general, but let us know your thoughts of what you’ve seen at the keynote on day. One in the comments below we’ll have a lot more coverage from Google iio over the next couple of days. So make sure you subscribe.
So you get the latest news here first and if you do that and I’ll see you a little bit later on. .