Google takes another step towards Jarvis by tapping your search history for chatbot answers. And just wait until the AI ​​mode is involved.

Google takes another step towards Jarvis by tapping your search history for chatbot answers. And just wait until the AI ​​mode is involved.

Google just published Gemini with personalization Two weeks ago, what its AI chatbot enables you to use your search course to answer questions. As early as February 2023, I wrote a post about Google’s “Code Red” based on Openai Start Chatgpt. In this article I mentioned that Ai Chatbot progress can quickly be headed for Jarvis (a personal AI assistant of KI, who knows everything about them where they were, what they like, not like and much more to answer their questions best.)

Well, the pace of change with AI chatbots was relentless and it is incredible to see how far they got in a short time. And now we have a new and exciting feature that is only another important step towards Jarvis. Gemini just published personalizationwho use your search course to answer your questions.

I have greatly tested “Gemini with personalization” since I received access, and I can’t stop thinking about how this could affect Gemini’s answers and how this could possibly affect Google search results (since the AI ​​mode develops further and can also include personalization). More about the AI ​​mode soon. Yes, these are modes with an “s”.

Connect Gemini to your search history.

Another step towards Jarvis, a personal AI assistant who knows everything about her.
By typing on your search course, Gemini can give answers based on all the different things you are looking for on this topic. In my tests it was pretty wild to see what it returned. Sure, it’s not perfect yet, but there is definitely some answers based on your search queries. And I found that extremely helpful when it makes sense.

I will specify a few examples below, but I used ‘Gemini with personalization’ when I ask about Colleges about my son, tips for improving my golf play, new coding languages ​​that I should learn, retro games that I should think about with purchase, exercises that I should add to my training sessions, and more. It’s not a Jarvis yet, but I can see parts of Jarvis.

In addition, it is important to understand that this is just the beginning. It is easy to point out errors when something is so new, but as we have seen since November 2022, the technology always improves hectic.

Here is a short example where I asked Gemini which golf shots I have to work based on my search story. Yes, I worked on my sand shots. 🙂

Gemini with personalization helps Glenn with his golf game.

And continue the conversation with Gemini …

Gemini with personalization helps Glenn to buy his next club to buy.

With “Gemini with personalization”, access to your search history is of crucial importance. However, wait for you to get more data such as cards (where you have traveled), youtube (what you have seen), photos (tons of data), your files (what you work) and can combine more. With Gemini you can already connect some apps for additional functions and data, and now we have personalization based on your search history. Jarvis will be powerful if it combines all of this to answer your questions.

Connect Gemini to other apps like YouTube.
Connect Gemini to other apps such as flights, hotels, cards and more.

Add Gemini live to the mix:
It is also worth noting that Gemini Live is a powerful function in the Gemini app, with which you can have live conversations with the AI ​​chat bot. Now imagine doing this, based on Gemini that type your search. Then Gemini Jarvis gets closer because you have a real live conversation with your AI assistant.

Gemini Live could benefit from personalization.

Here, too, we approach a Jarvis-like assistant who knows everything about them. The advantage of this (hopefully) will be powerful answers to your questions and help you to do tasks based on your personal background, knowledge, preferences, dislikes, strengths and weaknesses. For example, think about how Jarvis Tony Stark would help in Iron.

Here is another short example of “Gemini with personalization” in action. I asked what exercises I should add to my strength training for strength training, based on my search history. Gemini knows that I play golf, baseball and other swing sports. It also knows that I run a lot and I want to improve the strength and flexibility in my shoulders and back.

Gemini with personalization that helps Glenn with his workouts.

And continue the conversation with Gemini …

Gemini with personalization that helps Glenn with new exercises for his training.

A new SERP: AI mode that is personalized?
When and when personalization comes to AI mode, the search results can be radically different. Note that the AI ​​mode was recently started in the beta and I have tested it strongly. Like Gemini or Chatgpt, AI mode is in the search results and enables you to continue the conversation by asking follow-up questions. Adding personalization is completely useful (if the user wants it), and I can definitely see that it takes in the AI ​​mode.

Personalized search results based on their history history could rock a SERP. Each user has their own search results. Yes, say goodbye to what “rank” means at that time. Ranking tools cannot follow the personalized SERP, GSC data are even more confusing, and Site owners do not know where they rank for every user who taps in Ki mode “Gemini with personalization”. And if you want to know how GSC follows AI mode, read my contribution to the topic. “Ki mode with personalization” would make the data even more confusing …

Here is a model of AI mode with personalization. That is not yet alive.

A model of AI mode with personalization.

But wait, there is more!
I’m sorry to channel Billy Mays in this post, but Google works on many other powerful tools that could make their way to Jarvis. I will cover them below and how the personalization would be the key.

Project Mariner: Execution of tasks for you.
Project Seepfahrer is the version of an agent from Google who does tasks for you. For example, it can search websites and take measures (e.g. research pages, buying products, planning vacation, finally book this vacation and more). Personalization could obviously be extremely powerful if they are combined with a AI agent. This combines my original example from 2022 with Tony Stark’s assistant named Jarvis, who helped Iron Man in difficult situations that were based on everything that it knows about him.

Astra project: Jarvis will see what you see.
With Astra projectGemini can use your camera to see the world and give answers to your questions. Yes, Jarvis needs eyes just like in Iron Man. Incidentally, it sounds like Astra is starting to roll out for some people. So that’s not far away …

Ki modes and possibly many: Yes, Jarvis will be sent in many areas.
I mentioned the AI ​​mode earlier and how I had access since it started in the beta. So, Tom Critchlow caught a strange leak When testing the AI ​​mode. He saw many AI modes, like 47 of them, to be precise. For example, neural chef, Star Gazer, AIO Airport, visit Guide and more. And if you add this additional KI modes of personalization, you can see how powerful it could be … stay on this front because it was only a leak (and these have not yet been rolled out).

47 AI modes are leaked for a short time.

Jarvis is coming and the Serps may never be the same.
The pace of change with AI chatbots has been incredible since the start of Chatgpt. One thing is certain that Google caught up pretty quickly after publishing this “Code Red” in early 2023. Gemini quickly expanded and Google adds more and more functions to its KI chat bot. And now Gemini with Jarvis can become more like Jarvis – a personal AI assistant who can answer questions based on everything he knows about her. At the moment it is based on your search history, but at some point it can be expanded to all your experiences (such as cards, YouTube, your files, e -mails and more).

It is both incredible and scary at the same time. I will cover more over time. Stay tuned.

Gg

Leave a Comment

Your email address will not be published. Required fields are marked *

Scroll to Top