Hands on with Gemini 1.5 Pro
Having fun with a 1 million token context window
Last week we launched Gemini 1.5 Pro with an experimental 1 million context window. The means you can now input:
🎬 1 hour of video
🔊 11 hours of audio
🖥 30k lines of code
📖 700k words
which unlocks a whole world of new possibilities of things you can use Generative AI to do.
This weekend, I decided to have some fun with Gemini 1.5 Pro…
Playing Tour Guide
I often have friends and family visiting us and one of my go-to activities is taking them on a walk all around our neighborhood. Naturally, they want to hear all about the interesting sights and landmarks - so I decided to see if Gemini could help. I took a couple videos during our morning walk this weekend and then uploaded them to Gemini 1.5 Pro and asked it to come up with 10 interesting facts. After a bit of back and forth, these were my favourite facts:
Bernal Heights is a vibrant and diverse neighborhood with a rich history. It was originally a working-class neighborhood, but it has become increasingly gentrified in recent years. [General Fact]
The house at the corner of Eugenia and Anderson Streets is a classic example of Victorian architecture. It was built in the late 1800s and is one of the many historic homes in the neighborhood. [Video 1 @ 00:05]
The view from the top of Bernal Hill is one of the best in the city. On a clear day, you can see the Golden Gate Bridge, Alcatraz, and the Bay Bridge. [Video 2 @ 00:14]
The swing set at the top of Bernal Hill is a popular spot for kids and adults alike. It's a great place to relax and enjoy the views. [Video 2 @ 00:25]
The house at the corner of Moultrie and Anderson Streets is a good example of Edwardian architecture. It was built in the early 1900s and is characterized by its simple, yet elegant design. [Video 2 @ 01:18]
The neighborhood is home to a number of parks and green spaces, including Bernal Hill Park, Holly Park, and Precita Park.[General Fact]
The neighborhood is also known for its many murals, which can be found on buildings and walls throughout the area. [General Fact]
Bernal Heights is a great place to find delicious food, with a variety of restaurants and cafes to choose from. [General Fact]
The neighborhood is also home to a number of shops and boutiques, making it a great place to do some shopping. [General Fact]
Bernal Heights is a very walkable neighborhood, and it is easy to get around on foot. [General Fact]
And here is the initial prompt:
Fun Examples From Others
I’ve also been following along with what other developers have been doing with it - these are some of my favourites:
6 impressive capabilities - including understanding and comparing full movie transcripts from Interstellar and Ad Astra
Helpful Links
You can read more about the launch in Google AI Studio in my Google for Developers blog post Gemini 1.5: Our next-generation model, now available for Private Preview in Google AI Studio
You can read all about the amazing breakthrough behind Gemini 1.5 on the official Google blog post Our next-generation model: Gemini 1.5
You can also join the waitlist to get access to 1.5 Pro in Google AI Studio here:
I’m excited to see what interesting and creative things folks start building!