98 | Friday Fun: Chatbot Arena, Say What You See

Introduction

If you’d like to get some practice with AI, there are some places you can go to play with it. In this edition of “Friday Fun,” I’m introducing a couple that I’ve enjoyed.

Disclaimer: My definition of “fun” may be a bit different from yours!

Chatbot Arena

One of the truths about the evolving world of large language models (LLMs) is that there is no single agreed-on way to evaluate them. There are various benchmarks that companies will cite to tout their latest releases, pundits and thought leaders who share their preferences, and some academic research into approaches for evaluating LLM performance. But there’s no one place to go to see how the models stack up against each other.

Unless you’re interested in subjective popular opinion. In that case, go to the LMSYS Chatbot Arena! It’s a website where anyone can test out a few dozen LLMs, including pitting them against each other and voting for which model gives a better response; sort of an AI blind taste test. The chatbot arena also features a “leaderboard” listing stats on votes … and yes, OpenAI’s most recent GPT-4 model continues to be at the top.

I’ve enjoyed seeing the variation in responses, and I’ve found myself sometimes working to improve my prompts to see if I can get better answers. To many readers, this may seem rather dry, but I do find myself learning by being in a playground where the point is to play!

Say What You See

In the spirit of improving prompting, Google has a ‘game’ where you look at a picture and try to create a prompt that’ll generate something very close to it.

Here are my first three attempts. I think I have quite a bit of room for improvement!

The original for each is the small image at the top, left. The larger image is what was generated with my prompt, which appears below.

AI Word Tetris?

Sticking with Google, they’ve created an interesting game, Semantris. Like most games, it’s much easier to grasp if you try it than to read about it … so go to https://research.google.com/semantris/ and give it a go!

Meme Generator

And finally, there’s SuperMeme. Check it out!

And as you consider sharing one of those memes, be sure to…

Make Good Choices