Introduction: Barbara: the Talking AI Camera

About: Hi, we’re Dane & Nicole, two makers that create stuff, which we happily share with you!

AI being the latest buzzword, this project is all about the slightly
useless. After finding a neat API that captions images and an old camera, the goals is set: A camera that captions what it sees!

Step 1: Camera

This camera is an AGFA Synchro Box from the 50's. Any camera/device will do, as long as a Raspberry Pi, Powerbank and Pi Camera fit inside.

Step 2: Electronics

The electronics are pretty straightforward, to start off setup your Pi and connect the Pi Camera. To power everything you connect the powerbank, the same way you would with your phone.
When everything is wired up, we start on the fiddly part, placing the camera. In this case I kept the shutter open and made sure it was aligned. I takes some time, but hang in there!

All that remains is to plug in in our headphones and make sure the Pi plays our audio via the 3.5mm jack.

Step 3: Code

The code is a slightly tricky bit, but to make things easy, here is a high level overview:

  • Take a picture every second
  • Check if the picture is mostly black (shutter is closed), if so, delete the picture
  • If not, send the picture to the AI API, receiving the caption back.
  • This caption is turned into a MP3 file, playing it via the headphones.

For anyone curious, the full code is attached to this article.

Attachments

Step 4: Result

Now we have a camera that doesn't take pictures, it only captions them!

Some examples for your enjoyment.

You can find the full project video here!