Introduction: Raspberry Pi Smart Robotic Assistant

This is a smart Robotic Assistant that sits on your desk or home. It is based on Raspberry pi. A two DoF gimbal with on-board wide angle night-vision camera for face tracking and streaming surveillance videos. There is also a 2-inch SPI LCD display for expressive eye animations. USB microphone and speaker provides voice interaction with the assistant and it handles your daily tasks! The functionality are fully modular and expandable.

Supplies

  • Raspberry pi 4 B+ (model 3B+ or later)
  • 2 DoF serval gimbal module (2 9g servos and its holder)
  • Night vision camera
  • 2-inch SPI LCD Display
  • USB Speaker
  • USB Microphone
  • 5v 3A Power supply
  • Ice Cream Sticks
  • Glue Gun

Step 1: Assemble the Servo Gimbal

The servo gimbal should look like this when assembled. The complete assembled kit are available on Adafruit website or other equivalents.

Step 2: Ice Cream Sticks

Use glue gun to mount two ice-cream sticks on the side like this. The sticks will act as a structural holder for the camera and the display

Step 3: Mounting the Camera Module

Mounting the camera module onto the structure like this, secure it with glue gun

Step 4: Mounting the Display Module

With a glue gun, mount the 2-inch display to the gimbal like this. Right above the camera module. Upon completion, ensure that the wires are free to move.

Step 5: Mounting the Gimbal Assembly and Wiring

Glue the completed gimbal assembly to the raspberry pi casing. Connect the camera wires. Connect the x servo to GPIO 2 and the y servo to GPIO 3. Refer to this link for the connection of the LCD module: https://www.waveshare.com/wiki/2inch_LCD_Module

Step 6: Setup and Run the Assistant Python Scripts

Properly Setup raspberry pi with the latest software.

acquire pre-written code at https://github.com/YifanZhou1999/PyAssistant.git

start by running popcorn_main.py to test for installation and functionalities.

Follow on-screen prompt to begin interacting with the smart assistant!