Introduction: AI Tutor 1.0 2.0 3.0

By
About: I am the secondary teacher in Hong Kong. My students and I work together to form the stem team. Play well is our slogan. COS means Community Of Stem.

Introduction:

In order to cater for the needs of the students, we developed AI TUTOR 1.0, 2.0 and 3.0. We continuously improved the functions of AI TUTORS to meet the needs of students.

Creative Elements:


AI tutor 1.0: Musical Master (drum set) + AI Tutor

AI tutor 2.0: Become portable (open pipe) and wearable

AI tutor 3.0: Adding the eye to AI tutor (piano) which read the passage and the musical sheet (chord).

Step 1: Requirements

Components:

    1. raspberry pi 3B
    2. Voice kit v1
    3. ARDUINO MEGA 2560
    4. Capacitor sensor x 7 pieces
    5. 3D printed pianos
    6. 12 inch plastic pipe
    7. wires
    8. copper adhesive tapes
    9. paper box - 20cm(L) X 15cm(W) X 6 cm(H)
    10. Raspberry pi lens v2
    11. SP 1 PIT 1.5A 250VAC button
    12. 3D printing stands
    13. SPARKFUN MUSICAL INSTRUMENT SHIELD
    14. BELT
    15. Adafruit 12-Key Capacitive Touch Sensor Breakout - MPR121

    Software:

    1. Arduino programming
    2. Python programming


    Step 2: Assembly Google Voice Kit V1

    https://aiyprojects.withgoogle.com/voice-v1/

    Follow the instruction of the above links to build AI tutor1.

    Step 3: AI Tutor + Musical Shield

    1. Using Wood grain stickers to cover the google voice kit V1.
    2. Using USB cable to connect the google voice kit v1 to Arduino Mega with musical shield.
    3. Loading the Arduino program to the Arduino Mega.
    4. Running the python program in the google voice kit v1.
    5. Google voice kit and Arduino Mega communicate with each other through the USB cable.

    Step 4: Musical Shield and Arduino Mega

    We used Arduino Mega as the musical master since Arduino Mega provide more pins for the drumset. We combined these two components as a single module which will connect to AI tutor 1, teaching music.

    Step 5: Connecting the Drumsets to Musical Master

    We used the jumper pins as a connector which connected the drumsets to the musical master. So, the device could be expendable. In addition, other musical instrument can be connected to the musical master.

    Step 6: Coding - Arduino and Python

    Attachments

    Step 7: Video - AI Tutor 1.0

    AI Tutor 1.0: Students are playing piano.

    AI tutor 1.0 demonstration

    Step 8: Making AI Tutor 2.0

    1. Use the pipe and screw the hole by screw driver.
    2. Use copper adhesive tapes as the tone finger plate.
    3. Use Adafruit 12-Key Capacitive Touch Sensor Breakout - MPR121 for connecting the copper adhesive tape and arduino mega. The idea was reducing the complexity of circuit design and making wearable AI tutor 2.0.
    4. 3D printing: make the protective shield of three main components, Arduino Mega with musical shield, Goggle voice kit and Speaker.
    5. Attached three components to the belt.
    6. Use the USB portable battery as the power supply.

    Step 9: Making the Open Pipe

    1. Use the pipe and screw the hole by screw driver.
    2. Use copper adhesive tapes as the tone finger plates.
    3. Soldering each tone finger plate to the dupont wire.

    Step 10: Making the Connector to Adafruit 12-Key Capacitive Touch Sensor Breakout - MPR121

    1. 3D printg to make the connector socket.
    2. Put all the dupont wires from the tone finger plates into the connector socket.
    3. Insert the connector socket into Adafruit 12-Key Capacitive Touch Sensor Breakout - MPR121
    4. 3D printing to make protective box (orango color).
    5. Use USB type A wire connect the musical master module to google AIY voice kit 1.

    Step 11:

    1. 3D printing to make a protective box (white) for AIY voice kit 1.0.
    2. 3D printing to make a protective box (yellow) for the speaker

    Step 12: Video - AI Tutor 2.0

    AI tutor 2.0 demonstration

    AI tutor 2.0: The player is playing the music

    Practice : AI tutor 2.0 "next" command

    Step 13: AI Tutor 3.0

    Additional Functions:

    AI Tutor 3.0 can read the passage and simple musical sheet.

    Step 14: Making AI Tutor3.0 - Musical Instrument Phototype

    1. Use the hard mouse pad as a piano.
    2. Attach copper adhesive tapes on the hard mouse pad.
    3. Soldering the dupont wires to copper adhesive tapes.
    4. Attach all the heads of dupont wires altogether as a connector.

    Step 15: The Circuit of AI Tutor 3.0

    Long cable for the raspberry pi lens V2.

    Step 16: Making the Musical Instrument - Piano

    1. Soldering the 12 capacitive touch sensors to the Musical Shield.
    2. Soldering the 12 capacitive touch sensors to the the finger pin of piano.

    Step 17: OCR Speech - Raspberry Pi 3.0 B

    Reference: PiTextReader Document Reader for Impaired Vision - R.Grokett

    1. Connect the 24" camera cable to the camera.
    2. Connect the button to the Raspberry Pi 3.0 B+ which controls the OCR speech.

    Step 18: AIY Voice Kit V1.0

    1. Microphone module from AIY voice kit V1.0 connect to the voice hat.
    2. Make a hole for microphone.

    Step 19:

    Step 20: AI Tutor 3.0 Can Be Transformed to a Box.

    AI tutor 3.0, likes a transformer, is a paper box. All the components stands, the camera cable, speakers, wires and the lens can be put into the paper box.

    Step 21: Making AI Tutor 3.0

    In order to increase the data processing power, we used two raspberry pi 3B+ for making the AI Tutor 3.0.

    In addition, we make use of "PiTextReader, Document Reader for Impaired Vision, R. Grokett" to integrate into AI tutor 3.0.

    The AI Tutor 3.0 can read the passage and recognize each words. In addition,AI tutor 3.0 can read the simple musical sheet and play the music accordingly and AI tutor 3.0 likes a music tutor, the player can play the music with different type of musical notes, For example, organ, violin and sax phone. Finally, AI Tutor 3.0 can be a Maths tutor and a English tutor.

    Step 22: Video - AI Tutor 2.0 and 3.0

    AI tutor 3.0 are playing music with reading the chords.

    AI tutor 3.0 - "music" command and " Next" command

    AI tutor 3.0 "exercise 1 " command

    AI tutor 3.0 are reading the passage

    AI tutor 2.0 and 3.0 demonstration