Markov Crawler




Introduction: Markov Crawler

Crawler can execute a reflex agent or Q-learn optimal policy using Markov decision process.

Raspberry Pi runs CS188 AI Python software controlling crawler 2 servo motors for arm and hand, acquiring crawler position from optical mouse.

Step 1: Overview of the Project

Step 2: Assembly Instruction

Step 3: Usage Instruction

Step 4: Q-learning Process

Step 5: Execution of Q-learned Policy

Step 6: Synchronization of Simulator and Physical Robot

Raspberry Pi Contest 2017

Participated in the
Raspberry Pi Contest 2017

Be the First to Share


    • Pocket-Sized Speed Challenge

      Pocket-Sized Speed Challenge
    • Audio Challenge 2020

      Audio Challenge 2020
    • Maps Challenge

      Maps Challenge