Start Here

 

Goal

Mission

Our overarching goal is to explore why robots are limited to factory environments and why we don’t have them cooking for us and folding our clothes yet.

In our journey, we plan to publish our progress, tutorials, code, and workshops.

Right now

Right now, we’re building software/hardware for a robot arm to play chess.

From this, we hope to validate fundamental understanding of robot arm design, control (using control systems and/or reinforcement learning), sensor systems (vision, encoders, tactile), and mechanical actuator systems (servos, steppers, gearboxes).

Hardware

We currently have two hardware efforts:

  1. Designing a Mr. Janktastic from scratch
  2. Building the open-source BCN3D Moveo Arm for a better hardware system for software to experiment and test vision, RL systems with.

Software

Working on a variety of problems in vision, control, and high level planning (RL soon!)). See the Software Docs for a deeper dive.

What have we done?

May 2021

  • Object detection working on chess pieces with 90%+ accuracy using YOLOv5 and usable in ROS
    • Put together a 500+ chess piece dataset for detection

Object detection demo

  • Prototype gripper fingers that can pick up chess pieces decently well
  • Created Gazebo simulation that is controlled by MoveIt pipeline, including a simulated camera, chessboard, and chess pieces

December 2020

  • Got an early version of protoarm to stack some boxes using IK and trajectory planning from MoveIt and ROS
  • Designed a prototype 6dof arm

6DOF arm CAD