Who Stole my Pen?

Track and Grab a Pen | Sept 2022.

https://www.w3schools.com/bootstrap4/paris.jpg
Track and Grab a Pen.

Overview

To track a pen autonomously and grab it.

Hardware

  • PincherX 100 robotic arm
  • Intel Realsense D435i camera


Skills
  • ROS
  • OpenCV
  • Computer Vision

Description

To track a pen autonomously and grab it.

The Intel Realsense D435i depth camera is used to get the 3D position of the pen. Computer vision is incorporated to perform edge detection based on hsv color mask, gets the contours of the purple pen.

The PincherX 100 robotic arm which has a 4 degree of freedom tracks the pen and moves to the coordinates of the detected purple pen and grabs the pen by closing its grippers, comes to the home position and opens its grippers to drop the pen.