Vision-Guided Mechatronic Gantry System

AI-guided crane automation with perception and edge deployment

I contributed to the design and automation of a 3-DOF mechatronic gantry system with a parallelogram gripper for industrial payload manipulation. The project combined mechanical design, spatial kinematics, and computer vision.

Key work

  • Designed a 3-DOF mechatronic crane and parallelogram gripper.
  • Applied spatial kinematics for industrial payload manipulation.
  • Fine-tuned a real-time YOLO pipeline for object detection and tracking.
  • Used perspective transforms to map 2D camera feeds into 3D world coordinates.
  • Deployed a REST API on an ESP32 edge node to synchronize AI perception with hardware actuation.

What this project demonstrates

It brought together mechanical engineering, robotics perception, embedded systems, and intelligent automation into a single integrated workflow.