Projects Showcase
HOLOMAT: Touchless ROS 2 UI (Hand + Voice)
Hands-free operator UI: hand tracking + voice to launch & control ROS 2 modules.
About Me
From mental math to building systems
Growing up, I loved numbers and making things. I’d rattle off mental arithmetic to impress my parents’ friends and, as a teen, built a hydraulic arm that became my first real “engineering constraints” lesson. I posted game tutorials for fun, which nudged me into programming and, eventually, engineering.
I care about robotics, automation, AI, and AR, and I’m motivated by building systems that are useful, accurate, and delightful to use.
Outside class and work I balance badminton, ballroom dance, and hosting themed events with heavy workloads. Teaching is a through-line: designing explanations, tools, and interfaces that help people learn faster.
Speed Math — 60s
Outside School/Work
Projects
- ●Built hand_tracking_node (ROS 2 + MediaPipe) → publishes fingertip TF frames + MarkerArray for AR/telemetry.
- ●Wrote calibration_node (Python/NumPy) → 5×5 homography, persists M.npy for repeatable cam↔projector alignment.
- ●Added voice_command_node + ui_display_node (OpenAI API + Pygame) → hands-free launches with logging/monitoring.
ROS 2 · Python · MediaPipe · OpenAI API · Pygame
Open on YouTube ↗- ●Modeled + 3D-printed assemblies; firmware & keypad UI for recipe selection + pump sequencing.
- ●Ran DFX/FMEA to shrink footprint, speed assembly, and improve reliability.
- ●Prototype results: <5% dosing error, ≤6 min dispense, ≤5 min clean; up to 3 ingredients & 4-drink batches.
SolidWorks · Arduino (C/C++) · DFX · FMEA
Open on YouTube ↗- ●Demoed detector workflow: create detector, read frame, get bboxes + scores, overlay results.
- ●Explained pros: turnkey, accurate on upright full-body, integrates with MATLAB tooling.
- ●Caveats: partial occlusion/poses degrade accuracy; slower than modern DL detectors—good starter baseline.
MATLAB · Computer Vision Toolbox
Open on YouTube ↗Contact Me
By submitting, your message will be sent to santosmatthewjohn@gmail.com. If the form doesn’t open your mail app, email me directly.