ARIZOMS ← Home

PROJECTS

Two systems built in-house, drawn as they run today.

verified on hardwarein progress

LessonBuilder

HoloLens 2 spatial learning platform

Unity · C# · MRTK3 · Python/Flask · Azure IoT Hub

  • Places 3D learning stations in any classroom. Lesson content is stored apart from room geometry, so one lesson reflows to any room size.
  • Voice-driven room scanner: name the room, set an origin, measure the walls. The headset derives a room coordinate frame and stores the scan in a Flask backend.
  • Parametric station layouts computed from the scanned dimensions, with spacing and wall-clearance rules. If the room is too small, the layout shrinks and warns.
  • Show and hide 3D models per station, scaled automatically to fit.
  • Two-channel control: commands come down through Azure IoT Hub, data goes up over HTTP.
verified on devicein progress
HOLOLENS 2 HEADSET Voice room scanname · origin · walls Room frameorigin yaw + wall dist. Layout engineCircle3 · Center · rules Stations S0–S32 ft cubes, labeled Modelsshow / hide · fit-scale IoT Hub listenerMQTT over 443 Flask backendroom scans (upsert) HTTP POST CLASSROOM DISPLAY → AZURE Promethean / E-RAEteacher commands Azure Functions/hololens-trigger Azure IoT Hubcloud-to-device msg to headset: in progress verified to test device
The headset side runs on the device today. The cloud command path is verified end to end to a test device; the listener inside the headset is the next build step.

RAE

Classroom voice AI with physical hardware control

Azure Static Web Apps · Azure Functions (Node.js) · OpenAI Realtime · Raspberry Pi 5 · ESP32 · Python

  • A voice assistant that uses tool calling to drive a 1,070-pixel, six-strip LED wall in real time.
  • Traced a campus network slowdown to a polling service by matching its request-traffic signature, then re-architected from HTTP polling to IoT Hub push messaging and retired the polling path.
  • Server-minted ephemeral API tokens, access-code gating, and secrets kept out of source control.
  • Embedded hardware: level-shifted data lines, fused 300 W power distribution with star grounding, a dedicated UART between Pi and ESP32, and an I2S microphone.
live, verified by voice
BROWSER + AZURE Voice sessionWebRTC · OpenAI Realtime Azure Functionstoken mint · tool calls Azure IoT Hubcloud-to-device push tool call CLASSROOM HARDWARE Pi 5 listenerMQTT · systemd Flask light APIpalettes · watt guard ESP32 firmwareUART2 · effects LED wall — 6 strips, 1,070 pixelslevel shifters · fused 300 W supply · star ground · I2S mic MQTT push serial old HTTP polling — retired
Every hop is in production. The dotted red line is the polling path that slowed the campus network; push messaging replaced it.