WAVE: From Space to Ocean (NASA PACE Capstone)

NASA PACE · University of Maryland IMD · University of North Texas

Jan 2024 – May 2025

Problem

NASA's PACE mission produces complex oceanographic and atmospheric satellite data. The capstone challenge was to make that science approachable through a real-time, gesture-driven public exhibit.

Constraints

  • Real-time gesture recognition from ZED stereo-camera input
  • Reliable operation across changing exhibit lighting, spacing, and calibration
  • Interactive rendering of scientific data for a public audience
  • Setup and deployment that exhibit operators could repeat consistently

Approach

Designed a modular pipeline combining computer vision, real-time rendering, and gesture recognition. Built gesture interaction using ZED stereo cameras and OpenCV with CUDA acceleration for tracking and interpreting user movement. Developed a configurable ImGui-based setup wizard to automate deployment, calibration, and system validation, reducing friction for non-technical operators. Integrated the full pipeline into Unity to render interactive PACE satellite visualizations across multiple display environments.

Architecture

calibration · validationcamera setupZED Stereo Cameradepth + RGB streamGesture PipelineOpenCV + CUDAUnity RenderingPACE data visualsExhibit Displayinteractive scienceImGui Setup Wizardoperator calibration
ZED stereo camera → OpenCV + CUDA gesture pipeline → Unity rendering engine → ImGui setup wizard for calibration and validation

Metrics

MetricBaselineAchieved
Leadership scopeUNT senior capstoneLead Developer for a 5-person team
Public exhibitionResearch-driven prototypeKennedy Center premiere, March 2025
Interaction stackStereo-camera inputOpenCV + CUDA gesture recognition in Unity

Product Impact

Helped deliver an interactive installation that made NASA PACE satellite science tangible for a public audience. The WAVE exhibit premiered at the Kennedy Center in Washington, D.C., in March 2025.

Tech Stack

C#
C++
Python
Unity
OpenCV
ZED SDK
CUDA
ImGui
OpenGL
React
TypeScript
GraphQL

Links

Exhibit code is owned by the university/NASA partnership; third-party press coverage above independently documents the project.