NASA Astrobee. Cargo system prototype.

A Florida Atlantic University senior-design prototype from 2022–2023, exploring visual tracking and embedded control for an Astrobee cargo berth.

Project Type
University prototype
Focus
Vision & control
Senior Design Showcase
FAU
Project Duration
2022–23
Role and deliverables
Project type
University senior-design prototype
Technical focus
Embedded systems and robotics
Key focus
Reliability, constraints, and maintainability
What was built
Vision workflow, embedded control layer, communication link, and review-ready prototype documentation

The project.

This Florida Atlantic University senior-design project explored a cargo berth for NASA's Astrobee platform. The lead-development work connected visual marker tracking, an ESP32-controlled electromagnetic fixture, and TCP/IP communication. The project poster documents a working prototype and simulation, with space-station cargo handling as the intended application.

The prototype was presented at FAU's Spring 2023 Senior Design Showcase. The poster, hardware photographs, tracking view, and showcase images document the work and its university-project context.

The need.

The proposed cargo berth needed a way to locate a tagged bag, align with it, and control the magnet. Visual tracking, fixture behavior, and communication had to form one understandable workflow.

Space-station cargo handling was the intended application. The documented work covers the university prototype and simulation.

How the prototype connected.

Vision Layer (Python / OpenCV)
├── Live camera feed ingestion
├── ArUco & AprilTag detection
├── Position coordinates
└── Cargo ID + orientation output
         │
         │  TCP/IP socket
         ▼
State Machine Controller
├── Command queuing
├── Fixture state transitions
└── System state management
         │
         ▼
ESP32 Embedded Firmware (C++)
├── Electromagnetic actuation
├── Magnet and sleep commands
├── Active and idle states
└── Host and fixture coordination
👁️

Computer Vision Layer

A Python and OpenCV workflow tracks visible markers and produces position information for the prototype. This connects the camera input to the cargo berth control path.

⚡

Embedded Control Layer

C++ firmware on an ESP32 controls the electromagnetic fixture and its operating states, including magnet and sleep commands.

🔌

Communication Link

A TCP/IP host-and-client connection carries tracking information and commands between the computer-vision program and the fixture.

🧠

State Machine Controller

The state controller coordinates tracking, alignment, and fixture commands. The documented states make the prototype workflow easier to test and review.

The prototype workflow.

Vision and Tracking Workflow

  • Visual marker tracking from camera input
  • Position coordinates passed to the host program
  • Tracking output connected to fixture commands

Embedded Control Layer

  • An ESP32-controlled electromagnetic fixture
  • Commands for magnet and sleep modes
  • State transitions for alignment, capture, and idle behavior

Communication System

  • A host-and-client TCP socket connection
  • Coordinate output from the tracking program
  • Commands between the host and the ESP32 fixture

Project Decision Notes

Engineering decisions that made the prototype review-ready.

This project is technical, but the useful lesson is straightforward: complex work has to be broken into pieces that can be tested, explained, and handed off.

Engineering decision

Turn a complex idea into testable pieces.

The prototype needed planning, testing, and documentation before it could become review-ready.

Business reason: That same discipline applies to business websites and custom apps and workflow tools: define the workflow, test the important pieces, and make the next step clear.

Reliability decision

Use visible markers instead of guessing the object shape.

Visible markers made cargo tracking more predictable. For a prototype where precise docking mattered, reliability was more important than a more flexible but less certain approach.

Handoff decision

Document the work so it can be reviewed.

A technical project is not useful if nobody can understand what was built, how it works, or what comes next.

Scope decisions

The implementation stayed focused on the constraints that mattered most: tracking cargo, coordinating hardware behavior, communicating between layers, and making the prototype understandable for review. Extra complexity would not have helped if the core workflow was harder to test or explain.

NASA Collaboration

Developed through Florida Atlantic University's Senior Design program with NASA's Astrobee team. The project poster identifies NASA as the sponsor and records the Spring 2023 showcase.

What the project demonstrates.

The practical value was a maintainable technical foundation: separate layers for vision, state control, and embedded actuation, with enough structure to test the important pieces and explain the handoff between system parts.

Technology

PythonOpenCVESP32C++TCP/IPArUcoAprilTagComputer VisionSocket ProgrammingRobotics
Role
Lead Developer
Duration
2022 – 2023
Category
Embedded Systems / Robotics
Collaborator
NASA Astrobee Team
Presented At
FAU Senior Design Showcase

The next step

Put this experience to work for your business.

Tell us what your website or application needs to do. The first conversation turns that need into a scope you can review.

Start a Conversation

Share what you need. We will review the details and discuss the scope with you.