A simple two-shot PlanningAgent

3rd person POV

The Dimensional Framework

The universal framework for AI-native generalist robotics

What is Dimensional?

Dimensional is an open-source framework for building agentive generalist robots. DimOS allows off-the-shelf Agents to call tools/functions and read sensor/state data directly from ROS.

The framework enables neurosymbolic orchestration of Agents as generalized spatial reasoners/planners and Robot state/action primitives as functions.

The result: cross-embodied “Dimensional Applications” exceptional at generalization and robust at symbolic action execution.

DIMOS x Unitree Go2

We are shipping a first look at the DIMOS x Unitree Go2 integration, allowing for off-the-shelf Agents() to “call” Unitree ROS2 Nodes and WebRTC action primitives, including:

• Navigation control primitives (move, reverse, spinLeft, spinRight, etc.)
• WebRTC control primitives (FrontPounce, FrontFlip, FrontJump, etc.)
• Camera feeds (image_raw, compressed_image, etc.)
• IMU data
• State information
• Lidar / PointCloud primitives
• Any other generic Unitree ROS2 topics

Features

• DimOS Agents
  • Agent() classes with planning, spatial reasoning, and Robot.Skill() function calling abilities.
  • Integrate with any off-the-shelf hosted or local model: OpenAIAgent, ClaudeAgent, GeminiAgent 🚧, DeepSeekAgent 🚧, HuggingFaceRemoteAgent, HuggingFaceLocalAgent, etc.
  • Modular agent architecture for easy extensibility and chaining of Agent output –> Subagents input.
  • Agent spatial / language memory for location grounded reasoning and recall.
• DimOS Infrastructure
  • A reactive data streaming architecture using RxPY to manage real-time video (or other sensor input), outbound commands, and inbound robot state between the DimOS interface, Agents, and ROS2.
  • Robot Command Queue to handle complex multi-step actions to Robot.
  • Simulation bindings (Genesis, Isaacsim, etc.) to test your agentive application before deploying to a physical robot.
• DimOS Interface / Development Tools
  • Local development interface to control your robot, orchestrate agents, visualize camera/lidar streams, and debug your dimensional agentive application.

Docker Quick Start 🚀

⚠️ Recommended to start

Prerequisites

• Docker and Docker Compose installed
• A Unitree Go2 robot accessible on your network
• The robot’s IP address
• OpenAI API Key

Configuration:

Configure your environment variables in .env

OPENAI_API_KEY=<OPENAI_API_KEY>
ALIBABA_API_KEY=<ALIBABA_API_KEY>
ANTHROPIC_API_KEY=<ANTHROPIC_API_KEY>
ROBOT_IP=<ROBOT_IP>
CONN_TYPE=webrtc
WEBRTC_SERVER_HOST=0.0.0.0
WEBRTC_SERVER_PORT=9991
DISPLAY=:0

Run docker compose

xhost +local:root # If running locally and desire RVIZ GUI
docker compose -f docker/unitree/agents_interface/docker-compose.yml up --build

Interface will start at http://localhost:3000

Python Quick Start 🐍

Prerequisites

• A Unitree Go2 robot accessible on your network
• The robot’s IP address
• OpenAI/Claude/Alibaba API Key

Python Installation (Ubuntu 22.04)

```bash sudo apt install python3-venv

File truncated at 100 lines see the full file