The OpenClaw Software Stack

A complete open-source AI agent framework designed to run entirely on local hardware β€” no cloud required, no compromises.

Architecture Overview

The openclaw hardware software stack is built on a modular architecture that separates concerns cleanly while allowing deep integration. At its heart is the OpenClaw agent framework β€” a Node.js runtime that orchestrates language models, tools, and plugins into a cohesive AI assistant experience.

Every component in the stack is open source, auditable, and runs locally. When you build a DIY ClawBox build, you're not just assembling hardware β€” you're deploying a complete software platform that you can inspect, modify, and extend however you like.

High-Level Architecture
β”Œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”
β”‚ OpenClaw Agent Core β”‚
β”‚ (Node.js runtime, event loop, plugin API) β”‚
β”œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€
β”‚ LLM Runtime β”‚ Voice Stack β”‚ Tool System β”‚
β”‚ (llama.cpp, β”‚ (Piper TTS, β”‚ (plugins, β”‚
β”‚ Ollama, β”‚ Whisper STT,β”‚ skills, β”‚
β”‚ vLLM) β”‚ audio pipe) β”‚ MCP) β”‚
β”œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€
β”‚ OS Layer: Ubuntu / Raspberry Pi OS / Armbianβ”‚
β”‚ Kernel: Linux 6.x+ with appropriate drivers β”‚
β””β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”˜

LLM Runtimes β€” The Brain

The most critical software choice for any desktop AI openclaw build is the LLM inference engine. The OpenClaw framework supports multiple backends, and you can switch between them depending on your hardware and model preferences:

Ollama

For most builders, Ollama is the recommended starting point. It provides a simple CLI and REST API for downloading, managing, and running language models. With a single command β€” ollama run llama3.1 β€” you have a fully functional local LLM. Ollama handles quantization automatically, manages GPU offloading on Jetson and x86 systems, and maintains a curated model library. The OpenClaw framework connects to Ollama's API seamlessly, making it the path of least resistance for your openclaw AI assistant.

llama.cpp

For maximum performance on ARM devices like the Raspberry Pi 5, llama.cpp is the gold standard. Its aggressive CPU optimizations β€” including NEON SIMD instructions on ARM β€” squeeze every drop of performance from modest hardware. The GGUF model format supported by llama.cpp is the most widely available quantized format, giving you access to thousands of pre-quantized models on Hugging Face. Advanced features like speculative decoding and KV cache quantization help even low-end hardware punch above its weight.

NVIDIA TensorRT-LLM

Jetson builders can leverage NVIDIA's TensorRT-LLM for maximum GPU acceleration. It compiles models into highly optimized inference engines that exploit every GPU core, achieving 2-4x throughput improvements over generic runtimes. This is the professional-grade option for builders who need fast, production-quality inference.

Voice Processing Pipeline

Voice interaction transforms a silent box into a conversational AI companion. The OpenClaw voice pipeline is fully local and privacy-preserving:

  • Speech-to-Text (STT): OpenAI Whisper running locally via the whisper.cpp engine. Supports multiple model sizes β€” from tiny.en (fast, lightweight) to large-v3 (most accurate, needs more RAM). For ARM devices, the Whisper medium model offers the best balance of accuracy and speed. All audio processing happens on-device; your voice never leaves your local network.
  • Text-to-Speech (TTS): Piper neural TTS engine provides natural-sounding voice output with minimal CPU overhead. Multiple voice models are available β€” from warm and professional to energetic and casual. The system streams audio in real-time, so responses start playing almost immediately rather than waiting for the entire generation to complete.
  • Audio Hardware: Compatible with any ALSA-supported USB audio device. Many builders use a simple USB conference speakerphone for an all-in-one microphone and speaker solution.

The voice pipeline is optional β€” your ClawBox works perfectly as a text-only assistant, and many users interact primarily through a web interface, Telegram bot, or terminal.

Plugin and Skill Ecosystem

The true power of the openclaw private AI platform comes from its extensibility. The plugin system allows your assistant to interact with the real world:

  • Smart Home Control: Home Assistant, MQTT, and direct API integrations let your ClawBox control lights, thermostats, locks, and more. "Hey ClawBox, dim the living room lights to 50%" β€” processed locally, executed locally.
  • File Management: Browse, search, and organize your local files. The assistant can index your documents and answer questions about their contents.
  • Web Automation: Browser control plugins let your assistant fill forms, check prices, monitor websites, and extract information β€” all through a local Chromium instance.
  • Development Tools: Code generation, git operations, project scaffolding, and debugging assistance. Your ClawBox can be a pair programming partner.
  • Calendar and Email: Connect to local or self-hosted calendar and email servers for scheduling, reminders, and message drafting β€” all data stays on your infrastructure.
  • Weather, News, Maps: API integrations for real-world information when you choose to connect. Each plugin is opt-in and can be configured to use privacy-respecting alternatives.

Operating System and Deployment

The OpenClaw software runs on standard Linux distributions. For Raspberry Pi builds, we recommend Raspberry Pi OS (64-bit, Bookworm or newer) or Ubuntu Server 24.04 LTS. Both provide excellent ARM64 support, stable kernels, and wide peripheral compatibility. For x86 systems, Ubuntu Server or Debian are excellent choices.

Installation is simple: a single bootstrap script handles everything from dependency installation to model downloading. The script is fully auditable β€” every package it installs and every configuration it touches is documented. For advanced users, a Docker-based deployment is also available, providing containerized isolation and easy updates.

Once installed, your openclaw edge compute system runs as a systemd service, starting automatically on boot and persisting through power cycles. The web-based configuration interface lets you tweak every setting without editing config files by hand β€” though raw config files are always available for those who prefer them.

Quick Install

# Clone the repo git clone https://github.com/openclaw/openclaw.git cd openclaw # Run bootstrap ./scripts/bootstrap.sh # Start the agent openclaw gateway start # Open web UI http://localhost:3000

Full setup instructions in the Software Setup Guide.

Supported Models

  • Llama 3.1 / 3.2 (Meta) β€” 1B, 3B, 8B, 70B
  • Mistral / Mixtral β€” 7B, 8x7B
  • Phi-3 / Phi-4 (Microsoft) β€” Mini, Small, Medium
  • Gemma 2 (Google) β€” 2B, 9B, 27B
  • Qwen 2.5 (Alibaba) β€” 0.5B to 72B
  • Command R (Cohere) β€” 35B, 104B
  • DeepSeek β€” V2, V3, Coder