RAI: ROS 2 speech recognition agent

Connect a microphone, Silero VAD and local tiny Whisper to a ROS 2 speech recognition agent.

rai-examples-s2s-asr-py | Record version: source-c8913987745bc41b66c98782e7f0d316f2721a150c1053189c2c7f5d31a21c77

Record JSON | Markdown | Pinned upstream source

Access

Fetch the pinned repository, verify this source checksum, and use upstream installation and invocation. This record does not install or execute code.

Hub preparation adapter: false. Follow the upstream setup and invocation contract.

Source and license

Repository: https://github.com/RobotecAI/rai
Revision: b018729833742c6f71e1e9f332ee2b435676fb4f
Path: examples/s2s/asr.py
Source SHA256: c8913987745bc41b66c98782e7f0d316f2721a150c1053189c2c7f5d31a21c77
Original authors: Robotec.AI (per-file copyright notice)
License: Apache-2.0
License scope: Selected first-party source and per-file notices; excludes models, dependencies, datasets, simulator assets and external service terms.
License SHA256: c71d239df91726fc519c6eb72d318ec65820627232b2f796219e87dcf35d0ab4
Hub commit: 1d6d9eb134e397d910265a8d6e7d8f257f9e8d7f

Artifact

{
  "kind": "workflow",
  "format": "python",
  "workflow_role": "speech-inference"
}

Requirements

{
  "python": "Root/core/whoami/perception/semap/s2s use >=3.10,<3.13; standalone finetune uses >=3.10,<3.12. Match sourced ROS distribution Python.",
  "packages": [
    "Pinned RAI checkout",
    "Matching ROS 2 and rai_interfaces",
    "Per-workflow packages, local model or hosted-provider dependencies from pinned setup"
  ],
  "display": "Official setup documents ROS 2 Humble/Jazzy, rai_interfaces and feature-specific environment. Nothing installed or runtime verified.",
  "execution_domain": "computation-or-hardware",
  "source_imports": [
    "argparse",
    "rai_s2s.asr",
    "rai_s2s.sound_device",
    "rclpy",
    "signal",
    "time"
  ],
  "notes": "Upstream per-workflow profile declarations only; provider availability, dependency resolution and runtime/robot compatibility are unverified.",
  "declared_requirements": {
    "speech": {
      "gpu": "LocalWhisper selects CUDA when available and library default otherwise. Kokoro documentation declares CPU default/fallback and optional CUDA 12/cuDNN 9 setup. No capacity or throughput guarantee.",
      "external_models": "Selected Whisper, Silero VAD, OpenWakeWord or Kokoro ONNX assets. Upstream initialization can obtain assets; none were downloaded. OpenTTS requires an external server.",
      "api": "Selected ASR example uses local Whisper and TTS example local Kokoro. Other supported speech providers include hosted OpenAI/ElevenLabs with credentials; use of those providers is not implied by these examples.",
      "evidence_paths": [
        "src/rai_s2s/README.md",
        "src/rai_s2s/pyproject.toml",
        "src/rai_s2s/rai_s2s/asr/models/local_whisper.py",
        "src/rai_s2s/rai_s2s/tts/models/kokoro_tts.py"
      ]
    }
  }
}

Invocation

{
  "entrypoint": "python examples/s2s/asr.py",
  "notes": "Source/setup invocation shape only; not executed or runtime verified. Source references only; no Hub adapter, compatibility promise, provider access grant or runtime result. Known limits: OpenWakeWord is instantiated, but optional add_detection_model is commented out; wake-word gating is not asserted."
}

Explicit compatibility

[]

Missing environment fields remain unknown. Discovery labels do not establish robot compatibility.

Evidence

Level: source_reviewed; runtime verification: not_run.

Verified exact source, applicable license and author/setup document bytes at a full Git commit; parsed the Python AST and reviewed this guarded operational entrypoint and its explicit license notices. No upstream code, installation, robot command, dataset, mesh or checkpoint was executed or loaded.

Source review and contributor reports do not establish task completion. Preserve upstream attribution and licenses.