United Kingdom & Singapore Robotics solutions architect
R·1Latest · Independent research · Open source

WardZero: a simulated hospital for robots

WardZero is an open platform, created by Rakshith, to develop and test robot solutions for hospitals. It provides a full simulated hospital, two simulators, a safety layer and navigation. Robots train in WardZero before they work near patients.

Robot simulationIsaac Sim · MuJoCoROS 2 HumbleReinforcement learningHumanoid robots

Film

The hospital and surgical wing in Isaac Sim 6.0, path traced. The camera moves on a scripted path; it is not a robot view.

Results in simulation

99.6%
Map accuracy

Wall cells within 0.10 m of the Isaac ground truth

96.6%
Map coverage

Of the floor that the robot can reach

0.05 → 0.97
Stand survival

Stage A1, in 39 million steps

2048
Parallel robots

On one RTX 3070 GPU

What

WardZero is a full simulated hospital for robot development. The surgical wing has corridors, pre-operative bays, a recovery ward, a sterile store, a scrub room and an operating theatre. Users can bring their own robot, controller or task. The platform supports mapping, navigation, controller training, teleoperation, safety functions and robot tasks, and it records synchronised sensor data with exact ground truth.

How

All parts use the low-level interface of the real robot. The controller sends motor targets on /lowcmd at 500 Hz and reads joint states on /lowstate. As a result, the same software runs in MuJoCo, in Isaac Sim and on the real robot.

The component repositories with the prefix hospital-sim- contain no robot-specific code. A different robot supplies its own model, simulator bindings and controller, so the platform is robot agnostic.

Results

The hospital, both simulators, the safety layer, teleoperation, mapping and navigation are complete. The controller has completed training stage A1 (stand). All tests used simulation only; no test on a real robot and no sim-to-real test is complete yet.

System architecture

Select the diagram to enlarge it
WardZero architecture: inputs and autonomy send requests to the mode manager, the mode manager drives the controller, and the controller drives MuJoCo, Isaac Sim or the real G1
WardZero system architecture

One interface

The controller sends /lowcmd and receives /lowstate, as on the real robot. The simulators also publish the lidar scan, odometry and head camera.

One safety layer

All input sources send requests to the mode manager. It uses a control lease, a watchdog, an emergency-stop gate and speed zones.

One building

One Python layout file defines the hospital. It generates the Isaac scene and the MuJoCo walls in the same world frame, so a map from one simulator is correct in the other.

World

The hospital is the NVIDIA Isaac Sim hospital building. A generated surgical wing connects to its south-east door, with the operating theatre and props of NVIDIA Isaac for Healthcare and Lightwheel SimReady.

A generator builds the scene from the layout file. A build check stops the build if furniture blocks a door, if two props overlap or if a prop is outside its room. The corridors are 2 m and 4 m wide, and the doors have 2 m of clear width. A reduced copy of the assets runs on an 8 GB graphics card.

Simulation for training and test

Two simulators replace the robot and use the same low-level interface. MuJoCo provides fast physics: the ROS 2 simulator node steps it at 500 Hz, and MuJoCo MJX trains the controller. Isaac Sim provides realistic rendering, a GPU lidar and a head camera for tests of navigation and perception.

Plan of the surgical wing
Plan of the surgical wing. Top: pre-operative bays, link corridor and recovery ward. Middle: surgical corridor. Bottom: sterile store, scrub room and operating theatre.

Controller training

PPO trains the whole-body controller in MuJoCo MJX, with 2048 robots in parallel on one RTX 3070. The curriculum has three stages: stand (A), walk with arm targets (B) and follow full-body motions (C). A teacher policy with privileged data trains a student policy that uses only the sensors of the real robot. The controller loads the student as an ONNX file.

Stage A1 is complete. Survival increased from 0.05 to 0.97 in 39 million steps, in approximately one hour. Before training, the policy falls after 1.0 s; after training, it stands for the full 11 s test with a maximum tilt of 2.7 degrees.

Teleoperation and safety

All input sources send requests to the mode manager, which makes the decision. A control lease sets which source has control. A watchdog sets HOLD if the interface signal stops. A hardware emergency stop has priority over all inputs, and speed zones on the map set the maximum speed. Webcam teleoperation, with MediaPipe and a fork of xr_teleoperate, controls the arms and hands without a VR headset.

Autonomy

Navigation uses standard ROS 2 packages: slam_toolbox builds the map, AMCL localises the robot, and Nav2 with the MPPI controller plans the path. In the test, the robot followed a route of 60 points through the hospital and the surgical wing.

Survival in stage A1 against training steps
Survival in stage A1 against training steps. The green ring marks the checkpoint that passed the gate.

Mode manager · seven modes

DAMPRemoves power from the motors
STANDThe robot stands
LOCOWalks to velocity commands
MANIPArm and hand control
NAVNav2 drives the robot
AUTOThe task layer drives the robot
HOLDStops the robot in place until an explicit resume

Status and next steps

DoneHospital and surgical wing in Isaac Sim and MuJoCo, from one layout
DoneReal-robot interface in both simulators, with lidar, odometry and head camera
DoneMode manager, teleoperation, mapping and navigation
PartialController: stage A1 complete; walking and motion tracking next
NextSimulated patient personas for robot-human interaction studies
NextSim-to-real transfer and tests on a real robot

Components

hospital-sim
Master repository: interface contract, environment script, component list
…-env
Isaac Sim hospital and surgical wing, layout generator
…-description
Robot model: URDF, MJCF, meshes, specification
…-mujoco-sim
MuJoCo hospital from the same layout
…-isaac-sim
Physics layer, lidar, cameras, DDS and ROS 2 bridge
…-whole-body-rl
Controller training in MuJoCo MJX, ONNX export
…-ros2
Controller, mode manager, teleoperation, navigation, tasks
…-webcam-teleop
Webcam teleoperation of the arms and hands

Stills

Select a still to enlarge it
Operating theatre in the surgical wing
Operating theatre in the surgical wing, Isaac Sim 6.0.
Unitree G1 reference robot model
Reference robot: Unitree G1 with two BrainCo Revo2 hands.
Mapping and navigation: map, robot path and head camera
Mapping and navigation: slam_toolbox map, robot path and head camera.

Disclaimer. WardZero is research software in development. All tests used simulation only. WardZero is not a medical device. It is not for patient care, for a clinical procedure, or for the control of a real robot near people without a separate safety analysis, tests and approvals.

Assets. Hospital building: NVIDIA Isaac Sim (NVIDIA Limited Use Content). Operating theatre: NVIDIA Isaac for Healthcare (Apache 2.0). Surgical props: Lightwheel SimReady assets © Lightwheel AI, CC BY-NC 4.0. Robot: Unitree G1 descriptions from unitree_ros and BrainCo Revo2 hand descriptions. Based on hospital-sim by Bkrakshith.