Sensor fusion across two autonomous vehicles

Main Street Autonomy x Unnamed AV Customer demonstrate sensor fusion across two autonomous vehicles in a parking lot, showcasing sensor calibration and localization excellence.

The first AV is parked on the left. Lidar scans are shown in dark colors. The camera view from this vehicle is shown in the top right.

The second AV is performing a three-point turn calibration motion as part of the Calibration Anywhere process. Lidar scans from this vehicle are shown in warm orange/yellow colors.

Note how lidar scans from both vehicles perfectly match the objects in the scene (as observed by a camera from the first vehicle).

Note how the pose of various lidar and camera sensors on the second vehicle are illustrated in the camera view from the first vehicle.

This type of multi-vehicle multi-modal sensor fusion is only possible with:

- Perfect extrinsics calibration of lidar and camera sensors on both vehicles

- Perfect intrinsics calibration of cameras on both vehicles

- Perfect time offset calibration of lidar and camera sensors on both vehicles

- Perfect pose estimation of both vehicles