IEEE ITSC 2024

Ground Plane Projection for Improved Traffic Analytics at Intersections

Sajjad Pakdamansavoji1, Kumar Vaibhav Jha1, Baher Abdulhai2, James H Elder

¹Department of Electrical Engineering and Computer Science, York University, Toronto, ON, Canada
²Department of Civil and Mineral Engineering, University of Toronto, Toronto, ON, Canada

Supported by the Centre for Vision Research (CVR) and Centre for AI & Society (CAIS) at York University, the Vector Institute for Artificial Intelligence, the Region of York, and Trans-Plan.

Correspondence: sj.pakdaman.edu@gmail.com

Ground Plane Projection overview
Example from the CityFlow V2 dataset: vehicle trajectories observed in the camera image plane.

Summary

Shows that back-projecting detected vehicles to the ground plane, instead of analyzing them in the camera image plane, produces more accurate turning movement counts at intersections.

Abstract

Accurate turning movement counts at intersections are important for signal control, traffic management and urban planning. Computer vision systems for automatic turning movement counts typically rely on visual analysis in the image plane of an infrastructure camera. Here we explore potential advantages of back-projecting vehicles detected in one or more infrastructure cameras to the ground plane for analysis in real-world 3D coordinates. For single-camera systems we find that back-projection yields more accurate trajectory classification and turning movement counts. We further show that even higher accuracy can be achieved through weak fusion of back-projected detections from multiple cameras. These results suggeest that traffic should be analyzed on the ground plane, not the image plane

Key Contributions

Approach

Unsupervised learning pipeline for camera-plane analysis.
Unsupervised learning pipeline for camera-plane analysis.
Unsupervised learning pipeline for ground-plane analysis, us
Unsupervised learning pipeline for ground-plane analysis, using homographies to back-project detections into real-world coordinates.
Intrinsic calibration. Left: original image. Right: with non
Intrinsic calibration. Left: original image. Right: with nonlinear distortion removed.

Results

Reprojection error (pixels)

DatasetCamerasCamera planeOrthophoto
TransPlan2218.24.3
CityFlow1316.74.2
Region of York1815.82.8

Back-projection to the ground plane reduces reprojection error roughly four-fold.

Turning movement count error rate — camera plane vs ground plane

DatasetDomainDIRVOTEML
CityFlowCamera6.6%7.8%5.1%
Ground5.4%7.9%4.0%
TransPlanCamera12.6%14.2%11.0%
Ground10.5%13.8%9.9%
Region of YorkCamera20.0%38.2%19.5%
Ground14.9%38.2%13.8%

Ground-plane analysis is more accurate on every dataset for the learned (ML) classifier.

Single-camera vs multi-camera weak fusion

ModeError rateBias
Single13.8%5.2%
Multi7.3%0.1%

Weak fusion across cameras roughly halves error and all but eliminates bias.

Representative prototype tracks selected by the unsupervised
Representative prototype tracks selected by the unsupervised clustering method.
Optimized likelihood models in the ground plane for the turn
Optimized likelihood models in the ground plane for the turning movement classes at the Region of York intersection.

BibTeX

@inproceedings{pakdamansavoji2024ground,
  title     = {Ground Plane Projection for Improved Traffic Analytics at Intersections},
  author    = {Sajjad Pakdamansavoji and Kumar Vaibhav Jha and Baher Abdulhai and James H Elder},
  booktitle = {IEEE International Conference on Intelligent Transportation Systems (ITSC)},
  year      = {2024}
}