Robust Object Detection via Instance-Level Temporal Cycle Confusion
Xin Wang
Thomas E. Huang*
Benlin Liu*
Fisher Yu
Xiaolong Wang
Joseph E. Gonzalez
Trevor Darrell

*This video has audio.



Building reliable object detectors that are robust to domain shifts, such as various changes in context, viewpoint, and object appearances, is critical for real-world applications. In this work, we study the effectiveness of auxiliary self-supervised tasks to improve the out-of-distribution generalization of object detectors. Inspired by the principle of maximum entropy, we introduce a novel self-supervised task, instance-level cycle confusion (CycConf), which operates on the region features of the object detectors. For each object, the task is to find the most different object proposals in the adjacent frame in a video and then cycle back to itself for self-supervision. CycConf encourages the object detector to explore invariant structures across instances under various motions, which leads to improved model robustness in unseen domains at test time. We observe consistent out-of-domain performance improvements when training object detectors in tandem with self-supervised tasks on various domain adaptation benchmarks with static images (Cityscapes, Foggy Cityscapes, Sim10K) and large-scale video datasets (BDD100K and Waymo open data).




X. Wang, T. Huang*, B. Liu*, F. Yu, X. Wang, J. Gonzalez, T. Darrell.
Robust Object Detection via Instance-Level Temporal Cycle Confusion
Preprint, 2021.
(hosted on ArXiv)



This template was originally made by Phillip Isola and Richard Zhang for a colorful ECCV project; the code can be found here.