Important Dates

Stage one
a) Testing Dataset Available: April 26th, 2021 11:59 PM UTC
b) Submission Deadline: Aug 27th, 2021 11:59 PM UTC
Stage two
a) Testing Dataset Available: Aug 6th, 2021 11:59 PM UTC
b) Submission Deadline: Aug 27th, 2021 11:59 PM UTC

Release of the evaluation result: Aug 27th, 2021 11:59 PM UTC

Criteria of judging a submission

Mean Intersection-over-Union (mIoU) will be the criteria for evaluation. Each type of object is assessed and assigned an Intersection-over-Union (IoU) score, then all types of objects will be calculated for the average of their IoU scores, finally resulting in the mIoU score. The submissions will be ranked according to the criteria.

Description

This challenging contains two different stages of test. Each stage may use different test dataset for evaluation. There may have two different leaderboards. In this way, the final mIoU score will be the weighted sum of the mIoU scores at two stage. The weight of mIoU score at stage one is 0.3, and the weight of mIoU score at stage two is 0.7.

Leaderboard

Rank Team Score
1 GuGuOnTheWay 0.516552
2 ST*KK 0.502109
3 3DImageLab_Ma 0.495505
4 Jiarui Hai 0.474772