Metaverse Apartment Retrieval Challenge

This repository contains information about the baseline of the Metaverse Apartment Retrieval Challenge

Registration

If you are interested in this challenge please register through this form.

Data

In this challenge, you are supposed to rank 3D scenes based on their textual description. 3DFRONT dataset with the corresponding descriptions for each scenario will be used.

• The 3DFRONT dataset can be obtained here.

• The descriptions can be found in the descriptions directory.

• If you want to use point-of-view images to represent the scenes, they can be found at this repository which can be downloaded through front3d-2d.zip.

Data Split

The data split which should be used for train/validation/test sets can be found at data_split.

Pre Extracted Features

There are two sets of pre-extracted features for the scenes and descriptions. In the first set, you can find open_clip_features and in the second set, you can find resnet_bert_features. Each of these sets contains two directories including images (point of view images features) and descriptions which contains sentence level and token level features.

Baseline Code

To have a baseline code you can use this repository containing a couple of approaches to rank the scenes based on the textual descriptions.