You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
names = ["f30k_caption_karpathy_test"] when split == "val" or "test" at loading f30k dataset
but, it is necessary to run get_false_Image or get_false_text function during the test phase?
def get_suite(self, index):
result = None
while result is None:
try:
ret = dict()
ret.update(self.get_image(index))
if not self.image_only:
txt = self.get_text(index)
ret.update({"replica": True if txt["cap_index"] > 0 else False})
ret.update(txt)
for i in range(self.draw_false_image):
——> ret.update(self.get_false_image(i))
for i in range(self.draw_false_text):
——> ret.update(self.get_false_text(i))
result = True
except Exception as e:
print(f"Error while read file idx {index} in {self.names[0]} -> {e}")
index = random.randint(0, len(self.index_mapper) - 1)
return ret
hello, @dandelin
I have tracked the code at vilt_module.py
from the training_step function -> set_task function
ITM task will enabled only when v>=1
However, no matter what pre training task, all ITM parameters are set to 0.5 in config.py
Is there a problem with my understanding?
thank you!
The text was updated successfully, but these errors were encountered: