How you fed the VQA v2 each question and answers list to VL T5 or VL BART ?

[sanyalsunny111]

Hey Authors,

Thank you for the repo @ylsung .

Can you please explain a bit how you guys sent the question and paired answers to the model as each question has multiple answers from the code it seems you guys are selecting one random answer (

VL_adapter/VL-T5/src/vqa_data.py

Line 229 in 545fcbb

answer = random.choice(answers)['answer']

). Can you please explain your approach a bit?

[ylsung]

In order to let the model learn to generate all possible answers based on the questions, we choose to randomly select an answer from the answer list for simplicity. This approach also allows us to fully use the labels.