Importance of question words
Each question word has an importance score represented by the corresponding color shown in the color bar. Hovering over a question word occludes that word, and shows the predicted answer when the masked question (after dropping that question word) and the entire image is fed as inputs to the VQA model.