- I would have liked to see some analysis about the distribution of the addressing coefficients (Betas) with and without the bias towards sequential addressing. This difference seems to be very important for the synthetic task (likely because each question is based on the answer set of the previous one). Also I don't think the value of the trade-off parameter (Theta) was ever mentioned. What was it and how was it selected? If instead of a soft attention, the attention from the previous question was simply used, how would that baseline perform?
- Towards the same point, to what degree does the sequential bias affect the VisDial results?
- Minor complaint. There are a lot of footnotes which can be distracting, although I understand they are good for conserving clarity / space while still providing useful details.
- Does the dynamic weight prediction seem to identify a handful of modes depending on the question being asked? Analysis of these weights (perhaps tSNE colored by question type) would be interesting.
- It would have been interesting to see not only the retrieved and final attentions but also the tentative attention maps in the qualitative figures.
- It would have been interesting to see not only the retrieved and final attentions but also the tentative attention maps in the qualitative figures.