Weakness: 1. The novelty is limited. Interpretating the prediction of deep neural networks using linear model is not a new approach for model interpretation. 2. The motivation of the paper is not clear. It seems an experiment report about ~193k models, and obtains the obvious results, such as the middle layers represent the more generalizable features. But it is not about interpretation. 3. The writing is not clear. it's hard to read and follow the work. 4.
Concerns: 1. Why need 101 “source” tasks? What are these? 2. 101 tasks can be done on the retinal image, it is not a unified domain to do the research about model interpretation. 3. The motivation and conclusion should be clearly presented to under the contribution of this paper for model interpretation.
1. The novelty is limited. Interpretating the prediction of deep neural networks using linear model is not a new approach for model interpretation.