method , computer program product , and system to perform an operation for a deep question answering system . the operation begins by computing a concept score for a first concept in a first case received by the deep question answering system , the concept score being based on a machine learning concept model for the first concept . the operation then excludes the first concept from consideration when analyzing a candidate answer and an item of supporting evidence to generate a response to the first case upon determining that the concept score does not exceed a predefined concept minimum weight threshold . the operation then increases a weight applied to the first concept when analyzing the candidate answer and the item of supporting evidence to generate the response to the first case when the concept score exceeds a predefined maximum weight threshold .