The conversation between human and AI assistant.
How do I use a training set combined with confidence level to classify the samples in a test set?
That makes sense. How do I decide on the threshold for the confidence level?
That depends on your specific application and the trade-offs you are willing to make between precision and recall. If you set a high threshold, you will have higher precision but lower recall, meaning that you will correctly classify fewer images but you will be more confident in those classifications. If you set a low threshold, you will have higher recall but lower precision, meaning that you will correctly classify more images but you will be less confident in those classifications.