<p>Finetuning is more like adopting the pre-trained model to the downstream task. However, recent <a href="https://arxiv.org/pdf/1909.04925.pdf" rel="nofollow noreferrer">state-of-the-art</a> proves that finetuning doesn't help much with QA tasks. See also the following <a href="https://stackoverflow.com/questions/63218778/fine-tuning-distilbertforsequenceclassification-is-not-learning-why-is-loss-no/63593996#63593996">post</a>.</p>
BERT fine tuning
<p>I'm trying to create my model for question answering based on BERT und can't understand what is the meaning of fine tuning. Do I understand it right, that it is like adaption for specific domain? And if I want to use it with Wikipedia corpora, I just need to integrate unchanged pre-trained model in my network?</p>