Let me explain you about the parameters required for finetuning with LoRA.
batch_size = input seq processed at once.
epochs = no. of x to train.
gradi. accumu. = after how many batch sizes it should do the com.
learning rate = speed of learning
optmizer = Teacher (easy).
#LLM
#LLM