Department of Informatics, Athens University of Economics and Business, Greece; Helvia.ai; Department of Informatics, Athens University of Economics and Business, Greece; Archimedes Unit, Athena Research Center, Greece; Department of Informatics, Athens University of Economics and Business, Greece; Workable; Helvia.ai
Online Learning;Cost-Efficient;LLMs Applications;Caching;Teacher-Student
Cache me if you Can: an Online Cost-aware Teacher-Student framework to Reduce the Calls to Large Language Models