def get_crawler_stats(self):
        self.logger.debug("Gathering crawler stats")
        the_dict = {}

        the_dict['spiders'] = self.get_spider_stats()['spiders']
        the_dict['machines'] = self.get_machine_stats()['machines']

        return the_dict
Clean out the old jobs from the job cache
dataset/ETHPy150Open istresearch/scrapy-cluster/redis-monitor/plugins/stats_monitor.py/StatsMonitor.get_crawler_stats--crossover with--dataset/ETHPy150Open saltstack/salt/salt/returners/local_cache.py/clean_old_jobs