{"action":"created","comment":{"url":"https://api.github.com/repos/rhiever/tpot/pulls/comments/63531838","id":63531838,"diff_hunk":"@@ -261,16 +267,29 @@ def pareto_eq(ind1, ind2):\n \n             self.hof = tools.ParetoFront(similar=pareto_eq)\n \n-            stats = tools.Statistics(lambda ind: ind.fitness.values[1])\n-            stats.register('Minimum score', np.min)\n-            stats.register('Average score', np.mean)\n-            stats.register('Maximum score', np.max)\n+            # stats = tools.Statistics(lambda ind: ind.fitness.values[1])\n+            # stats.register('Minimum score', np.min)\n+            # stats.register('Average score', np.mean)\n+            # stats.register('Maximum score', np.max)\n \n             verbose = (self.verbosity == 2)\n \n-            pop, _ = algorithms.eaSimple(population=pop, toolbox=self._toolbox, cxpb=self.crossover_rate,\n+            # Start the progress bar\n+            num_evaluations = self.population_size * (self.generations + 1)\n+            self.pbar = tqdm(total=num_evaluations, unit='pipeline',\n+                             disable=(not verbose), desc='GP Progress')\n+\n+            with warnings.catch_warnings():\n+                # Ignore warnings\n+                warnings.simplefilter('ignore', category=UserWarning)","path":"tpot/tpot.py","position":50,"original_position":50,"commit_id":"f92494496b259019d0a0793339901fa82c0b5c6f","original_commit_id":"f92494496b259019d0a0793339901fa82c0b5c6f","user":{"login":"teaearlgraycold","id":3281507,"avatar_url":"https://avatars.githubusercontent.com/u/3281507?v=3","gravatar_id":"","url":"https://api.github.com/users/teaearlgraycold","html_url":"https://github.com/teaearlgraycold","followers_url":"https://api.github.com/users/teaearlgraycold/followers","following_url":"https://api.github.com/users/teaearlgraycold/following{/other_user}","gists_url":"https://api.github.com/users/teaearlgraycold/gists{/gist_id}","starred_url":"https://api.github.com/users/teaearlgraycold/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/teaearlgraycold/subscriptions","organizations_url":"https://api.github.com/users/teaearlgraycold/orgs","repos_url":"https://api.github.com/users/teaearlgraycold/repos","events_url":"https://api.github.com/users/teaearlgraycold/events{/privacy}","received_events_url":"https://api.github.com/users/teaearlgraycold/received_events","type":"User","site_admin":false},"body":"Some operators (like FastICA) can be noisy during a call to fit().\r\n\r\nSKLearn would say that `tol` was too low for convergence, but I assumed the GP would just work that out and there wasn't any need to actually display those types of errors, especially considering how the user has no direct input when it comes to those evolve-able parameters and they mess with the progress bar.\r\n\r\nMaybe tol just need to have a minimum allowed value for FastICA. I believe I've seen other operators have similar issues, though.","created_at":"2016-05-17T14:28:14Z","updated_at":"2016-05-17T14:28:14Z","html_url":"https://github.com/rhiever/tpot/pull/144#discussion_r63531838","pull_request_url":"https://api.github.com/repos/rhiever/tpot/pulls/144","_links":{"self":{"href":"https://api.github.com/repos/rhiever/tpot/pulls/comments/63531838"},"html":{"href":"https://github.com/rhiever/tpot/pull/144#discussion_r63531838"},"pull_request":{"href":"https://api.github.com/repos/rhiever/tpot/pulls/144"}}},"pull_request":{"url":"https://api.github.com/repos/rhiever/tpot/pulls/144","id":69605253,"html_url":"https://github.com/rhiever/tpot/pull/144","diff_url":"https://github.com/rhiever/tpot/pull/144.diff","patch_url":"https://github.com/rhiever/tpot/pull/144.patch","issue_url":"https://api.github.com/repos/rhiever/tpot/issues/144","number":144,"state":"open","locked":false,"title":"Add support for progress bar during GP if verbosity is set to 2","user":{"login":"teaearlgraycold","id":3281507,"avatar_url":"https://avatars.githubusercontent.com/u/3281507?v=3","gravatar_id":"","url":"https://api.github.com/users/teaearlgraycold","html_url":"https://github.com/teaearlgraycold","followers_url":"https://api.github.com/users/teaearlgraycold/followers","following_url":"https://api.github.com/users/teaearlgraycold/following{/other_user}","gists_url":"https://api.github.com/users/teaearlgraycold/gists{/gist_id}","starred_url":"https://api.github.com/users/teaearlgraycold/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/teaearlgraycold/subscriptions","organizations_url":"https://api.github.com/users/teaearlgraycold/orgs","repos_url":"https://api.github.com/users/teaearlgraycold/repos","events_url":"https://api.github.com/users/teaearlgraycold/events{/privacy}","received_events_url":"https://api.github.com/users/teaearlgraycold/received_events","type":"User","site_admin":false},"body":"## What does this PR do?\r\n\r\nAdds a progress bar (from the tqdm module) that displays during calls to fit() if verbosity is set to 2\r\n\r\n## Where should the reviewer start?\r\n\r\nThe reviewer should check the fit() and _gp_new_generation functions\r\n\r\n## How should this PR be tested?\r\n\r\nRunning TPOT with verbosity set to 2\r\n\r\n## Any background context you want to provide?\r\n\r\n\r\n\r\n## What are the relevant issues?\r\n\r\n#140\r\n\r\n## Screenshots (if appropriate)\r\n\r\nAs you can see below there's a bit of a conflict between the GP min/max/avg stats and the tqdm progress bar. Typically tqdm will smoothly update the progress bar as it progresses, but the stat output forces tqdm to redraw the bar. So it may be desirable to either remove the stats or change the conditions under which the stats and tqdm show up.\r\n\r\nConsole-shot:\r\n\r\n```\r\nGP Progress:  22%|██████▌                      | 9/40 [00:01<00:06,  4.98pipeline/s]\r\ngen\tnevals\tMinimum score\tAverage score\tMaximum score\r\n0  \t10    \t0.5          \t0.662568     \t0.972352                                                         \r\nGP Progress:  50%|██████████████              | 20/40 [00:06<00:09,  2.14pipeline/s]\r\n1  \t10    \t0.5          \t0.837614     \t0.984079                                                                \r\nGP Progress:  70%|███████████████████▌        | 28/40 [00:11<00:07,  1.63pipeline/s]\r\n2  \t8     \t0.97224      \t0.979522     \t0.984079                                                            \r\nGP Progress:  95%|██████████████████████████▌ | 38/40 [00:19<00:01,  1.15pipeline/s]\r\n3  \t8     \t0.881496     \t0.968862     \t0.984079  \r\n```\r\n\r\n**Edit:**\r\n\r\nAbove issue is no longer present in the branch\r\n\r\n## Questions:\r\n\r\n- Do the docs need to be updated?\r\n\r\nThere does not seem to be any information in the docs about what the verbosity setting does at the moment, so I suppose not unless it is desirable to add that now.\r\n\r\n- Does this PR add new (Python) dependencies?\r\n\r\nYes, `tqdm`","created_at":"2016-05-11T02:05:40Z","updated_at":"2016-05-17T14:28:14Z","closed_at":null,"merged_at":null,"merge_commit_sha":"8e2bac4fba6cc018768535e6a2c9b9f1fc628058","assignee":null,"milestone":null,"commits_url":"https://api.github.com/repos/rhiever/tpot/pulls/144/commits","review_comments_url":"https://api.github.com/repos/rhiever/tpot/pulls/144/comments","review_comment_url":"https://api.github.com/repos/rhiever/tpot/pulls/comments{/number}","comments_url":"https://api.github.com/repos/rhiever/tpot/issues/144/comments","statuses_url":"https://api.github.com/repos/rhiever/tpot/statuses/f92494496b259019d0a0793339901fa82c0b5c6f","head":{"label":"teaearlgraycold:progress_bar","ref":"progress_bar","sha":"f92494496b259019d0a0793339901fa82c0b5c6f","user":{"login":"teaearlgraycold","id":3281507,"avatar_url":"https://avatars.githubusercontent.com/u/3281507?v=3","gravatar_id":"","url":"https://api.github.com/users/teaearlgraycold","html_url":"https://github.com/teaearlgraycold","followers_url":"https://api.github.com/users/teaearlgraycold/followers","following_url":"https://api.github.com/users/teaearlgraycold/following{/other_user}","gists_url":"https://api.github.com/users/teaearlgraycold/gists{/gist_id}","starred_url":"https://api.github.com/users/teaearlgraycold/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/teaearlgraycold/subscriptions","organizations_url":"https://api.github.com/users/teaearlgraycold/orgs","repos_url":"https://api.github.com/users/teaearlgraycold/repos","events_url":"https://api.github.com/users/teaearlgraycold/events{/privacy}","received_events_url":"https://api.github.com/users/teaearlgraycold/received_events","type":"User","site_admin":false},"repo":{"id":54745664,"name":"tpot","full_name":"teaearlgraycold/tpot","owner":{"login":"teaearlgraycold","id":3281507,"avatar_url":"https://avatars.githubusercontent.com/u/3281507?v=3","gravatar_id":"","url":"https://api.github.com/users/teaearlgraycold","html_url":"https://github.com/teaearlgraycold","followers_url":"https://api.github.com/users/teaearlgraycold/followers","following_url":"https://api.github.com/users/teaearlgraycold/following{/other_user}","gists_url":"https://api.github.com/users/teaearlgraycold/gists{/gist_id}","starred_url":"https://api.github.com/users/teaearlgraycold/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/teaearlgraycold/subscriptions","organizations_url":"https://api.github.com/users/teaearlgraycold/orgs","repos_url":"https://api.github.com/users/teaearlgraycold/repos","events_url":"https://api.github.com/users/teaearlgraycold/events{/privacy}","received_events_url":"https://api.github.com/users/teaearlgraycold/received_events","type":"User","site_admin":false},"private":false,"html_url":"https://github.com/teaearlgraycold/tpot","description":"A Python tool that automatically creates and optimizes machine learning pipelines using genetic programming.","fork":true,"url":"https://api.github.com/repos/teaearlgraycold/tpot","forks_url":"https://api.github.com/repos/teaearlgraycold/tpot/forks","keys_url":"https://api.github.com/repos/teaearlgraycold/tpot/keys{/key_id}","collaborators_url":"https://api.github.com/repos/teaearlgraycold/tpot/collaborators{/collaborator}","teams_url":"https://api.github.com/repos/teaearlgraycold/tpot/teams","hooks_url":"https://api.github.com/repos/teaearlgraycold/tpot/hooks","issue_events_url":"https://api.github.com/repos/teaearlgraycold/tpot/issues/events{/number}","events_url":"https://api.github.com/repos/teaearlgraycold/tpot/events","assignees_url":"https://api.github.com/repos/teaearlgraycold/tpot/assignees{/user}","branches_url":"https://api.github.com/repos/teaearlgraycold/tpot/branches{/branch}","tags_url":"https://api.github.com/repos/teaearlgraycold/tpot/tags","blobs_url":"https://api.github.com/repos/teaearlgraycold/tpot/git/blobs{/sha}","git_tags_url":"https://api.github.com/repos/teaearlgraycold/tpot/git/tags{/sha}","git_refs_url":"https://api.github.com/repos/teaearlgraycold/tpot/git/refs{/sha}","trees_url":"https://api.github.com/repos/teaearlgraycold/tpot/git/trees{/sha}","statuses_url":"https://api.github.com/repos/teaearlgraycold/tpot/statuses/{sha}","languages_url":"https://api.github.com/repos/teaearlgraycold/tpot/languages","stargazers_url":"https://api.github.com/repos/teaearlgraycold/tpot/stargazers","contributors_url":"https://api.github.com/repos/teaearlgraycold/tpot/contributors","subscribers_url":"https://api.github.com/repos/teaearlgraycold/tpot/subscribers","subscription_url":"https://api.github.com/repos/teaearlgraycold/tpot/subscription","commits_url":"https://api.github.com/repos/teaearlgraycold/tpot/commits{/sha}","git_commits_url":"https://api.github.com/repos/teaearlgraycold/tpot/git/commits{/sha}","comments_url":"https://api.github.com/repos/teaearlgraycold/tpot/comments{/number}","issue_comment_url":"https://api.github.com/repos/teaearlgraycold/tpot/issues/comments{/number}","contents_url":"https://api.github.com/repos/teaearlgraycold/tpot/contents/{+path}","compare_url":"https://api.github.com/repos/teaearlgraycold/tpot/compare/{base}...{head}","merges_url":"https://api.github.com/repos/teaearlgraycold/tpot/merges","archive_url":"https://api.github.com/repos/teaearlgraycold/tpot/{archive_format}{/ref}","downloads_url":"https://api.github.com/repos/teaearlgraycold/tpot/downloads","issues_url":"https://api.github.com/repos/teaearlgraycold/tpot/issues{/number}","pulls_url":"https://api.github.com/repos/teaearlgraycold/tpot/pulls{/number}","milestones_url":"https://api.github.com/repos/teaearlgraycold/tpot/milestones{/number}","notifications_url":"https://api.github.com/repos/teaearlgraycold/tpot/notifications{?since,all,participating}","labels_url":"https://api.github.com/repos/teaearlgraycold/tpot/labels{/name}","releases_url":"https://api.github.com/repos/teaearlgraycold/tpot/releases{/id}","deployments_url":"https://api.github.com/repos/teaearlgraycold/tpot/deployments","created_at":"2016-03-25T20:26:36Z","updated_at":"2016-03-25T20:26:37Z","pushed_at":"2016-05-17T00:08:37Z","git_url":"git://github.com/teaearlgraycold/tpot.git","ssh_url":"git@github.com:teaearlgraycold/tpot.git","clone_url":"https://github.com/teaearlgraycold/tpot.git","svn_url":"https://github.com/teaearlgraycold/tpot","homepage":"http://rhiever.github.io/tpot/","size":3037,"stargazers_count":0,"watchers_count":0,"language":"Python","has_issues":false,"has_downloads":true,"has_wiki":true,"has_pages":true,"forks_count":0,"mirror_url":null,"open_issues_count":0,"forks":0,"open_issues":0,"watchers":0,"default_branch":"master"}},"base":{"label":"rhiever:master","ref":"master","sha":"bda254e4f43af5b71978dd9be010a97db4f3ffa0","user":{"login":"rhiever","id":1719223,"avatar_url":"https://avatars.githubusercontent.com/u/1719223?v=3","gravatar_id":"","url":"https://api.github.com/users/rhiever","html_url":"https://github.com/rhiever","followers_url":"https://api.github.com/users/rhiever/followers","following_url":"https://api.github.com/users/rhiever/following{/other_user}","gists_url":"https://api.github.com/users/rhiever/gists{/gist_id}","starred_url":"https://api.github.com/users/rhiever/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/rhiever/subscriptions","organizations_url":"https://api.github.com/users/rhiever/orgs","repos_url":"https://api.github.com/users/rhiever/repos","events_url":"https://api.github.com/users/rhiever/events{/privacy}","received_events_url":"https://api.github.com/users/rhiever/received_events","type":"User","site_admin":false},"repo":{"id":45495679,"name":"tpot","full_name":"rhiever/tpot","owner":{"login":"rhiever","id":1719223,"avatar_url":"https://avatars.githubusercontent.com/u/1719223?v=3","gravatar_id":"","url":"https://api.github.com/users/rhiever","html_url":"https://github.com/rhiever","followers_url":"https://api.github.com/users/rhiever/followers","following_url":"https://api.github.com/users/rhiever/following{/other_user}","gists_url":"https://api.github.com/users/rhiever/gists{/gist_id}","starred_url":"https://api.github.com/users/rhiever/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/rhiever/subscriptions","organizations_url":"https://api.github.com/users/rhiever/orgs","repos_url":"https://api.github.com/users/rhiever/repos","events_url":"https://api.github.com/users/rhiever/events{/privacy}","received_events_url":"https://api.github.com/users/rhiever/received_events","type":"User","site_admin":false},"private":false,"html_url":"https://github.com/rhiever/tpot","description":"A Python tool that automatically creates and optimizes machine learning pipelines using genetic programming.","fork":false,"url":"https://api.github.com/repos/rhiever/tpot","forks_url":"https://api.github.com/repos/rhiever/tpot/forks","keys_url":"https://api.github.com/repos/rhiever/tpot/keys{/key_id}","collaborators_url":"https://api.github.com/repos/rhiever/tpot/collaborators{/collaborator}","teams_url":"https://api.github.com/repos/rhiever/tpot/teams","hooks_url":"https://api.github.com/repos/rhiever/tpot/hooks","issue_events_url":"https://api.github.com/repos/rhiever/tpot/issues/events{/number}","events_url":"https://api.github.com/repos/rhiever/tpot/events","assignees_url":"https://api.github.com/repos/rhiever/tpot/assignees{/user}","branches_url":"https://api.github.com/repos/rhiever/tpot/branches{/branch}","tags_url":"https://api.github.com/repos/rhiever/tpot/tags","blobs_url":"https://api.github.com/repos/rhiever/tpot/git/blobs{/sha}","git_tags_url":"https://api.github.com/repos/rhiever/tpot/git/tags{/sha}","git_refs_url":"https://api.github.com/repos/rhiever/tpot/git/refs{/sha}","trees_url":"https://api.github.com/repos/rhiever/tpot/git/trees{/sha}","statuses_url":"https://api.github.com/repos/rhiever/tpot/statuses/{sha}","languages_url":"https://api.github.com/repos/rhiever/tpot/languages","stargazers_url":"https://api.github.com/repos/rhiever/tpot/stargazers","contributors_url":"https://api.github.com/repos/rhiever/tpot/contributors","subscribers_url":"https://api.github.com/repos/rhiever/tpot/subscribers","subscription_url":"https://api.github.com/repos/rhiever/tpot/subscription","commits_url":"https://api.github.com/repos/rhiever/tpot/commits{/sha}","git_commits_url":"https://api.github.com/repos/rhiever/tpot/git/commits{/sha}","comments_url":"https://api.github.com/repos/rhiever/tpot/comments{/number}","issue_comment_url":"https://api.github.com/repos/rhiever/tpot/issues/comments{/number}","contents_url":"https://api.github.com/repos/rhiever/tpot/contents/{+path}","compare_url":"https://api.github.com/repos/rhiever/tpot/compare/{base}...{head}","merges_url":"https://api.github.com/repos/rhiever/tpot/merges","archive_url":"https://api.github.com/repos/rhiever/tpot/{archive_format}{/ref}","downloads_url":"https://api.github.com/repos/rhiever/tpot/downloads","issues_url":"https://api.github.com/repos/rhiever/tpot/issues{/number}","pulls_url":"https://api.github.com/repos/rhiever/tpot/pulls{/number}","milestones_url":"https://api.github.com/repos/rhiever/tpot/milestones{/number}","notifications_url":"https://api.github.com/repos/rhiever/tpot/notifications{?since,all,participating}","labels_url":"https://api.github.com/repos/rhiever/tpot/labels{/name}","releases_url":"https://api.github.com/repos/rhiever/tpot/releases{/id}","deployments_url":"https://api.github.com/repos/rhiever/tpot/deployments","created_at":"2015-11-03T21:08:40Z","updated_at":"2016-05-17T09:17:10Z","pushed_at":"2016-05-17T00:08:37Z","git_url":"git://github.com/rhiever/tpot.git","ssh_url":"git@github.com:rhiever/tpot.git","clone_url":"https://github.com/rhiever/tpot.git","svn_url":"https://github.com/rhiever/tpot","homepage":"http://rhiever.github.io/tpot/","size":2914,"stargazers_count":960,"watchers_count":960,"language":"Python","has_issues":true,"has_downloads":true,"has_wiki":true,"has_pages":true,"forks_count":109,"mirror_url":null,"open_issues_count":33,"forks":109,"open_issues":33,"watchers":960,"default_branch":"master"}},"_links":{"self":{"href":"https://api.github.com/repos/rhiever/tpot/pulls/144"},"html":{"href":"https://github.com/rhiever/tpot/pull/144"},"issue":{"href":"https://api.github.com/repos/rhiever/tpot/issues/144"},"comments":{"href":"https://api.github.com/repos/rhiever/tpot/issues/144/comments"},"review_comments":{"href":"https://api.github.com/repos/rhiever/tpot/pulls/144/comments"},"review_comment":{"href":"https://api.github.com/repos/rhiever/tpot/pulls/comments{/number}"},"commits":{"href":"https://api.github.com/repos/rhiever/tpot/pulls/144/commits"},"statuses":{"href":"https://api.github.com/repos/rhiever/tpot/statuses/f92494496b259019d0a0793339901fa82c0b5c6f"}}}}