{"action":"created","issue":{"url":"https://api.github.com/repos/django-haystack/django-haystack/issues/1355","repository_url":"https://api.github.com/repos/django-haystack/django-haystack","labels_url":"https://api.github.com/repos/django-haystack/django-haystack/issues/1355/labels{/name}","comments_url":"https://api.github.com/repos/django-haystack/django-haystack/issues/1355/comments","events_url":"https://api.github.com/repos/django-haystack/django-haystack/issues/1355/events","html_url":"https://github.com/django-haystack/django-haystack/issues/1355","id":152023055,"number":1355,"title":"'update_index' command does not add indexes for all records","user":{"login":"richardasaurus","id":2279659,"avatar_url":"https://avatars.githubusercontent.com/u/2279659?v=3","gravatar_id":"","url":"https://api.github.com/users/richardasaurus","html_url":"https://github.com/richardasaurus","followers_url":"https://api.github.com/users/richardasaurus/followers","following_url":"https://api.github.com/users/richardasaurus/following{/other_user}","gists_url":"https://api.github.com/users/richardasaurus/gists{/gist_id}","starred_url":"https://api.github.com/users/richardasaurus/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/richardasaurus/subscriptions","organizations_url":"https://api.github.com/users/richardasaurus/orgs","repos_url":"https://api.github.com/users/richardasaurus/repos","events_url":"https://api.github.com/users/richardasaurus/events{/privacy}","received_events_url":"https://api.github.com/users/richardasaurus/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"milestone":null,"comments":1,"created_at":"2016-04-30T10:35:58Z","updated_at":"2016-04-30T12:42:49Z","closed_at":null,"body":"* [x] Tested with the latest Haystack release\r\n* [ ] Tested with the current Haystack master branch\r\n\r\n## Expected behaviour\r\n\r\nGiven `SomeModel` has 281870 records\r\nWhen I run `python manage.py update_index someapp.SomeModel -v 3 -k 20 --batch-size=1000`\r\nAnd it outputs:\r\n```\r\nIndexing 281870 somemodels\r\n  indexed 1 - 1000 of 281870 (by 25591).\r\n  indexed 3001 - 4000 of 281870 (by 25592).\r\n  indexed 6001 - 7000 of 281870 (by 25593).\r\n  indexed 9001 - 10000 of 281870 (by 25594).\r\n .... more lines here\r\n  indexed 275001 - 276000 of 281870 (by 25597).\r\n  indexed 272001 - 273000 of 281870 (by 25592).\r\n  indexed 278001 - 279000 of 281870 (by 25605).\r\n  indexed 269001 - 270000 of 281870 (by 25591).\r\n  indexed 281001 - 281870 of 281870 (by 25595).\r\n```\r\nThen 281870 items should be in the Search index\r\n\r\n## Actual behaviour\r\n\r\nWhen I run the above, it will only add ~10,000 Search index items\r\nIf i run it again, that number changes to 12,000\r\nIf i run it again, that number changes to 14,000\r\nand so on.\r\n\r\n## Steps to reproduce the behaviour\r\n\r\n1. install whoosh\r\n2. run `python manage.py update_index someapp.SomeModel -v 3 -k 20 --batch-size=1000`\r\n3. View Search index using https://github.com/kezabelle/django-haystackbrowser\r\n\r\n## Configuration\r\n\r\n* Operating system version: Ubuntu 14.04 lts\r\n* Search engine version:  Whoosh==2.7.4\r\n* Python version: Python 2.7.6\r\n* Django version: 1.8.12\r\n* Haystack version: 2.4.1"},"comment":{"url":"https://api.github.com/repos/django-haystack/django-haystack/issues/comments/215961205","html_url":"https://github.com/django-haystack/django-haystack/issues/1355#issuecomment-215961205","issue_url":"https://api.github.com/repos/django-haystack/django-haystack/issues/1355","id":215961205,"user":{"login":"richardasaurus","id":2279659,"avatar_url":"https://avatars.githubusercontent.com/u/2279659?v=3","gravatar_id":"","url":"https://api.github.com/users/richardasaurus","html_url":"https://github.com/richardasaurus","followers_url":"https://api.github.com/users/richardasaurus/followers","following_url":"https://api.github.com/users/richardasaurus/following{/other_user}","gists_url":"https://api.github.com/users/richardasaurus/gists{/gist_id}","starred_url":"https://api.github.com/users/richardasaurus/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/richardasaurus/subscriptions","organizations_url":"https://api.github.com/users/richardasaurus/orgs","repos_url":"https://api.github.com/users/richardasaurus/repos","events_url":"https://api.github.com/users/richardasaurus/events{/privacy}","received_events_url":"https://api.github.com/users/richardasaurus/received_events","type":"User","site_admin":false},"created_at":"2016-04-30T12:42:49Z","updated_at":"2016-04-30T12:42:49Z","body":"Ah, so if I don't specify the workers option `-k 20` then it works and indexes `281870` items. So I guess whoosh doesn't work with workers?"}}