{"action":"created","issue":{"url":"https://api.github.com/repos/magento/magento2/issues/5900","repository_url":"https://api.github.com/repos/magento/magento2","labels_url":"https://api.github.com/repos/magento/magento2/issues/5900/labels{/name}","comments_url":"https://api.github.com/repos/magento/magento2/issues/5900/comments","events_url":"https://api.github.com/repos/magento/magento2/issues/5900/events","html_url":"https://github.com/magento/magento2/issues/5900","id":168427140,"number":5900,"title":"Magneto 2.1.0 Indexing PHP \"Segmentation fault (core dumped)\" (Fix Me!)","user":{"login":"acidreian666","id":16370331,"avatar_url":"https://avatars.githubusercontent.com/u/16370331?v=3","gravatar_id":"","url":"https://api.github.com/users/acidreian666","html_url":"https://github.com/acidreian666","followers_url":"https://api.github.com/users/acidreian666/followers","following_url":"https://api.github.com/users/acidreian666/following{/other_user}","gists_url":"https://api.github.com/users/acidreian666/gists{/gist_id}","starred_url":"https://api.github.com/users/acidreian666/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/acidreian666/subscriptions","organizations_url":"https://api.github.com/users/acidreian666/orgs","repos_url":"https://api.github.com/users/acidreian666/repos","events_url":"https://api.github.com/users/acidreian666/events{/privacy}","received_events_url":"https://api.github.com/users/acidreian666/received_events","type":"User","site_admin":false},"labels":[{"url":"https://api.github.com/repos/magento/magento2/labels/bug%20report","name":"bug report","color":"d93f0b"}],"state":"open","locked":false,"assignee":null,"assignees":[],"milestone":null,"comments":9,"created_at":"2016-07-29T22:31:04Z","updated_at":"2016-09-21T18:04:28Z","closed_at":null,"body":"<!--- Provide a general summary of the issue in the Title above -->\r\n<!--- Before adding new issues, please, check this article https://github.com/magento/magento2/wiki/Issue-reporting-guidelines-->\r\n\r\nHaving a Large product database pushes the limits of Magento 2.\r\nMy full database is over 183,000 Products.\r\nImporting 30,000 products at a time and Indexing issue become relevant.\r\nAnything > then 30,000 products creates this error.\r\n### As noted at the bottom this issue does not occur on Magento 2.0.8 I have not been able to recreate this error. It only exists on Magento 2.1 & 2.2-dev.\r\n\r\n### Preconditions\r\n<!--- Provide a more detailed information of environment you use -->\r\n<!--- Magento version, tag, HEAD, etc., PHP & MySQL version, etc.. -->\r\n1. Install LEMP stack **Ubuntu 16.04** (Nginx1.10.0 PHP7.08-FPM Mysql 5.7)\r\n**(Also Seg Fault Exists on Debian 8.5 with Nginx php7.0.9-FPM MariaDB-10.0)**\r\n2. Setup Install Magento 2.1 via webinstaller\r\n3. Set mode Developer\r\n4. increase Memory limits and execution time for large product importing.( my config's found below)\r\n5. sudo php -f bin/magento Static-content Deploy | chmod -R 777 .  | chown -R www-data:www-data . \r\n6. sudo php -f bin/magento cache:disable\r\n7. sudo php -f bin/magento cache:flush\r\n8. sudo php -f bin/magento indexer:reindex\r\n\r\n### Steps to reproduce\r\n<!--- Provide a set of unambiguous steps to reproduce this bug include code, if relevant  -->\r\n1. Select & import 1-30k.csv ( import will take 5-10minutes and be successful then manually reindex will be successful)\r\n2. Select & import 30-60k.csv ( import will take 5-10minutes and be successful then manually reindex will Fail at catalogsearch_fulltext)\r\n3. Once \"Segmentation fault (core dumped)\" is reproduced run\r\n \"sudo php -f bin/magento indexer:reset\" to invalidate the index's to attempt another reindex.\r\n\r\n### Expected result\r\n<!--- Tell us what should happen -->\r\n1. Successful Reindex of catalogsearch_fulltext without a \"Segmentation fault (core dumped)\"\r\n\r\n### Actual result\r\n<!--- Tell us what happens instead -->\r\n1. Actual Result is \"Segmentation fault (core dumped)\"\r\n2. strace log via \"strace sudo php -f bin/magento indexer:reindex catalogsearch_fulltext\"\r\n[Seg fault.txt](https://github.com/magento/magento2/files/391627/Seg.fault.txt)\r\n\r\n### Trouble Shooting that I have done.\r\nThis is only an issue using Magento 2.1.\r\n\r\nTested with\r\nMagento 2.0.8 = No issues. tested with php7.08 & php5.6\r\nMagento 2.1 = Seg fault with php7.08 & php5.6\r\n### Updated\r\nMagento 2.2.0-dev that i pulled 7-30-16 also have the Seg Fault issue when indexing.\r\n\r\n![adb seg](https://cloud.githubusercontent.com/assets/16370331/17264876/12ae1912-55b8-11e6-99e3-953a2c08bfa5.png)\r\n![seg fault](https://cloud.githubusercontent.com/assets/16370331/17264882/1da8cc18-55b8-11e6-96f7-5157641873fc.png)\r\n\r\n### Below is the Config files used & 1-60,000 products csv files\r\n 1. Magento site config for nginx (remove .txt ext to use in sites available) \r\n[magento.txt](https://github.com/magento/magento2/files/391509/magento.txt)\r\n 2. php cli php.ini (change .txt to .ini)\r\n[php.txt](https://github.com/magento/magento2/files/391513/php.txt)\r\n 3. nginx config nginx.conf( remove .txt extension)\r\n[nginx.conf.txt](https://github.com/magento/magento2/files/391514/nginx.conf.txt)\r\n 4. mysqld.cnf( remove .txt extension)\r\n [mysqld.cnf.txt](https://github.com/magento/magento2/files/391515/mysqld.cnf.txt)\r\n 5. 1-30k.csv just random generated Product data( remove .txt extension)\r\n[1-30k.csv.txt](https://github.com/magento/magento2/files/391517/1-30k.csv.txt)\r\n 6. 30-60k.csv continuation of generated data for more product data( remove .txt extension)\r\n[30-60k.csv.txt](https://github.com/magento/magento2/files/391518/30-60k.csv.txt)\r\n\r\n### Don't open .csv files with Microsoft excel to edit or it removes the formatting and quotes from text. I used Note++ to fix formatting once i generated the .csv files\r\n\r\n\r\n\r\n\r\n"},"comment":{"url":"https://api.github.com/repos/magento/magento2/issues/comments/248693696","html_url":"https://github.com/magento/magento2/issues/5900#issuecomment-248693696","issue_url":"https://api.github.com/repos/magento/magento2/issues/5900","id":248693696,"user":{"login":"choukalos","id":145978,"avatar_url":"https://avatars.githubusercontent.com/u/145978?v=3","gravatar_id":"","url":"https://api.github.com/users/choukalos","html_url":"https://github.com/choukalos","followers_url":"https://api.github.com/users/choukalos/followers","following_url":"https://api.github.com/users/choukalos/following{/other_user}","gists_url":"https://api.github.com/users/choukalos/gists{/gist_id}","starred_url":"https://api.github.com/users/choukalos/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/choukalos/subscriptions","organizations_url":"https://api.github.com/users/choukalos/orgs","repos_url":"https://api.github.com/users/choukalos/repos","events_url":"https://api.github.com/users/choukalos/events{/privacy}","received_events_url":"https://api.github.com/users/choukalos/received_events","type":"User","site_admin":false},"created_at":"2016-09-21T18:04:28Z","updated_at":"2016-09-21T18:04:28Z","body":"Have you tried upping the temp table limit in MySQL?  I believe there's a similar bug that the teams are working where the work around is bumping that limit.  You might try bumping that to several GBs to see if that addresses the issue.  There's a bug being work that'll be back ported to 2.1.x that'll remove the need to bump temp table limit in MySQL.\r\n\r\n+1 for elastic search.  +1 for Smile - they've done some cool search work.  We've done some preliminary performance investigations around search and found that when you get more then a few concurrent search requests MySQL starts degrading (Elastic much higher concurrent limit before that happens).  In addition elastic has minimal growth/consistent retrieval times over catalog size where as MySQL linearly increases significantly as catalog size grows.  Our goal with the mysql adapter is to support hobbyist/small merchants (up to several $M in annual revenue for a small/medium catalog); beyond that Elasticsearch (or other option) is the way to go."}}
{"actor":{"display_login":"choukalos"}}