{"action":"created","issue":{"url":"https://api.github.com/repos/saltstack/salt/issues/46868","repository_url":"https://api.github.com/repos/saltstack/salt","labels_url":"https://api.github.com/repos/saltstack/salt/issues/46868/labels{/name}","comments_url":"https://api.github.com/repos/saltstack/salt/issues/46868/comments","events_url":"https://api.github.com/repos/saltstack/salt/issues/46868/events","html_url":"https://github.com/saltstack/salt/issues/46868","id":311257736,"number":46868,"title":"2017.7.4 to 2018.3.0 upgrade issue: Salt request timed out. The master is not responding","user":{"login":"tjyang","id":378638,"avatar_url":"https://avatars1.githubusercontent.com/u/378638?v=4","gravatar_id":"","url":"https://api.github.com/users/tjyang","html_url":"https://github.com/tjyang","followers_url":"https://api.github.com/users/tjyang/followers","following_url":"https://api.github.com/users/tjyang/following{/other_user}","gists_url":"https://api.github.com/users/tjyang/gists{/gist_id}","starred_url":"https://api.github.com/users/tjyang/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/tjyang/subscriptions","organizations_url":"https://api.github.com/users/tjyang/orgs","repos_url":"https://api.github.com/users/tjyang/repos","events_url":"https://api.github.com/users/tjyang/events{/privacy}","received_events_url":"https://api.github.com/users/tjyang/received_events","type":"User","site_admin":false},"labels":[{"id":41387723,"url":"https://api.github.com/repos/saltstack/salt/labels/Bug","name":"Bug","color":"e11d21","default":false},{"id":41388135,"url":"https://api.github.com/repos/saltstack/salt/labels/High%20Severity","name":"High Severity","color":"ff9143","default":false},{"id":194766164,"url":"https://api.github.com/repos/saltstack/salt/labels/P1","name":"P1","color":"2181ee","default":false},{"id":158446523,"url":"https://api.github.com/repos/saltstack/salt/labels/ZD","name":"ZD","color":"e11d21","default":false}],"state":"open","locked":false,"assignee":{"login":"garethgreenaway","id":718525,"avatar_url":"https://avatars0.githubusercontent.com/u/718525?v=4","gravatar_id":"","url":"https://api.github.com/users/garethgreenaway","html_url":"https://github.com/garethgreenaway","followers_url":"https://api.github.com/users/garethgreenaway/followers","following_url":"https://api.github.com/users/garethgreenaway/following{/other_user}","gists_url":"https://api.github.com/users/garethgreenaway/gists{/gist_id}","starred_url":"https://api.github.com/users/garethgreenaway/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/garethgreenaway/subscriptions","organizations_url":"https://api.github.com/users/garethgreenaway/orgs","repos_url":"https://api.github.com/users/garethgreenaway/repos","events_url":"https://api.github.com/users/garethgreenaway/events{/privacy}","received_events_url":"https://api.github.com/users/garethgreenaway/received_events","type":"User","site_admin":false},"assignees":[{"login":"garethgreenaway","id":718525,"avatar_url":"https://avatars0.githubusercontent.com/u/718525?v=4","gravatar_id":"","url":"https://api.github.com/users/garethgreenaway","html_url":"https://github.com/garethgreenaway","followers_url":"https://api.github.com/users/garethgreenaway/followers","following_url":"https://api.github.com/users/garethgreenaway/following{/other_user}","gists_url":"https://api.github.com/users/garethgreenaway/gists{/gist_id}","starred_url":"https://api.github.com/users/garethgreenaway/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/garethgreenaway/subscriptions","organizations_url":"https://api.github.com/users/garethgreenaway/orgs","repos_url":"https://api.github.com/users/garethgreenaway/repos","events_url":"https://api.github.com/users/garethgreenaway/events{/privacy}","received_events_url":"https://api.github.com/users/garethgreenaway/received_events","type":"User","site_admin":false}],"milestone":{"url":"https://api.github.com/repos/saltstack/salt/milestones/13","html_url":"https://github.com/saltstack/salt/milestone/13","labels_url":"https://api.github.com/repos/saltstack/salt/milestones/13/labels","id":9265,"number":13,"title":"Approved","description":"All issues that are ready to be worked on, both bugs and features.","creator":{"login":"thatch45","id":507599,"avatar_url":"https://avatars0.githubusercontent.com/u/507599?v=4","gravatar_id":"","url":"https://api.github.com/users/thatch45","html_url":"https://github.com/thatch45","followers_url":"https://api.github.com/users/thatch45/followers","following_url":"https://api.github.com/users/thatch45/following{/other_user}","gists_url":"https://api.github.com/users/thatch45/gists{/gist_id}","starred_url":"https://api.github.com/users/thatch45/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/thatch45/subscriptions","organizations_url":"https://api.github.com/users/thatch45/orgs","repos_url":"https://api.github.com/users/thatch45/repos","events_url":"https://api.github.com/users/thatch45/events{/privacy}","received_events_url":"https://api.github.com/users/thatch45/received_events","type":"User","site_admin":false},"open_issues":2398,"closed_issues":7030,"state":"open","created_at":"2011-05-14T04:00:56Z","updated_at":"2018-04-11T01:01:55Z","due_on":null,"closed_at":null},"comments":59,"created_at":"2018-04-04T14:36:24Z","updated_at":"2018-04-11T08:50:03Z","closed_at":null,"author_association":"CONTRIBUTOR","body":"### Description of Issue/Question\r\nI have a standby saltmaster on saltstack 2017.7.4 and I am trying to upgrade it to 8.3.0 salt just released.\r\nAfter 8.3.0 upgrade, I am getting following issue.\r\n\r\n```\r\n[root@salt01 ~]# sudo salt minion01 test.version\r\nSalt request timed out. The master is not responding. \r\nYou may need to run your command with `--async` in order to bypass the congested event bus. \r\nWith `--async`, the CLI tool will print the job id (jid) and exit immediately without\r\n listening for responses.  You can then use `salt-run jobs.lookup_jid` to look up \r\nthe results of the job in the job cache later.\r\n[root@salt01 ~]#\r\n\r\n```\r\n### Setup\r\n(Please provide relevant configs and/or SLS files (Be sure to remove sensitive info).)\r\n\r\n### Steps to Reproduce Issue\r\n*  snapshot salt01 VM (VMware image) for backup.\r\n* disable  /etc/yum.repos.d/salt-latest.repo\r\n*  yum update -y && reboot\r\n* enable  /etc/yum.repos.d/salt-latest.repo\r\n*  yum update -y salt && reboot\r\n* run test.ping on all minions or just one minion\r\n\r\n```\r\n[root@salt01 ~]# sudo salt minion01 test.version\r\nSalt request timed out. The master is not responding. \r\nYou may need to run your command with `--async` in order to bypass \r\nthe congested event bus. With `--async`, the CLI tool will print the job id (jid) and \r\nexit immediately without listening for responses. You can then \r\nuse `salt-run jobs.lookup_jid` to look up the results of the job in the job cache later.\r\n[root@salt01 ~]#\r\n```\r\n* If I revert the salt01's VM image back to saltstack 7.4 version. this problem disappear. \r\n\r\n### Versions Report\r\n\r\n* errors in systemctl status -l salt-master.\r\n\r\n```\r\n[root@salt01 ~]# systemctl status -l salt-master\r\n? salt-master.service - The Salt Master Server\r\n   Loaded: loaded (/usr/lib/systemd/system/salt-master.service; enabled; vendor preset: disabled)\r\n   Active: active (running) since Wed 2018-04-04 09:08:33 CDT; 19min ago\r\n     Docs: man:salt-master(1)\r\n           file:///usr/share/doc/salt/html/contents.html\r\n           https://docs.saltstack.com/en/latest/contents.html\r\n Main PID: 1090 (salt-master)\r\n   CGroup: /system.slice/salt-master.service\r\n           +-1090 /usr/bin/python /usr/bin/salt-master\r\n           +-1480 /usr/bin/python /usr/bin/salt-master\r\n           +-1707 /usr/bin/python /usr/bin/salt-master\r\n           +-1708 /usr/bin/python /usr/bin/salt-master\r\n           +-1715 /usr/bin/python /usr/bin/salt-master\r\n           +-1716 /usr/bin/python /usr/bin/salt-master\r\n           +-1717 /usr/bin/python /usr/bin/salt-master\r\n           +-1718 /usr/bin/python /usr/bin/salt-master\r\n           +-1724 /usr/bin/python /usr/bin/salt-master\r\n           +-1726 /usr/bin/python /usr/bin/salt-master\r\n           +-1727 /usr/bin/python /usr/bin/salt-master\r\n           +-1728 /usr/bin/python /usr/bin/salt-master\r\n           +-1729 /usr/bin/python /usr/bin/salt-master\r\n           +-1730 /usr/bin/python /usr/bin/salt-master\r\n\r\nApr 04 09:12:15 salt01 salt-master[1090]: pub = salt.crypt.get_rsa_pub_key(pubfn)\r\nApr 04 09:12:15 salt01 salt-master[1090]: File \"/usr/lib/python2.7/site-packages/salt/crypt.py\", line 210, in get_rsa_pub_key\r\nApr 04 09:12:15 salt01 salt-master[1090]: key = RSA.load_pub_key(path)\r\nApr 04 09:12:15 salt01 salt-master[1090]: File \"/usr/lib64/python2.7/site-packages/M2Crypto/RSA.py\", line 406, in load_pub_key\r\nApr 04 09:12:15 salt01 salt-master[1090]: return load_pub_key_bio(bio)\r\nApr 04 09:12:15 salt01 salt-master[1090]: File \"/usr/lib64/python2.7/site-packages/M2Crypto/RSA.py\", line 422, in load_pub_key_bio\r\nApr 04 09:12:15 salt01 salt-master[1090]: rsa_error()\r\nApr 04 09:12:15 salt01 salt-master[1090]: File \"/usr/lib64/python2.7/site-packages/M2Crypto/RSA.py\", line 302, in rsa_error\r\nApr 04 09:12:15 salt01 salt-master[1090]: raise RSAError, m2.err_reason_error_string(m2.err_get_error())\r\nApr 04 09:12:15 salt01 salt-master[1090]: RSAError: no start line\r\n[root@salt01 ~]#\r\n\r\n```\r\n* version report\r\n```\r\n[root@salt01 ~]# salt --versions-report\r\nSalt Version:\r\n           Salt: 2018.3.0\r\n\r\nDependency Versions:\r\n           cffi: 1.6.0\r\n       cherrypy: unknown\r\n       dateutil: 1.5\r\n      docker-py: Not Installed\r\n          gitdb: 0.6.4\r\n      gitpython: 1.0.1\r\n          ioflo: 1.3.8\r\n         Jinja2: 2.7.2\r\n        libgit2: 0.24.6\r\n        libnacl: 1.4.3\r\n       M2Crypto: 0.21.1\r\n           Mako: 0.8.1\r\n   msgpack-pure: Not Installed\r\n msgpack-python: 0.5.1\r\n   mysql-python: 1.2.5\r\n      pycparser: 2.14\r\n       pycrypto: 2.6.1\r\n   pycryptodome: 3.4.3\r\n         pygit2: 0.24.2\r\n         Python: 2.7.5 (default, Aug  4 2017, 00:39:18)\r\n   python-gnupg: Not Installed\r\n         PyYAML: 3.11\r\n          PyZMQ: 15.3.0\r\n           RAET: Not Installed\r\n          smmap: 0.9.0\r\n        timelib: 0.2.4\r\n        Tornado: 4.2.1\r\n            ZMQ: 4.1.4\r\n\r\nSystem Versions:\r\n           dist: centos 7.4.1708 Core\r\n         locale: UTF-8\r\n        machine: x86_64\r\n        release: 3.10.0-693.21.1.el7.x86_64\r\n         system: Linux\r\n        version: CentOS Linux 7.4.1708 Core\r\n\r\n[root@salt01 ~]#\r\n\r\n```\r\n"},"comment":{"url":"https://api.github.com/repos/saltstack/salt/issues/comments/380377126","html_url":"https://github.com/saltstack/salt/issues/46868#issuecomment-380377126","issue_url":"https://api.github.com/repos/saltstack/salt/issues/46868","id":380377126,"user":{"login":"Cobra1978","id":33548070,"avatar_url":"https://avatars0.githubusercontent.com/u/33548070?v=4","gravatar_id":"","url":"https://api.github.com/users/Cobra1978","html_url":"https://github.com/Cobra1978","followers_url":"https://api.github.com/users/Cobra1978/followers","following_url":"https://api.github.com/users/Cobra1978/following{/other_user}","gists_url":"https://api.github.com/users/Cobra1978/gists{/gist_id}","starred_url":"https://api.github.com/users/Cobra1978/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/Cobra1978/subscriptions","organizations_url":"https://api.github.com/users/Cobra1978/orgs","repos_url":"https://api.github.com/users/Cobra1978/repos","events_url":"https://api.github.com/users/Cobra1978/events{/privacy}","received_events_url":"https://api.github.com/users/Cobra1978/received_events","type":"User","site_admin":false},"created_at":"2018-04-11T08:50:03Z","updated_at":"2018-04-11T08:50:03Z","author_association":"NONE","body":"@mtorromeo \r\nWait, for what i've seen having some keys with wrong header may cause the issue for all minions, so by now  i try to fix all the keys in my environment, and see if this fix or not."}}
{"actor":{"display_login":"Cobra1978"}}