{"action":"created","issue":{"url":"https://api.github.com/repos/xcat2/xcat-core/issues/5398","repository_url":"https://api.github.com/repos/xcat2/xcat-core","labels_url":"https://api.github.com/repos/xcat2/xcat-core/issues/5398/labels{/name}","comments_url":"https://api.github.com/repos/xcat2/xcat-core/issues/5398/comments","events_url":"https://api.github.com/repos/xcat2/xcat-core/issues/5398/events","html_url":"https://github.com/xcat2/xcat-core/issues/5398","id":340545839,"node_id":"MDU6SXNzdWUzNDA1NDU4Mzk=","number":5398,"title":"[FVT]:rflash NODE <hpm_file_path> failed on IPMI managed node in some specific condition.","user":{"login":"tingtli","id":12440603,"node_id":"MDQ6VXNlcjEyNDQwNjAz","avatar_url":"https://avatars2.githubusercontent.com/u/12440603?v=4","gravatar_id":"","url":"https://api.github.com/users/tingtli","html_url":"https://github.com/tingtli","followers_url":"https://api.github.com/users/tingtli/followers","following_url":"https://api.github.com/users/tingtli/following{/other_user}","gists_url":"https://api.github.com/users/tingtli/gists{/gist_id}","starred_url":"https://api.github.com/users/tingtli/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/tingtli/subscriptions","organizations_url":"https://api.github.com/users/tingtli/orgs","repos_url":"https://api.github.com/users/tingtli/repos","events_url":"https://api.github.com/users/tingtli/events{/privacy}","received_events_url":"https://api.github.com/users/tingtli/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":{"login":"gurevichmark","id":16106630,"node_id":"MDQ6VXNlcjE2MTA2NjMw","avatar_url":"https://avatars1.githubusercontent.com/u/16106630?v=4","gravatar_id":"","url":"https://api.github.com/users/gurevichmark","html_url":"https://github.com/gurevichmark","followers_url":"https://api.github.com/users/gurevichmark/followers","following_url":"https://api.github.com/users/gurevichmark/following{/other_user}","gists_url":"https://api.github.com/users/gurevichmark/gists{/gist_id}","starred_url":"https://api.github.com/users/gurevichmark/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/gurevichmark/subscriptions","organizations_url":"https://api.github.com/users/gurevichmark/orgs","repos_url":"https://api.github.com/users/gurevichmark/repos","events_url":"https://api.github.com/users/gurevichmark/events{/privacy}","received_events_url":"https://api.github.com/users/gurevichmark/received_events","type":"User","site_admin":false},"assignees":[{"login":"gurevichmark","id":16106630,"node_id":"MDQ6VXNlcjE2MTA2NjMw","avatar_url":"https://avatars1.githubusercontent.com/u/16106630?v=4","gravatar_id":"","url":"https://api.github.com/users/gurevichmark","html_url":"https://github.com/gurevichmark","followers_url":"https://api.github.com/users/gurevichmark/followers","following_url":"https://api.github.com/users/gurevichmark/following{/other_user}","gists_url":"https://api.github.com/users/gurevichmark/gists{/gist_id}","starred_url":"https://api.github.com/users/gurevichmark/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/gurevichmark/subscriptions","organizations_url":"https://api.github.com/users/gurevichmark/orgs","repos_url":"https://api.github.com/users/gurevichmark/repos","events_url":"https://api.github.com/users/gurevichmark/events{/privacy}","received_events_url":"https://api.github.com/users/gurevichmark/received_events","type":"User","site_admin":false}],"milestone":{"url":"https://api.github.com/repos/xcat2/xcat-core/milestones/39","html_url":"https://github.com/xcat2/xcat-core/milestone/39","labels_url":"https://api.github.com/repos/xcat2/xcat-core/milestones/39/labels","id":3371697,"node_id":"MDk6TWlsZXN0b25lMzM3MTY5Nw==","number":39,"title":"2.14.2","description":"","creator":{"login":"zet809","id":8222144,"node_id":"MDQ6VXNlcjgyMjIxNDQ=","avatar_url":"https://avatars2.githubusercontent.com/u/8222144?v=4","gravatar_id":"","url":"https://api.github.com/users/zet809","html_url":"https://github.com/zet809","followers_url":"https://api.github.com/users/zet809/followers","following_url":"https://api.github.com/users/zet809/following{/other_user}","gists_url":"https://api.github.com/users/zet809/gists{/gist_id}","starred_url":"https://api.github.com/users/zet809/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/zet809/subscriptions","organizations_url":"https://api.github.com/users/zet809/orgs","repos_url":"https://api.github.com/users/zet809/repos","events_url":"https://api.github.com/users/zet809/events{/privacy}","received_events_url":"https://api.github.com/users/zet809/received_events","type":"User","site_admin":false},"open_issues":4,"closed_issues":99,"state":"open","created_at":"2018-05-24T09:29:59Z","updated_at":"2018-07-12T08:52:30Z","due_on":"2018-07-13T07:00:00Z","closed_at":null},"comments":1,"created_at":"2018-07-12T08:51:59Z","updated_at":"2018-07-12T15:59:49Z","closed_at":null,"author_association":"CONTRIBUTOR","body":"xCAT 2.14.2 \r\n\r\nHere is the steps to reproduce the defect.\r\n\r\n1. Check the firmeware level on test node\r\n```\r\n[root@boston01 ltt]# rflash mid21tor24cn02 -c\r\nmid21tor24cn02: Node firmware version for BOOT component:   2.13.104536\r\nmid21tor24cn02: Node firmware version for APP component:   2.13.104536\r\nmid21tor24cn02: Node firmware version for BIOS component:   1.12.85\r\n```\r\n\r\n2. Since node mid21tor24cn02 is in a very new firmware level, in order to test rflash, i first flash the firmware to  an old firmware level .\r\n```\r\n[root@boston01 ]# rflash mid21tor24cn02 /home/ltt/8335GTB_820.1642.20170405p.hpm\r\nmid21tor24cn02: rflash started, upgrade failure will be retried up to 2 times. Please wait...\r\nmid21tor24cn02: Success updating firmware.\r\n\r\n[root@boston01 ]# rflash mid21tor24cn02 /home/ltt/8335GTB_820.1642.20170405p.hpm -c\r\nHPM firmware version for BOOT component:  2.13.75\r\nHPM firmware version for APP  component:  2.13.75\r\nHPM firmware version for BIOS component:  1.12.114\r\nmid21tor24cn02: Node firmware version for BOOT component:   2.13.75\r\nmid21tor24cn02: Node firmware version for APP component:   2.13.75\r\nmid21tor24cn02: Node firmware version for BIOS component:   1.12.72\r\n```\r\n\r\n3. Then run rflash on node mid21tor24cn02 \r\n```\r\n[root@boston01 ltt]# rflash mid21tor24cn02 /mnt/xcat/iso/firmware/op820/820.1742.20180103o/8335_820.1742.20180103o.hpm --retry=5\r\nmid21tor24cn02: rflash started, upgrade failure will be retried up to 5 times. Please wait...\r\nmid21tor24cn02: Running attempt 5 of ipmitool command /opt/xcat/bin/ipmitool-xcat -H 172.17.24.2 -I lanplus -U ADMIN -P admin -z 15000 hpm upgrade /mnt/xcat/iso/firmware/op820/820.1742.20180103o/8335_820.1742.20180103o.hpm force  >/var/log/xcat/rflash/mid21tor24cn02.log 2>&1 failed with rc=1 and the following error messages:\r\n\r\nSee the /var/log/xcat/rflash/mid21tor24cn02.log for details.\r\nmid21tor24cn02: Firmware update failed, powering chassis on for a retry. This can take several minutes. 5 retries left ...\r\nmid21tor24cn02: Running attempt 4 of ipmitool command /opt/xcat/bin/ipmitool-xcat -H 172.17.24.2 -I lanplus -U ADMIN -P admin -z 15000 hpm upgrade /mnt/xcat/iso/firmware/op820/820.1742.20180103o/8335_820.1742.20180103o.hpm force  >/var/log/xcat/rflash/mid21tor24cn02.log 2>&1 failed with rc=1 and the following error messages:\r\n\r\nSee the /var/log/xcat/rflash/mid21tor24cn02.log for details.\r\nmid21tor24cn02: Firmware update failed, powering chassis on for a retry. This can take several minutes. 4 retries left ...\r\nmid21tor24cn02: Running attempt 3 of ipmitool command /opt/xcat/bin/ipmitool-xcat -H 172.17.24.2 -I lanplus -U ADMIN -P admin -z 15000 hpm upgrade /mnt/xcat/iso/firmware/op820/820.1742.20180103o/8335_820.1742.20180103o.hpm force  >/var/log/xcat/rflash/mid21tor24cn02.log 2>&1 failed with rc=1 and the following error messages:\r\n\r\nSee the /var/log/xcat/rflash/mid21tor24cn02.log for details.\r\nmid21tor24cn02: Firmware update failed, powering chassis on for a retry. This can take several minutes. 3 retries left ...\r\nmid21tor24cn02: Running attempt 2 of ipmitool command /opt/xcat/bin/ipmitool-xcat -H 172.17.24.2 -I lanplus -U ADMIN -P admin -z 15000 hpm upgrade /mnt/xcat/iso/firmware/op820/820.1742.20180103o/8335_820.1742.20180103o.hpm force  >/var/log/xcat/rflash/mid21tor24cn02.log 2>&1 failed with rc=1 and the following error messages:\r\n\r\nSee the /var/log/xcat/rflash/mid21tor24cn02.log for details.\r\nmid21tor24cn02: Firmware update failed, powering chassis on for a retry. This can take several minutes. 2 retries left ...\r\nmid21tor24cn02: Running attempt 1 of ipmitool command /opt/xcat/bin/ipmitool-xcat -H 172.17.24.2 -I lanplus -U ADMIN -P admin -z 15000 hpm upgrade /mnt/xcat/iso/firmware/op820/820.1742.20180103o/8335_820.1742.20180103o.hpm force  >/var/log/xcat/rflash/mid21tor24cn02.log 2>&1 failed with rc=1 and the following error messages:\r\n\r\nSee the /var/log/xcat/rflash/mid21tor24cn02.log for details.\r\nmid21tor24cn02: Firmware update failed, powering chassis on for a retry. This can take several minutes. 1 retries left ...\r\nError: [boston01]: mid21tor24cn02: Running ipmitool command /opt/xcat/bin/ipmitool-xcat -H 172.17.24.2 -I lanplus -U ADMIN -P admin -z 15000 hpm upgrade /mnt/xcat/iso/firmware/op820/820.1742.20180103o/8335_820.1742.20180103o.hpm force  >/var/log/xcat/rflash/mid21tor24cn02.log 2>&1 failed with rc=1 and the following error messages:\r\n\r\nSee the /var/log/xcat/rflash/mid21tor24cn02.log for details.\r\n[root@boston01 ltt]# echo $?\r\n1\r\n```\r\n\r\n4.  Here is the log information\r\n```\r\nPICMG HPM.1 Upgrade Agent 1.0.9:\r\n\r\nSetting large buffer to 15000\r\nValidating firmware image integrity...OK\r\nPerforming preparation stage...OK\r\n\r\nPerforming upgrade stage:\r\n\r\n-------------------------------------------------------------------------------\r\n|ID  | Name        |                     Versions                        | %  |\r\n|    |             |      Active     |      Backup     |      File       |    |\r\n|----|-------------|-----------------|-----------------|-----------------|----|\r\n|*  2|BIOS         |   1.12 48000000 | ---.-- -------- |   1.12 85000000 |  0%|^H^H^H^H^H  1%|^H^H^H^H^H  2%|^H^H^H^H^H  3%|^H^H^H^H^H  4%|^H^H^H^H^H  5%|^H^H^H^H^H  6%|^H^H^H^H^H  7%|^H^H^H^H^H  8%|^H^H^H^H^H  9%|^H^H^H^H^H 10%|^H^H^H^H^H 11%|^H^H^H^H^H 12%|^H^H^H^H^H 13%|^H^H^H^H^H 14%|^H^H^H^H^H 15%|^H^H^H^H^H 16%|^H^H^H^H^H 17%|^H^H^H^H^H 18%|^H^H^H^H^H 19%|^H^H^H^H^H 20%|^H^H^H^H^H 21%|^H^H^H^H^H 22%|^H^H^H^H^H 23%|^H^H^H^H^H 24%|^H^H^H^H^H 25%|^H^H^H^H^H 26%|^H^H^H^H^H 27%|^H^H^H^H^H 28%|^H^H^H^H^H 29%|^H^H^H^H^H 30%|^H^H^H^H^H 31%|^H^H^H^H^H 32%|^H^H^H^H^H 33%|^H^H^H^H^H 34%|^H^H^H^H^H 35%|^H^H^H^H^H 36%|^H^H^H^H^H 37%|^H^H^H^H^H 38%|^H^H^H^H^H 39%|^H^H^H^H^H 40%|^H^H^H^H^H 41%|^H^H^H^H^H 42%|^H^H^H^H^H 43%|^H^H^H^H^H 44%|^H^H^H^H^H 45%|^H^H^H^H^H 46%|^H^H^H^H^H 47%|^H^H^H^H^H 48%|^H^H^H^H^H 49%|^H^H^H^H^H 50%|^H^H^H^H^H 51%|^H^H^H^H^H 52%|^H^H^H^H^H 53%|^H^H^H^H^H 54%|^H^H^H^H^H 55%|^H^H^H^H^H 56%|^H^H^H^H^H 57%|^H^H^H^H^H 58%|^H^H^H^H^H 59%|^H^H^H^H^H 60%|^H^H^H^H^H 61%|^H^H^H^H^H 62%|^H^H^H^H^H 63%|^H^H^H^H^H 64%|^H^H^H^H^H 65%|^H^H^H^H^H 66%|^H^H^H^H^H 67%|^H^H^H^H^H 68%|^H^H^H^H^H 69%|^H^H^H^H^H 70%|^H^H^H^H^H 71%|^H^H^H^H^H 72%|^H^H^H^H^H 73%|^H^H^H^H^H 74%|^H^H^H^H^H 75%|^H^H^H^H^H 76%|^H^H^H^H^H 77%|^H^H^H^H^H 78%|^H^H^H^H^H 79%|^H^H^H^H^H 80%|^H^H^H^H^H 81%|^H^H^H^H^H 82%|^H^H^H^H^H 83%|^H^H^H^H^H 84%|^H^H^H^H^H 85%|^H^H^H^H^H 86%|^H^H^H^H^H 87%|^H^H^H^H^H 88%|^H^H^H^H^H 89%|^H^H^H^H^H 90%|^H^H^H^H^H 91%|^H^H^H^H^H 92%|^H^H^H^H^H 93%|^H^H^H^H^H 94%|^H^H^H^H^H 95%|^H^H^H^H^H 96%|^H^H^H^H^H 97%|^H^H^H^H^H 98%|^H^H^H^H^H 99%|^H^H^H^H^H100%|\r\n|    |Upload Time: 01:34             | Image Size: 67109016 bytes              |\r\n-------------------------------------------------------------------------------\r\n(*) Component requires Payload Cold Reset\r\nFirmware upgrade procedure failed\r\n```"},"comment":{"url":"https://api.github.com/repos/xcat2/xcat-core/issues/comments/404562720","html_url":"https://github.com/xcat2/xcat-core/issues/5398#issuecomment-404562720","issue_url":"https://api.github.com/repos/xcat2/xcat-core/issues/5398","id":404562720,"node_id":"MDEyOklzc3VlQ29tbWVudDQwNDU2MjcyMA==","user":{"login":"gurevichmark","id":16106630,"node_id":"MDQ6VXNlcjE2MTA2NjMw","avatar_url":"https://avatars1.githubusercontent.com/u/16106630?v=4","gravatar_id":"","url":"https://api.github.com/users/gurevichmark","html_url":"https://github.com/gurevichmark","followers_url":"https://api.github.com/users/gurevichmark/followers","following_url":"https://api.github.com/users/gurevichmark/following{/other_user}","gists_url":"https://api.github.com/users/gurevichmark/gists{/gist_id}","starred_url":"https://api.github.com/users/gurevichmark/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/gurevichmark/subscriptions","organizations_url":"https://api.github.com/users/gurevichmark/orgs","repos_url":"https://api.github.com/users/gurevichmark/repos","events_url":"https://api.github.com/users/gurevichmark/events{/privacy}","received_events_url":"https://api.github.com/users/gurevichmark/received_events","type":"User","site_admin":false},"created_at":"2018-07-12T15:59:49Z","updated_at":"2018-07-12T15:59:49Z","author_association":"CONTRIBUTOR","body":"Running with `-V` flag we see this error. Need to find out what that means:\r\n```\r\nError response 0xc1 from Get PICMG Properities\r\n?????  1%|\r\n:\r\n:\r\n?????  99%|\r\n\r\n|Error waiting for command 33, compcode = 83\r\n```"}}
{"actor":{"display_login":"gurevichmark"}}