{"action":"created","issue":{"url":"https://api.github.com/repos/phoronix-test-suite/phoronix-test-suite/issues/262","repository_url":"https://api.github.com/repos/phoronix-test-suite/phoronix-test-suite","labels_url":"https://api.github.com/repos/phoronix-test-suite/phoronix-test-suite/issues/262/labels{/name}","comments_url":"https://api.github.com/repos/phoronix-test-suite/phoronix-test-suite/issues/262/comments","events_url":"https://api.github.com/repos/phoronix-test-suite/phoronix-test-suite/issues/262/events","html_url":"https://github.com/phoronix-test-suite/phoronix-test-suite/issues/262","id":329116406,"node_id":"MDU6SXNzdWUzMjkxMTY0MDY=","number":262,"title":"Phoromatic: Test Reinstallation","user":{"login":"swarth100","id":30648953,"node_id":"MDQ6VXNlcjMwNjQ4OTUz","avatar_url":"https://avatars2.githubusercontent.com/u/30648953?v=4","gravatar_id":"","url":"https://api.github.com/users/swarth100","html_url":"https://github.com/swarth100","followers_url":"https://api.github.com/users/swarth100/followers","following_url":"https://api.github.com/users/swarth100/following{/other_user}","gists_url":"https://api.github.com/users/swarth100/gists{/gist_id}","starred_url":"https://api.github.com/users/swarth100/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/swarth100/subscriptions","organizations_url":"https://api.github.com/users/swarth100/orgs","repos_url":"https://api.github.com/users/swarth100/repos","events_url":"https://api.github.com/users/swarth100/events{/privacy}","received_events_url":"https://api.github.com/users/swarth100/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"assignees":[],"milestone":null,"comments":0,"created_at":"2018-06-04T15:55:31Z","updated_at":"2018-06-09T14:35:39Z","closed_at":null,"author_association":"CONTRIBUTOR","body":"When enabling the following option:\r\n\"For all test schedules, force the test installation/re-installation of tests each time prior to running the test.\"\r\nPhoromatic will force the reinstallation of the `installed-tests` directory. Yet the test source files from within the `test-profile` directory are never changed.\r\n\r\nWhat I would suggest is to wipe clean the `test-profiles` directory as well, meaning that a brand new test source is pulled from the Phoromatic Server at each run, ensuring that the actual latest test sources are compiled and run.\r\n\r\n- - -\r\nI am suggesting this because currently due to #255 and #260 it is very painful to attempt to deploy newer versions for tests, as all the test suites must be updated, yet that operation resets them.\r\nI am hence currently simply updating the same test's version over and over, and I am forced to clean the `test-profiles` directory of each client before each run.\r\n... Is there a smarter way to do this?"},"comment":{"url":"https://api.github.com/repos/phoronix-test-suite/phoronix-test-suite/issues/comments/395974105","html_url":"https://github.com/phoronix-test-suite/phoronix-test-suite/issues/262#issuecomment-395974105","issue_url":"https://api.github.com/repos/phoronix-test-suite/phoronix-test-suite/issues/262","id":395974105,"node_id":"MDEyOklzc3VlQ29tbWVudDM5NTk3NDEwNQ==","user":{"login":"michaellarabel","id":6035554,"node_id":"MDQ6VXNlcjYwMzU1NTQ=","avatar_url":"https://avatars1.githubusercontent.com/u/6035554?v=4","gravatar_id":"","url":"https://api.github.com/users/michaellarabel","html_url":"https://github.com/michaellarabel","followers_url":"https://api.github.com/users/michaellarabel/followers","following_url":"https://api.github.com/users/michaellarabel/following{/other_user}","gists_url":"https://api.github.com/users/michaellarabel/gists{/gist_id}","starred_url":"https://api.github.com/users/michaellarabel/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/michaellarabel/subscriptions","organizations_url":"https://api.github.com/users/michaellarabel/orgs","repos_url":"https://api.github.com/users/michaellarabel/repos","events_url":"https://api.github.com/users/michaellarabel/events{/privacy}","received_events_url":"https://api.github.com/users/michaellarabel/received_events","type":"User","site_admin":false},"created_at":"2018-06-09T14:35:39Z","updated_at":"2018-06-09T14:35:39Z","author_association":"MEMBER","body":"Generally at least from the OpenBenchmarking.org concept, whenever a test profile is changed on OpenBenchmarking.org, it's version is always bumped. That's how the versioning is handled rather than always wiping and re-downloading test profile metadata and/or querying Openbenchmarking.org to see what the checksums of the test profiles are.\r\n\r\nRight now for local test profiles via the Phoromatic Server it doesn't make the enforcement where when you modify a test profile that you bump the test profile version, but that's what I would suggest and would address this issue of having a potentially outdated test profile unknowingly.\r\n\r\nA bit on the test profile versioning is explained @ https://github.com/phoronix-test-suite/test-profiles in the readme. \r\n\r\nBut will do some thinking if there is an easy/efficient way of addressing a scenario like yours, etc."}}
{"actor":{"display_login":"michaellarabel"}}