{"action":"created","issue":{"url":"https://api.github.com/repos/synfig/synfig/issues/634","repository_url":"https://api.github.com/repos/synfig/synfig","labels_url":"https://api.github.com/repos/synfig/synfig/issues/634/labels{/name}","comments_url":"https://api.github.com/repos/synfig/synfig/issues/634/comments","events_url":"https://api.github.com/repos/synfig/synfig/issues/634/events","html_url":"https://github.com/synfig/synfig/issues/634","id":365799874,"node_id":"MDU6SXNzdWUzNjU3OTk4NzQ=","number":634,"title":"Regression testing for rendering engine","user":{"login":"morevnaproject","id":332868,"node_id":"MDQ6VXNlcjMzMjg2OA==","avatar_url":"https://avatars3.githubusercontent.com/u/332868?v=4","gravatar_id":"","url":"https://api.github.com/users/morevnaproject","html_url":"https://github.com/morevnaproject","followers_url":"https://api.github.com/users/morevnaproject/followers","following_url":"https://api.github.com/users/morevnaproject/following{/other_user}","gists_url":"https://api.github.com/users/morevnaproject/gists{/gist_id}","starred_url":"https://api.github.com/users/morevnaproject/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/morevnaproject/subscriptions","organizations_url":"https://api.github.com/users/morevnaproject/orgs","repos_url":"https://api.github.com/users/morevnaproject/repos","events_url":"https://api.github.com/users/morevnaproject/events{/privacy}","received_events_url":"https://api.github.com/users/morevnaproject/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"assignees":[],"milestone":null,"comments":16,"created_at":"2018-10-02T08:52:53Z","updated_at":"2018-10-26T07:10:34Z","closed_at":null,"author_association":"MEMBER","body":"We need a test script which identifies regressions in Synfig's render engine. \r\n\r\nThe script should render a set of sample files using latest version of Synfig and then compare the resulting images against the reference data. \r\n\r\nIn perspective it would be nice to measure performance and provide statistics, so we can identify performance drops or boosts from version to version.\r\n\r\n<bountysource-plugin>\r\n\r\n---\r\nWant to back this issue? **[Post a bounty on it!](https://www.bountysource.com/issues/64151139-regression-testing-for-rendering-engine?utm_campaign=plugin&utm_content=tracker%2F321991&utm_medium=issues&utm_source=github)** We accept bounties via [Bountysource](https://www.bountysource.com/?utm_campaign=plugin&utm_content=tracker%2F321991&utm_medium=issues&utm_source=github).\r\n</bountysource-plugin>"},"comment":{"url":"https://api.github.com/repos/synfig/synfig/issues/comments/433309796","html_url":"https://github.com/synfig/synfig/issues/634#issuecomment-433309796","issue_url":"https://api.github.com/repos/synfig/synfig/issues/634","id":433309796,"node_id":"MDEyOklzc3VlQ29tbWVudDQzMzMwOTc5Ng==","user":{"login":"morevnaproject","id":332868,"node_id":"MDQ6VXNlcjMzMjg2OA==","avatar_url":"https://avatars3.githubusercontent.com/u/332868?v=4","gravatar_id":"","url":"https://api.github.com/users/morevnaproject","html_url":"https://github.com/morevnaproject","followers_url":"https://api.github.com/users/morevnaproject/followers","following_url":"https://api.github.com/users/morevnaproject/following{/other_user}","gists_url":"https://api.github.com/users/morevnaproject/gists{/gist_id}","starred_url":"https://api.github.com/users/morevnaproject/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/morevnaproject/subscriptions","organizations_url":"https://api.github.com/users/morevnaproject/orgs","repos_url":"https://api.github.com/users/morevnaproject/repos","events_url":"https://api.github.com/users/morevnaproject/events{/privacy}","received_events_url":"https://api.github.com/users/morevnaproject/received_events","type":"User","site_admin":false},"created_at":"2018-10-26T07:10:34Z","updated_at":"2018-10-26T07:10:34Z","author_association":"MEMBER","body":"So, it looks like this task is done? Now all we have to do is to fill the testing engine with appropriate tests.\r\n\r\nBTW, the test engine already identified one difference in behavior of rendering engines for CheckerBoard Layer - https://travis-ci.com/synfig/synfig/jobs/154369637\r\nI do not call this \"regression\", since the behavior of current rendering engine is more correct (it gives correct image of checkerboard when size->0). \r\n\r\nSo, that raises a question:\r\nI would like to identify the test file - layers/checkerboard/checkerboard-origin-0-size-0.sif - as correctly rendered with CURRENT code.\r\nI.e., I need a new reference file, generated by current Synfig code (which is not released as any version yet). How can we achieve this? @reSHARMA any thoughts?"}}
{"actor":{"display_login":"morevnaproject"}}