{"action":"created","comment":{"url":"https://api.github.com/repos/geodynamics/aspect/pulls/comments/76488742","id":76488742,"diff_hunk":"@@ -10036,6 +10036,49 @@ \\subsection{Extending the basic solver}\n \\cite{BHK07,BK99m}.}\n \n \n+\\subsection{Testing \\aspect}\n+\\label{sec:testing}\n+\n+\\aspect{} makes use of a large suite of tests to ensure correct behavior.\n+\n+\\subsubsection{Running tests}\n+\\label{sec:running_tests}\n+\n+In order to run the tests, it is necessary to have either Diff or Numdiff to\n+compare the results to the known good case. While it is possible to use Diff,\n+Numdiff is preferred due to being able to more accurately identify whether a\n+variation in numerical output is significant.\n+\n+To run a set of tests, go to the build directory and execute \n+\n+\\begin{verbatim}\n+    ctest -R\n+\\end{verbatim}\n+\n+This will run all of the existing tests. To only part of the test suite, it is\n+possible to supply a regex that will select the names of the desired tests as\n+follows\n+\n+\\begin{verbatim}\n+    ctest -R <regex>\n+\\end{verbatim}\n+\n+\n+\\subsubsection{Writing tests}\n+\\label{sec:writing_tests}\n+\n+% Copied from email response by gassmoeller, and adjusted\n+\n+To write a test for a new feature, take one of the existing parameter files in\n+the tests/ directory, modify it to use the new feature, check that the new\n+feature does what it is supposed to do, and then just add the parameter file to\n+the tests directory. You will then need to add another folder to that directory\n+that is named like the parameter file, and add the model output files that\n+prove that the feature is working (rename log.txt to screen-output for\n+historical reasons). The test and output files should be as small and quick to\n+run as possible.","path":"doc/manual/manual.tex","position":44,"original_position":44,"commit_id":"6a9d9c2fdb9db3b66a93bd1a2fad109ffbb1c30d","original_commit_id":"6a9d9c2fdb9db3b66a93bd1a2fad109ffbb1c30d","user":{"login":"gassmoeller","id":7582930,"avatar_url":"https://avatars.githubusercontent.com/u/7582930?v=3","gravatar_id":"","url":"https://api.github.com/users/gassmoeller","html_url":"https://github.com/gassmoeller","followers_url":"https://api.github.com/users/gassmoeller/followers","following_url":"https://api.github.com/users/gassmoeller/following{/other_user}","gists_url":"https://api.github.com/users/gassmoeller/gists{/gist_id}","starred_url":"https://api.github.com/users/gassmoeller/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/gassmoeller/subscriptions","organizations_url":"https://api.github.com/users/gassmoeller/orgs","repos_url":"https://api.github.com/users/gassmoeller/repos","events_url":"https://api.github.com/users/gassmoeller/events{/privacy}","received_events_url":"https://api.github.com/users/gassmoeller/received_events","type":"User","site_admin":false},"body":"Here it might be added that the reference test machine might produce slightly different results due to differing libraries, operating systems, and so on. If that happens the reference tester will produce a .diff file on the page of the Github pull request that can be used to modify the checked in test results and resubmit the test results.","created_at":"2016-08-26T21:11:30Z","updated_at":"2016-08-26T21:11:30Z","html_url":"https://github.com/geodynamics/aspect/pull/1168#discussion_r76488742","pull_request_url":"https://api.github.com/repos/geodynamics/aspect/pulls/1168","_links":{"self":{"href":"https://api.github.com/repos/geodynamics/aspect/pulls/comments/76488742"},"html":{"href":"https://github.com/geodynamics/aspect/pull/1168#discussion_r76488742"},"pull_request":{"href":"https://api.github.com/repos/geodynamics/aspect/pulls/1168"}}},"pull_request":{"url":"https://api.github.com/repos/geodynamics/aspect/pulls/1168","id":81359908,"html_url":"https://github.com/geodynamics/aspect/pull/1168","diff_url":"https://github.com/geodynamics/aspect/pull/1168.diff","patch_url":"https://github.com/geodynamics/aspect/pull/1168.patch","issue_url":"https://api.github.com/repos/geodynamics/aspect/issues/1168","number":1168,"state":"open","locked":false,"title":"[WIP] Manual entry for tests","user":{"login":"class4kayaker","id":1050493,"avatar_url":"https://avatars.githubusercontent.com/u/1050493?v=3","gravatar_id":"","url":"https://api.github.com/users/class4kayaker","html_url":"https://github.com/class4kayaker","followers_url":"https://api.github.com/users/class4kayaker/followers","following_url":"https://api.github.com/users/class4kayaker/following{/other_user}","gists_url":"https://api.github.com/users/class4kayaker/gists{/gist_id}","starred_url":"https://api.github.com/users/class4kayaker/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/class4kayaker/subscriptions","organizations_url":"https://api.github.com/users/class4kayaker/orgs","repos_url":"https://api.github.com/users/class4kayaker/repos","events_url":"https://api.github.com/users/class4kayaker/events{/privacy}","received_events_url":"https://api.github.com/users/class4kayaker/received_events","type":"User","site_admin":false},"body":"Add entry suggested by #1140\r\n\r\nThis is a sparse skeleton manual entry for writing and running tests. I have assumed that the section on tests is best included under the section for extending aspect.","created_at":"2016-08-15T19:16:22Z","updated_at":"2016-08-26T21:11:30Z","closed_at":null,"merged_at":null,"merge_commit_sha":"7614f2e93eba52f5cabc08aaeef465cc3f90d36f","assignee":null,"assignees":[],"milestone":null,"commits_url":"https://api.github.com/repos/geodynamics/aspect/pulls/1168/commits","review_comments_url":"https://api.github.com/repos/geodynamics/aspect/pulls/1168/comments","review_comment_url":"https://api.github.com/repos/geodynamics/aspect/pulls/comments{/number}","comments_url":"https://api.github.com/repos/geodynamics/aspect/issues/1168/comments","statuses_url":"https://api.github.com/repos/geodynamics/aspect/statuses/6a9d9c2fdb9db3b66a93bd1a2fad109ffbb1c30d","head":{"label":"class4kayaker:manual_test_entry","ref":"manual_test_entry","sha":"6a9d9c2fdb9db3b66a93bd1a2fad109ffbb1c30d","user":{"login":"class4kayaker","id":1050493,"avatar_url":"https://avatars.githubusercontent.com/u/1050493?v=3","gravatar_id":"","url":"https://api.github.com/users/class4kayaker","html_url":"https://github.com/class4kayaker","followers_url":"https://api.github.com/users/class4kayaker/followers","following_url":"https://api.github.com/users/class4kayaker/following{/other_user}","gists_url":"https://api.github.com/users/class4kayaker/gists{/gist_id}","starred_url":"https://api.github.com/users/class4kayaker/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/class4kayaker/subscriptions","organizations_url":"https://api.github.com/users/class4kayaker/orgs","repos_url":"https://api.github.com/users/class4kayaker/repos","events_url":"https://api.github.com/users/class4kayaker/events{/privacy}","received_events_url":"https://api.github.com/users/class4kayaker/received_events","type":"User","site_admin":false},"repo":{"id":53872697,"name":"aspect","full_name":"class4kayaker/aspect","owner":{"login":"class4kayaker","id":1050493,"avatar_url":"https://avatars.githubusercontent.com/u/1050493?v=3","gravatar_id":"","url":"https://api.github.com/users/class4kayaker","html_url":"https://github.com/class4kayaker","followers_url":"https://api.github.com/users/class4kayaker/followers","following_url":"https://api.github.com/users/class4kayaker/following{/other_user}","gists_url":"https://api.github.com/users/class4kayaker/gists{/gist_id}","starred_url":"https://api.github.com/users/class4kayaker/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/class4kayaker/subscriptions","organizations_url":"https://api.github.com/users/class4kayaker/orgs","repos_url":"https://api.github.com/users/class4kayaker/repos","events_url":"https://api.github.com/users/class4kayaker/events{/privacy}","received_events_url":"https://api.github.com/users/class4kayaker/received_events","type":"User","site_admin":false},"private":false,"html_url":"https://github.com/class4kayaker/aspect","description":"A parallel, extendible finite element code to simulate thermal convection in both 2D and 3D models.","fork":true,"url":"https://api.github.com/repos/class4kayaker/aspect","forks_url":"https://api.github.com/repos/class4kayaker/aspect/forks","keys_url":"https://api.github.com/repos/class4kayaker/aspect/keys{/key_id}","collaborators_url":"https://api.github.com/repos/class4kayaker/aspect/collaborators{/collaborator}","teams_url":"https://api.github.com/repos/class4kayaker/aspect/teams","hooks_url":"https://api.github.com/repos/class4kayaker/aspect/hooks","issue_events_url":"https://api.github.com/repos/class4kayaker/aspect/issues/events{/number}","events_url":"https://api.github.com/repos/class4kayaker/aspect/events","assignees_url":"https://api.github.com/repos/class4kayaker/aspect/assignees{/user}","branches_url":"https://api.github.com/repos/class4kayaker/aspect/branches{/branch}","tags_url":"https://api.github.com/repos/class4kayaker/aspect/tags","blobs_url":"https://api.github.com/repos/class4kayaker/aspect/git/blobs{/sha}","git_tags_url":"https://api.github.com/repos/class4kayaker/aspect/git/tags{/sha}","git_refs_url":"https://api.github.com/repos/class4kayaker/aspect/git/refs{/sha}","trees_url":"https://api.github.com/repos/class4kayaker/aspect/git/trees{/sha}","statuses_url":"https://api.github.com/repos/class4kayaker/aspect/statuses/{sha}","languages_url":"https://api.github.com/repos/class4kayaker/aspect/languages","stargazers_url":"https://api.github.com/repos/class4kayaker/aspect/stargazers","contributors_url":"https://api.github.com/repos/class4kayaker/aspect/contributors","subscribers_url":"https://api.github.com/repos/class4kayaker/aspect/subscribers","subscription_url":"https://api.github.com/repos/class4kayaker/aspect/subscription","commits_url":"https://api.github.com/repos/class4kayaker/aspect/commits{/sha}","git_commits_url":"https://api.github.com/repos/class4kayaker/aspect/git/commits{/sha}","comments_url":"https://api.github.com/repos/class4kayaker/aspect/comments{/number}","issue_comment_url":"https://api.github.com/repos/class4kayaker/aspect/issues/comments{/number}","contents_url":"https://api.github.com/repos/class4kayaker/aspect/contents/{+path}","compare_url":"https://api.github.com/repos/class4kayaker/aspect/compare/{base}...{head}","merges_url":"https://api.github.com/repos/class4kayaker/aspect/merges","archive_url":"https://api.github.com/repos/class4kayaker/aspect/{archive_format}{/ref}","downloads_url":"https://api.github.com/repos/class4kayaker/aspect/downloads","issues_url":"https://api.github.com/repos/class4kayaker/aspect/issues{/number}","pulls_url":"https://api.github.com/repos/class4kayaker/aspect/pulls{/number}","milestones_url":"https://api.github.com/repos/class4kayaker/aspect/milestones{/number}","notifications_url":"https://api.github.com/repos/class4kayaker/aspect/notifications{?since,all,participating}","labels_url":"https://api.github.com/repos/class4kayaker/aspect/labels{/name}","releases_url":"https://api.github.com/repos/class4kayaker/aspect/releases{/id}","deployments_url":"https://api.github.com/repos/class4kayaker/aspect/deployments","created_at":"2016-03-14T16:28:54Z","updated_at":"2016-08-04T00:25:22Z","pushed_at":"2016-08-26T00:32:19Z","git_url":"git://github.com/class4kayaker/aspect.git","ssh_url":"git@github.com:class4kayaker/aspect.git","clone_url":"https://github.com/class4kayaker/aspect.git","svn_url":"https://github.com/class4kayaker/aspect","homepage":"http://aspect.dealii.org/","size":135751,"stargazers_count":0,"watchers_count":0,"language":"Gnuplot","has_issues":false,"has_downloads":true,"has_wiki":true,"has_pages":false,"forks_count":0,"mirror_url":null,"open_issues_count":0,"forks":0,"open_issues":0,"watchers":0,"default_branch":"master"}},"base":{"label":"geodynamics:master","ref":"master","sha":"f2b8ef86eacd6cbfa32b4a11cd7bd7d78bed746c","user":{"login":"geodynamics","id":4052461,"avatar_url":"https://avatars.githubusercontent.com/u/4052461?v=3","gravatar_id":"","url":"https://api.github.com/users/geodynamics","html_url":"https://github.com/geodynamics","followers_url":"https://api.github.com/users/geodynamics/followers","following_url":"https://api.github.com/users/geodynamics/following{/other_user}","gists_url":"https://api.github.com/users/geodynamics/gists{/gist_id}","starred_url":"https://api.github.com/users/geodynamics/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/geodynamics/subscriptions","organizations_url":"https://api.github.com/users/geodynamics/orgs","repos_url":"https://api.github.com/users/geodynamics/repos","events_url":"https://api.github.com/users/geodynamics/events{/privacy}","received_events_url":"https://api.github.com/users/geodynamics/received_events","type":"Organization","site_admin":false},"repo":{"id":19502452,"name":"aspect","full_name":"geodynamics/aspect","owner":{"login":"geodynamics","id":4052461,"avatar_url":"https://avatars.githubusercontent.com/u/4052461?v=3","gravatar_id":"","url":"https://api.github.com/users/geodynamics","html_url":"https://github.com/geodynamics","followers_url":"https://api.github.com/users/geodynamics/followers","following_url":"https://api.github.com/users/geodynamics/following{/other_user}","gists_url":"https://api.github.com/users/geodynamics/gists{/gist_id}","starred_url":"https://api.github.com/users/geodynamics/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/geodynamics/subscriptions","organizations_url":"https://api.github.com/users/geodynamics/orgs","repos_url":"https://api.github.com/users/geodynamics/repos","events_url":"https://api.github.com/users/geodynamics/events{/privacy}","received_events_url":"https://api.github.com/users/geodynamics/received_events","type":"Organization","site_admin":false},"private":false,"html_url":"https://github.com/geodynamics/aspect","description":"A parallel, extendible finite element code to simulate thermal convection in both 2D and 3D models.","fork":false,"url":"https://api.github.com/repos/geodynamics/aspect","forks_url":"https://api.github.com/repos/geodynamics/aspect/forks","keys_url":"https://api.github.com/repos/geodynamics/aspect/keys{/key_id}","collaborators_url":"https://api.github.com/repos/geodynamics/aspect/collaborators{/collaborator}","teams_url":"https://api.github.com/repos/geodynamics/aspect/teams","hooks_url":"https://api.github.com/repos/geodynamics/aspect/hooks","issue_events_url":"https://api.github.com/repos/geodynamics/aspect/issues/events{/number}","events_url":"https://api.github.com/repos/geodynamics/aspect/events","assignees_url":"https://api.github.com/repos/geodynamics/aspect/assignees{/user}","branches_url":"https://api.github.com/repos/geodynamics/aspect/branches{/branch}","tags_url":"https://api.github.com/repos/geodynamics/aspect/tags","blobs_url":"https://api.github.com/repos/geodynamics/aspect/git/blobs{/sha}","git_tags_url":"https://api.github.com/repos/geodynamics/aspect/git/tags{/sha}","git_refs_url":"https://api.github.com/repos/geodynamics/aspect/git/refs{/sha}","trees_url":"https://api.github.com/repos/geodynamics/aspect/git/trees{/sha}","statuses_url":"https://api.github.com/repos/geodynamics/aspect/statuses/{sha}","languages_url":"https://api.github.com/repos/geodynamics/aspect/languages","stargazers_url":"https://api.github.com/repos/geodynamics/aspect/stargazers","contributors_url":"https://api.github.com/repos/geodynamics/aspect/contributors","subscribers_url":"https://api.github.com/repos/geodynamics/aspect/subscribers","subscription_url":"https://api.github.com/repos/geodynamics/aspect/subscription","commits_url":"https://api.github.com/repos/geodynamics/aspect/commits{/sha}","git_commits_url":"https://api.github.com/repos/geodynamics/aspect/git/commits{/sha}","comments_url":"https://api.github.com/repos/geodynamics/aspect/comments{/number}","issue_comment_url":"https://api.github.com/repos/geodynamics/aspect/issues/comments{/number}","contents_url":"https://api.github.com/repos/geodynamics/aspect/contents/{+path}","compare_url":"https://api.github.com/repos/geodynamics/aspect/compare/{base}...{head}","merges_url":"https://api.github.com/repos/geodynamics/aspect/merges","archive_url":"https://api.github.com/repos/geodynamics/aspect/{archive_format}{/ref}","downloads_url":"https://api.github.com/repos/geodynamics/aspect/downloads","issues_url":"https://api.github.com/repos/geodynamics/aspect/issues{/number}","pulls_url":"https://api.github.com/repos/geodynamics/aspect/pulls{/number}","milestones_url":"https://api.github.com/repos/geodynamics/aspect/milestones{/number}","notifications_url":"https://api.github.com/repos/geodynamics/aspect/notifications{?since,all,participating}","labels_url":"https://api.github.com/repos/geodynamics/aspect/labels{/name}","releases_url":"https://api.github.com/repos/geodynamics/aspect/releases{/id}","deployments_url":"https://api.github.com/repos/geodynamics/aspect/deployments","created_at":"2014-05-06T16:47:18Z","updated_at":"2016-08-04T00:25:25Z","pushed_at":"2016-08-26T16:18:04Z","git_url":"git://github.com/geodynamics/aspect.git","ssh_url":"git@github.com:geodynamics/aspect.git","clone_url":"https://github.com/geodynamics/aspect.git","svn_url":"https://github.com/geodynamics/aspect","homepage":"http://aspect.dealii.org/","size":150456,"stargazers_count":28,"watchers_count":28,"language":"Gnuplot","has_issues":true,"has_downloads":true,"has_wiki":true,"has_pages":true,"forks_count":60,"mirror_url":null,"open_issues_count":145,"forks":60,"open_issues":145,"watchers":28,"default_branch":"master"}},"_links":{"self":{"href":"https://api.github.com/repos/geodynamics/aspect/pulls/1168"},"html":{"href":"https://github.com/geodynamics/aspect/pull/1168"},"issue":{"href":"https://api.github.com/repos/geodynamics/aspect/issues/1168"},"comments":{"href":"https://api.github.com/repos/geodynamics/aspect/issues/1168/comments"},"review_comments":{"href":"https://api.github.com/repos/geodynamics/aspect/pulls/1168/comments"},"review_comment":{"href":"https://api.github.com/repos/geodynamics/aspect/pulls/comments{/number}"},"commits":{"href":"https://api.github.com/repos/geodynamics/aspect/pulls/1168/commits"},"statuses":{"href":"https://api.github.com/repos/geodynamics/aspect/statuses/6a9d9c2fdb9db3b66a93bd1a2fad109ffbb1c30d"}}}}
{"actor":{"display_login":"gassmoeller"}}