{"action":"closed","number":70,"pull_request":{"url":"https://api.github.com/repos/Intel-HLS/TileDB/pulls/70","id":162512468,"node_id":"MDExOlB1bGxSZXF1ZXN0MTYyNTEyNDY4","html_url":"https://github.com/Intel-HLS/TileDB/pull/70","diff_url":"https://github.com/Intel-HLS/TileDB/pull/70.diff","patch_url":"https://github.com/Intel-HLS/TileDB/pull/70.patch","issue_url":"https://api.github.com/repos/Intel-HLS/TileDB/issues/70","number":70,"state":"closed","locked":false,"title":"Genomicsdb req","user":{"login":"nalinigans","id":35076948,"node_id":"MDQ6VXNlcjM1MDc2OTQ4","avatar_url":"https://avatars0.githubusercontent.com/u/35076948?v=4","gravatar_id":"","url":"https://api.github.com/users/nalinigans","html_url":"https://github.com/nalinigans","followers_url":"https://api.github.com/users/nalinigans/followers","following_url":"https://api.github.com/users/nalinigans/following{/other_user}","gists_url":"https://api.github.com/users/nalinigans/gists{/gist_id}","starred_url":"https://api.github.com/users/nalinigans/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/nalinigans/subscriptions","organizations_url":"https://api.github.com/users/nalinigans/orgs","repos_url":"https://api.github.com/users/nalinigans/repos","events_url":"https://api.github.com/users/nalinigans/events{/privacy}","received_events_url":"https://api.github.com/users/nalinigans/received_events","type":"User","site_admin":false},"body":"@kgururaj, Please review the port of TileDB to support for hdfs/emrfs/gcs. As mentioned in the commit comments, this is a first pass.\r\n\r\n1. Factor out the filesystem related functions from the existing TileDB code into its own namespace.\r\n2. Support hdfs using a new namespace and port utils.cc to use this for hdfs uri.\r\n3. Test with changes from (1) and (2) with GenomicsDB changes.\r\n4. Move BookKeeping to use in-mem buffers before finally writing to filesystem or after loading from\r\n    filesystem using gzip compression. This also allows for this class to work directly on files from\r\n    hdfs for example.\r\n5. Add Tracing to code that can be turned on using the TILEDB_TRACE=1 flag with cmake. Only    \r\n    available for Debug Builds.\r\n6. USE_HDFS cmake flag needs to be set to 1 to enable the hdfs support.\r\n7. Most Example code will now take an additional argument to specify explicitly a TILEDB_HOME dir. If\r\n           no command argument is specified, TileDB context will be initialized with default configuration.\r\n    \r\nTo be done:\r\n1. Optimizations to make read/write from the cloud a lot faster. This is work in progress.\r\n2. Implement some sort of distributed locking for consolidation. Currently, there is no locking\r\n    mechanism for hdfs.\r\n3. For clean support of multi-threaded and multiple tiledb contexts, the filesystem functionality\r\n    will have to be moved to classes and instances maintained by storage manager per tiledb context.\r\n4. Write out README files for using hdfs with TileDB including support for AWS EMRFS and GCS.\r\n\r\n\r\n","created_at":"2018-01-11T23:19:18Z","updated_at":"2018-06-20T21:21:54Z","closed_at":"2018-06-20T21:21:53Z","merged_at":"2018-06-20T21:21:53Z","merge_commit_sha":"b8102c2fa4bd35f1b54890998089061d1ddfda4c","assignee":null,"assignees":[],"requested_reviewers":[],"requested_teams":[],"labels":[],"milestone":null,"commits_url":"https://api.github.com/repos/Intel-HLS/TileDB/pulls/70/commits","review_comments_url":"https://api.github.com/repos/Intel-HLS/TileDB/pulls/70/comments","review_comment_url":"https://api.github.com/repos/Intel-HLS/TileDB/pulls/comments{/number}","comments_url":"https://api.github.com/repos/Intel-HLS/TileDB/issues/70/comments","statuses_url":"https://api.github.com/repos/Intel-HLS/TileDB/statuses/b8102c2fa4bd35f1b54890998089061d1ddfda4c","head":{"label":"nalinigans:genomicsdb_req","ref":"genomicsdb_req","sha":"b8102c2fa4bd35f1b54890998089061d1ddfda4c","user":{"login":"nalinigans","id":35076948,"node_id":"MDQ6VXNlcjM1MDc2OTQ4","avatar_url":"https://avatars0.githubusercontent.com/u/35076948?v=4","gravatar_id":"","url":"https://api.github.com/users/nalinigans","html_url":"https://github.com/nalinigans","followers_url":"https://api.github.com/users/nalinigans/followers","following_url":"https://api.github.com/users/nalinigans/following{/other_user}","gists_url":"https://api.github.com/users/nalinigans/gists{/gist_id}","starred_url":"https://api.github.com/users/nalinigans/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/nalinigans/subscriptions","organizations_url":"https://api.github.com/users/nalinigans/orgs","repos_url":"https://api.github.com/users/nalinigans/repos","events_url":"https://api.github.com/users/nalinigans/events{/privacy}","received_events_url":"https://api.github.com/users/nalinigans/received_events","type":"User","site_admin":false},"repo":{"id":116293709,"node_id":"MDEwOlJlcG9zaXRvcnkxMTYyOTM3MDk=","name":"TileDB","full_name":"nalinigans/TileDB","owner":{"login":"nalinigans","id":35076948,"node_id":"MDQ6VXNlcjM1MDc2OTQ4","avatar_url":"https://avatars0.githubusercontent.com/u/35076948?v=4","gravatar_id":"","url":"https://api.github.com/users/nalinigans","html_url":"https://github.com/nalinigans","followers_url":"https://api.github.com/users/nalinigans/followers","following_url":"https://api.github.com/users/nalinigans/following{/other_user}","gists_url":"https://api.github.com/users/nalinigans/gists{/gist_id}","starred_url":"https://api.github.com/users/nalinigans/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/nalinigans/subscriptions","organizations_url":"https://api.github.com/users/nalinigans/orgs","repos_url":"https://api.github.com/users/nalinigans/repos","events_url":"https://api.github.com/users/nalinigans/events{/privacy}","received_events_url":"https://api.github.com/users/nalinigans/received_events","type":"User","site_admin":false},"private":false,"html_url":"https://github.com/nalinigans/TileDB","description":"TileDB","fork":true,"url":"https://api.github.com/repos/nalinigans/TileDB","forks_url":"https://api.github.com/repos/nalinigans/TileDB/forks","keys_url":"https://api.github.com/repos/nalinigans/TileDB/keys{/key_id}","collaborators_url":"https://api.github.com/repos/nalinigans/TileDB/collaborators{/collaborator}","teams_url":"https://api.github.com/repos/nalinigans/TileDB/teams","hooks_url":"https://api.github.com/repos/nalinigans/TileDB/hooks","issue_events_url":"https://api.github.com/repos/nalinigans/TileDB/issues/events{/number}","events_url":"https://api.github.com/repos/nalinigans/TileDB/events","assignees_url":"https://api.github.com/repos/nalinigans/TileDB/assignees{/user}","branches_url":"https://api.github.com/repos/nalinigans/TileDB/branches{/branch}","tags_url":"https://api.github.com/repos/nalinigans/TileDB/tags","blobs_url":"https://api.github.com/repos/nalinigans/TileDB/git/blobs{/sha}","git_tags_url":"https://api.github.com/repos/nalinigans/TileDB/git/tags{/sha}","git_refs_url":"https://api.github.com/repos/nalinigans/TileDB/git/refs{/sha}","trees_url":"https://api.github.com/repos/nalinigans/TileDB/git/trees{/sha}","statuses_url":"https://api.github.com/repos/nalinigans/TileDB/statuses/{sha}","languages_url":"https://api.github.com/repos/nalinigans/TileDB/languages","stargazers_url":"https://api.github.com/repos/nalinigans/TileDB/stargazers","contributors_url":"https://api.github.com/repos/nalinigans/TileDB/contributors","subscribers_url":"https://api.github.com/repos/nalinigans/TileDB/subscribers","subscription_url":"https://api.github.com/repos/nalinigans/TileDB/subscription","commits_url":"https://api.github.com/repos/nalinigans/TileDB/commits{/sha}","git_commits_url":"https://api.github.com/repos/nalinigans/TileDB/git/commits{/sha}","comments_url":"https://api.github.com/repos/nalinigans/TileDB/comments{/number}","issue_comment_url":"https://api.github.com/repos/nalinigans/TileDB/issues/comments{/number}","contents_url":"https://api.github.com/repos/nalinigans/TileDB/contents/{+path}","compare_url":"https://api.github.com/repos/nalinigans/TileDB/compare/{base}...{head}","merges_url":"https://api.github.com/repos/nalinigans/TileDB/merges","archive_url":"https://api.github.com/repos/nalinigans/TileDB/{archive_format}{/ref}","downloads_url":"https://api.github.com/repos/nalinigans/TileDB/downloads","issues_url":"https://api.github.com/repos/nalinigans/TileDB/issues{/number}","pulls_url":"https://api.github.com/repos/nalinigans/TileDB/pulls{/number}","milestones_url":"https://api.github.com/repos/nalinigans/TileDB/milestones{/number}","notifications_url":"https://api.github.com/repos/nalinigans/TileDB/notifications{?since,all,participating}","labels_url":"https://api.github.com/repos/nalinigans/TileDB/labels{/name}","releases_url":"https://api.github.com/repos/nalinigans/TileDB/releases{/id}","deployments_url":"https://api.github.com/repos/nalinigans/TileDB/deployments","created_at":"2018-01-04T18:29:45Z","updated_at":"2018-01-04T18:29:47Z","pushed_at":"2018-01-30T00:21:27Z","git_url":"git://github.com/nalinigans/TileDB.git","ssh_url":"git@github.com:nalinigans/TileDB.git","clone_url":"https://github.com/nalinigans/TileDB.git","svn_url":"https://github.com/nalinigans/TileDB","homepage":"http://istc-bigdata.org/tiledb","size":10673,"stargazers_count":0,"watchers_count":0,"language":"C++","has_issues":false,"has_projects":true,"has_downloads":true,"has_wiki":true,"has_pages":false,"forks_count":1,"mirror_url":null,"archived":false,"open_issues_count":0,"license":{"key":"mit","name":"MIT License","spdx_id":"MIT","url":"https://api.github.com/licenses/mit","node_id":"MDc6TGljZW5zZTEz"},"forks":1,"open_issues":0,"watchers":0,"default_branch":"master"}},"base":{"label":"Intel-HLS:genomicsdb_req","ref":"genomicsdb_req","sha":"9275792e05d94748f8118570a820f0128fa8bf82","user":{"login":"Intel-HLS","id":18174158,"node_id":"MDEyOk9yZ2FuaXphdGlvbjE4MTc0MTU4","avatar_url":"https://avatars1.githubusercontent.com/u/18174158?v=4","gravatar_id":"","url":"https://api.github.com/users/Intel-HLS","html_url":"https://github.com/Intel-HLS","followers_url":"https://api.github.com/users/Intel-HLS/followers","following_url":"https://api.github.com/users/Intel-HLS/following{/other_user}","gists_url":"https://api.github.com/users/Intel-HLS/gists{/gist_id}","starred_url":"https://api.github.com/users/Intel-HLS/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/Intel-HLS/subscriptions","organizations_url":"https://api.github.com/users/Intel-HLS/orgs","repos_url":"https://api.github.com/users/Intel-HLS/repos","events_url":"https://api.github.com/users/Intel-HLS/events{/privacy}","received_events_url":"https://api.github.com/users/Intel-HLS/received_events","type":"Organization","site_admin":false},"repo":{"id":55086031,"node_id":"MDEwOlJlcG9zaXRvcnk1NTA4NjAzMQ==","name":"TileDB","full_name":"Intel-HLS/TileDB","owner":{"login":"Intel-HLS","id":18174158,"node_id":"MDEyOk9yZ2FuaXphdGlvbjE4MTc0MTU4","avatar_url":"https://avatars1.githubusercontent.com/u/18174158?v=4","gravatar_id":"","url":"https://api.github.com/users/Intel-HLS","html_url":"https://github.com/Intel-HLS","followers_url":"https://api.github.com/users/Intel-HLS/followers","following_url":"https://api.github.com/users/Intel-HLS/following{/other_user}","gists_url":"https://api.github.com/users/Intel-HLS/gists{/gist_id}","starred_url":"https://api.github.com/users/Intel-HLS/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/Intel-HLS/subscriptions","organizations_url":"https://api.github.com/users/Intel-HLS/orgs","repos_url":"https://api.github.com/users/Intel-HLS/repos","events_url":"https://api.github.com/users/Intel-HLS/events{/privacy}","received_events_url":"https://api.github.com/users/Intel-HLS/received_events","type":"Organization","site_admin":false},"private":false,"html_url":"https://github.com/Intel-HLS/TileDB","description":"TileDB","fork":false,"url":"https://api.github.com/repos/Intel-HLS/TileDB","forks_url":"https://api.github.com/repos/Intel-HLS/TileDB/forks","keys_url":"https://api.github.com/repos/Intel-HLS/TileDB/keys{/key_id}","collaborators_url":"https://api.github.com/repos/Intel-HLS/TileDB/collaborators{/collaborator}","teams_url":"https://api.github.com/repos/Intel-HLS/TileDB/teams","hooks_url":"https://api.github.com/repos/Intel-HLS/TileDB/hooks","issue_events_url":"https://api.github.com/repos/Intel-HLS/TileDB/issues/events{/number}","events_url":"https://api.github.com/repos/Intel-HLS/TileDB/events","assignees_url":"https://api.github.com/repos/Intel-HLS/TileDB/assignees{/user}","branches_url":"https://api.github.com/repos/Intel-HLS/TileDB/branches{/branch}","tags_url":"https://api.github.com/repos/Intel-HLS/TileDB/tags","blobs_url":"https://api.github.com/repos/Intel-HLS/TileDB/git/blobs{/sha}","git_tags_url":"https://api.github.com/repos/Intel-HLS/TileDB/git/tags{/sha}","git_refs_url":"https://api.github.com/repos/Intel-HLS/TileDB/git/refs{/sha}","trees_url":"https://api.github.com/repos/Intel-HLS/TileDB/git/trees{/sha}","statuses_url":"https://api.github.com/repos/Intel-HLS/TileDB/statuses/{sha}","languages_url":"https://api.github.com/repos/Intel-HLS/TileDB/languages","stargazers_url":"https://api.github.com/repos/Intel-HLS/TileDB/stargazers","contributors_url":"https://api.github.com/repos/Intel-HLS/TileDB/contributors","subscribers_url":"https://api.github.com/repos/Intel-HLS/TileDB/subscribers","subscription_url":"https://api.github.com/repos/Intel-HLS/TileDB/subscription","commits_url":"https://api.github.com/repos/Intel-HLS/TileDB/commits{/sha}","git_commits_url":"https://api.github.com/repos/Intel-HLS/TileDB/git/commits{/sha}","comments_url":"https://api.github.com/repos/Intel-HLS/TileDB/comments{/number}","issue_comment_url":"https://api.github.com/repos/Intel-HLS/TileDB/issues/comments{/number}","contents_url":"https://api.github.com/repos/Intel-HLS/TileDB/contents/{+path}","compare_url":"https://api.github.com/repos/Intel-HLS/TileDB/compare/{base}...{head}","merges_url":"https://api.github.com/repos/Intel-HLS/TileDB/merges","archive_url":"https://api.github.com/repos/Intel-HLS/TileDB/{archive_format}{/ref}","downloads_url":"https://api.github.com/repos/Intel-HLS/TileDB/downloads","issues_url":"https://api.github.com/repos/Intel-HLS/TileDB/issues{/number}","pulls_url":"https://api.github.com/repos/Intel-HLS/TileDB/pulls{/number}","milestones_url":"https://api.github.com/repos/Intel-HLS/TileDB/milestones{/number}","notifications_url":"https://api.github.com/repos/Intel-HLS/TileDB/notifications{?since,all,participating}","labels_url":"https://api.github.com/repos/Intel-HLS/TileDB/labels{/name}","releases_url":"https://api.github.com/repos/Intel-HLS/TileDB/releases{/id}","deployments_url":"https://api.github.com/repos/Intel-HLS/TileDB/deployments","created_at":"2016-03-30T18:11:47Z","updated_at":"2018-06-14T06:34:02Z","pushed_at":"2018-06-20T21:21:52Z","git_url":"git://github.com/Intel-HLS/TileDB.git","ssh_url":"git@github.com:Intel-HLS/TileDB.git","clone_url":"https://github.com/Intel-HLS/TileDB.git","svn_url":"https://github.com/Intel-HLS/TileDB","homepage":"http://istc-bigdata.org/tiledb","size":10613,"stargazers_count":82,"watchers_count":82,"language":"C++","has_issues":true,"has_projects":true,"has_downloads":true,"has_wiki":true,"has_pages":false,"forks_count":21,"mirror_url":null,"archived":false,"open_issues_count":10,"license":{"key":"mit","name":"MIT License","spdx_id":"MIT","url":"https://api.github.com/licenses/mit","node_id":"MDc6TGljZW5zZTEz"},"forks":21,"open_issues":10,"watchers":82,"default_branch":"master"}},"_links":{"self":{"href":"https://api.github.com/repos/Intel-HLS/TileDB/pulls/70"},"html":{"href":"https://github.com/Intel-HLS/TileDB/pull/70"},"issue":{"href":"https://api.github.com/repos/Intel-HLS/TileDB/issues/70"},"comments":{"href":"https://api.github.com/repos/Intel-HLS/TileDB/issues/70/comments"},"review_comments":{"href":"https://api.github.com/repos/Intel-HLS/TileDB/pulls/70/comments"},"review_comment":{"href":"https://api.github.com/repos/Intel-HLS/TileDB/pulls/comments{/number}"},"commits":{"href":"https://api.github.com/repos/Intel-HLS/TileDB/pulls/70/commits"},"statuses":{"href":"https://api.github.com/repos/Intel-HLS/TileDB/statuses/b8102c2fa4bd35f1b54890998089061d1ddfda4c"}},"author_association":"NONE","merged":true,"mergeable":null,"rebaseable":null,"mergeable_state":"unknown","merged_by":{"login":"kgururaj","id":5776852,"node_id":"MDQ6VXNlcjU3NzY4NTI=","avatar_url":"https://avatars2.githubusercontent.com/u/5776852?v=4","gravatar_id":"","url":"https://api.github.com/users/kgururaj","html_url":"https://github.com/kgururaj","followers_url":"https://api.github.com/users/kgururaj/followers","following_url":"https://api.github.com/users/kgururaj/following{/other_user}","gists_url":"https://api.github.com/users/kgururaj/gists{/gist_id}","starred_url":"https://api.github.com/users/kgururaj/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/kgururaj/subscriptions","organizations_url":"https://api.github.com/users/kgururaj/orgs","repos_url":"https://api.github.com/users/kgururaj/repos","events_url":"https://api.github.com/users/kgururaj/events{/privacy}","received_events_url":"https://api.github.com/users/kgururaj/received_events","type":"User","site_admin":false},"comments":2,"review_comments":8,"maintainer_can_modify":false,"commits":9,"additions":4601,"deletions":986,"changed_files":68}}
{"actor":{"display_login":"kgururaj"}}