{"action":"created","issue":{"url":"https://api.github.com/repos/frankmcsherry/differential-dataflow/issues/113","repository_url":"https://api.github.com/repos/frankmcsherry/differential-dataflow","labels_url":"https://api.github.com/repos/frankmcsherry/differential-dataflow/issues/113/labels{/name}","comments_url":"https://api.github.com/repos/frankmcsherry/differential-dataflow/issues/113/comments","events_url":"https://api.github.com/repos/frankmcsherry/differential-dataflow/issues/113/events","html_url":"https://github.com/frankmcsherry/differential-dataflow/issues/113","id":358780382,"node_id":"MDU6SXNzdWUzNTg3ODAzODI=","number":113,"title":"Questions on memory profiling of differential dataflow","user":{"login":"ryzhyk","id":8323135,"node_id":"MDQ6VXNlcjgzMjMxMzU=","avatar_url":"https://avatars2.githubusercontent.com/u/8323135?v=4","gravatar_id":"","url":"https://api.github.com/users/ryzhyk","html_url":"https://github.com/ryzhyk","followers_url":"https://api.github.com/users/ryzhyk/followers","following_url":"https://api.github.com/users/ryzhyk/following{/other_user}","gists_url":"https://api.github.com/users/ryzhyk/gists{/gist_id}","starred_url":"https://api.github.com/users/ryzhyk/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/ryzhyk/subscriptions","organizations_url":"https://api.github.com/users/ryzhyk/orgs","repos_url":"https://api.github.com/users/ryzhyk/repos","events_url":"https://api.github.com/users/ryzhyk/events{/privacy}","received_events_url":"https://api.github.com/users/ryzhyk/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"assignees":[],"milestone":null,"comments":6,"created_at":"2018-09-10T20:24:46Z","updated_at":"2018-09-12T09:32:17Z","closed_at":null,"author_association":"NONE","body":"I would like to understand the memory usage of my differential-dataflow-based program, including the size of each individual collection, arrangement, history, etc., and how these sizes change over time (basically, whatever it takes to correlate the overall memory footprint of the program to specific nodes in the dataflow graph). Is there currently an API/example code I could use to accomplish this?\r\n\r\nA related question: I understand that differential's memory footprint grows with the number of trace entries it stores, and that it now has the ability to compact the trace. When does is trace compaction triggered and is there a way to control it directly or indirectly?"},"comment":{"url":"https://api.github.com/repos/frankmcsherry/differential-dataflow/issues/comments/420579222","html_url":"https://github.com/frankmcsherry/differential-dataflow/issues/113#issuecomment-420579222","issue_url":"https://api.github.com/repos/frankmcsherry/differential-dataflow/issues/113","id":420579222,"node_id":"MDEyOklzc3VlQ29tbWVudDQyMDU3OTIyMg==","user":{"login":"frankmcsherry","id":5741500,"node_id":"MDQ6VXNlcjU3NDE1MDA=","avatar_url":"https://avatars1.githubusercontent.com/u/5741500?v=4","gravatar_id":"","url":"https://api.github.com/users/frankmcsherry","html_url":"https://github.com/frankmcsherry","followers_url":"https://api.github.com/users/frankmcsherry/followers","following_url":"https://api.github.com/users/frankmcsherry/following{/other_user}","gists_url":"https://api.github.com/users/frankmcsherry/gists{/gist_id}","starred_url":"https://api.github.com/users/frankmcsherry/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/frankmcsherry/subscriptions","organizations_url":"https://api.github.com/users/frankmcsherry/orgs","repos_url":"https://api.github.com/users/frankmcsherry/repos","events_url":"https://api.github.com/users/frankmcsherry/events{/privacy}","received_events_url":"https://api.github.com/users/frankmcsherry/received_events","type":"User","site_admin":false},"created_at":"2018-09-12T09:32:17Z","updated_at":"2018-09-12T09:32:17Z","author_association":"OWNER","body":"I just pushed a version that i. uses the correct identifiers (so you should see the right operator names and addresses) and ii. fixes an issue with blocking reads on sockets (process could easily hang while trying to read from two sockets)."}}
{"actor":{"display_login":"frankmcsherry"}}