{"action":"created","issue":{"url":"https://api.github.com/repos/edenhill/librdkafka/issues/585","repository_url":"https://api.github.com/repos/edenhill/librdkafka","labels_url":"https://api.github.com/repos/edenhill/librdkafka/issues/585/labels{/name}","comments_url":"https://api.github.com/repos/edenhill/librdkafka/issues/585/comments","events_url":"https://api.github.com/repos/edenhill/librdkafka/issues/585/events","html_url":"https://github.com/edenhill/librdkafka/issues/585","id":142661930,"number":585,"title":"Chicken and egg-problem","user":{"login":"FDePourcq","id":17044338,"avatar_url":"https://avatars.githubusercontent.com/u/17044338?v=3","gravatar_id":"","url":"https://api.github.com/users/FDePourcq","html_url":"https://github.com/FDePourcq","followers_url":"https://api.github.com/users/FDePourcq/followers","following_url":"https://api.github.com/users/FDePourcq/following{/other_user}","gists_url":"https://api.github.com/users/FDePourcq/gists{/gist_id}","starred_url":"https://api.github.com/users/FDePourcq/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/FDePourcq/subscriptions","organizations_url":"https://api.github.com/users/FDePourcq/orgs","repos_url":"https://api.github.com/users/FDePourcq/repos","events_url":"https://api.github.com/users/FDePourcq/events{/privacy}","received_events_url":"https://api.github.com/users/FDePourcq/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"milestone":null,"comments":2,"created_at":"2016-03-22T14:10:40Z","updated_at":"2016-03-22T14:58:03Z","closed_at":null,"body":"\r\nHi Magnus,\r\n\r\nThere are some constraints on buffersizes in the configuration for a producer. If wrong something might blow up at runtime when least expected.\r\nI don't know all of them, but I got a line like this one:\r\n`std::size_t receivemessagemaxbytes = fetchmessagemaxbytes * numpartitions + 200000;`\r\n\r\nSee how I use the number of partitions there. It is hardcoded because to inspect the broker for metadata i need the producer first. \r\n\r\nSo \r\nIssue 1: a exhaustive list of these caveats somewhere would be nice. right now i don't even know what options i should make configurable to operations.\r\nIssue 2: is it possible to change config like \"message.max.bytes\" after the producer has been constructed? (So that it can be used first to get info from the broker to calculate the configuration?)\r\n\r\nLooks like kafka could use some layer on top of the current configurationoptions to simplify things. Some kind of autoconfig.\r\n"},"comment":{"url":"https://api.github.com/repos/edenhill/librdkafka/issues/comments/199853199","html_url":"https://github.com/edenhill/librdkafka/issues/585#issuecomment-199853199","issue_url":"https://api.github.com/repos/edenhill/librdkafka/issues/585","id":199853199,"user":{"login":"FDePourcq","id":17044338,"avatar_url":"https://avatars.githubusercontent.com/u/17044338?v=3","gravatar_id":"","url":"https://api.github.com/users/FDePourcq","html_url":"https://github.com/FDePourcq","followers_url":"https://api.github.com/users/FDePourcq/followers","following_url":"https://api.github.com/users/FDePourcq/following{/other_user}","gists_url":"https://api.github.com/users/FDePourcq/gists{/gist_id}","starred_url":"https://api.github.com/users/FDePourcq/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/FDePourcq/subscriptions","organizations_url":"https://api.github.com/users/FDePourcq/orgs","repos_url":"https://api.github.com/users/FDePourcq/repos","events_url":"https://api.github.com/users/FDePourcq/events{/privacy}","received_events_url":"https://api.github.com/users/FDePourcq/received_events","type":"User","site_admin":false},"created_at":"2016-03-22T14:58:03Z","updated_at":"2016-03-22T14:58:03Z","body":"Because of the (obscenely) large outputmessage-sizes i did encounter problems, i had to fiddle with the broker-config and had to hardcode that line.\r\nAh well, lets just make it all configurable :)"}}