{"action":"created","issue":{"url":"https://api.github.com/repos/CESNET/ipfixcol/issues/162","repository_url":"https://api.github.com/repos/CESNET/ipfixcol","labels_url":"https://api.github.com/repos/CESNET/ipfixcol/issues/162/labels{/name}","comments_url":"https://api.github.com/repos/CESNET/ipfixcol/issues/162/comments","events_url":"https://api.github.com/repos/CESNET/ipfixcol/issues/162/events","html_url":"https://github.com/CESNET/ipfixcol/issues/162","id":140029093,"number":162,"title":"Question - How to get the ipfix filewriter to rotate","user":{"login":"jepries","id":10326075,"avatar_url":"https://avatars.githubusercontent.com/u/10326075?v=3","gravatar_id":"","url":"https://api.github.com/users/jepries","html_url":"https://github.com/jepries","followers_url":"https://api.github.com/users/jepries/followers","following_url":"https://api.github.com/users/jepries/following{/other_user}","gists_url":"https://api.github.com/users/jepries/gists{/gist_id}","starred_url":"https://api.github.com/users/jepries/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/jepries/subscriptions","organizations_url":"https://api.github.com/users/jepries/orgs","repos_url":"https://api.github.com/users/jepries/repos","events_url":"https://api.github.com/users/jepries/events{/privacy}","received_events_url":"https://api.github.com/users/jepries/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"milestone":null,"comments":15,"created_at":"2016-03-10T22:35:38Z","updated_at":"2016-03-16T13:03:36Z","closed_at":null,"body":"I did some capacity tests writing out received packets via JSON and via ipfix file.  The ipfix native format is way better, don't start losing data until > 15K packets per second, whereas I start losing data using json output at 4k packets per second.\r\n\r\nNo worries, I can store to ipfix and post process the ipfix file to json later.  Question is, how do I get it to rotate out the ipfix files (or do I need to make my own plugin to do that)?\r\n\r\nThanks guys, this code is awesome, really making it work for me."},"comment":{"url":"https://api.github.com/repos/CESNET/ipfixcol/issues/comments/197314157","html_url":"https://github.com/CESNET/ipfixcol/issues/162#issuecomment-197314157","issue_url":"https://api.github.com/repos/CESNET/ipfixcol/issues/162","id":197314157,"user":{"login":"jepries","id":10326075,"avatar_url":"https://avatars.githubusercontent.com/u/10326075?v=3","gravatar_id":"","url":"https://api.github.com/users/jepries","html_url":"https://github.com/jepries","followers_url":"https://api.github.com/users/jepries/followers","following_url":"https://api.github.com/users/jepries/following{/other_user}","gists_url":"https://api.github.com/users/jepries/gists{/gist_id}","starred_url":"https://api.github.com/users/jepries/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/jepries/subscriptions","organizations_url":"https://api.github.com/users/jepries/orgs","repos_url":"https://api.github.com/users/jepries/repos","events_url":"https://api.github.com/users/jepries/events{/privacy}","received_events_url":"https://api.github.com/users/jepries/received_events","type":"User","site_admin":false},"created_at":"2016-03-16T13:03:36Z","updated_at":"2016-03-16T13:03:36Z","body":"@thorgrin Absolutely!\r\n\r\nDidn't seem to make a difference, but I found another hint.  The first template received by the forwarder seems to transmit OK and is received by the downstream ipfixcols... Both of them in All and RoundRobin.\r\n\r\nHere the forwarder sent a template:\r\n\r\n    DEBUG: ipfix_message: [9] Processing data\r\n    INFO: preprocessor: [9] New template ID 256\r\n    DEBUG: forwarding storage: Adding template ID 256\r\n\r\nAnd here both receivers accepted it:\r\n\r\n    *** From Collector 51000 ***\r\n    DEBUG: ipfix_message: [9] Processing data\r\n    INFO: preprocessor: [9] New template ID 256\r\n  \r\n    *** From Collector 51001 ***\r\n    DEBUG: ipfix_message: [9] Processing data\r\n    INFO: preprocessor: [9] New template ID 256\r\n\r\nThen later in the pcap, other templates came in, here is the forwarder receiving them:\r\n\r\n    DEBUG: ipfix_message: [259] Processing data\r\n    INFO: preprocessor: [259] New template ID 256\r\n    DEBUG: ipfix_message: [261] Processing data\r\n    INFO: preprocessor: [261] New template ID 256\r\n    DEBUG: ipfix_message: [259] Processing data\r\n    DEBUG: ipfix_message: [259] Processing data\r\n\r\nThe warnings about templates not found go away on the forwarder.\r\n\r\nHere is the receiving ipfixcol's debug, both receivers are the same:\r\n\r\n    DEBUG: ipfix_message: [259] Processing data\r\n    DEBUG: dummy Intermediate Process: got IPFIX message!\r\n    DEBUG: ipfix_message: [261] Processing data\r\n    DEBUG: dummy Intermediate Process: got IPFIX message!\r\n    WARNING: UDP input: Packet header is incomplete; skipping message...\r\n    WARNING: UDP input: Packet header is incomplete; skipping message...\r\n    DEBUG: ipfix_message: [259] Processing data\r\n    WARNING: preprocessor: [259] Data template with ID 256 not found\r\n    DEBUG: dummy Intermediate Process: got IPFIX message!\r\n    DEBUG: ipfix_message: [259] Processing data\r\n    WARNING: preprocessor: [259] Data template with ID 256 not found\r\n    DEBUG: dummy Intermediate Process: got IPFIX message!\r\n    DEBUG: ipfix_message: [259] Processing data\r\n    WARNING: preprocessor: [259] Data template with ID 256 not found\r\n\r\nAleast for the first template sent works.... wondering if that was the same behavior in round robin? checking....  The above is the same behavior with both \"all\" and \"RoundRobin\", the first template appears to have come in ok, the rest failed.\r\n\r\nThanks for looking at this.\r\n\r\n\r\n"}}