{"action":"created","issue":{"url":"https://api.github.com/repos/rozofs/rozofs/issues/122","repository_url":"https://api.github.com/repos/rozofs/rozofs","labels_url":"https://api.github.com/repos/rozofs/rozofs/issues/122/labels{/name}","comments_url":"https://api.github.com/repos/rozofs/rozofs/issues/122/comments","events_url":"https://api.github.com/repos/rozofs/rozofs/issues/122/events","html_url":"https://github.com/rozofs/rozofs/issues/122","id":165328605,"number":122,"title":"No byte range locking?","user":{"login":"alexcrow","id":12735162,"avatar_url":"https://avatars.githubusercontent.com/u/12735162?v=3","gravatar_id":"","url":"https://api.github.com/users/alexcrow","html_url":"https://github.com/alexcrow","followers_url":"https://api.github.com/users/alexcrow/followers","following_url":"https://api.github.com/users/alexcrow/following{/other_user}","gists_url":"https://api.github.com/users/alexcrow/gists{/gist_id}","starred_url":"https://api.github.com/users/alexcrow/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/alexcrow/subscriptions","organizations_url":"https://api.github.com/users/alexcrow/orgs","repos_url":"https://api.github.com/users/alexcrow/repos","events_url":"https://api.github.com/users/alexcrow/events{/privacy}","received_events_url":"https://api.github.com/users/alexcrow/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"assignees":[],"milestone":null,"comments":13,"created_at":"2016-07-13T14:02:03Z","updated_at":"2016-07-18T10:12:15Z","closed_at":null,"body":"Hi,\r\n\r\nWe have an interest in using distributed file systems for CIFS access using Samba/CTDB. However I peformed the ping_pong test with and without -rw (https://wiki.samba.org/index.php/Ping_pong) on a Rozo mount (2.0.9) today and saw that only a single test can run. When a second ping_pong is started on another client, it does nothing at all. just stalls.\r\n\r\nIt seems the test file was locked at the file level, so the second test could not proceed.\r\n\r\nThis does mean that RozoFS can't be used to store the recovery lock for CTDB and is not able to deal with I/O contention on files exported via Samba. Is there any chance this can be looked at?\r\n\r\nBest regards."},"comment":{"url":"https://api.github.com/repos/rozofs/rozofs/issues/comments/233291764","html_url":"https://github.com/rozofs/rozofs/issues/122#issuecomment-233291764","issue_url":"https://api.github.com/repos/rozofs/rozofs/issues/122","id":233291764,"user":{"login":"alexcrow","id":12735162,"avatar_url":"https://avatars.githubusercontent.com/u/12735162?v=3","gravatar_id":"","url":"https://api.github.com/users/alexcrow","html_url":"https://github.com/alexcrow","followers_url":"https://api.github.com/users/alexcrow/followers","following_url":"https://api.github.com/users/alexcrow/following{/other_user}","gists_url":"https://api.github.com/users/alexcrow/gists{/gist_id}","starred_url":"https://api.github.com/users/alexcrow/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/alexcrow/subscriptions","organizations_url":"https://api.github.com/users/alexcrow/orgs","repos_url":"https://api.github.com/users/alexcrow/repos","events_url":"https://api.github.com/users/alexcrow/events{/privacy}","received_events_url":"https://api.github.com/users/alexcrow/received_events","type":"User","site_admin":false},"created_at":"2016-07-18T10:12:15Z","updated_at":"2016-07-18T10:12:15Z","body":"FYI:\n\n[root@zearing ~]# rozodiag -T export:1 -c vfstat_stor\n____[exportd-S1 ]__[vfstat_stor ]____\nFile distibution rule = size balancing\nFile estimated weigth = 1 MB\n\nVid    | Cid    | Sid    | Status | Capacity(B)          | \nFree(B)              | Free(%)  |\n-------+--------+--------+--------+----------------------+----------------------+----------+ \n\n      1 |      1 |      3 | UP     |         126692687872 |         \n100575379456 |       79 |\n      1 |      1 |      4 | UP     |         126692687872 |          \n99976110080 |       78 |\n      1 |      1 |      1 | UP     |         126692687872 |          \n99848527872 |       78 |\n      1 |      1 |      2 | UP     |         126692687872 |          \n99842297856 |       78 |\n\n[root@zearing ~]# rozodiag -T storaged -c device\n____[storaged]__[device ]____\n  ___ ___ ___ ________ ________ ________ ____ ______ ____ _____ ______ \n_____ ______ ________\n| C | S | D | status |  free  |  max   |free| dev  |busy| rd  | Avg. | \nwr  | Avg. |  last  |\n| I | I | E |        |  size  |  size  |  % | name |  % | /s  | rd   | \n/s  | wr   | access |\n| D | D | V |        |        |        |    |      | |     | usec |     \n| usec |  (sec) |\n|___|___|___|________|________|________|____|______|____|_____|______|_____|______|________|\n| 1 | 1 | 0 | IS     |99.8 GB | 126 GB | 78 | zd0  | |     |      |     \n|      |        |\n|___|___|___|________|________|________|____|______|____|_____|______|_____|______|________|\n                      |99.8 GB | 126 GB | 78 |\n                      |________|________|____|\n[root@zearing ~]# for i in zalma zapata zebulon; do ssh $i \"rozodiag -T \nstoraged -c device\"; done\n____[storaged]__[device ]____\n  ___ ___ ___ ________ ________ ________ ____ ______ ____ _____ ______ \n_____ ______ ________\n| C | S | D | status |  free  |  max   |free| dev  |busy| rd  | Avg. | \nwr  | Avg. |  last  |\n| I | I | E |        |  size  |  size  |  % | name |  % | /s  | rd   | \n/s  | wr   | access |\n| D | D | V |        |        |        |    |      | |     | usec |     \n| usec |  (sec) |\n|___|___|___|________|________|________|____|______|____|_____|______|_____|______|________|\n| 1 | 2 | 0 | IS     |99.8 GB | 126 GB | 78 | zd0  | |     |      |     \n|      |        |\n|___|___|___|________|________|________|____|______|____|_____|______|_____|______|________|\n                      |99.8 GB | 126 GB | 78 |\n                      |________|________|____|\n____[storaged]__[device ]____\n  ___ ___ ___ ________ ________ ________ ____ ______ ____ _____ ______ \n_____ ______ ________\n| C | S | D | status |  free  |  max   |free| dev  |busy| rd  | Avg. | \nwr  | Avg. |  last  |\n| I | I | E |        |  size  |  size  |  % | name |  % | /s  | rd   | \n/s  | wr   | access |\n| D | D | V |        |        |        |    |      | |     | usec |     \n| usec |  (sec) |\n|___|___|___|________|________|________|____|______|____|_____|______|_____|______|________|\n| 1 | 3 | 0 | IS     | 100 GB | 126 GB | 79 | zd0  | |     |      |     \n|      |        |\n|___|___|___|________|________|________|____|______|____|_____|______|_____|______|________|\n                      | 100 GB | 126 GB | 79 |\n                      |________|________|____|\n____[storaged]__[device ]____\n  ___ ___ ___ ________ ________ ________ ____ ______ ____ _____ ______ \n_____ ______ ________\n| C | S | D | status |  free  |  max   |free| dev  |busy| rd  | Avg. | \nwr  | Avg. |  last  |\n| I | I | E |        |  size  |  size  |  % | name |  % | /s  | rd   | \n/s  | wr   | access |\n| D | D | V |        |        |        |    |      | |     | usec |     \n| usec |  (sec) |\n|___|___|___|________|________|________|____|______|____|_____|______|_____|______|________|\n| 1 | 4 | 0 | IS     |99.9 GB | 126 GB | 78 | zd0  | |     |      |     \n|      |        |\n|___|___|___|________|________|________|____|______|____|_____|______|_____|______|________|\n                      |99.9 GB | 126 GB | 78 |\n                      |________|________|____|\n\n\nOn 18/07/16 11:05, rozodopamine wrote:\n> At a first glance this looks good. Can you run the following command\n> on one each of your nodes : \"rozodiag -T storaged -c device\" and\n> this one on the one holding the export function\n> \"rozodiag -T export:1 -c vfstat_stor'\n> Regards,\n> JPierre\n>\n> Jean-Pierre Monchanin - Customer support\n>\n>\n> *jean-pierre.monchanin@rozofs.com\n> <jean-pierre.monchanin@rozofs.com>www.rozofs.com\n> <http://www.rozofs.com>https://github.com/rozofs/rozofs\n> <https://github.com/rozofs/rozofs>*\n>\n>\n>\n> 2016-07-18 11:59 GMT+02:00 alexcrow <notifications@github.com>:\n>\n> > Hi,\n> >\n> > I have 4 storage nodes, 1 disk each (as I don't have any machines with\n> > real spare disks I'm using a ZVOL on 4 ZFSonLinux based boxes.)\n> >\n> > Export.conf:\n> >\n> > # rozofs export daemon configuration file\n> >\n> > layout = 0 ; # (inverse = 2, forward = 3, safe = 4)\n> >\n> > volumes = # List of volumes\n> > (\n> > {\n> > # First volume\n> > vid = 1 ; # Volume identifier = 1\n> > cids= # List of clusters for the volume 1\n> > (\n> > {\n> > # First cluster of volume 1\n> > cid = 1; # Cluster identifier = 1\n> > sids = # List of storages for the cluster 1\n> > (\n> > {sid = 1; host = \"zearing.ifa.net\";},\n> > {sid = 2; host = \"zalma.ifa.net\";},\n> > {sid = 3; host = \"zapata.ifa.net\";},\n> > {sid = 4; host = \"zebulon.ifa.net\";}\n> > );\n> > }\n> > );\n> > }\n> > );\n> >\n> > # List of exported filesystem\n> > exports = (\n> >\n> > # First filesystem exported\n> > {eid = 1; root = \"/srv/rozofs/exports/export_1\"; md5=\"\";\n> > squota=\"\"; hquota=\"\"; vid=1;}\n> > );\n> >\n> > storage.conf per host (ordered as above):\n> >\n> > # Activate CRC32 generation and control . Do not force HW CRC32 mode\n> > crc32c_check = True;\n> > crc32c_generate = True;\n> >\n> > listen = (\n> > {addr = \"*\"; port = 41001; }\n> > );\n> >\n> > storages = (\n> > {cid = 1; sid = 1; root = \"/srv/rozofs/storages/storage_1-1/\";\n> > device-total = 1; device-mapper = 1; device-redundancy = 1;}\n> > );\n> >\n> >\n> >\n> >\n> > # Activate CRC32 generation and control . Do not force HW CRC32 mode\n> > crc32c_check = True;\n> > crc32c_generate = True;\n> >\n> > listen = (\n> > {addr = \"*\"; port = 41001; }\n> > );\n> >\n> > storages = (\n> > {cid = 1; sid = 2; root = \"/srv/rozofs/storages/storage_1-2/\";\n> > device-total = 1; device-mapper = 1; device-redundancy = 1;}\n> > );\n> >\n> >\n> >\n> > # Activate CRC32 generation and control . Do not force HW CRC32 mode\n> > crc32c_check = True;\n> > crc32c_generate = True;\n> >\n> > listen = (\n> > {addr = \"*\"; port = 41001; }\n> > );\n> >\n> > storages = (\n> > {cid = 1; sid = 3; root = \"/srv/rozofs/storages/storage_1-3/\";\n> > device-total = 1; device-mapper = 1; device-redundancy = 1;}\n> > );\n> >\n> >\n> >\n> > # Activate CRC32 generation and control . Do not force HW CRC32 mode\n> > crc32c_check = True;\n> > crc32c_generate = True;\n> >\n> > listen = (\n> > {addr = \"*\"; port = 41001; }\n> > );\n> >\n> > storages = (\n> > {cid = 1; sid = 4; root = \"/srv/rozofs/storages/storage_1-4/\";\n> > device-total = 1; device-mapper = 1; device-redundancy = 1;}\n> > );\n> >\n> >\n> > Thanks,\n> >\n> > Alex\n> >\n> > On 18/07/16 08:38, rozodopamine wrote:\n> > > Alex,\n> > > it looks like you have not successfully configured you RozoFS system.\n> > > How many nodes do you have and how many disk per node do you use ?\n> > > Can you provide us with your exportd as well as you storage \n> configuration\n> > > files.\n> > > Regards,\n> > > JPierre\n> > >\n> > > Jean-Pierre Monchanin - Customer support\n> > >\n> > >\n> > > *jean-pierre.monchanin@rozofs.com\n> > > <jean-pierre.monchanin@rozofs.com>www.rozofs.com\n> > > <http://www.rozofs.com>https://github.com/rozofs/rozofs\n> > > <https://github.com/rozofs/rozofs>*\n> > >\n> > >\n> > >\n> > > 2016-07-14 15:32 GMT+02:00 alexcrow <notifications@github.com>:\n> > >\n> > > > Just trying out with Dovecot's dbox mailbox store on RozoFS and\n> > > getting a\n> > > > *lot* of this:\n> > > >\n> > > > Jul 14 14:22:42 dovecot-mfs dovecot: imap(acrow@integrafin.co.uk):\n> > > Error:\n> > > > flock(write-lock) locking failed for file /rozo/email-indexes/\n> > > > integrafin.co.uk/a/acrow/mailboxes/INBOX/dovecot.index.cache:\n> > Transport\n> > > > endpoint is not connected\n> > > > Jul 14 14:23:20 dovecot-mfs dovecot: imap(acrow@integrafin.co.uk):\n> > > Error:\n> > > > flock(write-lock) locking failed for file /rozo/email-indexes/\n> > > > integrafin.co.uk/a/acrow/mailboxes/INBOX/dovecot.index.cache:\n> > Transport\n> > > > endpoint is not connected\n> > > > Jul 14 14:23:20 dovecot-mfs dovecot: imap(acrow@integrafin.co.uk):\n> > > Error:\n> > > > flock(write-lock) locking failed for file /rozo/email-indexes/\n> > > > integrafin.co.uk/a/acrow/mailboxes/INBOX/dovecot.index.cache:\n> > Transport\n> > > > endpoint is not connected\n> > > > Jul 14 14:23:20 dovecot-mfs dovecot: imap(acrow@integrafin.co.uk):\n> > > Error:\n> > > > flock(write-lock) locking failed for file /rozo/email-indexes/\n> > > > integrafin.co.uk/a/acrow/mailboxes/INBOX/dovecot.index.cache:\n> > Transport\n> > > > endpoint is not connected\n> > > > Jul 14 14:23:20 dovecot-mfs dovecot: imap(acrow@integrafin.co.uk):\n> > > Error:\n> > > > flock(write-lock) locking failed for file /rozo/email-indexes/\n> > > > integrafin.co.uk/a/acrow/mailboxes/INBOX/dovecot.index.cache:\n> > Transport\n> > > > endpoint is not connected\n> > > >\n> > > > This is when importing mails into the new mailboxes or accessing a\n> > > folder\n> > > > from an IMAP client with lots of messages in it. Sometimes it causes\n> > the\n> > > > client to not be able to see all messages in a mailbox. Networking\n> > seems\n> > > > fine (VM on 10G ethernet connected host, all Rozo servers on 10G).\n> > > >\n> > > > Thanks\n> > > >\n> > > > Alex\n> > > >\n> > > > —\n> > > > You are receiving this because you commented.\n> > > > Reply to this email directly, view it on GitHub\n> > > >\n> > > <https://github.com/rozofs/rozofs/issues/122#issuecomment-232666155>,\n> > > or mute\n> > > > the thread\n> > > >\n> > > <\n> > \n> https://github.com/notifications/unsubscribe/ADQwOSohqbW3rwX9Fio69x_6AizHBUzFks5qVjp9gaJpZM4JLcyL\n> > >\n> > > > .\n> > > >\n> > >\n> > > —\n> > > You are receiving this because you authored the thread.\n> > > Reply to this email directly, view it on GitHub\n> > > <https://github.com/rozofs/rozofs/issues/122#issuecomment-233255315>,\n> > > or mute the thread\n> > > <\n> > \n> https://github.com/notifications/unsubscribe-auth/AMJSup-nyL9RxZukcl_ZQubeIe14ViV2ks5qWy1xgaJpZM4JLcyL>.Web\n> >\n> > > Bug from\n> > >\n> > \n> https://github.com/notifications/beacon/AMJSug89UEVNconvWlN_PV3AaISsK3Zuks5qWy1xgaJpZM4JLcyL.gif\n> > >\n> >\n> >\n> > --\n> > This message is intended only for the addressee and may contain\n> > confidential information. Unless you are that person, you may not\n> > disclose its contents or use it in any way and are requested to delete\n> > the message along with any attachments and notify us immediately.\n> > This email is not intended to, nor should it be taken to, constitute\n> > advice.\n> > The information provided is correct to our knowledge & belief and \n> must not\n> > be used as a substitute for obtaining tax, regulatory, investment, \n> legal or\n> > any other appropriate advice.\n> >\n> > \"Transact\" is operated by Integrated Financial Arrangements Ltd.\n> > 29 Clement's Lane, London EC4N 7AE. Tel: (020) 7608 4900 Fax: (020) 7608\n> > 5300.\n> > (Registered office: as above; Registered in England and Wales under\n> > number: 3727592). Authorised and regulated by the Financial Conduct\n> > Authority (entered on the Financial Services Register; no. 190856).\n> >\n> > —\n> > You are receiving this because you commented.\n> > Reply to this email directly, view it on GitHub\n> > \n> <https://github.com/rozofs/rozofs/issues/122#issuecomment-233289351>, \n> or mute\n> > the thread\n> > \n> <https://github.com/notifications/unsubscribe-auth/ADQwOVSrM_digN5VYQBft9B69txV1LCeks5qW05kgaJpZM4JLcyL>\n> > .\n> >\n>\n> —\n> You are receiving this because you authored the thread.\n> Reply to this email directly, view it on GitHub \n> <https://github.com/rozofs/rozofs/issues/122#issuecomment-233290648>, \n> or mute the thread \n> <https://github.com/notifications/unsubscribe-auth/AMJSugX5nRfLHFinNEkfn9twqrK9SrzVks5qW0_4gaJpZM4JLcyL>.Web \n> Bug from \n> https://github.com/notifications/beacon/AMJSutW6-ohS5VWJb9ICKTIJ8yHOLjIGks5qW0_4gaJpZM4JLcyL.gif\n>\n\n\n--\nThis message is intended only for the addressee and may contain\nconfidential information. Unless you are that person, you may not\ndisclose its contents or use it in any way and are requested to delete\nthe message along with any attachments and notify us immediately.\nThis email is not intended to, nor should it be taken to, constitute advice.\nThe information provided is correct to our knowledge & belief and must not\nbe used as a substitute for obtaining tax, regulatory, investment, legal or\nany other appropriate advice.\n\n\"Transact\" is operated by Integrated Financial Arrangements Ltd.\n29 Clement's Lane, London EC4N 7AE. Tel: (020) 7608 4900 Fax: (020) 7608 5300.\n(Registered office: as above; Registered in England and Wales under\nnumber: 3727592). Authorised and regulated by the Financial Conduct\nAuthority (entered on the Financial Services Register; no. 190856)."}}
{"actor":{"display_login":"alexcrow"}}