{"action":"created","issue":{"url":"https://api.github.com/repos/ceph/ceph-docker/issues/355","repository_url":"https://api.github.com/repos/ceph/ceph-docker","labels_url":"https://api.github.com/repos/ceph/ceph-docker/issues/355/labels{/name}","comments_url":"https://api.github.com/repos/ceph/ceph-docker/issues/355/comments","events_url":"https://api.github.com/repos/ceph/ceph-docker/issues/355/events","html_url":"https://github.com/ceph/ceph-docker/issues/355","id":170883211,"number":355,"title":"ceph_disk.main.Error: Error: No cluster conf found in /etc/ceph with fsid 00000000-0000-0000-0000-000000000000","user":{"login":"pineking","id":72760,"avatar_url":"https://avatars.githubusercontent.com/u/72760?v=3","gravatar_id":"","url":"https://api.github.com/users/pineking","html_url":"https://github.com/pineking","followers_url":"https://api.github.com/users/pineking/followers","following_url":"https://api.github.com/users/pineking/following{/other_user}","gists_url":"https://api.github.com/users/pineking/gists{/gist_id}","starred_url":"https://api.github.com/users/pineking/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/pineking/subscriptions","organizations_url":"https://api.github.com/users/pineking/orgs","repos_url":"https://api.github.com/users/pineking/repos","events_url":"https://api.github.com/users/pineking/events{/privacy}","received_events_url":"https://api.github.com/users/pineking/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"assignees":[],"milestone":null,"comments":0,"created_at":"2016-08-12T14:26:29Z","updated_at":"2016-08-12T15:44:52Z","closed_at":null,"body":"the cluster name :  ceph_tf \r\nuse the etcd as the backend\r\nthe command is:\r\ndocker run -d --pid=host --net=host --privileged=true  -v /dev:/dev  -e CLUSTER=ceph_tf -e KV_TYPE=etcd -e OSD_TYPE=disk -e OSD_FORCE_ZAP=1 -e OSD_DEVICE=/dev/sdb ceph/daemon osd                 \r\n\r\nthe log is:\r\n\r\n2016-08-12T14:21:03Z 00-25-90-c0-f7-ac confd[16656]: INFO Backend set to etcd\r\n2016-08-12T14:21:03Z 00-25-90-c0-f7-ac confd[16656]: INFO Starting confd\r\n2016-08-12T14:21:03Z 00-25-90-c0-f7-ac confd[16656]: INFO Backend nodes set to http://127.0.0.1:4001\r\n2016-08-12T14:21:03Z 00-25-90-c0-f7-ac confd[16656]: INFO Target config /etc/ceph/ceph_tf.conf out of sync\r\n2016-08-12T14:21:03Z 00-25-90-c0-f7-ac confd[16656]: INFO Target config /etc/ceph/ceph_tf.conf has been updated\r\nAdding bootstrap keyrings\r\nHEALTH_ERR 64 pgs are stuck inactive for more than 300 seconds; 64 pgs stuck inactive; no osds\r\nIt looks like /dev/sdb is an OSD, however OSD_FORCE_ZAP is enabled so we are zapping the device anyway\r\nget_dm_uuid: get_dm_uuid /dev/sdb uuid path is /sys/dev/block/8:16/dm/uuid\r\nzap: Zapping partition table on /dev/sdb\r\ncommand_check_call: Running command: /sbin/sgdisk --zap-all -- /dev/sdb\r\n\u0007Caution: invalid backup GPT header, but valid main header; regenerating\r\nbackup header from main header.\r\n\r\nWarning! Main and backup partition tables differ! Use the 'c' and 'e' options\r\non the recovery & transformation menu to examine the two tables.\r\n\r\nWarning! One or more CRCs don't match. You should repair the disk!\r\n\r\n\u0007\u0007****************************************************************************\r\nCaution: Found protective or hybrid MBR and corrupt GPT. Using GPT, but disk\r\nverification and recovery are STRONGLY recommended.\r\n****************************************************************************\r\nGPT data structures destroyed! You may now partition the disk using fdisk or\r\nother utilities.\r\ncommand_check_call: Running command: /sbin/sgdisk --clear --mbrtogpt -- /dev/sdb\r\nCreating new GPT entries.\r\nThe operation has completed successfully.\r\nupdate_partition: Calling partprobe on zapped device /dev/sdb\r\ncommand_check_call: Running command: /sbin/udevadm settle --timeout=600\r\ncommand: Running command: /sbin/partprobe /dev/sdb\r\ncommand_check_call: Running command: /sbin/udevadm settle --timeout=600\r\ncommand: Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=fsid\r\ncommand: Running command: /usr/bin/ceph-osd --check-allows-journal -i 0 --cluster ceph\r\ncommand: Running command: /usr/bin/ceph-osd --check-wants-journal -i 0 --cluster ceph\r\ncommand: Running command: /usr/bin/ceph-osd --check-needs-journal -i 0 --cluster ceph\r\nget_dm_uuid: get_dm_uuid /dev/sdb uuid path is /sys/dev/block/8:16/dm/uuid\r\nset_type: Will colocate journal with data on /dev/sdb\r\ncommand: Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=osd_journal_size\r\nget_dm_uuid: get_dm_uuid /dev/sdb uuid path is /sys/dev/block/8:16/dm/uuid\r\nget_dm_uuid: get_dm_uuid /dev/sdb uuid path is /sys/dev/block/8:16/dm/uuid\r\nget_dm_uuid: get_dm_uuid /dev/sdb uuid path is /sys/dev/block/8:16/dm/uuid\r\ncommand: Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mkfs_type\r\ncommand: Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_type\r\ncommand: Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mkfs_options_xfs\r\ncommand: Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mkfs_options_xfs\r\ncommand: Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mount_options_xfs\r\ncommand: Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mount_options_xfs\r\nget_dm_uuid: get_dm_uuid /dev/sdb uuid path is /sys/dev/block/8:16/dm/uuid\r\nget_dm_uuid: get_dm_uuid /dev/sdb uuid path is /sys/dev/block/8:16/dm/uuid\r\nptype_tobe_for_name: name = journal\r\nget_dm_uuid: get_dm_uuid /dev/sdb uuid path is /sys/dev/block/8:16/dm/uuid\r\ncreate_partition: Creating journal partition num 2 size 5120 on /dev/sdb\r\ncommand_check_call: Running command: /sbin/sgdisk --new=2:0:+5120M --change-name=2:ceph journal --partition-guid=2:d3c67b34-79e3-4151-a1bb-0ba7635bde1c --typecode=2:45b0969e-9b03-4f30-b4c6-b4b80ceff106 --mbrtogpt -- /dev/sdb\r\nThe operation has completed successfully.\r\nupdate_partition: Calling partprobe on created device /dev/sdb\r\ncommand_check_call: Running command: /sbin/udevadm settle --timeout=600\r\ncommand: Running command: /sbin/partprobe /dev/sdb\r\ncommand_check_call: Running command: /sbin/udevadm settle --timeout=600\r\nget_dm_uuid: get_dm_uuid /dev/sdb uuid path is /sys/dev/block/8:16/dm/uuid\r\nget_dm_uuid: get_dm_uuid /dev/sdb uuid path is /sys/dev/block/8:16/dm/uuid\r\nget_dm_uuid: get_dm_uuid /dev/sdb2 uuid path is /sys/dev/block/8:18/dm/uuid\r\nprepare_device: Journal is GPT partition /dev/disk/by-partuuid/d3c67b34-79e3-4151-a1bb-0ba7635bde1c\r\nprepare_device: Journal is GPT partition /dev/disk/by-partuuid/d3c67b34-79e3-4151-a1bb-0ba7635bde1c\r\nget_dm_uuid: get_dm_uuid /dev/sdb uuid path is /sys/dev/block/8:16/dm/uuid\r\nset_data_partition: Creating osd partition on /dev/sdb\r\nget_dm_uuid: get_dm_uuid /dev/sdb uuid path is /sys/dev/block/8:16/dm/uuid\r\nptype_tobe_for_name: name = data\r\nget_dm_uuid: get_dm_uuid /dev/sdb uuid path is /sys/dev/block/8:16/dm/uuid\r\ncreate_partition: Creating data partition num 1 size 0 on /dev/sdb\r\ncommand_check_call: Running command: /sbin/sgdisk --largest-new=1 --change-name=1:ceph data --partition-guid=1:dc6f57d4-65b4-4982-9499-a0d721db6f63 --typecode=1:89c57f98-2fe5-4dc0-89c1-f3ad0ceff2be --mbrtogpt -- /dev/sdb\r\nThe operation has completed successfully.\r\nupdate_partition: Calling partprobe on created device /dev/sdb\r\ncommand_check_call: Running command: /sbin/udevadm settle --timeout=600\r\ncommand: Running command: /sbin/partprobe /dev/sdb\r\ncommand_check_call: Running command: /sbin/udevadm settle --timeout=600\r\nget_dm_uuid: get_dm_uuid /dev/sdb uuid path is /sys/dev/block/8:16/dm/uuid\r\nget_dm_uuid: get_dm_uuid /dev/sdb uuid path is /sys/dev/block/8:16/dm/uuid\r\nget_dm_uuid: get_dm_uuid /dev/sdb1 uuid path is /sys/dev/block/8:17/dm/uuid\r\npopulate_data_path_device: Creating xfs fs on /dev/sdb1\r\ncommand_check_call: Running command: /sbin/mkfs -t xfs -f -i size=2048 -- /dev/sdb1\r\nmeta-data=/dev/sdb1              isize=2048   agcount=4, agsize=60719917 blks\r\n         =                       sectsz=512   attr=2, projid32bit=0\r\ndata     =                       bsize=4096   blocks=242879665, imaxpct=25\r\n         =                       sunit=0      swidth=0 blks\r\nnaming   =version 2              bsize=4096   ascii-ci=0\r\nlog      =internal log           bsize=4096   blocks=118593, version=2\r\n         =                       sectsz=512   sunit=0 blks, lazy-count=1\r\nrealtime =none                   extsz=4096   blocks=0, rtextents=0\r\nmount: Mounting /dev/sdb1 on /var/lib/ceph/tmp/mnt.MSP8x0 with options noatime,inode64\r\ncommand_check_call: Running command: /bin/mount -t xfs -o noatime,inode64 -- /dev/sdb1 /var/lib/ceph/tmp/mnt.MSP8x0\r\npopulate_data_path: Preparing osd data dir /var/lib/ceph/tmp/mnt.MSP8x0\r\ncommand: Running command: /bin/chown -R ceph:ceph /var/lib/ceph/tmp/mnt.MSP8x0/ceph_fsid.16757.tmp\r\ncommand: Running command: /bin/chown -R ceph:ceph /var/lib/ceph/tmp/mnt.MSP8x0/fsid.16757.tmp\r\ncommand: Running command: /bin/chown -R ceph:ceph /var/lib/ceph/tmp/mnt.MSP8x0/magic.16757.tmp\r\ncommand: Running command: /bin/chown -R ceph:ceph /var/lib/ceph/tmp/mnt.MSP8x0/journal_uuid.16757.tmp\r\nadjust_symlink: Creating symlink /var/lib/ceph/tmp/mnt.MSP8x0/journal -> /dev/disk/by-partuuid/d3c67b34-79e3-4151-a1bb-0ba7635bde1c\r\ncommand: Running command: /bin/chown -R ceph:ceph /var/lib/ceph/tmp/mnt.MSP8x0\r\nunmount: Unmounting /var/lib/ceph/tmp/mnt.MSP8x0\r\ncommand_check_call: Running command: /bin/umount -- /var/lib/ceph/tmp/mnt.MSP8x0\r\nget_dm_uuid: get_dm_uuid /dev/sdb uuid path is /sys/dev/block/8:16/dm/uuid\r\ncommand_check_call: Running command: /sbin/sgdisk --typecode=1:4fbd7e29-9d25-41b8-afd0-062c0ceff05d -- /dev/sdb\r\nThe operation has completed successfully.\r\nupdate_partition: Calling partprobe on prepared device /dev/sdb\r\ncommand_check_call: Running command: /sbin/udevadm settle --timeout=600\r\ncommand: Running command: /sbin/partprobe /dev/sdb\r\ncommand_check_call: Running command: /sbin/udevadm settle --timeout=600\r\ncommand_check_call: Running command: /sbin/udevadm trigger --action=add --sysname-match sdb1\r\nmain_activate: path = /dev/sdb1\r\nget_dm_uuid: get_dm_uuid /dev/sdb1 uuid path is /sys/dev/block/8:17/dm/uuid\r\ncommand: Running command: /sbin/blkid -o udev -p /dev/sdb1\r\ncommand: Running command: /sbin/blkid -p -s TYPE -o value -- /dev/sdb1\r\ncommand: Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mount_options_xfs\r\ncommand: Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mount_options_xfs\r\nmount: Mounting /dev/sdb1 on /var/lib/ceph/tmp/mnt.9ayXOd with options noatime,inode64\r\ncommand_check_call: Running command: /bin/mount -t xfs -o noatime,inode64 -- /dev/sdb1 /var/lib/ceph/tmp/mnt.9ayXOd\r\nactivate: Cluster uuid is 00000000-0000-0000-0000-000000000000\r\ncommand: Running command: /usr/bin/ceph-osd --cluster=ceph_tf --show-config-value=fsid\r\nmount_activate: Failed to activate\r\nunmount: Unmounting /var/lib/ceph/tmp/mnt.9ayXOd\r\ncommand_check_call: Running command: /bin/umount -- /var/lib/ceph/tmp/mnt.9ayXOd\r\nTraceback (most recent call last):\r\n  File \"/usr/sbin/ceph-disk\", line 9, in <module>\r\n    load_entry_point('ceph-disk==1.0.0', 'console_scripts', 'ceph-disk')()\r\n  File \"/usr/lib/python2.7/dist-packages/ceph_disk/main.py\", line 4994, in run\r\n    main(sys.argv[1:])\r\n  File \"/usr/lib/python2.7/dist-packages/ceph_disk/main.py\", line 4945, in main\r\n    args.func(args)\r\n  File \"/usr/lib/python2.7/dist-packages/ceph_disk/main.py\", line 3299, in main_activate\r\n    reactivate=args.reactivate,\r\n  File \"/usr/lib/python2.7/dist-packages/ceph_disk/main.py\", line 3056, in mount_activate\r\n    (osd_id, cluster) = activate(path, activate_key_template, init)\r\n  File \"/usr/lib/python2.7/dist-packages/ceph_disk/main.py\", line 3203, in activate\r\n    ' with fsid %s' % ceph_fsid)\r\nceph_disk.main.Error: Error: No cluster conf found in /etc/ceph with fsid 00000000-0000-0000-0000-000000000000\r\n\r\n\r\n"},"comment":{"url":"https://api.github.com/repos/ceph/ceph-docker/issues/comments/239482222","html_url":"https://github.com/ceph/ceph-docker/issues/355#issuecomment-239482222","issue_url":"https://api.github.com/repos/ceph/ceph-docker/issues/355","id":239482222,"user":{"login":"pineking","id":72760,"avatar_url":"https://avatars.githubusercontent.com/u/72760?v=3","gravatar_id":"","url":"https://api.github.com/users/pineking","html_url":"https://github.com/pineking","followers_url":"https://api.github.com/users/pineking/followers","following_url":"https://api.github.com/users/pineking/following{/other_user}","gists_url":"https://api.github.com/users/pineking/gists{/gist_id}","starred_url":"https://api.github.com/users/pineking/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/pineking/subscriptions","organizations_url":"https://api.github.com/users/pineking/orgs","repos_url":"https://api.github.com/users/pineking/repos","events_url":"https://api.github.com/users/pineking/events{/privacy}","received_events_url":"https://api.github.com/users/pineking/received_events","type":"User","site_admin":false},"created_at":"2016-08-12T15:44:52Z","updated_at":"2016-08-12T15:44:52Z","body":"I found there is a file named \"ceph_fsid\" in /dev/sdb1 , and this file contains a string with all zero \"00000000-0000-0000-0000-000000000000\".  change this string to the correct fsid, and restart the osd daemon, fix the problem."}}
{"actor":{"display_login":"pineking"}}