{"action":"created","issue":{"url":"https://api.github.com/repos/chrislusf/seaweedfs/issues/782","repository_url":"https://api.github.com/repos/chrislusf/seaweedfs","labels_url":"https://api.github.com/repos/chrislusf/seaweedfs/issues/782/labels{/name}","comments_url":"https://api.github.com/repos/chrislusf/seaweedfs/issues/782/comments","events_url":"https://api.github.com/repos/chrislusf/seaweedfs/issues/782/events","html_url":"https://github.com/chrislusf/seaweedfs/issues/782","id":387656264,"node_id":"MDU6SXNzdWUzODc2NTYyNjQ=","number":782,"title":"filer 相关","user":{"login":"BackLife","id":25834510,"node_id":"MDQ6VXNlcjI1ODM0NTEw","avatar_url":"https://avatars0.githubusercontent.com/u/25834510?v=4","gravatar_id":"","url":"https://api.github.com/users/BackLife","html_url":"https://github.com/BackLife","followers_url":"https://api.github.com/users/BackLife/followers","following_url":"https://api.github.com/users/BackLife/following{/other_user}","gists_url":"https://api.github.com/users/BackLife/gists{/gist_id}","starred_url":"https://api.github.com/users/BackLife/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/BackLife/subscriptions","organizations_url":"https://api.github.com/users/BackLife/orgs","repos_url":"https://api.github.com/users/BackLife/repos","events_url":"https://api.github.com/users/BackLife/events{/privacy}","received_events_url":"https://api.github.com/users/BackLife/received_events","type":"User","site_admin":false},"labels":[],"state":"closed","locked":false,"assignee":null,"assignees":[],"milestone":null,"comments":14,"created_at":"2018-12-05T09:05:16Z","updated_at":"2018-12-06T08:35:50Z","closed_at":"2018-12-06T08:28:07Z","author_association":"NONE","body":"filer 带目录结构上传这个功能很实用，我目前准备主要使用这个功能进行上传操作，但是目前有些我无法解决的问题：\r\n环境：centos 7  三台服务器，每台1master+1volume+1filer  三台同dataCenter，不同rack(相同的也试过)，通过nginx代理（轮询），kafka已开启（独立服务器），redis集群已配置  所有服务器防火墙均已关闭 使用最新版本的SeaweedFs\r\nnginx 策略 : \r\nupstream  tomcat_server2{  \r\n\t\t#ip_hash;\r\n\t\tserver   192.168.19.31:8888 weight=10 max_fails=2 fail_timeout=60s;\r\n\t\tserver   192.168.19.32:8888 weight=10 max_fails=2 fail_timeout=60s;\r\n\t\tserver   192.168.19.33:8888 weight=10 max_fails=2 fail_timeout=60s;\r\n\t}\r\n\r\n1:filer 上传文件，未指定dataCenter，数据存储正常，假如该数据存储在192.168.19.31:8888/path上面，无法通过192.168.19.32:8888/path  或者192.168.19.31:8888/path查找到该数据，但是根据备份策略，192.168.19.32 和 192.168.19.33 的volume 里面是有该数据的，\r\n2.在测试过程中， kafka发送一直异常，由于对于kafka没有研究过，第一次使用，无法解决（kafka机器独立测试消息发送接受均正常）异常信息：\r\nE1205 16:36:45  8058 kafka_queue.go:79] producer message error, partition:3 offset:0 key:/2018/12/1543999004514Seaweedfs.TXT valus:\u0012j\r\n#/2018/12/1543999004514Seaweedfs.TXT\u001A'\r\n\r\n9,0914f028ea\u0018*\r\n\"9cda6c02\"\"\u001A\u0010\u0005\u0018\u0007(B\u0003020\u0018\u0001 error(dial tcp [::1]:9092: connect: connection refused) topic:seaweedfs_filer1_to_filer2\r\n\r\n折腾许久，实在无法搞定，特别寻求帮助\r\n\r\n贴一点配置：\r\n[source.filer]\r\nenabled = true\r\ngrpcAddress = \"localhost:18888\"\r\ndirectory = \"/home/cra/seaweedfs/data/filerData\"    # all files under this directory tree are replicated\r\n\r\n[notification.kafka]\r\nenabled = true\r\nhosts = [\r\n  \"192.168.19.34:9092\"\r\n]\r\ntopic = \"seaweedfs_filer1_to_filer2\"\r\n\r\n[sink.filer]\r\nenabled = true\r\ngrpcAddress = \"localhost:18888\"\r\ndirectory = \"/home/cra/seaweedfs/data/filerData\"    # all replicated files are under this directory tree\r\nreplication = \"\"\r\ncollection = \"\"\r\nttlSec = 0\r\n[redis_cluster]\r\nenabled = true\r\naddresses = [\r\n    \"192.168.19.35:6379\",\r\n    \"192.168.19.36:6379\",\r\n]\r\n\r\n启动参数：\r\nnohup ./weed master -mdir=data/defaultData -port=9333 -defaultReplication=\"010\" -ip=\"192.168.19.31\" -peers=192.168.19.32:9333,192.168\r\n.19.33:9333 > log/master_server.log 2>&1 &\r\n\r\nnohup ./weed volume -dataCenter=dataCenter -rack=dataRack1 -dir=data/dataRack1 -ip=\"192.168.19.31\" -port=9080 -max=10 -mserver=\"192.1\r\n68.19.31:9333,192.168.19.32:9333,192.168.19.33:9333\" > log/volume_dataRack1.log 2>&1 &\r\n\r\nnohup ./weed filer -defaultReplicaPlacement=\"020\" -port=8888 -ip=\"192.168.19.31\"  -master=\"192.168.19.31:9333,192.168.19.32:9333,192.\r\n168.19.33:9333\"  > log/filer.log 2>&1 &\r\n\r\n\r\n项目实现目标：\r\n1：加了nginx后，不关注后台具体存在哪一个volum，均能正常上传读写（已实现上传使用filer,读使用IP:9333/fid）\r\n2:filer 通过浏览器访问，不管访问哪一个filer,均能看到三个(多个) filer（甚至包含非filer模式上传的文件）下的文件目录和文件，并可进行读取/下载\r\n期待实现：（老大要求，目前未找到便捷方式）\r\n极端情况下，在只有数据备份的情况下，可快速还原可识别的文件"},"comment":{"url":"https://api.github.com/repos/chrislusf/seaweedfs/issues/comments/444791206","html_url":"https://github.com/chrislusf/seaweedfs/issues/782#issuecomment-444791206","issue_url":"https://api.github.com/repos/chrislusf/seaweedfs/issues/782","id":444791206,"node_id":"MDEyOklzc3VlQ29tbWVudDQ0NDc5MTIwNg==","user":{"login":"BackLife","id":25834510,"node_id":"MDQ6VXNlcjI1ODM0NTEw","avatar_url":"https://avatars0.githubusercontent.com/u/25834510?v=4","gravatar_id":"","url":"https://api.github.com/users/BackLife","html_url":"https://github.com/BackLife","followers_url":"https://api.github.com/users/BackLife/followers","following_url":"https://api.github.com/users/BackLife/following{/other_user}","gists_url":"https://api.github.com/users/BackLife/gists{/gist_id}","starred_url":"https://api.github.com/users/BackLife/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/BackLife/subscriptions","organizations_url":"https://api.github.com/users/BackLife/orgs","repos_url":"https://api.github.com/users/BackLife/repos","events_url":"https://api.github.com/users/BackLife/events{/privacy}","received_events_url":"https://api.github.com/users/BackLife/received_events","type":"User","site_admin":false},"created_at":"2018-12-06T08:35:50Z","updated_at":"2018-12-06T08:35:50Z","author_association":"NONE","body":"再次感谢您给与的支持"}}
{"actor":{"display_login":"BackLife"}}