{"action":"created","issue":{"url":"https://api.github.com/repos/elastic/elasticsearch-hadoop/issues/607","repository_url":"https://api.github.com/repos/elastic/elasticsearch-hadoop","labels_url":"https://api.github.com/repos/elastic/elasticsearch-hadoop/issues/607/labels{/name}","comments_url":"https://api.github.com/repos/elastic/elasticsearch-hadoop/issues/607/comments","events_url":"https://api.github.com/repos/elastic/elasticsearch-hadoop/issues/607/events","html_url":"https://github.com/elastic/elasticsearch-hadoop/issues/607","id":116460290,"node_id":"MDU6SXNzdWUxMTY0NjAyOTA=","number":607,"title":"EsHadoopIllegalStateException reading Geo-Shape into DataFrame - SparkSQL","user":{"login":"randallwhitman","id":3411515,"node_id":"MDQ6VXNlcjM0MTE1MTU=","avatar_url":"https://avatars3.githubusercontent.com/u/3411515?v=4","gravatar_id":"","url":"https://api.github.com/users/randallwhitman","html_url":"https://github.com/randallwhitman","followers_url":"https://api.github.com/users/randallwhitman/followers","following_url":"https://api.github.com/users/randallwhitman/following{/other_user}","gists_url":"https://api.github.com/users/randallwhitman/gists{/gist_id}","starred_url":"https://api.github.com/users/randallwhitman/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/randallwhitman/subscriptions","organizations_url":"https://api.github.com/users/randallwhitman/orgs","repos_url":"https://api.github.com/users/randallwhitman/repos","events_url":"https://api.github.com/users/randallwhitman/events{/privacy}","received_events_url":"https://api.github.com/users/randallwhitman/received_events","type":"User","site_admin":false},"labels":[{"id":119737425,"node_id":"MDU6TGFiZWwxMTk3Mzc0MjU=","url":"https://api.github.com/repos/elastic/elasticsearch-hadoop/labels/:Spark","name":":Spark","color":"009800","default":false},{"id":31506632,"node_id":"MDU6TGFiZWwzMTUwNjYzMg==","url":"https://api.github.com/repos/elastic/elasticsearch-hadoop/labels/bug","name":"bug","color":"fc2929","default":true},{"id":308791014,"node_id":"MDU6TGFiZWwzMDg3OTEwMTQ=","url":"https://api.github.com/repos/elastic/elasticsearch-hadoop/labels/v2.2.0","name":"v2.2.0","color":"bfdadc","default":false}],"state":"closed","locked":false,"assignee":null,"assignees":[],"milestone":null,"comments":45,"created_at":"2015-11-12T01:31:58Z","updated_at":"2018-10-31T11:54:54Z","closed_at":"2016-01-29T18:34:37Z","author_association":"NONE","body":"1. Create an index type with a mapping consisting of a field of type geo_shape.\n2. Create an `RDD[String]` containing a polygon as GeoJSON, as the value of a field whose name matches the mapping:\n   `\"\"\"{\"rect\":{\"type\":\"Polygon\",\"coordinates\":[[[50,32],[69,32],[69,50],[50,50],[50,32]]],\"crs\":null}}\"\"\"`\n3. Write to an index type in Elasticsearch:\n   `rdd1.saveJsonToEs(indexName+\"/\"+indexType, connectorConfig)`\n4. Read into SparkSQL DataFrame with either `esDF` or `read`-`format`-`load`:\n   - `sqlContext.esDF(indexName+\"/\"+indexType, connectorConfig)`\n   - `sqlContext.read.format(\"org.elasticsearch.spark.sql\").options(connectorConfig).load(indexName+\"/\"+indexType)`\n\nResult is:\norg.elasticsearch.hadoop.EsHadoopIllegalStateException: Field 'rect' not found; typically this occurs with arrays which are not mapped as single value\n[Full stack trace in gist](https://gist.github.com/randallwhitman/62f2ff80d73e921d178d).  Elasticsearch Hadoop v2.1.2\n"},"comment":{"url":"https://api.github.com/repos/elastic/elasticsearch-hadoop/issues/comments/434659177","html_url":"https://github.com/elastic/elasticsearch-hadoop/issues/607#issuecomment-434659177","issue_url":"https://api.github.com/repos/elastic/elasticsearch-hadoop/issues/607","id":434659177,"node_id":"MDEyOklzc3VlQ29tbWVudDQzNDY1OTE3Nw==","user":{"login":"jbaiera","id":875779,"node_id":"MDQ6VXNlcjg3NTc3OQ==","avatar_url":"https://avatars1.githubusercontent.com/u/875779?v=4","gravatar_id":"","url":"https://api.github.com/users/jbaiera","html_url":"https://github.com/jbaiera","followers_url":"https://api.github.com/users/jbaiera/followers","following_url":"https://api.github.com/users/jbaiera/following{/other_user}","gists_url":"https://api.github.com/users/jbaiera/gists{/gist_id}","starred_url":"https://api.github.com/users/jbaiera/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/jbaiera/subscriptions","organizations_url":"https://api.github.com/users/jbaiera/orgs","repos_url":"https://api.github.com/users/jbaiera/repos","events_url":"https://api.github.com/users/jbaiera/events{/privacy}","received_events_url":"https://api.github.com/users/jbaiera/received_events","type":"User","site_admin":false},"created_at":"2018-10-31T11:54:54Z","updated_at":"2018-10-31T11:54:54Z","author_association":"CONTRIBUTOR","body":"@Bomb281993 Please refrain from mentioning users on old issues like this. If you are seeing errors with geo-shape indexing, please post those errors and a description of the problem on the [forum](https://discuss.elastic.co/c/elasticsearch-and-hadoop) or in a new issue."}}
{"actor":{"display_login":"jbaiera"}}