{"action":"opened","issue":{"url":"https://api.github.com/repos/confluentinc/kafka-connect-hdfs/issues/155","repository_url":"https://api.github.com/repos/confluentinc/kafka-connect-hdfs","labels_url":"https://api.github.com/repos/confluentinc/kafka-connect-hdfs/issues/155/labels{/name}","comments_url":"https://api.github.com/repos/confluentinc/kafka-connect-hdfs/issues/155/comments","events_url":"https://api.github.com/repos/confluentinc/kafka-connect-hdfs/issues/155/events","html_url":"https://github.com/confluentinc/kafka-connect-hdfs/issues/155","id":192910781,"number":155,"title":"Is there a way to map topic names to valid Hive tables?","user":{"login":"rmoff","id":3671582,"avatar_url":"https://avatars.githubusercontent.com/u/3671582?v=3","gravatar_id":"","url":"https://api.github.com/users/rmoff","html_url":"https://github.com/rmoff","followers_url":"https://api.github.com/users/rmoff/followers","following_url":"https://api.github.com/users/rmoff/following{/other_user}","gists_url":"https://api.github.com/users/rmoff/gists{/gist_id}","starred_url":"https://api.github.com/users/rmoff/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/rmoff/subscriptions","organizations_url":"https://api.github.com/users/rmoff/orgs","repos_url":"https://api.github.com/users/rmoff/repos","events_url":"https://api.github.com/users/rmoff/events{/privacy}","received_events_url":"https://api.github.com/users/rmoff/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"assignees":[],"milestone":null,"comments":0,"created_at":"2016-12-01T17:27:02Z","updated_at":"2016-12-01T17:27:02Z","closed_at":null,"body":"I have data coming through from GoldenGate Kafka Connector, which takes the fully-qualified Oracle table name as the topic name. From what I can see there is no way to override this. \r\nWhen kafka-connect-hdfs tries to create a Hive table, it fails. \r\n\r\n```\r\nCaused by: io.confluent.connect.hdfs.errors.HiveMetaStoreException: Invalid table\r\n        at io.confluent.connect.hdfs.hive.HiveMetaStore.createTable(HiveMetaStore.java:200)\r\n        at io.confluent.connect.hdfs.parquet.ParquetHiveUtil.createTable(ParquetHiveUtil.java:46)\r\n        at io.confluent.connect.hdfs.TopicPartitionWriter$1.call(TopicPartitionWriter.java:640)\r\n        at io.confluent.connect.hdfs.TopicPartitionWriter$1.call(TopicPartitionWriter.java:637)\r\n        ... 4 more\r\nCaused by: InvalidObjectException(message:ORCL.SOE.ORDERS is not a valid object name)\r\n```\r\n\r\nIn the elasticsearch connector there is a [`topic.index.map`](https://github.com/confluentinc/kafka-connect-elasticsearch/blob/master/docs/configuration_options.rst) configuration to address this exact scenario (source topic names being invalid target objects). Is there an equivalent for the HDFS connector (or another suitable workaround?). "}}
{"actor":{"display_login":"rmoff"}}