{"action":"created","issue":{"url":"https://api.github.com/repos/marytts/marytts/issues/583","repository_url":"https://api.github.com/repos/marytts/marytts","labels_url":"https://api.github.com/repos/marytts/marytts/issues/583/labels{/name}","comments_url":"https://api.github.com/repos/marytts/marytts/issues/583/comments","events_url":"https://api.github.com/repos/marytts/marytts/issues/583/events","html_url":"https://github.com/marytts/marytts/issues/583","id":169739657,"number":583,"title":"New language support issues: Incorrect string value when run wkdb_cleaning_up.sh","user":{"login":"jetaudio","id":7151441,"avatar_url":"https://avatars.githubusercontent.com/u/7151441?v=3","gravatar_id":"","url":"https://api.github.com/users/jetaudio","html_url":"https://github.com/jetaudio","followers_url":"https://api.github.com/users/jetaudio/followers","following_url":"https://api.github.com/users/jetaudio/following{/other_user}","gists_url":"https://api.github.com/users/jetaudio/gists{/gist_id}","starred_url":"https://api.github.com/users/jetaudio/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/jetaudio/subscriptions","organizations_url":"https://api.github.com/users/jetaudio/orgs","repos_url":"https://api.github.com/users/jetaudio/repos","events_url":"https://api.github.com/users/jetaudio/events{/privacy}","received_events_url":"https://api.github.com/users/jetaudio/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"assignees":[],"milestone":null,"comments":5,"created_at":"2016-08-06T09:59:35Z","updated_at":"2016-08-07T15:25:56Z","closed_at":null,"body":"I ran `wkdb_cleaning_up.sh wkdb.conf` and got this error \r\nProcessing xml file:xml_splits/page15.xml\r\n\r\nMysql driver loaded, set locale=vi_VI\r\nCreating connection to DB server...\r\nMysql connection created successfully.\r\nCreating and loading TABLES: page, text and revision. (The loading can take a while...)\r\n\r\nMysql driver loaded, set locale=vi_VI\r\nUsing mwdumper to convert xml file into sql source file and loading text, page and revision tables into the DB.\r\nCreating connection to DB server...\r\nMysql connection created successfully.\r\nCreating empty wikipedia tables: checking if tables text, page and revision already exist.\r\n\r\n ***To continue please check if the table \"text\" is used by another user/process.*** \r\n    Tables \"text\", \"page\" and \"revision\" are temporary tables used by mwdumper to extract wikipedia pages. \r\n    Just one user/process can use these tables at the same time in the same DataBase, please use other DataBase if possible.\r\n    If the tables are not in use by any other user/process please use the option for deleting.\r\n\r\n    TABLE = \"text\" already exists deleting (y/n)?y\r\n\r\n ***To continue please check if the table \"revision\" is used by another user/process.*** \r\n    Tables \"text\", \"page\" and \"revision\" are temporary tables used by mwdumper to extract wikipedia pages. \r\n    Just one user/process can use these tables at the same time in the same DataBase, please use other DataBase if possible.\r\n    If the tables are not in use by any other user/process please use the option for deleting.\r\n\r\n    TABLE = \"revision\" already exists deleting (y/n)?y\r\n  Creating table: text\r\n  Creating table: page\r\n  Creating table: revision\r\nException in thread \"main\" java.io.IOException: java.sql.SQLException: Incorrect string value: '\\xF0\\xA0\\x84\\xA9\\xE5\\xA9...' for column 'page_title' at row 337\r\n\tat org.mediawiki.importer.XmlDumpReader.readDump(XmlDumpReader.java:92)\r\n\tat marytts.tools.dbselection.DBHandler.loadPagesWithMWDumper(DBHandler.java:257)\r\n\tat marytts.tools.dbselection.WikipediaMarkupCleaner.processWikipediaPages(WikipediaMarkupCleaner.java:1088)\r\n\tat marytts.tools.dbselection.WikipediaProcessor.main(WikipediaProcessor.java:444)\r\nCaused by: org.xml.sax.SAXException: java.sql.SQLException: Incorrect string value: '\\xF0\\xA0\\x84\\xA9\\xE5\\xA9...' for column 'page_title' at row 337\r\n\tat org.mediawiki.importer.XmlDumpReader.endElement(XmlDumpReader.java:227)\r\n\tat com.sun.org.apache.xerces.internal.parsers.AbstractSAXParser.endElement(AbstractSAXParser.java:609)\r\n\tat com.sun.org.apache.xerces.internal.impl.XMLDocumentFragmentScannerImpl.scanEndElement(XMLDocumentFragmentScannerImpl.java:1776)\r\n\tat com.sun.org.apache.xerces.internal.impl.XMLDocumentFragmentScannerImpl$FragmentContentDriver.next(XMLDocumentFragmentScannerImpl.java:2964)\r\n\tat com.sun.org.apache.xerces.internal.impl.XMLDocumentScannerImpl.next(XMLDocumentScannerImpl.java:606)\r\n\tat com.sun.org.apache.xerces.internal.impl.XMLDocumentFragmentScannerImpl.scanDocument(XMLDocumentFragmentScannerImpl.java:504)\r\n\tat com.sun.org.apache.xerces.internal.parsers.XML11Configuration.parse(XML11Configuration.java:848)\r\n\tat com.sun.org.apache.xerces.internal.parsers.XML11Configuration.parse(XML11Configuration.java:777)\r\n\tat com.sun.org.apache.xerces.internal.parsers.XMLParser.parse(XMLParser.java:141)\r\n\tat com.sun.org.apache.xerces.internal.parsers.AbstractSAXParser.parse(AbstractSAXParser.java:1213)\r\n\tat com.sun.org.apache.xerces.internal.jaxp.SAXParserImpl$JAXPSAXParser.parse(SAXParserImpl.java:643)\r\n\tat com.sun.org.apache.xerces.internal.jaxp.SAXParserImpl.parse(SAXParserImpl.java:327)\r\n\tat javax.xml.parsers.SAXParser.parse(SAXParser.java:195)\r\n\tat org.mediawiki.importer.XmlDumpReader.readDump(XmlDumpReader.java:88)\r\n\t... 3 more\r\n\r\nCan anyone help me solve this? Please help :("},"comment":{"url":"https://api.github.com/repos/marytts/marytts/issues/comments/238088674","html_url":"https://github.com/marytts/marytts/issues/583#issuecomment-238088674","issue_url":"https://api.github.com/repos/marytts/marytts/issues/583","id":238088674,"user":{"login":"jetaudio","id":7151441,"avatar_url":"https://avatars.githubusercontent.com/u/7151441?v=3","gravatar_id":"","url":"https://api.github.com/users/jetaudio","html_url":"https://github.com/jetaudio","followers_url":"https://api.github.com/users/jetaudio/followers","following_url":"https://api.github.com/users/jetaudio/following{/other_user}","gists_url":"https://api.github.com/users/jetaudio/gists{/gist_id}","starred_url":"https://api.github.com/users/jetaudio/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/jetaudio/subscriptions","organizations_url":"https://api.github.com/users/jetaudio/orgs","repos_url":"https://api.github.com/users/jetaudio/repos","events_url":"https://api.github.com/users/jetaudio/events{/privacy}","received_events_url":"https://api.github.com/users/jetaudio/received_events","type":"User","site_admin":false},"created_at":"2016-08-07T15:25:56Z","updated_at":"2016-08-07T15:25:56Z","body":"Just delete ruined file from wikilist.txt and everything will be alright. Thanks for your help @BaimAT :)))"}}
{"actor":{"display_login":"jetaudio"}}