{"action":"created","issue":{"url":"https://api.github.com/repos/AKSW/Palmetto/issues/8","repository_url":"https://api.github.com/repos/AKSW/Palmetto","labels_url":"https://api.github.com/repos/AKSW/Palmetto/issues/8/labels{/name}","comments_url":"https://api.github.com/repos/AKSW/Palmetto/issues/8/comments","events_url":"https://api.github.com/repos/AKSW/Palmetto/issues/8/events","html_url":"https://github.com/AKSW/Palmetto/issues/8","id":187941114,"number":8,"title":"Upgrading Palmetto to Lucene 6.2.1","user":{"login":"cgravier","id":1123304,"avatar_url":"https://avatars.githubusercontent.com/u/1123304?v=3","gravatar_id":"","url":"https://api.github.com/users/cgravier","html_url":"https://github.com/cgravier","followers_url":"https://api.github.com/users/cgravier/followers","following_url":"https://api.github.com/users/cgravier/following{/other_user}","gists_url":"https://api.github.com/users/cgravier/gists{/gist_id}","starred_url":"https://api.github.com/users/cgravier/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/cgravier/subscriptions","organizations_url":"https://api.github.com/users/cgravier/orgs","repos_url":"https://api.github.com/users/cgravier/repos","events_url":"https://api.github.com/users/cgravier/events{/privacy}","received_events_url":"https://api.github.com/users/cgravier/received_events","type":"User","site_admin":false},"labels":[{"id":77970058,"url":"https://api.github.com/repos/AKSW/Palmetto/labels/bug","name":"bug","color":"fc2929","default":true},{"id":77970060,"url":"https://api.github.com/repos/AKSW/Palmetto/labels/enhancement","name":"enhancement","color":"84b6eb","default":true}],"state":"closed","locked":false,"assignee":{"login":"MichaelRoeder","id":6122307,"avatar_url":"https://avatars.githubusercontent.com/u/6122307?v=3","gravatar_id":"","url":"https://api.github.com/users/MichaelRoeder","html_url":"https://github.com/MichaelRoeder","followers_url":"https://api.github.com/users/MichaelRoeder/followers","following_url":"https://api.github.com/users/MichaelRoeder/following{/other_user}","gists_url":"https://api.github.com/users/MichaelRoeder/gists{/gist_id}","starred_url":"https://api.github.com/users/MichaelRoeder/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/MichaelRoeder/subscriptions","organizations_url":"https://api.github.com/users/MichaelRoeder/orgs","repos_url":"https://api.github.com/users/MichaelRoeder/repos","events_url":"https://api.github.com/users/MichaelRoeder/events{/privacy}","received_events_url":"https://api.github.com/users/MichaelRoeder/received_events","type":"User","site_admin":false},"assignees":[{"login":"MichaelRoeder","id":6122307,"avatar_url":"https://avatars.githubusercontent.com/u/6122307?v=3","gravatar_id":"","url":"https://api.github.com/users/MichaelRoeder","html_url":"https://github.com/MichaelRoeder","followers_url":"https://api.github.com/users/MichaelRoeder/followers","following_url":"https://api.github.com/users/MichaelRoeder/following{/other_user}","gists_url":"https://api.github.com/users/MichaelRoeder/gists{/gist_id}","starred_url":"https://api.github.com/users/MichaelRoeder/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/MichaelRoeder/subscriptions","organizations_url":"https://api.github.com/users/MichaelRoeder/orgs","repos_url":"https://api.github.com/users/MichaelRoeder/repos","events_url":"https://api.github.com/users/MichaelRoeder/events{/privacy}","received_events_url":"https://api.github.com/users/MichaelRoeder/received_events","type":"User","site_admin":false}],"milestone":null,"comments":11,"created_at":"2016-11-08T09:27:46Z","updated_at":"2016-11-22T15:35:57Z","closed_at":"2016-11-09T11:26:11Z","body":"Hello,\r\n\r\nI am trying to upgrade Palmetto for Lucene 6.2.1.\r\nThe current Lucene version clashes with another Lucene version in our classpath, and well, that's the opportunity to suggest a PR, if welcomed.\r\n\r\nI already made some changes in a new branch in my fork (under progress) : [https://github.com/cgravier/Palmetto/tree/lucene621](https://github.com/cgravier/Palmetto/tree/lucene621)\r\n\r\nWhen I try to run `mvn clean install`, I get the trace below.\r\n\r\nIt seems to me that the test resource file `src/test/resources/test_bd/segments_w` had been created with a Lucene 3.x version.\r\n\r\nI didn't find any sub routine to recreated those resource files (with Lucene 6.x for instance).\r\n\r\nIs it possible to actually reconstruct those files ?\r\n\r\nThank you in advance,\r\n\r\ncgravier\r\n\r\n\r\n````\r\n[INFO] Scanning for projects...\r\n[INFO]                                                                         \r\n[INFO] ------------------------------------------------------------------------\r\n[INFO] Building Palmetto 0.1.2\r\n[INFO] ------------------------------------------------------------------------\r\n[INFO] \r\n[INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ palmetto ---\r\n[INFO] Deleting /Users/cgravier/Downloads/Palmetto/palmetto/target\r\n[INFO] \r\n[INFO] --- maven-resources-plugin:2.6:resources (default-resources) @ palmetto ---\r\n[INFO] Using 'UTF-8' encoding to copy filtered resources.\r\n[INFO] Copying 3 resources\r\n[INFO] \r\n[INFO] --- maven-compiler-plugin:3.1:compile (default-compile) @ palmetto ---\r\n[INFO] Changes detected - recompiling the module!\r\n[INFO] Compiling 99 source files to /Users/cgravier/Downloads/Palmetto/palmetto/target/classes\r\n[WARNING] /Users/cgravier/Downloads/Palmetto/palmetto/src/main/java/org/aksw/palmetto/corpus/lucene/creation/AbstractLuceneIndexCreator.java: Some input files use or override a deprecated API.\r\n[WARNING] /Users/cgravier/Downloads/Palmetto/palmetto/src/main/java/org/aksw/palmetto/corpus/lucene/creation/AbstractLuceneIndexCreator.java: Recompile with -Xlint:deprecation for details.\r\n[INFO] \r\n[INFO] --- maven-resources-plugin:2.6:testResources (default-testResources) @ palmetto ---\r\n[INFO] Using 'UTF-8' encoding to copy filtered resources.\r\n[INFO] Copying 6 resources\r\n[INFO] \r\n[INFO] --- maven-compiler-plugin:3.1:testCompile (default-testCompile) @ palmetto ---\r\n[INFO] Changes detected - recompiling the module!\r\n[INFO] Compiling 78 source files to /Users/cgravier/Downloads/Palmetto/palmetto/target/test-classes\r\n[INFO] \r\n[INFO] --- maven-surefire-plugin:2.12.4:test (default-test) @ palmetto ---\r\n[INFO] Surefire report directory: /Users/cgravier/Downloads/Palmetto/palmetto/target/surefire-reports\r\n\r\n-------------------------------------------------------\r\n T E S T S\r\n-------------------------------------------------------\r\nRunning org.aksw.palmetto.calculations.direct.CondProbCoherenceCalculationTest\r\nTests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.093 sec\r\nRunning org.aksw.palmetto.calculations.direct.DifferenceBasedCoherenceCalculationTest\r\nTests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.005 sec\r\nRunning org.aksw.palmetto.calculations.direct.FitelsonCoherenceCalculationTest\r\nTests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.008 sec\r\nRunning org.aksw.palmetto.calculations.direct.JaccardCoherenceCalculationTest\r\nTests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.012 sec\r\nRunning org.aksw.palmetto.calculations.direct.LikelihoodCoherenceCalculationTest\r\nTests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.009 sec\r\nRunning org.aksw.palmetto.calculations.direct.LogCondProbCoherenceCalculationTest\r\nTests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.007 sec\r\nRunning org.aksw.palmetto.calculations.direct.LogJaccardCoherenceCalculationTest\r\nTests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.01 sec\r\nRunning org.aksw.palmetto.calculations.direct.LogLikelihoodCoherenceCalculationTest\r\nTests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.005 sec\r\nRunning org.aksw.palmetto.calculations.direct.LogRatioCoherenceCalculationTest\r\nTests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.007 sec\r\nRunning org.aksw.palmetto.calculations.direct.NormalizedLogRatioCoherenceCalculationTest\r\nTests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.012 sec\r\nRunning org.aksw.palmetto.calculations.direct.OlssonsCoherenceCalculationTest\r\nTests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.006 sec\r\nRunning org.aksw.palmetto.calculations.direct.RatioCoherenceCalculationTest\r\nTests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.006 sec\r\nRunning org.aksw.palmetto.calculations.direct.ShogenjisCoherenceCalculationTest\r\nTests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.009 sec\r\nRunning org.aksw.palmetto.calculations.indirect.CentroidBasedCoherenceTest\r\nTests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.012 sec\r\nRunning org.aksw.palmetto.calculations.indirect.CosinusBasedCalculationTest\r\nTests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.004 sec\r\nRunning org.aksw.palmetto.calculations.indirect.CosinusBasedCoherenceTest\r\nTests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.032 sec\r\nRunning org.aksw.palmetto.calculations.indirect.DiceBasedCalculationTest\r\nTests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.007 sec\r\nRunning org.aksw.palmetto.calculations.indirect.DiceBasedCoherenceTest\r\nTests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.004 sec\r\nRunning org.aksw.palmetto.calculations.indirect.JaccardBasedCalculationTest\r\nTests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.011 sec\r\nRunning org.aksw.palmetto.calculations.indirect.JaccardBasedCoherenceTest\r\nTests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.003 sec\r\nRunning org.aksw.palmetto.calculations.indirect.VectorCreationTest\r\nTests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.022 sec\r\nRunning org.aksw.palmetto.corpus.lucene.creation.PositionStoringLuceneIndexCreatorTest\r\n2016-11-04 15:49:18,631 INFO [org.aksw.palmetto.corpus.lucene.creation.PositionStoringLuceneIndexCreator] - <Starting index creation...>\r\n2016-11-04 15:49:18,984 INFO [org.aksw.palmetto.corpus.lucene.creation.PositionStoringLuceneIndexCreator] - <Finished index creation.>\r\n2016-11-04 15:49:19,088 INFO [org.aksw.palmetto.corpus.lucene.creation.LuceneIndexHistogramCreator] - <Saw 3 documents.>\r\n2016-11-04 15:49:19,089 INFO [org.aksw.palmetto.corpus.lucene.creation.LuceneIndexHistogramCreator] - <Counted 14 tokens.>\r\nTests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.578 sec\r\nRunning org.aksw.palmetto.corpus.lucene.creation.SimpleLuceneIndexCreatorTest\r\n2016-11-04 15:49:19,109 INFO [org.aksw.palmetto.corpus.lucene.creation.SimpleLuceneIndexCreator] - <Starting index creation...>\r\n2016-11-04 15:49:19,113 INFO [org.aksw.palmetto.corpus.lucene.creation.SimpleLuceneIndexCreator] - <Finished index creation.>\r\nTests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.024 sec\r\nRunning org.aksw.palmetto.corpus.lucene.LuceneCorpusAdapterForSlidingWindowsTest\r\nTests run: 1, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 0.006 sec <<< FAILURE!\r\ntest(org.aksw.palmetto.corpus.lucene.LuceneCorpusAdapterForSlidingWindowsTest)  Time elapsed: 0.006 sec  <<< ERROR!\r\norg.apache.lucene.index.IndexFormatTooOldException: Format version is not supported (resource BufferedChecksumIndexInput(NIOFSIndexInput(path=\"/Users/cgravier/Downloads/Palmetto/palmetto/src/test/resources/test_bd/segments_w\"))): 0 (needs to be between 4 and 6). This version of Lucene only supports indexes created with release 5.0 and later.\r\n\tat org.apache.lucene.codecs.CodecUtil.checkHeaderNoMagic(CodecUtil.java:213)\r\n\tat org.apache.lucene.index.SegmentInfos.readCommit(SegmentInfos.java:297)\r\n\tat org.apache.lucene.index.SegmentInfos.readCommit(SegmentInfos.java:284)\r\n\tat org.apache.lucene.index.StandardDirectoryReader$1.doBody(StandardDirectoryReader.java:57)\r\n\tat org.apache.lucene.index.StandardDirectoryReader$1.doBody(StandardDirectoryReader.java:54)\r\n\tat org.apache.lucene.index.SegmentInfos$FindSegmentsFile.run(SegmentInfos.java:685)\r\n\tat org.apache.lucene.index.StandardDirectoryReader.open(StandardDirectoryReader.java:77)\r\n\tat org.apache.lucene.index.DirectoryReader.open(DirectoryReader.java:63)\r\n\tat org.aksw.palmetto.corpus.lucene.WindowSupportingLuceneCorpusAdapter.create(WindowSupportingLuceneCorpusAdapter.java:48)\r\n\tat org.aksw.palmetto.corpus.lucene.LuceneCorpusAdapterForSlidingWindowsTest.test(LuceneCorpusAdapterForSlidingWindowsTest.java:35)\r\n\tat sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)\r\n\tat sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)\r\n\tat sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)\r\n\tat java.lang.reflect.Method.invoke(Method.java:497)\r\n\tat org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:44)\r\n\tat org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:15)\r\n\tat org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:41)\r\n\tat org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:20)\r\n\tat org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:76)\r\n\tat org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:50)\r\n\tat org.junit.runners.ParentRunner$3.run(ParentRunner.java:193)\r\n\tat org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:52)\r\n\tat org.junit.runners.ParentRunner.runChildren(ParentRunner.java:191)\r\n\tat org.junit.runners.ParentRunner.access$000(ParentRunner.java:42)\r\n\tat org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:184)\r\n\tat org.junit.runners.ParentRunner.run(ParentRunner.java:236)\r\n\tat org.apache.maven.surefire.junit4.JUnit4Provider.execute(JUnit4Provider.java:252)\r\n\tat org.apache.maven.surefire.junit4.JUnit4Provider.executeTestSet(JUnit4Provider.java:141)\r\n\tat org.apache.maven.surefire.junit4.JUnit4Provider.invoke(JUnit4Provider.java:112)\r\n\tat sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)\r\n\tat sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)\r\n\tat sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)\r\n\tat java.lang.reflect.Method.invoke(Method.java:497)\r\n\tat org.apache.maven.surefire.util.ReflectionUtils.invokeMethodWithArray(ReflectionUtils.java:189)\r\n\tat org.apache.maven.surefire.booter.ProviderFactory$ProviderProxy.invoke(ProviderFactory.java:165)\r\n\tat org.apache.maven.surefire.booter.ProviderFactory.invokeProvider(ProviderFactory.java:85)\r\n\tat org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:115)\r\n\tat org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:75)\r\n\r\nRunning org.aksw.palmetto.corpus.lucene.SimpleAnalyzerTest\r\nTests run: 8, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.014 sec\r\nRunning org.aksw.palmetto.evaluate.correlation.KendallsTauTest\r\nTests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.005 sec\r\nRunning org.aksw.palmetto.evaluate.correlation.PearsonsSampleCorrelationCoefficientTest\r\nTests run: 9, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.023 sec\r\nRunning org.aksw.palmetto.evaluate.correlation.SpearmanTest\r\nTests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.017 sec\r\nRunning org.aksw.palmetto.prob.bd.BitSetBasedBooleanDocumentFrequencyDeterminerTest\r\nTests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.008 sec\r\nRunning org.aksw.palmetto.prob.bd.BooleanDocumentFrequencyDeterminerPerformanceTest\r\nBooleanDocument performance test BitSetBased: 150 ms\tListBased: 189 ms\r\nBooleanDocument performance test BitSetBased: 93 ms\tListBased: 71 ms\r\nBooleanDocument performance test BitSetBased: 90 ms\tListBased: 78 ms\r\nTests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.731 sec\r\nRunning org.aksw.palmetto.prob.bd.BooleanDocumentProbabilitySupplierTest\r\nTests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.003 sec\r\nRunning org.aksw.palmetto.prob.BooleanSlidingWindowFrequencyDeterminerCountingTest\r\nTests run: 10, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.017 sec\r\nRunning org.aksw.palmetto.prob.BooleanSlidingWindowFrequencyDeterminerSumCreationTest\r\nTests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.002 sec\r\nRunning org.aksw.palmetto.prob.BooleanSlidingWindowProbabilitySupplierTest\r\nTests run: 8, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.005 sec\r\nRunning org.aksw.palmetto.prob.ContextWindowFrequencyDeterminerCountingTest\r\nTests run: 9, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.012 sec\r\nRunning org.aksw.palmetto.prob.decorator.FrequencyCachingDeterminerDecoratorTest\r\n2016-11-04 15:49:20,048 INFO [org.aksw.palmetto.prob.decorator.FrequencyCachingDeterminerDecoratorTest] - <Testing cache...>\r\n2016-11-04 15:49:20,736 INFO [org.aksw.palmetto.prob.decorator.FrequencyCachingDeterminerDecoratorTest] - <Testing cache...>\r\nTests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.594 sec\r\nRunning org.aksw.palmetto.prob.ListBasedBooleanDocumentFrequencyDeterminerTest\r\nTests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.002 sec\r\nRunning org.aksw.palmetto.subsets.AllAllTest\r\nTests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0 sec\r\nRunning org.aksw.palmetto.subsets.AllOneTest\r\nTests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0 sec\r\nRunning org.aksw.palmetto.subsets.AnyAnyTest\r\nTests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.003 sec\r\nRunning org.aksw.palmetto.subsets.OneAllTest\r\nTests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0 sec\r\nRunning org.aksw.palmetto.subsets.OneAnyTest\r\nTests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0 sec\r\nRunning org.aksw.palmetto.subsets.OneOneAndSelfTest\r\nTests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0 sec\r\nRunning org.aksw.palmetto.subsets.OneOneTest\r\nTests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.011 sec\r\nRunning org.aksw.palmetto.subsets.OnePrecedingTest\r\nTests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0 sec\r\nRunning org.aksw.palmetto.subsets.OneSetTest\r\nTests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0 sec\r\nRunning org.aksw.palmetto.subsets.OneSubsequentTest\r\nTests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0 sec\r\nRunning org.aksw.palmetto.sum.ArithmeticMeanTest\r\nTests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.001 sec\r\nRunning org.aksw.palmetto.sum.GeometricMeanTest\r\nTests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0 sec\r\nRunning org.aksw.palmetto.sum.HarmonicMeanTest\r\nTests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.001 sec\r\nRunning org.aksw.palmetto.sum.MaxTest\r\nTests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0 sec\r\nRunning org.aksw.palmetto.sum.MedianTest\r\nTests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.009 sec\r\nRunning org.aksw.palmetto.sum.MinTest\r\nTests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.006 sec\r\nRunning org.aksw.palmetto.sum.QuadraticMeanTest\r\nTests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.01 sec\r\nRunning org.aksw.palmetto.vector.CondProbCalculationBasedCreatorTest\r\nTests run: 16, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.008 sec\r\nRunning org.aksw.palmetto.vector.DifferenceCalculationBasedCreatorTest\r\nTests run: 16, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.02 sec\r\nRunning org.aksw.palmetto.vector.FitelsonCalculationBasedCreatorTest\r\nTests run: 16, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.006 sec\r\nRunning org.aksw.palmetto.vector.JaccardCalculationBasedCreatorTest\r\nTests run: 16, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.011 sec\r\nRunning org.aksw.palmetto.vector.LikelihoodCalculationBasedCreatorTest\r\nTests run: 20, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.009 sec\r\nRunning org.aksw.palmetto.vector.LogCondProbCalculationBasedCreatorTest\r\nTests run: 16, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.012 sec\r\nRunning org.aksw.palmetto.vector.LogJaccardCoherenceCalculationTest\r\nTests run: 16, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.023 sec\r\nRunning org.aksw.palmetto.vector.LogLikelihoodCalculationBasedCreatorTest\r\nTests run: 20, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.013 sec\r\nRunning org.aksw.palmetto.vector.LogRatioCalculationBasedCreatorTest\r\nTests run: 20, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.013 sec\r\nRunning org.aksw.palmetto.vector.NormalizedLogRatioCalculationBasedCreatorTest\r\nTests run: 20, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.017 sec\r\nRunning org.aksw.palmetto.vector.ProbabilityBasedVectorCreatorTest\r\nTests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.001 sec\r\nRunning org.aksw.palmetto.vector.RatioCoherenceCalculationTest\r\nTests run: 20, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.014 sec\r\nRunning org.aksw.palmetto.weight.CompleteProbabilityBasedWeighterTest\r\nTests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.002 sec\r\nRunning org.aksw.palmetto.weight.ConditionalProbabilityBasedWeighterTest\r\nTests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.001 sec\r\nRunning org.aksw.palmetto.weight.MarginalProbabilityBasedWeighterTest\r\nTests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.002 sec\r\nRunning org.aksw.palmetto.weight.WordSetSizeBasedWeighterTest\r\nTests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.006 sec\r\n\r\nResults :\r\n\r\nTests in error: \r\n  test(org.aksw.palmetto.corpus.lucene.LuceneCorpusAdapterForSlidingWindowsTest): Format version is not supported (resource BufferedChecksumIndexInput(NIOFSIndexInput(path=\"/Users/cgravier/Downloads/Palmetto/palmetto/src/test/resources/test_bd/segments_w\"))): 0 (needs to be between 4 and 6). This version of Lucene only supports indexes created with release 5.0 and later.\r\n\r\nTests run: 427, Failures: 0, Errors: 1, Skipped: 0\r\n\r\n[INFO] ------------------------------------------------------------------------\r\n[INFO] BUILD FAILURE\r\n[INFO] ------------------------------------------------------------------------\r\n[INFO] Total time: 9.645 s\r\n[INFO] Finished at: 2016-11-04T15:49:21+01:00\r\n[INFO] Final Memory: 22M/272M\r\n[INFO] ------------------------------------------------------------------------\r\n[ERROR] Failed to execute goal org.apache.maven.plugins:maven-surefire-plugin:2.12.4:test (default-test) on project palmetto: There are test failures.\r\n[ERROR] \r\n[ERROR] Please refer to /Users/cgravier/Downloads/Palmetto/palmetto/target/surefire-reports for the individual test results.\r\n[ERROR] -> [Help 1]\r\n[ERROR] \r\n[ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.\r\n[ERROR] Re-run Maven using the -X switch to enable full debug logging.\r\n[ERROR] \r\n[ERROR] For more information about the errors and possible solutions, please read the following articles:\r\n[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException\r\n\r\n```\r\n"},"comment":{"url":"https://api.github.com/repos/AKSW/Palmetto/issues/comments/262273619","html_url":"https://github.com/AKSW/Palmetto/issues/8#issuecomment-262273619","issue_url":"https://api.github.com/repos/AKSW/Palmetto/issues/8","id":262273619,"user":{"login":"MichaelRoeder","id":6122307,"avatar_url":"https://avatars.githubusercontent.com/u/6122307?v=3","gravatar_id":"","url":"https://api.github.com/users/MichaelRoeder","html_url":"https://github.com/MichaelRoeder","followers_url":"https://api.github.com/users/MichaelRoeder/followers","following_url":"https://api.github.com/users/MichaelRoeder/following{/other_user}","gists_url":"https://api.github.com/users/MichaelRoeder/gists{/gist_id}","starred_url":"https://api.github.com/users/MichaelRoeder/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/MichaelRoeder/subscriptions","organizations_url":"https://api.github.com/users/MichaelRoeder/orgs","repos_url":"https://api.github.com/users/MichaelRoeder/repos","events_url":"https://api.github.com/users/MichaelRoeder/events{/privacy}","received_events_url":"https://api.github.com/users/MichaelRoeder/received_events","type":"User","site_admin":false},"created_at":"2016-11-22T15:35:57Z","updated_at":"2016-11-22T15:35:57Z","body":"1) You will have to preprocess the Wikipedia, i.e., remove all markups and stuff like that (but I think that you are aware of that). This can be a very annoying task since some markups can become very complicated. We decided to simply remove all markups (including tables). Additionally you should remove pages that are not helpful to calculate the coherences as described in the paper: \r\n> All corpora as well as the complete Wikipedia used as reference corpus are preprocessed using lemmatization and stop word removal. Additionally, we removed portal and category articles, redirection and disambiguation pages as well as articles about single years.\r\n\r\n2) You have to decide whether you would like to use a lemmatizer in your text preprocessing or not. This is an important decision because it has a direct influence of the cooccurence of your words. So it depends on the preprocessing you are using for your topic modeling algorithm. If you are using topic modeling on lemmatized words, the index should contain lemmatized forms as well. If you are not using a lemmatizer, you shouldn't use it for the index creation.\r\n3) In most cases you will have to create an index that contains the positions of the words inside the documents. This is needed to use more complex coherences like UCI or NPMI. The creation of the index is described in [this wiki article](https://github.com/AKSW/Palmetto/wiki/How-to-create-a-new-index). \r\n\r\nFeel free to ask questions if you encounter problems.\r\n\r\nIf you are creating new indexes, you might want to share them with the community as van der Zwaan et al. did who gave me a Dutch index for hosting it."}}
{"actor":{"display_login":"MichaelRoeder"}}