{"action":"created","issue":{"url":"https://api.github.com/repos/matt-gardner/pra/issues/12","repository_url":"https://api.github.com/repos/matt-gardner/pra","labels_url":"https://api.github.com/repos/matt-gardner/pra/issues/12/labels{/name}","comments_url":"https://api.github.com/repos/matt-gardner/pra/issues/12/comments","events_url":"https://api.github.com/repos/matt-gardner/pra/issues/12/events","html_url":"https://github.com/matt-gardner/pra/issues/12","id":149144367,"number":12,"title":"re-run EMNLP 2015 paper using PRA not SFE","user":{"login":"samehkamaleldin","id":3719032,"avatar_url":"https://avatars.githubusercontent.com/u/3719032?v=3","gravatar_id":"","url":"https://api.github.com/users/samehkamaleldin","html_url":"https://github.com/samehkamaleldin","followers_url":"https://api.github.com/users/samehkamaleldin/followers","following_url":"https://api.github.com/users/samehkamaleldin/following{/other_user}","gists_url":"https://api.github.com/users/samehkamaleldin/gists{/gist_id}","starred_url":"https://api.github.com/users/samehkamaleldin/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/samehkamaleldin/subscriptions","organizations_url":"https://api.github.com/users/samehkamaleldin/orgs","repos_url":"https://api.github.com/users/samehkamaleldin/repos","events_url":"https://api.github.com/users/samehkamaleldin/events{/privacy}","received_events_url":"https://api.github.com/users/samehkamaleldin/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"milestone":null,"comments":1,"created_at":"2016-04-18T13:00:22Z","updated_at":"2016-04-18T16:47:09Z","closed_at":null,"body":"I'm trying to run the experiment from EMNLP 2015 using PRA with random walks but I can't.\r\n\r\nI've used the following configuration file\r\n`~/pra/examples/experiment_specs/nell/final_emnlp2015/sfe_bfs_pra_anyrel_PRA.json`\r\n\r\n``` json\r\n{\r\n  \"operation\": {\r\n    \"type\": \"train and test\",\r\n    \"features\": {\r\n      \"path finder\": {\r\n        \"walks per source\": 100,\r\n        \"path finding iterations\": 3,\r\n        \"path accept policy\": \"paired-only\"\r\n      },\r\n      \"path selector\": {\r\n        \"number of paths to keep\": 1000\r\n      },\r\n      \"path follower\": {\r\n        \"walks per path\": 50,\r\n        \"matrix accept policy\": \"all-targets\"\r\n      }\r\n    },\r\n    \"learning\": {\r\n      \"l1 weight\": 0.005,\r\n      \"l2 weight\": 1\r\n    }\r\n  }\r\n}\r\n````\r\nthen I ran it like the following:\r\n``` bash\r\nsbt \"run ./examples/ sfe_bfs_pra_anyrel_PRA\"\r\n```\r\nThen chosed experiment runner and it omited the following error\r\n\r\n``` bash\r\n[info] Running edu.cmu.ml.rtw.pra.experiments.ExperimentRunner ./examples/ sfe_bfs_pra_anyrel_PRA\r\n[info] Found 353 experiment specs, and kept 1 of them\r\n[info] Running PRA from spec file ./examples/experiment_specs/nell/final_emnlp2015/sfe_bfs_pra_anyrel_PRA.json\r\n[info] Split not found at ./examples/splits/nell_with_negatives/; creating it...\r\n[error] Exception in thread \"main\" java.util.NoSuchElementException: None.get\r\n[error]         at scala.None$.get(Option.scala:347)\r\n[error]         at scala.None$.get(Option.scala:345)\r\n[error]         at edu.cmu.ml.rtw.pra.data.SplitCreator.<init>(SplitCreator.scala:32)\r\n[error]         at edu.cmu.ml.rtw.pra.experiments.Driver.createSplitIfNecessary(Driver.scala:286)\r\n[error]         at edu.cmu.ml.rtw.pra.experiments.Driver.runPra(Driver.scala:57)\r\n[error]         at edu.cmu.ml.rtw.pra.experiments.ExperimentRunner$.runPraFromSpec(ExperimentRunner.scala:70)\r\n[error]         at edu.cmu.ml.rtw.pra.experiments.ExperimentRunner$$anonfun$runPra$1.apply(ExperimentRunner.scala:55)\r\n[error]         at edu.cmu.ml.rtw.pra.experiments.ExperimentRunner$$anonfun$runPra$1.apply(ExperimentRunner.scala:55)\r\n[error]         at scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:245)\r\n[error]         at scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:245)\r\n[error]         at scala.collection.mutable.ArraySeq.foreach(ArraySeq.scala:74)\r\n[error]         at scala.collection.TraversableLike$class.map(TraversableLike.scala:245)\r\n[error]         at scala.collection.AbstractTraversable.map(Traversable.scala:104)\r\n[error]         at edu.cmu.ml.rtw.pra.experiments.ExperimentRunner$.runPra(ExperimentRunner.scala:55)\r\n[error]         at edu.cmu.ml.rtw.pra.experiments.ExperimentRunner$.main(ExperimentRunner.scala:25)\r\n[error]         at edu.cmu.ml.rtw.pra.experiments.ExperimentRunner.main(ExperimentRunner.scala)\r\njava.lang.RuntimeException: Nonzero exit code returned from runner: 1\r\n        at scala.sys.package$.error(package.scala:27)\r\n[trace] Stack trace suppressed: run last compile:run for the full output.\r\n[error] (compile:run) Nonzero exit code returned from runner: 1\r\n[error] Total time: 3 s, completed 18-Apr-2016 13:38:56\r\n\r\n```\r\n\r\nHow can I manage to make it working with PRA ?"},"comment":{"url":"https://api.github.com/repos/matt-gardner/pra/issues/comments/211468437","html_url":"https://github.com/matt-gardner/pra/issues/12#issuecomment-211468437","issue_url":"https://api.github.com/repos/matt-gardner/pra/issues/12","id":211468437,"user":{"login":"matt-gardner","id":3291951,"avatar_url":"https://avatars.githubusercontent.com/u/3291951?v=3","gravatar_id":"","url":"https://api.github.com/users/matt-gardner","html_url":"https://github.com/matt-gardner","followers_url":"https://api.github.com/users/matt-gardner/followers","following_url":"https://api.github.com/users/matt-gardner/following{/other_user}","gists_url":"https://api.github.com/users/matt-gardner/gists{/gist_id}","starred_url":"https://api.github.com/users/matt-gardner/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/matt-gardner/subscriptions","organizations_url":"https://api.github.com/users/matt-gardner/orgs","repos_url":"https://api.github.com/users/matt-gardner/repos","events_url":"https://api.github.com/users/matt-gardner/events{/privacy}","received_events_url":"https://api.github.com/users/matt-gardner/received_events","type":"User","site_admin":false},"created_at":"2016-04-18T16:47:09Z","updated_at":"2016-04-18T16:47:09Z","body":"There are a few issues here.  First, if you want to run PRA on the data from the EMNLP 2015 paper, you should use [this experiment configuration](https://github.com/matt-gardner/pra/blob/master/examples/experiment_specs/nell/final_emnlp2015/baseline.json) - there's no need to create your own.  Assuming you've downloaded the data from [the paper website](http://rtw.ml.cmu.edu/emnlp2015_sfe/), that should fix the split creation issue you're seeing (and, for comparing to the experiments in the 2015 paper, you need to use `paired-targets-only` in the `path follower` parameters, not `all-targets`).\r\n\r\nHowever, the default parameters have changed since the EMNLP 2015 paper, and I think this experiment spec will probably crash with an error about invalid parameters.  If it does, the fix is to add two more parameters: (1) under `\"features\"`, add `\"type\": \"pra\"`, and (2) under `\"path finder\"`, add `\"type\": \"RandomWalkPathFinder\"`.  "}}