{"action":"created","issue":{"url":"https://api.github.com/repos/tambetm/simple_dqn/issues/15","repository_url":"https://api.github.com/repos/tambetm/simple_dqn","labels_url":"https://api.github.com/repos/tambetm/simple_dqn/issues/15/labels{/name}","comments_url":"https://api.github.com/repos/tambetm/simple_dqn/issues/15/comments","events_url":"https://api.github.com/repos/tambetm/simple_dqn/issues/15/events","html_url":"https://github.com/tambetm/simple_dqn/issues/15","id":154911975,"number":15,"title":"Visual and Test not work ?","user":{"login":"mingtop","id":4143491,"avatar_url":"https://avatars.githubusercontent.com/u/4143491?v=3","gravatar_id":"","url":"https://api.github.com/users/mingtop","html_url":"https://github.com/mingtop","followers_url":"https://api.github.com/users/mingtop/followers","following_url":"https://api.github.com/users/mingtop/following{/other_user}","gists_url":"https://api.github.com/users/mingtop/gists{/gist_id}","starred_url":"https://api.github.com/users/mingtop/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/mingtop/subscriptions","organizations_url":"https://api.github.com/users/mingtop/orgs","repos_url":"https://api.github.com/users/mingtop/repos","events_url":"https://api.github.com/users/mingtop/events{/privacy}","received_events_url":"https://api.github.com/users/mingtop/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"milestone":null,"comments":2,"created_at":"2016-05-15T14:42:03Z","updated_at":"2016-05-16T07:32:14Z","closed_at":null,"body":"Two problems I got when I following you PostII . I am not sure where the problem is. Sincerely Thank you for answer~ ！\r\n\r\nWhen I run the python virtual environment , I got a problem of h5py version is 1.83, I set the bashrc fixed the problem. \r\n\r\n./play.sh snape/breakout_77.pkl  work well. \r\n\r\nBut when I test or visual kernel I got the following problems, here the debug infor.  \r\nBut when I test and visual the kernels of  snapshot, I got a problem with this:\r\n\r\n\r\n1. ~/git/simple_dqn$ ./play.sh snapshots/breakout_77.pkl \r\nWarning! ***HDF5 library version mismatched error***\r\nThe HDF5 header files used to compile this application do not match\r\nthe version used by the HDF5 library to which this application is linked.\r\nData corruption or segmentation faults may occur if the application continues.\r\nThis can happen when an application was compiled by one version of HDF5 but\r\nlinked with a different version of static or shared HDF5 library.\r\nYou should recompile the application or check your shared library related\r\nsettings such as 'LD_LIBRARY_PATH'.\r\n'HDF5_DISABLE_VERSION_CHECK' environment variable is set to 1, application will\r\ncontinue at your own risk.\r\nHeaders are 1.8.11, library is 1.8.13\r\n\t    SUMMARY OF THE HDF5 CONFIGURATION\r\n\t    =================================\r\n\r\nGeneral Information:\r\n-------------------\r\n\t\t   HDF5 Version: 1.8.13\r\n\t\t  Configured on: Wed Sep 10 18:56:58 CDT 2014\r\n\t\t  Configured by: ilan@centos5x64.corp.continuum.io\r\n\t\t Configure mode: production\r\n\t\t    Host system: x86_64-unknown-linux-gnu\r\n\t      Uname information: Linux centos5x64.corp.continuum.io 2.6.18-348.el5 #1 SMP Tue Jan 8 17:53:53 EST 2013 x86_64 x86_64 x86_64 GNU/Linux\r\n\t\t       Byte sex: little-endian\r\n\t\t      Libraries: shared\r\n\t     Installation point: /opt/anaconda1anaconda2anaconda3\r\n\r\nCompiling Options:\r\n------------------\r\n               Compilation Mode: production\r\n                     C Compiler: /usr/bin/gcc44 ( gcc44 (GCC) 4.4.7 20120313 )\r\n                         CFLAGS: \r\n                      H5_CFLAGS: -std=c99 -pedantic -Wall -Wextra -Wundef -Wshadow -Wpointer-arith -Wbad-function-cast -Wcast-qual -Wcast-align -Wwrite-strings -Wconversion -Waggregate-return -Wstrict-prototypes -Wmissing-prototypes -Wmissing-declarations -Wredundant-decls -Wnested-externs -Winline -Wno-long-long -Wfloat-equal -Wmissing-format-attribute -Wmissing-noreturn -Wpacked -Wdisabled-optimization -Wformat=2 -Wunreachable-code -Wendif-labels -Wdeclaration-after-statement -Wold-style-definition -Winvalid-pch -Wvariadic-macros -Wnonnull -Winit-self -Wmissing-include-dirs -Wswitch-default -Wswitch-enum -Wunused-macros -Wunsafe-loop-optimizations -Wc++-compat -Wstrict-overflow -Wlogical-op -Wlarger-than=2048 -Wvla -Wsync-nand -Wframe-larger-than=16384 -Wpacked-bitfield-compat -O3 -fomit-frame-pointer -finline-functions\r\n                      AM_CFLAGS: \r\n                       CPPFLAGS: \r\n                    H5_CPPFLAGS: -D_POSIX_C_SOURCE=199506L   -DNDEBUG -UH5_DEBUG_API\r\n                    AM_CPPFLAGS: -D_LARGEFILE_SOURCE -D_LARGEFILE64_SOURCE -D_BSD_SOURCE \r\n               Shared C Library: yes\r\n               Static C Library: no\r\n  Statically Linked Executables: no\r\n                        LDFLAGS: \r\n                     H5_LDFLAGS: \r\n                     AM_LDFLAGS: \r\n \t \tExtra libraries:  -lpthread -lz -lrt -ldl -lm \r\n \t\t       Archiver: ar\r\n \t\t \t Ranlib: ranlib\r\n \t      Debugged Packages: \r\n\t\t    API Tracing: no\r\n\r\nLanguages:\r\n----------\r\n                        Fortran: no\r\n\r\n                            C++: no\r\n\r\nFeatures:\r\n---------\r\n                  Parallel HDF5: no\r\n             High Level library: yes\r\n                   Threadsafety: yes\r\n            Default API Mapping: v18\r\n With Deprecated Public Symbols: yes\r\n         I/O filters (external): deflate(zlib)\r\n         I/O filters (internal): shuffle,fletcher32,nbit,scaleoffset\r\n                            MPE: no\r\n                     Direct VFD: no\r\n                        dmalloc: no\r\nClear file buffers before write: yes\r\n           Using memory checker: no\r\n         Function Stack Tracing: no\r\n      Strict File Format Checks: no\r\n   Optimization Instrumentation: no\r\n       Large File Support (LFS): yes\r\nA.L.E: Arcade Learning Environment (version 0.5.1)\r\n[Powered by Stella]\r\nUse -help for help screen.\r\nWarning: couldn't load settings file: ./ale.cfg\r\nGame console created:\r\n  ROM file:  roms/breakout.bin\r\n  Cart Name: Breakout - Breakaway IV (1978) (Atari)\r\n  Cart MD5:  f34f08e5eb96e500e851a80be3277a56\r\n  Display Format:  AUTO-DETECT ==> NTSC\r\n  ROM Size:        2048\r\n  Bankswitch Type: AUTO-DETECT ==> 2K\r\n\r\nScreen Display Active. [Manual Control Mode] 'm' [Slowdown] 'a' [Speedup] 's' [VolumeDown] '[' [VolumeUp] ']'.\r\nRunning ROM file...\r\nRandom seed is 0\r\n2016-05-15 22:35:08,283 Using minimal action set with size 4\r\n2016-05-15 22:35:08,284 Using ALE Environment\r\n2016-05-15 22:35:08,284 Replay memory size: 1000000\r\n2016-05-15 22:35:08,606 Initialized NervanaGPU\r\n2016-05-15 22:35:08,606 Backend: gpu, RNG seed: None\r\n2016-05-15 22:35:08,754 Loading weights from snapshots/breakout_77.pkl\r\n2016-05-15 22:35:09,983 Using old model serialization format. Serialized the model into new format\r\n2016-05-15 22:35:09,988 Model weights loaded from snapshots/breakout_77.pkl\r\n2016-05-15 22:35:09,988 Playing for 1 game(s)\r\n2016-05-15 22:35:49,096   num_games: 1, average_reward: 302.000000, min_game_reward: 302, max_game_reward: 302\r\n2016-05-15 22:35:49,096   last_exploration_rate: 0.050000, epoch_time: 21s, steps_per_second: 102\r\n(.venv)jamin@jamin-lab:~/git/simple_dqn$ ./test.sh snapshots/pong_200.pk\r\nWarning! ***HDF5 library version mismatched error***\r\nThe HDF5 header files used to compile this application do not match\r\nthe version used by the HDF5 library to which this application is linked.\r\nData corruption or segmentation faults may occur if the application continues.\r\nThis can happen when an application was compiled by one version of HDF5 but\r\nlinked with a different version of static or shared HDF5 library.\r\nYou should recompile the application or check your shared library related\r\nsettings such as 'LD_LIBRARY_PATH'.\r\n'HDF5_DISABLE_VERSION_CHECK' environment variable is set to 1, application will\r\ncontinue at your own risk.\r\nHeaders are 1.8.11, library is 1.8.13\r\n\t    SUMMARY OF THE HDF5 CONFIGURATION\r\n\t    =================================\r\n\r\nGeneral Information:\r\n-------------------\r\n\t\t   HDF5 Version: 1.8.13\r\n\t\t  Configured on: Wed Sep 10 18:56:58 CDT 2014\r\n\t\t  Configured by: ilan@centos5x64.corp.continuum.io\r\n\t\t Configure mode: production\r\n\t\t    Host system: x86_64-unknown-linux-gnu\r\n\t      Uname information: Linux centos5x64.corp.continuum.io 2.6.18-348.el5 #1 SMP Tue Jan 8 17:53:53 EST 2013 x86_64 x86_64 x86_64 GNU/Linux\r\n\t\t       Byte sex: little-endian\r\n\t\t      Libraries: shared\r\n\t     Installation point: /opt/anaconda1anaconda2anaconda3\r\n\r\nCompiling Options:\r\n------------------\r\n               Compilation Mode: production\r\n                     C Compiler: /usr/bin/gcc44 ( gcc44 (GCC) 4.4.7 20120313 )\r\n                         CFLAGS: \r\n                      H5_CFLAGS: -std=c99 -pedantic -Wall -Wextra -Wundef -Wshadow -Wpointer-arith -Wbad-function-cast -Wcast-qual -Wcast-align -Wwrite-strings -Wconversion -Waggregate-return -Wstrict-prototypes -Wmissing-prototypes -Wmissing-declarations -Wredundant-decls -Wnested-externs -Winline -Wno-long-long -Wfloat-equal -Wmissing-format-attribute -Wmissing-noreturn -Wpacked -Wdisabled-optimization -Wformat=2 -Wunreachable-code -Wendif-labels -Wdeclaration-after-statement -Wold-style-definition -Winvalid-pch -Wvariadic-macros -Wnonnull -Winit-self -Wmissing-include-dirs -Wswitch-default -Wswitch-enum -Wunused-macros -Wunsafe-loop-optimizations -Wc++-compat -Wstrict-overflow -Wlogical-op -Wlarger-than=2048 -Wvla -Wsync-nand -Wframe-larger-than=16384 -Wpacked-bitfield-compat -O3 -fomit-frame-pointer -finline-functions\r\n                      AM_CFLAGS: \r\n                       CPPFLAGS: \r\n                    H5_CPPFLAGS: -D_POSIX_C_SOURCE=199506L   -DNDEBUG -UH5_DEBUG_API\r\n                    AM_CPPFLAGS: -D_LARGEFILE_SOURCE -D_LARGEFILE64_SOURCE -D_BSD_SOURCE \r\n               Shared C Library: yes\r\n               Static C Library: no\r\n  Statically Linked Executables: no\r\n                        LDFLAGS: \r\n                     H5_LDFLAGS: \r\n                     AM_LDFLAGS: \r\n \t \tExtra libraries:  -lpthread -lz -lrt -ldl -lm \r\n \t\t       Archiver: ar\r\n \t\t \t Ranlib: ranlib\r\n \t      Debugged Packages: \r\n\t\t    API Tracing: no\r\n\r\nLanguages:\r\n----------\r\n                        Fortran: no\r\n\r\n                            C++: no\r\n\r\nFeatures:\r\n---------\r\n                  Parallel HDF5: no\r\n             High Level library: yes\r\n                   Threadsafety: yes\r\n            Default API Mapping: v18\r\n With Deprecated Public Symbols: yes\r\n         I/O filters (external): deflate(zlib)\r\n         I/O filters (internal): shuffle,fletcher32,nbit,scaleoffset\r\n                            MPE: no\r\n                     Direct VFD: no\r\n                        dmalloc: no\r\nClear file buffers before write: yes\r\n           Using memory checker: no\r\n         Function Stack Tracing: no\r\n      Strict File Format Checks: no\r\n   Optimization Instrumentation: no\r\n       Large File Support (LFS): yes\r\nA.L.E: Arcade Learning Environment (version 0.5.1)\r\n[Powered by Stella]\r\nUse -help for help screen.\r\nWarning: couldn't load settings file: ./ale.cfg\r\nGame console created:\r\n  ROM file:  roms/pong.bin\r\n  Cart Name: Video Olympics (1978) (Atari)\r\n  Cart MD5:  60e0ea3cbe0913d39803477945e9e5ec\r\n  Display Format:  AUTO-DETECT ==> NTSC\r\n  ROM Size:        2048\r\n  Bankswitch Type: AUTO-DETECT ==> 2K\r\n\r\nRunning ROM file...\r\nRandom seed is 0\r\n2016-05-15 22:38:19,319 Using minimal action set with size 6\r\n2016-05-15 22:38:19,319 Using ALE Environment\r\n2016-05-15 22:38:19,319 Replay memory size: 1000000\r\n2016-05-15 22:38:19,626 Initialized NervanaGPU\r\n2016-05-15 22:38:19,627 Backend: gpu, RNG seed: None\r\n2016-05-15 22:38:19,766 Loading weights from snapshots/pong_200.pk\r\nTraceback (most recent call last):\r\n  File \"src/main.py\", line 109, in <module>\r\n    net.load_weights(args.load_weights)\r\n  File \"/home/jamin/git/simple_dqn/src/deepqnetwork.py\", line 189, in load_weights\r\n    self.model.load_params(load_path)\r\n  File \"/home/jamin/git/neon/neon/models/model.py\", line 320, in load_params\r\n    self.deserialize(load_obj(param_path), load_states=load_states)\r\n  File \"/home/jamin/git/neon/neon/util/persist.py\", line 87, in load_obj\r\n    load_path = open(load_path)\r\nIOError: [Errno 2] No such file or directory: 'snapshots/pong_200.pk'\r\n\r\n\r\n-------------------------------------------------------------------------\r\n2.  visual  also got some problems \r\n-------------------------\r\n2016-05-15 22:27:03,337 Using minimal action set with size 4\r\n2016-05-15 22:27:03,338 Using ALE Environment\r\n2016-05-15 22:27:03,338 Replay memory size: 1000000\r\n2016-05-15 22:27:03,646 Initialized NervanaGPU\r\n2016-05-15 22:27:03,646 Backend: gpu, RNG seed: None\r\n2016-05-15 22:27:03,784 Loading weights from snapshots/breakout_200.pkl\r\n2016-05-15 22:27:04,981 Using old model serialization format. Serialized the model into new format\r\n2016-05-15 22:27:04,985 Model weights loaded from snapshots/breakout_200.pkl\r\n2016-05-15 22:27:04,986 Playing for 1 game(s)\r\n2016-05-15 22:27:13,828   num_games: 1, average_reward: 399.000000, min_game_reward: 399, max_game_reward: 399\r\n2016-05-15 22:27:13,828   last_exploration_rate: 0.050000, epoch_time: 8s, steps_per_second: 201\r\n2016-05-15 22:27:13,829 Collected 0 game states\r\nTraceback (most recent call last):\r\n  File \"src/main.py\", line 124, in <module>\r\n    visualize(net.model, states, args.visualization_filters, args.visualization_file)\r\n  File \"/home/jamin/git/simple_dqn/src/visualization.py\", line 9, in visualize\r\n    data = data.reshape((data.shape[0], -1))\r\nValueError: total size of new array must be unchanged\r\n\r\n"},"comment":{"url":"https://api.github.com/repos/tambetm/simple_dqn/issues/comments/219366259","html_url":"https://github.com/tambetm/simple_dqn/issues/15#issuecomment-219366259","issue_url":"https://api.github.com/repos/tambetm/simple_dqn/issues/15","id":219366259,"user":{"login":"tambetm","id":3816322,"avatar_url":"https://avatars.githubusercontent.com/u/3816322?v=3","gravatar_id":"","url":"https://api.github.com/users/tambetm","html_url":"https://github.com/tambetm","followers_url":"https://api.github.com/users/tambetm/followers","following_url":"https://api.github.com/users/tambetm/following{/other_user}","gists_url":"https://api.github.com/users/tambetm/gists{/gist_id}","starred_url":"https://api.github.com/users/tambetm/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/tambetm/subscriptions","organizations_url":"https://api.github.com/users/tambetm/orgs","repos_url":"https://api.github.com/users/tambetm/repos","events_url":"https://api.github.com/users/tambetm/events{/privacy}","received_events_url":"https://api.github.com/users/tambetm/received_events","type":"User","site_admin":false},"created_at":"2016-05-16T07:32:14Z","updated_at":"2016-05-16T07:32:14Z","body":"Regarding the HDF5 library you are better asking somewhere else. I see you are using Anaconda, if this is binary distribution, then maybe the libraries it was compiled against do not match your runtime libraries.\r\n\r\nRegarding visualization you are right, I haven't had time to update it against latest Neon. Feel free to submit a pull request! I'm keeping this issue open until the visualization is fixed."}}