{"action":"created","issue":{"url":"https://api.github.com/repos/plutov/practice-go/issues/56","repository_url":"https://api.github.com/repos/plutov/practice-go","labels_url":"https://api.github.com/repos/plutov/practice-go/issues/56/labels{/name}","comments_url":"https://api.github.com/repos/plutov/practice-go/issues/56/comments","events_url":"https://api.github.com/repos/plutov/practice-go/issues/56/events","html_url":"https://github.com/plutov/practice-go/issues/56","id":391420859,"node_id":"MDU6SXNzdWUzOTE0MjA4NTk=","number":56,"title":"nasacollage: nasa api is unreliable","user":{"login":"shogg","id":130464,"node_id":"MDQ6VXNlcjEzMDQ2NA==","avatar_url":"https://avatars2.githubusercontent.com/u/130464?v=4","gravatar_id":"","url":"https://api.github.com/users/shogg","html_url":"https://github.com/shogg","followers_url":"https://api.github.com/users/shogg/followers","following_url":"https://api.github.com/users/shogg/following{/other_user}","gists_url":"https://api.github.com/users/shogg/gists{/gist_id}","starred_url":"https://api.github.com/users/shogg/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/shogg/subscriptions","organizations_url":"https://api.github.com/users/shogg/orgs","repos_url":"https://api.github.com/users/shogg/repos","events_url":"https://api.github.com/users/shogg/events{/privacy}","received_events_url":"https://api.github.com/users/shogg/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"assignees":[],"milestone":null,"comments":2,"created_at":"2018-12-15T23:37:19Z","updated_at":"2018-12-28T10:05:25Z","closed_at":null,"author_association":"CONTRIBUTOR","body":"It's very slow and generates HTTP 500 and other errors. You'll lose some pictures even when obeying the quota of 1000 requests/h. After a while it stopped working at all for me. (While writing this I tested again: works again but errors remain)\r\n\r\nAPI is unreliable but downloading the linked pictures in the API data works like a charm. I already used https://apod.nasa.gov/apod/archivepix.html to extract the dates needed to query the API. I think it could be easier to scrape the needed URLs out of the linked pages and not use the API at all. No quota involved. Just download +8500 files in one batch.\r\n\r\nPS: I used this to slowly hammer the API:\r\n`cat dates04.txt | xargs -I{} curl https://api.nasa.gov/planetary/apod?api_key=<mykey>\\&date={}`\r\nI have 11 dates??.txt files with ~800 lines each.\r\ndates04.txt: https://drive.google.com/file/d/1UstQi3wGO5bzDvAd7AnrwmijIZw4zd6H/view?usp=sharing"},"comment":{"url":"https://api.github.com/repos/plutov/practice-go/issues/comments/450333265","html_url":"https://github.com/plutov/practice-go/issues/56#issuecomment-450333265","issue_url":"https://api.github.com/repos/plutov/practice-go/issues/56","id":450333265,"node_id":"MDEyOklzc3VlQ29tbWVudDQ1MDMzMzI2NQ==","user":{"login":"plutov","id":1124859,"node_id":"MDQ6VXNlcjExMjQ4NTk=","avatar_url":"https://avatars0.githubusercontent.com/u/1124859?v=4","gravatar_id":"","url":"https://api.github.com/users/plutov","html_url":"https://github.com/plutov","followers_url":"https://api.github.com/users/plutov/followers","following_url":"https://api.github.com/users/plutov/following{/other_user}","gists_url":"https://api.github.com/users/plutov/gists{/gist_id}","starred_url":"https://api.github.com/users/plutov/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/plutov/subscriptions","organizations_url":"https://api.github.com/users/plutov/orgs","repos_url":"https://api.github.com/users/plutov/repos","events_url":"https://api.github.com/users/plutov/events{/privacy}","received_events_url":"https://api.github.com/users/plutov/received_events","type":"User","site_admin":false},"created_at":"2018-12-28T10:05:25Z","updated_at":"2018-12-28T10:05:25Z","author_association":"OWNER","body":"@shogg have you been able to build a collage after that? :)"}}
{"actor":{"display_login":"plutov"}}