{"action":"reopened","issue":{"url":"https://api.github.com/repos/diaspora/diaspora/issues/6220","repository_url":"https://api.github.com/repos/diaspora/diaspora","labels_url":"https://api.github.com/repos/diaspora/diaspora/issues/6220/labels{/name}","comments_url":"https://api.github.com/repos/diaspora/diaspora/issues/6220/comments","events_url":"https://api.github.com/repos/diaspora/diaspora/issues/6220/events","html_url":"https://github.com/diaspora/diaspora/issues/6220","id":96391786,"number":6220,"title":"Don't retry dead pods indefinately","user":{"login":"jaywink","id":1174866,"avatar_url":"https://avatars.githubusercontent.com/u/1174866?v=3","gravatar_id":"","url":"https://api.github.com/users/jaywink","html_url":"https://github.com/jaywink","followers_url":"https://api.github.com/users/jaywink/followers","following_url":"https://api.github.com/users/jaywink/following{/other_user}","gists_url":"https://api.github.com/users/jaywink/gists{/gist_id}","starred_url":"https://api.github.com/users/jaywink/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/jaywink/subscriptions","organizations_url":"https://api.github.com/users/jaywink/orgs","repos_url":"https://api.github.com/users/jaywink/repos","events_url":"https://api.github.com/users/jaywink/events{/privacy}","received_events_url":"https://api.github.com/users/jaywink/received_events","type":"User","site_admin":false},"labels":[{"url":"https://api.github.com/repos/diaspora/diaspora/labels/feature","name":"feature","color":"02e10c"},{"url":"https://api.github.com/repos/diaspora/diaspora/labels/federation","name":"federation","color":"453400"}],"state":"open","locked":false,"assignee":{"login":"SuperTux88","id":458548,"avatar_url":"https://avatars.githubusercontent.com/u/458548?v=3","gravatar_id":"","url":"https://api.github.com/users/SuperTux88","html_url":"https://github.com/SuperTux88","followers_url":"https://api.github.com/users/SuperTux88/followers","following_url":"https://api.github.com/users/SuperTux88/following{/other_user}","gists_url":"https://api.github.com/users/SuperTux88/gists{/gist_id}","starred_url":"https://api.github.com/users/SuperTux88/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/SuperTux88/subscriptions","organizations_url":"https://api.github.com/users/SuperTux88/orgs","repos_url":"https://api.github.com/users/SuperTux88/repos","events_url":"https://api.github.com/users/SuperTux88/events{/privacy}","received_events_url":"https://api.github.com/users/SuperTux88/received_events","type":"User","site_admin":false},"milestone":null,"comments":9,"created_at":"2015-07-21T18:58:21Z","updated_at":"2016-03-05T05:05:24Z","closed_at":null,"body":"Currently we seem to retry dead pods if not forever, then for a long time at least. Currently, for a recent post I made, I had **89 failures** for outgoing sidekiq jobs. I can only imagine how much extra weight this is putting on large long running pods.\r\n\r\nSo what I would propose is to either;\r\n\r\n* Add a \"retry_next\" timestamp which would be set on a failure. It would start as \"1s\" and increase exponentally each time a failure occurs. When a job needs to be done, the pod first checks whether this pod should be retried or not, if timestamp exists, and if not, it would just brutally skip the job.\r\n* After say \"local users*1000\" failures or something that somehow takes into account pod size, queue deletion of pod entry and all local content from that pod. Brutal but would clean up for real users.\r\n\r\nHere is the list as a fyi, from the post on my pod. A few I know might not be permanently down, but most are and many of these names have gone years ago.\r\n\r\n    http://diaspora.linuxmaniac.net/receive/public return_code=couldnt_resolve_host response_code=0\r\n    http://party.spraci.info/receive/public return_code=ok response_code=502\r\n    http://pod.gnuaspora.de:8080/receive/public return_code=couldnt_connect response_code=0\r\n    http://red.zy.lc/receive/public return_code=ok response_code=410\r\n    http://uxpod.vispress.com/receive/public return_code=operation_timedout response_code=0\r\n    https://4ray.co/receive/public return_code=ok response_code=404\r\n    https://antipod.net/receive/public return_code=couldnt_resolve_host response_code=0\r\n    https://bastion.enigmacurry.com/receive/public return_code=couldnt_resolve_host response_code=0\r\n    https://blue.skye.cx/receive/public return_code=couldnt_connect response_code=0\r\n    https://calispora.org/receive/public return_code=couldnt_resolve_host response_code=0\r\n    https://canfly.org/receive/public return_code=operation_timedout response_code=0\r\n    https://caray.net/receive/public return_code=couldnt_resolve_host response_code=0\r\n    https://colapso.eu/receive/public return_code=ok response_code=301\r\n    https://community.fi/receive/public return_code=ok response_code=502\r\n    https://d.viewskew.com/receive/public return_code=couldnt_resolve_host response_code=0\r\n    https://d.w2bh.com.ar/receive/public return_code=operation_timedout response_code=0\r\n    https://d.xd.cm/receive/public return_code=operation_timedout response_code=0\r\n    https://datamol.in/receive/public return_code=ok response_code=302\r\n    https://diasp-pucheen.rhcloud.com/receive/public return_code=ok response_code=503\r\n    https://diasp.net/receive/public return_code=couldnt_resolve_host response_code=0\r\n    https://diaspo.rrerr.net/receive/public return_code=ok response_code=404\r\n    https://diaspop.org/receive/public return_code=couldnt_resolve_host response_code=0\r\n    https://diaspora.cc/receive/public return_code=couldnt_connect response_code=0\r\n    https://diaspora.dark-fx.com/receive/public return_code=ok response_code=500\r\n    https://diaspora.deadhexagon.com/receive/public return_code=couldnt_connect response_code=0\r\n    https://diaspora.derfahrervombangbushatdenschlechtestenjobimporn.biz/receive/public return_code=couldnt_resolve_host response_code=0\r\n    https://diaspora.digitalignition.net/receive/public return_code=couldnt_resolve_host response_code=0\r\n    https://diaspora.ing-adb.eu/receive/public return_code=operation_timedout response_code=0\r\n    https://diaspora.la/receive/public return_code=operation_timedout response_code=0\r\n    https://diaspora.melroy.org/receive/public return_code=couldnt_resolve_host response_code=0\r\n    https://diaspora.mike-jones.me.uk/receive/public return_code=ok response_code=503\r\n    https://diaspora.monetd.fr/receive/public return_code=couldnt_connect response_code=0\r\n    https://diaspora.selent.me/receive/public return_code=couldnt_resolve_host response_code=0\r\n    https://diaspora.teriksson.com/receive/public return_code=couldnt_resolve_host response_code=0\r\n    https://diaspora.toxip.net/receive/public return_code=operation_timedout response_code=0\r\n    https://diasporado.org/receive/public return_code=couldnt_connect response_code=0\r\n    https://diaspote.org/receive/public return_code=ok response_code=503\r\n    https://flokk.no/receive/public return_code=ok response_code=500\r\n    https://friendiaspora.com/receive/public return_code=couldnt_connect response_code=0\r\n    https://frolix8.asia/receive/public return_code=operation_timedout response_code=0\r\n    https://hardrate.net/receive/public return_code=couldnt_resolve_host response_code=0\r\n    https://hfase.com/receive/public return_code=couldnt_resolve_host response_code=0\r\n    https://homebutter.com/receive/public return_code=couldnt_connect response_code=0\r\n    https://i.luckfables.net/receive/public return_code=couldnt_connect response_code=0\r\n    https://ilikefreedom.org/receive/public return_code=operation_timedout response_code=0\r\n    https://jauspora.com/receive/public return_code=couldnt_resolve_host response_code=0\r\n    https://jiprnet.cf/receive/public return_code=couldnt_resolve_host response_code=0\r\n    https://logicfish.org.uk/receive/public return_code=couldnt_resolve_host response_code=0\r\n    https://meekshome.com/receive/public return_code=operation_timedout response_code=0\r\n    https://morab.drunkenhorse.org/receive/public return_code=ok response_code=404\r\n    https://nakama.moe/receive/public return_code=couldnt_connect response_code=0\r\n    https://nerdbash.net/receive/public return_code=operation_timedout response_code=0\r\n    https://netiz.in/receive/public return_code=couldnt_connect response_code=0\r\n    https://nym.no/receive/public return_code=operation_timedout response_code=0\r\n    https://oi.cx/receive/public return_code=couldnt_resolve_host response_code=0\r\n    https://ontrigue.com/receive/public return_code=ok response_code=404\r\n    https://paracin.me/receive/public return_code=couldnt_resolve_host response_code=0\r\n    https://pod.02019.org/receive/public return_code=operation_timedout response_code=0\r\n    https://pod.affix.me/receive/public return_code=couldnt_resolve_host response_code=0\r\n    https://pod.andreasrohner.at/receive/public return_code=ok response_code=503\r\n    https://pod.carlnimbus.com/receive/public return_code=operation_timedout response_code=0\r\n    https://pod.daquan.eu/receive/public return_code=ok response_code=503\r\n    https://pod.diaspbr.org/receive/public return_code=couldnt_resolve_host response_code=0\r\n    https://pod.diaspora.co.nz/receive/public return_code=couldnt_resolve_host response_code=0\r\n    https://pod.ecigusine.fr/receive/public return_code=couldnt_connect response_code=0\r\n    https://pod.felmey.org/receive/public return_code=couldnt_connect response_code=0\r\n    https://pod.freedombox.org/receive/public return_code=couldnt_resolve_host response_code=0\r\n    https://pod.glasgownet.com/receive/public return_code=ok response_code=404\r\n    https://pod.gleisnetze.de/receive/public return_code=couldnt_resolve_host response_code=0\r\n    https://pod.matbranyon.net/receive/public return_code=peer_failed_verification response_code=0\r\n    https://pod.p07.co/receive/public return_code=couldnt_resolve_host response_code=0\r\n    https://pod.pyaspora.info/receive/public return_code=couldnt_resolve_host response_code=0\r\n    https://pod.sfunk1x.com/receive/public return_code=couldnt_resolve_host response_code=0\r\n    https://pod.teejay.org/receive/public return_code=couldnt_resolve_host response_code=0\r\n    https://podricing.org/receive/public return_code=ok response_code=502\r\n    https://pubpod.alqualonde.org/receive/public return_code=operation_timedout response_code=0\r\n    https://rbsn.org/receive/public return_code=ok response_code=404\r\n    https://social-underground.nl/receive/public return_code=ok response_code=404\r\n    https://social.deuxfleurs.fr/receive/public return_code=ok response_code=502\r\n    https://social.neshema.com/receive/public return_code=couldnt_resolve_host response_code=0\r\n    https://social.sedrubal.de/receive/public return_code=couldnt_resolve_host response_code=0\r\n    https://social.sysfu.com/receive/public return_code=couldnt_resolve_host response_code=0\r\n    https://social.trashserver.net/receive/public return_code=ok response_code=404\r\n    https://sxspora.de/receive/public return_code=couldnt_resolve_host response_code=0\r\n    https://triaspora.net/receive/public return_code=ok response_code=502\r\n    https://www.diasporasf.org/receive/public return_code=ok response_code=500\r\n    https://www.dpod.se/receive/public return_code=ok response_code=301\r\n    https://www.sour.be/receive/public return_code=couldnt_resolve_host response_code=0\r\n    https://www.theantidrug.org/receive/public return_code=couldnt_connect response_code=0\r\n"}}