Since this was written, we have gained the federation tester (`https://matrix.org/federationtester/api/report?server_name=<...>`), but it still lacks a UI (https://github.com/matrix-org/matrix-federation-tester/issues/6). The point stands that the errors we get are crap.