If controlling borders were the only issue, you would be right. But unfortunately the far-right has a much more racist agenda than only that.  For them,  it's about keeping the "purity of the white race".   You might want to read a bit of history on how well that worked in Germany. 
And Goodwin's law be damned.