Hm, so the problem I ran into with the previous attempt (moving the lints around) was that some of our CI scripts use `CARGO_TARGET_{}_RUSTFLAGS` if I got the order right and currently cargo will bail out completely if it finds `RUSTFLAGS` in the environment and just use that. Maybe we can use the target rustflags here? Not sure.