Remove hack and change a benchmark to fail
We are improving the use of asv for Pandas benchmarks. On this PR, I'm removing a hack on the .github/workflows/code-checks.yml file and creating an error on the `attrs_caching.py` file to make the benchmark fail and check the CI output.

cc @datapythonista 
Here the CI output for the Code Checks / ASV Benchmarks (pull_request)
<img width="1413" alt="image" src="https://user-images.githubusercontent.com/13194519/154178996-16e8267b-6c74-4030-a05c-d696ee82ee84.png">
 > Here the CI output for the Code Checks / ASV Benchmarks (pull_request) <img alt="image" width="1413" src="https://user-images.githubusercontent.com/13194519/154178996-16e8267b-6c74-4030-a05c-d696ee82ee84.png">

Sorry, just saw this now. Seems like asv is not returning the right exit code then, and this hack is still needed. We should start by making sure the problem persists in the latest asv. But we may need to fix its problem first. Closing for now, we can reopen when asv is fixed.