CI: Removed pattern check for specific modules
- [ ] closes #xxxx
- [x] tests added / passed
- [x] passes `black pandas`
- [x] passes `git diff upstream/master -u -- "*.py" | flake8 --diff`
- [ ] whatsnew entry

Looks good. Do you have a larger plan with doctest or just this? @WillAyd The end goal is to have the line
```
pytest -q --doctest-module pandas/
```

But ATM it's not possible.

---

I am just making sure that we keep some modules with correct examples.
My next PR will cover ```pd.Series``` Thanks @MomIsBestFriend  Could be convinced otherwise but I think worth backporting to keep CI consistent - @MomIsBestFriend can you do manually? @WillAyd Sure! I have opened a PR here #31993