BUG: No affect both index and column(GH 13522)
- [x] closes #13522 
- [x] tests added / passed
- [x] passes `git diff upstream/master | flake8 --diff`
- [x] whatsnew entry

## [Current coverage](https://codecov.io/gh/pydata/pandas/pull/14005?src=pr) is 85.29% (diff: 100%)

> Merging [#14005](https://codecov.io/gh/pydata/pandas/pull/14005?src=pr) into [master](https://codecov.io/gh/pydata/pandas/branch/master?src=pr) will increase coverage by **<.01%**

``` diff
@@             master     #14005   diff @@
==========================================
  Files           139        139          
  Lines         50245      50247     +2   
  Methods           0          0          
  Messages          0          0          
  Branches          0          0          
==========================================
+ Hits          42857      42859     +2   
  Misses         7388       7388          
  Partials          0          0          
```

> Powered by [Codecov](https://codecov.io?src=pr). Last update [7c0b742...6dfd2bc](https://codecov.io/gh/pydata/pandas/compare/7c0b74287408a2dcff4cbcafbbebbf9847a6905a...6dfd2bcfe6b3902c8d3774b4d0b3b07f0d611c71?src=pr)
 can you run an asv and see if anything changed signficantly. lgtm otherwise.
 @jreback all benchmarks not significantly changed beside groupby.groupby_frame_singlekey_integer.time_sum. It ranges from 1 to 1.2
 thanks!
