CI: Move durations to pytest call
Having it in the setup.cfg meant it was used with doctests, which
pushed errors further from the exit code.

# [Codecov](https://codecov.io/gh/pandas-dev/pandas/pull/23434?src=pr&el=h1) Report
> Merging [#23434](https://codecov.io/gh/pandas-dev/pandas/pull/23434?src=pr&el=desc) into [master](https://codecov.io/gh/pandas-dev/pandas/commit/de39bfc5e5c6483cb2669773fa10ddc2e32ca111?src=pr&el=desc) will **not change** coverage.
> The diff coverage is `n/a`.

[![Impacted file tree graph](https://codecov.io/gh/pandas-dev/pandas/pull/23434/graphs/tree.svg?width=650&token=eZ4WkYLtcO&height=150&src=pr)](https://codecov.io/gh/pandas-dev/pandas/pull/23434?src=pr&el=tree)

```diff
@@           Coverage Diff           @@
##           master   #23434   +/-   ##
=======================================
  Coverage   92.21%   92.21%           
=======================================
  Files         161      161           
  Lines       51173    51173           
=======================================
  Hits        47190    47190           
  Misses       3983     3983
```

| Flag | Coverage Δ | |
|---|---|---|
| #multiple | `90.65% <ø> (ø)` | :arrow_up: |
| #single | `42.23% <ø> (ø)` | :arrow_up: |


------

[Continue to review full report at Codecov](https://codecov.io/gh/pandas-dev/pandas/pull/23434?src=pr&el=continue).
> **Legend** - [Click here to learn more](https://docs.codecov.io/docs/codecov-delta)
> `Δ = absolute <relative> (impact)`, `ø = not affected`, `? = missing data`
> Powered by [Codecov](https://codecov.io/gh/pandas-dev/pandas/pull/23434?src=pr&el=footer). Last update [de39bfc...ee7d86c](https://codecov.io/gh/pandas-dev/pandas/pull/23434?src=pr&el=lastupdated). Read the [comment docs](https://docs.codecov.io/docs/pull-request-comments).
 Would it make sense to override in the doctest command rather than repeat in all the others? It's not possible to override with a duration of 0. 0 is treated as "all".

On Wed, Oct 31, 2018 at 3:01 PM jbrockmendel <notifications@github.com>
wrote:

> Would it make sense to override in the doctest command rather than repeat
> in all the others?
>
> —
> You are receiving this because you authored the thread.
> Reply to this email directly, view it on GitHub
> <https://github.com/pandas-dev/pandas/pull/23434#issuecomment-434863185>,
> or mute the thread
> <https://github.com/notifications/unsubscribe-auth/ABQHIu1aXH8iAdL9HFMJjg1bvA-1uD_oks5uqh3IgaJpZM4YE5fW>
> .
>
 thanks, this makes sense