bpo-39907: Improve performance of pathlib.Path.iterdir() by using os.scandir() under the hood

[barneygale]

Per PEP 471:

It returns a generator instead of a list, so that scandir acts as a true iterator instead of returning the full list immediately.

By using scandir() we avoid allocating a full list of directory children, and we don't need to worry about "." and ".." entries. Also simplifies the accessor interface a tiny bit.

https://bugs.python.org/issue39907

[the-knights-who-say-ni]

Hello, and thanks for your contribution!

I'm a bot set up to make sure that the project can legally accept this contribution by verifying everyone involved has signed the PSF contributor agreement (CLA).

CLA Missing

Our records indicate the following people have not signed the CLA:

@barneygale

For legal reasons we need all the people listed to sign the CLA before we can look at your contribution. Please follow the steps outlined in the CPython devguide to rectify this issue.

If you have recently signed the CLA, please wait at least one business day
before our records are updated.

You can check yourself to see if the CLA has been received.

Thanks again for the contribution, we look forward to reviewing it!

[vstinner]

LGTM, but you should add a NEWS entry using blurb tool. Install it with "python3 -m pip install --user blurb", than run "blurb".

@serhiy-storchaka, @pitrou: Would you mind to have a look as well?

[pitrou]

+1, but need a NEWS entry (also need to wait for the CLA bit to be updated).

[serhiy-storchaka]

There are reasons why it was not done earlier. I explained at the tracker.

[barneygale]

Closing this PR per discussion on the tracker.