Stop relying on .egg-info directories for kedro micropkg

[astrojuanlu]

Description

While working on gh-2273, I realized that kedro micropkg relies on finding .egg-info directories to locate packages:

kedro/kedro/framework/cli/micropkg.py

Lines 146 to 154 in 6531457

	egg_info_files = list((temp_dir_path).rglob("*.egg-info"))
	if len(egg_info_files) != 1:
	raise KedroCliError(
	f"More than 1 or no egg-info files found from {package_path}. "
	f"There has to be exactly one egg-info directory."
	)
	egg_info_file = egg_info_files[0]
	package_name = egg_info_file.stem
	package_requirements = egg_info_file.parent / "setup.py"

However, .egg-info directories are a legacy setuptools artifact and they're in the process of going away, see https://github.com/pypa/setuptools/milestone/3

The code was implemented in dbe6d89, which is part of #1263 and was recently touched by #1848. I couldn't find any discussion as to why dist-info was dropped in favor of egg-info.

Possible Implementation

Since _unpack_sdist is called right before, IIUC the location of the project metadata file (at the moment setup.py, in the future pyproject.toml, see gh-2414) should be known. But I am surely missing something here.

[astrojuanlu]

Just in time 👀 https://github.com/pypa/setuptools/blob/49fec9fafb0e23e0dde52d3c4c410d23a2de9b0d/CHANGES.rst?plain=1#L8-L11

• Revise modular pipelines docs #3948: Remove autofixing of broken .egg-info directories containing the -
  character in their base name (without suffix).
  They should no longer be produced by sufficiently new versions of setuptools
  (warning introduced in 2005).