Can't install prerelease using pip because version check doesn't like the version number.

[IMarvinTPA]

File "\AppData\Local\Temp\pip-install-udfmg8eb\pyspark_1676b3c5251148c4a731b700963b9009\pyspark/install.py", line 74, in checked_versions
raise RuntimeError(
RuntimeError: Spark version should start with 'spark-' prefix; however, got 4.2.0.dev4

spark/python/pyspark/install.py

Lines 62 to 63 in 26ae8c1

	if re.match("^[0-9]+\\.[0-9]+\\.[0-9]+$", spark_version):
	spark_version = "spark-%s" % spark_version

The regex needs to accept .dev# optionally to work.

[IMarvinTPA]

The fixed regex: ^[0-9]+\.[0-9]+\.[0-9]+(?:\.dev[0-9]+)?$
"^[0-9]+\\.[0-9]+\\.[0-9]+(?:\\.dev[0-9]+)?$"

[joshuaharris951-cmd]

Yeah, that makes sense — the current check is too strict. Allowing an optional .dev# suffix should fix cases like 4.2.0.dev4 without breaking normal versions. The updated regex looks good to me 👍

…

On Fri, Apr 10, 2026, 9:19 AM IMarvinTPA ***@***.***> wrote: *IMarvinTPA* left a comment (apache/spark#55289) <#55289 (comment)> The fixed regex: ^[0-9]+\.[0-9]+\.[0-9]+(?:\.dev[0-9]+)?$ "^[0-9]+\\.[0-9]+\\.[0-9]+(?:\\.dev[0-9]+)?$" — Reply to this email directly, view it on GitHub <#55289 (comment)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/B72KXLM7DTGED4VWKJI7DDD4VD7IDAVCNFSM6AAAAACXT72LBOVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHM2DEMRUGQYDENRYGI> . You are receiving this because you are subscribed to this thread.Message ID: ***@***.***>

[kiyeonjeon21]

I'd like to work on this. I'll create a JIRA ticket and submit a PR with the regex fix for both checked_versions and convert_old_hadoop_version.