Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

chore: added synapse-internal to platform detector function #1651

Merged
merged 13 commits into from
Sep 16, 2022
Merged

chore: added synapse-internal to platform detector function #1651

Changes from all commits
Commits
Show all changes
13 commits
Select commit Hold shift + click to select a range
1ec0ac5
chore: added trident platform
thinkall Sep 13, 2022
e78f563
Merge branch 'master' into check-platform
thinkall Sep 13, 2022
795218a
Merge branch 'master' of https://github.com/thinkall/SynapseML into c…
thinkall Sep 13, 2022
b28a305
chore: update naming
thinkall Sep 13, 2022
d67bccf
Merge branch 'check-platform' of https://github.com/thinkall/SynapseM…
thinkall Sep 13, 2022
2e5c0b5
Update core/src/main/python/synapse/ml/core/platform/Platform.py
mhamilton723 Sep 14, 2022
6cf5e1f
Merge branch 'microsoft:master' into check-platform
thinkall Sep 15, 2022
a134287
chore: update detection rules
thinkall Sep 15, 2022
2542a32
chore: remove redundant check
thinkall Sep 15, 2022
235b98e
Merge branch 'microsoft:master' into check-platform
thinkall Sep 16, 2022
c6dd6a0
Merge branch 'master' of https://github.com/thinkall/SynapseML into c…
thinkall Sep 16, 2022
6782806
docs: apply black formatter
thinkall Sep 16, 2022
92d23e2
Merge branch 'check-platform' of https://github.com/thinkall/SynapseM…
thinkall Sep 16, 2022
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
14 changes: 13 additions & 1 deletion core/src/main/python/synapse/ml/core/platform/Platform.py
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -3,6 +3,7 @@
import os


PLATFORM_SYNAPSE_INTERNAL = "synapse_internal"
PLATFORM_SYNAPSE = "synapse"
PLATFORM_BINDER = "binder"
PLATFORM_DATABRICKS = "databricks"
Expand All @@ -13,7 +14,14 @@

def current_platform():
if os.environ.get("AZURE_SERVICE", None) == SYNAPSE_PROJECT_NAME:
return PLATFORM_SYNAPSE
from pyspark.sql import SparkSession

sc = SparkSession.builder.getOrCreate().sparkContext
cluster_type = sc.getConf().get("spark.cluster.type")
if cluster_type == "synapse":
return PLATFORM_SYNAPSE
else:
return PLATFORM_SYNAPSE_INTERNAL
elif "dbfs" in os.listdir("/"):
return PLATFORM_DATABRICKS
elif os.environ.get("BINDER_LAUNCH_HOST", None) is not None:
Expand All @@ -22,6 +30,10 @@ def current_platform():
return PLATFORM_UNKNOWN


def running_on_synapse_internal():
return current_platform() is PLATFORM_SYNAPSE_INTERNAL


def running_on_synapse():
return current_platform() is PLATFORM_SYNAPSE

Expand Down