-
Notifications
You must be signed in to change notification settings - Fork 28.1k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[SPARK-10548] [SPARK-10563] [SQL] Fix concurrent SQL executions #8710
Commits on Sep 10, 2015
-
Exclude certain local properties from being inherited
such as, cough cough, the SQL execution ID. This was a problem because scala's parallel collections spawns threads as children of the existing threads, causing the execution ID to be inherited when it shouldn't be.
Andrew Or committedSep 10, 2015 Configuration menu - View commit details
-
Copy full SHA for 8ceae42 - Browse repository at this point
Copy the full SHA 8ceae42View commit details
Commits on Sep 11, 2015
-
Fix remove from Properties + add tests
Because java.util.Properties' remove method takes in an Any instead of a String, there were some issues with matching the key's hashCode, so removing was not successful in unit tests. Instead, this commit fixes it by manually filtering out the keys and adding them to the child thread's properties.
Andrew Or committedSep 11, 2015 Configuration menu - View commit details
-
Copy full SHA for 3ec715c - Browse repository at this point
Copy the full SHA 3ec715cView commit details -
Andrew Or committed
Sep 11, 2015 Configuration menu - View commit details
-
Copy full SHA for d48c114 - Browse repository at this point
Copy the full SHA d48c114View commit details -
Merge branch 'master' of github.com:apache/spark into concurrent-sql-…
…executions
Andrew Or committedSep 11, 2015 Configuration menu - View commit details
-
Copy full SHA for bbda199 - Browse repository at this point
Copy the full SHA bbda199View commit details -
Always clone parent properties
... to make the behavior more consistent in SQL vs non-SQL cases.
Andrew Or committedSep 11, 2015 Configuration menu - View commit details
-
Copy full SHA for 5297f79 - Browse repository at this point
Copy the full SHA 5297f79View commit details -
Merge branch 'master' of github.com:apache/spark into concurrent-sql-…
…executions Conflicts: core/src/test/scala/org/apache/spark/ThreadingSuite.scala
Andrew Or committedSep 11, 2015 Configuration menu - View commit details
-
Copy full SHA for 3c00cc6 - Browse repository at this point
Copy the full SHA 3c00cc6View commit details
Commits on Sep 13, 2015
-
Merge branch 'master' of github.com:apache/spark into concurrent-sql-…
…executions
Andrew Or committedSep 13, 2015 Configuration menu - View commit details
-
Copy full SHA for 801fbe0 - Browse repository at this point
Copy the full SHA 801fbe0View commit details -
Andrew Or committed
Sep 13, 2015 Configuration menu - View commit details
-
Copy full SHA for 35bb6f0 - Browse repository at this point
Copy the full SHA 35bb6f0View commit details
Commits on Sep 14, 2015
-
Simplify fix by cloning properties on inherit
The fix for SPARK-10548 can be simplified by just cloning the parent properties on inherit rather than excluding specific properties from ever being inherited. This is safe because the child thread must be created BEFORE the parent thread runs a query.
Andrew Or committedSep 14, 2015 Configuration menu - View commit details
-
Copy full SHA for 984a92f - Browse repository at this point
Copy the full SHA 984a92fView commit details -
Merge branch 'master' of github.com:apache/spark into concurrent-sql-…
…executions
Andrew Or committedSep 14, 2015 Configuration menu - View commit details
-
Copy full SHA for fce3819 - Browse repository at this point
Copy the full SHA fce3819View commit details -
Merge branch 'master' of github.com:apache/spark into concurrent-sql-…
…executions Conflicts: core/src/test/scala/org/apache/spark/ThreadingSuite.scala
Andrew Or committedSep 14, 2015 Configuration menu - View commit details
-
Copy full SHA for 75a8d90 - Browse repository at this point
Copy the full SHA 75a8d90View commit details