Update II. Manipulating data.py

Author: ortizfram

Introduction to PySpark/II. Manipulating data.py

@@ -39,3 +39,16 @@
 #|
 #|
 ### Filtering Data
+# Filter flights by passing a string
+long_flights1 = flights.filter("distance > 1000")   # sql string
+
+# Filter flights by passing a column of boolean values
+long_flights2 = flights.filter(flights.distance > 1000)
+
+# Print the data to check they're equal
+long_flights1.show()
+long_flights2.show()
+#- same result
+#|
+#|
+### Selecting