-
Notifications
You must be signed in to change notification settings - Fork 0
Spark cheetsheet
<**init> DRIVER_IDENTIFIER HiveContext **
LEGACY_DRIVER_IDENTIFIER RDD_SCOPE_KEY RDD_SCOPE_NO_OVERRIDE_KEY SPARK_JOB_DESCRIPTION
SPARK_JOB_GROUP_ID SPARK_JOB_INTERRUPT_ON_CANCEL StringToColumn _sqlContext abs acos add_months
approxCountDistinct array array_contains asc ascii asin atan
atan2 avg base64 bin bitwiseNOT boolToBoolWritable booleanWritableConverter
broadcast bytesToBytesWritable bytesWritableConverter callUDF callUdf cbrt ceil
classOf clearActiveContext clone coalesce col collect_list collect_set
column concat concat_ws conv corr cos cosh
count countDistinct crc32 cumeDist cume_dist current_date current_timestamp
date_add date_format date_sub datediff dayofmonth dayofyear decode
denseRank dense_rank desc doubleRDDToDoubleRDDFunctions doubleToDoubleWritable doubleWritableConverter encode
eq equals exp explode expm1 expr factorial
finalize first floatToFloatWritable floatWritableConverter floor format_number format_string
from_unixtime from_utc_timestamp getClass getOrCreate get_json_object greatest hashCode
hex hour hypot initcap inputFileName input_file_name instr
intRddToDataFrameHolder intToIntWritable intWritableConverter isNaN isTraceEnabled isnan isnull
jarOfClass jarOfObject json_tuple kurtosis lag last last_day
lead least length levenshtein lit localSeqToDataFrameHolder localSeqToDatasetHolder
locate log log10 log1p log2 logDebug logError
logInfo logName logTrace logWarning longRddToDataFrameHolder longToLongWritable longWritableConverter
lower lpad ltrim markPartiallyConstructed max md5 mean
min minute monotonicallyIncreasingId monotonically_increasing_id month months_between nanvl
ne negate newBooleanArrayEncoder newBooleanEncoder newBooleanSeqEncoder newByteArrayEncoder newByteEncoder
newByteSeqEncoder newDoubleArrayEncoder newDoubleEncoder newDoubleSeqEncoder newFloatArrayEncoder newFloatEncoder newFloatSeqEncoder
newIntArrayEncoder newIntEncoder newIntSeqEncoder newLongArrayEncoder newLongEncoder newLongSeqEncoder newProductArrayEncoder
newProductEncoder newProductSeqEncoder newShortArrayEncoder newShortEncoder newShortSeqEncoder newStringArrayEncoder newStringEncoder
newStringSeqEncoder next_day not notify notifyAll ntile numDriverCores
numericRDDToDoubleRDDFunctions percentRank percent_rank pmod pow quarter rand
randn rank rddToAsyncRDDActions rddToDataFrameHolder rddToDatasetHolder rddToOrderedRDDFunctions rddToPairRDDFunctions
rddToSequenceFileRDDFunctions regexp_extract regexp_replace repeat res0 res1 res2
res3 res5 reverse rint round rowNumber row_number
rpad rtrim sc second setActiveContext sha1 sha2
shiftLeft shiftRight shiftRightUnsigned signum sin sinh size
skewness sort_array soundex sparkPartitionId spark_partition_id split sql
sqlContext sqrt stddev stddev_pop stddev_samp stringRddToDataFrameHolder stringToText
stringWritableConverter struct substring substring_index sum sumDistinct symbolToColumn
synchronized table table1 tan tanh text textData
toDegrees toRadians toString to_date to_utc_timestamp translate trim
trunc udf unbase64 unhex unix_timestamp updatedConf upper
var_pop var_samp variance wait weekofyear when writableWritableConverter
year