Skip to content

Navigation Menu

Explore
For
- Enterprise
- Teams
- Startups
- Education
By Solution
Resources
- GitHub Sponsors
  Fund open source developers
- The ReadME Project
  GitHub community articles
Repositories
Pricing

Search code, repositories, users, issues, pull requests...

Search

Clear

Search syntax tips

Provide feedback

We read every piece of feedback, and take your input very seriously.

Include my email address so I can be contacted

Saved searches

Use saved searches to filter your results more quickly

Name

Query

To see all available qualifiers, see our documentation.

You signed in with another tab or window. Reload to refresh your session. You signed out in another tab or window. Reload to refresh your session. You switched accounts on another tab or window. Reload to refresh your session.

Dismiss alert

vaquarkhan / vaquarkhan Public

Notifications
Fork 0
Star 1.5k

Code
Issues
Pull requests
Actions
Projects
Wiki
Security
Insights

Additional navigation options

Code
Issues
Pull requests
Actions
Projects
Wiki
Security
Insights

Spark notes

Jump to bottom Edit New page

Vaquar Khan edited this page Sep 21, 2022 · 1 revision

https://spoddutur.github.io/spark-notes/

Add a custom footer

Toggle table of contents Pages 262

Home
557 GCP blogs
9 Common Errors Made During API Testing
access Broadcast Variables in Spark java
ACCUMULATORS
Aggregating over sorted data
Allow your Elastic Beanstalk Environment to Connect to your Database Instance
Amazon Cognito
Amazon Cognito Groups and Fine Grained Role Based Access
An Optimization Technique in Apache Spark
Angular 2
Apache streaming performance
Apache Flink Traning
apache kafka quick start guide
Apache livy
Apache Spark Differences between coalesce and repartition
Apache Spark Shuffle hash join vs Broadcast hash join
apache spark as a compiler joining a billion rows per second on a laptop
Apache spark before 2.3 unionByName union two data frame issue with different column order
Apache Spark Benchmarking
Apache Spark Best Practices.
apache spark case when else in sql
Apache Spark handling of empty partitions
Apache Spark Hub
Apache Spark Join
Apache Spark Join Optimization 2 Large Tables
Apache Spark ML
Apache Spark POC and benchmark
Apache Spark Prod cluster size
Apache Spark Quick Guide
Apache Spark RDD vs DataFrame vs DataSet
Apache Spark serialization
Apache Spark structured streaming and AWS EMR Memory issue
Apache spark with Hive and Mysql
author
AWS API Gateway Endpoints Protect using API Keys
AWS API getway and dynamodb
AWS API getway developer guide
AWS AuthN using Cognito User Pool with SAML Federation at the UW
AWS Cognito role based access
AWS cognito and Alexa skills
AWS cognito get id token using refresh token
aws cognito migrate user node js lambda function
AWS Cognito passwordless authentication
AWS cognito Sync
AWS Cognito User Migration old pool to new Pool
AWS Custom Lambda authorizer authentication for amazon api gateway for microservice
aws data pipeline vs aws glue
AWS Deploying Multiple Java Applications in a Single Elastic Beanstalk Instance
AWS few question wrong
aws glue rds Mysql s3 jdbc
AWS IP Whitelisting with Amazon API Gateway
AWS Kinesis
AWS Lambda
AWS Lambda invoke an aws lambda function from within another lambda function
AWS Lambda PreAuth trigger
Aws lambda send sms using amazon sns from
AWS Lambda and send Alerts on Errors CloudWatch to Monitor lambda
AWS Lambda call other lambda function
AWS Lambda EMR BOTO#
AWS lambda function listen for an incoming SNS
AWS LAMBDA NODE JS calling rest API get and post
AWS Lambda orchestration
AWS lambda Read CSV file from S3
AWS lambda read S3 CSV file and insert into RDS mysql
AWS Lambda run locally on window
AWS Lambda send SMS message
AWS Lambda to Kafka
AWS Lambda with Spring Boot
AWS Managing API access with Amazon API Gateway
AWS QuickSight as code
AWS Serverless Microservice Patterns
AWS Simple email service in different regions
Backpressure in WebFlux
Bibucket as a maven repository
Blockchain technology a very special kind of Distributed Database
Building a Pipeline to Ingest and Analyze Streaming Data
Building Eureka Client and Server
Cassandra client to node one way SSL vs two way SSL
Cloud Foundry for Developers
Cloud foundry install application
Cognito user pool migration export xls
Cognito with API Gateway custom authorizer Lambda (Python 3.6)
com.gemstone.gemfire.cache.query.internal.StructImpl cannot be cast to com.a.b.c
Configure AWS ELB classic load balancer SSL and point to godaddy domain
Configuring a GEMFIRE Region
Configuring Eureka
Connect Hive using beeline
Connection pool setting in spring boot application properties
Convert Gradle to Maven
CORS in AWS API Gateway AWS Lambda
CQRS and Event Sourcing in Java with Spring Framework
CQRS example
cross account assume role
Cross account AWS Glue Data
Curl tools
Data lake
Data processing architectures – Lambda and Kappa
Data Science books
Data Transformation lambda and python in Kinesis Firehose
Databricks cloud
Databricks guide
DataFrames
Deduplicate data in Apache Spark
delete
Difference between HMACSHA256, HMACSHA384 or HMACSHA512 jwt
Difference between scaling horizontally and vertically
Distributed Tracing Demo Zipkin sluth
DynamoDB Lambda
DynamoDB1 Lambda
ElasticBeanstalk and self sign certificate SSL
ELK Stack
EMR cluster using Python boto3
Eureka at a glance
eureka vs Zookeper
Externalize springboot component
Firebase vs Realm
flink vs spark
GCP Cert
GemFire Geode: Pivotal GemFire is now open source
Gemfire Dashboard jmx metrics grafana
Gemfire Geode WAN Replication
Gemfire Geode doc
Gemfire Geode Indexing Best Practices Working with Gemfire Indexes
Gemfire Issue : Root cause of scaling problem NAT (Network Address Translation)
git for beginners the definitive practical guide
Glue and redshift
Glue job
glue monitor optimize cost glue spark
Glue partitions
grammarly
Graph QL
GraphQL issues and solutions followed by unsolved ones.
group by
Has anyone managed to connect to Oracle via JDBC from Spark CDH 5.5.2
Hbase rowkey design and hotspoting
Hbase schema design best practices
HDP Certified Developer (HDPCD) Exam Hortonworks
Hive date read write issue with ORC date format
How Databricks makes big data simple.
How to Calculate Hadoop Cluster Size
How to calculate node and executors memory in Apache Spark
How to Generate Jmeter Report Dashboard
How to get recent value in spark dataframe
How to simulate network bandwidth in JMeter
https: databricks.com resources type ebooks
Install Kafka on Window
Installing the AWS CLI and Boto3
Integrating Apache Spark 2.x Jobs with Apache NiFi 1.4 Apache Livy
Integrating GemFire systems over WAN using REST
introducing agile analytics
Java Algo problem
Java Jdbc connection with Hive 2
Java Keystores and Truststores
Java to Hive connectivity
Jmeter xlxs for request
Join
Join vs EXISTS
JWT iat and exp
JWT vs OAuth
Kafka Connect and Spark Straming
Kafka POC on Ubanu
Kafka real world
kafka spark streaming integration
Kafka start
Knowledge Driven Microservices
Kubernetes cheetsheet
Lambda call Glue job
Lambda lyer steps
Lambda Proxy vs Lambda Integration in AWS API Gateway
lambda sns send csv attachement
lambda vs kinesis iteratorage difference
Lambda(python ) boto3 EC2 creation
lambda: email notification through sns and lambda
Load Json remove corrupt column
Machine Learning Algorithms
Manage Spring Boot Logs with Elasticsearch, Logstash and Kibana
Mapping between Spark Structured Streaming executors and Kafka partitions
Maven dependency conflict resolution
Maven scope
microservice code
Microservices Orchestration with Kubernetes
Mysql dataload with Apache Spark
MYSQL GEO Location search
MYSQL Partitioning and Indexing
Netflix
New Relic notes
notebook
Parallelism in Spark and tuning
Pass Glue arguments via lambda to Glue job
PIG
Private S3 with public ACL s3:getObject
Pyspark dynamic allocation
Querying Data in S3 with Amazon Athena
quicksight CLI dashboard embed url
RDDsTransformationsActions
RDS MYSQL other non language english language not stored and shows ????
react cognito
Read write Parquet
Redshift connect with JDBC client
Redshift password rotate
reduce vs fold in apache spark
References microservice ,docker
Restore file from deep archive S3 Glacier and Lambda
RestTemplate vs WebClient
S3 file copy one location to other boto3
sc.textFile vs sc.WholeTextFiles
Scalable Big Data at Uber
Scalable Partition Handling for Cloud Native Architecture in Apache Spark 2.1
Scale Spark
Securing Microservices with Spring Cloud Security
Segmaker pyspark
SOA vs Microservice
Sonatlint zipdownload
Spark 2.3 Avro jar
Spark 3.0 and kafka offset Spark Structured Integration
Spark cheetsheet
Spark contains invalid character
Spark Debugger Overview¶
Spark Hardware provisioning
Spark memory managment
Spark notes
Spark Partition Tuning
Spark scratchpad
Spark SQL paper
Spark Streaming Intro
Spark Streaming or Flink Streaming
Spark Streaming Programming Guide
Spark Streaming Stateful Transformations with Windowing
Spark to Cassandra SSL connection using spark cassandra connector
Spark tutorial
Spark UI
Spark usecase
Spark with Mongodb
Spring Security API and Web
Spring Batch
spring batch annotation partitioner
Spring Batch Listener
Spring batch remote chunking vs remote partitioning
Spring Batch task executer
Spring boot Scaling connection pool {MYSQL][HIKARICP]
Spring Boot to Apache Phonix connection
Spring Boot with and without the web server
Spring Cloud Data Flow Server on Cloud Foundry
Spring Cors
Springb boot enable TLS 1.2
SpringBoot AWS with Env variable and profiles in application properties file
Springboot with hikari pool connections
SSL TLS Handshaking process
Stopping multiple AWS RDS instances using lambda function
Storm and Spark
test
Test Driven Development for Big Data
The twelve factor app
Unix Epoch date convert to date
What are broadcast variables and accumulators in Apache Spark? Answer Request
What is JWT
What is the difference between Apache Spark and Apache Flink?
What is the difference between 𝗣𝗮𝗿𝘁𝗶𝘁𝗶𝗼𝗻𝗶𝗻𝗴 𝗮𝗻𝗱 𝗕𝘂𝗰𝗸𝗲𝘁𝗶𝗻𝗴 𝗶𝗻 𝗦𝗽𝗮𝗿𝗸?
Yoman Grant
Zuul
“Exactly once” message handling with Spring Cloud Stream and Kafka

Add a custom sidebar

Clone this wiki locally

Footer

© 2024 GitHub, Inc.

Footer navigation

Terms
Privacy
Security
Status
Docs
Contact

You can’t perform that action at this time.