Skip to content

Commit

Permalink
docs: Improve Superset on EKS doc (#530)
Browse files Browse the repository at this point in the history
Co-authored-by: Vara Bonthu <vara.bonthu@gmail.com>
Co-authored-by: avasu80 <vasuaswi@amazon.com>
  • Loading branch information
3 people committed May 21, 2024
1 parent 6fa0ca6 commit e711af4
Show file tree
Hide file tree
Showing 11 changed files with 40 additions and 4 deletions.
1 change: 0 additions & 1 deletion analytics/terraform/superset-on-eks/addons.tf
Original file line number Diff line number Diff line change
Expand Up @@ -110,7 +110,6 @@ module "eks_data_addons" {
values = [templatefile("${path.module}/helm-values/superset-values.yaml", {})]
}
depends_on = [module.eks_blueprints_addons]

}

#------------------------------------------------------------
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -50,11 +50,9 @@ supersetWorker:
requests:
cpu: 200m
memory: 400Mi

persistence:
enabled: true


postgresql:
## Set to false if bringing your own PostgreSQL.
enabled: true
Expand Down Expand Up @@ -93,3 +91,4 @@ redis:
accessModes:
- ReadWriteOnce
runAsUser: 1000

Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
40 changes: 39 additions & 1 deletion website/docs/blueprints/data-analytics/superset-on-eks.md
Original file line number Diff line number Diff line change
Expand Up @@ -67,11 +67,15 @@ terraform init
terraform apply --auto-approve
```

### Architecture Overview

![img.png](img/apache-superset-eks.png)

### Verify Deployment

After the deployment completes, we can access the Superset UI . For demo purpose, this blueprint creates the Ingress object for the Superset FrontEnd UI with public LoadBalancer.
After the deployment completes, we can access the Superset UI . For demo purpose, this blueprint creates the Ingress object for the Superset FrontEnd UI with public LoadBalancer and also number of pods across 2 AZ's in the corenode and superset node respectively.

![img.png](img/superset-pods.png)

You may find the URL to the Superset frontend from the output superset_url, or by running kubectl command below:

Expand All @@ -83,11 +87,45 @@ NAME CLASS HOSTS ADDRESS
superset-ingress aws-alb * k8s-superset-***.***.elb.amazonaws.com 80 125m
```



Copy the ADDRESS field from the output, then open browser and enter the URL as `http://<address>/`. Enter `admin` as both user name and password when prompted. We can view the Superset UI like below.

![img.png](img/superset1.png)
![img.png](img/superset2.png)

In order to visualize data, we need to first connect to Postgres database. the IP address of the database can be obtained by describing a pod 'superset-postgresql-0'. Basically the database is hosted on the superset-node


```sh
k describe po superset-postgresql-0 -n superset

```


After obtaining the IP address, database connection can be established as per the screenshot below
![img.png](img/superset-connect-database.png)

Once the database is connected, it has to be configured to allow file upload. This features allows, csv and other format files to be uploaded as a new table. Please refer to the screeshots below

Step -1 : Edit database configuration and navigate to 'ADVANCED' settings

![img.png](img/superset-edit-database.png)

Step - 2 : Under Security scroll down to the very end and 'check allow file uploads to the database'

![img.png](img/superset-enable-fileupload.png)

Step -3 : Create a dataset by uploading a file

![img.png](img/superset-create-dataset.png)

Step - 4 : To show a sample visualization a sample CSV of COVID research across various countries was uploaded. Here are a few visualizations that shows countries porgess with respect to trial of various vaccines

![img.png](img/superset-sample-graph.png)


![img.png](img/superset-view-by-country.png)
## Cleanup

To clean up your environment, run the `cleanup.sh` script.
Expand Down

0 comments on commit e711af4

Please sign in to comment.