Init actions 1

.github/workflows/publish_page.yml

@@ -0,0 +1,38 @@
+name: Publish Notes
+on:
+  push:
+    branches:
+      - main
+  pull_request:
+jobs:
+  build-and-publish:
+    runs-on: ubuntu-latest
+    steps:
+      - name: init
+        run: |
+          echo "🎉 The job was automatically triggered by a ${{ github.event_name }} event." \
+          && echo "🐧 This job is now running on a ${{ runner.os }} server hosted by GitHub!" \
+          && echo "🔎 The name of your branch is ${{ github.ref }} and your repository is ${{ github.repository }}."
+
+      - name: Checkout
+        uses: actions/checkout@v3
+      - run: |
+          echo "💡 The ${{ github.repository }} repository has been cloned to the runner." \
+          && "🖥️ The workflow is now ready to test the code on the runner."
+
+      - name: List files in the repository
+        run: |
+          ls ${{ github.workspace }}
+      - name: build
+        uses: actions/setup-python@v4
+        with:
+          python-version: "3.8"
+      - name: release
+        run: |
+            which pip \
+            && pip -V \
+            && pip install -r requirements.txt \
+            && mkdocs -V \
+            && mkdocs gh-deploy
+      - name: done
+        run: echo "🍏 This job's status is ${{ job.status }}."

docs/Engineering/Software-Engineering/Data-Engineering/gcp_dataflow.md

@@ -167,7 +167,7 @@ type: JOB_TYPE_BATCH
 
 ## Schedule
 
-Refer to [DevOps/GCP/Setup/gcloud CLI](/Engineering/Software-Engineering/DevOps/Clouds/gcp/).
+Refer to [DevOps/GCP/Scheduler](/Engineering/Software-Engineering/DevOps/Clouds/gcp/#scheduler).
 
 ## Clean
 
@@ -325,7 +325,7 @@ https://cloud.google.com/dataflow/docs/concepts
 
 ## gcloud CLI
 
-Refer to [DevOps/GCP/Setup/gcloud CLI](/Engineering/Software-Engineering/DevOps/Clouds/gcp/).
+Refer to [DevOps/GCP/Setup/gcloud CLI](/Engineering/Software-Engineering/DevOps/Clouds/gcp/#gcloud-cli).
 
 ## `python 3.8`
 

docs/Engineering/Software-Engineering/Database/gcp_bigquery.md

@@ -87,10 +87,13 @@ https://cloud.google.com/bigquery/quotas#row_level_security
 ### Cost
 
 ### Create 
+- https://cloud.google.com/bigquery/docs/creating-partitioned-tables#python
 
 ### Manage/Modify
+- https://cloud.google.com/bigquery/docs/managing-partitioned-tables#api_2
 
 ### Query
+- https://cloud.google.com/bigquery/docs/querying-partitioned-tables
 
 ## Clustered Table
 ### Quota & Limit

docs/Engineering/Software-Engineering/DevOps/Clouds/gcp.md

@@ -153,8 +153,17 @@ Ref: https://www.thecodebuzz.com/schedule-dataflow-job-google-cloud-scheduler/
 
 ### Using HTTP
 
+https://cloud.google.com/sdk/gcloud/reference/scheduler/jobs/update/http
+
 Use this option along with Dataflow REST api t<F3>o launch the dataflow template. Select the service account for OAuth credentials.
 
+```bash
+
+$ curl
+
+```
+
+
 ### Using PubSub
 tbd
 

docs/Engineering/Software-Engineering/Product-Development/regulations_and_compliances.md

@@ -0,0 +1,57 @@
+# Regulations & Compliances
+
+<h3>Table of Contents</h3>
+
+[TOC]
+
+# GDPR
+
+Global Data Protection Regulation
+
+- https://www.gdpreu.org/the-regulation/
+- PII anonymization
+- applicable to
+    - Companies that do business in the European Union (EU) or European Economic Area (EEA) 
+
+Ref:
+
+- https://www.gdpreu.org/the-regulation/key-concepts/personal-data/
+- https://linfordco.com/blog/gdpr-soc-2/
+
+# CCPA
+
+California Consumer Protection Act 
+
+- https://oag.ca.gov/privacy/ccpa
+- PII de-identification
+- applicable to
+    - Companies that do business in the United States of America 
+
+Ref:
+- https://www.termsfeed.com/blog/ccpa/
+
+
+# GDPR vs CCPA
+
+- https://www.termsfeed.com/blog/gdpr-anonymization-versus-ccpa-de-identification/
+
+# SOC2
+
+System & Organization Control
+
+https://soc2.co.uk/
+https://en.wikipedia.org/wiki/System_and_Organization_Controls
+
+
+- https://cloud.google.com/security/compliance/soc-2
+- https://www.onelogin.com/compliance/soc-2-type-2
+- https://linfordco.com/blog/gdpr-soc-2/
+
+
+# PII Anonymization/Deidentification Techniques
+
+## Data Masking
+- replace the PII with general values, which are still unique
+
+## 
+

requirements.txt

@@ -0,0 +1,6 @@
+mkdocs
+mkdocs-material
+pymdown-extensions
+plantuml-markdown
+
+