Notebook for my work and career (public version)

“I’ve learned that people will forget what you said, people will forget what you did, but people will never forget how you made them feel.” - Maya Angelou

What makes a good data scientist? (DJ Patil)

• Technical expertise: the best data scientists typically have deep expertise in some scientific discipline.
• Curiosity: a desire to go beneath the surface and discover and distill a problem down into a very clear set of hypotheses that can be tested.
• Storytelling: the ability to use data to tell a story and to be able to communicate it effectively.
• Cleverness: the ability to look at a problem in different, creative ways.

Cultivate conditions for team success

• 1. communicate with intent
• 2. inspire to generate action
• 3. understand what motivate each team member (e.g. direct praise, quiet reinforcement, more responsibilities)
• 4. encourage risk-taking
• 5. leverage diversity (different angles)
• 6. lead by examples (set examples, a tone that balances authority & humility)

From manager to leader

Enhance personal growth

• Self-awareness
• Executive presence (image, demeanor, leadership)
• Emotional intelligence

Commite to people and relationships

• Coach
• Network

Strong - vulnerable, Decisive - flexible, Strategic - creative, Outgoing - introspective

Techstack notes

• Athena, Redshift(AWS SQL): local setup and some tricks for date and time
• Python
• Regular Expressions (Regex)
• Data Engineering 101
• Data Structure Algorithm
• Apache Spark
• Visualization
• Container
• AWS Security
• pandas
• Note: AWS Big Data Training
• Note: AWS Analytics Course
• Note: Computer Vision Theory
• cv preprocessing jpg - png

Domain knowledge notes

• Synthesizing health insurance claim payload (JSON)
• Medical Coding
• conditional probability, carc code as example (private link)
• dental xray basics
• Dental tooth number

tech to-do list

• Violin plot
• Panel (jnb interactive html)
• Gradio (create UI for ML demo)
• IntepretML, Explainable Boosting
• tqdm, loading bar
• Detectron2.0, successor of Mask R-CNN benchmark
• Image Deduplicator (imagededup)
• joblib (multiprocessing in JNB)

Others

Update environment and package (step order):

    $ brew update 
    $ brew upgrade
    $ conda update -n base conda    
    $ conda update --all

Tips: in terminal, type !j will start last command start with j such as 'jupyter notebook'.

Git: a very well-made tutorial for Git https://youtu.be/n-p1RUmdl9M

Mapping generic keyboard on Mac

• Go to Keyboard, then Modifer Keys ...
  • Swap Option Key with Command Key
• Verified by Mac build-in 'Keyboard Viewer'
• Wired connnection is always reliable. Wireless connection: non-BT is slightly better.

Reference

• Ref https://www.oreilly.com/library/view/machine-learning-pocket/9781492047537/ (purchased copy: private links .epub, .pdf/zip)
• Ref https://www.earthdatascience.org/courses/intro-to-earth-data-science/python-code-fundamentals/use-python-packages/use-conda-environments-and-install-packages/