education

Extras

0. Communicating using Markdown
1. Markdown Cheatsheet
2. Typing Tutor
3. Git flow
4. SQL video course
5. Why you should be using pathlib

Stage 5 - Will be added on 02.11.2020

Stage 4 - Algorithms and Advanced Python

Homework 5

0. Read Grokking algorithms book.
1. Use homeworks/homework_5 folder as a scaffolding for you task. Send a pull-request to python-tech-leaders/education that should include:
   • write solutions for problems from main.py file using TDD
   • extend .gitignore file
   • extend Makefile

Materials

0. Grokking algorithms
1. Pytest

Stage 3 - Data scraping

Homework 4

Send a pull-request to python-tech-leaders/education repo (this one) with your folder that contains that task.

You need to create a crawler to get 100 products from category electronics from olx website (use scrapy).

It should be able to extract the following fields:

• product price
• product name
• product category
• product photos urls
• product state
• product description
• product date of creation
• product views count
• product id
• product url
• seller name
• seller address
• olx delivery availability
• other fields that might be important (as much fields as you can find)

Materials

0. Scrapy docs

Stage 2 - Python

Homework 2

Create cheatsheet for python presentation.

Homework 3

Send a pull-request to python-tech-leaders/education repo (this one) with your folder that contains task_3/main.py file. (for example education/dpoliuha/task_3/main.py)

You need to:

0. Download all text data from the following pages (use requests to download files):

   • https://en.wikipedia.org/wiki/Wikipedia
   • https://en.wikipedia.org/wiki/Main_Page
   • https://en.wikipedia.org/wiki/COVID-19_pandemic
   • https://ru.wikipedia.org/wiki/Пандемия_COVID-19
   • https://yi.wikipedia.org/wiki/קאוויד-19_פאנדעמיק
   • https://tr.wikipedia.org/wiki/COVID-19_pandemisi
   • https://uk.wikipedia.org/wiki/Пандемія_коронавірусної_хвороби_2019
   • https://bg.wikipedia.org/wiki/Пандемия_от_коронавирус_(2019_–_2020)
   • https://be.wikipedia.org/wiki/Пандэмія_COVID-19
   • https://ro.wikipedia.org/wiki/Pandemia_de_coronaviroză_(COVID-19)

1. Count all characters from all of downloaded text data (collections might be very helpful).

   Ex:

   data = "<h1>S</h1>"
   ...
   letter_count = {
       "h": 2,
       "<": 2,
       ">": 2,
       "S": 1,
       "1": 2,
       "/": 1,
   }

2. Sort results data based on count descent.

   Ex:

   sorted_letter_count = {
       "h": 2,
       "<": 2,
       ">": 2,
       "1": 2,
       "/": 1,
       "S": 1,
   }

3. Write results to file (use pathlib to do that).

4. You need to do all of that with threading and without. (So, you'll have 2 functions at least).

5. Create cli for your script (argparse). Should look like:

6. Your script should output time duration of processing.

Stage 1 - Unix Shell

Homework 1

0. Send a pull-request to python-tech-leaders/education repo (this one) with your folder that contains task_1/README.md file. (for example education/dpoliuha/task_1/README.md)

   You need to add to README.md descriptions of basic commands that are used while working with unix shell.

   For example:

   # View content of file
   more <file>
   

1. [optional] Install Oh my zsh and configure plugins.

   Add useful zsh shortcuts to your task_1/README.md file.

   For example:

   # Git push shortcut
   ggp
   

Materials

0. Linux Survival
1. linuxcommand
2. Linux Bash Shell Cheat Sheet
3. Advanced Bash-Scripting Guide
4. A Guide to 100 Useful Unix Commands
5. Command Line Power User

Materials for Windows lovers 😄

0. How to Install WSL, Zsh and Oh My Zsh on Windows 10

Stage 0 - Git and GitHub

Homework 0

0. Send a pull-request to python-tech-leaders/education repo (this one) with your folder that contains task_0/README.md file. (for example education/dpoliuha/task_0/README.md)

   You need to add to README.md descriptions of basic commands that are used while working with git.

   For example:

   # Merge branch to current branch
   git merge <branch>
   

Materials

0. Version Control with Git
1. GitHub & Collaboration
2. try.github.io
3. Git tips — consolidate your knowledge of Git
4. Learn git branching — improve your understanding of branching
5. An Introduction to Git and GitHub by Brian Yu (CS50 course), video, ~40 min.
6. Oh shit, git!
7. Flight rules for git
8. GitHub Learning Lab