Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Extract data of courses #175

Open
5 tasks
ofiralexi opened this issue Nov 21, 2018 · 5 comments
Open
5 tasks

Extract data of courses #175

ofiralexi opened this issue Nov 21, 2018 · 5 comments
Assignees
@matanpugach
Labels
Bot logic issues tag with this label mention that this issue is the logic team responsibility
Milestone
Sprint 12.12

Comments

@ofiralexi
Copy link
Contributor

ofiralexi commented Nov 21, 2018 •
edited
Loading

Extract data of relevant courses:

  • course name and number
  • syllabus
  • lecture hours and locations
  • courses prerequisits ( which are needed for this course ? )
  • Any more data you can get
    into a CSV file
@ofiralexi ofiralexi added Bot logic issues tag with this label mention that this issue is the logic team responsibility labels Nov 21, 2018
@ofiralexi ofiralexi added this to the Bot Test milestone Nov 21, 2018
@ofiralexi
Copy link
Contributor Author

ofiralexi commented Nov 21, 2018 •
edited
Loading

Some helpful links

UG REP -
http://ug3.technion.ac.il/rep/REPFILE.zip
PARSER -
https://github.com/lutzky/repy
hosted:
https://repy-176217.appspot.com/
UG SCRAPING -
https://bitbucket.org/eytan_s/courses-tree/src/default/technion_parser_V1.py?fbclid=IwAR2c_eYJKODAWyyKlJrG0zQTkfLnTyfWuLJ1Exx0vpgwXNpl-KUPoyn4NIc&fileviewer=file-view-default

@matanpugach matanpugach self-assigned this Nov 22, 2018
matanpugach added a commit that referenced this issue Nov 27, 2018
@matanpugach
data extraction Classes under course.info package #175
57887d8
@ofiralexi ofiralexi modified the milestones: Bot Test, sprint 12.12 Nov 28, 2018
@matanpugach
Copy link
Contributor

courses prerequisites can be from the form (X AND Y ) OR (Z AND W).
will update on how this was handled

@ShaiZeevi
Copy link
Contributor

Indeed, please update how it is represented in DB, those using the data will decide how it should be read\spoken

@matanpugach
Copy link
Contributor

matanpugach commented Nov 28, 2018 •
edited
Loading

will be stored as a string, repesenting a logical connection: for example:
'111111&222222|333333&444444'
represents both 111111 and 222222 are prerequisites or 333333 and 444444

matanpugach added a commit that referenced this issue Dec 1, 2018
@matanpugach
data extraction Classes under course.info package #175
7b7617b
matanpugach added a commit that referenced this issue Dec 2, 2018
@matanpugach
Course json added #175
8782981
matanpugach added a commit that referenced this issue Dec 2, 2018
@matanpugach
Build should be succsful #175
4438276
matanpugach added a commit that referenced this issue Dec 2, 2018
@matanpugach
Build - hopefully fixed all errors #175
5e0e6f3
matanpugach added a commit that referenced this issue Dec 2, 2018
@matanpugach
Build - maybe now fixed all errors #175
edad758
matanpugach added a commit that referenced this issue Dec 2, 2018
@matanpugach
Build - maybe now fixed all errors #175
6d71cac
@ofiralexi
Copy link
Contributor Author

@ShaiZeevi can we close?

@matanpugach matanpugach mentioned this issue Jan 21, 2019
Open
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@matanpugach matanpugach

Labels
Bot logic issues tag with this label mention that this issue is the logic team responsibility
Projects
None yet
Milestone
Sprint 12.12
Development

No branches or pull requests
3 participants
@matanpugach @ShaiZeevi @ofiralexi