Skip to content

rlawrenc/cosc_404

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 
 
 
 
 
 
 
 
 

Repository files navigation

COSC 404 - Database System Implementation - Jan 2023

Instructor

Dr. Ramon Lawrence, ramon.lawrence@ubc.ca, 250-807-9390
Live Classroom Schedule: Tuesday/Thursday, 8:00 a.m. - 9:30 a.m.
Mode of Delivery: LIB 317 and live-stream on Zoom
Office Hours: Thursdays 2 to 4 p.m. or by an appointment
Office Location: ASC 349
Calendar Course Description, from the UBCO Calendar: http://www.calendar.ubc.ca/okanagan/courses.cfm?go=name&code=COSC

TAs

Omar Abdelaziz - Zoom virtual hours Monday 2 to 4 p.m., Wednesday 2 to 4 p.m.
Devon MacNeil - Zoom virtual hours Tuesday 2 to 4 p.m., Friday 2 to 4 p.m.

For support, create a ticket on HelpMe system at: https://help.cosc304.ok.ubc.ca/

User id: your student number Password: your student number

Course Description

Official Calendar: Fundamental concepts in constructing database systems including file organizations, storage management, system architectures, query processing/optimization, transaction management, recovery, and concurrency control. Additional topics may include distributed databases, mobile databases, and integration. Prerequisite: COSC 304 and third-year standing.

Specific description: This course provides an in-depth study of various approaches and techniques to data management including relational (SQL) databases, NoSQL systems, and techniques for indexing, query processing, and concurrency. Students completing the course will have experience in a wide variety of commercial systems (MySQL, PostgreSQL, MongoDB, Microsoft SQL Server, Snowflake) and the fundamental knowledge of data processing to make key decisions on selecting and optimizing data architectures and systems.

Course Objectives

Course Format: Interactive classes consisting of topic introduction, understanding evaluation using quick questions, and concept mastery with larger exercises. Practical skills and applications of topics covered in assignments as well as practice using industrial database systems and software.

Learning Outcomes:

  • Develop programs that access many different SQL and NoSQL databases and implement key database features such as data storage, query parsing/processing, and execution of database query operators.
  • Evaluate different storage designs and index techniques (e.g. B-trees, hashing) to maximize efficiency for specific hardware and application use cases.
  • Analyze the efficiency of SQL queries based on how the database performs query parsing, translation, and optimization to produce a query execution plan of relational operators.
  • Explain how databases implement transactions, and apply precedence graphs to verify conflict serializability of transactions.
  • Compare and contrast implementing concurrency control using locking versus timestamp and multi-version protocols.
  • Utilize knowledge of how databases are developed to be better users with the ability to use different database systems, compare their properties, and adapt database techniques when developing software.

Marking and Evaluation

Item Weighting Description
Quizzes and Exercises 10% Online and during class time activities
Assignments 25% Weekly assignments
Midterm #1 15% February 28th in class
Midterm #2 15% March 21st in class
Final Exam 35% Cumulative, two and half hours

A student must receive a combined grade of at least 50% on the exams (midterms and final) to pass the course. Otherwise, the student receives a maximum overall grade of 45.

COSC 504 - Graduate Student Evaluation

Item Weighting Description
Quizzes and Exercises 5% Online and during class time activities
Assignments 15% Weekly assignments
Project 15% Research paper and presentation
Midterm #1 15% February 28th in class
Midterm #2 15% March 21st in class
Final Exam 35% Cumulative, two and half hours

Textbook and Reference Material

Expectations

  • Attend all classes and prepare before attending class.
  • Review the material before the class time. Expect to spend about five hours per week in out-of-class preparation.
  • Learn the material in the course by completing all assignments. No late assignments are accepted.
  • Enjoy attending class activities and participate according to your personality. Ask questions by posting on chat or raising your hand.
  • Please actively participate in class discussions, questions, and problem solving exercises.
  • I want all students to pass the course, receive a good grade, and feel the course was beneficial.

Schedule

Date Topic
January 10 (T) First day of classes. Introduction to course. Database architecture.
January 12 (TH) Storage I: Accessing/Representing Data on Devices (SSD,RAID) using Records/Blocks
January 17 (T) Storage II: File operations, buffer management, column vs row storage
January 19 (TH) Indexing I: Index Types, Primary Indexes, Multi-level Indexes, Secondary Indexes
January 24 (T) Indexing II: B-Trees (insertion, deletion), B+-Trees
January 26 (TH) Indexing III: B+-Trees, R-Trees
January 31 (T) Indexing IV: Hash Indexes, SQL Indexing in Practice
February 2 (TH) Query processing I: SQL/RA Review, Types of Operators, Iterators, One-pass Algorithms
February 7 (T) Query processing II: Nested-Loop Joins, External Sorting, Two-Pass Sorting Algorithms, Sort-Join, Sort-Merge-Join
February 9 (TH) Query processing III: Hash Partitioning, Two-Pass Hash Algorithms, Hybrid Hash Join
February 14 (T) Query optimization I: Query Parsing/Translation, Relational Algebra Laws
February 16 (TH) No class
February 21 (T) No classes during Midterm Break.
February 23 (TH) No classes during Midterm Break.
February 28 (T) Midterm exam #1
March 2 (TH) Query optimization II: Heuristic Optimization, Physical Query Plans
March 7 (T) Query optimization III: Cost-based Query Optimization
March 9 (TH) Transaction processing I: ACID Properties, Schedules, Conflict Serializability
March 14 (T) Transaction processing II: View Serializability, Schedule Properties
March 16 (TH) Concurrency control I: Two-Phase Locking (2PL), Multiple Granularity Locking, Deadlock Handling, Wait-for Graphs
March 21 (T) Midterm exam #2
March 23 (TH) Concurrency control II: Timestamp Protocols, Validation Protocols, Multi-versioning, Snapshot isolation
March 28 (T) Concurrency control III: SQL Isolation Levels, Phantom Phenomenon, CC in systems
March 30 (TH) Recovery: Types of Failures, Log-Based Recovery, Undo/Redo Logging
April 4 (T) Distribution I: Architectures, Semi-joins, Two-Phase Commit
April 6 (TH) Distribution II: Fragmentation, Partitioning
April 11 (T) Distribution III: Replication: Primary-Primary and Primary-Secondary, CAP Theorem
Architecture I: Comparison of database architectures: Relational, Key-Value, In-Memory

Course Review. Discuss final exam.
April 13 (TH) Course Review No class
April 28 (F) Final Exam. April 28 at 12 p.m. in COM 201

Labs

Lab Date Topic
January 9 - 13 No Lab during First Week of Class
1 January 16 - 20 Lab 1: MySQL vs. PostgreSQL – Creating and Querying Data
2 January 23 - 27 Lab 2: MySQL vs. PostgreSQL – Indexing for Performance
3 Jan. 30 - Feb. 3 Lab 3: Implementing a Text Database and JDBC Driver
4 February 6 - 10 Lab 4: Query Processing with Iterators
5 February 13 - 17 Lab 5: Query Parsing with JavaCC
February 20 - 24 Midterm Break — No Labs
6 Feb. 27 - Mar. 3 Lab 6: Storing JSON Documents: MongoDB and PostgreSQL
7 March 6 - 10 Lab 7: Map-Reduce using MongoDB
8 March 13 - 17 Lab 8: Transactions with Microsoft SQL Server
9 March 20 - 24 Lab 9: Cloud Data Analysis with Snowflake
10 March 27 - 31 Lab 10: Recovering from a Database Failure
11 April 3 - 7 No Lab Lab 11: Scaling Databases with MySQL and MongoDB
April 10 - 13 No Lab during Last Week of Class

Final Examinations

The Final Exam period is April 17-28, 2023. Except in the case of examination clashes and hardships (three or more formal examinations scheduled within a 24-hour period) or unforeseen events, students will be permitted to apply for out-of-time final examinations only if they are representing the University, the province, or the country in a competition or performance; serving in the Canadian military; observing a religious rite; working to support themselves or their family; or caring for a family member. Unforeseen events include (but may not be limited to) the following: ill health or other personal challenges that arise during a term and changes in the requirements of an ongoing job.
Further information on Academic Concession can be found under Policies and Regulation in the Okanagan Academic Calendar http://www.calendar.ubc.ca/okanagan/index.cfm?tree=3,48,0,0

Missing an Exam

Only students who miss the final exam for a reason that corresponds to the University of British Columbia Okanagan's policy on excused absences from examinations will be permitted to take the final exam at a later time. A make-up exam may have a question format different from the regular exam. There will be no make-up midterm exams. If the reason for absence is satisfactory, the student’s final exam will be worth more of the final grade. Further information on Academic Concession is in the Academic Calendar http://www.calendar.ubc.ca/okanagan/index.cfm?tree=3,48,0,0.

Copyright Disclaimer

Diagrams and figures included in lecture presentations adhere to Copyright Guidelines for UBC Faculty, Staff and Students http://copyright.ubc.ca/requirements/copyright-guidelines/ and UBC Fair Dealing Requirements for Faculty and Staff http://copyright.ubc.ca/requirements/fair-dealing/. Some of these figures and images are subject to copyright and will not be posted to Canvas. All material uploaded to Canvas that contain diagrams and figures are used with permission of the publisher; are in the public domain; are licensed by Creative Commons; meet the permitted terms of use of UBC’s library license agreements for electronic items; and/or adhere to the UBC Fair Dealing Requirements for Faculty and Staff. Access to the Canvas course site is limited to students currently registered in this course. Under no circumstance are students permitted to provide any other person with means to access this material. Anyone violating these restrictions may be subject to legal action. Permission to electronically record any course materials must be granted by the instructor. Distribution of this material to a third party is forbidden.

Grievances and Complaints Procedures

A student who has a complaint related to this course should follow the procedures summarized below:

  • The student should attempt to resolve the matter with the instructor first. Students may talk first to someone other than the instructor if they do not feel, for whatever reason, that they can directly approach the instructor.
  • If the complaint is not resolved to the student's satisfaction, the student should e-mail the Associate Head, Dr. Yves Lucet at yves.lucet@ubc.ca or the Department Head, Dr. John Braun at cmps.depthead@ubc.ca.

Your Responsibilities

Your responsibilities to this class and to your education as a whole include attendance and participation. You have a responsibility to help create a classroom environment where all may learn. At the most basic level, this means you will respect the other members of the class and the instructor and treat them with the courtesy you hope to receive in return. Inappropriate classroom behavior may include: disruption of the classroom atmosphere, engaging in non-class activities, talking on a cell-phone, inappropriate use of profanity in classroom discussion, use of abusive or disrespectful language toward the instructor, a student in the class, or about other individuals or groups.

Academic Integrity

The academic enterprise is founded on honesty, civility, and integrity. As members of this enterprise, all students are expected to know, understand, and follow the codes of conduct regarding academic integrity. At the most basic level, this means submitting only original work done by you and acknowledging all sources of information or ideas and attributing them to others as required. This also means you should not cheat, copy, or mislead others about what is your work. Violations of academic integrity (i.e., misconduct) lead to the breakdown of the academic enterprise, and therefore serious consequences arise and harsh sanctions are imposed. For example, incidences of plagiarism or cheating may result in a mark of zero on the assignment or exam and more serious consequences may apply if the matter is referred to the President’s Advisory Committee on Student Discipline. Careful records are kept in order to monitor and prevent recurrences. A more detailed description of academic integrity, including the University’s policies and procedures, may be found in the Academic Calendar at: http://okanagan.students.ubc.ca/calendar/index.cfm?tree=3,54,111,0. If you have any questions about how academic integrity applies to this course, please consult with your professor. The use of artificial intelligence (AI) assistance for any assessed portions of this course is not permitted.

Academic Integrity Course Policies

Academic integrity is critical to being a professional developer and a respected person. This is a guide to what is and is not acceptable behaviors in this course.

In-Class Participation and Quizzes and Teamwork Collaboration

Allowed

  • Collaboration in groups of up to 4 on Canvas quizzes and in-class exercises

Not Allowed

  • One person providing all answers for a quiz/exercise to a group of people of any size
  • Sharing, posting, or distributing answers to other students or websites for quizzes/exercises
  • Answering questions for another student or submitting answers on their behalf
  • Requesting help from previous students in the course or other individuals outside of the course
  • Relying on others to do work for me or not contributing reasonable effort to group activities
  • Dividing up the work for a quiz or exercise between members of an approved group (Not Recommended)

Assignments

Allowed

  • Collaborating with your approved group members (usually two) and submitting a shared answer to the assignment
  • Request help from the TA or instructor and use the answer/code that they provide
  • Answer general questions about assignments in chat or discussion forums (Allowed with care)

Not Allowed

  • Working on an individual assignment with a group of people and submitting minor variations of work developed together
  • For group assignment, completing all work independently and providing answer to rest of group
  • Sharing solutions to assignments with other students or on the Internet
  • Receiving solutions to assignments from other sources (students, web, tutors)

Exams

Allowed

  • Using course material including assignments, notes, and quizzes in an open book exam

Not Allowed

  • Using any non-approved resource (people, web, etc.) for exams (severe)
  • Allowing another person to write or complete any part of any exam (severe)
  • Posting or providing answers to students who have not yet completed the exam
  • Requesting help from other people or web services for open book exams
  • Posting or providing exam questions and answers after exam has been completed

Grading Practices

Faculties, departments, and schools reserve the right to scale grades in order to maintain equity among sections and conformity to University, faculty, department, or school norms. Students should therefore note that an unofficial grade given by an instructor might be changed by the faculty, department, or school. Grades are not official until they appear on a student's academic record. http://www.calendar.ubc.ca/okanagan/index.cfm?tree=3,41,90,1014 If you have any questions about how academic integrity applies to this course, please consult with your professor.

Disability Resource Centre

The Disability Resource Centre ensures educational equity for students with disabilities and chronic medical conditions. If you are disabled, have an injury or illness and require academic accommodations to meet the course objectives, please contact Earllene Roberts, the Diversity Advisor for the Disability Resource Centre located in the University Centre building (UNC 215). Ph: 250.807.9263 Email: earllene.roberts@ubc.ca  Web: https://students.ok.ubc.ca/drc

Equity and Inclusion Office

Through leadership, vision, and collaborative action, the Equity & Inclusion Office (EIO) develops action strategies in support of efforts to embed equity and inclusion in the daily operations across the campus. The EIO provides education and training from cultivating respectful, inclusive spaces and communities to understanding unconscious/implicit bias and its operation within in campus environments. UBC Policy 3 prohibits discrimination and harassment on the basis of BC’s Human Rights Code. If you require assistance related to an issue of equity, educational programs, discrimination or harassment please contact the EIO. Office: UNC 325H Ph: 250.807.9291 Email: equity.ubco@ubc.ca  Web: https://equity.ok.ubc.ca

Office of the Ombudsperson for Students 

The Office of the Ombudsperson for Students is an independent, confidential and impartial resource to ensure students are treated fairly. The Ombuds Office helps students navigate campus-related fairness concerns. They work with UBC community members individually and at the systemic level to ensure students are treated fairly and can learn, work and live in a fair, equitable and respectful environment. Ombuds helps students gain clarity on UBC policies and procedures, explore options, identify next steps, recommend resources, plan strategies and receive objective feedback to promote constructive problem solving. If you require assistance, please feel free to reach out for more information or to arrange an appointment.  Office: UNC 328 Ph: 250.807.9818 Email: ombuds.office.ok@ubc.ca   Web: https://ombudsoffice.ubc.ca

Sexual Violence Prevention and Response Office (SVPRO)

A safe and confidential place for UBC students, staff and faculty who have experienced sexual violence regardless of when or where it took place. Just want to talk? We are here to listen and help you explore your options. We can help you find a safe place to stay, explain your reporting options (UBC or police), accompany you to the hospital, or support you with academic accommodations. You have the right to choose what happens next. We support your decision, whatever you decide. Visit svpro.ok.ubc.ca or call us at 250.807.9640.

Independent Investigations Office (IIO)

If you or someone you know has experienced sexual assault or some other form of sexual misconduct by a UBC community member and you want the Independent Investigations Office (IIO) at UBC to investigate, please contact the IIO. Investigations are conducted in a trauma informed, confidential and respectful manner in accordance with the principles of procedural fairness. You can report your experience directly to the IIO by calling 604-827-2060. Web:  https://investigationsoffice.ubc.ca E-mail: director.of.investigations@ubc.ca

Student Learning Hub 

The Student Learning Hub (LIB 237) is your go-to resource for free math, science, writing, and language learning support. The Hub welcomes undergraduate students from all disciplines and year levels to access a range of supports that include tutoring in math, sciences, languages, and writing, as well as help with study skills and learning strategies. For more information, please visit the Hub’s website https://students.ok.ubc.ca/student-learning-hub or call 250-807-9185. 

Student Wellness  

At UBC Okanagan health services to students are provided by Student Wellness.  Nurses, physicians and counsellors provide health care and counselling related to physical health, emotional/mental health and sexual/reproductive health concerns. As well, health promotion, education and research activities are provided to the campus community.  If you require assistance with your health, please contact Student Wellness for more information or to book an appointment. 

UNC 337 250.807.9270  email: healthwellness.okanagan@ubc.ca  Web: https://students.ok.ubc.ca/health-wellness

SAFEWALK

Don't want to walk alone at night? Not too sure how to get somewhere on campus? Call Safewalk at 250-807-8076. For more information: https://security.ok.ubc.ca/safewalk or download the UBC SAFE – Okanagan app.

Reference Material