Skip to content

bioinformatics-core-shared-training/avoid-data-disaster

Repository files navigation

Avoiding data disasters

Outline

It has been said that 80% of data analysis is spent on the process of cleaning and preparing the data. Not only does this represent a significant time investment for the data analyst, but is often a hurdle for the non-specialist trying to get to grips with analysing their own data after attending an R or Python course. Despite the best intentions, a spreadsheet that is intuitive and easily-understandable by human eyes can lead to disaster when trying to process computationally.

This workshop will go through the basic principles that we can all adopt in order to work with data more effectively and "think like a computer". Moreover, we will discuss the best practices for data management and organisation so that our research is auditable and reproducible by ourselves, and others, in the future.

Timetable

  • 12:30 - 13:00 Andy - philosophical introduction
  • 13:00 - 14:30 Sergio / Valeria - Typical problems talk + practical
  • 14:30 - 15:00 Anne - File management
  • 15:00 - 15:30 Peter - Strategies for backup