/
d-printing-raspberry-pi-and-maker-archaeology.html
745 lines (704 loc) · 109 KB
/
d-printing-raspberry-pi-and-maker-archaeology.html
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215
216
217
218
219
220
221
222
223
224
225
226
227
228
229
230
231
232
233
234
235
236
237
238
239
240
241
242
243
244
245
246
247
248
249
250
251
252
253
254
255
256
257
258
259
260
261
262
263
264
265
266
267
268
269
270
271
272
273
274
275
276
277
278
279
280
281
282
283
284
285
286
287
288
289
290
291
292
293
294
295
296
297
298
299
300
301
302
303
304
305
306
307
308
309
310
311
312
313
314
315
316
317
318
319
320
321
322
323
324
325
326
327
328
329
330
331
332
333
334
335
336
337
338
339
340
341
342
343
344
345
346
347
348
349
350
351
352
353
354
355
356
357
358
359
360
361
362
363
364
365
366
367
368
369
370
371
372
373
374
375
376
377
378
379
380
381
382
383
384
385
386
387
388
389
390
391
392
393
394
395
396
397
398
399
400
401
402
403
404
405
406
407
408
409
410
411
412
413
414
415
416
417
418
419
420
421
422
423
424
425
426
427
428
429
430
431
432
433
434
435
436
437
438
439
440
441
442
443
444
445
446
447
448
449
450
451
452
453
454
455
456
457
458
459
460
461
462
463
464
465
466
467
468
469
470
471
472
473
474
475
476
477
478
479
480
481
482
483
484
485
486
487
488
489
490
491
492
493
494
495
496
497
498
499
500
501
502
503
504
505
506
507
508
509
510
511
512
513
514
515
516
517
518
519
520
521
522
523
524
525
526
527
528
529
530
531
532
533
534
535
536
537
538
539
540
541
542
543
544
545
546
547
548
549
550
551
552
553
554
555
556
557
558
559
560
561
562
563
564
565
566
567
568
569
570
571
572
573
574
575
576
577
578
579
580
581
582
583
584
585
586
587
588
589
590
591
592
593
594
595
596
597
598
599
600
601
602
603
604
605
606
607
608
609
610
611
612
613
614
615
616
617
618
619
620
621
622
623
624
625
626
627
628
629
630
631
632
633
634
635
636
637
638
639
640
641
642
643
644
645
646
647
648
649
650
651
652
653
654
655
656
657
658
659
660
661
662
663
664
665
666
667
668
669
670
671
672
673
674
675
676
677
678
679
680
681
682
683
684
685
686
687
688
689
690
691
692
693
694
695
696
697
698
699
700
701
702
703
704
705
706
707
708
709
710
711
712
713
714
715
716
717
718
719
720
721
722
723
724
725
726
727
728
729
730
731
732
733
734
735
736
737
738
739
740
741
742
743
744
745
<!DOCTYPE html>
<html lang="en">
<head>
<meta charset="UTF-8">
<meta http-equiv="X-UA-Compatible" content="IE=edge">
<title>The Open Digital Archaeology Textbook</title>
<meta name="description" content="The Open Digital Archaeology Textbook combines instructive text with a computational DA laboratory">
<meta name="generator" content="bookdown 0.7 and GitBook 2.6.7">
<meta property="og:title" content="The Open Digital Archaeology Textbook" />
<meta property="og:type" content="book" />
<meta property="og:image" content="images/brandon-green-321795-unsplash.jpg" />
<meta property="og:description" content="The Open Digital Archaeology Textbook combines instructive text with a computational DA laboratory" />
<meta name="github-repo" content="o-date/draft" />
<meta name="twitter:card" content="summary" />
<meta name="twitter:title" content="The Open Digital Archaeology Textbook" />
<meta name="twitter:description" content="The Open Digital Archaeology Textbook combines instructive text with a computational DA laboratory" />
<meta name="twitter:image" content="images/brandon-green-321795-unsplash.jpg" />
<meta name="author" content="Shawn Graham, Neha Gupta, Jolene Smith, Andreas Angourakis, Andrew Reinhard, Kate Ellenberger, Zack Batist, Joel Rivard, Ben Marwick, Michael Carter, Beth Compton, Rob Blades, & Cristina Wood">
<meta name="date" content="2018-12-14">
<meta name="viewport" content="width=device-width, initial-scale=1">
<meta name="apple-mobile-web-app-capable" content="yes">
<meta name="apple-mobile-web-app-status-bar-style" content="black">
<link rel="prev" href="d-photogrammetry.html">
<link rel="next" href="place-based-interpretation-with-locative-augmented-reality.html">
<script src="libs/jquery-2.2.3/jquery.min.js"></script>
<link href="libs/gitbook-2.6.7/css/style.css" rel="stylesheet" />
<link href="libs/gitbook-2.6.7/css/plugin-bookdown.css" rel="stylesheet" />
<link href="libs/gitbook-2.6.7/css/plugin-highlight.css" rel="stylesheet" />
<link href="libs/gitbook-2.6.7/css/plugin-search.css" rel="stylesheet" />
<link href="libs/gitbook-2.6.7/css/plugin-fontsettings.css" rel="stylesheet" />
<script src="https://hypothes.is/embed.js" async></script>
<link rel="stylesheet" href="css/custom.css">
<style type="text/css">
div.sourceCode { overflow-x: auto; }
table.sourceCode, tr.sourceCode, td.lineNumbers, td.sourceCode {
margin: 0; padding: 0; vertical-align: baseline; border: none; }
table.sourceCode { width: 100%; line-height: 100%; }
td.lineNumbers { text-align: right; padding-right: 4px; padding-left: 4px; color: #aaaaaa; border-right: 1px solid #aaaaaa; }
td.sourceCode { padding-left: 5px; }
code > span.kw { color: #007020; font-weight: bold; } /* Keyword */
code > span.dt { color: #902000; } /* DataType */
code > span.dv { color: #40a070; } /* DecVal */
code > span.bn { color: #40a070; } /* BaseN */
code > span.fl { color: #40a070; } /* Float */
code > span.ch { color: #4070a0; } /* Char */
code > span.st { color: #4070a0; } /* String */
code > span.co { color: #60a0b0; font-style: italic; } /* Comment */
code > span.ot { color: #007020; } /* Other */
code > span.al { color: #ff0000; font-weight: bold; } /* Alert */
code > span.fu { color: #06287e; } /* Function */
code > span.er { color: #ff0000; font-weight: bold; } /* Error */
code > span.wa { color: #60a0b0; font-weight: bold; font-style: italic; } /* Warning */
code > span.cn { color: #880000; } /* Constant */
code > span.sc { color: #4070a0; } /* SpecialChar */
code > span.vs { color: #4070a0; } /* VerbatimString */
code > span.ss { color: #bb6688; } /* SpecialString */
code > span.im { } /* Import */
code > span.va { color: #19177c; } /* Variable */
code > span.cf { color: #007020; font-weight: bold; } /* ControlFlow */
code > span.op { color: #666666; } /* Operator */
code > span.bu { } /* BuiltIn */
code > span.ex { } /* Extension */
code > span.pp { color: #bc7a00; } /* Preprocessor */
code > span.at { color: #7d9029; } /* Attribute */
code > span.do { color: #ba2121; font-style: italic; } /* Documentation */
code > span.an { color: #60a0b0; font-weight: bold; font-style: italic; } /* Annotation */
code > span.cv { color: #60a0b0; font-weight: bold; font-style: italic; } /* CommentVar */
code > span.in { color: #60a0b0; font-weight: bold; font-style: italic; } /* Information */
</style>
<link rel="stylesheet" href="css/style.css" type="text/css" />
</head>
<body>
<div class="book without-animation with-summary font-size-2 font-family-1" data-basepath=".">
<div class="book-summary">
<nav role="navigation">
<ul class="summary">
<li><a href="./">ODATE</a></li>
<li class="divider"></li>
<li class="chapter" data-level="" data-path="index.html"><a href="index.html"><i class="fa fa-check"></i>notice</a></li>
<li class="chapter" data-level="" data-path="about-the-authors.html"><a href="about-the-authors.html"><i class="fa fa-check"></i>About the Authors</a><ul>
<li class="chapter" data-level="" data-path="about-the-authors.html"><a href="about-the-authors.html#shawn-graham"><i class="fa fa-check"></i>Shawn Graham</a></li>
<li class="chapter" data-level="" data-path="about-the-authors.html"><a href="about-the-authors.html#neha-gupta"><i class="fa fa-check"></i>Neha Gupta</a></li>
<li class="chapter" data-level="" data-path="about-the-authors.html"><a href="about-the-authors.html#michael-carter"><i class="fa fa-check"></i>Michael Carter</a></li>
<li class="chapter" data-level="" data-path="about-the-authors.html"><a href="about-the-authors.html#beth-compton"><i class="fa fa-check"></i>Beth Compton</a></li>
<li class="chapter" data-level="" data-path="about-the-authors.html"><a href="about-the-authors.html#jolene-smith"><i class="fa fa-check"></i>Jolene Smith</a></li>
<li class="chapter" data-level="" data-path="about-the-authors.html"><a href="about-the-authors.html#andreas-angourakis"><i class="fa fa-check"></i>Andreas Angourakis</a></li>
<li class="chapter" data-level="" data-path="about-the-authors.html"><a href="about-the-authors.html#andrew-reinhard"><i class="fa fa-check"></i>Andrew Reinhard</a></li>
<li class="chapter" data-level="" data-path="about-the-authors.html"><a href="about-the-authors.html#kate-ellenberger"><i class="fa fa-check"></i>Kate Ellenberger</a></li>
<li class="chapter" data-level="" data-path="about-the-authors.html"><a href="about-the-authors.html#zack-batist"><i class="fa fa-check"></i>Zack Batist</a></li>
<li class="chapter" data-level="" data-path="about-the-authors.html"><a href="about-the-authors.html#joel-rivard"><i class="fa fa-check"></i>Joel Rivard</a></li>
<li class="chapter" data-level="" data-path="about-the-authors.html"><a href="about-the-authors.html#ben-marwick"><i class="fa fa-check"></i>Ben Marwick</a></li>
<li class="chapter" data-level="" data-path="about-the-authors.html"><a href="about-the-authors.html#rob-blades"><i class="fa fa-check"></i>Rob Blades</a></li>
<li class="chapter" data-level="" data-path="about-the-authors.html"><a href="about-the-authors.html#cristina-wood"><i class="fa fa-check"></i>Cristina Wood</a></li>
<li class="chapter" data-level="" data-path="about-the-authors.html"><a href="about-the-authors.html#editorial-board"><i class="fa fa-check"></i>Editorial Board</a></li>
</ul></li>
<li class="chapter" data-level="" data-path="getting-started.html"><a href="getting-started.html"><i class="fa fa-check"></i>Getting Started</a><ul>
<li class="chapter" data-level="" data-path="instructors-how-to-use-this-text.html"><a href="instructors-how-to-use-this-text.html"><i class="fa fa-check"></i>Instructors: How to use this text</a></li>
<li class="chapter" data-level="" data-path="students-how-to-use-this-text.html"><a href="students-how-to-use-this-text.html"><i class="fa fa-check"></i>Students: How to use this text</a></li>
<li class="chapter" data-level="" data-path="how-to-contribute-changes-or-make-your-own-version.html"><a href="how-to-contribute-changes-or-make-your-own-version.html"><i class="fa fa-check"></i>How to contribute changes, or make your own version</a></li>
<li class="chapter" data-level="" data-path="how-to-access-and-use-the-computational-environment.html"><a href="how-to-access-and-use-the-computational-environment.html"><i class="fa fa-check"></i>How to access and use the computational environment</a></li>
<li class="chapter" data-level="" data-path="colophon.html"><a href="colophon.html"><i class="fa fa-check"></i>Colophon</a></li>
</ul></li>
<li class="chapter" data-level="" data-path="welcome.html"><a href="welcome.html"><i class="fa fa-check"></i>Welcome!</a></li>
<li class="chapter" data-level="1" data-path="going-digital.html"><a href="going-digital.html"><i class="fa fa-check"></i><b>1</b> Going Digital</a><ul>
<li class="chapter" data-level="1.0.1" data-path="going-digital.html"><a href="going-digital.html#further-reading"><i class="fa fa-check"></i><b>1.0.1</b> Further Reading</a></li>
<li class="chapter" data-level="1.1" data-path="so-what-is-digital-archaeology.html"><a href="so-what-is-digital-archaeology.html"><i class="fa fa-check"></i><b>1.1</b> So what is Digital Archaeology?</a><ul>
<li class="chapter" data-level="1.1.1" data-path="so-what-is-digital-archaeology.html"><a href="so-what-is-digital-archaeology.html#a-distant-view"><i class="fa fa-check"></i><b>1.1.1</b> A distant view</a></li>
<li class="chapter" data-level="1.1.2" data-path="so-what-is-digital-archaeology.html"><a href="so-what-is-digital-archaeology.html#is-digital-archaeology-part-of-the-digital-humanities"><i class="fa fa-check"></i><b>1.1.2</b> Is digital archaeology part of the digital humanities?</a></li>
<li class="chapter" data-level="1.1.3" data-path="so-what-is-digital-archaeology.html"><a href="so-what-is-digital-archaeology.html#archaeological-glitch-art"><i class="fa fa-check"></i><b>1.1.3</b> Archaeological Glitch Art</a></li>
<li class="chapter" data-level="1.1.4" data-path="so-what-is-digital-archaeology.html"><a href="so-what-is-digital-archaeology.html#the-cool-factor-and-the-tensions-of-cool"><i class="fa fa-check"></i><b>1.1.4</b> The ‘cool’ factor and the tensions of cool</a></li>
<li class="chapter" data-level="1.1.5" data-path="so-what-is-digital-archaeology.html"><a href="so-what-is-digital-archaeology.html#takeaways"><i class="fa fa-check"></i><b>1.1.5</b> Takeaways</a></li>
<li class="chapter" data-level="1.1.6" data-path="so-what-is-digital-archaeology.html"><a href="so-what-is-digital-archaeology.html#exercises"><i class="fa fa-check"></i><b>1.1.6</b> Exercises</a></li>
</ul></li>
<li class="chapter" data-level="1.2" data-path="project-management-basics.html"><a href="project-management-basics.html"><i class="fa fa-check"></i><b>1.2</b> Project Management Basics</a><ul>
<li class="chapter" data-level="1.2.1" data-path="project-management-basics.html"><a href="project-management-basics.html#take-aways"><i class="fa fa-check"></i><b>1.2.1</b> Take-aways</a></li>
<li class="chapter" data-level="1.2.2" data-path="project-management-basics.html"><a href="project-management-basics.html#exercises-1"><i class="fa fa-check"></i><b>1.2.2</b> exercises</a></li>
</ul></li>
<li class="chapter" data-level="1.3" data-path="github-version-control.html"><a href="github-version-control.html"><i class="fa fa-check"></i><b>1.3</b> Github & Version Control</a><ul>
<li class="chapter" data-level="1.3.1" data-path="github-version-control.html"><a href="github-version-control.html#the-core-functions-of-git"><i class="fa fa-check"></i><b>1.3.1</b> The core functions of Git</a></li>
<li class="chapter" data-level="1.3.2" data-path="github-version-control.html"><a href="github-version-control.html#key-terms"><i class="fa fa-check"></i><b>1.3.2</b> Key Terms</a></li>
<li class="chapter" data-level="1.3.3" data-path="github-version-control.html"><a href="github-version-control.html#take-aways-1"><i class="fa fa-check"></i><b>1.3.3</b> Take-aways</a></li>
<li class="chapter" data-level="1.3.4" data-path="github-version-control.html"><a href="github-version-control.html#further-reading-1"><i class="fa fa-check"></i><b>1.3.4</b> Further Reading</a></li>
<li class="chapter" data-level="1.3.5" data-path="github-version-control.html"><a href="github-version-control.html#exercises-2"><i class="fa fa-check"></i><b>1.3.5</b> Exercises</a></li>
<li class="chapter" data-level="1.3.6" data-path="github-version-control.html"><a href="github-version-control.html#warnings"><i class="fa fa-check"></i><b>1.3.6</b> Warnings</a></li>
</ul></li>
<li class="chapter" data-level="1.4" data-path="open-notebook-research-scholarly-communication.html"><a href="open-notebook-research-scholarly-communication.html"><i class="fa fa-check"></i><b>1.4</b> Open Notebook Research & Scholarly Communication</a><ul>
<li class="chapter" data-level="1.4.1" data-path="open-notebook-research-scholarly-communication.html"><a href="open-notebook-research-scholarly-communication.html#how-to-ask-questions"><i class="fa fa-check"></i><b>1.4.1</b> How to Ask Questions</a></li>
<li class="chapter" data-level="1.4.2" data-path="open-notebook-research-scholarly-communication.html"><a href="open-notebook-research-scholarly-communication.html#discussion"><i class="fa fa-check"></i><b>1.4.2</b> discussion</a></li>
<li class="chapter" data-level="1.4.3" data-path="open-notebook-research-scholarly-communication.html"><a href="open-notebook-research-scholarly-communication.html#take-aways-2"><i class="fa fa-check"></i><b>1.4.3</b> Take-aways</a></li>
<li class="chapter" data-level="1.4.4" data-path="open-notebook-research-scholarly-communication.html"><a href="open-notebook-research-scholarly-communication.html#further-reading-2"><i class="fa fa-check"></i><b>1.4.4</b> Further Reading</a></li>
<li class="chapter" data-level="1.4.5" data-path="open-notebook-research-scholarly-communication.html"><a href="open-notebook-research-scholarly-communication.html#on-privilege-and-open-notebooks"><i class="fa fa-check"></i><b>1.4.5</b> On Privilege and Open Notebooks</a></li>
<li class="chapter" data-level="1.4.6" data-path="open-notebook-research-scholarly-communication.html"><a href="open-notebook-research-scholarly-communication.html#exercises-3"><i class="fa fa-check"></i><b>1.4.6</b> exercises</a></li>
</ul></li>
<li class="chapter" data-level="1.5" data-path="failing-productively.html"><a href="failing-productively.html"><i class="fa fa-check"></i><b>1.5</b> Failing Productively</a><ul>
<li class="chapter" data-level="1.5.1" data-path="failing-productively.html"><a href="failing-productively.html#a-taxonomy-of-fails"><i class="fa fa-check"></i><b>1.5.1</b> A taxonomy of fails</a></li>
<li class="chapter" data-level="1.5.2" data-path="failing-productively.html"><a href="failing-productively.html#exercises-4"><i class="fa fa-check"></i><b>1.5.2</b> Exercises</a></li>
</ul></li>
<li class="chapter" data-level="1.6" data-path="the-ethics-of-big-data-in-archaeology.html"><a href="the-ethics-of-big-data-in-archaeology.html"><i class="fa fa-check"></i><b>1.6</b> The Ethics of Big Data in Archaeology</a><ul>
<li class="chapter" data-level="1.6.1" data-path="the-ethics-of-big-data-in-archaeology.html"><a href="the-ethics-of-big-data-in-archaeology.html#exercises-5"><i class="fa fa-check"></i><b>1.6.1</b> exercises</a></li>
</ul></li>
<li class="chapter" data-level="1.7" data-path="effective-collaboration.html"><a href="effective-collaboration.html"><i class="fa fa-check"></i><b>1.7</b> Effective Collaboration</a><ul>
<li class="chapter" data-level="1.7.1" data-path="effective-collaboration.html"><a href="effective-collaboration.html#the-two-sentence-pitch"><i class="fa fa-check"></i><b>1.7.1</b> The Two-Sentence Pitch</a></li>
<li class="chapter" data-level="1.7.2" data-path="effective-collaboration.html"><a href="effective-collaboration.html#consulting-colleagues-and-stakeholders"><i class="fa fa-check"></i><b>1.7.2</b> Consulting Colleagues and Stakeholders</a></li>
<li class="chapter" data-level="1.7.3" data-path="effective-collaboration.html"><a href="effective-collaboration.html#making-a-plan"><i class="fa fa-check"></i><b>1.7.3</b> Making a Plan</a></li>
<li class="chapter" data-level="1.7.4" data-path="effective-collaboration.html"><a href="effective-collaboration.html#persisting-and-adapting-your-plan"><i class="fa fa-check"></i><b>1.7.4</b> Persisting and Adapting your Plan</a></li>
<li class="chapter" data-level="1.7.5" data-path="effective-collaboration.html"><a href="effective-collaboration.html#exercises-6"><i class="fa fa-check"></i><b>1.7.5</b> Exercises</a></li>
</ul></li>
</ul></li>
<li class="chapter" data-level="2" data-path="making-data-useful.html"><a href="making-data-useful.html"><i class="fa fa-check"></i><b>2</b> Making Data Useful</a><ul>
<li class="chapter" data-level="2.1" data-path="proper-prior-planning.html"><a href="proper-prior-planning.html"><i class="fa fa-check"></i><b>2.1</b> Proper Prior Planning</a><ul>
<li class="chapter" data-level="2.1.1" data-path="proper-prior-planning.html"><a href="proper-prior-planning.html#making-data-sensible-pre-planning"><i class="fa fa-check"></i><b>2.1.1</b> Making Data Sensible: Pre-Planning</a></li>
<li class="chapter" data-level="2.1.2" data-path="proper-prior-planning.html"><a href="proper-prior-planning.html#making-data-durable-preservation-and-longevity"><i class="fa fa-check"></i><b>2.1.2</b> Making Data Durable: Preservation and Longevity</a></li>
<li class="chapter" data-level="2.1.3" data-path="proper-prior-planning.html"><a href="proper-prior-planning.html#takeaways-1"><i class="fa fa-check"></i><b>2.1.3</b> Takeaways</a></li>
<li class="chapter" data-level="2.1.4" data-path="proper-prior-planning.html"><a href="proper-prior-planning.html#further-reading-3"><i class="fa fa-check"></i><b>2.1.4</b> Further Reading</a></li>
</ul></li>
<li class="chapter" data-level="2.2" data-path="designing-data-collection-and-curation.html"><a href="designing-data-collection-and-curation.html"><i class="fa fa-check"></i><b>2.2</b> Designing Data Collection and Curation</a><ul>
<li class="chapter" data-level="2.2.1" data-path="designing-data-collection-and-curation.html"><a href="designing-data-collection-and-curation.html#takeaways-2"><i class="fa fa-check"></i><b>2.2.1</b> Takeaways</a></li>
<li class="chapter" data-level="2.2.2" data-path="designing-data-collection-and-curation.html"><a href="designing-data-collection-and-curation.html#further-reading-4"><i class="fa fa-check"></i><b>2.2.2</b> Further Reading</a></li>
</ul></li>
<li class="chapter" data-level="2.3" data-path="cleaning-data.html"><a href="cleaning-data.html"><i class="fa fa-check"></i><b>2.3</b> Cleaning Data</a><ul>
<li class="chapter" data-level="2.3.1" data-path="cleaning-data.html"><a href="cleaning-data.html#tools"><i class="fa fa-check"></i><b>2.3.1</b> Tools</a></li>
<li class="chapter" data-level="2.3.2" data-path="cleaning-data.html"><a href="cleaning-data.html#cleaning-tasks"><i class="fa fa-check"></i><b>2.3.2</b> Cleaning Tasks</a></li>
<li class="chapter" data-level="2.3.3" data-path="cleaning-data.html"><a href="cleaning-data.html#takeaways-3"><i class="fa fa-check"></i><b>2.3.3</b> Takeaways</a></li>
<li class="chapter" data-level="2.3.4" data-path="cleaning-data.html"><a href="cleaning-data.html#further-reading-5"><i class="fa fa-check"></i><b>2.3.4</b> Further Reading</a></li>
</ul></li>
<li class="chapter" data-level="2.4" data-path="arranging-and-storing-data-for-the-long-haul-databases.html"><a href="arranging-and-storing-data-for-the-long-haul-databases.html"><i class="fa fa-check"></i><b>2.4</b> Arranging and Storing Data for the Long Haul (Databases!)</a><ul>
<li class="chapter" data-level="" data-path="arranging-and-storing-data-for-the-long-haul-databases.html"><a href="arranging-and-storing-data-for-the-long-haul-databases.html#flat-tables"><i class="fa fa-check"></i>Flat tables</a></li>
<li class="chapter" data-level="2.4.1" data-path="arranging-and-storing-data-for-the-long-haul-databases.html"><a href="arranging-and-storing-data-for-the-long-haul-databases.html#takeaways-4"><i class="fa fa-check"></i><b>2.4.1</b> Takeaways</a></li>
<li class="chapter" data-level="2.4.2" data-path="arranging-and-storing-data-for-the-long-haul-databases.html"><a href="arranging-and-storing-data-for-the-long-haul-databases.html#further-reading-6"><i class="fa fa-check"></i><b>2.4.2</b> Further Reading</a></li>
<li class="chapter" data-level="2.4.3" data-path="arranging-and-storing-data-for-the-long-haul-databases.html"><a href="arranging-and-storing-data-for-the-long-haul-databases.html#exercises-7"><i class="fa fa-check"></i><b>2.4.3</b> Exercises</a></li>
</ul></li>
<li class="chapter" data-level="2.5" data-path="linked-open-data-and-data-publishing.html"><a href="linked-open-data-and-data-publishing.html"><i class="fa fa-check"></i><b>2.5</b> Linked Open Data and Data Publishing</a></li>
<li class="chapter" data-level="2.6" data-path="using-application-programming-interfaces-apis-to-retrieve-data.html"><a href="using-application-programming-interfaces-apis-to-retrieve-data.html"><i class="fa fa-check"></i><b>2.6</b> Using Application Programming Interfaces (APIS) to Retrieve Data</a><ul>
<li class="chapter" data-level="2.6.1" data-path="using-application-programming-interfaces-apis-to-retrieve-data.html"><a href="using-application-programming-interfaces-apis-to-retrieve-data.html#exercises-8"><i class="fa fa-check"></i><b>2.6.1</b> Exercises</a></li>
</ul></li>
<li class="chapter" data-level="2.7" data-path="scraping-data.html"><a href="scraping-data.html"><i class="fa fa-check"></i><b>2.7</b> Scraping Data</a><ul>
<li class="chapter" data-level="2.7.1" data-path="scraping-data.html"><a href="scraping-data.html#exercises-9"><i class="fa fa-check"></i><b>2.7.1</b> Exercises</a></li>
</ul></li>
</ul></li>
<li class="chapter" data-level="3" data-path="finding-and-communicating-the-compelling-story.html"><a href="finding-and-communicating-the-compelling-story.html"><i class="fa fa-check"></i><b>3</b> Finding and Communicating the Compelling Story</a><ul>
<li class="chapter" data-level="3.1" data-path="designing-for-accessibility.html"><a href="designing-for-accessibility.html"><i class="fa fa-check"></i><b>3.1</b> Designing for Accessibility</a><ul>
<li class="chapter" data-level="3.1.1" data-path="designing-for-accessibility.html"><a href="designing-for-accessibility.html#screen-readers-text-browsers-html-labels-and-headings"><i class="fa fa-check"></i><b>3.1.1</b> Screen Readers, Text Browsers, HTML Labels, and Headings</a></li>
<li class="chapter" data-level="3.1.2" data-path="designing-for-accessibility.html"><a href="designing-for-accessibility.html#contrast-and-styles"><i class="fa fa-check"></i><b>3.1.2</b> Contrast and Styles</a></li>
<li class="chapter" data-level="3.1.3" data-path="designing-for-accessibility.html"><a href="designing-for-accessibility.html#font"><i class="fa fa-check"></i><b>3.1.3</b> Font</a></li>
<li class="chapter" data-level="3.1.4" data-path="designing-for-accessibility.html"><a href="designing-for-accessibility.html#going-forward"><i class="fa fa-check"></i><b>3.1.4</b> Going Forward</a></li>
<li class="chapter" data-level="3.1.5" data-path="designing-for-accessibility.html"><a href="designing-for-accessibility.html#exercises-10"><i class="fa fa-check"></i><b>3.1.5</b> Exercises</a></li>
<li class="chapter" data-level="3.1.6" data-path="designing-for-accessibility.html"><a href="designing-for-accessibility.html#further-reading-7"><i class="fa fa-check"></i><b>3.1.6</b> Further Reading</a></li>
</ul></li>
<li class="chapter" data-level="3.2" data-path="statistical-computing-with-r-and-python-notebooks-reproducible-code.html"><a href="statistical-computing-with-r-and-python-notebooks-reproducible-code.html"><i class="fa fa-check"></i><b>3.2</b> Statistical Computing with R and Python Notebooks; Reproducible code</a><ul>
<li class="chapter" data-level="3.2.1" data-path="statistical-computing-with-r-and-python-notebooks-reproducible-code.html"><a href="statistical-computing-with-r-and-python-notebooks-reproducible-code.html#reproducible-methods"><i class="fa fa-check"></i><b>3.2.1</b> Reproducible Methods</a></li>
<li class="chapter" data-level="3.2.2" data-path="statistical-computing-with-r-and-python-notebooks-reproducible-code.html"><a href="statistical-computing-with-r-and-python-notebooks-reproducible-code.html#exercises-11"><i class="fa fa-check"></i><b>3.2.2</b> exercises</a></li>
</ul></li>
<li class="chapter" data-level="3.3" data-path="data-driven-documents.html"><a href="data-driven-documents.html"><i class="fa fa-check"></i><b>3.3</b> Data Driven Documents</a><ul>
<li class="chapter" data-level="3.3.1" data-path="data-driven-documents.html"><a href="data-driven-documents.html#d3"><i class="fa fa-check"></i><b>3.3.1</b> D3</a></li>
<li class="chapter" data-level="3.3.2" data-path="data-driven-documents.html"><a href="data-driven-documents.html#discussion-1"><i class="fa fa-check"></i><b>3.3.2</b> discussion</a></li>
<li class="chapter" data-level="3.3.3" data-path="data-driven-documents.html"><a href="data-driven-documents.html#exercises-12"><i class="fa fa-check"></i><b>3.3.3</b> exercises</a></li>
</ul></li>
<li class="chapter" data-level="3.4" data-path="storytelling-and-the-archaeological-cms-omeka-kora-and-mukurtu.html"><a href="storytelling-and-the-archaeological-cms-omeka-kora-and-mukurtu.html"><i class="fa fa-check"></i><b>3.4</b> Storytelling and the Archaeological CMS: Omeka, Kora, and Mukurtu</a><ul>
<li class="chapter" data-level="3.4.1" data-path="storytelling-and-the-archaeological-cms-omeka-kora-and-mukurtu.html"><a href="storytelling-and-the-archaeological-cms-omeka-kora-and-mukurtu.html#the-content-management-system"><i class="fa fa-check"></i><b>3.4.1</b> The Content Management System</a></li>
<li class="chapter" data-level="3.4.2" data-path="storytelling-and-the-archaeological-cms-omeka-kora-and-mukurtu.html"><a href="storytelling-and-the-archaeological-cms-omeka-kora-and-mukurtu.html#omeka"><i class="fa fa-check"></i><b>3.4.2</b> Omeka</a></li>
<li class="chapter" data-level="3.4.3" data-path="storytelling-and-the-archaeological-cms-omeka-kora-and-mukurtu.html"><a href="storytelling-and-the-archaeological-cms-omeka-kora-and-mukurtu.html#kora"><i class="fa fa-check"></i><b>3.4.3</b> Kora</a></li>
<li class="chapter" data-level="3.4.4" data-path="storytelling-and-the-archaeological-cms-omeka-kora-and-mukurtu.html"><a href="storytelling-and-the-archaeological-cms-omeka-kora-and-mukurtu.html#mukurtu"><i class="fa fa-check"></i><b>3.4.4</b> Mukurtu</a></li>
<li class="chapter" data-level="3.4.5" data-path="storytelling-and-the-archaeological-cms-omeka-kora-and-mukurtu.html"><a href="storytelling-and-the-archaeological-cms-omeka-kora-and-mukurtu.html#exercises-13"><i class="fa fa-check"></i><b>3.4.5</b> Exercises</a></li>
</ul></li>
<li class="chapter" data-level="3.5" data-path="what-is-web-mapping.html"><a href="what-is-web-mapping.html"><i class="fa fa-check"></i><b>3.5</b> What is Web Mapping?</a><ul>
<li class="chapter" data-level="3.5.1" data-path="what-is-web-mapping.html"><a href="what-is-web-mapping.html#overview-of-map-services"><i class="fa fa-check"></i><b>3.5.1</b> Overview of Map Services</a></li>
<li class="chapter" data-level="3.5.2" data-path="what-is-web-mapping.html"><a href="what-is-web-mapping.html#making-a-web-map-with-leaflet"><i class="fa fa-check"></i><b>3.5.2</b> Making a web map with Leaflet</a></li>
<li class="chapter" data-level="3.5.3" data-path="what-is-web-mapping.html"><a href="what-is-web-mapping.html#exercises-14"><i class="fa fa-check"></i><b>3.5.3</b> Exercises</a></li>
<li class="chapter" data-level="3.5.4" data-path="what-is-web-mapping.html"><a href="what-is-web-mapping.html#resources"><i class="fa fa-check"></i><b>3.5.4</b> Resources</a></li>
</ul></li>
<li class="chapter" data-level="3.6" data-path="virtual-archaeology.html"><a href="virtual-archaeology.html"><i class="fa fa-check"></i><b>3.6</b> Virtual Archaeology</a><ul>
<li class="chapter" data-level="3.6.1" data-path="virtual-archaeology.html"><a href="virtual-archaeology.html#basic-principles"><i class="fa fa-check"></i><b>3.6.1</b> Basic principles</a></li>
<li class="chapter" data-level="3.6.2" data-path="virtual-archaeology.html"><a href="virtual-archaeology.html#main-challenge"><i class="fa fa-check"></i><b>3.6.2</b> Main Challenge</a></li>
<li class="chapter" data-level="3.6.3" data-path="virtual-archaeology.html"><a href="virtual-archaeology.html#the-archaeological-narrative"><i class="fa fa-check"></i><b>3.6.3</b> The Archaeological Narrative</a></li>
<li class="chapter" data-level="3.6.4" data-path="virtual-archaeology.html"><a href="virtual-archaeology.html#theoretical-pragmatism"><i class="fa fa-check"></i><b>3.6.4</b> Theoretical Pragmatism</a></li>
<li class="chapter" data-level="3.6.5" data-path="virtual-archaeology.html"><a href="virtual-archaeology.html#phenomenology-and-virtual-archaeology"><i class="fa fa-check"></i><b>3.6.5</b> Phenomenology and Virtual Archaeology</a></li>
<li class="chapter" data-level="3.6.6" data-path="virtual-archaeology.html"><a href="virtual-archaeology.html#lasting-considerations"><i class="fa fa-check"></i><b>3.6.6</b> Lasting Considerations</a></li>
<li class="chapter" data-level="3.6.7" data-path="virtual-archaeology.html"><a href="virtual-archaeology.html#exercises-15"><i class="fa fa-check"></i><b>3.6.7</b> Exercises</a></li>
</ul></li>
<li class="chapter" data-level="3.7" data-path="archaeogaming.html"><a href="archaeogaming.html"><i class="fa fa-check"></i><b>3.7</b> Archaeogaming</a><ul>
<li class="chapter" data-level="3.7.1" data-path="archaeogaming.html"><a href="archaeogaming.html#archaeological-reception"><i class="fa fa-check"></i><b>3.7.1</b> Archaeological Reception</a></li>
<li class="chapter" data-level="3.7.2" data-path="archaeogaming.html"><a href="archaeogaming.html#games-as-archaeology"><i class="fa fa-check"></i><b>3.7.2</b> Games as Archaeology</a></li>
<li class="chapter" data-level="3.7.3" data-path="archaeogaming.html"><a href="archaeogaming.html#archaeogaming-projects-past-and-present"><i class="fa fa-check"></i><b>3.7.3</b> Archaeogaming Projects Past and Present</a></li>
<li class="chapter" data-level="3.7.4" data-path="archaeogaming.html"><a href="archaeogaming.html#is-archaeogaming-archaeology-a-future-of-the-discipline."><i class="fa fa-check"></i><b>3.7.4</b> Is Archaeogaming Archaeology? A Future of the Discipline.</a></li>
<li class="chapter" data-level="3.7.5" data-path="archaeogaming.html"><a href="archaeogaming.html#exercises-16"><i class="fa fa-check"></i><b>3.7.5</b> Exercises</a></li>
<li class="chapter" data-level="3.7.6" data-path="archaeogaming.html"><a href="archaeogaming.html#further-reading-8"><i class="fa fa-check"></i><b>3.7.6</b> Further Reading</a></li>
</ul></li>
<li class="chapter" data-level="3.8" data-path="social-media-as-public-engagement-scholarly-communication-in-archaeology.html"><a href="social-media-as-public-engagement-scholarly-communication-in-archaeology.html"><i class="fa fa-check"></i><b>3.8</b> Social Media as Public Engagement & Scholarly Communication in Archaeology</a><ul>
<li class="chapter" data-level="3.8.1" data-path="social-media-as-public-engagement-scholarly-communication-in-archaeology.html"><a href="social-media-as-public-engagement-scholarly-communication-in-archaeology.html#social-media-as-outreach"><i class="fa fa-check"></i><b>3.8.1</b> Social Media as Outreach</a></li>
<li class="chapter" data-level="3.8.2" data-path="social-media-as-public-engagement-scholarly-communication-in-archaeology.html"><a href="social-media-as-public-engagement-scholarly-communication-in-archaeology.html#social-media-to-keep-current-on-research"><i class="fa fa-check"></i><b>3.8.2</b> Social Media to Keep Current on Research</a></li>
<li class="chapter" data-level="3.8.3" data-path="social-media-as-public-engagement-scholarly-communication-in-archaeology.html"><a href="social-media-as-public-engagement-scholarly-communication-in-archaeology.html#four-moves-or-getting-at-the-truth"><i class="fa fa-check"></i><b>3.8.3</b> Four Moves, or, Getting at the Truth</a></li>
<li class="chapter" data-level="3.8.4" data-path="social-media-as-public-engagement-scholarly-communication-in-archaeology.html"><a href="social-media-as-public-engagement-scholarly-communication-in-archaeology.html#exercises-17"><i class="fa fa-check"></i><b>3.8.4</b> exercises</a></li>
</ul></li>
<li class="chapter" data-level="3.9" data-path="computational-creativity.html"><a href="computational-creativity.html"><i class="fa fa-check"></i><b>3.9</b> Computational Creativity</a><ul>
<li class="chapter" data-level="3.9.1" data-path="computational-creativity.html"><a href="computational-creativity.html#twitterbots-with-tracery"><i class="fa fa-check"></i><b>3.9.1</b> Twitterbots with Tracery</a></li>
<li class="chapter" data-level="3.9.2" data-path="computational-creativity.html"><a href="computational-creativity.html#chatbots"><i class="fa fa-check"></i><b>3.9.2</b> Chatbots</a></li>
<li class="chapter" data-level="3.9.3" data-path="computational-creativity.html"><a href="computational-creativity.html#sonification"><i class="fa fa-check"></i><b>3.9.3</b> Sonification</a></li>
<li class="chapter" data-level="3.9.4" data-path="computational-creativity.html"><a href="computational-creativity.html#worldbuilding"><i class="fa fa-check"></i><b>3.9.4</b> Worldbuilding</a></li>
</ul></li>
</ul></li>
<li class="chapter" data-level="4" data-path="eliding-the-digital-and-the-physical.html"><a href="eliding-the-digital-and-the-physical.html"><i class="fa fa-check"></i><b>4</b> Eliding the Digital and the Physical</a><ul>
<li class="chapter" data-level="4.1" data-path="d-photogrammetry.html"><a href="d-photogrammetry.html"><i class="fa fa-check"></i><b>4.1</b> 3D Photogrammetry</a><ul>
<li class="chapter" data-level="4.1.1" data-path="d-photogrammetry.html"><a href="d-photogrammetry.html#basic-principles-1"><i class="fa fa-check"></i><b>4.1.1</b> Basic principles</a></li>
<li class="chapter" data-level="4.1.2" data-path="d-photogrammetry.html"><a href="d-photogrammetry.html#further-readings"><i class="fa fa-check"></i><b>4.1.2</b> Further Readings</a></li>
<li class="chapter" data-level="4.1.3" data-path="d-photogrammetry.html"><a href="d-photogrammetry.html#exercises-19"><i class="fa fa-check"></i><b>4.1.3</b> exercises</a></li>
</ul></li>
<li class="chapter" data-level="4.2" data-path="d-printing-raspberry-pi-and-maker-archaeology.html"><a href="d-printing-raspberry-pi-and-maker-archaeology.html"><i class="fa fa-check"></i><b>4.2</b> 3D Printing, Raspberry Pi and “Maker” Archaeology</a><ul>
<li class="chapter" data-level="4.2.1" data-path="d-printing-raspberry-pi-and-maker-archaeology.html"><a href="d-printing-raspberry-pi-and-maker-archaeology.html#overview"><i class="fa fa-check"></i><b>4.2.1</b> Overview</a></li>
<li class="chapter" data-level="4.2.2" data-path="d-printing-raspberry-pi-and-maker-archaeology.html"><a href="d-printing-raspberry-pi-and-maker-archaeology.html#d-printing---a-workflow"><i class="fa fa-check"></i><b>4.2.2</b> 3d Printing - a Workflow</a></li>
<li class="chapter" data-level="4.2.3" data-path="d-printing-raspberry-pi-and-maker-archaeology.html"><a href="d-printing-raspberry-pi-and-maker-archaeology.html#using-raspberry-pi-in-the-field"><i class="fa fa-check"></i><b>4.2.3</b> Using Raspberry Pi in the Field</a></li>
<li class="chapter" data-level="4.2.4" data-path="d-printing-raspberry-pi-and-maker-archaeology.html"><a href="d-printing-raspberry-pi-and-maker-archaeology.html#discussion-2"><i class="fa fa-check"></i><b>4.2.4</b> Discussion</a></li>
<li class="chapter" data-level="4.2.5" data-path="d-printing-raspberry-pi-and-maker-archaeology.html"><a href="d-printing-raspberry-pi-and-maker-archaeology.html#further-reading-9"><i class="fa fa-check"></i><b>4.2.5</b> Further Reading</a></li>
</ul></li>
<li class="chapter" data-level="4.3" data-path="place-based-interpretation-with-locative-augmented-reality.html"><a href="place-based-interpretation-with-locative-augmented-reality.html"><i class="fa fa-check"></i><b>4.3</b> Place-based Interpretation with Locative Augmented Reality</a><ul>
<li class="chapter" data-level="4.3.1" data-path="place-based-interpretation-with-locative-augmented-reality.html"><a href="place-based-interpretation-with-locative-augmented-reality.html#projection-mapping"><i class="fa fa-check"></i><b>4.3.1</b> Projection Mapping</a></li>
<li class="chapter" data-level="4.3.2" data-path="place-based-interpretation-with-locative-augmented-reality.html"><a href="place-based-interpretation-with-locative-augmented-reality.html#exercises-20"><i class="fa fa-check"></i><b>4.3.2</b> exercises</a></li>
</ul></li>
<li class="chapter" data-level="4.4" data-path="artificial-intelligence-in-digital-archaeology.html"><a href="artificial-intelligence-in-digital-archaeology.html"><i class="fa fa-check"></i><b>4.4</b> Artificial Intelligence in Digital Archaeology</a><ul>
<li class="chapter" data-level="4.4.1" data-path="artificial-intelligence-in-digital-archaeology.html"><a href="artificial-intelligence-in-digital-archaeology.html#agent-based-modeling-abm"><i class="fa fa-check"></i><b>4.4.1</b> Agent-based modeling (ABM)</a></li>
</ul></li>
<li class="chapter" data-level="4.5" data-path="computer-vision-and-archaeology.html"><a href="computer-vision-and-archaeology.html"><i class="fa fa-check"></i><b>4.5</b> Computer Vision and Archaeology</a><ul>
<li class="chapter" data-level="4.5.1" data-path="computer-vision-and-archaeology.html"><a href="computer-vision-and-archaeology.html#convolutional-neural-networks"><i class="fa fa-check"></i><b>4.5.1</b> Convolutional Neural Networks</a></li>
<li class="chapter" data-level="4.5.2" data-path="computer-vision-and-archaeology.html"><a href="computer-vision-and-archaeology.html#applications"><i class="fa fa-check"></i><b>4.5.2</b> Applications</a></li>
<li class="chapter" data-level="4.5.3" data-path="computer-vision-and-archaeology.html"><a href="computer-vision-and-archaeology.html#exercises-21"><i class="fa fa-check"></i><b>4.5.3</b> Exercises</a></li>
</ul></li>
</ul></li>
<li class="chapter" data-level="5" data-path="digital-archaeologys-place-in-the-world.html"><a href="digital-archaeologys-place-in-the-world.html"><i class="fa fa-check"></i><b>5</b> Digital Archaeology’s Place in the World</a><ul>
<li class="chapter" data-level="5.1" data-path="marketing-digital-archaeology.html"><a href="marketing-digital-archaeology.html"><i class="fa fa-check"></i><b>5.1</b> Marketing Digital Archaeology</a></li>
<li class="chapter" data-level="5.2" data-path="sustainability-power-in-digital-archaeology.html"><a href="sustainability-power-in-digital-archaeology.html"><i class="fa fa-check"></i><b>5.2</b> Sustainability & Power in Digital Archaeology</a><ul>
<li class="chapter" data-level="5.2.1" data-path="sustainability-power-in-digital-archaeology.html"><a href="sustainability-power-in-digital-archaeology.html#exercises-22"><i class="fa fa-check"></i><b>5.2.1</b> exercises</a></li>
</ul></li>
</ul></li>
<li class="chapter" data-level="6" data-path="on-the-horizons-where-digital-archaeology-might-go-next.html"><a href="on-the-horizons-where-digital-archaeology-might-go-next.html"><i class="fa fa-check"></i><b>6</b> On the Horizons: Where Digital Archaeology Might Go Next</a></li>
<li class="chapter" data-level="" data-path="references.html"><a href="references.html"><i class="fa fa-check"></i>References</a></li>
<li class="divider"></li>
<li><a href="https://creativecommons.org/licenses/by/4.0/" target="blank">CC-BY 4.0</a></li>
<li><a href="https://github.com/rstudio/bookdown" target="blank">Made with bookdown</a></li>
<li><a href="https://www.ecampusontario.ca/" target="blank">Funded by EcampusOntario</a></li>
</ul>
</nav>
</div>
<div class="book-body">
<div class="body-inner">
<div class="book-header" role="navigation">
<h1>
<i class="fa fa-circle-o-notch fa-spin"></i><a href="./">The Open Digital Archaeology Textbook</a>
</h1>
</div>
<div class="page-wrapper" tabindex="-1" role="main">
<div class="page-inner">
<section class="normal" id="section-">
<div id="d-printing-raspberry-pi-and-maker-archaeology" class="section level2">
<h2><span class="header-section-number">4.2</span> 3D Printing, Raspberry Pi and “Maker” Archaeology</h2>
<div class="rmdcaution">
<em>This section is under development</em>.
</div>
<div id="overview" class="section level3">
<h3><span class="header-section-number">4.2.1</span> Overview</h3>
<p>A ‘maker’ approach, in general terms, is a creative process of on-the-fly craftwork that involves learning and contributing towards the development of neat things. It’s an inclusive, community driven movement that recognizes the capabilities for anyone to learn or do anything (but never everything!). Makers share their tools and experiences through direct dialogue and by making alongside others, by posting code and resources online in accessible formats, and by nurturing open and supportive ecosystems of information exchange. Failing is considered to be part of making by providing unique opportunities to learn from.</p>
<p>Although making often involves digital technology, it’s incredibly open-ended. Crafts like pottery, needlework, mushroom foraging, birdwatching, woodworking, improv entertainment and even archaeological excavation subscribe to similar tenets, and sometimes cross-pollinate with computer tech in fun and functional ways. In this chapter we guide the reader through the use of 3D printing and Raspberry Pi microcomputers in an open-ended way, enabling you to continue on with this work on your own and apply what you learn in various circumstances.</p>
</div>
<div id="d-printing---a-workflow" class="section level3">
<h3><span class="header-section-number">4.2.2</span> 3d Printing - a Workflow</h3>
<p>In the workflow described below, it is entirely possible to 3d print a wide variety of data that are not, strictly speaking ‘3d’ in the sense of existing in three dimensions in the ‘real world’. For instance, one could extract the hue, colour, and saturation values of a collection of site photographs and 3d print an object that represents several hundred photographs as a surface where x = hue, y = colour, and z = saturation.</p>
<div class="figure">
<img src="images/9000images3dspace.jpg" alt="Hue, color, and saturation values for 9000 images depicting human remains for sale collected from Instagram" />
<p class="caption">Hue, color, and saturation values for 9000 images depicting human remains for sale collected from Instagram</p>
</div>
<p>Users will obtain values for x,y,z and represent those values as points using the values from x,y. The z value will remain in the attribute table and will be used later. Once the points are represented in x,y space, we’ll create a digital elevation model (DEM). This essentially will take the x,y points and interpolate or mathematically guess all of the values between the points while assigning a pixel value to each location from the z attribute table. Typically this z value represents elevation (hence the name of the DEM), but this is typically colour coded in various shades of grey/black/white. The last step will be to use a tool in <a href="https://www.qgis.org/en/site/">QGIS</a> to convert the DEM to an STL file, which is a standard 3d object file format that is used for makerbot. This will create the 3D object, which can then be printed using the 3D printer.</p>
<p>Let’s walk through the process.</p>
<p>You have data values that you’d like represent in a 3D space. To display values into 3D space, you’ll need values inputed in x,y and z. x,y will represent your data in a 2D space, while the addition of the z value will add the 3rd dimension. The method outlined below is typically done to display geographic data, but it can also be used with other types of data. The method below will use non-geographic data to create a 3D object file.</p>
<p>The software used in this workflow is QGIS. QGIS is a free open source desktop geographic information systems (GIS) application that allows users to view, edit and analyze geographic information. Users can <a href="http://www.qgis.org/en/site/forusers/download.html" title="download">download the tool for Windows, MAC OS X or Linux at the following website.</a> The workflow below was done using QGIS 2.14.</p>
<div id="create-a-point-shapefile" class="section level4">
<h4><span class="header-section-number">4.2.2.1</span> Create a point shapefile</h4>
<ol style="list-style-type: decimal">
<li>Collect or ensure that you have a comma-separated file (.csv) with values of x,y,z. This is displayed in a text editor, but it can also be viewed as tabular data.</li>
</ol>
<p><img src="images/joelcsv.png" alt="Comma seperated values" />.</p>
<ol start="2" style="list-style-type: decimal">
<li>Open QGIS and in the menu, click on Layer > Add Layer > Add delimited text layer… This will allow us to add our .csv file in QGIS</li>
</ol>
<p><img src="images/joelimportcsv.png" alt="Add delimited layer" />.</p>
<p>You should now see some points displayed in QGIS. You’ll notice in the layers panel on the left that there is a point file. This point file is considered to be a vector feature with its geometry represented as a point. If you can’t see the Layers Panel, select in the menu View > Panels > Layers Panel. In the layers Panel, turn the layer on/off by clicking on the box next to it. Keep in mind that this point file is only temporary and should now be saved properly.</p>
<ol start="3" style="list-style-type: decimal">
<li><p>In the Layers Panel, right click on the file and select Save as… and change to the settings as outlined in the screenshot. Ensure that you change the CRS to EPSG 3857 WGS 84 / Pseudo Mercator.</p></li>
<li><p>In the Layers Panel, remove the temporary point file by right clicking on the file and clicking remove. You’ll want to have only the pointfilepseudo in the Layers Panel.</p></li>
</ol>
<p>Your data is now viewed in 2D space and represented as points. Each point (x,y) has a z value associated to it, even if we can’t see it. You can view this z value by clicking on identify tool in QGIS and then clicking on a point. The underlying attribute table will appear, indicating the value of x,y and most importantly the z.</p>
</div>
<div id="create-a-digital-elevation-model" class="section level4">
<h4><span class="header-section-number">4.2.2.2</span> Create a Digital Elevation Model</h4>
<p>Our next step is to fill in the gaps between the points. To do so, we’ll convert the vector point geometry to raster pixels while we use interpolation tools in QGIS to do this. This is quite common in a GIS software, where users attempt to interpolate the elevation of the area with use the spot height points. The output product from this operation is called a digital elevation model (DEM).</p>
<ol style="list-style-type: decimal">
<li>In QGIS, click on View > Panels > Toolbox. This will open up the Processing Toolbox window on the right. We’ll be using one of the interpolation tools from this toolbox to create our Digital Elevation Model (DEM).</li>
<li>In the search box, type v.surf. This will bring up various interpolation tools that can be used for your interpolation with the use of GRASS tools. GRASS (Geographic Resources Analysis Support System) are open source tools that can be used in QGIS or as a standalone application. In this case, we’re using the GRASS tools in QGIS.</li>
<li>Double click on the v.surf.idw - surface interpolation by…The idw in this particular case refers to the interpolate method of Inverse-Distance Weighted. This method essentially gives less weight to known points that are furthest when trying to interpolate values.</li>
<li>Fill in the information as seen in the screenshot. The algorithm will process and your output will be added to the Layers Panel.</li>
</ol>
<p>You’ll see various shades of grey/black/white sections when looking at the DEM raster in QGIS. Each shade of grey represents a different value of z.</p>
</div>
<div id="create-a-3d-object-.stl" class="section level4">
<h4><span class="header-section-number">4.2.2.3</span> Create a 3D object (.stl)</h4>
<p>For 3D printing, users must have specific file formats. An .obj or .stl are some of the common formats that can be used to create 3D models. Meshlab is a free tool that can be used to view and convert between multiple types of 3D object formats. In our particular case, we’ll be printing our final 3D object on a makerbot printer. We’ll need the file format to be in .stl. Luckily for us, QGIS can export directly from a DEM to STL file.</p>
<ol style="list-style-type: decimal">
<li>In QGIS, click plugins > Manage and Install Plugins…</li>
<li>In the search box, type DEMto3d. This should bring up the plugin that’s required for our conversion. Click on the plugin and install it. Exit the plugins menu when complete.</li>
<li>In the QGIS menu, click on Raster > DEMto3D > DEM 3D Printing. Select the InterpolateIDW layer and the remainder of the settings as outlined in the screenshot below. Once complete, click on Export to STL. Once prompted to save the file, select the appropriate directory.</li>
</ol>
</div>
<div id="print-3d-object-or-create-ar" class="section level4">
<h4><span class="header-section-number">4.2.2.4</span> Print 3D object or create AR</h4>
<p>This will export an stl file that is rather large in file size. This stl file can be used to print a 3D representation of the model or can be used to view the model as an augmented reality object.</p>
</div>
</div>
<div id="using-raspberry-pi-in-the-field" class="section level3">
<h3><span class="header-section-number">4.2.3</span> Using Raspberry Pi in the Field</h3>
<p>Archaeology is an inherently collaborative process that happens in various places simulataneously. It is therefore often challening to ensure that archaeological databases, which serve to store and organize inter-related information obtained through various methods and practices, are kept up to date and syncronized across research environments. In order to deal with these challenges it might be necessary to set up a database hosted on a network, which would enable multiple users to simultaneously engage with the database while ensuring that the data remains orderly and complete.</p>
<p>In order to implement such a system we need to set up a network, set up a server, set up a database along with user-friendly interfaces, and ensure that the system is aligned with and contributes positively to the goals of the overall project.</p>
<p>The system that we’re going to build will look something like this: <img src="images/DIYDatabaseDiagram.png" alt="DIY Fieldwork Database Diagram" /></p>
<p>It consists of: - a local network generated and managed by a wireless router - a Raspberri Pi mini-computer upon which the database will reside and be served to other devices across the network - the software configured to host the database and ensure that the data is secured and backed up - user interfaces that talk to the database and that encourage desired user behaviour - other useful services such as a file sharing server and data visualization portal that may help encourage collaborative and informed research</p>
<p>The system that we’re going to build may be suitable for some, but not for others. It is therefore important to remember that this all requires some degree of flexibility so that what you make suits the overall goals of the project you’re contributing to. So you may copy these instructions directly or tinker around to suit your needs!</p>
<p><strong>Some Notes on Hardware:</strong> This is meant to be a very portable, low energy use and inexpensive setup. While I recommend that you use a dedicated server - a computer that is configured to run the database server, and only the database server - you can actually host the database on a regular laptop that you also serves as the client. I will be including notes on how to configure this to work all on one device, but I recommend that you use this kind of setup for educational and testing purposes only, and not in a production environment.</p>
<p>Raspberry Pi is available online for around 45$ CAD at <a href="https://www.raspberrypi.org/products/" class="uri">https://www.raspberrypi.org/products/</a>, but your local library or makerspace will likely be happy to lend you one to play with. You will also need a SD card with a capacity of at least 8GB and with adequate read/write speeds (see <a href="https://www.raspberrypi.org/documentation/installation/sd-cards.md" class="uri">https://www.raspberrypi.org/documentation/installation/sd-cards.md</a> for more info), a wireless router (this one is 40$ and tiny - perfect for portability! <a href="https://amzn.to/2HoOM6W" class="uri">https://amzn.to/2HoOM6W</a>), a power source that is capabale of high-ampage output of at least 2.4A (a wall socket will suffice, but in the field I recommend an external battery pack to be used, to allow for increased portability and as a safeguard against power failures - I use this one at 43$: <a href="https://amzn.to/2Ht8quv" class="uri">https://amzn.to/2Ht8quv</a>) and a couple USB flash drives with varying storage capacities that suit your needs.</p>
<p>This guide is designed with unix-users in mind - so those who use MacOS or Linux. Sorry Windows users :(</p>
<div id="networking-basics" class="section level4">
<h4><span class="header-section-number">4.2.3.1</span> Networking Basics</h4>
<p>The goal of this project is to enable multiple computers to communicate with a database on a central server. In order to accomplish this we first need to set up a network, which enables this communication to happen. <strong>A network is a set of interconnected computers, which communicate with each other using cables or wireless connections as well as protocols that manage the connections.</strong></p>
<p>The internet is one kind of network that relies on immense cabling infrastructure and DNS protocols that have global reach (DNS, or Domain Name Servers, distribute codes to every computer on the internet, which are comparable to phone numbers in a phone network). However in our case we are going to set up a local network (also known as a local area network, LAN or intranet) that has a limited scope and range. <strong>A local network distributes IP addresses to connected devices that enable them to communicate with each other, but it does not necessarily connect these computers to the outside world of the internet.</strong> It can be imagined as a neighbourhood with roads and walkways of its own that serve the local community; the neighbourhood may be connected to the rest of the world via a regional or national highway. <strong>The local network is managed by a router, which is a specialized computer that assigns local IP addresses and also helps direct traffic to and from the broader internet.</strong> You can think of the router as a local post office, which receives mail directed to the town and distributes the mail to every household.</p>
<div class="figure">
<img src="images/networks.png" alt="computer networks" />
<p class="caption">computer networks</p>
</div>
<p>Other kinds of specialized buildings might exist in the town as well. You might do all sorts of things in your home, such as cook, water the garden, wash the dog, or host a party, which each consume varying degrees of food and water (including some waste) but services like grocery store or water reclamation plants need to be streamlined and focused in order to keep up with the inflow and outflow of material that they need to process, which is immense because they engage with each and every household in town. These represent specialized computers on a network called servers (also referred to as hosts, clusters or ‘the cloud’). <strong>Servers are centralized computers that manage and distribute information to and from clients across the network. They are designed to be as lightweight and efficient as possible,</strong> such as by minimizing flair in user interfaces to enable more effective use of computing resources directed towards the task at hand, or by keeping the temperature cool to prevent shutdowns and slowdowns due to overheating. The hardware places hard limits on how efficient a computer may operate, but configuring the software can go a long way in stretching a computer’s capabilities.</p>
<p>Finally, <strong>a user (also referred to as a client, terminal or workstation) is any other computer on the network that is served information or passes along information to be served to others.</strong> The things that they do on their own computer are local relative to other computers on the network. The terms ‘local’ and ‘remote’ are therefore commonly used to designate things that occur close to home base, and things that occur further away, respectively.</p>
</div>
<div id="raspberry-pi-and-raspbian" class="section level4">
<h4><span class="header-section-number">4.2.3.2</span> Raspberry Pi and Raspbian</h4>
<p>Raspberry Pi is an open source, inexpensive and low-power mini-computer that includes all the necessary components needed to do a wide variety of creative things. It’s very popular among makers and DIY/DIWO hackers due to its extensibility and flexibility of use. Raspberry Pi has its own Linux distribution called Raspbian OS, which is designed to be lightweight and consume relatively little power.</p>
<p>While you <em>could</em> connect a display, keyboard and mouse to the Raspberry Pi and interface with it directly, <strong>it’s actually very common to run it ‘headless’ - by running commands via the command line or terminal over a network, without the use of a visual user interface</strong>. We do this by establishing a SSH connection, by typing commands in a terminal window on a remote computer that are actually implemented on the local computer. The network setup enables all of this to happen.</p>
<p>It may seem a little intimidating, but using the terminal is actually quite easy and systematic once you get the hang of it - it just takes some getting used to! Moreover, experimenting with a Raspberry Pi is arguably the best way to learn how to do this, since the operating system can be wiped and reinstalled very easily. So if you mess up (as everyone does at some time or another) you’ll be back up and running in a matter of minutes!</p>
<p>So let’s get started by installing Raspbian on a SD card. Start by inserting the SD card into your computer using an adapter (these tend to come with the microSD card if you just bought a new one, but makerspaces and photographers may have one lying around for you to borrow). Once it’s in it will mount automatically and you should see it pop up on your finder or file explorer. It might have a different name, but be sure you are able to identify it and associate it with what you just inserted into your laptop or desktop computer.</p>
<div class="figure">
<img src="images/sd.png" alt="sd" />
<p class="caption">sd</p>
</div>
<p>Now we’ll have to wipe and format the microSD card using an SD Card Formatter tool. Use the one made available by the SD Association, available at: <a href="https://www.sdcard.org/downloads/formatter_4/" class="uri">https://www.sdcard.org/downloads/formatter_4/</a>.</p>
<p>Once the microSD card is wiped and formatted, we want to etch the Raspbian operating system onto the card. First, download Raspbian OS from <a href="https://www.raspberrypi.org/downloads/raspbian/" class="uri">https://www.raspberrypi.org/downloads/raspbian/</a>, and then use Etcher (available at <a href="https://etcher.io/" class="uri">https://etcher.io/</a>) to write it to the microSD card. This may take a few minutes. Notice that the mounted volume is re-named as ‘boot’.</p>
<div class="figure">
<img src="images/format.png" alt="format" />
<p class="caption">format</p>
</div>
<p>There are a couple other things that we need to do to ensure that we can interface with the Raspberry Pi headless. First we need to create a file in the OS that enables SSH interface. Open terminal (/Applications/Utilities/Terminal.app, or by hitting <code>Command+Space</code> and then typing Terminal.app) and type the following command, then hit enter:</p>
<div class="sourceCode"><pre class="sourceCode bash"><code class="sourceCode bash"><span class="kw">touch</span> /Volumes/boot/ssh</code></pre></div>
<p>This command (<code>touch</code>) creates an empty text file in a location specified after the space. In this case, we are creating a text file called ‘ssh’ in the main directory of the boot volume. What this file does, in simple terms, is <a href="https://www.raspberrypi.org/documentation/remote-access/ssh/README.md#3-enable-ssh-on-a-headless-raspberry-pi-add-file-to-sd-card-on-another-machine">specify that it’s okay to allow other computers to interface with the Raspberry Pi over the network.</a></p>
<p>So now that we’ve specified that it’s okay to enable SSH connections over a network, we need to enable the Raspberry Pi to connect to the network in the first place. If we were using a graphical user interface, we would go to a menubar, select the network and input the password. Only then would we be able to connect to the Raspberry Pi headless. However because we are not using a graphical user interface, we need to devise a way to make the Raspberry Pi connect to the network automatically, without prior intervention on our part. We can do this by creating another file, <code>wpa_supplicant.conf</code>, similarly to how we made the <code>ssh</code> file above. However we want to edit this file to include our network’s login credentials. We’ll use a terminal-based text editor called <code>nano</code> instead of <code>touch</code> to simultaneously create and edit the file.</p>
<div class="sourceCode"><pre class="sourceCode bash"><code class="sourceCode bash"><span class="kw">cd</span> /Volumes/boot
<span class="kw">nano</span> wpa_supplicant.conf</code></pre></div>
<p>The <code>cd</code> command moves you around directories. Check what files and sub-directories are in your current directory with <code>ls</code>. See the cheatsheet provided by the Raspberry Pi Foundation that lists some common terminal command and explains how to use them: <a href="https://www.raspberrypi.org/documentation/linux/usage/commands.md" class="uri">https://www.raspberrypi.org/documentation/linux/usage/commands.md</a></p>
<p>After the <code>nano</code> command you should see a blank file. Type the following into <code>wpa_supplicant.conf</code>. Remember to change the generic country code, network SSID and network password, including the <> characters, to suit your setup. The quotes should remain in place.</p>
<div class="sourceCode"><pre class="sourceCode bash"><code class="sourceCode bash"><span class="ot">country=</span><span class="kw"><XX></span>
<span class="ot">ctrl_interface=</span>DIR=<span class="kw">/var/run/wpa_supplicant</span> GROUP=netdev
<span class="ot">update_config=</span>1
<span class="ot">network=</span><span class="kw">{</span>
<span class="ot">ssid=</span><span class="st">"<network name>"</span>
<span class="ot">psk=</span><span class="st">"<network password>"</span>
<span class="kw">}</span></code></pre></div>
<div class="figure">
<img src="images/wpasupp.png" alt="wpasupp" />
<p class="caption">wpasupp</p>
</div>
<p><strong>Note:</strong> this is a relatively insecure method, since we are writing out our network credentials in plain text. Anyone who has read access to this file can see this information. I recommend that you not use login credentials that are personal to your university account, since they are typically used to access other crucial university or employee services. Ask your network administrator or IT department to create a new generic or institutional user and password combination for such testing and tinkering experiences! <a href="https://www.raspberrypi.org/documentation/configuration/wireless/wireless-cli.md">See the Raspberry Pi documentation on this topic for further information.</a></p>
<p>Exit nano by hitting <code>control + x</code>, and then pressing the <code>y</code> key when asked if you’d like to save the buffer (which means save the file). This should return you to the normal terminal window.</p>
<p>Now eject the microSD card, place it in the Raspberry Pi and boot it up. Wait a couple minutes for it to finish booting up. The red LED light specifies power consumption (solid means power is flowing, flickering means inadequate power supply, i.e. needs a supply with better ampage), and the green LED light specifies data processing. The operating system will be finished installing once the green LED calms down.</p>
<p>Now that we’ve installed the OS and enabled network-based control of it, let’s go ahead and establish such a connection. <a href="https://www.raspberrypi.org/documentation/remote-access/ssh/">This is called SSH, or Secure SHell connection</a>. To establish an SSH connection we will need to know the location of the target computer on the network. We can do this by going into the router’s settings and checking all connected computers’ IP addresses.</p>
<p>Once you determine the target computer’s ip address, we can type the following command, replacing the generic placeholder (including the <> characters) with the actual address:</p>
<div class="sourceCode"><pre class="sourceCode bash"><code class="sourceCode bash"><span class="kw">ssh</span> pi@<span class="kw"><</span>ip address<span class="kw">></span></code></pre></div>
<p>You will be prompted for a password. The default password on fresh installations of Raspbian is ‘raspberry’. No astericks will be visible as you type it, just hit enter when you are finished. Your window should look something like this:</p>
<div class="figure">
<img src="images/ssh.png" alt="ssh" />
<p class="caption">ssh</p>
</div>
<p>Congratulations, you’re in! 🎉</p>
<p>In the command we just ran, ‘pi’ and ‘raspberry’ specify the default username and password on the host computer, and the host computer itself is specified by the IP address that locates it on the network.</p>
<p>This terminal window should now be considered a remote client to the raspberry pi. More specifically, everything that you do run that follows <code>pi@raspberrypi:</code> in the terminal window is being implemented on the Raspberry Pi. If you were to close the terminal window, you will be prompted to end the session - this is fine, but the Raspberry Pi will still be running, without any SSH connections still active. You will need to re-establish a new SSH connection to get back in control of the host computer, and to shut it down.</p>
<p>You may also get the following warning when trying to establish an initial connection via SSHL:</p>
<div class="sourceCode"><pre class="sourceCode bash"><code class="sourceCode bash"><span class="kw">@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@</span>
<span class="kw">@</span> WARNING: REMOTE HOST IDENTIFICATION HAS CHANGED! @
<span class="kw">@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@</span>
<span class="kw">IT</span> IS POSSIBLE THAT SOMEONE IS DOING SOMETHING NASTY!
<span class="kw">Someone</span> could be eavesdropping on you right now (man-in-the-middle attack)!
<span class="kw">It</span> is also possible that a host key has just been changed.
<span class="kw">The</span> fingerprint for the ECDSA key sent by the remote host is
<span class="kw">SHA256</span>:/1AS9um/kBFfaIf0vny7UX8YyDP3nTCZhd2H5FAv2VY.
<span class="kw">Please</span> contact your system administrator.
<span class="kw">Add</span> correct host key in /root/.ssh/known_hosts to get rid of this message.
<span class="kw">Offending</span> ECDSA key in /root/.ssh/known_hosts:1
<span class="kw">remove</span> with:
<span class="kw">ssh-keygen</span> -f <span class="st">"/root/.ssh/known_hosts"</span> -R 192.168.1.234
<span class="kw">ECDSA</span> host key for 192.168.1.234 has changed and you have requested strict checking.
<span class="kw">Host</span> key verification failed.</code></pre></div>
<p>This is triggered because each remote computer that establishes an SSH connection with a specific target is identified using a cryptographic key, for security reasons. When you re-install Raspbian on the same microSD card, the old key slot is removed and replaced with a new one. However, when your remote laptop tries to enter the computer located on the same location on the network it reaches for the old key that works with the lock that has since been removed. We therefore need to delete the old key and replace it with a new one that fits the new lock.</p>
<p>To do this, navigate to the file where the keys are stored, and edit the file to delete the corresponding keys:</p>
<div class="sourceCode"><pre class="sourceCode bash"><code class="sourceCode bash"><span class="kw">sudo</span> nano ~/.ssh/known_hosts</code></pre></div>
<p>Remove all the data stored in this file by going to the end and holding backspace, then save and exit with <code>control + x</code> and then <code>y</code>. See <a href="https://www.raspberrypi.org/forums/viewtopic.php?t=40037" class="uri">https://www.raspberrypi.org/forums/viewtopic.php?t=40037</a> for more info.</p>
<div class="figure">
<img src="images/knownhosts.png" alt="known hosts" />
<p class="caption">known hosts</p>
</div>
<p><strong>SSH via direct ethernet connection (MacOS):</strong> Raspbian is configured by default to receive an IP address from a DHCP server, a role that is typically fulfilled by a wireless router. This can be done without a router by connecting the Raspberry Pi to the client computer using an ethernet cable, but it is necessary to configure the sharing options in MacOS in order for this to work. From System Preferences, go to the Sharing window. From the box on the left, enable ‘Internet Sharing’. You may have to select ‘Thunderbolt Ethernet’ under the Wi-Fi dropdown before checking off the ‘Internet Sharing’ box.</p>
<p>Then in terminal, use <code>ifconfig</code> to get information about your computer’s networking configuration. Find the header <code>bridge100</code>, note the IP address after <code>inet</code>, which is most likely <code>192.168.2.1</code>. Add one to the final digit to determine the likely IP address of the Raspberry Pi (<code>192.168.2.2</code> in this case).</p>
<p><strong>Note:</strong> This will not work if the wireless network is secured by a 802.1x firewall, which are commonly implemented by most university, hospital and government networks.</p>
<p>For more information, visit: * <a href="https://medium.com/@tzhenghao/how-to-ssh-into-your-raspberry-pi-with-a-mac-and-ethernet-cable-636a197d055" class="uri">https://medium.com/@tzhenghao/how-to-ssh-into-your-raspberry-pi-with-a-mac-and-ethernet-cable-636a197d055</a> * <a href="https://www.jeffgeerling.com/blog/2016/ssh-raspberry-pi-only-network-cable-using-os-xs-internet-sharing" class="uri">https://www.jeffgeerling.com/blog/2016/ssh-raspberry-pi-only-network-cable-using-os-xs-internet-sharing</a></p>
<p>Now that we are in the remote host, let’s install updates. This requires that the local network be connected to the internet.</p>
<div class="sourceCode"><pre class="sourceCode bash"><code class="sourceCode bash"><span class="kw">sudo</span> apt-get update -y
<span class="kw">sudo</span> apt-get upgrade -y</code></pre></div>
<p>Linux software is installed and managed through the use of package managers, in this case one called apt. <code>apt-get update</code> updates the listing of software (along with version numbers and compatibility info) that is managed on a trusted and audited series of servers out on the internet. <code>apt-get upgrade</code> installs updates to outdated software on your device based on comparisons of the local version numbers with those on the external listing. Including the <code>-y</code> flag is optional, and specifies that any prompt to confirm an update with a yes/no response should always respond with ‘yes’.</p>
<p>For the purpose of this tutorial it is not necessary to update the kernel or firmware. The most up-to-date versions are included in the raspbian disk images. Using <code>sudo rpi-update</code> may install bleeding-edge updates or untested firmware that might break our intended setup.</p>
<p><strong>Note:</strong> There is no power switch on the Raspberry Pi, and power-supply can therefore be a bit finicky. <strong>You will have to shut down the computer by running a specific command. DO NOT JUST UNPLUG THE POWER CORD! That can corrupt the SD card and you’ll have to re-image it and re-install the OS, and all data will be lost in the process!</strong></p>
<p>To shut down the Raspberry Pi, use the following command:</p>
<div class="sourceCode"><pre class="sourceCode bash"><code class="sourceCode bash"><span class="kw">sudo</span> shutdown -h now</code></pre></div>
<p>To restart the Raspberry Pi, simply re-connect the power source.</p>
</div>
<div id="setting-up-static-ip-addresses" class="section level4">
<h4><span class="header-section-number">4.2.3.3</span> Setting up Static IP Addresses</h4>
<p>To make our lives a little easier, especially when working on a network that many other devices will be connected to, it will be helpful to configure a static IP address for the Raspberry Pi on the network. Each device connected to the network is assigned a unique IP address, typically as a sequence following the order in which they connected. So the router might have IP address <code>192.168.0.100</code>, and subsequently connected computers will have <code>192.168.0.101</code>, <code>192.168.0.102</code>, <code>192.168.0.103</code>, etc. Most routers enable up to 200 connections by default, distributing IP addresses up to <code>192.168.0.199</code>. In order to maintain consistency when connecting to the Raspberry Pi (which may be necessary when writing instructions for others to follow, or when pre-configuring connections to the Raspberry Pi on others’ computers), we can reserve an IP address from the upper end of the range, such as <code>192.168.0.198</code>. You will no longer have to lookup the target computer’s IP address in the router options or via the terminal - you could simply run <code>ssh pi@192.168.0.198</code> to establish a connection to the Raspberry Pi from any remote computer on the network.</p>
<p>In order to do this we will have to find some information about the network configuration. Start by SSH-ing into the Raspberry Pi.</p>
<p>We first need to get the Raspberry Pi’s IP address on the network, on both wifi and ethernet interfaces.</p>
<div class="sourceCode"><pre class="sourceCode bash"><code class="sourceCode bash"><span class="kw">ip</span> -4 addr show <span class="kw">|</span> <span class="kw">grep</span> global</code></pre></div>
<p>The output should look something like this:</p>
<div class="sourceCode"><pre class="sourceCode bash"><code class="sourceCode bash"><span class="kw">inet</span> 169.254.39.157/16 brd 169.254.255.255 scope global eth0
<span class="kw">inet</span> 192.168.0.102/24 brd 192.168.0.255 scope global wlan0</code></pre></div>
<p><code>eth0</code> refers to the ethernet interface, and <code>wlan0</code> refers to the wireless interface. Information pertaining to the ethernet interface will not appear if the Raspberry Pi is not currently connected to the router via an ethernet cable.</p>
<p>Next we need to determine the router’s gateway:</p>
<div class="sourceCode"><pre class="sourceCode bash"><code class="sourceCode bash"><span class="kw">ip</span> route <span class="kw">|</span> <span class="kw">grep</span> default <span class="kw">|</span> <span class="kw">awk</span> <span class="st">'{print $3}'</span></code></pre></div>
<p>The result should look something like this:</p>
<div class="sourceCode"><pre class="sourceCode bash"><code class="sourceCode bash"><span class="kw">192.168.0.1</span></code></pre></div>
<p>Then we need to determine the DNS server or namespace, which is often the same as the router’s gateway:</p>
<div class="sourceCode"><pre class="sourceCode bash"><code class="sourceCode bash"><span class="kw">cat</span> /etc/resolv.conf</code></pre></div>
<p>The result should look something like this:</p>
<div class="sourceCode"><pre class="sourceCode bash"><code class="sourceCode bash"><span class="co"># Generated by resolvconf</span>
<span class="kw">nameserver</span> 192.168.0.1</code></pre></div>
<p>Finally, we have to add this retrieved information to the file located at <code>/etc/dhcpcd.conf</code>:</p>
<div class="sourceCode"><pre class="sourceCode bash"><code class="sourceCode bash"><span class="kw">sudo</span> nano /etc/dhcpcd.conf</code></pre></div>
<p><strong>ProTip:</strong> when editing system files or doing anything that reconfigures the computer setup in a serious way, you will have to include the <code>sudo</code> before the command. This grants ‘super user’ privileges, which are required for system adminstration.</p>
<p>Add the following, substituting the <code>static routers</code> and <code>static domain_name_servers</code> values with the one’s that were just determined above. The values for <code>static ip_address</code> should be our new consistent IP address. For the numbers following the <code>/</code>, use the values from the IP addresses we identified above.</p>
<div class="sourceCode"><pre class="sourceCode bash"><code class="sourceCode bash"><span class="kw">interface</span> eth0
<span class="kw">static</span> ip_address = 192.168.0.197/16
<span class="kw">static</span> routers = 192.168.0.1
<span class="kw">static</span> domain_name_servers = 192.168.0.1
<span class="kw">interface</span> wlan0
<span class="kw">static</span> ip_address = 192.168.0.198/24
<span class="kw">static</span> routers = 192.168.0.1
<span class="kw">static</span> domain_name_servers = 192.168.0.1</code></pre></div>
<p>Save and close the file, and you should be good to go! You might have to re-establish the connection, however, since the host may now be situated at a different location on the network. Further information: <a href="http://raspberrypi.stackexchange.com/a/37921/8697" class="uri">http://raspberrypi.stackexchange.com/a/37921/8697</a></p>
<p><strong>ProTip:</strong> You may need to make a direct connection with your computer to download updates (When in the field, I tend to tether my cullular connection to my laptop and share the connection over ethernet). In such cases, you will need to edit <code>dhcpcd.conf</code> and comment out the <code>eth0</code> specifications to enable an alternative ethernet interface with your laptop that is not specific to the router that it is normally connected to. You may not even need an <code>eth0</code> static IP, but it helps to have that direct ethernet connection in place if you are using the Pi as a network attached storage (NAS) device, i.e. sharing files over the network, as this gives a significant speed boost to file transfers.</p>
</div>
<div id="setting-up-the-database-management-system" class="section level4">
<h4><span class="header-section-number">4.2.3.4</span> Setting up the database management system</h4>
<p>Now that we have the Raspberry Pi set up, let’s set up a database management system (DBMS for short). We’re going to be using MariaDB, which is for all intents and purposes identical to MySQL (<a href="https://www.tecmint.com/the-story-behind-acquisition-of-mysql-and-the-rise-of-mariadb/">MariaDB is a fork of MySQL that is more committed to open source principles</a>). In fact, <a href="https://mariadb.com/kb/en/library/mariadb-vs-mysql-compatibility/">all MySQL commands work in MariaDB</a>, and the community of users cross-polinate and use the terms synonymously in their documentation and troubleshooting. We will be using many commands that were designed for use in MySQL and which were ported over to MariaDB when it was forked.</p>
<p>In our current application, we will be installing a database server on the Raspberry Pi, which hosts one or more databases. The database, and all information stored within it, resides on the SD card slotted into the Raspberry Pi, which users connect to over the network as clients. The fact that the database exists in one centralized place ensures that the information accessed by clients is constantly up to date and consistent. In order to connect to the database as a client, users will have to know the server’s IP address, the port that is used by MariaDB on the server, the name of the database to be accessed, and the users’ login credentials to access the database.</p>
<p>To install MariaDB Server, first SSH into the Raspberry Pi and then use <code>apt-get</code> to install <code>mariadb-server</code> from the package manager:</p>
<div class="sourceCode"><pre class="sourceCode bash"><code class="sourceCode bash"><span class="kw">sudo</span> apt-get install mariadb-server</code></pre></div>
<p>Once it is installed, you will have to re-configure a configuration file to enable access to the database across the network. First access the config file:</p>
<div class="sourceCode"><pre class="sourceCode bash"><code class="sourceCode bash"><span class="kw">sudo</span> nano /etc/mysql/mariadb.conf.d/50-server.cnf</code></pre></div>
<p>Find the line that configures <code>bind-address</code> to <code>127.0.0.1</code> and change its value to <code>0.0.0.0</code>. <a href="https://mariadb.com/kb/en/library/server-system-variables/#bind_address">This changes the addresses that the MariaDB server will listen to for connections</a>. If we had left it at <code>127.0.0.1</code>, which is typically synonymous with <code>localhost</code>, only modifications made by the Raspberry Pi’s local users would be able to access any of the databases managed by the MariaDB server. By changing the value to <code>0.0.0.0</code> we enable the server to accept connections from any computer on the network, if they have valid credentials. You can also configure specific IP addresses in order to allow only computers with those locations on the network to access the database server.</p>
<p>Once your changes are made, save the file using <code>control + x</code> and then restart the MariaDB service:</p>
<div class="sourceCode"><pre class="sourceCode bash"><code class="sourceCode bash"><span class="kw">sudo</span> service mysql restart</code></pre></div>
<p><strong>Installing and running MariaDB locally on MacOS:</strong> It is possible to install the MariaDB DBMS locally on your laptop, which means that your laptop would serve as both the server and the client at the same time. This is useful if you want to create and manage a database locally before migrating it to a server, or if you don’t have a Raspberry Pi on hand but want to learn more about database adminstration.</p>
<p>To onstall MariaDB on a mac, we need to first install a paclage manager called homebrew, similar to apt, that is designed specifically for MacOS. To install homebrew, open terminal and then run the following command to download the installation files and build the program:</p>
<div class="sourceCode"><pre class="sourceCode bash"><code class="sourceCode bash"><span class="kw">/usr/bin/ruby</span> -e <span class="st">"</span><span class="ot">$(</span><span class="kw">curl</span> -fsSL https://raw.githubusercontent.com/Homebrew/install/master/install<span class="ot">)</span><span class="st">"</span></code></pre></div>
<p>Then update the index of retrievable packages and upgrade any installed packages:</p>
<div class="sourceCode"><pre class="sourceCode bash"><code class="sourceCode bash"><span class="kw">brew</span> update
<span class="kw">brew</span> upgrade</code></pre></div>
<p>Nowe install MariaDB via homebrew:</p>
<div class="sourceCode"><pre class="sourceCode bash"><code class="sourceCode bash"><span class="kw">brew</span> install mariadb</code></pre></div>
<p>Once installed, to start the MariaDB server use the following:</p>
<div class="sourceCode"><pre class="sourceCode bash"><code class="sourceCode bash"><span class="kw">mysql.server</span> start</code></pre></div>
<p>It is also important to stop the server when you are finished using it in order to ensure that your computer is not constantly using up resources when they are not needed:</p>
<div class="sourceCode"><pre class="sourceCode bash"><code class="sourceCode bash"><span class="kw">mysql.server</span> stop</code></pre></div>
<p>Once the database server is installed and running up, let’s login to the server so that we can create a database. By default there is only one user named ‘root’, whose password is blank. Root has the broadest set of privileges, and can create or drop databases and users freely. You can only log in as root on the machine on which the MariaDB server resides; you can not log in as root from a remote connection. After establishing a SSH connection to the Raspberry Pi, initiate the server and login as root:</p>
<div class="sourceCode"><pre class="sourceCode bash"><code class="sourceCode bash"><span class="kw">sudo</span> mysql</code></pre></div>
<p>You’ll notice that the terminal window looks a little different. We are now in the MariaDB server environment, and we will have to escape it in order to run commands outside of it. The command to escape is <code>control + c</code>. You can also establish another SSH connection in a new terminal window so that you can use one window for database management tasks, and the other for working with other aspects of the operating system.</p>
<p>MariaDB commands are SQL, or Structured Query Language. They are generally written using upper case letters, and every command must end with a semicolon. The semicolon essentially indicates the boundaries of a SQL statement, which is essentially a self-contained logical statement. If you do hit enter after an incomplete statement is input then any further input will be tacked on to the end of the incomplete statement. The semicolon indicates that the statement is finished and ready to be executed.</p>
<p>Now let’s create a database called <code>odate1</code>:</p>
<div class="sourceCode"><pre class="sourceCode sql"><code class="sourceCode sql"><span class="kw">CREATE</span> <span class="kw">DATABASE</span> odate1;</code></pre></div>
<p>Next create a new user named <code>lara</code> with password <code>croft</code>:</p>
<div class="sourceCode"><pre class="sourceCode sql"><code class="sourceCode sql"><span class="kw">CREATE</span> <span class="fu">USER</span> <span class="st">'lara'</span>@<span class="st">'localhost'</span> <span class="kw">IDENTIFIED</span> <span class="kw">BY</span> <span class="st">'croft'</span>;</code></pre></div>
<p>We can also make a restriction that would only recognize a user named lara if she attempts to access the server from a specific IP address by replacing <code>localhost</code> with the IP address that you are expecting her to connect from:</p>
<div class="sourceCode"><pre class="sourceCode sql"><code class="sourceCode sql"><span class="kw">CREATE</span> <span class="fu">USER</span> <span class="st">'lara'</span>@<span class="st">'12.34.56.78'</span> <span class="kw">IDENTIFIED</span> <span class="kw">BY</span> <span class="st">'croft'</span>;</code></pre></div>
<p>Different users can have different <a href="https://mariadb.com/kb/en/library/grant/">permissions</a> granted to them. Groups of specific permissions can be lumped together and labelled as <a href="https://mariadb.com/kb/en/library/roles_overview/">roles</a>, which can also be assigned to users, which may make database management slightly easier. In this tutorial we will not fret too much with permissions or roles (see <a href="https://mariadb.com/kb/en/library/grant/" class="uri">https://mariadb.com/kb/en/library/grant/</a> for more information), and we will simply assign all permissions to our user lara:</p>
<div class="sourceCode"><pre class="sourceCode sql"><code class="sourceCode sql"><span class="kw">GRANT</span> <span class="kw">ALL</span> <span class="kw">PRIVILEGES</span> <span class="kw">ON</span> odate1.* <span class="kw">TO</span> <span class="st">'lara'</span>@<span class="st">'%'</span> <span class="kw">IDENTIFIED</span> <span class="kw">BY</span> <span class="st">'croft'</span>;
<span class="kw">FLUSH</span> <span class="kw">PRIVILEGES</span>;</code></pre></div>
<p>We could also restrict lara’s permissions to specific tables on the database by replacing the <code>*</code>, which means ‘any’ or ‘wild card’ in logical or boolean terms, with the name of a specific table contained within the database.</p>
<p>Now let’s close the MariaDB service (using <code>control + c</code>) and try logging in as lara:</p>
<div class="sourceCode"><pre class="sourceCode bash"><code class="sourceCode bash"><span class="kw">mysql</span> -u lara -p</code></pre></div>
<p>The -p flag indicates that the terminal should prompt us for a password. As lara, if we try creating a database we will get an error because lara does not have permission to do so.</p>
<p>Creating or dropping tables, columns, indexes and relationships, as well as selecting, inserting, updating and deleting rows, is done via SQL. More comprehensive guides on SQL can be found at <a href="https://www.w3schools.com/sql/sql_intro.asp">w3schools</a> (among other great learning resources that they offer) and the <a href="https://mariadb.com/kb/en/library/mariadb-basics/">MariaDB Knowledge Base</a>, but here are a few useful snippets that you can try out.</p>
<p>To create a table:</p>
<div class="sourceCode"><pre class="sourceCode sql"><code class="sourceCode sql"><span class="kw">CREATE</span> <span class="kw">TABLE</span> `odate1`.`contexts` (
`id` <span class="dt">INT</span>(<span class="dv">11</span>) UNSIGNED <span class="kw">NOT</span> <span class="kw">NULL</span> AUTO_INCREMENT,
`Context` <span class="dt">VARCHAR</span>(<span class="dv">255</span>) <span class="kw">DEFAULT</span> <span class="st">''</span>,
`Trench` <span class="dt">VARCHAR</span>(<span class="dv">255</span>) <span class="kw">DEFAULT</span> <span class="st">''</span>,
`ContextDescription` <span class="dt">VARCHAR</span>(<span class="dv">255</span>) <span class="kw">DEFAULT</span> <span class="st">''</span>,
`Munsell` <span class="dt">VARCHAR</span>(<span class="dv">255</span>) <span class="kw">DEFAULT</span> <span class="st">''</span>,
`SedimentColour` <span class="dt">VARCHAR</span>(<span class="dv">255</span>) <span class="kw">DEFAULT</span> <span class="st">''</span>,
`NumberOfBuckets` <span class="dt">INT</span>(<span class="dv">11</span>) <span class="kw">DEFAULT</span> <span class="dv">0</span>,
<span class="kw">PRIMARY</span> <span class="kw">KEY</span> (`id`)
);</code></pre></div>
<p>To insert data into the table:</p>
<div class="sourceCode"><pre class="sourceCode sql"><code class="sourceCode sql"><span class="kw">INSERT</span> <span class="kw">INTO</span> `odate1`.`contexts` (<span class="kw">Context</span>, Trench, ContextDescription, Munsell, SedimentColour, NumberOfBuckets) <span class="kw">VALUES</span> (<span class="dv">0001</span>, <span class="dv">001</span>, <span class="ot">"The first context of the season. Loamy sand, very herbaceous, characteristic of a typical surface layer."</span>,<span class="ot">"5YR 3/3"</span>,<span class="kw">NULL</span>,<span class="dv">3</span>);</code></pre></div>
<p>to select data from the table:</p>
<div class="sourceCode"><pre class="sourceCode sql"><code class="sourceCode sql"><span class="kw">SELECT</span> `Context`, `Munsell`, `SedimentColour` <span class="kw">FROM</span> `contexts` <span class="kw">WHERE</span> `contexts`.`Trench` = <span class="dv">001</span>;</code></pre></div>
<p>To update data in the table (<a href="https://www.w3schools.com/sql/sql_update.asp" class="uri">https://www.w3schools.com/sql/sql_update.asp</a>):</p>
<div class="sourceCode"><pre class="sourceCode sql"><code class="sourceCode sql"><span class="kw">UPDATE</span> `odate1`.`contexts` <span class="kw">SET</span> `SedimentColour` = <span class="ot">"Dark Brown"</span> <span class="kw">WHERE</span> `Munsell` = <span class="ot">"5YR 3/3"</span>;
<span class="kw">UPDATE</span> `odate1`.`contexts` <span class="kw">SET</span> `SedimentColour` = <span class="ot">"Brown"</span> <span class="kw">WHERE</span> `Munsell` = <span class="ot">"5YR 4/3"</span>;
<span class="kw">UPDATE</span> `odate1`.`contexts` <span class="kw">SET</span> `SedimentColour` = <span class="ot">"Brown"</span> <span class="kw">WHERE</span> `Munsell` = <span class="ot">"5YR 5/4"</span>;
<span class="kw">UPDATE</span> `odate1`.`contexts` <span class="kw">SET</span> `SedimentColour` = <span class="ot">"Reddish Yellow"</span> <span class="kw">WHERE</span> `Munsell` = <span class="ot">"5YR 7/6"</span>;</code></pre></div>
<p>To delete data from the table (<a href="https://www.w3schools.com/sql/sql_delete.asp" class="uri">https://www.w3schools.com/sql/sql_delete.asp</a>):</p>
<div class="sourceCode"><pre class="sourceCode sql"><code class="sourceCode sql"><span class="kw">DELETE</span> <span class="kw">FROM</span> `contexts` <span class="kw">WHERE</span> `Context` = <span class="ot">"0005"</span>;</code></pre></div>
<p>To make a relationship between two tables:</p>
<div class="sourceCode"><pre class="sourceCode sql"><code class="sourceCode sql"><span class="kw">CREATE</span> <span class="kw">TABLE</span> `odate1`.`trenches` (
`id` <span class="dt">INT</span>(<span class="dv">11</span>) SIGNED <span class="kw">NOT</span> <span class="kw">NULL</span> AUTO_INCREMENT,
`Trench` <span class="dt">VARCHAR</span>(<span class="dv">255</span>) <span class="kw">DEFAULT</span> <span class="st">''</span>,
`Supervisor` <span class="dt">VARCHAR</span>(<span class="dv">255</span>) <span class="kw">DEFAULT</span> <span class="st">''</span>,
`Reason` <span class="dt">VARCHAR</span>(<span class="dv">255</span>) <span class="kw">DEFAULT</span> <span class="st">''</span>,
`LocalDatum` <span class="dt">VARCHAR</span>(<span class="dv">255</span>) <span class="kw">DEFAULT</span> <span class="st">''</span>,
<span class="kw">PRIMARY</span> <span class="kw">KEY</span> (`id`)
);
<span class="kw">ALTER</span> <span class="kw">TABLE</span> `odate1`.`contexts` <span class="kw">ADD</span> <span class="kw">CONSTRAINT</span> `FK_contexts_Trench` <span class="kw">FOREIGN</span> <span class="kw">KEY</span> (`Trench`) <span class="kw">REFERENCES</span> `odate1`.`contexts` (`Trench`) <span class="kw">ON</span> <span class="kw">DELETE</span> <span class="kw">CASCADE</span> <span class="kw">ON</span> <span class="kw">UPDATE</span> <span class="kw">CASCADE</span>;</code></pre></div>
<p>To run a join query (<a href="https://www.w3schools.com/sql/sql_join.asp" class="uri">https://www.w3schools.com/sql/sql_join.asp</a>):</p>
<div class="sourceCode"><pre class="sourceCode sql"><code class="sourceCode sql"><span class="kw">SELECT</span> `contexts`.Context, `contexts`.`Trench`, `contexts`.`NumberOfBuckets`, `Trench`.`Reason` <span class="kw">FROM</span> `contexts` <span class="kw">INNER</span> <span class="kw">JOIN</span> `trenches` <span class="kw">ON</span> `contexts`.`Trench` = `trenches`.`Trench`;</code></pre></div>
<ul>
<li>do all this from the command line but show how it can also be done from a GUI like <a href="https://www.sequelpro.com/">Sequel Pro</a> or <a href="https://www.mysql.com/products/workbench/">SQL Workbench</a>, which actually shows the queries being run</li>
</ul>
</div>
<div id="accessing-the-database-from-a-client" class="section level4">
<h4><span class="header-section-number">4.2.3.5</span> Accessing the database from a client</h4>
<p>Manipulating a database can be done from the command line or from a graphical user interface running on a remote client. There are a wide variety of database client software available (either open source or proprietary) but I highly recommend Sequel Pro (mac only) and MySQL Workbench (cross platform).</p>
<p>As mentioned above, in order for a client to access a database on a remote server they will need the following information: * the server’s IP address * the port on which MariaDB listens to connections * the database’s name * a user’s username and password</p>
<p>Assuming that the Raspberry Pi has the static IP we assigned to it earlier, we can access our test database using the following information: * IP address: 192.168.0.198 * Port: 3306 (this is the default for MariaDB and MySQL) * Database: odate1 * User: lara * Password: croft</p>
<p>Everything that happens in this interface can be expressed as a logical SQL statement, which is passed on to the server and executed there as if it were done in the terminal, as demonstrated above. In MySQL Workbench this is explicitly shown to the user so that they may verify the actions that they take.</p>
<p>It is also possible to generate your own interfaces and data entry forms using Microsoft Access, PHP or R. In broad terms, a connection to the database is established using the same information just listed above, and buttons next to text fields or table renderers are used to execute SQL statements that insert, update, select delete or otherwise query the database accordingly.</p>
<p>For more information on how create data entry forms using Microsoft Access, PHP and R Shiny, please refer to the following links: * Microsoft Access: <a href="https://dev.mysql.com/doc/connector-odbc/en/connector-odbc-examples-tools-with-access-linked-tables.html" class="uri">https://dev.mysql.com/doc/connector-odbc/en/connector-odbc-examples-tools-with-access-linked-tables.html</a> * PHP: <a href="https://www.taniarascia.com/create-a-simple-database-app-connecting-to-mysql-with-php/" class="uri">https://www.taniarascia.com/create-a-simple-database-app-connecting-to-mysql-with-php/</a> * R: <a href="https://mariadb.com/kb/en/library/r-statistical-programming-using-mariadb-as-the-background-database/" class="uri">https://mariadb.com/kb/en/library/r-statistical-programming-using-mariadb-as-the-background-database/</a>, <a href="https://shiny.rstudio.com/articles/overview.html" class="uri">https://shiny.rstudio.com/articles/overview.html</a>, <a href="https://github.com/MangoTheCat/dtdbshiny" class="uri">https://github.com/MangoTheCat/dtdbshiny</a></p>
</div>
<div id="scheduling-automatic-backups" class="section level4">
<h4><span class="header-section-number">4.2.3.6</span> Scheduling automatic backups</h4>
<p>It is wise to backup your databases regularly, but this is often overlooked. Thankfully we can automate this process! We accomplish this by running a basic script that wraps the database as a single file and copies it over to a specified directory that corresponds with a folder on a mounted USB storage drive.</p>
<p>First we will have to configure the system so that the USB storage device is mounted consistently and automatically each time the device is connected. While Raspberry Pi does support auto USB mounting when starting the machine, it can be a bit flaky. Therefore we will use the device ID (referred to as UUID in the linux system) to ensure that there is more certainty of a proper mount. So we need to determine the UUID of the USB device by first inserting it in the Raspberry Pi and then cross-checking the outputs of the following commands:</p>
<div class="sourceCode"><pre class="sourceCode bash"><code class="sourceCode bash"><span class="kw">ls</span> -al /dev/disk/by-uuid
<span class="kw">lsblk</span></code></pre></div>
<p>Infer the correct UUID based on the drive’s capacity and through elimination of other possibilities, and note it down somewhere.</p>
<p>Now create the directory where we want to mount the drive:</p>
<div class="sourceCode"><pre class="sourceCode bash"><code class="sourceCode bash"><span class="kw">sudo</span> mkdir /media/backup</code></pre></div>
<p>Give the directory adequate permissions:</p>
<div class="sourceCode"><pre class="sourceCode bash"><code class="sourceCode bash"><span class="kw">sudo</span> chmod -R 777 /media/backup</code></pre></div>
<p><strong>Note:</strong> This command gives unrestricted read, write and execute permissions to all users! Configure your permissions to suit your needs! Further information: <a href="https://www.guru99.com/file-permissions.html" class="uri">https://www.guru99.com/file-permissions.html</a>, <a href="https://chmod-calculator.com/" class="uri">https://chmod-calculator.com/</a></p>
<p>Next open the <code>fstab</code> file, which is a system file that handles the way Raspbian mounts USB devices:</p>
<div class="sourceCode"><pre class="sourceCode bash"><code class="sourceCode bash"><span class="kw">sudo</span> nano /etc/fstab</code></pre></div>
<p>At the end of that file, add the following command, replacing the UUID with the one pertaining to the specific device and the directory with the intended mount point:</p>
<div class="sourceCode"><pre class="sourceCode bash"><code class="sourceCode bash"><span class="ot">UUID=</span>783A-120B <span class="kw">/media/backup</span> auto noatime,nofail,umask=000 0 0</code></pre></div>
<p>Further information: (<a href="https://www.raspberrypi.org/documentation/configuration/external-storage.md" class="uri">https://www.raspberrypi.org/documentation/configuration/external-storage.md</a>)[<a href="https://www.raspberrypi.org/documentation/configuration/external-storage.md" class="uri">https://www.raspberrypi.org/documentation/configuration/external-storage.md</a>]</p>
<p><strong>Note:</strong> This is the correct code for FAT32/exFAT formatted drives only. FAT32/exFAT handles permissions is a slightly different way than NTFS and linux-based filesystems (i.e. ext4) and you will need to configure them accordingly. However, I recommend the use of FAT32/exFAT in general, since it is interoperable between virtually all operating systems, whereas others are not, and zipped archaeological databases probably won’t be more than 4GB each, which is the file size limit for FAT32/exFAT-formatted devices.</p>
<p>Now the USB drive will be auto mounted and ready to use. Don’t forget to restart your Raspberry Pi to test it out:</p>
<div class="sourceCode"><pre class="sourceCode bash"><code class="sourceCode bash"><span class="kw">sudo</span> shutdown -h now</code></pre></div>
<p>After you have gotten the USB drive to mount automatically, we need to create a script called <code>dbbackup.sh</code> in the home directory:</p>
<div class="sourceCode"><pre class="sourceCode bash"><code class="sourceCode bash"><span class="kw">cd</span> ~
<span class="kw">sudo</span> nano dbbackup.sh</code></pre></div>
<p>In that file, enter the following:</p>
<div class="sourceCode"><pre class="sourceCode bash"><code class="sourceCode bash"><span class="co">#!/bin/bash</span>
<span class="ot">$OUTPUT_FILE</span> = <span class="kw">/media/backup/mysqldump/odate1_</span><span class="ot">$(</span><span class="kw">date</span> +<span class="st">"%Y%m%d_%H%M%S"</span><span class="ot">)</span><span class="kw">.gzip</span>
<span class="ot">$USERNAME</span> = <span class="kw">lara</span>
<span class="ot">$PASSWORD</span> = <span class="kw">croft</span>
<span class="ot">$DATABASE_NAME</span> = <span class="kw">odate1</span>
<span class="kw">sudo</span> mysqldump -u<span class="ot">$USERNAME</span> -p<span class="ot">$PASSWORD</span> <span class="ot">$DATABASE_NAME</span> <span class="kw">|</span> <span class="kw">gzip</span> <span class="kw">></span> <span class="ot">$OUTPUT_FILE</span></code></pre></div>
<p>The username, password, database name and file path can also be modified to suit your unique situation. Ensure that the permissions are properly set to allow you to write to the specified directory.</p>
<p>Then we need to set the script to be executable:</p>
<div class="sourceCode"><pre class="sourceCode bash"><code class="sourceCode bash"><span class="kw">sudo</span> chmod 755 dbbackup.sh</code></pre></div>
<p>Now we need to automate the execution of this script using <code>cron</code>. <code>cron</code> is a time-based scheduling utility in Unix/Linux operating systems such as Raspbian. It reads a configuration file, commonly referred to as <code>crontab</code> where jobs are scheduled using a special syntax. To access and edit the crontab simply enter <code>sudo crontab -e</code> and add a line at the end of the file to schedule a job.</p>
<p>To run dbbackup.sh every 30 minutes, add the following line at the end of the crontab:</p>
<div class="sourceCode"><pre class="sourceCode bash"><code class="sourceCode bash"><span class="kw">*/30</span> * * * * /home/pi/dbbackup.sh</code></pre></div>
<p><strong>ProTip:</strong> <a href="https://crontab.guru/">crontab.guru</a> is a great resource for determining the correct syntax for cron schedules.</p>
<p>For more information, please refer to the following link: <a href="https://www.codingepiphany.com/2013/06/12/raspberry-pi-lamp-server-tuning-and-automated-db-backup/" class="uri">https://www.codingepiphany.com/2013/06/12/raspberry-pi-lamp-server-tuning-and-automated-db-backup/</a></p>
</div>
<div id="configuring-a-file-sharing-server" class="section level4">
<h4><span class="header-section-number">4.2.3.7</span> Configuring a file sharing server</h4>
<p>It may be useful for participants on a project to assemmble photos, spreadsheets, reports or various other digital files with minimal hassle. Luckily, the Raspberry Pi can also be used to set up a network attached storage (NAS) device. In simpler terms, network-connected users can transfer files between their own computers and a USB storage device connected to the Raspberry Pi. This effectively renders a USB storage drive as a wireless drive.</p>
<p>To begin, the system must be confured to automount the USB drive. Instructions on how to do this have been provided in section 4.2.2.5. I recommend that you use a separate USB drive than the one used for backups. For the purpose of this tutorial, I will assume that the file sharing drive is mounted at <code>/media/FileShare</code>.</p>
<p>We will be using a software package called Samba to enable the primary NAS functions. Install Samba using the following command:</p>
<div class="sourceCode"><pre class="sourceCode bash"><code class="sourceCode bash"><span class="kw">sudo</span> apt-get install samba samba-common-bin</code></pre></div>
<p>Next, edit the Samba configuration file:</p>
<div class="sourceCode"><pre class="sourceCode bash"><code class="sourceCode bash"><span class="kw">sudo</span> nano /etc/samba/smb.conf</code></pre></div>
<p>Add the following at the end of the file:</p>
<div class="sourceCode"><pre class="sourceCode bash"><code class="sourceCode bash">[<span class="kw">FileShare</span>]
<span class="kw">Comment</span> = Pi shared folder
<span class="kw">Path</span> = /media/FileShare
<span class="kw">Browseable</span> = yes
<span class="kw">Writeable</span> = Yes
<span class="kw">only</span> guest = no
<span class="kw">create</span> mask = 0777
<span class="kw">directory</span> mask = 0777
<span class="kw">Public</span> = yes
<span class="kw">Guest</span> ok = yes</code></pre></div>
<p>Ensure that <code>Path =</code> the directory you want to share, such as the mount point of an external drive.</p>
<p>This configuration allows anyone to read, write, and execute files in a volume named share, either by logging in as a Samba user or as a guest. If you do not want to allow guest users, omit the <code>guest ok = yes</code> line.</p>
<p>Please refer to <a href="https://www.raspberrypi.org/magpi/samba-file-server/">this resource</a> for further information, as well as the <a href="https://www.samba.org/samba/docs/">Samba documentation</a> in order to set up usernames and passwords. The method just described allows free-for-all access, and it should be communicated to users that they can add, delete or modify any file in the shared directory, for better or worse. You may feel inclined to schedule automated backups of your shared drive to yet another connected drive, though this may congest the network and occupy lots of disk space, depending on the size of the shared directory. You may wish to schedule such backups during off-hours, when volumes of traffic across the network are expected to be low.</p>
</div>
</div>
<div id="discussion-2" class="section level3">
<h3><span class="header-section-number">4.2.4</span> Discussion</h3>
<p>These guides and workflows are meant to emphasize the open-ended opportunities that 3D printing and low-power portable computing afford. They are not definitive instructions to be copied and pasted to obtain the same result, but instead should be considered as ideas to tinker with. To meet the expectations of stakeholders involved in a project, it will be necessary to read the room and get others involved in the making process, in ways that meet their needs and capabilities. The maker community is generally very friendly supportive; help is only a google search away.</p>
</div>
<div id="further-reading-9" class="section level3">
<h3><span class="header-section-number">4.2.5</span> Further Reading</h3>
<p>[bibliography / reading list goes here]</p>
</div>
</div>
</section>
</div>
</div>
</div>
<a href="d-photogrammetry.html" class="navigation navigation-prev " aria-label="Previous page"><i class="fa fa-angle-left"></i></a>
<a href="place-based-interpretation-with-locative-augmented-reality.html" class="navigation navigation-next " aria-label="Next page"><i class="fa fa-angle-right"></i></a>
</div>
</div>
<script src="libs/gitbook-2.6.7/js/app.min.js"></script>
<script src="libs/gitbook-2.6.7/js/lunr.js"></script>
<script src="libs/gitbook-2.6.7/js/plugin-search.js"></script>
<script src="libs/gitbook-2.6.7/js/plugin-sharing.js"></script>
<script src="libs/gitbook-2.6.7/js/plugin-fontsettings.js"></script>
<script src="libs/gitbook-2.6.7/js/plugin-bookdown.js"></script>
<script src="libs/gitbook-2.6.7/js/jquery.highlight.js"></script>
<script>
gitbook.require(["gitbook"], function(gitbook) {
gitbook.start({
"sharing": {
"github": false,
"facebook": true,
"twitter": true,
"google": false,
"linkedin": false,
"weibo": false,
"instapper": false,
"vk": false,
"all": ["facebook", "google", "twitter", "linkedin", "weibo", "instapaper"]
},
"fontsettings": {
"theme": "white",
"family": "sans",
"size": 2
},
"edit": {
"link": "https://github.com/o-date/draft/edit/gh-pages/04.2-3d-printing.rmd",
"text": "Edit"
},
"download": ["odate.pdf"],
"toc": {
"collapse": "section",
"number_sections": null
}
});
});
</script>
</body>
</html>