Manifests of the public domain images uploaded to Flickr Commons, with descriptive information about the books they were taken from.
Python
Switch branches/tags
Nothing to show
Clone or download
Pull request Compare This branch is even with BL-Labs:master.
Fetching latest commit…
Cannot retrieve the latest commit at this time.
Permalink
Failed to load latest commit information.
bin
1510_small.tsv
1528_plates.tsv
1528_small.tsv
1540_small.tsv
1556_plates.tsv
1556_small.tsv
1567_medium.tsv
1567_small.tsv
1584_medium.tsv
1584_small.tsv
1592_plates.tsv
1592_small.tsv
1593_small.tsv
1596_small.tsv
1599_plates.tsv
1599_small.tsv
1602_small.tsv
1605_medium.tsv
1605_plates.tsv
1605_small.tsv
1606_medium.tsv
1606_small.tsv
1607_small.tsv
1608_small.tsv
1610_plates.tsv
1610_small.tsv
1611_small.tsv
1612_small.tsv
1613_small.tsv
1615_small.tsv
1616_plates.tsv
1616_small.tsv
1617_small.tsv
1618_small.tsv
1622_small.tsv
1623_small.tsv
1625_small.tsv
1626_small.tsv
1628_medium.tsv
1628_small.tsv
1629_small.tsv
1630_small.tsv
1631_plates.tsv
1631_small.tsv
1632_small.tsv
1633_plates.tsv
1633_small.tsv
1634_plates.tsv
1634_small.tsv
1635_medium.tsv
1635_plates.tsv
1635_small.tsv
1636_small.tsv
1637_medium.tsv
1637_plates.tsv
1637_small.tsv
1638_plates.tsv
1638_small.tsv
1639_plates.tsv
1639_small.tsv
1640_plates.tsv
1640_small.tsv
1641_small.tsv
1643_small.tsv
1644_medium.tsv
1644_small.tsv
1646_small.tsv
1647_plates.tsv
1647_small.tsv
1648_plates.tsv
1648_small.tsv
1649_small.tsv
1650_plates.tsv
1650_small.tsv
1651_small.tsv
1652_small.tsv
1653_small.tsv
1654_small.tsv
1655_small.tsv
1656_small.tsv
1657_small.tsv
1658_plates.tsv
1658_small.tsv
1659_small.tsv
1660_small.tsv
1661_plates.tsv
1661_small.tsv
1662_small.tsv
1663_small.tsv
1664_plates.tsv
1664_small.tsv
1665_plates.tsv
1665_small.tsv
1666_small.tsv
1667_small.tsv
1668_medium.tsv
1668_plates.tsv
1668_small.tsv
1669_plates.tsv
1669_small.tsv
1670_small.tsv
1671_plates.tsv
1671_small.tsv
1672_plates.tsv
1672_small.tsv
1673_small.tsv
1674_plates.tsv
1674_small.tsv
1675_small.tsv
1676_plates.tsv
1676_small.tsv
1677_plates.tsv
1677_small.tsv
1678_plates.tsv
1678_small.tsv
1679_medium.tsv
1679_plates.tsv
1679_small.tsv
1680_small.tsv
1681_medium.tsv
1681_plates.tsv
1681_small.tsv
1682_small.tsv
1683_plates.tsv
1683_small.tsv
1685_medium.tsv
1685_plates.tsv
1685_small.tsv
1686_medium.tsv
1686_small.tsv
1687_plates.tsv
1687_small.tsv
1688_medium.tsv
1688_plates.tsv
1688_small.tsv
1689_plates.tsv
1689_small.tsv
1690_small.tsv
1691_plates.tsv
1691_small.tsv
1692_small.tsv
1693_medium.tsv
1693_plates.tsv
1693_small.tsv
1694_plates.tsv
1694_small.tsv
1695_plates.tsv
1695_small.tsv
1696_plates.tsv
1696_small.tsv
1697_small.tsv
1699_plates.tsv
1699_small.tsv
1700_medium.tsv
1700_plates.tsv
1700_small.tsv
1701_plates.tsv
1701_small.tsv
1702_medium.tsv
1702_small.tsv
1704_plates.tsv
1704_small.tsv
1705_medium.tsv
1705_plates.tsv
1705_small.tsv
1706_small.tsv
1707_small.tsv
1708_plates.tsv
1708_small.tsv
1709_plates.tsv
1709_small.tsv
1710_medium.tsv
1710_plates.tsv
1710_small.tsv
1711_small.tsv
1712_small.tsv
1713_medium.tsv
1713_small.tsv
1714_medium.tsv
1714_plates.tsv
1714_small.tsv
1715_medium.tsv
1715_plates.tsv
1715_small.tsv
1716_small.tsv
1717_medium.tsv
1717_plates.tsv
1717_small.tsv
1718_medium.tsv
1718_plates.tsv
1718_small.tsv
1719_medium.tsv
1719_plates.tsv
1719_small.tsv
1720_medium.tsv
1720_plates.tsv
1720_small.tsv
1721_medium.tsv
1721_small.tsv
1722_medium.tsv
1722_plates.tsv
1722_small.tsv
1723_medium.tsv
1723_plates.tsv
1723_small.tsv
1724_medium.tsv
1724_plates.tsv
1724_small.tsv
1725_medium.tsv
1725_plates.tsv
1725_small.tsv
1726_medium.tsv
1726_plates.tsv
1726_small.tsv
1727_small.tsv
1728_medium.tsv
1728_plates.tsv
1728_small.tsv
1729_medium.tsv
1729_small.tsv
1730_medium.tsv
1730_plates.tsv
1730_small.tsv
1731_medium.tsv
1731_plates.tsv
1731_small.tsv
1732_medium.tsv
1732_small.tsv
1733_medium.tsv
1733_plates.tsv
1733_small.tsv
1734_medium.tsv
1734_plates.tsv
1734_small.tsv
1735_medium.tsv
1735_plates.tsv
1735_small.tsv
1736_medium.tsv
1736_plates.tsv
1736_small.tsv
1737_medium.tsv
1737_plates.tsv
1737_small.tsv
1738_medium.tsv
1738_plates.tsv
1738_small.tsv
1739_medium.tsv
1739_plates.tsv
1739_small.tsv
1740_medium.tsv
1740_plates.tsv
1740_small.tsv
1741_medium.tsv
1741_plates.tsv
1741_small.tsv
1742_medium.tsv
1742_plates.tsv
1742_small.tsv
1743_medium.tsv
1743_plates.tsv
1743_small.tsv
1744_medium.tsv
1744_plates.tsv
1744_small.tsv
1745_medium.tsv
1745_small.tsv
1746_medium.tsv
1746_plates.tsv
1746_small.tsv
1747_medium.tsv
1747_small.tsv
1748_medium.tsv
1748_plates.tsv
1748_small.tsv
1749_medium.tsv
1749_plates.tsv
1749_small.tsv
1750_medium.tsv
1750_small.tsv
1751_medium.tsv
1751_plates.tsv
1751_small.tsv
1752_medium.tsv
1752_plates.tsv
1752_small.tsv
1753_medium.tsv
1753_small.tsv
1754_medium.tsv
1754_plates.tsv
1754_small.tsv
1755_medium.tsv
1755_small.tsv
1756_medium.tsv
1756_plates.tsv
1756_small.tsv
1757_medium.tsv
1757_plates.tsv
1757_small.tsv
1758_small.tsv
1759_medium.tsv
1759_small.tsv
1760_medium.tsv
1760_plates.tsv
1760_small.tsv
1761_medium.tsv
1761_plates.tsv
1761_small.tsv
1762_medium.tsv
1762_plates.tsv
1762_small.tsv
1763_medium.tsv
1763_plates.tsv
1763_small.tsv
1764_medium.tsv
1764_plates.tsv
1764_small.tsv
1765_medium.tsv
1765_plates.tsv
1765_small.tsv
1766_medium.tsv
1766_plates.tsv
1766_small.tsv
1767_medium.tsv
1767_plates.tsv
1767_small.tsv
1768_medium.tsv
1768_plates.tsv
1768_small.tsv
1769_medium.tsv
1769_plates.tsv
1769_small.tsv
1770_medium.tsv
1770_plates.tsv
1770_small.tsv
1771_medium.tsv
1771_plates.tsv
1771_small.tsv
1772_medium.tsv
1772_plates.tsv
1772_small.tsv
1773_medium.tsv
1773_plates.tsv
1773_small.tsv
1774_medium.tsv
1774_plates.tsv
1774_small.tsv
1775_medium.tsv
1775_plates.tsv
1775_small.tsv
1776_medium.tsv
1776_plates.tsv
1776_small.tsv
1777_medium.tsv
1777_plates.tsv
1777_small.tsv
1778_medium.tsv
1778_plates.tsv
1778_small.tsv
1779_medium.tsv
1779_plates.tsv
1779_small.tsv
1780_medium.tsv
1780_plates.tsv
1780_small.tsv
1781_medium.tsv
1781_plates.tsv
1781_small.tsv
1782_medium.tsv
1782_plates.tsv
1782_small.tsv
1783_medium.tsv
1783_plates.tsv
1783_small.tsv
1784_medium.tsv
1784_plates.tsv
1784_small.tsv
1785_medium.tsv
1785_plates.tsv
1785_small.tsv
1786_medium.tsv
1786_small.tsv
1787_medium.tsv
1787_plates.tsv
1787_small.tsv
1788_medium.tsv
1788_plates.tsv
1788_small.tsv
1789_medium.tsv
1789_plates.tsv
1789_small.tsv
1790_medium.tsv
1790_small.tsv
1791_medium.tsv
1791_plates.tsv
1791_small.tsv
1792_medium.tsv
1792_plates.tsv
1792_small.tsv
1793_medium.tsv
1793_plates.tsv
1793_small.tsv
1794_medium.tsv
1794_plates.tsv
1794_small.tsv
1795_medium.tsv
1795_plates.tsv
1795_small.tsv
1796_medium.tsv
1796_plates.tsv
1796_small.tsv
1797_medium.tsv
1797_plates.tsv
1797_small.tsv
1798_medium.tsv
1798_plates.tsv
1798_small.tsv
1799_medium.tsv
1799_plates.tsv
1799_small.tsv
1800_medium.tsv
1800_plates.tsv
1800_small.tsv
1801_medium.tsv
1801_plates.tsv
1801_small.tsv
1802_medium.tsv
1802_plates.tsv
1802_small.tsv
1803_medium.tsv
1803_plates.tsv
1803_small.tsv
1804_medium.tsv
1804_plates.tsv
1804_small.tsv
1805_medium.tsv
1805_plates.tsv
1805_small.tsv
1806_medium.tsv
1806_plates.tsv
1806_small.tsv
1807_medium.tsv
1807_plates.tsv
1807_small.tsv
1808_medium.tsv
1808_plates.tsv
1808_small.tsv
1809_medium.tsv
1809_plates.tsv
1809_small.tsv
1810_medium.tsv
1810_plates.tsv
1810_small.tsv
1811_medium.tsv
1811_plates.tsv
1811_small.tsv
1812_medium.tsv
1812_plates.tsv
1812_small.tsv
1813_medium.tsv
1813_plates.tsv
1813_small.tsv
1814_medium.tsv
1814_plates.tsv
1814_small.tsv
1815_medium.tsv
1815_plates.tsv
1815_small.tsv
1816_medium.tsv
1816_plates.tsv
1816_small.tsv
1817_medium.tsv
1817_plates.tsv
1817_small.tsv
1818_medium.tsv
1818_plates.tsv
1818_small.tsv
1819_medium.tsv
1819_plates.tsv
1819_small.tsv
1820_medium.tsv
1820_plates.tsv
1820_small.tsv
1821_medium.tsv
1821_plates.tsv
1821_small.tsv
1822_medium.tsv
1822_plates.tsv
1822_small.tsv
1823_medium.tsv
1823_plates.tsv
1823_small.tsv
1824_medium.tsv
1824_plates.tsv
1824_small.tsv
1825_medium.tsv
1825_plates.tsv
1825_small.tsv
1826_medium.tsv
1826_plates.tsv
1826_small.tsv
1827_medium.tsv
1827_plates.tsv
1827_small.tsv
1828_medium.tsv
1828_plates.tsv
1828_small.tsv
1829_medium.tsv
1829_plates.tsv
1829_small.tsv
1830_medium.tsv
1830_plates.tsv
1830_small.tsv
1831_medium.tsv
1831_plates.tsv
1831_small.tsv
1832_medium.tsv
1832_plates.tsv
1832_small.tsv
1833_medium.tsv
1833_plates.tsv
1833_small.tsv
1834_medium.tsv
1834_plates.tsv
1834_small.tsv
1835_medium.tsv
1835_plates.tsv
1835_small.tsv
1836_medium.tsv
1836_plates.tsv
1836_small.tsv
1837_medium.tsv
1837_plates.tsv
1837_small.tsv
1838_medium.tsv
1838_plates.tsv
1838_small.tsv
1839_medium.tsv
1839_plates.tsv
1839_small.tsv
1840_medium.tsv
1840_plates.tsv
1840_small.tsv
1841_medium.tsv
1841_plates.tsv
1841_small.tsv
1842_medium.tsv
1842_plates.tsv
1842_small.tsv
1843_medium.tsv
1843_plates.tsv
1843_small.tsv
1844_medium.tsv
1844_plates.tsv
1844_small.tsv
1845_medium.tsv
1845_plates.tsv
1845_small.tsv
1846_medium.tsv
1846_plates.tsv
1846_small.tsv
1847_medium.tsv
1847_plates.tsv
1847_small.tsv
1848_medium.tsv
1848_plates.tsv
1848_small.tsv
1849_medium.tsv
1849_plates.tsv
1849_small.tsv
1850_medium.tsv
1850_plates.tsv
1850_small.tsv
1851_medium.tsv
1851_plates.tsv
1851_small.tsv
1852_medium.tsv
1852_plates.tsv
1852_small.tsv
1853_medium.tsv
1853_plates.tsv
1853_small.tsv
1854_medium.tsv
1854_plates.tsv
1854_small.tsv
1855_medium.tsv
1855_plates.tsv
1855_small.tsv
1856_medium.tsv
1856_plates.tsv
1856_small.tsv
1857_medium.tsv
1857_plates.tsv
1857_small.tsv
1858_medium.tsv
1858_plates.tsv
1858_small.tsv
1859_medium.tsv
1859_plates.tsv
1859_small.tsv
1860_medium.tsv
1860_plates.tsv
1860_small.tsv
1861_medium.tsv
1861_plates.tsv
1861_small.tsv
1862_medium.tsv
1862_plates.tsv
1862_small.tsv
1863_medium.tsv
1863_plates.tsv
1863_small.tsv
1864_medium.tsv
1864_plates.tsv
1864_small.tsv
1865_medium.tsv
1865_plates.tsv
1865_small.tsv
1866_medium.tsv
1866_plates.tsv
1866_small.tsv
1867_medium.tsv
1867_plates.tsv
1867_small.tsv
1868_medium.tsv
1868_plates.tsv
1868_small.tsv
1869_medium.tsv
1869_plates.tsv
1869_small.tsv
1870_medium.tsv
1870_plates.tsv
1870_small.tsv
1871_medium.tsv
1871_plates.tsv
1871_small.tsv
1872_medium.tsv
1872_plates.tsv
1872_small.tsv
1873_medium.tsv
1873_plates.tsv
1873_small.tsv
1874_medium.tsv
1874_plates.tsv
1874_small.tsv
1875_medium.tsv
1875_plates.tsv
1875_small.tsv
1876_medium.tsv
1876_plates.tsv
1876_small.tsv
1877_medium.tsv
1877_plates.tsv
1877_small.tsv
1878_medium.tsv
1878_plates.tsv
1878_small.tsv
1879_medium.tsv
1879_plates.tsv
1879_small.tsv
1880_medium.tsv
1880_plates.tsv
1880_small.tsv
1881_medium.tsv
1881_plates.tsv
1881_small.tsv
1882_medium.tsv
1882_plates.tsv
1882_small.tsv
1883_medium.tsv
1883_plates.tsv
1883_small.tsv
1884_medium.tsv
1884_plates.tsv
1884_small.tsv
1885_medium.tsv
1885_plates.tsv
1885_small.tsv
1886_medium.tsv
1886_plates.tsv
1886_small.tsv
1887_medium.tsv
1887_plates.tsv
1887_small.tsv
1888_medium.tsv
1888_plates.tsv
1888_small.tsv
1889_medium.tsv
1889_plates.tsv
1889_small.tsv
1890_medium.tsv
1890_plates.tsv
1890_small.tsv
1891_medium.tsv
1891_plates.tsv
1891_small.tsv
1892_medium.tsv
1892_plates.tsv
1892_small.tsv
1893_medium.tsv
1893_plates.tsv
1893_small.tsv
1894_medium.tsv
1894_plates.tsv
1894_small.tsv
1895_medium.tsv
1895_plates.tsv
1895_small.tsv
1896_medium.tsv
1896_plates.tsv
1896_small.tsv
1897_medium.tsv
1897_plates.tsv
1897_small.tsv
1898_medium.tsv
1898_plates.tsv
1898_small.tsv
1899_medium.tsv
1899_plates.tsv
1899_small.tsv
1900_medium.tsv
1900_plates.tsv
1900_small.tsv
1905_plates.tsv
1905_small.tsv
1906_plates.tsv
1907_plates.tsv
1907_small.tsv
1908_small.tsv
1910_small.tsv
1911_medium.tsv
1911_plates.tsv
1911_small.tsv
1912_medium.tsv
1912_plates.tsv
1912_small.tsv
1913_plates.tsv
1914_small.tsv
1916_small.tsv
1917_medium.tsv
1917_plates.tsv
1917_small.tsv
1918_plates.tsv
1918_small.tsv
1919_medium.tsv
1919_plates.tsv
1919_small.tsv
1920_medium.tsv
1920_plates.tsv
1920_small.tsv
1921_medium.tsv
1921_plates.tsv
1921_small.tsv
1922_medium.tsv
1922_plates.tsv
1922_small.tsv
1923_plates.tsv
1923_small.tsv
1925_medium.tsv
1925_plates.tsv
1925_small.tsv
1926_medium.tsv
1926_plates.tsv
1926_small.tsv
1927_medium.tsv
1927_small.tsv
1928_small.tsv
1946_small.tsv
LICENSE
README.md
book_list__NB_encoding_issues.csv
book_metadata.json
image_counts_by_date.csv
imagesonline_data.json
plot_sizes.py
size_distribution.png
size_distribution.py
sizecounts.json
unknown_medium.tsv
unknown_plates.tsv
unknown_small.tsv

README.md

Flickr Common Manifests

Manifests of the public domain images uploaded to Flickr Commons, with descriptive information about the books they were taken from.

Please read the following for a better idea of why we are doing this:

http://britishlibrary.typepad.co.uk/digital-scholarship/2013/12/a-million-first-steps.html

Structure

book_metadata.json

A large hash in the following form:

{
"000000037" : {  ... bundle of metadata for book with ID 000000037 ... },
"000000206" : { ... etc ... },
...
}

The fields are as follows:

'identifier' - The book ID, eg 000000206
'title' - a bit of a misnomer. The book might have more than a single title attributed to it,
          and other details, inferred by a cataloguer/librarian might be added to it.
          Typically, these addition details will be enclosed by '[]' brackets
'authors' - (Named people who are 'personal' contributors). If the metadata states a particular
            role should be attributed to them, then this is marked also.
'corporate' - as above, but corporate bodies rather than individuals.
'place' - Place of publishing or manufacture
'datefield' - The details from the published date field
'date' - A date inferred by me by sweeping through fields where this information may likely hide such as
         'publisher'.
'publisher' - The stated publisher of the work
'edition' - Edition of the work
'issuance' - Issuance, typically 'monograph'
'shelfmarks' - Shelfmark, or marks of where the physical original 'lives'.
'flickr_url_to_book_images' - link to the tag page that shows all the images taken from this book

Most fields, except 'date', 'edition', 'issuance', are potential multivalued and have been generated as lists of values ordered in the same manner that they were in the metadata that accompanied these scans.

NB The metadata is for all the books that were scanned as part of the Microsoft Live Search Books project. Not all of these books had illustrations in them that were detected. The 'flickr_url_to_book_images' field is generated from the identifier of the book, and so there may be nothing on Flickr for that book!

[YEAR]_[Image size].tsv

All TSV files are in UTF-8 encoding and are split by year, and by size of illustration.

  • Small images are anything below 800x600 (480,000 in pixel area) This has nothing to do with the aspect ratio of the image i.e. they can be long and thin.
  • Medium are between small and 'plate' size
  • 'Plates' are any images larger than 1000x1000 (1,000,000 pixel area)

Each image is represented by a single row in the manifest. The columns are:

flickr_id:       The 'photo' identifier on flickr
flickr_url:      A handy URL to the image for convenience
book_identifier: The internal 'sysnum' for the record of the book in the BL's cataloguing system
title:           The title of the work the image was drawn from
first_author:    The first listed author/contributor in the work's record
pubplace:        Place of Publication
publisher:       Publisher
date:            Date of Publication
volume:          Which book volume the image was taken from 
page:            Which page
image_idx:       What image number on the page (useful when multiple are present. Arbitrary but unique to an image.)
ARK_id_of_book:  ARK identifier for the digitised version of the work [NB known ~20% of the time]
BL_DLS_ID:       Digital Library Service identifier.(Starts with 'lsidyv...') [NB known ~20% of the time]
 - And, thanks to [Aaron Straup Cope](@straup), the rows now include direct links to the files, as well as the pixel sizes of them:
flickr_original_source:    URL to jpg file (the original, and largest resolution)
flickr_original_height:    Height in px of original
flickr_original_width:     Width in px of original
flickr_large_source:       And so on.
flickr_large_height
flickr_large_width
flickr_medium_source
flickr_medium_height
flickr_medium_width
flickr_small_source
flickr_small_height
flickr_small_width 

NB As @straup himself notes, this adds bloat to the list and I agree with him on that, but also on the fact that this keeps it simple and grokkable and should allow anyone else wanting to do stats on the set to not have to hit Flickr's API to get this sort of info.

You can retrieve the PDF of the book by appending the BL_DLS_ID to the following URL:

http://access.bl.uk/item/pdf/...

e.g. from the first line of '1846_plates.tsv':

11047063964     http://www.flickr.com/photos/britishlibrary/11047063964 001365762       Travels in the interior of Brazil, principally through the northern provinces and the Gold and Diamond districts, 1838-41       GARDNER, George F.L.S   London          1846    0       0000241        ark:/81055/vdc_000000056040     lsidyv3c0ae38a

You can get the PDF of "Travels in the interior of Brazil, principally through the northern provinces and the Gold and Diamond districts, 1838-41" by GARDNER, George F.L.S by going to the following URL:

http://access.bl.uk/item/pdf/lsidyv3c0ae38a