Lagotto 5.0.1 (April 12, 2016)
Lagotto 5.0.1 was released on April 12, 2016. This release includes breaking changes, users of Lagotto 4.x should wait for Lagotto 5.2, which will provide an upgrade path for 4.x users.
The following changes were made:
In Lagotto 5.0 the functionality of sources is broken into two different models:
- agents collect information from external APIs
- sources provide this information via the Lagotto API
One consequence of this split of functionality is that agents can now be external to the Lagotto application.
Another consequence is that agents no longer need to do API calls for every single work, but can import data in bulk. This dramatically improves performance.
The new deposits API provides a common way to import data into Lagotto from external APIs. Import of data via rake task, as in previous Lagotto versions, is no longer supported in Lagotto 5.0. The deposits API is also used by the built-in Lagotto agents.
The deposits API is generic enough to allow not only the import of works, but also publishers and contrbutors.
Added automatic import of publisher information from Crossref and DataCite (#430).
- use berkshelf instead of librarian to manage cookbooks (#408)
- added packer support (#409)
- upload .env file before starting capistrano (#410)
- import DataCite DOIs that include relatedIdentifiers (#414)
- added agent to extract ORCID identifiers from DataCite metadata (#416)
- fetch DOI and ORCID metadata right before validation (#418)
- added namae gem for more consistent name parsing (#419)
- created datacite_github agent (#424)
- created crossref_orcid agent (#425)
- removed CouchDB code (#429)
- added jwt authentication (#436)
- use sidekiq with connection_pool (#446)
- added support for master-slave db configuration (#447)
- upgraded to sidekiq 4 (#449)
- removed persona authentication support (#457)
- add templates for crossref, allowing organization-specific headers, footers and CSS (#463)
- added httplog for http request logging (#464)
- use only one standard filename for .env file (#466)
- removed events by day (#468)
- use iso8601 instead of date-parts for publication date (#490)
- normalize all DOI forms when processing deposit (#491)
- added separate sources for html views and pdf downloads (#495)
- redefined groups for sources (#500)
- set sidekiq log level via ENV variable (#520)
Lagotto 4.3 was released on July 20, 2015 with the following changes:
- created snapshop of Lagotto JSON API responses for works, that is then automatically deposited in Zenodo (#343)
- fixed failing rspec acceptance tests (#380)
- added registration_agency check to some sources (#381)
- added foreign_key constraints (#382)
- added DataONE identifier (#384)
- added two sources for DataONE usage stats (#394)
- enamed Github organization from
- fixed nginx installation issue where nodejs can't be found (#399)
JSON API snapshots
The snapshots of the Lagotto JSON API require the same ENV variables as the CSV export. Run
bundle exec rake api:snapshot:all to create the snapshots and export them to Zenodo. More information is available in the
This release adds foreign keys (supported in Rails core since Rails 4.2) to the database to enforce referential integrity.
Registration agency checks
Some sources now check for the work registration agency, allowing different functionality, e.g. for CrossRef or DataCite DOIs.
DataONE usage stats
This release adds two sources that collect usage stats from the DataONE repository network. The
dataone_counter source collects COUNTER-compliant usage stats, whereas the
dataone_usage source also includes machine usage from some useragents.
Lagotto 4.2 was released on July 13, 2015 with the following changes:
- export CSV summary report to Zenodo data repository (#339)
- process pmc import and parsing in the background (#363)
- allow wildcard searches for works in the API and admin frontend (#368)
- added missing author information to v6 API (#370)
- make sure DOIs are stored in lowercase(#372)
- optionally load all DataONE member nodes as publishers (#374)
- added methods to fetch metadata for DataCite DOIs, and to look up the DOI registration agency (#376)
- added registration agency column to works (#377)
- store temporary files in tmp folder (#378)
- fixed name inconsistencies for EuropePMC sources (#379)
The following new ENV variables must be set in the
.env file to use the new Zenodo export functionality:
CREATOR=Public Library of Science ZENODO_KEY=YOUR_KEY_HERE ZENODO_URL=https://zenodo.org/api/ #ZENODO_URL=https://sandbox.zenodo.org/api/ for testing SITENAMELONG="PLOS ALM"
ZENODO_KEY can be obtained by creating a Zenodo account and then a personal access token on the profile page.
Lagotto 4.1 was released on June 17, 2015 with the following changes:
/heartbeatendpoint to use sinatra so that it works if the database is down (#302)
- fixed a bug in source and publisher caching (#306)
- upgraded source to use v.1.2 ORCID API (#308)
- fetch metadata from pubmed if there is a pmid but no doi (#309)
- added recommendations, similar works that are also tracked (#310)
- use CrossRef REST API for metadata of articles fetched via CrossRef CitedBy (#312)
- use CrossRef date indexed if date issued is in the future (#314)
- pass member id as integer to CrossRef REST API, fixing a CrossRef import issue (#320)
- optionally serve v3 API responses for single works as array for backward compatibility (#321)
- upgraded capistrano gem, use capistrano-passenger (#323)
- workaround to support 4-byte utf-8 characters, e.g. emojis (#324)
- allow update of works on import (#325)
- added optional Bugsnag error tracking, using two
- use different path for RSS urls rather than file extension
- handle timeout errors more gracefully (#330)
- avoid ActiveRecord connection pool issues (#331)
- automatically track metrics for works from article_coverage_curated source (#332)
- use http://doi.org instead of http://dx.doi.org for encoding DOIs as URLs (#333)
- use http URI of the primary identifier as the PID in the API (#334)
- automatically track metrics for blog posts referencing a work (#335)
- automatically track metrics for works mentioned in the body of another work, using the sources
This release includes numerous other small bug fixes. While the release fixes on bug fixes, new features were also introduced:
A list of similar works that we also track, generated by common relations, e.g. other works tracked by Lagotto cited
by the same paper or bookmarked in the same ORCID profile. Available in the v6 API, e.g. here.
Identifiers as URIs
Starting with this release, the
id for a work in the v6 API will always be a URL, e.g.
http://doi.org/10.1371/journal.pmed.1000097, and the use of
dx.doi.org has been
doi.org in all places.
Lagotto 4.1 adds support for second-order events, i.e. it will track news items and blog posts that discuss a work in Lagotto.
We do the same for scholarly articles that mention a tracked work in the body text (where we can search the fulltext), e.g. informal citations to datasets.
Lagotto 3.20 was released on June 8, 2015 with the following changes: