Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

3-year ROADMAP (new products and tools) #52

eplebel opened this issue Apr 16, 2019 · 0 comments

3-year ROADMAP (new products and tools) #52

eplebel opened this issue Apr 16, 2019 · 0 comments


Copy link

eplebel commented Apr 16, 2019

For RESEARCHERS (part of Curate Scholar product)

  • users can choose a specific transparency standard they want (or need) to comply with (& also automatic transparency compliance determination as user is curating article transparency, showing additional requirements needed to achieve a higher standard):
    1 0-T-standards-A-HD-new-format-may-2021
  • personalized gamification to nudge researchers toward making their articles more accessible (see accessibility standards below) AND transparent (i.e., adding links to open materials, data, code, etc.)
    • personalized gamification involves offering rewards tailored to a specific user, egs:
      • career stage: e.g., for ECRs, give achievement badges, points, leader boards, etc.; vs. for more established researchers, virtue signaling, philanthropy charity micro-donations, social proof angle, and/or "impact as motivation" (visual summary of how one's curated articles have helped others), reciprocity bias, spotlight effect, public commitment, empathy/compassion inducements,
      • personality type (or at least inferred personality type based on user behavior patterns), e.g., performance graphs (for less competitive personality types, given that performance graphs show transparent/accessibility behaviors compared to one's previous behaviors, rather than compared to other researchers (and this fits nicely with the plan to show one's transparency/accessibility improvements over time, instead or in addition to impact metrics). For overview of different kinds of (gamified) nudges, see



  • Interact w/ data & Code Ocean capsules directly within article list via full-screen mode (multi-panel mode: live demo (scroll down to "Registered Replication Report..." article card, hover over code badge (teal color), and click full-screen icon on the right of the CodeOcean URL)

  • Interactive CV (based on one's Curate Scholar's author page) w/ interactive article cards featuring interactive Transparency badges & impact metrics, and also featuring full-screen viewable full-text articles (exportable in various formats):


For REPLICATORS/Credibility curation

  1. Replication/replicability curation
  • study-level curation and improved replication taxonomy, including automatic methodological similarity categorization based on user ticking check boxes:
    6 0-article-page-HIW-HD

  • replication collection pages to track replicability of effects across distinct methods of observing/testing an effect (involving automatically updating meta-analytic estimates across subsets of replications based on transparency and key study characteristics)
    7 0-COLLECTION-page-HIW-HD
    Medical/COVID-19 example, more relevant to our CURATE Citizen product, whereby any citizen can track papers and evidence/replication collections related to topics, conditions, and diseases that are personally-relevant to them:

  1. Result reproducibility curation
  • curation and display of result reproducibility status of articles/studies):
  1. Result robustness curation (ambitious)
    [insert screenshot of rough paper mockups of study-level result robustness curation workflows...; e.g., UI to post crowd-sourced multiverse analyses of previously published findings; which goes beyond currently-offered article-level curation of articles reporting robustness re-analyses]


  • journal issue article list embed widget to make journals accountable given that any follow-up commentaries and replications added on CS will automatically be displayed in their journal issues article lists (see example articles in journal issue mockup below)!:
    10 0-journal-article-list-ABOUT-HD
    10 5-journal-article-list-ABOUT-HD-BMJ-Open

  • Journal article page transparency signaling UI designs

  • Including displaying article T & C within existing journal website (for journals who prefer keeping their legacy journal website issue layout, rather than using our article list issue widget):
    journal-website-integration-T- -C

  • journal submission portal article editor widget so journals can require transparency compliance (of their choosing) for submissions (& can also decide whether want to allow/do this 1. at submission, 2. after 1st round of review/per reviewer request, or 3. upon acceptance).
    10 75-journal-article-editor-widget-MP-A-HD
    11 0-T-leaderboards-JOURNALS-HD



12 0-uni-researcher-list-ABOUT-HD

  • This includes an admin dashboard for the university staff/prof in charge of ensuring all department articles meet minimum T standard within a certain time period (see below)
    12 5-uni-T-compliance-dashboard-A-HD




13 0-T-leaderboard-UNIS-HD


14 0-funders-grantee-list-CIHR-ABOUT-HD
14 0-funders-grantee-list-ABOUT-HD
14 0-funders-output-list-Gates

  • This also includes an admin dashboard for the funding agency staff in charge of ensuring that all grantee publications meet minimum T standard within a certain time period (just like admin dashboard for university librarian/staff, see prototype above under "For UNIS")


  • Funder grant review transparency standards that can be used globally by any funder (non-profit funder; publicly-funded government funding agencies), to ensure that their grant review processes are sufficiently transparent, hence ensuring the accountability of the funder to its stakeholders:



  • journal article CITATION popup prototype: hovering over in-text citation in an HTML article (or news article, blog post, etc.) displays the cited article's metadata & CS transparency info! (live demo)

  • for Journalists!: Embed the transparency and credibility information of a scientific article a journalist is reporting on for accountable science journalism (given that follow-up replications and critical commentaries will automatically be displayed)



  • user page (listing recent user contributions and contribution statistics)

  • allow non-admin users to add non-author page articles (& add “+ ADD” button on navbar)

    • but this requires to split current non-admin user type into 2 new non-admin user types:
      • editors: can add/edit any article (incl. articles claimed by authors), but cannot delete articles, even ones they themselves created.
      • users: can add/edit only new articles that they themselves added; if author claims (i.e., links to their author page) a user-created article, user loses ability to edit that article (but a message is displayed saying they can become editors by achieving a certain curation milestone).
  • Create embedabble article lists:

    • use cases: article lists for courses; topic-based for general reference; references lists for interactive HTML articles; publicly editable crowdsourced article lists (e.g., Brent Roberts open science article list)).
  • article list NEWS FEEDS (see paper mockup)

    • similar to article lists, except it's an automatically updating (& embeddable) article list resulting from a filtered search query! Use cases: university websites, conference website, etc. (but this only useful once our DB is sufficiently large)
  • tracked content page to automatically be notified of new transparency-compliant articles and replications in one's research area:

  • lab pages: article lists of authors/researchers belonging to the same lab (w/ lab info input boxes at the top) (live demo)

  • author page topic tagging filtering (e.g., see T. Griffiths’ website)

  • upload files to OSF via CS interface (via user-authorized API)

  • web scraping

    • open content URLs and open access PDF/HTML URLs from most transparent top journals (e.g., PSCI, Cognition, etc.)
    • automatic updating of citations (via GS) and open content/preprint metrics (via OSF API)


Various integrations

  • Wikipedia Curate Science integration: Embed a Curate Science article card within Wikipedia citation tooltips:
  • Zotero integration to display any transparency and/or credibility information based on article DOI
  • Web browser plug to display any transparency and/or credibility information based on article DOI

2 0-article-card-ecosys-HD

0 4 0-release-beautiful-on-all-devices

@eplebel eplebel changed the title next 3 batches of new features & feature improvements next batches of features & feature improvements (& ROADMAP) Jun 7, 2019
@eplebel eplebel changed the title next batches of features & feature improvements (& ROADMAP) 3-year ROADMAP (new products and features) Mar 24, 2020
@eplebel eplebel changed the title 3-year ROADMAP (new products and features) 3-year ROADMAP (new products and tools) May 27, 2020
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
None yet
None yet

No branches or pull requests

1 participant