Skip to content

arXiv Search v0.1

Choose a tag to compare

@erickpeirson erickpeirson released this 17 Apr 15:41
a790b85

Release notes - arXiv-NG - Version search-0.1

Sub-task

  • [ARXIVNG-10] - Examples (documented in Confluence) and team feedback
  • [ARXIVNG-11] - Comb user surveys, admin team, and wishlist for possible new/improved features
  • [ARXIVNG-12] - Liz + developer session for understanding arXiv search needs as they exist
  • [ARXIVNG-13] - Writeup of criteria/requirements for search UI/UX
  • [ARXIVNG-14] - Wireframes for search, possibly in phased-release designs
  • [ARXIVNG-15] - Full UI design prototype
  • [ARXIVNG-18] - Prototype CSS/JS application for search UI
  • [ARXIVNG-109] - Replacement for "advanced" search interface
  • [ARXIVNG-110] - Replacement for search results view (/find)
  • [ARXIVNG-111] - Replacement for freeform author name search view
  • [ARXIVNG-127] - Set up initial Flask application and blueprint
  • [ARXIVNG-184] - Update transform module and/or DocumentMapping to be consistent
  • [ARXIVNG-185] - Investigate mappings for secondary classification
  • [ARXIVNG-187] - Come up with a plan for document analysis
  • [ARXIVNG-188] - In freeform search input, if query looks like an arXiv ID, try to get that
  • [ARXIVNG-189] - Implement pagination & sorting in controller(s) and template
  • [ARXIVNG-190] - Update document mapping and schema re publication date
  • [ARXIVNG-196] - Implement query builder
  • [ARXIVNG-203] - Connect mini search box in baseUI template to a form

Bug

  • [ARXIVNG-283] - Sorting is broken in author search
  • [ARXIVNG-297] - Pagination is broken for high-numbered pages
  • [ARXIVNG-322] - Whitespace around search input not being stripped
  • [ARXIVNG-336] - /docmeta(_bulk) returns wrong value for announced_date_first field for some old paper IDs
  • [ARXIVNG-337] - Go button on results page falls off screen horizontally for mobile
  • [ARXIVNG-385] - Term1 term2* in journal reference field produces no results
  • [ARXIVNG-409] - Hit highlight color contrast is not accessibility compliant

New Feature

  • [ARXIVNG-186] - Index all versions of papers and separately index the latest version
  • [ARXIVNG-298] - When user enters data in linked fields, their parent checkbox should be automatically checked.
  • [ARXIVNG-299] - Expose all* of the fields that we index in advanced search, barring some weird/problematic ones.
  • [ARXIVNG-300] - UI should handle search index connection problems
  • [ARXIVNG-301] - Dates: make selection checkboxes into radio buttons
  • [ARXIVNG-303] - Add help text about submission date
  • [ARXIVNG-305] - Stack fields on simple search page for mobile
  • [ARXIVNG-306] - Collapse authors when more than 25 names, especially for mobile
  • [ARXIVNG-331] - Create /docmeta_bulk endpoint that returns docmeta for multiple paper ids
  • [ARXIVNG-370] - Hit highlighting for search
  • [ARXIVNG-371] - Add DOI, Record number, Jref, abstract to search results
  • [ARXIVNG-379] - Some parameters should propagate between searches

Task

  • [ARXIVNG-5] - Generate a set of user stories and behavioral requirements about searching
  • [ARXIVNG-6] - Wireframe UI design for search interface
  • [ARXIVNG-7] - Generate a behavioral test-suite for search
  • [ARXIVNG-8] - Prototype schema for search index
  • [ARXIVNG-9] - Implement a Catalyst controller that exposes paper metadata in JSON
  • [ARXIVNG-19] - Implement module for transforming metadata to search document
  • [ARXIVNG-20] - Implement module for Elasticsearch integration
  • [ARXIVNG-21] - Implement module for retrieving publication metadata from arXiv classic system
  • [ARXIVNG-24] - Implement module for retrieving plain text content
  • [ARXIVNG-56] - Update docmeta controller to include additional submitter and other metadata
  • [ARXIVNG-64] - Create workflow maps that represent the user stories for search
  • [ARXIVNG-126] - Generate some mock data for search
  • [ARXIVNG-153] - Transform module should use all available metadata
  • [ARXIVNG-165] - Implement pagination in search query controller
  • [ARXIVNG-167] - Implement sort in search query controller
  • [ARXIVNG-175] - Update /abs to link to new search
  • [ARXIVNG-194] - Create tests for API behavior
  • [ARXIVNG-261] - Add linting to arxiv-search
  • [ARXIVNG-280] - Deploy search prototype to beta.arxiv.org
  • [ARXIVNG-282] - Clean up minor UI issues for search templates
  • [ARXIVNG-284] - Update arXiv search documentation
  • [ARXIVNG-285] - Add mypy to lint checks
  • [ARXIVNG-291] - Reintroduce title_utf8 in /docmeta response and in document map
  • [ARXIVNG-292] - Load testing for arxiv-search
  • [ARXIVNG-293] - Update mypy checks on arxiv-search to use arxiv-zero/mypy.ini
  • [ARXIVNG-294] - Accessibility scan and fix form labels
  • [ARXIVNG-304] - Update search templates to use arXiv-hosted MathJax and configuration
  • [ARXIVNG-307] - Remove institution from author display in search results
  • [ARXIVNG-308] - Offer optional full-name search (parallel to forename/surname)
  • [ARXIVNG-309] - Include owner-authors in all author queries
  • [ARXIVNG-310] - Add help text explaining the limitations and options around author search.
  • [ARXIVNG-311] - Wider margins required on the results page to use best design practices for scanning/reading of text.
  • [ARXIVNG-312] - Implement bulk indexing
  • [ARXIVNG-317] - Implement round-robin requests for metadata retrieval
  • [ARXIVNG-323] - Improve test coverage for process and index service modules
  • [ARXIVNG-324] - Generate UI test criteria and execute manually
  • [ARXIVNG-325] - Deploy search to /search-beta route on production system
  • [ARXIVNG-326] - Identify and create user feedback mechanism
  • [ARXIVNG-327] - Generate five-second user feedback questions
  • [ARXIVNG-328] - Implement user feedback collection mechanism(s)
  • [ARXIVNG-330] - Security review
  • [ARXIVNG-332] - Implement bulk retrieval method in metadata service
  • [ARXIVNG-333] - Implement Dockerfile for search agent
  • [ARXIVNG-334] - Implement static file deployment
  • [ARXIVNG-335] - Update search to base-0.3
  • [ARXIVNG-338] - Replace requirements/... with pipenv
  • [ARXIVNG-365] - Lead discussion of author search test cases
  • [ARXIVNG-366] - Blog post that communicates the search milestones
  • [ARXIVNG-367] - Supporting proceedings index page links to report numbers
  • [ARXIVNG-368] - Update help text to reflect Journal Reference field behavior
  • [ARXIVNG-369] - Default option for search to be chronological most recent -> least recent
  • [ARXIVNG-372] - Refactor author name search
  • [ARXIVNG-373] - Search service log output should be consistent with arXiv standard logging format, and free of tracebacks
  • [ARXIVNG-377] - Label the + box on advanced search page
  • [ARXIVNG-378] - Add toggle for whether to include all versions
  • [ARXIVNG-383] - Add "all fields" as option in advanced search
  • [ARXIVNG-384] - Add comma for thousands separator
  • [ARXIVNG-401] - Implement health check endpoint
  • [ARXIVNG-402] - Document search UI with screenshots
  • [ARXIVNG-414] - Update arXiv base header template to include all fields listed in classic template
  • [ARXIVNG-415] - Update classic template header to point to /search instead of /find
  • [ARXIVNG-416] - When bad sort or page size parameters are passed to search views, a 400 Bad Request should be returned with a link back to the search page.
  • [ARXIVNG-417] - Rename drop-down labels (identifier, author id) in search interface
  • [ARXIVNG-418] - Single-character wildcard (?) does not appear to work in title and abstract
  • [ARXIVNG-419] - Deploy indexing agent in k8s
  • [ARXIVNG-420] - Deploy notification generation on classic
  • [ARXIVNG-421] - Write up deprecation notice for classic search
  • [ARXIVNG-422] - Research potential options for easy feedback collection from users
  • [ARXIVNG-423] - Add some helper fields to docmeta responses

Story

  • [ARXIVNG-108] - Search application should replace existing search views on arXiv.org
  • [ARXIVNG-166] - When browsing search results, users should be able to progress through numbered pages of results
  • [ARXIVNG-168] - When browsing search results, users should be able to sort results
  • [ARXIVNG-262] - Search interfaces should support wildcards
  • [ARXIVNG-380] - Default results per page should be 50
  • [ARXIVNG-381] - MathJax should only target title and abstract in search results
  • [ARXIVNG-382] - Date range filter in advanced search should support variable precision