A community-maintained ROS package index. (source code)
Branch: ros2
Clone or download
Pull request Compare This branch is 201 commits ahead of rosindex:master.
Fetching latest commit…
Cannot retrieve the latest commit at this time.
Permalink
Type Name Latest commit message Commit time
Failed to load latest commit information.
_config
_data Merge pull request #130 from ros-infrastructure/hidmic/augment-search… Feb 5, 2019
_includes
_layouts
_plugins Collect documentation images too (#143) Feb 15, 2019
_ruby_libs
_sass
_scripts
_stopwords
about
assets
bootstrap layout updates Feb 17, 2015
contribute Update About & Contribute (#99) Oct 26, 2018
css Addresses peer review comments. Sep 24, 2018
docker
js
node_modules Extend searching capabilities. Jan 8, 2019
.dockerignore
.gitignore Enable Intersphinx support - Take 2 (#88) Oct 24, 2018
404.html
CNAME
Gemfile
Gemfile.lock
LICENSE Create LICENSE Jul 27, 2017
Makefile Better Docker containers for build automation (#83) Oct 23, 2018
README.md
_config.yml
_config_devel.yml
about.md
contribute.md
feed.xml
google2363892c5dcb7a68.html
index.html
index.yml
privacy.txt
search.md Extend searching capabilities. Jan 8, 2019

README.md

ROS Index

A simple static index for known ROS packages. It builds in jekyll with a plugin to clone repositories containing ROS packages, scrapes them for information, and uses client-side javascript for quick searching and visualization.

ROS Index

Stories in Ready

Building the site

On an Ubuntu 16.04 box

Pre-Requisites

Dependencies
sudo sh -c 'echo "deb http://packages.ros.org/ros/ubuntu $(lsb_release -sc) main" > /etc/apt/sources.list.d/ros-latest.list'
apt-key adv --keyserver hkp://ha.pool.sks-keyservers.net:80 --recv-key 421C365BD9FF1F717815A3895523BAEEB01FA116
sudo apt-get update
sudo apt-get install curl git git-svn mercurial nodejs pandoc python3-vcstool
Ruby 2.2 via RVM
curl -L https://get.rvm.io | bash -s stable
# if this fails, add the PGP key and run again
source ~/.rvm/scripts/rvm
rvm requirements
rvm install ruby
rvm rubygems current
Node.js on Ubuntu 12.04
sudo apt-get install python-software-properties
sudo apt-add-repository ppa:chris-lea/node.js
sudo apt-get update
sudo apt-get install nodejs
Ruby Requirements
gem install bundler

Clone Source and Install Gems

git clone git@github.com:ros-infrastructure/rosindex.git --recursive
cd rosindex
bundle install

Clone repos that are part of rosdistro and build the index

Run:

make build

By default, site will be written to _site. This behavior can be overriden as follows:

make build site_path=/path/to/site

On the provided Ubuntu 16.04 container

Pre-requisites

Docker

See https://docs.docker.com/install/linux/ for details on docker installation.

Build docker image

docker/build.sh

Build the index inside the container

Run:

docker/run.sh
make build  # once inside the container

Or the following can be used as a shorthand:

docker/run.sh build_site

Skipping parts of the build

The build process entails four long-running steps:

  1. Generating the list of repositories
  2. Cloning / Updating the known repositories
  3. Scraping the repositories
  4. Generating the static pages
  5. Generating the lunr search index

Each of the first three steps can be skipped in order to save time when experimenting with different parts of the pipeline with the following flags in _config.yml:

# If true, this skips finding repos based on the repo sources
skip_discover: false
# If true, this skips updating the known repos
skip_update: false
# If true, this skips scraping the cloned repos
skip_scrape: false
# If true, this skips generating the search index
skip_search_index: false

Additionally, some make targets are provided for convenience:

  • To skip everything but repo discovering:

    make discover
  • To skip everything but repo updates:

    make update
  • To skip everything but repo scraping:

    make scrape
  • To skip everything but a search index build:

    make search-index

Note that skipping parts of the rosindex build does not interfere with Jekyll's build process (e.g. generated files are still written to site).

Serving the site

Serve the devel (tiny) version locally

Run:

make serve-devel

The following can be used as a shorthand if using docker containers:

docker/run.sh test_site

Serve the full version locally

Run:

make serve

Note: This requires a minimum of 30GB of free space for the checkout directory.

Deployment

Deployment is not managed by these tools. It is to be managed externally e.g. using a local repository as site destination.

ROS buildfarm integration

ROSIndex qualifies as independent documentation of 'external_site' type. Therefore, it can readily be built and deployed as Github Pages by a doc_independent job.