Firefly is an open-source web-based UI library for astronomical data archive access and visualization developed at Caltech. The development was started in the context of archive-specific applications at the NASA/IPAC Infrared Science Archive (IRSA), and was then generalized to serve data from many different archives at IRSA (and beyond). It was open sourced in 2015, hosted at GitHub.
Firefly is designed to build complex web-based front-end applications making use of reusable React components to enable accessing and exploring astronomical data with advanced data visualization capabilities.
The visualization provides user with an integrated experience with brushing and linking capabilities among images, catalogs, and plots. Firefly is used in IRSA GUIs to query and visualize data from missions such as WISE, Spitzer, SOFIA, ZTF, PTF, etc. and a large number of highly-used contributed data products from a diverse set of astrophysics projects. It is also used in various user interfaces of the NASA Exoplanet Science Institute (NExScI) and the NASA/IPAC Extragalactic Database (NED), as well as to construct the Portal Aspect of the Vera C. Rubin Observatory Science Platform.
The fastest way to start using Firefly and check examples is to make use of Docker images. See the Docker quick-start here.
Note - if you are pulling, look at the branches section
Firefly builds are available on Docker and additional notes for using it are on the Docker Page.
Firefly is being reused for various archives because it is a framework of archive components. This has allowed us to implement multiple archive systems at a fraction of the cost of the first system, Spitzer Heritage Archive. Firefly has undergone an extensive re-write since then, adopted React/Redux framework for the client side, making it much easier to work with other JavaScript libraries. Firefly's general scientific visualizations are based on the Plotly.js graphing library.
By default, this repository builds a default example webapp. This tool can be used for viewing FITS data, catalogs, and xyplots. It is a general viewer tool for retrieving and viewing astronomy related data.
Firefly APIs exposes the most powerful components of Firefly in a way that can be used by any web page with no prerequisites. It allows any web developer access to Firefly's FITS visualizers or Table Tool with just a very few lines of JavaScript. The goal is to make these APIs very easy to use with only a 10 minute learning curve.
An important feature is that the Firefly APIs server can be installed cross-site. In other words, it is not required to be on the same server as the web page. Firefly APIs can do this because it uses JSONP or CORS for the server communication. This allows Firefly APIs not to be limited by the server's Same Origin Policy and to give the developer a lot of flexibility. The web developer does not have to do any installation, but can simply just start using Firefly APIs.
The firefly components contain three main visualizers for astronomy data.
Firefly has implemented “Excel-like” tables on the webpage. In an easy, interactive way, a user can sort the results, filter the data on multiple constraints, hide or show columns, or select data for download or visualization. The Firefly APIs server is optimized to show very large tables without significant performance degradation. We have tested it with over 10 million rows, 50 column tables.
Firefly provides a first-class FITS visualization on the Web without any plugins. All of the significant components you would expect to see in a basic desktop FITS application are available with data that Firefly displays. The FITS visualizer allows for overplotting any table data with Lon(RA) and Lat(Dec). Therefore, users can overlay multiple catalogs over their FITS image and interact with it.
In addition, Firefly is able to display all-sky images in the IVOA standard HiPS format, and display catalogs overlaid on them just as with FITS images.
Firefly shows 2D graphs interactively so that a user can read the data point values as moves mouse around or zooms in to investigate the data at a finer level. These graphs are used for plotting table columns. The user can specify any column that the tables are showing. The user can also define expressions from the columns for the XY Plot, such as (col1*col2/tan(col3)). Table based charts share their data model with the table, so both table and chart can trigger or respond to the common events, such as filtering of the data. Firefly also supports creating and plotting 1D histograms and heatmaps (2D histograms).
There are several branches in the repository. Here are the ones that you should care about.
- rc-YYYY.N: The next release candidate branch. This is generally the most stable branch.
- dev: This branch could be updated every day. It is the active development branch. It is not stable. Nightly builds are performed.
- firefly-xxx-reason, IRSA-xxx: These branches are temporary development feature branches and are associated with corresponding tickets in IPAC Jira.
- Tags: Firefly is tagged for releases and pre-releases
- See Details on tags and branches
-
[Java 17] (https://jdk.java.net/17/) This is the version we are using to compile and run Firefly.
-
[Gradle 7.4] (https://gradle.org/install/) Gradle is an open source build automation system.
-
[Tomcat 9] (https://tomcat.apache.org/download-90.cgi) Apache Tomcat is an open source software implementation of the Java Servlet and JavaServer Pages technologies.
-
[Node v18] (https://nodejs.org/) Javascript interpreter for command line environment, used for development tools
- Make sure you have
<GRADLE>/bin,<JAVA>/bin, and<NODE>/binin your PATH. - Install yarn via npm: npm install yarn -g
First git clone the firefly repository or download the zip (and unzip) to your target machine. Then install the prerequisites (node, java, tomcat).
In a terminal, cd into the firefly directory, then run:
$ gradle :firefly:jar
This generates firefly.jar located at ./jars/build/. You may include this jar into your project to build advanced astronomy web applications.
In a terminal, cd into the firefly directory, then run:
$ gradle :firefly:war
To include the API documentation and tutorial into the war archive run:
$ gradle :firefly:warAll
This generates firefly.war located at ./build/dist/. Simply drop this file into your $CATALINA_HOME/webapps/ directory to deploy it. $CATALINA_HOME is your Tomcat server installation directory.
Goto http://localhost:8080/firefly to launch Firefly Viewer. The documentation is accessible via http://localhost:8080/firefly/docs/js/index.html
Firefly supports the following browsers:
- safari >= 12
- chrome >= 81
- firefox >= 79
- edge >= 83
See firefly-api-overview.md (Deprecated [docs/fftools-api-overview.md])
See firefly-api-code-examples.md (Deprecated [docs/fftools-api-code-examples.md])
See server-settings-for-fits-files.md