Home

Scraper - A Composable Taskflow Framework

Scraper is a framework which enables flow-based programming in a declarative way. It is based on two main components: the core which translates the declarative description into a format that is understood by the framework, and the actual nodes which can be composed to construct a workflow. The workflow specification is statically checked to ensure that the configuration is well-typed against the composition of nodes.

The main goal of this framework is to facilitate reuse of code (nodes) and help managing control flow of programs in an easy way (control flow graph).

A recent Java version is recommended.

For more information, visit the quick start guide if you want to use the framework or the developer's quick start guide if you want to contribute to the project.

There is also a quick overview over existing features.

Links

• Scraper Git
• Scraper Node Documentation
  • The documentation contains all nodes, including extra nodes, not only the nodes in the core framework
• Scraper Wiki
• Scraper Releases and Plugins
• Scraper Editor (prototype, deprecated)

FAQ

• Which Java versions are supported?
  • Only Java 11 and higher is supported

Publications

• Master's Thesis, Formal Semantics for Composable Workflows for Scraper, Technische Universität Kaiserslautern and Kyoto University, supervised by Dr. rer. nat. Annette Bieniusa (TUK), Prof. Dr. Arnd Peotzsch-Heffter (TUK), Prof. Dr. Atsushi Igarashi (Kyoto University) (pdf)

Talks

• 04.02.2020 Progress Presentation, Kaiserslautern, TUK (pdf)
• 17.07.2019 Master's Defense, Kaiserslautern, Technische Universität Kaiserslautern (pdf)
• 14.05.2019 Kaiserslautern, Technische Universität Kaiserslautern
• 11.12.2018 金沢 (Kanazawa, Japan) (pdf)
• 5.11.2018 京都大学　(Kyoto University, Japan)
• Kaiserslautern, Technische Universität Kaiserslautern