Join GitHub today
GitHub is home to over 28 million developers working together to host and review code, manage projects, and build software together.Sign up
Texera is a system to support big text analytics as a Web-based service by using declarative GUI-based interactive workflows.
Many text analysts need to spend a significant amount of effort on low-level computation such as keyword search, regular expressions and dictionary-based matching. and natural language processing (NLP). There are new ML and NLP algorithms and packages available for text analysis, resulting in a higher demand for analysts to use these techniques in their domain. These tasks are especially tough for non-IT community due to their lack of IT background, limited programming skills, and no knowledge to set up and maintain a computing infrastructure for large-scale text analytics.
The available workflow based analysis systems are not scalable. They are mostly softwares that run on a single machine and their architecture doesn't support huge data. Also, the existing systems support little or no interaction during the execution of the workflow. They face the long running time and lack of debugging tools, and need to re-run the program after making just some minor changes.
- Provide text analytics as cloud services so users do not need to download software and do periodic updates and patches. Plus sharing becomes much easier;
- Provide a browser-based GUI for developers to form a workflow plan declaratively without writing code;
- Allow non-IT people to do text anlytics.
- Increase productivity of text analytics.
- Support huge volumes of data efficiently.
- Allow users to interact with the workflow, pause/resume and debug it during the execution.
Sample Workflow Plan
The following is a workflow formulated using the Texera GUI in a Web browser. It consists of a workflow of basic operators, such as keyword search, sentiment analysis, and NLP.
Check this video to see Texera in action! (Texera was formally known as "TextDB" before August 28, 2017.)