Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Pipelines integration #154

Closed
3 tasks done
nicolay-r opened this issue Aug 7, 2021 · 0 comments
Closed
3 tasks done

Pipelines integration #154

nicolay-r opened this issue Aug 7, 2021 · 0 comments
Assignees
Labels
question Further information is requested task

Comments

@nicolay-r
Copy link
Owner

nicolay-r commented Aug 7, 2021

It might be useful to take a look onto document processing framework in terms of variety pipelines that allows you to extract a particular type of information.
Such information might be as follows: NER, contexts, context-level attitudes, document level attitudes [many more in a potential future]

  • Integration for text processing
  • Enhance pipeline results organization (automatically assign src value once pipeline element accomplised and provide the related result).
  • Enhance ppl.run() by adopting src-based parameters as a separate input_data argument.

The latter might be gathered into pipelines as follows:

# implement pipeline
ppl = Pipeline(
               ParseDocument(
                   SentenceSplitter, NER, ...
               ), 
               ExtractContexts(...),
               AnnotateContexts(...),
               ConvertToDocumentLevel(...))
                      
# call
ppl()
@nicolay-r nicolay-r added question Further information is requested task labels Aug 7, 2021
@nicolay-r nicolay-r self-assigned this Aug 7, 2021
nicolay-r added a commit that referenced this issue Sep 22, 2021
nicolay-r added a commit that referenced this issue Sep 22, 2021
nicolay-r added a commit that referenced this issue Sep 22, 2021
nicolay-r added a commit that referenced this issue Sep 23, 2021
…ths encapsulation). Removed non utilzed methods
@nicolay-r nicolay-r removed the task label Dec 13, 2021
nicolay-r added a commit that referenced this issue Dec 16, 2021
…. Pipelines intergration related (#154). Related #244. Refactoring text processing #161.
@nicolay-r nicolay-r added the task label Dec 16, 2021
nicolay-r added a commit that referenced this issue Dec 20, 2021
nicolay-r added a commit that referenced this issue Dec 20, 2021
nicolay-r added a commit that referenced this issue Dec 25, 2021
nicolay-r added a commit that referenced this issue Dec 25, 2021
nicolay-r added a commit that referenced this issue Feb 18, 2022
nicolay-r added a commit that referenced this issue Feb 19, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
question Further information is requested task
Projects
None yet
Development

No branches or pull requests

1 participant