Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

quiet logger #482

Merged
merged 1 commit into from
Jun 17, 2024
Merged

quiet logger #482

merged 1 commit into from
Jun 17, 2024

Conversation

emrgnt-cmplxty
Copy link
Contributor

@emrgnt-cmplxty emrgnt-cmplxty commented Jun 17, 2024

🚀 This description was created by Ellipsis for commit 6a83e06

Summary:

Reduced logging verbosity in KVLoggingProvider classes and added a log_run_info flag to the Pipeline class for conditional logging.

Key points:

  • Removed initialization log messages from LocalKVLoggingProvider and PostgresKVLoggingProvider constructors in r2r/core/logging/kv_logger.py.
  • Added a log message in KVLoggingSingleton.configure method in r2r/core/logging/kv_logger.py.
  • Enhanced error logging in KVLoggingSingleton.log method to include log details in r2r/core/logging/kv_logger.py.
  • Introduced log_run_info flag in Pipeline class constructor in r2r/core/pipeline/base_pipeline.py.
  • Conditional logging of run info based on log_run_info flag in Pipeline.run method in r2r/core/pipeline/base_pipeline.py.
  • Set log_run_info=False for nested pipelines in IngestionPipeline.add_pipe method in r2r/core/pipeline/base_pipeline.py.

Generated with ❤️ by ellipsis.dev

@emrgnt-cmplxty emrgnt-cmplxty marked this pull request as ready for review June 17, 2024 19:12
Copy link

vercel bot commented Jun 17, 2024

The latest updates on your projects. Learn more about Vercel for Git ↗︎

Name Status Preview Comments Updated (UTC)
r2r-docs 🔄 Building (Inspect) Visit Preview 💬 Add feedback Jun 17, 2024 7:12pm

@emrgnt-cmplxty emrgnt-cmplxty merged commit 688533a into dev Jun 17, 2024
1 of 4 checks passed
Copy link
Contributor

@ellipsis-dev ellipsis-dev bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

👍 Looks good to me! Reviewed everything up to 6a83e06 in 52 seconds

More details
  • Looked at 100 lines of code in 2 files
  • Skipped 0 files when reviewing.
  • Skipped posting 2 drafted comments based on config settings.
1. r2r/core/logging/kv_logger.py:64
  • Draft comment:
    The removal of initialization logging in individual logging providers and centralizing it in KVLoggingSingleton.configure is a good approach to reduce log redundancy and centralize configuration logging. Ensure that this change aligns with the overall logging strategy of the application.
  • Reason this comment was not posted:
    Confidence changes required: 0%
    The PR removes the initialization logging from the LocalKVLoggingProvider and PostgresKVLoggingProvider constructors. This might reduce the verbosity of logs, which could be the intent given the PR title 'quiet logger'. However, it introduces a new logging statement in the KVLoggingSingleton.configure method, which logs the initialization with the configuration. This change centralizes the logging of initialization to one place, which could be beneficial for maintaining a single point of logging the configuration. The change seems to be consistent across different parts of the code, aiming to reduce redundancy and centralize logging.
2. r2r/core/pipeline/base_pipeline.py:33
  • Draft comment:
    The introduction of the log_run_info parameter to control logging at the pipeline level is a thoughtful addition. It allows for better control over logging verbosity, especially in complex setups with nested pipelines. Ensure that all uses of this parameter are intentional and correctly implemented across different pipeline configurations.
  • Reason this comment was not posted:
    Confidence changes required: 0%
    The PR introduces a new parameter log_run_info in the Pipeline constructor to control whether run information should be logged. This is a useful feature for controlling verbosity on a per-pipeline basis. The default value is set to True, which maintains the existing behavior unless explicitly overridden. This change is applied consistently in the run method of the Pipeline class, where it checks the log_run_info flag before logging the run information. Additionally, when creating sub-pipelines for knowledge graph (KG) and embedding within the IngestionPipeline, the log_run_info is explicitly set to False. This could be intended to prevent redundant logging when these pipelines are part of a larger pipeline, which already logs the run information.

Workflow ID: wflow_IkG0EWPqI2qwIuvW


You can customize Ellipsis with 👍 / 👎 feedback, review rules, user-specific overrides, quiet mode, and more.

@emrgnt-cmplxty emrgnt-cmplxty deleted the feature/fix-extra-logging branch June 19, 2024 21:11
emrgnt-cmplxty added a commit that referenced this pull request Jun 21, 2024
emrgnt-cmplxty added a commit that referenced this pull request Jun 21, 2024
* quiet logger (#482)

* Add debug mode to Posthog (#480)

* Feature/add kg agent search to pipeline rebased 2 (#483)

* expand search pipeline

* checkin progress

* checkin progress

* grinding out

* make sure we can configure kg

* fix id error on server use

* checkin

* finish merge, add rag stream

* cleanup and pass tests

* up

* harmonize

* check in config refactor

* checkin work

* cleanup

* minor cleanups

* Add optional metadata to KG cookbook (#484)

* Add optional metadata to KG cookbook

* Align CB with script

* rm cruft and fix bug (#488)

* Feature/refactor app logic (#490)

* modularize app logic

* add management service

* add management service

* add management service

* Feature/move to singleton to prevent reload rebased (#491)

* modularize app logic

* add management service

* prevent r2r reload

* prevent r2r reload

* add back file (#492)

* add back file (#493)

* add back file

* fix bugs

* fix the routes (#496)

* rebase

* update docs

* cleanups

---------

Co-authored-by: Nolan Tremelling <34580718+NolanTrem@users.noreply.github.com>
iCUE-Solutions pushed a commit to DeweyLearn/DeweyLearnR2R that referenced this pull request Jul 18, 2024
* quiet logger (SciPhi-AI#482)

* Add debug mode to Posthog (SciPhi-AI#480)

* Feature/add kg agent search to pipeline rebased 2 (SciPhi-AI#483)

* expand search pipeline

* checkin progress

* checkin progress

* grinding out

* make sure we can configure kg

* fix id error on server use

* checkin

* finish merge, add rag stream

* cleanup and pass tests

* up

* harmonize

* check in config refactor

* checkin work

* cleanup

* minor cleanups

* Add optional metadata to KG cookbook (SciPhi-AI#484)

* Add optional metadata to KG cookbook

* Align CB with script

* rm cruft and fix bug (SciPhi-AI#488)

* Feature/refactor app logic (SciPhi-AI#490)

* modularize app logic

* add management service

* add management service

* add management service

* Feature/move to singleton to prevent reload rebased (SciPhi-AI#491)

* modularize app logic

* add management service

* prevent r2r reload

* prevent r2r reload

* add back file (SciPhi-AI#492)

* add back file (SciPhi-AI#493)

* add back file

* fix bugs

* fix the routes (SciPhi-AI#496)

* rebase

* update docs

* cleanups

---------

Co-authored-by: Nolan Tremelling <34580718+NolanTrem@users.noreply.github.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

1 participant