Skip to content

Dqwang to add the streaming pipeline and the logging system#3

Merged
dqwang122 merged 2 commits into
mainfrom
dqwang
Apr 17, 2026
Merged

Dqwang to add the streaming pipeline and the logging system#3
dqwang122 merged 2 commits into
mainfrom
dqwang

Conversation

@dqwang122
Copy link
Copy Markdown
Contributor

Description

This branch contains two commits on top of main:

  1. fa8c9b8 — update the streaming system

    • Adds a streaming package (env, overlap, bridges, chunk_audio, run_listen_demo) for chunked audio → ASR → debate-tree updates, watch-directory listeners, overlap/playback-driven runs, and live chunk bridges aligned with log output directories.
    • New YAML configs: base_st.yml, base_st_io.yml, overlap_debate.yml, overlap_debate_2.yml.
    • Substantial updates to ouragents.py, agents.py, debate_tree.py, tool.py, model.py, prepare.py, and related env/evaluator/search paths to integrate streaming behavior.
    • Adds analyze_streaming_performance.py and analyze_agent_timing.py for performance/timing analysis.
    • README and src/streaming/README.md document usage and CLI entrypoints.
  2. d2b0e07 — update the logging system, and Pydantic

    • Introduces structured timing/logging helpers (timing_log.py) and documents them in src/scripts/README_LOGGING.md.
    • Adds llm_schemas.py (Pydantic) and wires schema-oriented flows where appropriate.
    • Dependency and small config/helper updates (requirements.txt, .gitignore, compare_env.py, DB/helper utilities).

Diff summary: ~35 files changed, +5509 / −333 lines vs origin/main.

Motivation and Context

Supports incremental / streaming debate runs (chunked speech, overlap timing, bridges from TTS or log outputs) and improves observability (timing logs) and structured LLM I/O (Pydantic), so experiments and demos can match online/chunked pipelines and be analyzed with the new scripts.

How Has This Been Tested?

  • If you are adding a new feature, test on your own test scripts.

(Replace with what you actually ran—e.g. overlap/non-overlap streaming CLIs from src/streaming/README.md, and/or analyze_streaming_performance.py on a sample log.)

Screenshots of Test Results (if appropriate):

  1. Your own tests:

(Optional: e.g. plots from analyze_streaming_performance.py or overlap timeline PNGs under log_files/.../outputs.)

Types of changes

  • Fix bugs
  • Add new feature
  • Update documentation

@dqwang122 dqwang122 merged commit ed5cb96 into main Apr 17, 2026
3 checks passed
@dqwang122 dqwang122 deleted the dqwang branch April 17, 2026 20:00
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant