[feat] - smart carriage return read in logs

[VictorMorand]

• when using verbose tqdms, TUI doesn't group them to keep the last one

It could be nice to detect carriage returns and display the log as a tail -f would do

[VictorMorand]

I have an issue with the current mechanics:

tui/log_viewer.py:486 in            │
│ _refresh_logs                                                                                                         │
│                                                                                                                       │
│   483 │   │   │   return                                                                                              │
│   484 │   │                                                                                                           │
│   485 │   │   for widget in self.log_widgets:                                                                         │
│ ❱ 486 │   │   │   widget.refresh_content()                                                                            │
│   487 │                                                                                                               │
│   488 │   def action_close_viewer(self) -> None:                                                                      │
│   489 │   │   """Go back to the job detail view"""                                                                    │
│                                                                                                                       │
│ ╭──────────── locals ────────────╮                                                                                    │
│ │   self = LogViewerScreen()     │                                                                                    │
│ │ widget = LogWidget(id='log-1') │                                                                                    │
│ ╰────────────────────────────────╯                                                                                    │
│                                                                                                                       │
│ /...experimaestro-python/src/experimaestro/tui/log_viewer.py:171 in            │
│ refresh_content                                                                                                       │
│                                                                                                                       │
│   168 │   │   │   return                                                                                              │
│   169 │   │                                                                                                           │
│   170 │   │   complete_lines, partial = self.log_file.read_new_content()                                              │
│ ❱ 171 │   │   self._apply_update(complete_lines, partial)                                                             │
│   172 │                                                                                                               │
│   173 │   def scroll_to_end(self) -> None:                                                                            │
│   174 │   │   """Scroll to end of log"""                                                                              │
│                                                                                                                       │
│ ╭─────────────────────────────────────────────────── locals ───────────────────────────────────────────────────╮      │
│ │ complete_lines = [                                                                                           │      │
│ │                  │   'INFO:603013:26-05-07 14:31:12 [xpm] Working in directory /lustre/fsn1/projects/r'+125, │      │
│ │                  │   'INFO:603014:26-05-07 14:31:12 [xpm] Working in directory /lustre/fsn1/projects/r'+125, │      │
│ │                  │   'INFO:603014:26-05-07 14:31:12 [xpm] Non-zero rank (1): marking as slave process',      │      │
│ │                  │   'INFO:603013:26-05-07 14:31:12 [xpm] Locking /lustre/fsn1/projects/rech/npl/commu'+126, │      │
│ │                  │   'INFO:603014:26-05-07 14:31:12 [xpm] Running task',                                     │      │
│ │                  │   'INFO:603013:26-05-07 14:31:12 [xpm] Running task',                                     │      │
│ │                  │   'WARNING:603013:26-05-07 14:32:19 [xpmir.text.huggingface.tokenizers] No max_len '+31,  │      │
│ │                  │   'WARNING:603013:26-05-07 14:32:19 [xpmir.neural.huggingface] No max_docs_len prov'+32,  │      │
│ │                  │   'WARNING:603013:26-05-07 14:32:19 [xpmir.neural.huggingface] No max_query_len pro'+33,  │      │
│ │                  │   'WARNING:603014:26-05-07 14:32:19 [xpmir.text.huggingface.tokenizers] No max_len '+31,  │      │
│ │                  │   ... +27                                                                                 │      │
│ │                  ]                                                                                           │      │
│ │        partial = 'Re-ranking:   1%|          | 30/3333 [01:17<2:48:22,  3.06s/q'                             │      │
│ │           self = LogWidget(id='log-1')                                                                       │      │
│ ╰──────────────────────────────────────────────────────────────────────────────────────────────────────────────╯      │
│                                                                                                                       │
│ /...experimaestro-python/src/experimaestro/tui/log_viewer.py:148 in            │
│ _apply_update                                                                                                         │
│                                                                                                                       │
│   145 │                                                                                                               │
│   146 │   def _apply_update(self, complete_lines: list[str], partial: str) -> None:                                   │
│   147 │   │   if complete_lines:                                                                                      │
│ ❱ 148 │   │   │   log_widget = self.query_one(f"#{self.id}-content", RichLog)                                         │
│   149 │   │   │   for line in complete_lines:                                                                         │
│   150 │   │   │   │   log_widget.write(line)                                                                          │
│   151 │   │   if partial != self._last_partial:                                                                       │
│                                                                                                                       │
│ ╭─────────────────────────────────────────────────── locals ───────────────────────────────────────────────────╮      │
│ │ complete_lines = [                                                                                           │      │
│ │                  │   'INFO:603013:26-05-07 14:31:12 [xpm] Working in directory /lustre/fsn1/projects/r'+125, │      │
│ │                  │   'INFO:603014:26-05-07 14:31:12 [xpm] Working in directory /lustre/fsn1/projects/r'+125, │      │
│ │                  │   'INFO:603014:26-05-07 14:31:12 [xpm] Non-zero rank (1): marking as slave process',      │      │
│ │                  │   'INFO:603013:26-05-07 14:31:12 [xpm] Locking /lustre/fsn1/projects/rech/npl/commu'+126, │      │
│ │                  │   'INFO:603014:26-05-07 14:31:12 [xpm] Running task',                                     │      │
│ │                  │   'INFO:603013:26-05-07 14:31:12 [xpm] Running task',                                     │      │
│ │                  │   'WARNING:603013:26-05-07 14:32:19 [xpmir.text.huggingface.tokenizers] No max_len '+31,  │      │
│ │                  │   'WARNING:603013:26-05-07 14:32:19 [xpmir.neural.huggingface] No max_docs_len prov'+32,  │      │
│ │                  │   'WARNING:603013:26-05-07 14:32:19 [xpmir.neural.huggingface] No max_query_len pro'+33,  │      │
│ │                  │   'WARNING:603014:26-05-07 14:32:19 [xpmir.text.huggingface.tokenizers] No max_len '+31,  │      │
│ │                  │   ... +27                                                                                 │      │
│ │                  ]                                                                                           │      │
│ │        partial = 'Re-ranking:   1%|          | 30/3333 [01:17<2:48:22,  3.06s/q'                             │      │
│ │           self = LogWidget(id='log-1')                                                                       │      │
│ ╰──────────────────────────────────────────────────────────────────────────────────────────────────────────────╯      │
╰───────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╯
NoMatches: No nodes match '#log-1-content' on LogWidget(id='log-1')

-> maybe it could be simpler to just delete the intermediate lines when properly detected directly in the temp file rather than building a new widget for the progress bar ?