v0.42.3

v0.42.3 (2024-11-08)

Chore

• chore(dependencies): update various libraries; deprecate NiceGUI (#888)

• deprecate nicegui; move app/tray.py dependencies to app/init.py

• remove bind; update README

• Fix: wrap raw SQL queries in text() to prevent ArgumentError

• black

• noqa (50e4a3e)

Fix

• fix(build): remove deprecated modules; remove numpy2 from poetry.lock

• fix: Fix build issues due to numpy

• fix: Fix broken imports

• chore: Remove uses of nicegui and clean up files (de91850)

• fix(build): remove nicegui from build.py (02cb0fe)

v0.42.2

v0.42.2 (2024-11-06)

Fix

• fix(recording): specify pywinauto types as strings (#913) (4955237)

v0.42.1

v0.42.1 (2024-10-30)

Fix

• fix(build): add tokencost to build.py, update pyinstaller to 6.11.0, new ERROR_REPORTING_DSN (e7ad4e5)

• fix(replay): fix poetry lock, ulralytics.py, update ERROR_REPORTING_DSN

• fix dependencies, update ultralytics.py

• update ERROR_REPORTING_DSN

• black (0ce11f3)

v0.42.0

v0.42.0 (2024-10-25)

Feature

• feat(build): improve build script reliability (#886) (ea743a2)

v0.41.0

v0.41.0 (2024-10-24)

Feature

• feat(browser.py): add BrowserReplayStrategy; support browser modes record/replay (#872)

• add BrowserReplayStrategy; support browser modes record/replay

• minor refactor

• black/flake8

• update README

• improve README

• add BrowserReplayStrategy to README

• add strategies/visual_browser.py

• fix Action.from_dict and test_action_from_dict to support <cmd>-t

• calculate_tokens_and_cost; bugfix ActionEvent.fromdict; add ActionEvent.next_event; add TODOs; add visual_browser.py::SKIP_MOVE_BEFORE_CLICK

• handle mousemove/scroll; add_screen_tlbr forwards and backwards; RAW_PRECISE/IMPRECISE_MOUSE_EVENTS; openai.MAX_IMAGES = 90; fix merge_consecutive_mouse_scroll_events and tests; filter_invalid_window_events; dump_state timeout;

• add TODO

• noqa (d31fde0)

Unknown

• Improve macOS app test script reliability and error handling (#885)

• Improve macOS app test script reliability and error handling

• Update actions/setup-python to v5 to resolve deprecation warnings (c1075f1)

• /nh -> 2>nul (99bbe0e)

v0.40.0

v0.40.0 (2024-09-11)

Feature

• feat(chrome_extension): correct commit format for semantic release (532ec3f)

Unknown

• feat(browser_extension) add browser_extension and openadapt.browser (#744)

• add old chrome extension files

• add old changes back, related to chrome extension, in openadapt dir

• try web socket solution, add asyncio and websockets libraries to poetry

• now we can log the dom changes ina a desctop running python process

• remove the old nativeMessaging extension code

• rename dir

• save the dom chages into dummy db: chrome.db

• fix actions tests

• ran poetry run black --preview . --exclude 'alembic'

• remove sockets.py

• fix falke8 formatting issues

• ran poetry run black --preview . --exclude 'alembic'

• add browser event code

• chrome extension work wip

• fix reset_db python file.

• now, extension messages can be seen in logs when the recording is started.

• till trying to fix the issue: record functione execution gets stuck at read_browser_events due to asyncio.runForever

• browser_events can be seen in db

• ran black and flake8

• add documentation in extension side js files and remove unused files

• #744 (review)

Update readme.md

• #744 (comment)
  remove mlds logo

• #744 (comment)

add todo

• #744 (comment)

add NAMED_CONSTANT

• #744 (comment)

remove unused lines in content.js

• #744 (comment)

uncomment for alembic upgrade

• #744 (comment)

resolve this

• #744 (comment)

remove unwanted obfuscate keys

• #744 (comment)

used joinedload

• #744 (comment)

remove unwanted return

• #744 (comment)

Ran the following:

• alembic revision --autogenerate -m "regenrate with browser_event table"
• alembic upgrade head

• #744 (comment)

remove unwanted commetns lines

• #744 (comment)

remove commented lines

• https://github.com/OpenAdaptAI/OpenAdapt/pull/744/files#r1668802201

added this todo

• #744 (comment)

optimize browser events record by adding an option to include to record or not like audio

• #744 (comment)

move constants to config

• #744 (comment)

update readme

• update readme again

• #744 (comment)

update config default for RECORD_BROWSER_EVENTS

• #744 (comment)

removed unessary comment in events.py

• Update openadapt/models.py

#744 (comment)

Co-authored-by: Richard Abrich <richard.abrich@mldsai.com>

• #744 (comment)

resolve d

• https://github.com/OpenAdaptAI/OpenAdapt/pull/744/files/3836c3d165bb11c5615c83a0df65f6cdc155f93f#r1676068390

resolved

• ran black on openadapt dir
  poetry run black --preview openadapt/

• #744 (comment)

fixed faiing tests

• update the form type script

• add the record browser flag in classification group

• #744 (comment)

Co-authored-by: Richard Abrich <richard.abrich@mldsai.com>

• #744 (comment)

Co-authored-by: Richard Abrich <richard.abrich@mldsai.com>

• #744 (comment)

Co-authored-by: Richard Abrich <richard.abrich@mldsai.com>

• Update openadapt/config.py: #744 (comment)

#744 (comment)

Co-authored-by: Richard Abrich <richard.abrich@mldsai.com>

• Update openadapt/record.py

#744 (comment)

Co-authored-by: Richard Abrich <richard.abrich@mldsai.com>

• Update openadapt/config.py: https://github.com/OpenAdaptAI/OpenAdapt/pull/744/files/aa7b1ae7df8fb7045abb5d71d1d41a09f2d8bea2#r1691430453

https://github.com/OpenAdaptAI/OpenAdapt/pull/744/files/aa7b1ae7df8fb7045abb5d71d1d41a09f2d8bea2#r1691430453

Co-authored-by: Richard Abrich <richard.abrich@mldsai.com>

• Remove 3 unused functions owing to:

#744 (comment)

#744 (comment)

#744 (comment)

• Update openadapt/record.py: #744 (comment)

#744 (comment)

Co-authored-by: Richard Abrich <richard.abrich@mldsai.com>

• Rename owing to: #744 (comment)

• Rename const: #744 (comment)

• Remove unused: #744 (comment)

• Use ClassVar again: #744 (comment)

• Update openadapt/models.py: #744 (comment)

#744 (comment)

Co-authored-by: Richard Abrich <richard.abrich@mldsai.com>

• Update openadapt/record.py: #744 (comment)

#744 (comment)

Co-authored-by: Richard Abrich <richard.abrich@mldsai.com>

• Update openadapt/record.py: #744 (comment)

#744 (comment)

Co-authored-by: Richard Abrich <richard.abrich@mldsai.com>

• Move string to const: #744 (comment)

• Correct Grammatical errors: #744 (comment)

• fix visualize and reformat

• fix alembic migrations

• Intersection/MutationObserver; _repr_ignore_attrs; fix process_events

• synchronize timestamps

• attachWindowEventListeners

• recreate alembic migration

• sync; buffer

• add dtw.py (wip)

• remove sorting and syncing; working experiments/dtw.py

• fix content.js

• report screenX/screenY; fix getScreenCoordinates; compute coordinate differences

• wip

• remove observers; composite distance; task_by_name

• replace eventBuffer with coordMappings; compute tlbr-screen in browser.py

• assign_browser_events in events.py

• black; docstrings

• flake8

• update test

• black

• add test_browser.py

---

Co-authored-by: pate1595 <kmp.patel@utoronto.ca>
Co-authored-by: Krish Patel <65433817+KrishPatel13@users.noreply.github.com> (49d71d1)

v0.39.3

v0.39.3 (2024-08-07)

Fix

• fix: remove duplicate import (#870) (e776ed8)

• fix: only import window if necessary (#869)

Only import window if necessary (efc941d)

v0.39.2

v0.39.2 (2024-08-06)

Fix

• fix(video): upgrade to pyav 12.3.0 (#868)

Fixes #862 (d7f463c)

v0.39.1

v0.39.1 (2024-07-25)

Fix

• fix(installer): fix installer upload (#866)

• Update release-and-publish.yml: upload installers

• Update release-and-publish.yml: fix case (489b9c2)

• fix(VisualReplayStrategy): avoid re-using failing segmentations (0045ebb)

• fix(installer, audio): postinstall whisper; download installer artefacts (#865)

• postinstall whisper; download installer artefacts

• poetry lock (a4470c3)

v0.39.0

v0.39.0 (2024-07-25)

Feature

• feat(installer): upload installers (#863) (47fa551)