Skip to content

Latest commit

 

History

History
5129 lines (2560 loc) · 181 KB

CHANGELOG.md

File metadata and controls

5129 lines (2560 loc) · 181 KB
Raw

CHANGELOG

v0.42.4 (2024-11-15)

Fix

  • fix(crud): Use subqueryload for all joins (#920) (a73439a)

v0.42.3 (2024-11-08)

Chore

  • chore(dependencies): update various libraries; deprecate NiceGUI (#888)

  • deprecate nicegui; move app/tray.py dependencies to app/init.py

  • remove bind; update README

  • Fix: wrap raw SQL queries in text() to prevent ArgumentError

  • black

  • noqa (50e4a3e)

Fix

  • fix(build): remove deprecated modules; remove numpy2 from poetry.lock

  • fix: Fix build issues due to numpy

  • fix: Fix broken imports

  • chore: Remove uses of nicegui and clean up files (de91850)

  • fix(build): remove nicegui from build.py (02cb0fe)

v0.42.2 (2024-11-06)

Fix

  • fix(recording): specify pywinauto types as strings (#913) (4955237)

v0.42.1 (2024-10-30)

Fix

  • fix(build): add tokencost to build.py, update pyinstaller to 6.11.0, new ERROR_REPORTING_DSN (e7ad4e5)

  • fix(replay): fix poetry lock, ulralytics.py, update ERROR_REPORTING_DSN

  • fix dependencies, update ultralytics.py

  • update ERROR_REPORTING_DSN

  • black (0ce11f3)

v0.42.0 (2024-10-25)

Feature

  • feat(build): improve build script reliability (#886) (ea743a2)

v0.41.0 (2024-10-24)

Feature

  • feat(browser.py): add BrowserReplayStrategy; support browser modes record/replay (#872)

  • add BrowserReplayStrategy; support browser modes record/replay

  • minor refactor

  • black/flake8

  • update README

  • improve README

  • add BrowserReplayStrategy to README

  • add strategies/visual_browser.py

  • fix Action.from_dict and test_action_from_dict to support <cmd>-t

  • calculate_tokens_and_cost; bugfix ActionEvent.fromdict; add ActionEvent.next_event; add TODOs; add visual_browser.py::SKIP_MOVE_BEFORE_CLICK

  • handle mousemove/scroll; add_screen_tlbr forwards and backwards; RAW_PRECISE/IMPRECISE_MOUSE_EVENTS; openai.MAX_IMAGES = 90; fix merge_consecutive_mouse_scroll_events and tests; filter_invalid_window_events; dump_state timeout;

  • add TODO

  • noqa (d31fde0)

Unknown

  • Improve macOS app test script reliability and error handling (#885)

  • Improve macOS app test script reliability and error handling

  • Update actions/setup-python to v5 to resolve deprecation warnings (c1075f1)

  • /nh -> 2>nul (99bbe0e)

v0.40.0 (2024-09-11)

Feature

  • feat(chrome_extension): correct commit format for semantic release (532ec3f)

Unknown

  • feat(browser_extension) add browser_extension and openadapt.browser (#744)

  • add old chrome extension files

  • add old changes back, related to chrome extension, in openadapt dir

  • try web socket solution, add asyncio and websockets libraries to poetry

  • now we can log the dom changes ina a desctop running python process

  • remove the old nativeMessaging extension code

  • rename dir

  • save the dom chages into dummy db: chrome.db

  • fix actions tests

  • ran poetry run black --preview . --exclude &#39;alembic&#39;

  • remove sockets.py

  • fix falke8 formatting issues

  • ran poetry run black --preview . --exclude &#39;alembic&#39;

  • add browser event code

  • chrome extension work wip

  • fix reset_db python file.

  • now, extension messages can be seen in logs when the recording is started.

  • till trying to fix the issue: record functione execution gets stuck at read_browser_events due to asyncio.runForever

  • browser_events can be seen in db

  • ran black and flake8

  • add documentation in extension side js files and remove unused files

  • #744 (review)

Update readme.md

add todo

add NAMED_CONSTANT

remove unused lines in content.js

uncomment for alembic upgrade

resolve this

remove unwanted obfuscate keys

used joinedload

remove unwanted return

Ran the following:

  • alembic revision --autogenerate -m &#34;regenrate with browser_event table&#34;
  • alembic upgrade head

remove unwanted commetns lines

remove commented lines

added this todo

optimize browser events record by adding an option to include to record or not like audio

move constants to config

update readme

update config default for RECORD_BROWSER_EVENTS

removed unessary comment in events.py

  • Update openadapt/models.py

#744 (comment)

Co-authored-by: Richard Abrich <richard.abrich@mldsai.com>

resolve d

resolved

  • ran black on openadapt dir poetry run black --preview openadapt/

  • #744 (comment)

fixed faiing tests

  • update the form type script

  • add the record browser flag in classification group

  • #744 (comment)

Co-authored-by: Richard Abrich <richard.abrich@mldsai.com>

Co-authored-by: Richard Abrich <richard.abrich@mldsai.com>

Co-authored-by: Richard Abrich <richard.abrich@mldsai.com>

#744 (comment)

Co-authored-by: Richard Abrich <richard.abrich@mldsai.com>

  • Update openadapt/record.py

#744 (comment)

Co-authored-by: Richard Abrich <richard.abrich@mldsai.com>

https://github.com/OpenAdaptAI/OpenAdapt/pull/744/files/aa7b1ae7df8fb7045abb5d71d1d41a09f2d8bea2#r1691430453

Co-authored-by: Richard Abrich <richard.abrich@mldsai.com>

  • Remove 3 unused functions owing to:

#744 (comment)

#744 (comment)

#744 (comment)

#744 (comment)

Co-authored-by: Richard Abrich <richard.abrich@mldsai.com>

#744 (comment)

Co-authored-by: Richard Abrich <richard.abrich@mldsai.com>

#744 (comment)

Co-authored-by: Richard Abrich <richard.abrich@mldsai.com>

#744 (comment)

Co-authored-by: Richard Abrich <richard.abrich@mldsai.com>

  • Move string to const: #744 (comment)

  • Correct Grammatical errors: #744 (comment)

  • fix visualize and reformat

  • fix alembic migrations

  • Intersection/MutationObserver; _repr_ignore_attrs; fix process_events

  • synchronize timestamps

  • attachWindowEventListeners

  • recreate alembic migration

  • sync; buffer

  • add dtw.py (wip)

  • remove sorting and syncing; working experiments/dtw.py

  • fix content.js

  • report screenX/screenY; fix getScreenCoordinates; compute coordinate differences

  • wip

  • remove observers; composite distance; task_by_name

  • replace eventBuffer with coordMappings; compute tlbr-screen in browser.py

  • assign_browser_events in events.py

  • black; docstrings

  • flake8

  • update test

  • black

  • add test_browser.py

Co-authored-by: pate1595 <kmp.patel@utoronto.ca> Co-authored-by: Krish Patel <65433817+KrishPatel13@users.noreply.github.com> (49d71d1)

v0.39.3 (2024-08-07)

Fix

  • fix: remove duplicate import (#870) (e776ed8)

  • fix: only import window if necessary (#869)

Only import window if necessary (efc941d)

v0.39.2 (2024-08-06)

Fix

  • fix(video): upgrade to pyav 12.3.0 (#868)

Fixes #862 (d7f463c)

v0.39.1 (2024-07-25)

Fix

  • fix(installer): fix installer upload (#866)

  • Update release-and-publish.yml: upload installers

  • Update release-and-publish.yml: fix case (489b9c2)

  • fix(VisualReplayStrategy): avoid re-using failing segmentations (0045ebb)

  • fix(installer, audio): postinstall whisper; download installer artefacts (#865)

  • postinstall whisper; download installer artefacts

  • poetry lock (a4470c3)

v0.39.0 (2024-07-25)

Feature

  • feat(installer): upload installers (#863) (47fa551)

v0.38.0 (2024-07-25)

Feature

  • feat: add_centroid in WindowEvent.to_prompt_dict (#840)

  • add centroid in window_dict output

  • black

Co-authored-by: Richard Abrich <richard.abrich@mldsai.com> Co-authored-by: Richard Abrich <richard.abrich@gmail.com> (5118b39)

  • feat(action verification): implement replay action verification (#857)

  • add is_action_event_complete

  • retry_with_exceptions in apply_replay_instructions

  • fix parse_code_snippet

  • add error_reporting.py

  • refactor video.py

  • black/flake8

  • add module docstring

  • CHECK_ACTION_COMPLETE (b288c07)

Unknown

  • fix keyerror if no state in window_dict (001c8fa)

v0.37.0 (2024-07-19)

Feature

  • feat(logging): store application logs (#854)

  • feat: Wrap all processes inside a try catch block

  • chore: Modify files to use the custom logger

  • lint: flake8 lint

Co-authored-by: Richard Abrich <richard.abrich@mldsai.com> (13bbe48)

v0.36.6 (2024-07-19)

Fix

  • fix(build): escape installer newline, upload installers and executables (#860)

  • escape newline in inno script

  • upload installers and executables (6d878fe)

Unknown

  • feat(build) modify build.py to produce installers (#858)

  • modify build.py to produce installers

  • download_and_install_inno_setup

  • black/flake8

  • remove zipping in build (21e5de1)

v0.36.5 (2024-07-16)

Fix

  • fix(error-reporting): add ignore_errors (#855)

  • add ignore_errors

  • black (dc26a2a)

v0.36.4 (2024-07-12)

Fix

  • fix(VanillaReplayStrategy): replay_instructions -> instructions (#849) (640f926)

v0.36.3 (2024-07-11)

Fix

  • fix(replay): fix video not found (#845)

  • fix:modify Recording class to delete all associated records when recording is deleted (ab1f125)

v0.36.2 (2024-07-06)

Fix

  • fix(release): add ngrok; run release on debug-release branch; fallback to python (#838) (8777574)

Unknown

  • revert until 615fc6ffe560ff0788414c80643308b484012750 (748bdb3)

v0.36.1 (2024-07-06)

Fix

  • fix(release): hard code python path fallback (#837) (1b48f94)

  • fix(release): set PYTHON_PATH in semantic_release; hard-code fallback (#836)

  • Update release-and-publish.yml: set PYTHON_PATH in semantic_release

  • Update pyproject.toml: hard code python path fallback (e6c88d1)

  • fix(release): modify build_command in pyproject.toml (#835)

  • Update release-and-publish.yml: remove build_command

  • Update pyproject.toml: add PYTHON_PATH to build_command

  • Update pyproject.toml: increase verbosity (0f5166e)

  • fix(release): override build_command and include PYTHON_PATH (#834) (88fca89)

  • fix(release): set python path more robustly (#833) (6b382dd)

  • fix(release): add PYTHON_PATH to GITHUB_PATH (#832) (217204b)

  • fix(release): update python-semantic-release to v9.8.4 (#831) (8054d69)

  • fix(release): remove ADMIN_TOKEN from actions/checkout (#830) (094a054)

  • fix(release): replace GITHUB_TOKEN with ADMIN_TOKEN (#829) (c193fe6)

  • fix(release): add token to actions/checkout (#828) (8e1a17d)

  • fix(db): eager loading (#822)

  • add joinedload to eagerly load related entities

  • change get_active_window_data to return empty dict when state is none

  • add eager as parameter in _get

  • add a default parameter for relationships

  • flake8 error fix

  • use direct and indirect relationships

  • chore: refactor code (615fc6f)

  • fix(audio): Fix error when downloading whisper model (#826) (2ad143a)

v0.36.0 (2024-06-28)

Feature

  • feat(logging): redirect stdout (#810)

  • feat: Override std out for application

  • feat: Separate logs by version number and date and use logger instead of print

Co-authored-by: Richard Abrich <richard.abrich@mldsai.com> (f44795c)

Fix

  • fix(tray): fix tray signals (#812)

  • feat: Override std out for application

  • fix: Fix passing signals around using multiprocessing pipes

  • feat: Separate logs by version number and date and use logger instead of print

  • lint: flake8 lint

Co-authored-by: Richard Abrich <richard.abrich@mldsai.com> (f231a34)

v0.35.2 (2024-06-27)

Fix

  • fix(build): Fix build issues (#809)

  • fix: Fix build issues

  • fix: Add pyqttoast and whisper explicitly to build

  • black/flake8

Co-authored-by: Richard Abrich <richard.abrich@mldsai.com> Co-authored-by: Richard Abrich <richard.abrich@gmail.com> (48995bb)

Unknown

v0.35.1 (2024-06-23)

Fix

  • fix(ultralytics): fix windows file permission in do_fastsam (#791)

  • fix:windows file permission

  • Changes as per the comments on last commit

  • add max_retries and retry_delay_seconds in args

  • add comments for segmented_image.load()

  • order imports in ultralytics.py

  • build fix

  • remove unnecessary formatting changes

Co-authored-by: Richard Abrich <richard.abrich@mldsai.com> (742b176)

v0.35.0 (2024-06-22)

Feature

  • feat(SegmentReplayStrategy, drivers): add strategies.replay; refactor adapters -> drivers + adapters (#714)

  • implemented

  • add get_active_window_data parameter include_window_data; fix ActionEvent.from_dict to handle multiple separators; add test_models.py

  • update get_default_prompt_adapter

  • add TODO

  • tests.openadapt.adapters -> drivers

  • utils.get_marked_image, .extract_code_block; .strip_backticks

  • working segment.py (misses final click in calculator task)

  • include_replay_instructions; dev_mode=False

  • fix test_openai.py: ValueError -> Exception

  • replay.py --record -> --capture

  • black/flake8

  • remove import

  • INCLUDE_CURRENT_SCREENSHOT; handle mouse events without x/y

  • add models.Replay; print_config in replay.py (7ef115a)

v0.34.0 (2024-06-20)

Feature

  • feat(onboarding): Add onboarding for new users (#746)

  • feat: Add onboarding for new users

  • feat: Overhaul onboarding into a multistep process

  • docs: Update README.md with usage of the entrypoint module

  • refactor: Remove steppers and move all steps to a single page

  • feat: Move onboarding to a separate page and add bounty card

  • feat: Redirect to onboarding on launch, and move around content

Co-authored-by: Richard Abrich <richard.abrich@mldsai.com> (bdf153e)

v0.33.6 (2024-06-20)

Fix

  • fix(tray): Fix incorrect argument when visualizing from tary (#780)

Changed order in tray.py

Co-authored-by: Richard Abrich <richard.abrich@mldsai.com> (4ff4c73)

  • fix(record): remove extra param (#784) (f60a617)

v0.33.5 (2024-06-19)

Fix

  • fix(analytics): Posthog event logging updates (#772)

  • feat: Add openadapt version to posthog events

  • feat: Update tracking text of replay, visualize and delete submenus

  • fix: Fix code in plotting.py not using correct arguments

  • fix: Update broken tests (59c2714)

v0.33.4 (2024-06-18)

Fix

  • fix(visualize): Handle no screenshots (#763)

  • handle no screenshot in visualize.py / plotting.py

  • black/flake8 (92b74f0)

Test

  • test: Add CI scripts to run the app after build (#709)

  • feat: Add scripts to run the app after build

  • feat: Log error in a file

  • chore: Add TODO for future additions of logging

Co-authored-by: Richard Abrich <richard.abrich@mldsai.com> (e370fe6)

v0.33.3 (2024-06-18)

Fix

  • fix(record): fix performance plotting regression (#774)

  • Fixes regressions introduced in Database access refactor #676 affecting plotting of performance plots.

  • Re-uses record.write_event for video events.

  • Modifies plot_performance to use color-blind-friendly markers

  • black/flake8 (44371e9)

v0.33.2 (2024-06-15)

Fix

  • fix(VisualReplayStrategy): increase default NMS thresh/conf (#758)

  • repair VisualReplayStrategy

  • black/flake8 (dd9e8fa)

v0.33.1 (2024-06-14)

Fix

  • fix(posthog): fix broken posthog api (#753)

  • fix: Fix broken posthog api

  • fix types

Co-authored-by: Richard Abrich <richard.abrich@gmail.com> (16d510f)

v0.33.0 (2024-06-13)

Feature

  • feat(scripts.downloads): add scripts/downloads.py (#735)

  • add scripts/downloads.py

  • add total cumulative downloads to title

  • add module docstring

  • pagination

  • add datetime

  • accumulate by release_date

  • black/flake8 (3c20298)

v0.32.0 (2024-06-13)

Feature

  • feat(tray): Add posthog analytics to tray actions (#737)

Co-authored-by: Richard Abrich <richard.abrich@mldsai.com> (dc0b7ea)

v0.31.0 (2024-06-12)

Feature

  • feat(contrib.som, postinstall): add contrib.som; postinstall.py; other fixes (#679)

  • add vision.get_similar_image_idxs and test_vision.py

  • refactor fixtures

  • add get_size_similarity and tests; update default params in adapters.ultralytics

  • get_image_similarity rgb

  • add caching; win_size

  • short_circuit_ssim; plot_similar_image_groups

  • refactor: adding plotting.py

  • fix test; typo

  • bug fixes; title_params

  • add tests/openadapt/adapters

  • bugfix: imports

  • modify prompt adapter API to accept images instead of base64 images

  • add experiments/handle_similar_segments.py

  • add highlight_masks; increase_contrast

  • add experiments/gpt4o_seg.py; normalize_positions; clean_data; filter_keys; modify get_scale_ratios to accept no arguments; modify crop_active_window to accept window event; fix bugs

  • ultralytics sam

  • add experiments/nms.py

  • add fastsamsom.py, visualizer.py

  • working fastsamsom.py

  • cleanup

  • black; flake8; postinstall.py; test_vision.py

  • restore utils.get_performance_plot_file_path/get_performance_plot_file_path

  • fix ActionEvent.from_dict

  • handle HTTPError in test_openai

  • utils.split_by_separators

  • other fixes

  • remove list python files step

  • consolidate install-dashboard and postinstall

  • install_dashboard from dashboard_dir

  • postinstall error logging (588494c)

Fix

  • fix(build): pip install wheel (#738) (3640f41)

  • fix(tests, utils): fix regressions (#736)

  • recording.monitor_hefith -> recording.monitor_height

  • add test_utils.py

  • release-and-publish.yml: poetry run postinstall

  • black (d28a886)

v0.30.4 (2024-06-11)

Fix

  • fix(RecordingsAPI): catch AttributeError if audio_info is None (#729) (81b4089)

v0.30.3 (2024-06-10)

Fix

  • fix(scrubbing): Catch exceptions when download required spacy model (#733) (b3f73d8)

  • fix(video): add num_copies to write_video_event (#732) (ca04b6d)

v0.30.2 (2024-06-08)

Fix

  • fix(video): fix video playback with force_key_frame (#726)

  • force_key_frame

  • fix embedded video playback

  • disable fix_moov

  • black; flake8

  • fix typo

  • yuv420p -> yuv444p (lossless) (1f67822)

v0.30.1 (2024-06-08)

Chore

  • chore: fix typo in test_video.py (#710) (57a3376)

Fix

  • fix(get_audio_info, visualize): replace use of recording timestamp in functions with recording id (#717)

  • fix(audio): Replace use of recording timestamp in functions with recording id (#727)

Co-authored-by: Shohan Dutta Roy <shohanduttaroy99@gmail.com>

  • fix get_audio_info

  • black

Co-authored-by: Shohan Dutta Roy <shohanduttaroy99@gmail.com> (1b04fd4)

v0.30.0 (2024-06-05)

Feature

  • feat(dashboard): Add feature to remove action events (#688)

  • feat: Add feature to remove action events

  • fix: Fix database revision (f33b36d)

v0.29.0 (2024-06-05)

Documentation

  • docs(README): add dashboard visualization; improve description of VanillaReplayStrategy (6df4bb9)

Feature

  • feat(vanilla): Implement vanilla baseline (#702)

  • add vanilla.py; update README.md

  • update module docstring

  • add TODO; remove unused code

  • tabs -> spaces

  • modify prompt adapter API to accept images instead of base64 images

  • fix typo

  • add ActionEvent/WindowEvent.to_prompt_dict

  • add prompts/describe_recording.j2; prompts/generate_action_event.j2

  • fixes; log action history

  • fixes; black; flake8

  • add tests/openadapt/adapters

  • add missing test assets

  • DATA_DIR_PATH -> PARENT_DIR_PATH

  • get_completion dev_mode

  • anthropic dev_mode

  • fix tests

  • black

  • flake8

  • ignore .cache in flake8

  • vanilla.INCLUDE_WINDOW_DATA; utils.clean_data/filter_keys

  • flake8 (81074c4)

v0.28.0 (2024-06-05)

Feature

  • feat: Delete/transfer video (#696)

  • feat: Delete recording files when deleting recording

  • fix: Fix share recording feature

  • feat: Share related files when transferring recording

  • fix: Fix tests and lint code

Co-authored-by: Richard Abrich <richard.abrich@mldsai.com> (889d48c)

  • feat(alerts): Alert user when any exception occurs, via sentry hooks (#685)

  • feat: Alert user when any exception occurs, via sentry hooks

  • chore: Turn ERROR_REPORTING_BRANCH to a static config variable

Co-authored-by: Richard Abrich <richard.abrich@mldsai.com> (6492120)

v0.27.0 (2024-06-04)

Feature

  • feat: Audio narration (#673)

  • feat: Add audio narration feature while recording

  • feat: Remove implicit scrubbing in display_event function and recursively convert reqd properties to str

  • feat: Add transcribed text to dashboard visualisation

  • feat: Use recording id as foreign key, and add interrupt signal handler in audio recording process

  • feat: Check if the lock is stale when acquiring locks

  • refactor: Convert database lock path to a constant in config file

Co-authored-by: Richard Abrich <richard.abrich@mldsai.com> (1e11906)

v0.26.2 (2024-06-03)

Documentation

  • docs: Create FUNDING.yml (#690) (3692416)

Fix

  • fix(docs): add nvm install info in Readme.md in manual setup section. (#694) (4f240b6)

v0.26.1 (2024-05-28)

Fix

  • fix(db): Database access refactor (#676)

  • feat: Remove global sessions, and introduce read only sessions for cases where no writing is required

  • refactor: Rename db to session

  • feat: Raise exceptions if commit/write/delete is attempted on a read-only session

  • feat: Add tests for the read only session

  • chore: lint using flake8

  • rename test_database -> db_engine

Co-authored-by: Richard Abrich <richard.abrich@gmail.com> (987f6ac)

v0.26.0 (2024-05-27)

Feature

  • feat(dashboard): Dashboard scrubbing (#672)

  • feat: Add ability to download spacy model from within pyinstaller build

  • refactor: Add id column as foreign keys instead of timestamp

  • feat(scrubbing): Add api endpoints and scrubbing feature

  • fix: Fix code after merge with main

  • lint: flake8 lint

  • refactor: Cleanup code and add comments

  • chore: Fix comments

  • chore: Add comments on crud.py

Co-authored-by: Richard Abrich <richard.abrich@mldsai.com> (3083fef)

v0.25.5 (2024-05-24)

Fix

  • fix(docs): fix typo in README.md (#686) (320bb88)

v0.25.4 (2024-05-22)

Fix

  • fix(installer): Fix build failing due to replicate and other issues (#684) (fdf286c)

v0.25.3 (2024-05-22)

Fix

  • fix(installer): add hidden import replicate (#680) (6621a04)

v0.25.2 (2024-05-19)

Fix

  • fix(app): add hidden-imports to build spec (#678) (d2db305)

v0.25.1 (2024-05-17)

Fix

  • fix(config): Fix path of default config file (#675) (9ffdf67)

v0.25.0 (2024-05-14)

Feature

  • feat: run posthog in production only (#670)

Co-authored-by: Richard Abrich <richard.abrich@mldsai.com> (bed12ec)

v0.24.1 (2024-05-14)

Fix

  • fix(dashboard): close dashboard from tray (#671) (3f0db86)

v0.24.0 (2024-05-12)

Feature

  • feat(VisualReplayStrategy): Remove model copy logic; avoid unnecessary segmentations (#669)

  • preferences_dir -> root_dir; add data_dir; remove copying logic; disable dashboard from tray; avoid unnecessary segmentations; bugfixes

  • fix json serialize error

  • with session

  • fix template paths

  • black; flake8

  • make dir if not exists

  • fix confest.py: RECORDING_DIRECTORY_PATH -> RECORDING_DIR_PATH

  • fix test_share.py: RECORDING_DIRECTORY_PATH -> RECORDING_DIR_PATH (45c06c3)

v0.23.1 (2024-05-11)

Fix

  • fix: Install latest version before deciding which release to upload to (#668) (c91efd4)

v0.23.0 (2024-05-11)

Feature

  • feat(dashboard): Add recording detail page with screenshots (#616)

  • feat: Add recording detail page with screenshots

  • refactor(screenshots): Refactor code to add more comments and improve styling

  • refactor: Cleanup of redirects and not found env variables

  • feat: Change dynamic route to regular routes with query parameters and use websockets since response is too large

  • add main guard to dashboard/run.py

  • feat(screenshots): Make changes to screenshots ui, add diff to images and add carousel

  • feat(dashboard): Terminate dashboard process on pressing ctrl + c

  • feat: Add write locks for endpoints which need to write to database

  • feat(screenshots): Add utility functions to copy objects so they are independent of the sa session

  • feat(screenshots): Remove diff and add progress loader

  • chore: flake8 lint

  • fix: Filter out invalid action events after copies are made

  • fet: Change favicon and logo on dashboard

Co-authored-by: Richard Abrich <richard.abrich@gmail.com> Co-authored-by: Richard Abrich <richard.abrich@mldsai.com> (0ac599c)

v0.22.0 (2024-05-10)

Feature

  • feat: Run ci steps only if not triggered by the bot commit (#666)

Co-authored-by: OpenAdapt Bot <bot@openadapt.ai> Co-authored-by: Richard Abrich <richard.abrich@mldsai.com> (400a73b)

v0.21.0 (2024-05-10)

Feature

  • feat: Add posthog analytics (#655)

  • feat: Add posthog analytics

  • feat: Move posthog config to the python config file (294fe71)

  • feat(tray): performance and UX improvements

  • write_video_event; pre_callback/post_callback

  • add Recording.config; read Screenshot.image from video; asserts if diff_video

  • add FrameCache

  • maybe_obfuscate; video_dir_path; event_type_modifier

  • update .gitignore

  • replace notifypy with pyqttoast

  • add video event to perf_q; fix documentation

  • add build.py main guard

  • reduce visualize import time

  • add RedirectOutput.null_stream

  • add on_ready argument to record; remove Notify

  • add task description input dialog; replace QTimer with Connection

  • configure replay strategy

  • handle argument types in replay dialog; remove replay_instructions where not used

  • show "No recordings available"

  • add delete menu

  • on_ready -> status_pipe; oaThread -> Thread; disable app action; sticky toasts; log_memory arg; view_file false

  • pass args to strategy class; add Config.ROOT_DIR_PATH; matplotlib use Qt5Agg

  • remove extensions.thread

  • Union -> |

  • fix mouse playback bug; sleep in NaiveReplayStrategy

  • improve parse_code_snippet; validate ActionEvent properties; fix ActionEvent.from_dict

  • fix: timestamp int -> float

  • fix: redundant_mouse_move -> remove_move_before_click

  • add ActionEvent.reducer_names

  • add common.MOUSE_CLICK_EVENTS; remove sleep in naive.py; disable remove_move_before_click

  • fix: num_total -> num_total_

  • RECORD_FULL_VIDEO; LOG_MEMORY; num_copies

  • visualize recording_timestamp

  • black

  • flake8

  • fix tests: add row2dicts drop_cols

  • replay status pipe

  • ignore reducer_names in get_action_prompt_dict (88b9726)

Fix

  • fix(build): python-semantic-release@v9.6.0 (c3c26e6)

  • fix(build): pip install poetry (#667) (0a64d65)

  • fix(build): poetry env use python3.10 in pyproject.toml

  • Revert "fix(build): poetry install order"

This reverts commit a475ee362efde1983681b570cb62e1037c4bd00e.

  • Revert "fix(build): poetry env use 3.10 (#663)"

This reverts commit c6c176879f703530465ac70a0ecd044394c90688.

  • Revert "fix(build): add setup-python to release job (#662)"

This reverts commit cc6cab34861032393d0264844d3714c0319ebd03.

  • pip install poetry -> poetry env use python3.10 (pyproject.toml) (553a29d)

  • fix(build): poetry install order

  • install poetry before poetry env (a475ee3)

  • fix(build): poetry env use 3.10 (#663) (c6c1768)

  • fix(build): add setup-python to release job (#662) (cc6cab3)

  • fix(build): remove notifypy from build.py (abd2d99)

Unknown

  • python-semantic-release@9.6.0 (e06bceb)

v0.20.1 (2024-05-03)

Fix

  • fix(config): restore Config.ROOT_DIR_PATH (#653) (b33e454)

v0.20.0 (2024-05-02)

Documentation

  • docs(README): add link to calculator demo (54c2b16)

Feature

  • feat(config, build): refactor config; build executables

  • feat(config): Make changes to config to use pydantic settings

  • chore: Refactor all uses of config to use the config object from the config module

  • refactor(config): Remove unused code, fix typos and add comments for clearer information

  • refactor: Add more comments and change variable names

  • fix(record): Fix progress bar

  • feature(config): Re-read config value only if it changes

  • update README

Co-authored-by: Richard Abrich <richard.abrich@gmail.com> (ee506f0)

Fix

  • fix(release): Revert to use admin token for release checkout action (#648) (1d80f33)

  • fix(release): Revert to use admin token for semantic release action (#646) (64cd483)

v0.19.0 (2024-04-27)

Feature

  • feat(VisualReplayStrategy): compute image similarity to avoid unnecessary segmentation

  • remove sct_image from Screenshot; fix typo

  • add Image.cropped_image

  • add experiments/imagesimilarity.py

  • bugfix: sct_image -> image

  • find_similar_image_segmentation

  • fix test_crop_active_window (3c185e8)

v0.18.3 (2024-04-22)

Fix

  • fix: video performance

  • remove screenshot_to_np (943adb7)

v0.18.2 (2024-04-22)

Fix

  • fix: video recording

  • screenshot_to_np Image.Image argument

  • remove unused import; update documentation/types (9a0501d)

v0.18.1 (2024-04-22)

Fix

  • fix: performance, windows cursor flicker

  • CAPTURES_DIR -> CAPTURE_DIR_PATH; add capture/main.py

  • save as mp4

  • mss.windows.CAPTUREBLT = 0

  • return PIL.image in utils.take_screenshot() (d354b94)

v0.18.0 (2024-04-16)

Feature

  • feat(VisualReplayStrategy): adapters: ultralytics, som, anthropic, google; remove_move_before_click; vision.py

  • add prompts/, adapters/openai.py, strategies/visual.py (wip)

  • adapters.anthropic

  • add anthropic.py

  • prompt with active segment descriptions

  • Set-of-Mark Prompting Adapter (#612)

  • Update openadapt/config.py

  • remove_move_before_click

  • started_counter; adapters.ultralytics

  • add vision.py

  • add openadapt/adapters/google.py

  • filter_masks_by_size

  • documentation

  • update README

  • add ultralytics

  • exclude alembic in black/flake8

  • exclude .venv in black/flake8

  • disable som adapter; remove logging

  • add adapters.google

Co-authored-by: Cody DeVilliers <devilliers.cody@gmail.com> (250943f)

v0.17.1 (2024-04-15)

Fix

  • fix(ci): dashboard -> install-dashboard

  • Update install_openadapt.sh

dashboard -> install-dashboard

  • dashboard -> install-dashboard (win)

  • pull_request_target -> pull_request (e3834ed)

v0.17.0 (2024-04-11)

Documentation

  • docs(README): System Overview -> Alpha Architecture

System Overview -> Alpha Architecture (dd1c29e)

  • docs(README): update System Overview diagram

Update system overview diagram (c08caf7)

  • docs(README): update System Overview diagram

Update system overview diagram (3b2dfbc)

  • docs(README): update System Overview diagram

Update system overview diagram (de9fad2)

  • docs(README): update System Overview diagram

Update system overview diagram (13a9f23)

  • docs(README): update System Overview diagram

Update system overview diagram (ff1e4d9)

  • docs(README): update System Overview diagram

Update system overview image (086e42f)

  • docs(README): update System Overview diagram (ca5f093)

  • docs(README): update System Overview diagram (7ca2086)

  • docs(README): update System Overview diagram

Update System Overview diagram (aee1078)

Feature

  • feat(dashboard): add web dashboard

  • feat: Complete initial setup of web dashboard

  • feat(recordings): Add simple view to start, stop and list recordings

  • fix: Fix sqlite thread issue and a few dashbaord ui improvements

  • feat: Add script to download npm dependencies and update installer script

  • chore: Code cleanup and workflow fix (0050cea)

v0.16.2 (2024-03-08)

Documentation

  • docs(README): add image of system tray icon and client GUI app (985cc6e)

  • docs(README): update System Overview diagram (edf2241)

  • docs(README): update System Overview diagram (1b12ffb)

  • docs(README): update System Overview diagram

  • Update README.md

Update system overview diagram (15f2818)

  • docs(README): add notable works-in-progress under contributing (e44aa1f)

  • docs(README): update system overview image (#587)

  • Update README.md

Update system overview image

  • Update README.md (91c3eab)

  • docs(README): document root directory requirement (a021c2b)

  • docs(README): poetry shell (dd9dc9f)

Fix

  • fix(app): use default logo for tray icon (21f229b)

Refactor

  • refactor(visualize): /visualize.py to /app; move deprecated/visualize.py to /

  • mv visualize.py -> app.py; restore deprecated/visualize.py

  • remove deprecated

  • swallow AssertionError regarding timestamps

  • fix logo path

Co-authored-by: Aaron <57018940+0dm@users.noreply.github.com> (9ed9ac3)

v0.16.1 (2024-02-29)

Documentation

  • docs(README): remove redundant text from image (76b55fd)

Fix

  • fix(video): add migration script (b769c4a)

v0.16.0 (2024-02-29)

Documentation

  • docs(README): document AudioInfo.words_with_timestamps (7759996)

  • docs(README): add System Overview image (8b56a83)

  • docs(README): early loom demo (729e0be)

Feature

  • feat: video

  • replace multiprocessing with pyav

  • add config.RECORD_WINDOW_DATA

  • video_write_q

  • fix get_timestamp; extract_frames_to_pil_images with pyav

  • add video.py; ActionEvent.original_timestamp

  • use global SCT in get_monitor_dims

  • fix tests

  • fix window._windows.get_active_window_state (missing type)

  • add tests/openadapt/test_video.py

  • flake8

  • black

  • poetry lock (20e08b8)

Unknown

  • Update README.md (#566) (c7f8af4)

  • docs(README) (000db3c)

  • Update README.md (#558) (028f6e8)

  • Update README.md (#557)

  • Update README.md

Add links to Architecture and RFC

  • Update README.md

  • Update README.md (ad6de5b)

  • docs(README)

  • Update README.md

Add contract positions

  • Update README.md

Improve contracts section (275db79)

v0.15.1 (2023-12-12)

Documentation

  • docs(README): Transformers -> LLMs

Transformers -> LMMs (ef4c901)

  • docs: README (aca53f5)

  • docs: features

  • Update README.md

  • Update README.md

  • Update README.md (aaf7727)

  • docs: README (c8bb1a7)

Unknown

  • Merge pull request #223 from Mustaballer/share-magic-wormhole (cf81f1a)

  • Update openadapt/config.py

Co-authored-by: Richard Abrich <richard.abrich@gmail.com> (b79f3b5)

  • Update openadapt/config.py

Co-authored-by: Richard Abrich <richard.abrich@gmail.com> (39b334e)

  • Merge branch 'main' into share-magic-wormhole (bf9e8bf)

  • docs(README) (ec58755)

  • Merge branch 'share-magic-wormhole' of https://github.com/Mustaballer/puterbot into share-magic-wormhole (117694b)

  • Restore export_recording import with lint ignore comment (6651f2c)

  • Merge branch 'main' into share-magic-wormhole (9682209)

  • change logging.py name to resolve naming conflict with logger library (54a954f)

  • remove custom visualize function (1367cb9)

  • Update README.md (#538) (a4bfdbd)

  • add spacy-curated-transformers (0edcd88)

  • poetry lock (21340b2)

  • Merge branch 'main' into share-magic-wormhole (00c79cf)

  • fix failing tests (22b5f0c)

  • poetry lock (61553f0)

v0.15.0 (2023-11-11)

Feature

  • feat(openadapt.privacy.providers): add private_ai as a scrubbing provider (#486)

  • ran black

  • add blank file for priavte ai

  • add class PrivateAIScrubbingProvider

  • add pvt_ai api key in config

  • ran pre-commit run --all

  • add scrub_text function

  • progress for image redaction

  • format

  • complete scrub_image

  • start scrub_pdf

  • add pdf redaction code

  • add more wrapper for invalid reponse from priavate ai

  • try to fix pytest

  • try to fix pytest

  • remove lst

  • remove uncessary methods

  • text scrubbing test all passses

  • pdf_redaction test works

  • add test_image_redaction test in pyetst

  • add easy ocr to poetry

  • pytest is fixed

  • remove versino files

  • remove un-neccasry files

  • add code to remove uncessary files after pytest

  • addressed #486 (comment)

  • address comment #486 (comment)

  • reduce line chars

  • addressed comment: #486 (comment)

  • fix flake8

  • use f strings

  • address comment: #486 (comment)

  • address comment: #486 (comment)

  • change to value error

  • remove .keys()

  • add constants

  • fix flake8 erros

  • use BytesIO

  • address comment #486 (comment)

  • rna black

  • final commit

  • remove unused code

  • refactor typo

  • rename redact_file_path to redacted_file_path

  • use BytesIO wherever possible

  • fix flake8

  • add documentation links

  • Apply suggestions from code review

  • Update tests/openadapt/privacy/providers/test_private_ai_scrub.py

  • fix poetry.lock

  • poetry.lock

Co-authored-by: Krish Patel <kmppatel133@gmail.com> Co-authored-by: Richard Abrich <richard.abrich@mldsai.com> Co-authored-by: Richard Abrich <richard.abrich@gmail.com> (396bbb5)

Fix

  • fix(install): add vs redistributable installation in powershell script (#490)

  • VS C++ redist installation

  • add VS C++ redist installtion

Co-authored-by: Krish Patel <kmppatel133@gmail.com> Co-authored-by: Richard Abrich <richard.abrich@mldsai.com> (086a5ca)

v0.14.0 (2023-11-10)

Feature

  • feat(openadapt.record): implemented notifications on record (#510)

  • implemented notifications on record

fixed deprecated/visualize

Unknown

v0.13.2 (2023-10-16)

Fix

  • fix: resolve repository not found error in mac install.sh script (#502)

  • Update install_openadapt.sh

  • Update install_openadapt.sh (eb3c8c3)

Unknown

  • Update README.md (#493)

  • Update README.md

replace slack with discord (5a6530a)

  • Merge remote-tracking branch 'upstream/main' into share-magic-wormhole (ca04296)

  • fix wormhole sharing (a94c303)

v0.13.1 (2023-08-30)

Fix

  • fix(tests.openadapt.privacy.providers): failing test_comprehend_scrub.py (#488)

  • skip all the tests if ther is an issue wiht aws config files, either they are not htere or incorrect values are porided

  • format (cec2a53)

Unknown

  • Merge pull request #483 from OpenAdaptAI/modify-install-script (5fa12eb)

  • Merge branch 'main' into modify-install-script (73bfad4)

v0.13.0 (2023-08-29)

Feature

  • feat(privacy.providers): add aws_comprehend as scrubbing provider (#476)

  • add aws_comprehend provider module

  • fix typo

  • add boto3 and botocore to poetry

  • ran poetry update

  • add the AWS Comprehend Class

  • update the script

  • create test module to test comprhend

  • refactor name

  • add full fleged test module

  • try to fix failing tests

  • try to fix failing tests

  • fixed pytest

  • format test file

  • fix all flake 8 formattings

  • add naming meaning for NER

  • remove repeated code and make a TextMixin

  • format

  • change scrub enabled to false after testing visualization

  • remove redundant rmethods

  • add enum style provider names

addressing: #476 (comment)

  • fix all flak8 errors

  • add files for private_ai scrubbing provider

  • change name

  • add scrub text function in PrivateAIScrubbingProvider

  • try to skip tests if api key is incorrect or missing or the syntax used in code is incorrect

  • pytest passes for test_private_ai

  • add temp code for pdfs redaction

  • remove the PRIVATE_AI provider code as it will be added in seprate pr

  • remove omre prvt_ai files

  • ran black

Co-authored-by: Richard Abrich <richard.abrich@mldsai.com> (33fe244)

Unknown

  • Merge branch 'main' into modify-install-script (705a2f0)

v0.12.0 (2023-08-29)

Feature

  • feat: manage recording database (#451)

  • implemented db module

  • use click + loguru (5b25b90)

Unknown

  • update poetry.lock file and some formatting (a03bd59)

  • Merge branch 'main' into share-magic-wormhole (24a3e79)

  • fix formatting (d668901)

  • Merge branch 'modify-install-script' of github.com:OpenAdaptAI/OpenAdapt into modify-install-script (4e52dc3)

  • address formatting errors (2fa3fde)

  • Merge branch 'main' into modify-install-script (b5ad05c)

v0.11.0 (2023-08-29)

Feature

  • feat: add capture.py - also fixes audio recording (#362)

  • merge

  • Create capture.py

  • Update capture.py

  • Update capture.py

  • it's finally fixed

  • add dependencies

  • comment

  • move code + use config.CAPTURE_DIR_PATH

  • remove debug lines

  • Update capture.py

  • OpenAdaptCapture -> Capture

  • add camera

  • Let's have this off by default.

  • hotfix

  • fix

  • linting

  • Create capture.py

  • windows

  • cleanup + lint

  • Update _windows.py

  • add audio + new windows recording

  • screen_recorder.free_resources()

  • Update _windows.py

  • isort

  • add playback recording

  • Update replay.py

  • Update replay.py

  • Update README.md

  • Revert "Update README.md"

This reverts commit 706410358d5e47ceccb34b77d82d5ffd0f3821a8.

  • Update README.md

  • Revert "Revert "Update README.md""

This reverts commit 0fe81563e88417d61012e24e1dc55befa960c2ed.

  • Update README.md

  • run pre-commit

  • Update pyproject.toml

  • Update openadapt/replay.py

  • Update openadapt/replay.py

  • Update openadapt/replay.py

  • Update replay.py

  • update poetry.lock

Co-authored-by: Richard Abrich <richard.abrich@gmail.com> Co-authored-by: Richard Abrich <richard.abrich@mldsai.com> (581b9b8)

v0.10.0 (2023-08-29)

Feature

  • feat: use sentry.io (#386)

  • sentry

  • check for main branch

  • Update openadapt/config.py

  • Update openadapt/config.py

  • ERROR_REPORTING_ENABLED

  • Update config.py

  • update poetry.lock

  • Update openadapt/config.py

Co-authored-by: Richard Abrich <richard.abrich@gmail.com> (90bfe8f)

v0.9.0 (2023-08-28)

Chore

  • chore: add invalid configuration assertion in naive.py (#471)

  • Update naive.py

  • simplify logical expression

  • github action check (6040fae)

  • chore: Silence pytest DeprecationWarnings (#407)

  • Update pyproject.toml

  • tomlkit

  • Update config.py

  • remove config (212452c)

  • chore: modify install script to execute on user's repo and branch (21e4942)

  • chore: validate functionality of status checks (#477)

  • chore: validate functionality of status checks

  • test removing install script testing

  • try removing docstring form module to see if its picked up

  • add reference to pull request

  • add removed docstring back for app init file

  • add missing check out statement (1485ae4)

Feature

  • feat: enhanced visualize.py with NiceGUI (#406)

  • Create visualize1.py

  • changes

  • fix actions + add dark mode + remove unused code

  • Update visualize1.py

  • Update visualize1.py

  • bump ^ nicegui == 1.2.24

  • splitter

  • add plot

  • updated

  • add search button

  • isort

  • formatting

  • make plot dynamic

  • Update visualize1.py

  • make logo dynamic

  • comments

  • missed one

  • fixed plot bug

    • max table children, deprecate old visualize

  • Update visualize.py

  • Update config.py

  • Update config.py

  • Update config.py

  • refactor: show -> view_file

  • Update visualize.py

  • Update visualize.py

  • downgrade fastapi

  • update config

  • linting

  • remove debug print

  • disabled on_select

  • Update visualize.py

  • fix visualization with tray

  • merge privacy api

  • Update visualize.py

  • pre-commit

  • Update poetry.lock (8031a9d)

Refactor

  • refactor: failing actions (#474)

  • add missing dicstrings

  • make docstring a bit longer

  • fix all flake8 errors

  • Add documentation on status checks

  • Update README.md

Co-authored-by: Mustafa Abdulrahman <mus2003.abdul@gmail.com> Co-authored-by: Richard Abrich <richard.abrich@gmail.com> (09f4e71)

  • refactor: style errors from productivity measurement PR (#480)

  • check for long gaps in recording

  • display basic productivity data in html page similar to visualize

  • show images for each window change

  • show productivity info for each window

  • WIP find tasks/cycles of ActionEvents

  • WIP find tasks/cycles of ActionEvents

  • WIP implementing brent's algorithm

  • implemented brent's algorithm

  • add task duration info + style changes to display

  • comments

  • floyd's algorithm and basic implementation of counting errors

  • implement longest repeated non-overlapping substring algorithm

  • removed unused code

  • small bug fixes

  • no empty window titles

  • small fixes

  • add title

  • edge case

  • make longest repeated substring recursive

  • changed window/tab switching

  • add number of actions in a task

  • add comments

  • make sure no non-repeating tasks are found

  • fix off by 1 error with window event screenshots

  • remove unused functions, comments, and some refactoring

  • docstrings

  • black

  • Undo changing PLOT_PERFORMANCE

  • style changes (2089e74)

Unknown

  • Update README.md (250949f)

  • Merge branch 'main' into share-magic-wormhole (5b9bbe0)

  • add default values when no parameters are passed (e8775e8)

  • Productivity measurement (#234)

  • check for long gaps in recording

  • display basic productivity data in html page similar to visualize

  • show images for each window change

  • show productivity info for each window

  • WIP find tasks/cycles of ActionEvents

  • WIP find tasks/cycles of ActionEvents

  • WIP implementing brent's algorithm

  • implemented brent's algorithm

  • add task duration info + style changes to display

  • comments

  • floyd's algorithm and basic implementation of counting errors

  • implement longest repeated non-overlapping substring algorithm

  • removed unused code

  • small bug fixes

  • no empty window titles

  • small fixes

  • add title

  • edge case

  • make longest repeated substring recursive

  • changed window/tab switching

  • add number of actions in a task

  • add comments

  • make sure no non-repeating tasks are found

  • fix off by 1 error with window event screenshots

  • remove unused functions, comments, and some refactoring

  • docstrings

  • black

  • Undo changing PLOT_PERFORMANCE (56d22a8)

v0.8.1 (2023-08-21)

Chore

  • chore(*): change installation of spacy weights to runtime (#462)

  • remove spacy from manual steup instruciton in README.md

  • remove spacy installion from both the install scripts

  • add todo

  • test runtime code for spacy installtion

  • pyetst passes even if spacy model is not installed

  • addressing:

#462 (comment)

  • add spacy-trnasformers

address comment: #462 (comment)

  • skip all the tests in test_scrub if spacy miodel is ont installed

  • format (479937e)

Fix

  • fix: enhance publish action and authors in pyproject.toml (#463)

  • fix: enhance publish action and authors in pyproject.toml

  • modify release-and-publish.yml

  • change author name to OpenAdapt.AI Team

  • use pull_request_target to trigger status checks for any git branch (c7813c2)

  • fix: enhance publish action and authors in pyproject.toml (dc5f2b6)

Refactor

  • refactor: add Privacy design API (#439)

  • add Privacy API design code

  • add Presidio.scrub_text

  • update script to remove linting error

  • add test script

  • try to fix the pytest error

  • try to fix failing test_scrub_api.py

  • fixed the pytest error

  • change the test file to use the providers code

  • refactor presidio_scrub

  • fix pytest test_presidio_scrub_text

  • fix pytest

  • update the scrub_image method header

  • add module docstrings

  • update base.py

  • update providers

  • update providers

  • add noqa

  • update flake8 to ignore flake8 F821 undefined name '...' error

  • remove noqa from line now

  • update flake8: fix undefined error in pylint and falek8

  • update privacy api

  • fix all pylint errors

  • fix all pytlint errors

  • fix all pylint errors in base.py

  • now pytest passes with 6 warnings

  • update visualize to use the privacy api providers code

  • now visualization works with new Privacy API

  • change scrub ebaled to False

  • fix pytest

  • remove scrbu.py old moidule

  • format test script

  • format base.py and presidio.py

  • remove scrub module

  • fix merge

  • add spacy runtime code

  • remove pytestmark unused variable

  • tests get skippped if spacy is not installed

  • update utils

  • format for final commit (5151cb5)

Unknown

  • resolve merge conflicts and linting errors from recent merge (0e8d620)

  • Merge branch 'main' into share-magic-wormhole (1b2eef3)

  • fix poetry conflicts and conflicting files (8ea0ee4)

  • test publish to test pypi (09dd4d6)

  • Merge remote-tracking branch 'upstream/enhance-publishing' into share-magic-wormhole (8b1299d)

  • change author name to OpenAdapt.AI Team (c77f339)

  • modify release-and-publish.yml (ebea2cb)

  • Merge branch 'main' into share-magic-wormhole (75b324d)

v0.8.0 (2023-08-10)

Chore

  • chore: resolve failing publish github actions (#458)

  • check if modified flake8 works

  • Add release github action

  • Add oa-pynput and oa-atomacos and refactor accordingly

  • Use simpler publish github action and rename to release-and-publish.yml

  • add preview check in main.yml

  • add documentation on publishing direct dependencies

  • chore: resolve publishing github action errors (7b57505)

Feature

  • feat: Implement System Tray Icon (#300)

  • add tray icon

  • move to tray.py

  • add notifications & guards

  • pyinstaller currently broken

  • Update tray.py

  • Update cards.py

  • hide icon in taskbar + minor improvements

  • add dropdown for visualize

  • Update tray.py

  • Update tray.py

  • add py6tray + notifier

  • BYE BYE PYSTRAY !!!

hello dependency inversion?

  • os.sep + fix console + other

  • use path.join

  • run -> _run

  • add replays

  • fix conflicting action items

  • fix database is locked + threading

  • type annotations

  • Update cards.py

  • Create visualize1.py

  • Revert "Create visualize1.py"

This reverts commit 753f6919e7566b89686922c4e6b2a4fddf33ef04.

  • fix typo

  • fix merge conflicts : still broken

  • fix

  • Revert "fix"

This reverts commit 9d844467a9a9f16e219175eb60734b709c6f7b76.

  • Revert "fix merge conflicts : still broken"

This reverts commit 82e62d95093e6114653f59b8a7ea94233efc60e1.

  • Update pyproject.toml

  • styling / linting

  • Update tray.py

  • Update build.py

  • return vals

  • Update build.py

  • show app

  • changes (9f2a04e)

Unknown

  • fix pytest (#460) (1049589)

  • update poetry.lock (4d66584)

  • Merge branch 'main' into share-magic-wormhole (453d2c2)

v0.7.1 (2023-08-10)

Chore

  • chore: add pypi action and oa-atomacos and oa-pynput packages (#456) (a62d7f3)

  • chore: suppress identical warnings (#389)

  • chore: suppress identical warnings

  • add max_num_warnings_per_second to limit number of allowed warnings per cond

  • remove MAX_NUM_REPEAT_WARNINGS and check for max num warnings per second in utils.py

  • Update openadapt/config.py

  • address linting errors and set new variable

  • use class for filter_log_messages and track message_timestamps with instance variable

  • create logging.py to replace logging class using namespace

  • test github actions with empty commit

  • replaced variable name with MESSAGES_TO_FILTER

  • Update openadapt/logging.py

Co-authored-by: Richard Abrich <richard.abrich@gmail.com> (7648210)

Fix

  • fix: pypi direct dependency failure (#459)

  • remove trf from toml and then ran poetry update

  • update all neccessary files (d638469)

Unknown

Co-authored-by: M <mortezaho.1376@gmail.com> (ea25b53)

  • resolve merge issues (c3173f8)

  • Merge branch 'main' into share-magic-wormhole (1a10f8a)

v0.7.0 (2023-07-28)

Feature

  • feat: scrub toggle for gui (#375)

  • add scrub toggle + write dark_mode to env

  • Update config.py

  • Update util.py

  • Update config.py

  • address comments

  • Update config.py

  • run isort

  • from first

  • Update openadapt/config.py

  • Update openadapt/config.py

  • Update openadapt/config.py

  • Update openadapt/config.py

  • Update openadapt/config.py

  • Update openadapt/config.py

  • add env file path (also where did the toggle go??)

  • Update config.py

  • Update config.py

  • Update config.py

  • isort

  • Update util.py

  • linted

Co-authored-by: Richard Abrich <richard.abrich@gmail.com> (1e96a4f)

v0.6.1 (2023-07-28)

Fix

  • fix: modify flake8 config (#429)

  • style: modify flake8 config

  • add platform check for macOS in pyobjc-framework-avfoundation version

  • remove file exclusion in .flake8 and add ignore comment in openadapt/strategies/init.py

  • resolve lint errors from recent merge (f03be2f)

v0.6.0 (2023-07-26)

Feature

  • feat(crud): compute and save screenshot diff (#367)

  • feat(crud): Compute and save screenshot diff

  • Add 2 columns in screenshot table to store png_diff_data and png_mask_diff_data.

  • CRUD now supports calculation and save screenshots diff data on the flight.

  • feat(config): Add SAVE_SCREENSHOT_DIFF environment variable

  • SAVE_SCREENSHOT_DIFF indicates that 2 neighbors screenshot will be compared and the difference will be saved to db

  • feat(crud): add missing import after merge

  • refactor(crud): add missing type annotations

  • refactor(crud): add missing type annotations (9189bca)

Unknown

  • address flake8 errors (f29f199)

  • resolve merge conflicts (2f66b8a)

  • Merge branch 'main' into share-magic-wormhole (ada2aad)

v0.5.8 (2023-07-25)

Fix

  • fix(install): improve powershell script (Issue #372) (#409)

  • fix: git reinstallation even if it si present

  • fix: Error Message:

Remove-Item : Cannot remove the item at 'C:\Users\Krish Patel\hi' because it is in use. At line:1 char:9

  •     Remove-Item -LiteralPath $setupdir -Force -Recurse

  •     ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
    • CategoryInfo : InvalidOperation: (:) [Remove-Item], PSInvalidOperation Exception
    • FullyQualifiedErrorId : InvalidOperation,Microsoft.PowerShell.Commands.RemoveIt emCommand

  • fix: issue that poetry shell gives "..runnning scripts is disabled on the command line"

  • fix: bug #4 issue to support multiple version of python (acc. to OpenAdapt standards)

  • add start mesage to know why sometimes the installtion command exits

  • fix the edge case where the new terminal PWD is not set to the OpenAdapt folder that was installed

  • Update install/install_openadapt.ps1

Co-authored-by: Richard Abrich <richard.abrich@gmail.com> (fb3ae1e)

v0.5.7 (2023-07-25)

Chore

  • chore: format changes with black, and google python docstring, install script testing (#289)

  • ran black

  • use poetry for install

  • Add caching to main.yml for faster github action checks

  • Add missing job to main.yml

  • try ubuntu latest instead

  • change readme type to string instead of array in pyproject.toml

  • Update poetry version in main.yml

  • try macos

  • commented out tests

  • see if black command works

  • see if black command runs properly

  • use black github action

  • fix parsing

  • use supported black github action

  • ignore venv as well

  • change args for flake8 action

  • try flake8 exclude

  • manually add and use flake8

  • change docstring keyword

  • Chain commands for installing flake8

  • exclude .venv

  • merged latest changes and add download instruction

  • remove import comment

  • try python command with ubuntu

  • add tesseract-ocr

  • add homebrew option

  • add cache for tesseract

  • add ntlk command with poetry

  • ran black

  • Add .flake8 and add flake8 to poetry

  • Add max length to flake8, add windows job with new install script, and address linting errors

  • add some ignore errors in flake8

  • Adress more flake8 lint errors

  • Change max line length

  • ran black

  • resolve new changes and ran black

  • remove "import nltk; nltk.download('punkt')" command

  • resolve lint errors in record.py

  • remove unnecessary commas

  • Address D415, sentence/comma missing on first line error

  • Resolve F403

  • Address D200, single line doctstrings

  • Addressed E731, F841, D205 errors

  • resolve F401, unused imports

  • Address return type annotations

  • Add type annotations for function arguments

  • ran black

  • Address 'Multi-line docstring summaries should start at the first line'

  • Revert main.yml to test if all checks pass

  • fix syntax issue in main.yml

  • Use cache for install poetry dependencies

  • Revert main.yml and convert black action to oneliner with poetry

  • Address lint errors for newly merged changes

  • Try caching tesseract install

  • test if tesseract is cached

  • try cache brew package

  • try cache brew again

  • Remove failing tesseract cache

  • Address lint errors from recent merge

  • replace test command

  • address comments on annotations and ran black

  • change todo

  • Shorten word line max length to 88 for comments

  • try executing script

  • keep windows runner as todo

  • comment poetry shell in install_opendapt.sh

  • add error flag in mac install script to avoid poetry shell in github actions

  • try to see if this will pass

  • update main.yml

  • Address incorrect function annotations in record.py

  • Address annotation errors in _windows.py

  • Addressed more general annotations

  • Address incomplete annotations in util.py

  • run isort and other precommit hooks with custom black config on all files

  • Update openadapt/crud.py

  • replaced more 'Any' type annotations

  • resolve lint errors from recent merge

  • ran black

  • resolve circular imports, and address Any annotations

Co-authored-by: Aaron <57018940+0dm@users.noreply.github.com> Co-authored-by: Richard Abrich <richard.abrich@gmail.com> (c815924)

Fix

  • fix: issues after latest merge (#424)

  • merge

  • hotfix

  • fix: resolve annotation errors and restore incorrectly removed code in lint PR

  • fix

  • Update models.py

  • run black

  • Update openadapt/models.py

Co-authored-by: Mustafa Abdulrahman <mus2003.abdul@gmail.com> Co-authored-by: Richard Abrich <richard.abrich@gmail.com> (2d4e8c6)

Unknown

  • update unit tests (76f14b0)

  • modify conftest.py and fixtures.sql to insert data to every table for fixture (653e785)

  • remove unittest class and fix failing test case for receiving recording, and clean up share.py (644c83a)

  • refactor copy_recording_data (786e063)

  • remove unnecessary function and todo comment (9b7f7af)

  • add command to visualize recording (18a4918)

  • extract db file upon receiving recording (625c192)

  • Copy all data relating to recording_timestamp in all tables (2f1548d)

  • copy alembic migrations (2149adc)

v0.5.6 (2023-07-20)

Chore

  • chore: add preview option to black pre-commit hook and update README (#405) (6a42eb7)

  • chore: configure isort with black profile and add black precommit hook (#384)

  • chore: configure isort with black profile and add black precommit hook

  • update black version

  • add advanced isort settings to match CONTRIBUTING.md (2e7496b)

Documentation

  • docs: replace MLDSAI with OpenAdaptAI in README.md (#402) (750cf1d)

  • docs: update README (installation table) (#398) (1212198)

  • docs: update readme (take transpose of installation table) (#397) (fe39c73)

  • docs: Update README.md (#390) (8745969)

Fix

  • fix(merge_consecutive_keyboard_events): Fix reference before assignment (#411)

Co-authored-by: Seyed Morteza Hosseini <seyedmortezahosseini@Seyeds-MacBook-Pro.local> (e136b28)

Unknown

  • modify env names and add asserts to share.py (5893b3e)

  • modify copy deb function to return recording data and remov comments and unused set_db_url (6196876)

  • Merge branch 'share-magic-wormhole' of https://github.com/Mustaballer/puterbot into share-magic-wormhole (7a67386)

  • use new approach for copying db (2f2c0dd)

  • Merge branch 'main' into share-magic-wormhole (d4d3f1c)

v0.5.5 (2023-07-17)

Fix

  • fix: loguru exception handling for invalid recordings (#361)

  • raise ValueError

  • improve exception handling

  • Update crud.py

  • use assert

  • reorganize catch

  • Update openadapt/replay.py

  • Update openadapt/visualize.py

  • Update openadapt/events.py

  • Update openadapt/crud.py

Co-authored-by: Richard Abrich <richard.abrich@gmail.com> (7aba45b)

v0.5.4 (2023-07-17)

Fix

  • fix(utils): prevent duplicate log messages (#339) (#366)

  • fix(utils): prevent duplicate log messages (#339)

Acquire a lock in utils.configure_logging. Otherwise this function has a race where two threads can both call logger.remove(), and then both call logger.add(), creating two identical sinks.

  • refactor(record): remove redundant configure_logging calls

configure_logging is already called at the module level so there's no need to call it with identical arguments in various functions.

  • fixup! fix(utils): prevent duplicate log messages (#339) (cf1a782)

  • fix: add test fixtures (#356)

  • fix: add test fixtures

  • revert test_summary.py (0ee5397)

v0.5.3 (2023-07-17)

Fix

  • fix: support more objective-c objects (#323)

  • Update _macos.py

  • Update _macos.py

  • Update _macos.py

  • add bug report option

  • Update _macos.py

  • undo formatting

  • refactor

  • split

  • remove debug line

  • Update _macos.py

  • Update _macos.py

  • Update _macos.py

  • Update _macos.py

  • reorganize

  • Update _macos.py

  • Update _macos.py

  • nonetype

  • Update _macos.py (be0774f)

v0.5.2 (2023-07-17)

Chore

  • chore: add isort as pre-commit hook (#319)

  • Add precommit hooks for isort, check-yaml, end-of-file-fixer, trailing-whitespaces

  • Updated README on setting up precommit hooks

  • Add updated poetry.lock

  • Fix step numbering of pre-commit section in README.md (72da341)

Documentation

  • docs: Create Use Case issue template (#324)

  • initial draft

  • new line issue

  • update link

  • address comment

  • add numbers (20fb5a3)

  • docs: update install section of README.md (#344)

  • run poetry lock --no-update

  • fix: update CONTRIBUTING.md

fix typo in 3 words and make pytest code word

  • fix: add required dependencies

  • add seup.md

  • add setup.md

  • remove typo

  • rename temporarily

  • rename to SETUP.md

  • update README to include more documentation on

-- when someone should use the install script vs. follow the steps here?

  • remove requirements.txt

  • add link to installation

  • rename typo: prerequisite

  • link to start: https://openadapt.ai/#start

  • reomve .venv as requirements.txt is no longer used

  • update installation instructions

  • update the Windows Installtion command (in favour of):

  1. https://github.com/OpenAdaptAI/OpenAdaptWeb/pull/30/files#r1252126510
  2. https://github.com/OpenAdaptAI/OpenAdaptWeb/pull/30/files#r1252128457

#344 (comment)

  • address the comment:

https://github.com/OpenAdaptAI/OpenAdapt/pull/344/files#r1252175602

  • add .venv to address the comment:

https://github.com/OpenAdaptAI/OpenAdapt/pull/344/files#r1252172932

and

https://github.com/OpenAdaptAI/OpenAdapt/pull/289/files#r1252150636 (755dd55)

Fix

  • fix: windows.get_active_window() (#333)

  • return top_window of the active app

  • remove runtime exception

  • handle runtime error

  • handle COMerror

  • add logger.warning

  • add logger.warning

  • add get_properties

  • remove unnecessary imports

  • remove -> Desktop

  • monkey patching

  • fix get_properties

  • monkey patch class

  • fix monkey patching

  • format with black (d3f07c9)

Unknown

  • use .env.example for creating .env and removed unnecessary exceptions (3992d1c)

  • Add .env.example and generate env in config.py (2d54e83)

  • update config.SCRUB_ENABLED to False (#373) (3f32883)

  • merge with latest main (04c69b8)

  • delete temp .env if ctrl+c during sharing (e675227)

  • Add missing docstring in db.py (8317634)

  • ran black and update poetry.lock (5e52b5c)

  • Add exception handling when ctrl+c during sharing that deletes db and zip file and reverts db environment. Also add type and return annotations (01eef24)

  • Merge branch 'main' into share-magic-wormhole (1096a15)

v0.5.1 (2023-07-04)

Fix

  • fix: add pympler and psutil (f853839)

v0.5.0 (2023-07-03)

Feature

  • feat: add progress bar in record.py and visualize.py

  • run poetry lock --no-update

  • add alive-progress via poetry and in code

  • add progress bar in visualization

  • add a check for MAX_EVENT = None

  • update the title for the Progress bAr (better for USer pov)

  • update the requirement.txt

  • ran black --line-length 80 &lt;file&gt; on record.py and visualize.py

  • remove all progress bar from record

  • add tqdm progress bar in recrod.py

  • add tqdm for visualiztion

  • remove alive-progress

  • consistent tqdm api

--add dynamic_cols: to enable adjustments when window is resized

Order: --total -description --unit --Optional[bar_format] --colour --dynamic_ncols

  • Update requirements.txt

Co-authored-by: Aaron <57018940+0dm@users.noreply.github.com>

  • Address comemnt: #318 (comment)

  • remove incorrect indent

  • remove rows

  • try to fix distorted table in html

  • add custom queue class

  • lint --line-length 80

  • fix NotImplementedError for MacOs -- using custom MyQueue class

  • rename custom -> thirdparty_customization

  • rename to something useful

  • address comments

  • rename dir to customized_imports

  • rename to extensions #318 (comment)

Co-authored-by: Aaron <57018940+0dm@users.noreply.github.com> (3e12fd4)

v0.4.0 (2023-07-03)

Feature

  • feat(install): download and install MacOS dependencies

  • add messages

  • add download python line

  • created cleanup func

  • helper functions created

  • partially down python downloading

  • python installation script complete

  • added git (and brew)

  • added git (and brew)

  • add tesseract and refactor

  • works on current macbook

  • install python with brew

  • install python with brew

  • check if pyenv is needed

  • merge2

  • merge2

  • simplify brew call

  • finished testing

  • Less output

  • split line

  • Revert adding svg file This reverts commit 5601407207b085c254cf86b2f425be2eddd741c1.

  • remove unnecessary things

  • remove ps1 edit

  • remove ps1 edits

  • make the ps1 the same

  • Remove space

  • add poetry and aesthetic changes

  • small changes

  • add brew to path if needed

  • switch to pip3

  • switch to pip3.10 (25b70c0)

v0.3.1 (2023-07-03)

Fix

  • fix(window): prevent SegmentationFault (cf0fc0b)

v0.3.0 (2023-07-02)

Feature

  • feat(record): memory profiling

  • tracemalloc

  • pympler

  • todo

  • changed position of tracemalloc stats collection

  • updated requirements.txt

  • memory leak fix and cleanup

  • removed todo

  • changed printing to logging

  • alphabetical order

  • changes to tracemalloc usage

  • plot memory usage

  • memory writer terminates with performance writer

  • add MemoryStat table to database

  • remove todo

  • switch from writing/reading memory using file to saving/retrieving from database

  • add memory legend to performance plot

  • prevent error from child processes terminating

  • style changes

  • moved PLOT_PERFORMANCE to config.py

  • only display memory legend if there is memory data

  • moved memory logging into function

  • removed unnecessary call to row2dicts

  • rename memory_usage to memory_usage_bytes

  • replaced alembic revision

  • remove start_time_deltas; minor refactor

  • fix indent

Co-authored-by: Krish Patel <65433817+KrishPatel13@users.noreply.github.com> Co-authored-by: Richard Abrich <richard.abrich@mldsai.com> Co-authored-by: Richard Abrich <richard.abrich@gmail.com> (ef0d5eb)

v0.2.0 (2023-07-02)

Documentation

  • docs: contributing

  • Update README.md

  • Update pull_request_template.md

  • Add import order

  • Add Poetry conflicts

  • Add Richard's better import order explanation: (5b9f735)

Feature

  • feat: stop listener

  • created listener for "oa.stop" sequence

  • fixed issue with comparing objects of diff types

  • moved list of sequences to config.STOP_SEQUENCES and changed code to accomadate multiple stop sequences, + minor changes to naming and logging

  • moved list of stop sequences to config.STOP_SEQUENCES

  • filter out stop sequence in crud.get_action_events

  • combined keyboard listeners for macOS compatability

  • style changes

  • code cleanup

  • special char support

  • change to config.STOP_STRS and split by character in record.py and crud.py

  • black

  • add todo and fix special char functionality

  • fix filter_stop_sequences

  • added SPECIAL_CHAR_STOP_SEQUENCES and STOP_SEQUENCES that combines STOP_STRS and SPECIAL_CHAR_STOP_SEQUENCES

  • STOP_SEQUENCES moved to config.py

  • black

  • black (385963c)

Unknown

  • Update config.py (#332) (aa49489)

v0.1.0 (2023-06-29)

Chore

  • chore(release): Use PAT token to bypass branch protection for release github action (#326)

  • feat(release): Initial development version 0.1.0

  • use PAT token to bypass branch protection for release github action (d456bc2)

Documentation

  • docs: Add note on making major release in CONTRIBUTING.md (e097189)

Feature

  • feat(install): install tesseract, remove vcredist (windows)

  • test only tesseract

  • test only tesseract

  • test tesseract only

  • uncomment the last line

  • try to redirect

  • change the description for failed message

  • add OCR

  • test python

  • format function calling

  • Update Description

  • prepare for git test

  • test Git

  • update the VSCppRedistCMD

  • using Write-Host

  • Use ';' for the return command

  • full test

  • add description for all arguments

  • test tesseract on pc with out it

  • fix order for the installtion

  • uncomment the remove-gitinstaller

  • Stop deletion of Openadapt if the pytest fails

  • add the Cleanupfailure parameter to the apt comman

  • make user oriented messages

  • rewrite comments

  • do not exit on pytest fail

  • remove VS C++ Redistributable

  • remove VS C++ installtion consts

  • fix pytest fail exit

  • redirect the output to null

  • rename the param

  • remove unneccessary line

  • try a new powershell window for poetry shell

  • add colours to messages

  • try to fix NSIS error

  • fix file name

  • different approach to fix NSIS

  • different approach to fix tesseract

  • try to fic NSIS error

  • try to fix NSIS error

  • remove line

  • remove uneccssary comment

  • remove unsupported dcostrings

  • remove unused arugs

  • redirect output to null

  • ran poetry lock --no-update to fix the warning

  • Address comment: #312 (comment)

  • Address comment: #312 (comment)

  • Address comment: #312 (comment)

  • imporve resuability and readability

  • remove redirection to null (ddb7d78)

  • feat(release): Initial development version 0.1.0 (#325) (5ab0e01)

Unknown

  • Merge branch 'main' into share-magic-wormhole (088f370)

  • ran black -l 60, and it used call chain (4c59c10)

  • Merge pull request #178 from Mustaballer/publishing-with-pypi

Automatic Publishing with PyPi (a37b62f)

  • restore original db name instead of literal (b801caf)

  • use tempfile in test_share.py and address minor changes (3434a00)

  • moved functions in crud.py to db.py (dafca05)

  • Update CONTRIBUTING.md referring to comments (84b623e)

  • Merge pull request #306 from dianzrong/expand-on-demo-replay-strategy

Fix Summary test (d56dd57)

  • Merge pull request #229 from angelala3252/feat/tracing

Implement tracing (5cdc8fd)

  • Merge pull request #315 from MLDSAI/feat/max_table_str_len

max_table_str_len (c92e2e6)

  • max_table_str_len (4051804)

  • Merge pull request #201 from dianzrong/update

Implement Updating (27b89b7)

  • Merge pull request #313 from MLDSAI/feat/obfuscate_config_logs

config.obfuscate (495a280)

  • don't obfuscate defaults (abac4e5)

  • remove publish action and rename to release.yml (9b340ee)

  • config.obfuscate (79c41f5)

  • ran black (f58fd5f)

  • ran black (2211f78)

  • reformat file and group constants together in config.py (afd9810)

  • Remove unnecessary function and pass test cases (9819330)

  • comments (a87e202)

  • Merge pull request #310 from KrishPatel13/feature/install

Add Tesseract OCR in for powershell script (ac27a79)

  • remove python3.10 as it works on mac not on window (52b0f58)

  • for cosistency remove the paranthesis (47019d6)

  • refresh the path everytime (55b288a)

  • remove uneccessary code (16c18e5)

  • ran format document (acef0be)

  • add function for Vs C++ redist

and beautify hte code for better readability (2029cc4)

  • made a function for git installtion (babe791)

  • remove redundant if condition and also fails on windows: as python3.10 is not a valid command (388ce67)

  • simplify the refresh command (ab56341)

  • fix merge conflict and use better approach for overwriting env (cbee5e8)

  • Merge branch 'main' into share-magic-wormhole (0977859)

  • try resolve merge conflict with poetry.lock (53f11f5)

  • modify export_sql to use paramerterized queries to prevent sql injection (9dc1850)

  • Organize Tesseract Installation (d3f479e)

  • Merge pull request #292 from KrishPatel13/feature/scrub_mp4

Scrubbing for mp4 files (fee2c72)

add pywinauto using poetry (5c443a9)

  • temporary changes to time performance of specific lines (683c3cf)

  • Merge branch 'MLDSAI:main' into feature/scrub_mp4 (8b23e20)

  • Merge branch 'fix/pywinauto' of https://github.com/KrishPatel13/OpenAdapt into fix/pywinauto (fc9755f)

  • add marker for pywinauto and ran poetry update (ee0a8e2)

  • Merge branch 'MLDSAI:main' into fix/pywinauto (224cde1)

  • Merge pull request #297 from dianzrong/expand-on-demo-replay-strategy

Refactored test to use custom replay strategy (767e362)

  • Merge pull request #299 from MLDSAI/abrichr-patch-3

Update README.md (3b72e81)

Update README.md (cf0c339)

  • Update README.md (66c3d70)

  • Merge pull request #207 from 0dm/clear-data

added openadapt.renew (15a5cca)

  • Merge pull request #268 from 0dm/poetry

Use Poetry for dependencies (bde3816)

  • remove license and update readme image (c6f30f1)

  • Merge pull request #204 from jesicasusanto/feat/windowstate_for_windows

Windowstate for windows (f837d62)

  • reorder authors alphabetically, and add placeholder license (983781c)

  • adjusted imports, added to readme (5a75be9)

  • add spacy files (e9d053a)

  • update for nicegui (b20b060)

  • Merge remote-tracking branch 'upstream/main' into poetry (17a12ad)

  • add noqa + newline after docstring (482ab56)

  • add docstring to main (a8fa74f)

  • serialize_rect -> dictify_rect (580c294)

  • split docstrings to be <= 80 chars per line (8f0b179)

  • Merge branch 'publishing-with-pypi' of https://github.com/Mustaballer/puterbot into publishing-with-pypi (567ea8f)

  • Update author list pyproject.toml (1a65973)

  • Merge pull request #266 from dianzrong/add-contributing-md

Update Contributing Templates (8653d0c)

  • Merge branch 'main' into share-magic-wormhole (395fa00)

  • Merge pull request #215 from Mustaballer/github-actions-lint-tests

Github actions for automatic testing and linting (0cd5c54)

  • Merge pull request #272 from KrishPatel13/feature/semantic_scrub

Feature/semantic scrub (a11b76b)

  • add comment for SCRUB_COLOR and remove unused import (e2bcbca)

  • removed test_window (09680c6)

  • Merge branch 'main' into clear-data (ab0c6b3)

  • fix visualizatoin->red color (93b32b8)

  • Merge pull request #169 from jesicasusanto/feat/sam_mixin

add sam_mixin.py (8fd1af7)

  • Merge branch 'main' into feat/sam_mixin (e3b4056)

  • Merge pull request #67 from dianzrong/expand-on-demo-replay-strategy

SummaryReplayStrategyMixin (2c0e860)

  • Merge pull request #135 from 0dm/add-GUI

GUI + Installer (3e1ebb9)

  • turn values into placeholders (40fd85e)

  • fix visualization error:

color must be int or single element tuple (ab4427c)

  • add scrub_cahr for force_scrubbing key char (438b22f)

  • Remove SCRUB_CHAR from config (b6ab737)

  • Merge branch 'main' into github-actions-lint-tests (eba635e)

  • Aesthetic changes to PR template (e5973d4)

  • Removed operators from scrub and changed the test_scrub (d03aae7)

  • Add .idea to gitignore (5a28170)

  • Merge branch 'main' into publishing-with-pypi (cbdf887)

  • Merge branch 'main' into share-magic-wormhole (b4b7879)

  • Merge branch 'MLDSAI:main' into feat/windowstate_for_windows (43ead42)

  • Merge branch 'MLDSAI:main' into feat/sam_mixin (a0f17c3)

  • undo changes (f6e0caf)

  • fix conflict (347eb3d)

  • fix merge conflict (ba4348a)

  • Update pyproject.toml (8871555)

  • Revert "merged changes"

This reverts commit 2066147107c63379ac20cdc95ba3d3fa63fe2603. (12c9243)

  • Revert "remove uneccesary files and"

This reverts commit 806e717049ae4ad76843134c907fa604534b5b28. (fb170e1)

  • Revert "Fix for Visualization"

This reverts commit 6d717f535a15867727065e48d0b7e92c3904204e. (7fc3439)

  • comments (330d999)

  • Update pyproject.toml (d814d8a)

  • added scripts (1eb2085)

  • Update pyproject.toml (853fef2)

  • create pyproject (2e6b487)

  • Request test output (ff8614a)

  • Merge branch 'main' into feat/tracing (70bf019)

  • Merge pull request #248 from dianzrong/add-contributing-md

Make OS Option Optional (6a77a3a)

  • Merge pull request #263 from MLDSAI/abrichr-patch-2

Update README.md (1095399)

  • Update README.md (dd1725b)

  • Add value to feature request (1cd9acc)

  • Simpler bug form (3cd2876)

  • Add <br> (047afce)

  • Update bug_form.yml (9fbd59e)

  • remove optional sections (27072ff)

  • Attempt to add new lines (9630394)

  • Remove optional required sections (6d3ead0)

  • Merge remote-tracking branch 'upstream/main' into add-GUI (794925c)

  • remove uneccesary files and add .idea in .gitignore (806e717)

  • Fix for Visualization (6d717f5)

  • merged changes (2066147)

  • Merge pull request #256 from MLDSAI/abrichr-patch-2

Update README.md (8c1c84b)

  • Update README.md (1123353)

  • Merge pull request #254 from MLDSAI/abrichr-patch-2

Update README.md (fe255ce)

  • Update README.md (af72ed6)

  • Merge pull request #253 from MLDSAI/abrichr-patch-2

Update README.md (a1b5daa)

  • Update README.md (da1dd46)

  • Update new feature template (717a1c1)

  • Make OS optional (fbe5008)

  • Merge pull request #247 from MLDSAI/abrichr-patch-2

Update README.md (912566a)

  • Update README.md (0818046)

  • Merge pull request #245 from MLDSAI/abrichr-patch-1

Update README.md (f1e3ca2)

  • Update README.md (685b20c)

  • Update README.md (19fbab4)

  • Update README.md (0306a38)

  • Update README.md (6524683)

  • Merge remote-tracking branch 'upstream/main' into clear-data (b88fa55)

  • add todo for future improvement (4fb0ba5)

  • Merge remote-tracking branch 'upstream/main' into add-GUI (c54103c)

  • Merge pull request #161 from dianzrong/add-contributing-md

Create CONTRIBUTING.md (f5cbdd2)

  • Merge pull request #241 from 0dm/scrubbing-changes

Scrubbing changes (180a774)

  • Merge pull request #243 from KrishPatel13/update/install

Add TODO in Installation Scripts (7ce0479)

  • add link in TODO (6369256)

  • add TODO: Tesseract OCR installation (5f6610e)

  • Correct typo (386c14f)

  • resolve merge conflicts (df22ff8)

  • Merge pull request #142 from AvidEslami/crop_active_window

Crop Screenshot to fit the Bounds of a WindowEvent (#108 (e3fd5c7)

  • Merge branch 'main' into clear-data (b5fdc81)

  • add black (5501191)

  • requested changes (76b1396)

  • fix window data to have hierarchy (4a58ad4)

  • changes (b20a4d9)

  • false by default (9975a09)

  • Merge remote-tracking branch 'upstream/main' into silence-warnings (3cd8daa)

  • Merge remote-tracking branch 'upstream/main' into add-GUI (df78d57)

  • Add github action bot name and email (1ff6435)

  • Merge pull request #239 from KrishPatel13/main

Fix Pytest (b92309c)

  • Fix Pytest (d399970)

  • rename localfilepicker (bbb3fca)

  • Merge remote-tracking branch 'upstream/main' into add-GUI (0666809)

  • doc: fix incorrect version bump example (281b77c)

  • enqueue log messages to make logging multiprocess-safe (eb3deb0)

  • Merge pull request #211 from KrishPatel13/feature/scrub-final

feat(scrub): Scrubbing and Fix Atomacos (d784d37)

  • Merge pull request #225 from 0dm/pickling_investigation

Use pickle.HIGHEST_PROTOCOL (45b77ce)

  • ran black on scrub.py (5ceea9a)

  • Merge branch 'MLDSAI:main' into feat/windowstate_for_windows (1638d96)

  • add serialize_rect function (b5d9d7e)

  • addressed reviewed comments (075cfff)

  • Add publish action to github, reformat CONTRIBUTING.md, set up git release config pyproject.toml (e63d455)

  • serialize RECT object (d0a0800)

  • Merge branch 'MLDSAI:main' into feature/scrub-final (23b5228)

  • fix get_descendants_info performance (371b7c2)

  • allow for python3 -m openadapt.app (6789dcd)

  • Merge branch 'silence-warnings' into add-GUI (45a651f)

  • Merge remote-tracking branch 'upstream/main' into add-GUI (cc0107f)

  • Merge remote-tracking branch 'upstream/main' into clear-data (b922155)

  • Merge remote-tracking branch 'upstream/main' into silence-warnings (cf3b7ce)

  • Merge remote-tracking branch 'upstream/main' into pickling_investigation (9ea3953)

  • Merge branch 'MLDSAI:main' into feat/tracing (3da5b64)

  • removed indentation since not necessary with logging (65fb226)

  • added tracing for most functions (except those that would be redundant) (e325c2e)

  • Merge branch 'publishing-with-pypi' of https://github.com/Mustaballer/puterbot into publishing-with-pypi (84c2e14)

  • Merge branch 'main' into publishing-with-pypi (89386f3)

  • use repository_username and repository_password instead of pypi_token in release.yml (e19dcfd)

  • Merge pull request #217 from KrishPatel13/install

Add openadapt/install (7db7cc9)

  • add pickle dumps state (28b409f)

  • use highest_protocol (76fb5ec)

  • fix typo (c36f13e)

  • Add CONTRIBUTING.md (871d1e7)

  • merge (9b64cc7)

  • better checks if changes are needed (8e66364)

  • Check if stashing is needed (d564bf4)

  • check if stashing is needed (cf9afa6)

  • added pull request template (bdb3ba8)

  • Copy from closed PR magic wormhole working code and test cases (8c0a78d)

  • add issue template to contributing (92889d9)

  • new feature template and add config to templates (6821222)

  • remove print (192217a)

  • add docstrings (feaf63a)

  • change docstring (5d92e22)

  • remove ws, reduce market point size (d582549)

  • update gitignore (38cf23c)

  • sync branch (7778049)

  • update .gitignore and requirements.txt (f7e2517)

  • fix inaccurate mask by adding more input points (90be2d1)

  • black sam.py (abcd31d)

  • remove unnecessary lines of code (ad39a80)

  • added test for to check for duplicate descendants (fe0c267)

  • def get_descendants_info (40ed70b)

  • use regex for excluding src and alembic directories (74e58c2)

  • exclude src from black check (9c2daa0)

  • Try Krish approach for failing dependency in requirements.txt (2460ca3)

  • add version to black, and moved around in requirements.txt (ce320b6)

  • use config file (8c70f6f)

  • use config.DB_FPATH (b7ed43e)

  • Update CONTRIBUTING.md with issues (c9fab2f)

  • renamed the template folder (d595c35)

  • Rename bug_form.yaml to bug_form.yml (598efe0)

  • Initial bug form (22dd66d)

  • improve formatting (bbbfde9)

  • refactor openadapt to OpenAdapt (853331b)

  • puterbot -> openadapt (aa6e5a3)

  • remove optional scrubbing for images for now (ad01102)

  • organized the requirements.txt (392a465)

  • created mock unit test (e505888)

  • fixed recording stop button (a680c4d)

  • save & sync switch states (e3732a3)

  • suggestions implemented (a61c812)

  • remove unused file (56d3cff)

  • fic utils.py L477 Todo (f495c4c)

  • add openadapt/install add install_openadapt.ps1 (from OpenAdaptAi/install repo) add install_openadapt.sh (from OpenAdaptAi/install repo) update spacy model from _lg to _trf (760be83)

  • fix main (c4edfef)

  • change state to include all props (86766ef)

  • Merge branch 'clear-data' into add-GUI (f165494)

  • remove commented line (93e9ba1)

  • added changes from review, fixed pyinstaller (77818ec)

  • Exclude migration files in black check and lint checks (d4c4b7a)

  • code reformating (389d373)

  • add scrubbing features (dab2967)

  • Copied main.yml from closed PR, and replaced reST doctsring style with Google Python Style (a9a062a)

  • scrubbing in diff images (37968e5)

  • refactor

added some comments and moved to scripts/reset_db.py (b728c98)

  • remove blank lines (318c344)

  • resolves a TODO in utils Moved DIRNAME_PERFORMANCE_PLOTS = "performance" in config (f72de4c)

  • Added function docstrings

fix typo is_seperated (d5b303d)

  • moved the text_sep, prefix and suffix from models.py to config also move language to config also moves the masking char to scrub (c69caf3)

  • Added Testing Section (8ec83b0)

  • purely summarizes now (f197253)

  • Update Readme convert back all hyphenated and scrubbed text back to hyphenated form (99bbb9a)

  • ran black, flake-8 and pylint (89430e2)

  • 255 -> (255,) single element tuple (80edc68)

  • implement get_active_element_state(x, y) (113933e)

  • Merge branch 'feat/windowstate_for_windows' of https://github.com/jesicasusanto/PAT into feat/windowstate_for_windows (37da667)

  • implement get_window_state() (97a9eba)

  • add .db-journal in .gitignore (03c1fc0)

  • fixed 255 -> (255,0,0) in config due to failing test (faab021)

  • Scrubbing Before Visualization Final Version (1296995)

  • make action_event a required parameter (df80ac0)

  • Refactored start.py to increase Python usage (c5ff8b7)

  • encapsulated into method "run_app" (25d82b5)

  • Added semantic release tool to pyproject.toml and updated github action (97863ee)

  • switch approach to incorporate scale_ratios (376cc66)

  • last line may need to be changed (fe77bb9)

  • Changed the update file to be a python file (b29905a)

  • added openadapt.renew (f6fba8a)

  • trying to fix the scrubbing configurations (b4a3b60)

  • Add scrub module Add test_scrub module Add Scrubbing config in config.py Add presidio and required packages in requirements.txt (ce67fd1)

  • allow window_event to be passed, if not passed retrieve from action_event relationship (2cafcf3)

  • Merge branch 'MLDSAI:main' into crop_active_window (69642a4)

  • Merge branch 'MLDSAI:main' into feat/windowstate_for_windows (e26c201)

  • implement get_active_window_meta() (3ec8b1f)

  • Create update.sh

Initial commit (b909b8d)

  • remove newline (e044d13)

  • more configurable (400370c)

  • Merge branch 'silence-warnings' into add-GUI (33f8cc9)

  • added filter for loguru (b534bc4)

  • add SHOW_PLOTS (8ea9773)

  • add RESIZE_RATIO (f221598)

  • undo whitespace (ce3bcbf)

  • removed code for testing (e63ae6b)

  • removed code for testing (56ae587)

  • fixed sam.py (a0989b6)

  • fixed indent and added visualization (ba40792)

  • Remove unnecessary changes (6b8a564)

  • Merge pull request #191 from MLDSAI/abrichr-patch-1

Update config.py (2bbe036)

  • Update config.py (d615950)

  • Merge pull request #122 from MLDSAI/feat/save-event-performance

Save performance data to db (5ce11ea)

  • migration (04cb8db)

  • fix (d2eaed3)

  • fix (60de470)

  • fixes (e0a1b23)

  • Merge branch 'main' into feat/save-event-performance (b576793)

  • Merge branch 'main' into feat/save-event-performance (f31d094)

  • fixes (4aca87d)

  • Merge remote-tracking branch 'upstream/main' into add-GUI (bfd4af7)

  • add PerformanceStat alembic migration script (7130b49)

  • Merge pull request #182 from MLDSAI/abrichr-patch-1

Update README.md (08dac61)

  • Update README.md (a0e8b71)

  • Merge pull request #120 from atineoSE/macOS_improvements

MacOS improvements (20976c5)

  • documentation (e1d4496)

  • Merge remote-tracking branch 'upstream/main' into add-GUI (c5cb169)

  • Merge branch 'main' into macOS_improvements (0d40517)

  • Merge pull request #179 from MLDSAI/abrichr-patch-1

Update README.md (75041fc)

  • Update README.md (c27fc3b)

  • Updated README with hosted image instead of relative image for visualize.py (f498c7d)

  • Added github actions for automatic publishing when releasing a new version (059651e)

  • Create pyproject.toml config using Test PyPi (686505d)

  • Merge pull request #176 from MLDSAI/fix/window

wrap with try/except (2777019)

  • import pickle (be6e7e0)

  • revert; try pickling (3fcbb17)

  • try except in trigger_action_event (cba2573)

  • wrap with try/except (a457f50)

  • Merge remote-tracking branch 'upstream/main' into add-GUI (8fc3d40)

  • remove unnecessary imports (a87f667)

  • remove unnecessary imports (95c9aa9)

  • add bbox functions (66a28a8)

  • Merge branch 'MLDSAI:main' into feat/sam_mixin (6b6b287)

  • Merge pull request #151 from MLDSAI/feat/window_state

Window state (4ea4ba8)

Updated README to note trackpad/touchpad limitations (fe8be21)

  • add sam_Mixin (8f2d67e)

  • create sam_mixin (63a569f)

  • modularization + fixes (f9b7029)

  • Add Github Action info

Added the exact linter used in the GitHub Action (23ca868)

  • implemented pyinstaller (fa43c57)

  • added file picker for import

todo: work on export (03b5295)

  • Merge remote-tracking branch 'upstream/main' into add-GUI (062cde9)

  • Create CONTRIBUTING.md

Rough draft (20abe2a)

  • Add instructions for troubleshooting (cf1bee4)

  • Improve description (1346f09)

  • Add information on how to set up permissions on macOS (a7c0ad9)

  • Ignore packages in editable mode (e0df478)

  • Add missing dependencies and import pynput in editable mode (907b6de)

  • deprecate old ui, add import/export recording (c8ad9fe)

  • Reformatted limitations in the README and added that most touchpad and trackpad gestures aren't supported (88aecca)

  • working StatefulReplayStrategy (fc8cb2a)

  • share button

could use it for exporting? or just sharing openadapt (a95661f)

code needs a little bit of clean up but is functional (359fbaf)

#109 renamed all instances of puterbot to openadapt (754b854)

  • MAX_TABLE_CHILDREN (b8481ee)

  • save window state (mac) (99dc235)

  • Merge branch 'MLDSAI:main' into expand-on-demo-replay-strategy (1f09c07)

  • Fixed initializer (13a930b)

  • small error with initializer (fbc2486)

  • Merge branch '#109' into add-GUI (09d1303)

  • resolved merge conflict (8508583)

  • Merge remote-tracking branch 'upstream/main' into #109 (3bd935c)

  • Revert "Merge branch 'main' into #109"

This reverts commit cb5373b6238b91c4576aca04228f3c416c1f5e6e, reversing changes made to 796e35a2ccf7c12df3b20a5903355ab4d07ab68a. (605e3fb)

  • Merge branch 'main' into #109 (cb5373b)

  • Created tests for the helper functions in summary_mixin.py (3895474)

  • Moved SummaryReplayStrategyMixin up (8aab461)

  • Formatting changes and changed ascii text to only contain words (becb3a8)

  • Additional formatting changes (e0ddbe8)

  • Used black and the Google Python style guide to imrpove formatting. (2dcf6cd)

  • Removed finding the last screenshot (a0ead1f)

  • Merge pull request #119 from 0dm/#103

#103 : Rename InputEvent(s) to ActionEvent(s) (27efb0a)

  • Update app.py

added logo button (8220fe4)

  • Add Functioning GUI

requires tkinter (c2db59d)

  • #103 : Refactor InputEvent => ActionEvent (7e537d4)

  • Revert "resolved #103"

This reverts commit b7c99373fb35e54f7e2efdafa09baa5aa818992c. (659b9d7)

  • Add newline (0844f9c)

  • Merge remote-tracking branch 'upstream/main' into #109 (796e35a)

  • Use _insert for writing perf stats to db (1564d56)

  • Merge pull request #129 from MLDSAI/fix/prompt_truncation

fix prompt truncation; fix diff_mask (0ab8213)

  • fix prompt truncation; fix diff_mask (dd045ef)

  • #109 renamed all instances of puterbot to openadapt (0e4e0ca)

  • Revert performance plot to off by default (c1cb8de)

  • Save event performances data. Closes #85 Fixes #93 (8ced5bd)

  • Merge pull request #121 from MLDSAI/abrichr-patch-1

Update README.md (4f22e89)

  • Update README.md (447969d)

  • resolved #103

🔨 (b7c9937)

  • Merge pull request #115 from MLDSAI/abrichr-patch-1

Update README.md (3f310d0)

  • Update README.md (089295e)

  • Merge pull request #110 from MLDSAI/abrichr-patch-1

Update README.md (2aa96d2)

  • Update README.md (1566cdf)

  • Merge remote-tracking branch 'upstream/main' (b49d1cd)

  • Merge pull request #107 from MLDSAI/abrichr-patch-1

Update README.md (e944074)

  • Update README.md (e0ed5fa)

  • Merge pull request #106 from MLDSAI/abrichr-patch-1

Update README.md (9eb420d)

  • Update README.md (793ef07)

  • Merge pull request #101 from MLDSAI/abrichr-patch-1

Update README.md (02b718c)

fastapi on localhost (cdaee2a)

  • Update README.md (29419e1)

  • Integrated SummaryReplayStrategyMixin into the DemoReplayStrategy (e6c67fb)

  • Refactored into a into a SummaryReplayStrategyMixin. Am open to changing the function parameters of get_summary and what attributes SummaryReplayStrategyMixin has (2116cf6)

  • Small type change (fad5430)

  • Removed print statements (b897ac8)

  • Added the needed libraries for DemoReplayStrategy (9c570fd)

  • Changed the method in which the OCR and ASCII texts are summarized and compared. (0a53330)

  • Changed the way window_changed was added (626c209)

  • Fixed error (d4968b6)

  • Merge remote-tracking branch 'origin/main' (33ee2d5)

  • Used ASCII to check the summarization of the OCR text (f34cec2)

  • Merge branch 'MLDSAI:main' into main (daaf679)

  • Used the OCR text to note in the prompt to add a note at the front of the string to indicate whether the screen changed (f5e935d)

  • Update README.md (17f8e64)

  • Update README.md (d37b157)

  • Update README.md (02cfb5a)

  • Merge pull request #31 from MLDSAI/fix/sys_platform

pywin32 on windows only (76aa27b)

  • pywin32 on windows only (228a4b3)

  • get_screenshot -> take_screenshot (18327f0)

  • Update README.md (8a563bb)

  • rename completion_history -> result_history (6892cf4)

  • add InputEvent.str; improve demo (549ef67)

  • Merge pull request #25 from MLDSAI/feat/ascii

add ascii_mixin.py (cb28427)

refactor screenshots (da13e5f)

  • Screenshot.take_screenshot; fix fps (0657e43)

  • refactor screenshots (f34c5f6)

  • Merge pull request #21 from MLDSAI/feat/llm_ocr_demo

add llm_ocr_demo.py and related mixins (09e36f8)

add round_timestamps (601208c)

  • NUM_TIMESTAMP_DIGITS=6 (74b2410)

  • read/write properties instead of globals in NaiveReplayStrategy (5828baa)

  • add round_timestamps (2e2e2a7)

  • Update README (fd7e825)

  • update visualize.png (d486d6f)

  • update README (eaa76a7)

  • Merge pull request #18 from MLDSAI/feat/replay_strategies

Add puterbot/strategies (a75665b)

  • Merge branch 'main' into feat/replay_strategies (76097e4)

  • add missing pywin32 (91942a3)

  • update README (44cafc4)

  • Update README and docs (7969e98)

  • add assets/visualize.png; add back_populates; update README (4461031)

  • Add puterbot/strategies (a7ce3e8)

  • Update README.md (f8f3438)

  • Update README.md (6ec32b6)

  • Merge pull request #16 from MLDSAI/feat/task_description

add Recording.task_description; recording.py types and documentation (0325fc3)

  • add Recording.task_description; recording.py types and documentation (0299a05)

  • Update README.md (93bfdf9)

  • Update README.md (b69a3b7)

  • Merge pull request #10 from MLDSAI/ag23

Update README (91c57f0)