Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

python 3.12/stats/benches/ui fixes #6

Merged
merged 8 commits into from
Feb 13, 2024
+10,357 −3,038
Merged

python 3.12/stats/benches/ui fixes #6

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
8 commits
Select commit Hold shift + click to select a range
513c430
wl
e-nikolov Jan 24, 2024
d25b07d
stats and benches
e-nikolov Feb 4, 2024
68e0555
scrolls
e-nikolov Feb 12, 2024
c9edac5
scrolls
e-nikolov Feb 12, 2024
992f76a
scrolls 3
e-nikolov Feb 12, 2024
674f5a8
scrolls 4
e-nikolov Feb 12, 2024
1a6fe80
cleanup
e-nikolov Feb 13, 2024
92d605d
cleanup
e-nikolov Feb 13, 2024
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
12 changes: 0 additions & 12 deletions .env
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1,13 +1 @@
# complete -o nospace -C /nix/store/zbzv9x7y2z690pj4kwpq1f4lak47w9f9-terraform-1.3.3/bin/terraform terraform

TAILSCALE_API_KEY=op://personal/mpyc-demo/tailscale-api-token
TAILSCALE_TAILNET=op://personal/mpyc-demo/tailscale-tailnet
DIGITALOCEAN_TOKEN=op://personal/mpyc-demo/digitalocean-api-token
AWS_ACCESS_KEY_ID=op://personal/mpyc-demo/digitalocean-spaces-key-id
AWS_SECRET_ACCESS_KEY=op://personal/mpyc-demo/digitalocean-spaces-secret-access-key
SPACES_ACCESS_KEY_ID=op://personal/mpyc-demo/digitalocean-spaces-key-id
SPACES_SECRET_ACCESS_KEY=op://personal/mpyc-demo/digitalocean-spaces-secret-access-key
TF_VAR_DOMAIN=demo.mpyc.tech
G=test
VITE_HTTPS_KEY=op://personal/mpyc-demo/tls-home-nix-key
VITE_HTTPS_CERT=op://personal/mpyc-demo/tls-home-nix-crt
17 changes: 8 additions & 9 deletions .envrc
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1,17 +1,16 @@
export DIRENV_WARN_TIMEOUT=1m

if ! has nix_direnv_version || ! nix_direnv_version 3.0.0; then
source_url "https://raw.githubusercontent.com/nix-community/nix-direnv/3.0.0/direnvrc" "sha256-21TMnI2xWX7HkSTjFFri2UaohXVj854mgvWapWrxRXg="
dotenv_if_exists

# use oprc

if ! has nix_direnv_version || ! nix_direnv_version 3.0.4; then
source_url "https://raw.githubusercontent.com/nix-community/nix-direnv/3.0.4/direnvrc" "sha256-DzlYZ33mWF/Gs8DDeyjr8mnVmQGx7ASYqA5WlxwvBG4="
fi

watch_file ./nix/devenv.nix
watch_file devenv.lock
watch_file devenv.yaml
nix_direnv_manual_reload

if ! use flake . --impure; then
echo "devenv could not be built. The devenv environment was not loaded. Make the necessary changes to devenv.nix and hit enter to try again." >&2
fi

if [ -f .env ]; then
dotenv
watch_file .env
fi
1 change: 1 addition & 0 deletions .gitignore
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -412,6 +412,7 @@ celerybeat.pid
*.sage.py

# Environments
.oprc
.env
.venv
env/
Expand Down
54 changes: 36 additions & 18 deletions benches/bnnmnist.txt
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1,45 +1,63 @@
Python 3.11

╭────────────────────────────── stats ───────────────────────────────╮
│ asyncio: tasks: 2 / 1 / 8 k / 29 k | loop: 599 / 152 k / 152 k │
│ data s/r: 4.6 MiB / 4.6 MiB │
│ latency: 2.00 ms / 745 ms / 1.81 s │
│ messages s/r: 41 k / 41 k │
│ on_runtime_message │
│ └── time: 4.00 μs / 51.6 μs / 353 ms │
│ send_runtime_message │
│ └── time: 14.0 μs / 52.4 μs / 35.1 ms │
╰───────────────────────────── 00:01:14 ─────────────────────────────╯


############################# bnnmnist/3 ##########################

mswsl1/native 00:27

mswin1/web/v0.6.0-c8b8d89/edge/debug 02:25
mswin1/web/v0.5.0-c8b8d89/edge/debug 01:32
mswin1/web/v0.4.0-76ca881/edge/debug 01:32
mswin1/web/v0.9.2-312c118(wl10)/edge/stats 01:14
mswin1/web/v0.9.2-312c118(wl10)/edge 01:14

mswin1/web/v0.6.0-c8b8d89/edge/stats 02:25
mswin1/web/v0.5.0-c8b8d89/edge/stats 01:32
mswin1/web/v0.4.0-76ca881/edge/stats 01:32
mswin1/web/v0.2.1-a51a93f/edge 02:10

mswin1/web/v0.6.0-c8b8d89/ffox/debug ??:??
mswin1/web/v0.5.0-c8b8d89/ffox/debug ??:??
mswin1/web/v0.4.0-76ca881/ffox/debug ??:??
mswin1/web/v0.6.0-c8b8d89/ffox/stats ??:??
mswin1/web/v0.5.0-c8b8d89/ffox/stats ??:??
mswin1/web/v0.4.0-76ca881/ffox/stats ??:??
mswin1/web/v0.2.1-a51a93f/ffox ??:??


############################# bnnmnist/1 #############################

mswsl1/native 00:21

mswin1/web/v0.6.0-c8b8d89/edge/debug 00:55
mswin1/web/v0.5.0-76ca881/edge/debug 00:58
mswin1/web/v0.4.0-76ca881/edge/debug 00:58
mswin1/web/v0.9.2-312c118(wl10)/edge 00:44

mswin1/web/v0.6.0-c8b8d89/edge/stats 00:55
mswin1/web/v0.5.0-76ca881/edge/stats 00:58
mswin1/web/v0.4.0-76ca881/edge/stats 00:58
mswin1/web/v0.2.1-a51a93f/edge 01:57 / 02:00

mswin1/web/v0.6.0-c8b8d89/ffox/debug ??:??
mswin1/web/v0.5.0-c8b8d89/ffox/debug ??:??
mswin1/web/v0.4.0-76ca881/ffox/debug ??:??
mswin1/web/v0.6.0-c8b8d89/ffox/stats ??:??
mswin1/web/v0.5.0-c8b8d89/ffox/stats ??:??
mswin1/web/v0.4.0-76ca881/ffox/stats ??:??
mswin1/web/v0.2.1-a51a93f/ffox ??:??

############################# bnnmnist/0 #############################

mswsl1/native 00:13

mswin1/web/v0.6.0-c8b8d89/edge/debug 00:37
mswin1/web/v0.5.0-c8b8d89/edge/debug 00:39
mswin1/web/v0.4.0-76ca881/edge/debug 00:39
mswin1/web/v0.9.2-312c118(wl10)/edge 00:32

mswin1/web/v0.6.0-c8b8d89/edge/stats 00:37
mswin1/web/v0.5.0-c8b8d89/edge/stats 00:39
mswin1/web/v0.4.0-76ca881/edge/stats 00:39
mswin1/web/v0.2.1-a51a93f/edge 00:39

mswin1/web/v0.6.0-c8b8d89/ffox/debug ??:??
mswin1/web/v0.5.0-c8b8d89/ffox/debug ??:??
mswin1/web/v0.4.0-76ca881/ffox/debug ??:??
mswin1/web/v0.6.0-c8b8d89/ffox/stats ??:??
mswin1/web/v0.5.0-c8b8d89/ffox/stats ??:??
mswin1/web/v0.4.0-76ca881/ffox/stats ??:??
mswin1/web/v0.2.1-a51a93f/ffox ??:??
151 changes: 95 additions & 56 deletions benches/cnnmnist.txt
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1,63 +1,98 @@
Python 3.11

╭────────────────────────────── stats ──────────────────────────────╮
│ asyncio: tasks: 2 / 1 / 113 k / 728 k | loop: 2 k / 3 M / 3 M │
│ data s/r: 37.6 MiB / 37.6 MiB │
│ latency: 1.00 ms / 72.7 ms / 9.18 s │
│ messages s/r: 738 k / 738 k │
│ on_runtime_message │
│ └── time: 4.00 μs / 41.2 μs / 1.73 s │
│ send_runtime_message │
│ └── time: 14.0 μs / 42.6 μs / 81.1 ms │
╰──────────────────────────── 00:09:30 ─────────────────────────────╯

╭───────────────────────────────────── stats ─────────────────────────────────────╮
│ $time: │
│ _run_once: ∧ 35.0 μs / μ 2.46 ms / ∨ 20.5 s / ∑ 658 s │
│ call_later: ∧ 4.00 μs / μ 101 μs / ∨ 3.31 s / ∑ 142 s │
│ call_later:89: ∧ 0.00 s / μ 3.45 μs / ∨ 12.6 ms / ∑ 9.23 s │
│ nothing: ∧ 0.00 s / μ 2.94 μs / ∨ 16.9 ms / ∑ 6.70 s │
│ nothing2: ∧ 0.00 s / μ 15.7 μs / ∨ 887 ms / ∑ 34.9 s │
│ nothing3: ∧ 4.00 μs / μ 24.6 μs / ∨ 2.99 s / ∑ 65.6 s │
│ on_runtime_message: ∧ 0.00 s / μ 80.3 μs / ∨ 3.31 s / ∑ 65.6 s │
│ run_handle: ∧ 0.00 s / μ 2.00 ms / ∨ 20.5 s / ∑ 561 s │
│ run_handle_outer1: ∧ 0.00 s / μ 2.01 ms / ∨ 20.5 s / ∑ 585 s │
│ run_handle_outer2: ∧ 4.00 μs / μ 2.02 ms / ∨ 20.5 s / ∑ 609 s │
│ send_runtime_message: ∧ 19.0 μs / μ 61.6 μs / ∨ 47.0 ms / ∑ 43.8 s │
│ asyncio: tasks: 1.00 / ∨ 107 k / ∑ 728 k | loop: o 1.77 k / i 3.61 M / 2.00 │
│ data: ⬆37.6 MiB / ⬇37.6 MiB │
│ latency: ∧ 1.00 ms / μ 6.77 ms / ∨ 10.9 s / ∑ 1.46 Ms │
│ messages: ⬆738 k / ⬇738 k │
╰─────────────────────────────────── 00:14:55 ────────────────────────────────────╯


############################# cnnmnist/3 ##########################

mswsl1/native 02:25
mswin1/native 02:19
linux2/native 02:02

mswin1/web/v0.9.2-312c118(wl7)/chrm/debug 09:30
mswin1/web/v0.9.2-312c118(wl6)/chrm 08:40
mswin1/web/v0.9.2-312c118(wl10)/chrm/stats 09:30
mswin1/web/v0.9.2-312c118(wl10)/chrm 07:43
mswin1/web/v0.9.2-312c118(wl10)/edge/stats 09:30
mswin1/web/v0.9.2-312c118(wl10)/edge 07:43

mswin1/web/v0.9.2-312c118(wl7)/chrm/stats 09:30
mswin1/web/v0.9.2-312c118(wl7)/chrm 08:40

mswin1/web/v0.9.2-312c118(wl6)/chrm/debug 09:46
mswin1/web/v0.9.2-312c118(wl6)/chrm/stats 09:46
mswin1/web/v0.9.2-312c118(wl6)/chrm 08:40

mswin1/web/v0.9.2-312c118(wl5)/chrm/debug 09:48
mswin1/web/v0.9.2-312c118(wl5)/chrm/stats 09:48
mswin1/web/v0.9.2-312c118(wl5)/chrm 08:13

mswin1/web/v0.9.2-312c118(wl4)/chrm/debug 09:54
mswin1/web/v0.9.2-312c118(wl4)/chrm/stats 09:54
mswin1/web/v0.9.2-312c118(wl4)/chrm 08:21

mswin1/web/v0.9.2-312c118(wl3)/chrm/debug 10:01
mswin1/web/v0.9.2-312c118(wl3)/chrm/stats 10:01
mswin1/web/v0.9.2-312c118(wl3)/chrm 08:40

mswin1/web/v0.9.2-e110e8c(owl3)/chrm/debug 09:50
mswin1/web/v0.9.2-e110e8c(owl3)/chrm/stats 09:50
mswin1/web/v0.9.2-e110e8c(owl3)/chrm 09:17

mswin1/web/v0.9.2-e110e8c(owl2)/chrm/debug 10:29 / 10:24 / 10:14
mswin1/web/v0.9.2-e110e8c(owl2)/chrm/stats 10:29 / 10:24 / 10:14
mswin1/web/v0.9.2-e110e8c(owl2)/chrm 08:46 / 12:00 / 09:06 / 09:18

mswin1/web/v0.9.2-03f1a8a(owl)/chrm/debug xx:xx - queueMicrotask deadlock after Barrier 1 0
mswin1/web/v0.9.2-03f1a8a(owl)/chrm xx:xx - queueMicrotask deadlock after Barrier 1 0,
mswin1/web/v0.9.2-03f1a8a(owl)/chrm/stats xx:xx - queueMicrotask deadlock after Barrier 1 0
mswin1/web/v0.9.2-03f1a8a(owl)/chrm xx:xx - queueMicrotask deadlock after Barrier 1 0

mswin1/web/v0.7.0-d09e338/edge/full_async 30:00
mswin1/web/v0.7.0-d09e338/edge/full_call_soon 24:19
mswin1/web/v0.7.0-d09e338/edge 11:37
mswin1/web/v0.7.0-d09e338/edge/debug 11:59
mswin1/web/v0.5.0-d09e338/edge/debug 11:32 / 11:55
mswin1/web/v0.5.0-c8b8d89/edge/debug/console 25:51
mswin1/web/v0.4.0-76ca881/edge/debug 12:40 / 12:45
mswin1/web/v0.2.1-a51a93f/edge/debug 19:53 / 20:08
mswin1/web/v0.7.0-d09e338/edge/stats 11:59
mswin1/web/v0.5.0-d09e338/edge/stats 11:32 / 11:55
mswin1/web/v0.5.0-c8b8d89/edge/stats/console 25:51
mswin1/web/v0.4.0-76ca881/edge/stats 12:40 / 12:45
mswin1/web/v0.2.1-a51a93f/edge/stats 19:53 / 20:08

mswin1/web/v0.7.0-d09e338/ffox 12:17
mswin1/web/v0.7.0-d09e338/ffox/debug 13:16
mswin1/web/v0.5.0-c8b8d89/ffox/debug ??:??
mswin1/web/v0.4.0-76ca881/ffox/debug ??:??
mswin1/web/v0.2.1-a51a93f/ffox/debug ??:??
mswin1/web/v0.7.0-d09e338/ffox/stats 13:16
mswin1/web/v0.5.0-c8b8d89/ffox/stats ??:??
mswin1/web/v0.4.0-76ca881/ffox/stats ??:??
mswin1/web/v0.2.1-a51a93f/ffox/stats ??:??

linux2/web/v0.7.0-d09e338/edge 13:15
linux2/web/v0.7.0-d09e338/edge/debug 13:51 / 14:12 / 13:54
linux2/web/v0.5.0-c8b8d89/edge/debug 14
linux2/web/v0.4.0-76ca881/edge/debug ??:??
linux2/web/v0.2.1-a51a93f/edge/debug ??:??
linux2/web/v0.7.0-d09e338/edge/stats 13:51 / 14:12 / 13:54
linux2/web/v0.5.0-c8b8d89/edge/stats 14
linux2/web/v0.4.0-76ca881/edge/stats ??:??
linux2/web/v0.2.1-a51a93f/edge/stats ??:??

linux2/web/v0.7.0-d09e338/ffox/debug/full_async 36:00
linux2/web/v0.7.0-d09e338/ffox/debug 16:00 / 16:59
linux2/web/v0.5.0-c8b8d89/ffox/debug 19:44 / 20:42 / 20:49
linux2/web/v0.5.0-c8b8d89/ffox/debug/10/100 36:00
linux2/web/v0.4.0-76ca881/ffox/debug 23:38
linux2/web/v0.2.1-a51a93f/ffox/debug ??:??
linux2/web/v0.7.0-d09e338/ffox/stats/full_async 36:00
linux2/web/v0.7.0-d09e338/ffox/stats 16:00 / 16:59
linux2/web/v0.5.0-c8b8d89/ffox/stats 19:44 / 20:42 / 20:49
linux2/web/v0.5.0-c8b8d89/ffox/stats/10/100 36:00
linux2/web/v0.4.0-76ca881/ffox/stats 23:38
linux2/web/v0.2.1-a51a93f/ffox/stats ??:??


mswin1/web/v0.5.0-c8b8d89/edge/dev 10:22
Expand All @@ -70,32 +105,34 @@ mswin1/native 01:20
linux2/native 01:06


mswin1/web/v0.9.2-312c118(wl3)/chrm/debug 04:08
mswin1/web/v0.9.2-312c118(wl10)/edge 03:05

mswin1/web/v0.9.2-312c118(wl3)/chrm/stats 04:08
mswin1/web/v0.9.2-312c118(wl3)/chrm 03:56

mswin1/web/v0.9.2-e110e8c(owl3)/chrm/debug 03:36
mswin1/web/v0.9.2-e110e8c(owl3)/chrm/stats 03:36
mswin1/web/v0.9.2-e110e8c(owl3)/chrm 03:38

mswin1/web/v0.9.2-e110e8c(owl2)/chrm/debug 03:40
mswin1/web/v0.9.2-e110e8c(owl2)/chrm/stats 03:40
mswin1/web/v0.9.2-e110e8c(owl2)/chrm 03:47

mswin1/web/v0.9.2-03f1a8a(owl)/chrm/debug 03:38
mswin1/web/v0.9.2-03f1a8a(owl)/chrm/stats 03:38
mswin1/web/v0.9.2-03f1a8a(owl)/chrm 03:43

mswin1/web/v0.5.0-c8b8d89/edge/debug 05:17
mswin1/web/v0.4.0-76ca881/edge/debug 05:18
mswin1/web/v0.5.0-c8b8d89/edge/stats 05:17
mswin1/web/v0.4.0-76ca881/edge/stats 05:18
mswin1/web/v0.2.1-a51a93f/edge 05:57

mswin1/web/v0.5.0-c8b8d89/ffox/debug ??:??
mswin1/web/v0.4.0-76ca881/ffox/debug ??:??
mswin1/web/v0.2.1-a51a93f/ffox/debug ??:??
mswin1/web/v0.5.0-c8b8d89/ffox/stats ??:??
mswin1/web/v0.4.0-76ca881/ffox/stats ??:??
mswin1/web/v0.2.1-a51a93f/ffox/stats ??:??

linux2/web/v0.5.0-c8b8d89/edge/debug 05:20
linux2/web/v0.4.0-76ca881/edge/debug 05:34
linux2/web/v0.5.0-c8b8d89/edge/stats 05:20
linux2/web/v0.4.0-76ca881/edge/stats 05:34
linux2/web/v0.2.1-a51a93f/edge 06:13

linux2/web/v0.5.0-c8b8d89/ffox/debug 06:02 / 05:52 / 05:46
linux2/web/v0.4.0-76ca881/ffox/debug 06:24 / 06:17
linux2/web/v0.5.0-c8b8d89/ffox/stats 06:02 / 05:52 / 05:46
linux2/web/v0.4.0-76ca881/ffox/stats 06:24 / 06:17
linux2/web/v0.2.1-a51a93f/ffox 06:04


Expand All @@ -107,38 +144,40 @@ mswin1/web/v0.5.0-c8b8d89/edge/desktop-win 05:15
mswin1/web/v0.5.0-c8b8d89/edge/desktop-win/dev 05:11


############################# cnnmnist/1/no async #############################
############################# cnnmnist/0 #############################

mswsl1/native 00:26
mswin1/native 00:27
linux2/native 00:24

mswin1/web/v0.9.2-312c118(wl3)/chrm/debug 01:38
mswin1/web/v0.9.2-312c118(wl10)/edge 01:17

mswin1/web/v0.9.2-312c118(wl3)/chrm/stats 01:38
mswin1/web/v0.9.2-312c118(wl3)/chrm 01:39

mswin1/web/v0.9.2-e110e8c(owl3)/chrm/debug 01:38
mswin1/web/v0.9.2-e110e8c(owl3)/chrm/stats 01:38
mswin1/web/v0.9.2-e110e8c(owl3)/chrm 01:36

mswin1/web/v0.9.2-e110e8c(owl2)/chrm/debug 01:36
mswin1/web/v0.9.2-e110e8c(owl2)/chrm/stats 01:36
mswin1/web/v0.9.2-e110e8c(owl2)/chrm 01:36

mswin1/web/v0.9.2-03f1a8a(owl)/chrm/debug 01:43
mswin1/web/v0.9.2-03f1a8a(owl)/chrm/stats 01:43
mswin1/web/v0.9.2-03f1a8a(owl)/chrm 01:45

mswin1/web/v0.5.0-c8b8d89/edge/debug 01:35
mswin1/web/v0.4.0-76ca881/edge/debug 01:38
mswin1/web/v0.5.0-c8b8d89/edge/stats 01:35
mswin1/web/v0.4.0-76ca881/edge/stats 01:38
mswin1/web/v0.2.1-a51a93f/edge 01:33

mswin1/web/v0.5.0-c8b8d89/ffox/debug ??:??
mswin1/web/v0.4.0-76ca881/ffox/debug ??:??
mswin1/web/v0.2.1-a51a93f/ffox/debug ??:??
mswin1/web/v0.5.0-c8b8d89/ffox/stats ??:??
mswin1/web/v0.4.0-76ca881/ffox/stats ??:??
mswin1/web/v0.2.1-a51a93f/ffox/stats ??:??

linux2/web/v0.5.0-c8b8d89/edge/debug ?????
linux2/web/v0.4.0-76ca881/edge/debug 01:43
linux2/web/v0.5.0-c8b8d89/edge/stats ?????
linux2/web/v0.4.0-76ca881/edge/stats 01:43
linux2/web/v0.2.1-a51a93f/edge ?????

linux2/web/v0.5.0-c8b8d89/ffox/debug 01:34 / 01:20
linux2/web/v0.4.0-76ca881/ffox/debug 01:41 / 01:21
linux2/web/v0.5.0-c8b8d89/ffox/stats 01:34 / 01:20
linux2/web/v0.4.0-76ca881/ffox/stats 01:41 / 01:21
linux2/web/v0.2.1-a51a93f/ffox 01:21 / 01:21


Expand Down
33 changes: 33 additions & 0 deletions benches/np_bnnmnist.txt
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -0,0 +1,33 @@
Python 3.11

╭─────────────────────────── stats ────────────────────────────╮
│ asyncio: tasks: 2 / 1 / 52 / 221 | loop: 608 / 1 k / 1 k │
│ data s/r: 4.8 MiB / 4.8 MiB │
│ latency: 1.00 ms / 147 ms / 650 ms │
│ messages s/r: 113 / 109 │
│ on_runtime_message │
│ └── time: 10.0 μs / 97.3 μs / 485 μs │
│ send_runtime_message │
│ └── time: 19.0 μs / 91.8 μs / 539 μs │
╰────────────────────────── 00:00:22 ──────────────────────────╯


############################# np_bnnmnist/3 ##########################

mswsl1/native 00:15

mswin1/web/v0.9.2-312c118(wl10)/edge/stats 00:22
mswin1/web/v0.9.2-312c118(wl10)/edge 00:22


############################# np_bnnmnist/1 #############################

mswsl1/native 00:13

mswin1/web/v0.9.2-312c118(wl10)/edge 00:15

############################# np_bnnmnist/0 #############################

mswsl1/native 00:08

mswin1/web/v0.9.2-312c118(wl10)/edge 00:15
Loading
Loading