Skip to content

WIP: svelte5 port #1501

WIP: svelte5 port

WIP: svelte5 port #1501

Triggered via pull request December 8, 2024 01:29
@mgremingermgreminger
synchronize #305
svelte5
Status Failure
Total duration 24m 22s
Artifacts 2

playwright.yml

on: pull_request
Fit to window
Zoom out
Zoom in

Annotations

10 errors, 1 warning, and 1 notice
[chromium] › test_database.spec.mjs:176:1 › Test database consistency: tests/test_database.spec.mjs#L194
1) [chromium] › test_database.spec.mjs:176:1 › Test database consistency ───────────────────────── Error: expect(received).toEqual(expected) // deep equality Expected: 0 Received: 749 192 | await page.screenshot({ path: `${screenshotDir}/${browserName}_screenshot_reference_check.png`, fullPage: true }); 193 | > 194 | expect(compareImages(`${browserName}_reference.png`, `${browserName}_screenshot_reference_check.png`)).toEqual(0); | ^ 195 | }); at /home/runner/work/EngineeringPaper.xyz/EngineeringPaper.xyz/tests/test_database.spec.mjs:194:106
[chromium] › test_database.spec.mjs:176:1 › Test database consistency: tests/test_database.spec.mjs#L194
1) [chromium] › test_database.spec.mjs:176:1 › Test database consistency ───────────────────────── Retry #1 ─────────────────────────────────────────────────────────────────────────────────────── Error: expect(received).toEqual(expected) // deep equality Expected: 0 Received: 749 192 | await page.screenshot({ path: `${screenshotDir}/${browserName}_screenshot_reference_check.png`, fullPage: true }); 193 | > 194 | expect(compareImages(`${browserName}_reference.png`, `${browserName}_screenshot_reference_check.png`)).toEqual(0); | ^ 195 | }); at /home/runner/work/EngineeringPaper.xyz/EngineeringPaper.xyz/tests/test_database.spec.mjs:194:106
[chromium] › test_database.spec.mjs:176:1 › Test database consistency: tests/test_database.spec.mjs#L194
1) [chromium] › test_database.spec.mjs:176:1 › Test database consistency ───────────────────────── Retry #2 ─────────────────────────────────────────────────────────────────────────────────────── Error: expect(received).toEqual(expected) // deep equality Expected: 0 Received: 749 192 | await page.screenshot({ path: `${screenshotDir}/${browserName}_screenshot_reference_check.png`, fullPage: true }); 193 | > 194 | expect(compareImages(`${browserName}_reference.png`, `${browserName}_screenshot_reference_check.png`)).toEqual(0); | ^ 195 | }); at /home/runner/work/EngineeringPaper.xyz/EngineeringPaper.xyz/tests/test_database.spec.mjs:194:106
[firefox] › test_database.spec.mjs:176:1 › Test database consistency: tests/test_database.spec.mjs#L194
2) [firefox] › test_database.spec.mjs:176:1 › Test database consistency ────────────────────────── Error: expect(received).toEqual(expected) // deep equality Expected: 0 Received: 747 192 | await page.screenshot({ path: `${screenshotDir}/${browserName}_screenshot_reference_check.png`, fullPage: true }); 193 | > 194 | expect(compareImages(`${browserName}_reference.png`, `${browserName}_screenshot_reference_check.png`)).toEqual(0); | ^ 195 | }); at /home/runner/work/EngineeringPaper.xyz/EngineeringPaper.xyz/tests/test_database.spec.mjs:194:106
[firefox] › test_database.spec.mjs:176:1 › Test database consistency: tests/test_database.spec.mjs#L194
2) [firefox] › test_database.spec.mjs:176:1 › Test database consistency ────────────────────────── Retry #1 ─────────────────────────────────────────────────────────────────────────────────────── Error: expect(received).toEqual(expected) // deep equality Expected: 0 Received: 747 192 | await page.screenshot({ path: `${screenshotDir}/${browserName}_screenshot_reference_check.png`, fullPage: true }); 193 | > 194 | expect(compareImages(`${browserName}_reference.png`, `${browserName}_screenshot_reference_check.png`)).toEqual(0); | ^ 195 | }); at /home/runner/work/EngineeringPaper.xyz/EngineeringPaper.xyz/tests/test_database.spec.mjs:194:106
[firefox] › test_database.spec.mjs:176:1 › Test database consistency: tests/test_database.spec.mjs#L194
2) [firefox] › test_database.spec.mjs:176:1 › Test database consistency ────────────────────────── Retry #2 ─────────────────────────────────────────────────────────────────────────────────────── Error: expect(received).toEqual(expected) // deep equality Expected: 0 Received: 747 192 | await page.screenshot({ path: `${screenshotDir}/${browserName}_screenshot_reference_check.png`, fullPage: true }); 193 | > 194 | expect(compareImages(`${browserName}_reference.png`, `${browserName}_screenshot_reference_check.png`)).toEqual(0); | ^ 195 | }); at /home/runner/work/EngineeringPaper.xyz/EngineeringPaper.xyz/tests/test_database.spec.mjs:194:106
[chromium] › test_matrix_calc.spec.mjs:33:1 › Derivative: tests/test_matrix_calc.spec.mjs#L38
3) [chromium] › test_matrix_calc.spec.mjs:33:1 › Derivative ────────────────────────────────────── TimeoutError: page.textContent: Timeout 120000ms exceeded. Call log: - waiting for locator('#result-value-0') 36 | await page.waitForSelector('text=Updating...', {state: 'detached'}); 37 | > 38 | let content = await page.textContent(`#result-value-0`); | ^ 39 | expect(content).toBe('\\begin{bmatrix} 1 & 2 \\cdot x \\\\ 3 \\cdot x^{2} & 4 \\cdot x^{3} \\end{bmatrix}'); 40 | }); at /home/runner/work/EngineeringPaper.xyz/EngineeringPaper.xyz/tests/test_matrix_calc.spec.mjs:38:28
[chromium] › test_system_solve.spec.mjs:430:1 › Test parser error messages for solve: tests/test_system_solve.spec.mjs#L434
4) [chromium] › test_system_solve.spec.mjs:430:1 › Test parser error messages for solve ────────── TimeoutError: locator.click: Timeout 120000ms exceeded. Call log: - waiting for locator('text=Show Error') 432 | await page.setLatex(0, '2\\cdot x=y'); 433 | > 434 | await page.locator('text=Show Error').click(); | ^ 435 | await page.locator('text=Equality statements are no longer allowed in math cells, use a System Solve Cell instead.').waitFor({state: 'visible', timeout: 1000}); 436 | 437 | await page.forceDeleteCell(0); at /home/runner/work/EngineeringPaper.xyz/EngineeringPaper.xyz/tests/test_system_solve.spec.mjs:434:41
[firefox] › test_checkpoints.spec.mjs:15:1 › Test autosave checkpoints: tests/test_checkpoints.spec.mjs#L68
5) [firefox] › test_checkpoints.spec.mjs:15:1 › Test autosave checkpoints ──────────────────────── Error: expect(received).toBeCloseTo(expected, precision) Expected: 1 Received: 2 Expected precision: 13 Expected difference: < 0.00000000000005 Received difference: 1 66 | await page.waitForSelector('.status-footer', { state: 'detached' }); 67 | content = await page.locator('#result-value-0').textContent(); > 68 | expect(parseLatexFloat(content)).toBeCloseTo(1, precision); | ^ 69 | 70 | await page.goBack(); 71 | await page.getByRole('heading', { name: 'New Sheet' }).waitFor(); at /home/runner/work/EngineeringPaper.xyz/EngineeringPaper.xyz/tests/test_checkpoints.spec.mjs:68:36
[firefox] › test_data_table.spec.mjs:860:1 › Test csv export and reload: tests/test_data_table.spec.mjs#L890
6) [firefox] › test_data_table.spec.mjs:860:1 › Test csv export and reload ─────────────────────── Error: expect(received).toBe(expected) // Object.is equality Expected: "\\begin{bmatrix} 4.1\\left\\lbrack m\\right\\rbrack \\\\ 0\\left\\lbrack m\\right\\rbrack \\\\ 3\\left\\lbrack m\\right\\rbrack \\\\ 1\\left\\lbrack m\\right\\rbrack \\\\ -20.3\\left\\lbrack m\\right\\rbrack \\end{bmatrix}" Received: "col_{1}" 888 | 889 | let content = await page.textContent(`#result-value-0`); > 890 | expect(content).toBe(String.raw`\begin{bmatrix} 4.1\left\lbrack m\right\rbrack \\ 0\left\lbrack m\right\rbrack \\ 3\left\lbrack m\right\rbrack \\ 1\left\lbrack m\right\rbrack \\ -20.3\left\lbrack m\right\rbrack \end{bmatrix}`); | ^ 891 | 892 | content = await page.textContent(`#result-value-1`); 893 | expect(content).toBe(String.raw`\begin{bmatrix} 9\left\lbrack s\right\rbrack \\ 8\left\lbrack s\right\rbrack \\ 7\left\lbrack s\right\rbrack \\ 0\left\lbrack s\right\rbrack \\ -1\left\lbrack s\right\rbrack \\ -2\left\lbrack s\right\rbrack \\ -3\left\lbrack s\right\rbrack \\ -3.4\left\lbrack s\right\rbrack \end{bmatrix}`); at /home/runner/work/EngineeringPaper.xyz/EngineeringPaper.xyz/tests/test_data_table.spec.mjs:890:19
Deprecation notice: v1, v2, and v3 of the artifact actions
The following artifacts were uploaded using a version of actions/upload-artifact that is scheduled for deprecation: "screenshots", "test-results". Please update your workflow to use v4 of the artifact actions. Learn more: https://github.blog/changelog/2024-04-16-deprecation-notice-v3-of-the-artifact-actions/
🎭 Playwright Run Summary
2 failed [chromium] › test_database.spec.mjs:176:1 › Test database consistency ────────────────────────── [firefox] › test_database.spec.mjs:176:1 › Test database consistency ─────────────────────────── 6 flaky [chromium] › test_matrix_calc.spec.mjs:33:1 › Derivative ─────────────────────────────────────── [chromium] › test_system_solve.spec.mjs:430:1 › Test parser error messages for solve ─────────── [firefox] › test_checkpoints.spec.mjs:15:1 › Test autosave checkpoints ───────────────────────── [firefox] › test_data_table.spec.mjs:860:1 › Test csv export and reload ──────────────────────── [firefox] › test_file_save_open.spec.mjs:138:1 › Test opening file with results and syntax error [firefox] › test_plotting.spec.mjs:153:1 › Test plot number of points ────────────────────────── 9 skipped 759 passed (20.9m)

Artifacts

Produced during runtime
Name Size
screenshots Expired
15.9 MB
test-results Expired
191 MB