Skip to content

Nightly Tests

Nightly Tests #3

Manually triggered September 11, 2026 18:06
Status Failure
Total duration 50m 19s
Artifacts –

nightly_tests.yml

on: workflow_dispatch
Performance — 50 Small Documents (real LLM)  /  file_based — 50_small_documents (llm)
3m 6s
Performance — 50 Small Documents (real LLM) / file_based — 50_small_documents (llm)
Performance — 50 Small Documents (real LLM)  /  postgres — 50_small_documents (llm)
1m 9s
Performance — 50 Small Documents (real LLM) / postgres — 50_small_documents (llm)
Performance — 50 Small Documents (mock LLM)  /  file_based — 50_small_documents (mock_llm)
3m 15s
Performance — 50 Small Documents (mock LLM) / file_based — 50_small_documents (mock_llm)
Performance — 50 Small Documents (mock LLM)  /  postgres — 50_small_documents (mock_llm)
1m 19s
Performance — 50 Small Documents (mock LLM) / postgres — 50_small_documents (mock_llm)
Performance — War and Peace (real LLM)  /  file_based — war_and_peace (llm)
42s
Performance — War and Peace (real LLM) / file_based — war_and_peace (llm)
Performance — War and Peace (real LLM)  /  postgres — war_and_peace (llm)
1m 9s
Performance — War and Peace (real LLM) / postgres — war_and_peace (llm)
Performance — War and Peace (mock LLM)  /  file_based — war_and_peace (mock_llm)
54s
Performance — War and Peace (mock LLM) / file_based — war_and_peace (mock_llm)
Performance — War and Peace (mock LLM)  /  postgres — war_and_peace (mock_llm)
1m 3s
Performance — War and Peace (mock LLM) / postgres — war_and_peace (mock_llm)
Performance — Datasheets (real LLM)  /  file_based — datasheets (llm)
2m 21s
Performance — Datasheets (real LLM) / file_based — datasheets (llm)
Performance — Datasheets (real LLM)  /  postgres — datasheets (llm)
2m 2s
Performance — Datasheets (real LLM) / postgres — datasheets (llm)
Performance — Datasheets (mock LLM)  /  file_based — datasheets (mock_llm)
38s
Performance — Datasheets (mock LLM) / file_based — datasheets (mock_llm)
Performance — Datasheets (mock LLM)  /  postgres — datasheets (mock_llm)
1m 17s
Performance — Datasheets (mock LLM) / postgres — datasheets (mock_llm)
Performance — Medium graph — Artificial 100k nodes/edges (mock LLM)  /  file_based — ${{ inputs.label }} (${{ inputs.mode }})
0s
Performance — Medium graph — Artificial 100k nodes/edges (mock LLM) / file_based — ${{ inputs.label }} (${{ inputs.mode }})
Performance — Medium graph — Artificial 100k nodes/edges (mock LLM)  /  postgres — war_and_peace_large (mock_llm)
1m 4s
Performance — Medium graph — Artificial 100k nodes/edges (mock LLM) / postgres — war_and_peace_large (mock_llm)
Performance — 50 Small Documents (cloud)  /  cloud — 50_small_documents
39s
Performance — 50 Small Documents (cloud) / cloud — 50_small_documents
Performance — War and Peace (cloud)  /  cloud — war_and_peace
38s
Performance — War and Peace (cloud) / cloud — war_and_peace
Performance — Datasheets (cloud)  /  cloud — datasheets
52s
Performance — Datasheets (cloud) / cloud — datasheets
Performance — Rust SDK — 50 Small Documents (real LLM)  /  rust file_based — 50_small_documents (llm)
50m 1s
Performance — Rust SDK — 50 Small Documents (real LLM) / rust file_based — 50_small_documents (llm)
Performance — Rust SDK — 50 Small Documents (mock LLM)  /  rust file_based — 50_small_documents (mock_llm)
40m 59s
Performance — Rust SDK — 50 Small Documents (mock LLM) / rust file_based — 50_small_documents (mock_llm)
Performance — Rust SDK — War and Peace (real LLM)  /  rust file_based — war_and_peace (llm)
48m 57s
Performance — Rust SDK — War and Peace (real LLM) / rust file_based — war_and_peace (llm)
Performance — Rust SDK — War and Peace (mock LLM)  /  rust file_based — war_and_peace (mock_llm)
48m 13s
Performance — Rust SDK — War and Peace (mock LLM) / rust file_based — war_and_peace (mock_llm)
Test Completion Status
10s
Test Completion Status
Fit to window
Zoom out
Zoom in

Annotations

21 errors and 37 warnings
Performance — War and Peace (cloud) / cloud — war_and_peace
Process completed with exit code 1.
Performance — Datasheets (mock LLM) / file_based — datasheets (mock_llm)
Process completed with exit code 1.
Performance — 50 Small Documents (cloud) / cloud — 50_small_documents
Process completed with exit code 1.
Performance — War and Peace (real LLM) / file_based — war_and_peace (llm)
Process completed with exit code 1.
Performance — Datasheets (cloud) / cloud — datasheets
Process completed with exit code 1.
Performance — War and Peace (mock LLM) / file_based — war_and_peace (mock_llm)
Process completed with exit code 1.
Performance — War and Peace (mock LLM) / postgres — war_and_peace (mock_llm)
Process completed with exit code 1.
Performance — War and Peace (real LLM) / postgres — war_and_peace (llm)
Process completed with exit code 1.
Performance — Datasheets (mock LLM) / postgres — datasheets (mock_llm)
Process completed with exit code 1.
Performance — Datasheets (real LLM) / postgres — datasheets (llm)
Process completed with exit code 1.
Performance — Datasheets (real LLM) / file_based — datasheets (llm)
Process completed with exit code 1.
Test Completion Status
Missing input! A token must be provided to use the method decided.
Performance — War and Peace (cloud) / cloud — war_and_peace
Node.js 20 is deprecated. The following actions target Node.js 20 but are being forced to run on Node.js 24: actions/setup-python@v5, astral-sh/setup-uv@v4. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
Performance — War and Peace (cloud) / cloud — war_and_peace
Failed to restore: Cache service responded with 400
Performance — Datasheets (mock LLM) / file_based — datasheets (mock_llm)
Node.js 20 is deprecated. The following actions target Node.js 20 but are being forced to run on Node.js 24: actions/setup-python@v5, astral-sh/setup-uv@v4. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
Performance — Datasheets (mock LLM) / file_based — datasheets (mock_llm)
Failed to restore: Cache service responded with 400
Performance — 50 Small Documents (cloud) / cloud — 50_small_documents
Node.js 20 is deprecated. The following actions target Node.js 20 but are being forced to run on Node.js 24: actions/setup-python@v5, astral-sh/setup-uv@v4. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
Performance — 50 Small Documents (cloud) / cloud — 50_small_documents
Failed to restore: Cache service responded with 400
Performance — War and Peace (real LLM) / file_based — war_and_peace (llm)
Node.js 20 is deprecated. The following actions target Node.js 20 but are being forced to run on Node.js 24: actions/setup-python@v5, astral-sh/setup-uv@v4. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
Performance — War and Peace (real LLM) / file_based — war_and_peace (llm)
Failed to restore: Cache service responded with 400
Performance — Datasheets (cloud) / cloud — datasheets
Node.js 20 is deprecated. The following actions target Node.js 20 but are being forced to run on Node.js 24: actions/setup-python@v5, astral-sh/setup-uv@v4. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
Performance — Datasheets (cloud) / cloud — datasheets
Failed to restore: Cache service responded with 400
Performance — War and Peace (mock LLM) / file_based — war_and_peace (mock_llm)
Node.js 20 is deprecated. The following actions target Node.js 20 but are being forced to run on Node.js 24: actions/setup-python@v5, astral-sh/setup-uv@v4. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
Performance — War and Peace (mock LLM) / file_based — war_and_peace (mock_llm)
Failed to restore: Cache service responded with 400
Performance — War and Peace (mock LLM) / postgres — war_and_peace (mock_llm)
Node.js 20 is deprecated. The following actions target Node.js 20 but are being forced to run on Node.js 24: actions/setup-python@v5, astral-sh/setup-uv@v4. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
Performance — War and Peace (mock LLM) / postgres — war_and_peace (mock_llm)
Failed to restore: Cache service responded with 400
Performance — Medium graph — Artificial 100k nodes/edges (mock LLM) / postgres — war_and_peace_large (mock_llm)
Node.js 20 is deprecated. The following actions target Node.js 20 but are being forced to run on Node.js 24: actions/setup-python@v5, astral-sh/setup-uv@v4. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
Performance — 50 Small Documents (real LLM) / postgres — 50_small_documents (llm)
Node.js 20 is deprecated. The following actions target Node.js 20 but are being forced to run on Node.js 24: actions/setup-python@v5, astral-sh/setup-uv@v4. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
Performance — 50 Small Documents (real LLM) / postgres — 50_small_documents (llm)
Failed to restore: Cache service responded with 400
Performance — War and Peace (real LLM) / postgres — war_and_peace (llm)
Node.js 20 is deprecated. The following actions target Node.js 20 but are being forced to run on Node.js 24: actions/setup-python@v5, astral-sh/setup-uv@v4. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
Performance — War and Peace (real LLM) / postgres — war_and_peace (llm)
Failed to restore: Cache service responded with 400
Performance — Datasheets (mock LLM) / postgres — datasheets (mock_llm)
Node.js 20 is deprecated. The following actions target Node.js 20 but are being forced to run on Node.js 24: actions/setup-python@v5, astral-sh/setup-uv@v4. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
Performance — Datasheets (mock LLM) / postgres — datasheets (mock_llm)
Failed to restore: Cache service responded with 400
Performance — 50 Small Documents (mock LLM) / postgres — 50_small_documents (mock_llm)
Node.js 20 is deprecated. The following actions target Node.js 20 but are being forced to run on Node.js 24: actions/setup-python@v5, astral-sh/setup-uv@v4. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
Performance — 50 Small Documents (mock LLM) / postgres — 50_small_documents (mock_llm)
Failed to restore: Cache service responded with 400
Performance — Datasheets (real LLM) / postgres — datasheets (llm)
Node.js 20 is deprecated. The following actions target Node.js 20 but are being forced to run on Node.js 24: actions/setup-python@v5, astral-sh/setup-uv@v4. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
Performance — Datasheets (real LLM) / postgres — datasheets (llm)
Failed to restore: Cache service responded with 400
Performance — Datasheets (real LLM) / file_based — datasheets (llm)
Node.js 20 is deprecated. The following actions target Node.js 20 but are being forced to run on Node.js 24: actions/setup-python@v5, astral-sh/setup-uv@v4. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
Performance — Datasheets (real LLM) / file_based — datasheets (llm)
Failed to restore: Cache service responded with 400
Performance — 50 Small Documents (real LLM) / file_based — 50_small_documents (llm)
Node.js 20 is deprecated. The following actions target Node.js 20 but are being forced to run on Node.js 24: actions/setup-python@v5, astral-sh/setup-uv@v4. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
Performance — 50 Small Documents (real LLM) / file_based — 50_small_documents (llm)
Failed to restore: Cache service responded with 400
Performance — 50 Small Documents (mock LLM) / file_based — 50_small_documents (mock_llm)
Node.js 20 is deprecated. The following actions target Node.js 20 but are being forced to run on Node.js 24: actions/setup-python@v5, astral-sh/setup-uv@v4. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
Performance — 50 Small Documents (mock LLM) / file_based — 50_small_documents (mock_llm)
Failed to restore: Cache service responded with 400
Performance — Rust SDK — 50 Small Documents (mock LLM) / rust file_based — 50_small_documents (mock_llm)
Node.js 20 is deprecated. The following actions target Node.js 20 but are being forced to run on Node.js 24: actions/cache@0057852bfaa89a56745cba8c7296529d2fc39830. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
Performance — Rust SDK — War and Peace (mock LLM) / rust file_based — war_and_peace (mock_llm)
Node.js 20 is deprecated. The following actions target Node.js 20 but are being forced to run on Node.js 24: actions/cache@0057852bfaa89a56745cba8c7296529d2fc39830. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
Performance — Rust SDK — War and Peace (real LLM) / rust file_based — war_and_peace (llm)
Node.js 20 is deprecated. The following actions target Node.js 20 but are being forced to run on Node.js 24: actions/cache@0057852bfaa89a56745cba8c7296529d2fc39830. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
Performance — Rust SDK — 50 Small Documents (real LLM) / rust file_based — 50_small_documents (llm)
Node.js 20 is deprecated. The following actions target Node.js 20 but are being forced to run on Node.js 24: actions/cache@0057852bfaa89a56745cba8c7296529d2fc39830. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
Test Completion Status
Node.js 20 is deprecated. The following actions target Node.js 20 but are being forced to run on Node.js 24: slackapi/slack-github-action@b0fa283ad8fea605de13dc3f449259339835fc52. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/