Skip to content

ci: load per-family Archil disk id instead of shared ARCHIL_DISK_ID - #566

Merged
dtice25 merged 1 commit into
masterfrom
devin/1793381073-archil-per-family-disks
Oct 30, 2026
Merged

dtice25 merged 1 commit into
masterfrom
devin/1793381073-archil-per-family-disks

Conversation

@dtice25

@dtice25 dtice25 commented Oct 30, 2026 •

Copy link
Copy Markdown
Collaborator

Summary

Every Archil bench now reports as fsHandlerStatus: unhealthy-readonly. Every exec against it hangs. This PR moves each benchmark family to its own disk via a new vault key; bench code still reads ARCHIL_DISK_ID.

. benchmarks/scripts/load-vault-secrets.sh '^(ARCHIL_API_KEY|ARCHIL_REGION|ARCHIL_DISK_ID_SANDBOX|...)='
if [ -n "${ARCHIL_DISK_ID_SANDBOX:-}" ]; then export ARCHIL_DISK_ID="$ARCHIL_DISK_ID_SANDBOX"; fi
Vault key Workflows
ARCHIL_DISK_ID_SANDBOX sandbox-dax-benchmarks, sandbox-tti-benchmarks
ARCHIL_DISK_ID_CAPABILITY sandbox-capabilities

The old ARCHIL_DISK_ID key is no longer loaded.

Link to Devin session: https://app.devin.ai/sessions/fc0fbf3957a446388c8dfd409defd460
Open in Devin Desktop: https://app.devin.ai/desktop/session/fc0fbf3957a446388c8dfd409defd460?variant=devin
Requested by: @dtice25


Devin Review

Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
@devin-ai-integration

Copy link
Copy Markdown
Contributor

I'll fix CI failures and address comments from users with write access. I'll skip comments containing "(aside)".

  • Disable automatic comment, CI, and merge conflict monitoring

@open-cla

open-cla Bot commented Oct 30, 2026

Copy link
Copy Markdown

Contributor License Agreement

All contributors are covered by a CLA.

@dtice25
dtice25 merged commit cd0645d into master Oct 30, 2026
7 checks passed
@computesdk

computesdk Bot commented Oct 30, 2026

Copy link
Copy Markdown

Sandbox Dax Benchmark Results

Provider Phases Total Prepare Clone Install Typecheck Status
archil 0/7 0.00s 0.00s 0.00s 0.00s 0.00s 0/1 OK
arker 7/7 67.39s 5.54s 2.04s 12.60s 41.69s 1/1 OK
beam 7/7 84.19s 13.31s 2.56s 18.95s 31.76s 1/1 OK
blaxel 7/7 60.06s 1.29s 1.21s 24.32s 25.13s 1/1 OK
buddy 7/7 60.56s 2.17s 1.62s 20.83s 26.54s 1/1 OK
cloud-run 2/7 1.25s 0.41s 0.00s 0.00s 0.00s 0/1 OK
cloudflare 7/7 143.02s 8.60s 3.80s 44.57s 66.50s 1/1 OK
codesandbox 6/7 22.55s 146311.83s 1.73s 9.28s 0.00s 0/1 OK
createos 7/7 52.04s 4.70s 2.37s 12.60s 27.20s 1/1 OK
daytona 7/7 78.78s 8.65s 1.56s 17.87s 37.26s 1/1 OK
declaw -- 0.00s 0.00s 0.00s 0.00s 0.00s 0/1 OK
e2b 7/7 76.16s 5.11s 3.27s 17.00s 40.98s 1/1 OK
freestyle 6/7 301.94s 16.71s 4.32s 23.48s 0.00s 0/1 OK
givemeanode 2/7 2.12s 1.52s 0.00s 0.00s 0.00s 0/1 OK
gravixlayer 7/7 60.26s 5.12s 4.35s 14.30s 30.42s 1/1 OK
hopx -- 0.00s 0.00s 0.00s 0.00s 0.00s 0/1 OK
isorun 7/7 37.33s 2.72s 1.12s 9.11s 20.60s 1/1 OK
microsandbox 7/7 52.74s 3.67s 1.75s 12.08s 25.22s 1/1 OK
miosa 7/7 35.15s 0.70s 1.77s 8.35s 19.56s 1/1 OK
modal 7/7 102.22s 8.05s 2.98s 21.18s 60.93s 1/1 OK
mosaic 7/7 63.44s 1.53s 2.23s 18.00s 30.05s 1/1 OK
namespace 7/7 68.64s 4.41s 1.97s 17.93s 35.41s 1/1 OK
northflank -- 0.00s 0.00s 0.00s 0.00s 0.00s 0/1 OK
novita 7/7 94.65s 23.11s 4.06s 21.04s 31.82s 1/1 OK
opencomputer -- 0.00s 0.00s 0.00s 0.00s 0.00s 0/1 OK
promigence 7/7 31.88s 2.03s 1.01s 7.66s 18.91s 1/1 OK
run-cloud -- 0.00s 0.00s 0.00s 0.00s 0.00s 0/1 OK
sail 7/7 61.99s 2.95s 3.15s 17.40s 31.92s 1/1 OK
sandbox0 7/7 112.23s 21.79s 2.98s 21.24s 59.99s 1/1 OK
superserve 7/7 59.02s 2.68s 1.75s 10.34s 41.18s 1/1 OK
tenki 7/7 83.66s 5.80s 3.19s 20.85s 39.74s 1/1 OK
tensorlake -- 0.00s 0.00s 0.00s 0.00s 0.00s 0/1 OK
upstash 7/7 54.80s 6.28s 1.68s 10.13s 25.52s 1/1 OK
vercel 7/7 87.81s 16.55s 2.65s 15.07s 44.43s 1/1 OK

View full run

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant