Skip to content

Track B: agentic swarm (≥10 roles) + team scoring eval #82

Open

Description

@Treelovah

Track B — Agentic swarm eval (≥10 specialists)

Status: unblocked for design; eng still after Track A review.

Track A landed

Goal

Score the TEAM, not one chatty model:

  • ≥10 role specialists (CPO locks: recon, web, auth/IDOR, API, priv-esc/Linux, network/pivot, binary/RE, cloud/misconfig, LLM/agent attack, supply chain)
  • Thin coordinator + independent verifier (never the finder)
  • Metrics: decomposition, handoffs, tool discipline, verified findings rate

Runtime preference

Drive/score kbot (Treelovah/kryptsec-kbot) via thin adapter — do not reinvent fleetd in OASIS TS.

Cost / weights

Research ≤$25/day formal runs. Swarm specialists default open ≤30B (SLM map v2).

Do not

Auto-merge. No CF branding. No Academy in this issue.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions