Skip to content

Providers / Devin

swe-2

devin/swe-2 Subscription providers.dev2026-11-16

Type unknown · Release date unknown

Input window
at least 300,499 tokensmeasured
providers.dev · 2026-11-16
Input alone
Context window
Unknown
Exposed by this provider
Maximum output
Unknown
Per response; not a default
Cache lifetime, short
0 smeasured
providers.dev · 2026-11-08
Cache lifetime, long
Unknown
Not documented or measured

Limits

Input window

LimitValueSource
Input window
input_window: the most input one request can carry on this entry, in tokens as the provider counts them.
at least 300,499 tokensmeasuredInput aloneproviders.dev2026-11-16
Documented
The figure the source documents, and the field it is in.
Not documented–
Measured
What each limit evaluation that counts gives, one line per evaluation.
at least 300,499 tokens
300,499 accepted · 300,499 read to the end · nothing refused
Requests sent through CLIProxyAPI
2026-11-16 · Raw result

How the input window is worked out, and what it does not say

Documented

LimitValueSource
Context window
limit.context: what this provider accepts for the model, input and output together.
Unknown–
Largest input
limit.input: stated where the input limit is lower than the context window.
Unknown–
Maximum output
limit.output: the most one response can hold. A maximum, not what you get by default.
Unknown–

Measured tokens

DateMeasured throughContextInput acceptedInput refusedOutput limitRequested output acceptedEvidence
2026-11-16Devin subscription
Requests sent through CLIProxyAPI
Unknown300,499UnknownUnknownUnknownRaw result

Price

Base chargeRate
InputIn plan
OutputIn plan
Reasoning outputIn plan
Cache readIn plan
Cache writeIn plan

Conditional rates

ConditionChargeRateApplies to
Not applicable: the entry has no price per token.

Source: Not applicable

Other prices in the source, not shown above (0)

None

Request controls

ControlSupportRequest fieldAccepted valuesDefaultConditions
Service tierUnknownUnknownUnknownUnknownUnknown

Source: Unknown

Prompt caching

Lifetimes

Every cache lifetime of this entry, by retention
LifetimeDocumented for, or measured throughTime since the prompt was cached · served from the cache, in percent, with hits/checks
At once2.5 min5 min7.5 min10 min15 min20 min25 min30 min40 min50 min1 h1 h 151 h 302 h4 h8 h12 h24 h
Short retention
Safe lifetime
0 smeasuredproviders.dev2026-11-08
Documented
Not documented
Measured
0 s · 3 clients
Inside the documented lifetime
Not applicable
0 smeasuredproviders.dev2026-11-08A coding agent, through CLIProxyAPI
No lifetime asked for · 1 of 11 checks hit
Tested from 5 min · First miss 5 min
1 evaluation
1001/1·00/2··00/2··00/2··00/2··00/2····
devin-harness-2026-11-08/D12p 2026-11-08
Devin subscription · reasoning=low
Raw result
1001/1·00/2··00/2··00/2··00/2··00/2····
0 smeasuredproviders.dev2026-11-04Requests sent through CLIProxyAPI
No lifetime asked for · 0 of 1 checks hit
No timed check · First miss at once
1 evaluation
00/1··················
cpa-8.0.53/D3 2026-11-04
Devin subscription
Raw result
00/1··················
0 smeasuredproviders.dev2026-11-08The Devin CLI
No lifetime asked for · 0 of 11 checks hit
Tested from 5 min · First miss at once
1 evaluation
00/1·00/2··00/2··00/2··00/2··00/2····
devin-harness-2026-11-08/D12c 2026-11-08
Devin subscription · reasoning=low
Raw result
00/1·00/2··00/2··00/2··00/2··00/2····
Long retention
Safe lifetime
Unknown
Documented
Not documented
Measured
Not measured
Inside the documented lifetime
Not applicable

Checks served from the cache, in percent and as hits/checks, by time since the prompt was cached100 All67 Half or more33 Fewer0 None· Not checked at that ageMethodology

Cache modes

ModeSupportedMin. tokensBreakpointsTargets
Automatic implicit Unknown Unknown Unknown Unknown
Manual explicit Unknown Unknown Unknown Unknown

Source: providers.dev · Cache modes

Retention

ControlSupportRequest fieldAccepted valuesDefaultConditions
Cache retentionUnknownUnknownUnknownUnknownUnknown

Source: Unknown

Provenance

ProvenanceValue
Sourceproviders.dev2026-11-16
Inherited fromNone
CorrectionsNone
Evidence

Data

GET /api/v1/entries/devin/swe-2

Show the full entry as published
{
  "id": "swe-2",
  "providers_dev": {
    "origin": "added",
    "access": "subscription",
    "provenance": [],
    "inherited": null,
    "cache": {
      "documented": {
        "support": "unknown",
        "modes": {
          "implicit": {
            "support": "unknown",
            "min_tokens": null,
            "max_breakpoints": null,
            "targets": null
          },
          "explicit": {
            "support": "unknown",
            "min_tokens": null,
            "max_breakpoints": null,
            "targets": null
          }
        }
      },
      "retention": {
        "support": "unknown",
        "parameter": null,
        "accepted_values": null,
        "default": null,
        "profiles": [],
        "conditions": [],
        "evidence": []
      },
      "lifetime": {
        "short": {
          "safe_s": 0,
          "basis": "measured",
          "source": "providers.dev",
          "date": "2026-11-08",
          "documented_s": null,
          "measured_s": 0,
          "documented_status": null,
          "clients": 3,
          "evaluations": 3,
          "checks": 23,
          "hits": 1,
          "checks_inside": null,
          "hits_inside": null,
          "tested_from_s": 300,
          "first_miss_s": 0
        },
        "long": {
          "safe_s": null,
          "basis": "none",
          "source": null,
          "date": null,
          "documented_s": null,
          "measured_s": null,
          "documented_status": null,
          "clients": 0,
          "evaluations": 0,
          "checks": 0,
          "hits": 0,
          "checks_inside": null,
          "hits_inside": null,
          "tested_from_s": null,
          "first_miss_s": null
        },
        "lifetimes": [
          {
            "retention_profile": "short",
            "basis": "measured",
            "source": "providers.dev",
            "date": "2026-11-08",
            "lifetime_s": 0,
            "mode": null,
            "documented_as": null,
            "client": "agent+cliproxyapi",
            "client_label": "A coding agent, through CLIProxyAPI",
            "parameter": null,
            "value": null,
            "evaluations": 1,
            "evaluation_ids": [
              "devin-harness-2026-11-08/D12p"
            ],
            "checks": 11,
            "hits": 1,
            "tested_from_s": 300,
            "first_miss_s": 300,
            "results": [
              {
                "kind": "control",
                "age_s": 0,
                "hits": 1,
                "checks": 1,
                "hit_rate_pct": 100
              },
              {
                "kind": "timed",
                "age_s": 300,
                "hits": 0,
                "checks": 2,
                "hit_rate_pct": 0
              },
              {
                "kind": "timed",
                "age_s": 900,
                "hits": 0,
                "checks": 2,
                "hit_rate_pct": 0
              },
              {
                "kind": "timed",
                "age_s": 1800,
                "hits": 0,
                "checks": 2,
                "hit_rate_pct": 0
              },
              {
                "kind": "timed",
                "age_s": 3600,
                "hits": 0,
                "checks": 2,
                "hit_rate_pct": 0
              },
              {
                "kind": "timed",
                "age_s": 7200,
                "hits": 0,
                "checks": 2,
                "hit_rate_pct": 0
              }
            ]
          },
          {
            "retention_profile": "short",
            "basis": "measured",
            "source": "providers.dev",
            "date": "2026-11-04",
            "lifetime_s": 0,
            "mode": null,
            "documented_as": null,
            "client": "cliproxyapi",
            "client_label": "Requests sent through CLIProxyAPI",
            "parameter": null,
            "value": null,
            "evaluations": 1,
            "evaluation_ids": [
              "cpa-8.0.53/D3"
            ],
            "checks": 1,
            "hits": 0,
            "tested_from_s": null,
            "first_miss_s": 0,
            "results": [
              {
                "kind": "control",
                "age_s": 0,
                "hits": 0,
                "checks": 1,
                "hit_rate_pct": 0
              }
            ]
          },
          {
            "retention_profile": "short",
            "basis": "measured",
            "source": "providers.dev",
            "date": "2026-11-08",
            "lifetime_s": 0,
            "mode": null,
            "documented_as": null,
            "client": "devin-cli",
            "client_label": "The Devin CLI",
            "parameter": null,
            "value": null,
            "evaluations": 1,
            "evaluation_ids": [
              "devin-harness-2026-11-08/D12c"
            ],
            "checks": 11,
            "hits": 0,
            "tested_from_s": 300,
            "first_miss_s": 0,
            "results": [
              {
                "kind": "control",
                "age_s": 0,
                "hits": 0,
                "checks": 1,
                "hit_rate_pct": 0
              },
              {
                "kind": "timed",
                "age_s": 300,
                "hits": 0,
                "checks": 2,
                "hit_rate_pct": 0
              },
              {
                "kind": "timed",
                "age_s": 900,
                "hits": 0,
                "checks": 2,
                "hit_rate_pct": 0
              },
              {
                "kind": "timed",
                "age_s": 1800,
                "hits": 0,
                "checks": 2,
                "hit_rate_pct": 0
              },
              {
                "kind": "timed",
                "age_s": 3600,
                "hits": 0,
                "checks": 2,
                "hit_rate_pct": 0
              },
              {
                "kind": "timed",
                "age_s": 7200,
                "hits": 0,
                "checks": 2,
                "hit_rate_pct": 0
              }
            ]
          }
        ]
      },
      "evaluations": [
        {
          "id": "devin-harness-2026-11-08/D12c",
          "route": "devin",
          "route_label": "Devin subscription",
          "client": "devin-cli",
          "client_label": "The Devin CLI",
          "date": "2026-11-08",
          "request_settings": {
            "reasoning": "low"
          },
          "retention_profile": "short",
          "parameter": null,
          "value": null,
          "results": [
            {
              "kind": "control",
              "age_s": 0,
              "hits": 0,
              "checks": 1,
              "hit_rate_pct": 0
            },
            {
              "kind": "timed",
              "age_s": 300,
              "hits": 0,
              "checks": 2,
              "hit_rate_pct": 0
            },
            {
              "kind": "timed",
              "age_s": 900,
              "hits": 0,
              "checks": 2,
              "hit_rate_pct": 0
            },
            {
              "kind": "timed",
              "age_s": 1800,
              "hits": 0,
              "checks": 2,
              "hit_rate_pct": 0
            },
            {
              "kind": "timed",
              "age_s": 3600,
              "hits": 0,
              "checks": 2,
              "hit_rate_pct": 0
            },
            {
              "kind": "timed",
              "age_s": 7200,
              "hits": 0,
              "checks": 2,
              "hit_rate_pct": 0
            }
          ],
          "late_excluded": 0,
          "note": null,
          "source": "https://github.com/ngvoicu/groundtruth/blob/main/results/devin-harness-2026-11-08/D12c.jsonl"
        },
        {
          "id": "devin-harness-2026-11-08/D12p",
          "route": "devin",
          "route_label": "Devin subscription",
          "client": "agent+cliproxyapi",
          "client_label": "A coding agent, through CLIProxyAPI",
          "date": "2026-11-08",
          "request_settings": {
            "reasoning": "low"
          },
          "retention_profile": "short",
          "parameter": null,
          "value": null,
          "results": [
            {
              "kind": "control",
              "age_s": 0,
              "hits": 1,
              "checks": 1,
              "hit_rate_pct": 100
            },
            {
              "kind": "timed",
              "age_s": 300,
              "hits": 0,
              "checks": 2,
              "hit_rate_pct": 0
            },
            {
              "kind": "timed",
              "age_s": 900,
              "hits": 0,
              "checks": 2,
              "hit_rate_pct": 0
            },
            {
              "kind": "timed",
              "age_s": 1800,
              "hits": 0,
              "checks": 2,
              "hit_rate_pct": 0
            },
            {
              "kind": "timed",
              "age_s": 3600,
              "hits": 0,
              "checks": 2,
              "hit_rate_pct": 0
            },
            {
              "kind": "timed",
              "age_s": 7200,
              "hits": 0,
              "checks": 2,
              "hit_rate_pct": 0
            }
          ],
          "late_excluded": 0,
          "note": null,
          "source": "https://github.com/ngvoicu/groundtruth/blob/main/results/devin-harness-2026-11-08/D12p.jsonl"
        },
        {
          "id": "cpa-8.0.53/D3",
          "route": "devin",
          "route_label": "Devin subscription",
          "client": "cliproxyapi",
          "client_label": "Requests sent through CLIProxyAPI",
          "date": "2026-11-04",
          "request_settings": {},
          "retention_profile": "short",
          "parameter": null,
          "value": null,
          "results": [
            {
              "kind": "control",
              "age_s": 0,
              "hits": 0,
              "checks": 1,
              "hit_rate_pct": 0
            }
          ],
          "late_excluded": 0,
          "note": null,
          "source": "https://github.com/ngvoicu/groundtruth/blob/main/results/cpa-8.0.53/D3-2026-11-04T17-57-26.json"
        }
      ]
    },
    "pricing": {
      "coverage": "not_applicable",
      "billing": "not_applicable",
      "reference_ref": null,
      "rules": null,
      "rule_order": null,
      "unparsed": [],
      "evidence": []
    },
    "request_controls": {
      "coverage": "unknown",
      "items": [
        {
          "id": "cache.retention",
          "support": "unknown",
          "when": null,
          "bindings": null,
          "options": null,
          "default": null,
          "conditions": [],
          "evidence": []
        },
        {
          "id": "service_tier",
          "support": "unknown",
          "when": null,
          "bindings": null,
          "options": null,
          "default": null,
          "conditions": [],
          "evidence": []
        }
      ]
    },
    "limits": {
      "measured": [
        {
          "route": "devin",
          "route_label": "Devin subscription",
          "client": "cliproxyapi",
          "client_label": "Requests sent through CLIProxyAPI",
          "context": null,
          "output": null,
          "input_accepted": 300499,
          "input_refused": null,
          "input_read": 300499,
          "output_accepted": null,
          "note": "no edge found: no request was refused at any size tried, and Devin lists 262,000. Both code words (one before the filler, one after it) came back at 20,493, 200,497 and 300,499 tokens, so the model read those inputs to the end. Requests of up to 930,487 tokens were accepted on 2026-11-13 (results/limits-2026-11-13) with no check that they were read, and a both-ends request then got no answer at 250K and 300K within 5 minutes: those sizes are not in the row",
          "date": "2026-11-16",
          "source": "https://github.com/ngvoicu/groundtruth/blob/main/results/limits-2026-11-16/swe-2-recall.jsonl"
        }
      ],
      "from_measurement": [],
      "input_window": {
        "tokens": 300499,
        "basis": "measured",
        "bound": "at_least",
        "scope": "input",
        "source": "providers.dev",
        "date": "2026-11-16",
        "documented_tokens": null,
        "documented_field": null,
        "documented_source": null,
        "documented_date": null,
        "documented_status": null,
        "measured_tokens": 300499,
        "measured_bound": "at_least",
        "measured_kind": "accepted",
        "measured_refused": null,
        "measured_date": "2026-11-16",
        "clients": 1,
        "evaluations": 1,
        "measurements": [
          {
            "client": "cliproxyapi",
            "client_label": "Requests sent through CLIProxyAPI",
            "route": "devin",
            "route_label": "Devin subscription",
            "date": "2026-11-16",
            "tokens": 300499,
            "bound": "at_least",
            "kind": "accepted",
            "accepted": 300499,
            "refused": null,
            "named": null,
            "read": 300499,
            "source": "https://github.com/ngvoicu/groundtruth/blob/main/results/limits-2026-11-16/swe-2-recall.jsonl"
          }
        ]
      }
    },
    "evidence": [
      {
        "kind": "measured",
        "url": "https://github.com/ngvoicu/groundtruth/blob/main/results/cpa-8.0.53/D3-2026-11-04T17-57-26.json",
        "date": "2026-11-04",
        "note": null
      }
    ],
    "verified": "2026-11-16"
  },
  "name": "swe-2"
}