swe-2
devin/swe-2 Subscription
providers.dev2026-11-16
Type unknown · Release date unknown
Input window
at least 300,499 tokensmeasured
providers.dev · 2026-11-16
Input alone
Context window
Unknown
Exposed by this provider
Maximum output
Unknown
Per response; not a default
Cache lifetime, short
0 smeasured
providers.dev · 2026-11-08
Cache lifetime, long
Unknown
Not documented or measured
Limits
Input window
| Limit | Value | Source |
|---|---|---|
Input windowinput_window: the most input one request can carry on this entry, in tokens as the provider counts them. | at least 300,499 tokensmeasuredInput alone | providers.dev2026-11-16 |
| Documented The figure the source documents, and the field it is in. | Not documented | – |
| Measured What each limit evaluation that counts gives, one line per evaluation. | at least 300,499 tokens 300,499 accepted · 300,499 read to the end · nothing refused | Requests sent through CLIProxyAPI 2026-11-16 · Raw result |
How the input window is worked out, and what it does not say
Documented
| Limit | Value | Source |
|---|---|---|
Context windowlimit.context: what this provider accepts for the model, input and output together. | Unknown | – |
Largest inputlimit.input: stated where the input limit is lower than the context window. | Unknown | – |
Maximum outputlimit.output: the most one response can hold. A maximum, not what you get by default. | Unknown | – |
Measured tokens
| Date | Measured through | Context | Input accepted | Input refused | Output limit | Requested output accepted | Evidence |
|---|---|---|---|---|---|---|---|
| 2026-11-16 | Devin subscription Requests sent through CLIProxyAPI | Unknown | 300,499 | Unknown | Unknown | Unknown | Raw result |
Price
| Base charge | Rate |
|---|---|
| Input | In plan |
| Output | In plan |
| Reasoning output | In plan |
| Cache read | In plan |
| Cache write | In plan |
Conditional rates
| Condition | Charge | Rate | Applies to |
|---|---|---|---|
| Not applicable: the entry has no price per token. | |||
Source: Not applicable
Other prices in the source, not shown above (0)
None
Request controls
| Control | Support | Request field | Accepted values | Default | Conditions |
|---|---|---|---|---|---|
| Service tier | Unknown | Unknown | Unknown | Unknown | Unknown |
Source: Unknown
Prompt caching
Lifetimes
| Lifetime | Documented for, or measured through | Time since the prompt was cached · served from the cache, in percent, with hits/checks | ||||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| At once | 2.5 min | 5 min | 7.5 min | 10 min | 15 min | 20 min | 25 min | 30 min | 40 min | 50 min | 1 h | 1 h 15 | 1 h 30 | 2 h | 4 h | 8 h | 12 h | 24 h | ||
| Short retention |
| |||||||||||||||||||
| 0 smeasuredproviders.dev2026-11-08 | A coding agent, through CLIProxyAPI No lifetime asked for · 1 of 11 checks hit Tested from 5 min · First miss 5 min 1 evaluation | 1001/1 | · | 00/2 | · | · | 00/2 | · | · | 00/2 | · | · | 00/2 | · | · | 00/2 | · | · | · | · |
devin-harness-2026-11-08/D12p 2026-11-08Devin subscription · Raw resultreasoning=low | 1001/1 | · | 00/2 | · | · | 00/2 | · | · | 00/2 | · | · | 00/2 | · | · | 00/2 | · | · | · | · | |
| 0 smeasuredproviders.dev2026-11-04 | Requests sent through CLIProxyAPI No lifetime asked for · 0 of 1 checks hit No timed check · First miss at once 1 evaluation | 00/1 | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · |
cpa-8.0.53/D3 2026-11-04Devin subscription Raw result | 00/1 | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | |
| 0 smeasuredproviders.dev2026-11-08 | The Devin CLI No lifetime asked for · 0 of 11 checks hit Tested from 5 min · First miss at once 1 evaluation | 00/1 | · | 00/2 | · | · | 00/2 | · | · | 00/2 | · | · | 00/2 | · | · | 00/2 | · | · | · | · |
devin-harness-2026-11-08/D12c 2026-11-08Devin subscription · Raw resultreasoning=low | 00/1 | · | 00/2 | · | · | 00/2 | · | · | 00/2 | · | · | 00/2 | · | · | 00/2 | · | · | · | · | |
| Long retention |
| |||||||||||||||||||
Checks served from the cache, in percent and as hits/checks, by time since the prompt was cached100 All67 Half or more33 Fewer0 None· Not checked at that ageMethodology
Cache modes
| Mode | Supported | Min. tokens | Breakpoints | Targets |
|---|---|---|---|---|
| Automatic implicit | Unknown | Unknown | Unknown | Unknown |
| Manual explicit | Unknown | Unknown | Unknown | Unknown |
Source: providers.dev · Cache modes
Retention
| Control | Support | Request field | Accepted values | Default | Conditions |
|---|---|---|---|---|---|
| Cache retention | Unknown | Unknown | Unknown | Unknown | Unknown |
Source: Unknown
Provenance
| Provenance | Value |
|---|---|
| Source | providers.dev2026-11-16 |
| Inherited from | None |
| Corrections | None |
| Evidence |
|
Data
GET /api/v1/entries/devin/swe-2
Show the full entry as published
{
"id": "swe-2",
"providers_dev": {
"origin": "added",
"access": "subscription",
"provenance": [],
"inherited": null,
"cache": {
"documented": {
"support": "unknown",
"modes": {
"implicit": {
"support": "unknown",
"min_tokens": null,
"max_breakpoints": null,
"targets": null
},
"explicit": {
"support": "unknown",
"min_tokens": null,
"max_breakpoints": null,
"targets": null
}
}
},
"retention": {
"support": "unknown",
"parameter": null,
"accepted_values": null,
"default": null,
"profiles": [],
"conditions": [],
"evidence": []
},
"lifetime": {
"short": {
"safe_s": 0,
"basis": "measured",
"source": "providers.dev",
"date": "2026-11-08",
"documented_s": null,
"measured_s": 0,
"documented_status": null,
"clients": 3,
"evaluations": 3,
"checks": 23,
"hits": 1,
"checks_inside": null,
"hits_inside": null,
"tested_from_s": 300,
"first_miss_s": 0
},
"long": {
"safe_s": null,
"basis": "none",
"source": null,
"date": null,
"documented_s": null,
"measured_s": null,
"documented_status": null,
"clients": 0,
"evaluations": 0,
"checks": 0,
"hits": 0,
"checks_inside": null,
"hits_inside": null,
"tested_from_s": null,
"first_miss_s": null
},
"lifetimes": [
{
"retention_profile": "short",
"basis": "measured",
"source": "providers.dev",
"date": "2026-11-08",
"lifetime_s": 0,
"mode": null,
"documented_as": null,
"client": "agent+cliproxyapi",
"client_label": "A coding agent, through CLIProxyAPI",
"parameter": null,
"value": null,
"evaluations": 1,
"evaluation_ids": [
"devin-harness-2026-11-08/D12p"
],
"checks": 11,
"hits": 1,
"tested_from_s": 300,
"first_miss_s": 300,
"results": [
{
"kind": "control",
"age_s": 0,
"hits": 1,
"checks": 1,
"hit_rate_pct": 100
},
{
"kind": "timed",
"age_s": 300,
"hits": 0,
"checks": 2,
"hit_rate_pct": 0
},
{
"kind": "timed",
"age_s": 900,
"hits": 0,
"checks": 2,
"hit_rate_pct": 0
},
{
"kind": "timed",
"age_s": 1800,
"hits": 0,
"checks": 2,
"hit_rate_pct": 0
},
{
"kind": "timed",
"age_s": 3600,
"hits": 0,
"checks": 2,
"hit_rate_pct": 0
},
{
"kind": "timed",
"age_s": 7200,
"hits": 0,
"checks": 2,
"hit_rate_pct": 0
}
]
},
{
"retention_profile": "short",
"basis": "measured",
"source": "providers.dev",
"date": "2026-11-04",
"lifetime_s": 0,
"mode": null,
"documented_as": null,
"client": "cliproxyapi",
"client_label": "Requests sent through CLIProxyAPI",
"parameter": null,
"value": null,
"evaluations": 1,
"evaluation_ids": [
"cpa-8.0.53/D3"
],
"checks": 1,
"hits": 0,
"tested_from_s": null,
"first_miss_s": 0,
"results": [
{
"kind": "control",
"age_s": 0,
"hits": 0,
"checks": 1,
"hit_rate_pct": 0
}
]
},
{
"retention_profile": "short",
"basis": "measured",
"source": "providers.dev",
"date": "2026-11-08",
"lifetime_s": 0,
"mode": null,
"documented_as": null,
"client": "devin-cli",
"client_label": "The Devin CLI",
"parameter": null,
"value": null,
"evaluations": 1,
"evaluation_ids": [
"devin-harness-2026-11-08/D12c"
],
"checks": 11,
"hits": 0,
"tested_from_s": 300,
"first_miss_s": 0,
"results": [
{
"kind": "control",
"age_s": 0,
"hits": 0,
"checks": 1,
"hit_rate_pct": 0
},
{
"kind": "timed",
"age_s": 300,
"hits": 0,
"checks": 2,
"hit_rate_pct": 0
},
{
"kind": "timed",
"age_s": 900,
"hits": 0,
"checks": 2,
"hit_rate_pct": 0
},
{
"kind": "timed",
"age_s": 1800,
"hits": 0,
"checks": 2,
"hit_rate_pct": 0
},
{
"kind": "timed",
"age_s": 3600,
"hits": 0,
"checks": 2,
"hit_rate_pct": 0
},
{
"kind": "timed",
"age_s": 7200,
"hits": 0,
"checks": 2,
"hit_rate_pct": 0
}
]
}
]
},
"evaluations": [
{
"id": "devin-harness-2026-11-08/D12c",
"route": "devin",
"route_label": "Devin subscription",
"client": "devin-cli",
"client_label": "The Devin CLI",
"date": "2026-11-08",
"request_settings": {
"reasoning": "low"
},
"retention_profile": "short",
"parameter": null,
"value": null,
"results": [
{
"kind": "control",
"age_s": 0,
"hits": 0,
"checks": 1,
"hit_rate_pct": 0
},
{
"kind": "timed",
"age_s": 300,
"hits": 0,
"checks": 2,
"hit_rate_pct": 0
},
{
"kind": "timed",
"age_s": 900,
"hits": 0,
"checks": 2,
"hit_rate_pct": 0
},
{
"kind": "timed",
"age_s": 1800,
"hits": 0,
"checks": 2,
"hit_rate_pct": 0
},
{
"kind": "timed",
"age_s": 3600,
"hits": 0,
"checks": 2,
"hit_rate_pct": 0
},
{
"kind": "timed",
"age_s": 7200,
"hits": 0,
"checks": 2,
"hit_rate_pct": 0
}
],
"late_excluded": 0,
"note": null,
"source": "https://github.com/ngvoicu/groundtruth/blob/main/results/devin-harness-2026-11-08/D12c.jsonl"
},
{
"id": "devin-harness-2026-11-08/D12p",
"route": "devin",
"route_label": "Devin subscription",
"client": "agent+cliproxyapi",
"client_label": "A coding agent, through CLIProxyAPI",
"date": "2026-11-08",
"request_settings": {
"reasoning": "low"
},
"retention_profile": "short",
"parameter": null,
"value": null,
"results": [
{
"kind": "control",
"age_s": 0,
"hits": 1,
"checks": 1,
"hit_rate_pct": 100
},
{
"kind": "timed",
"age_s": 300,
"hits": 0,
"checks": 2,
"hit_rate_pct": 0
},
{
"kind": "timed",
"age_s": 900,
"hits": 0,
"checks": 2,
"hit_rate_pct": 0
},
{
"kind": "timed",
"age_s": 1800,
"hits": 0,
"checks": 2,
"hit_rate_pct": 0
},
{
"kind": "timed",
"age_s": 3600,
"hits": 0,
"checks": 2,
"hit_rate_pct": 0
},
{
"kind": "timed",
"age_s": 7200,
"hits": 0,
"checks": 2,
"hit_rate_pct": 0
}
],
"late_excluded": 0,
"note": null,
"source": "https://github.com/ngvoicu/groundtruth/blob/main/results/devin-harness-2026-11-08/D12p.jsonl"
},
{
"id": "cpa-8.0.53/D3",
"route": "devin",
"route_label": "Devin subscription",
"client": "cliproxyapi",
"client_label": "Requests sent through CLIProxyAPI",
"date": "2026-11-04",
"request_settings": {},
"retention_profile": "short",
"parameter": null,
"value": null,
"results": [
{
"kind": "control",
"age_s": 0,
"hits": 0,
"checks": 1,
"hit_rate_pct": 0
}
],
"late_excluded": 0,
"note": null,
"source": "https://github.com/ngvoicu/groundtruth/blob/main/results/cpa-8.0.53/D3-2026-11-04T17-57-26.json"
}
]
},
"pricing": {
"coverage": "not_applicable",
"billing": "not_applicable",
"reference_ref": null,
"rules": null,
"rule_order": null,
"unparsed": [],
"evidence": []
},
"request_controls": {
"coverage": "unknown",
"items": [
{
"id": "cache.retention",
"support": "unknown",
"when": null,
"bindings": null,
"options": null,
"default": null,
"conditions": [],
"evidence": []
},
{
"id": "service_tier",
"support": "unknown",
"when": null,
"bindings": null,
"options": null,
"default": null,
"conditions": [],
"evidence": []
}
]
},
"limits": {
"measured": [
{
"route": "devin",
"route_label": "Devin subscription",
"client": "cliproxyapi",
"client_label": "Requests sent through CLIProxyAPI",
"context": null,
"output": null,
"input_accepted": 300499,
"input_refused": null,
"input_read": 300499,
"output_accepted": null,
"note": "no edge found: no request was refused at any size tried, and Devin lists 262,000. Both code words (one before the filler, one after it) came back at 20,493, 200,497 and 300,499 tokens, so the model read those inputs to the end. Requests of up to 930,487 tokens were accepted on 2026-11-13 (results/limits-2026-11-13) with no check that they were read, and a both-ends request then got no answer at 250K and 300K within 5 minutes: those sizes are not in the row",
"date": "2026-11-16",
"source": "https://github.com/ngvoicu/groundtruth/blob/main/results/limits-2026-11-16/swe-2-recall.jsonl"
}
],
"from_measurement": [],
"input_window": {
"tokens": 300499,
"basis": "measured",
"bound": "at_least",
"scope": "input",
"source": "providers.dev",
"date": "2026-11-16",
"documented_tokens": null,
"documented_field": null,
"documented_source": null,
"documented_date": null,
"documented_status": null,
"measured_tokens": 300499,
"measured_bound": "at_least",
"measured_kind": "accepted",
"measured_refused": null,
"measured_date": "2026-11-16",
"clients": 1,
"evaluations": 1,
"measurements": [
{
"client": "cliproxyapi",
"client_label": "Requests sent through CLIProxyAPI",
"route": "devin",
"route_label": "Devin subscription",
"date": "2026-11-16",
"tokens": 300499,
"bound": "at_least",
"kind": "accepted",
"accepted": 300499,
"refused": null,
"named": null,
"read": 300499,
"source": "https://github.com/ngvoicu/groundtruth/blob/main/results/limits-2026-11-16/swe-2-recall.jsonl"
}
]
}
},
"evidence": [
{
"kind": "measured",
"url": "https://github.com/ngvoicu/groundtruth/blob/main/results/cpa-8.0.53/D3-2026-11-04T17-57-26.json",
"date": "2026-11-04",
"note": null
}
],
"verified": "2026-11-16"
},
"name": "swe-2"
}