Insights
Weekly digest · Week of Jul 6, 2026

Rent per hour is not cost per token

Reserved Blackwell runs near $12 a GPU-hour, marketplace B200 asks rose, Hopper eased. Ambient note-taking gave clinicians back 13 minutes of every clinical day.

Economics
A data center's server racks laced with fiber, the compute that GPU rental prices ride on.
Taylor Vick / Unsplash

Two GPU generations moving apart

Amazon charges $98.84 an hour to reserve a Capacity Block of eight B200s, about $12.36 per GPU-hour, and says it moves that price on supply and demand. In our July 13 Vast.ai snapshot the B200 asking range rose to $7.25 to $9.92 an hour, up from about $5 a week earlier, while the upper end for last-generation H100 and H200 spot offers eased. Two GPU generations, moving apart.

It is tempting to read that as the shortage narrowing onto Blackwell. Be careful. These are asking-price ranges on one marketplace, and the snapshot merges board variants like H100 SXM and PCIe into a single range, so a move can reflect what is on offer rather than what is scarce. And hourly rent is not what a workload costs. A B200 rents for more than an H100 and can still produce a cheaper token, because throughput, batching, and memory fit decide cost per token, not the sticker on the hour.

So the honest read is narrow. Reserved rates are high across generations; one marketplace's Blackwell asks rose this week while its Hopper asks fell. For what to build on, the number that decides it is cost per token under comparable terms, not the hourly rate.

Metric move

In the July 13 Vast.ai snapshot, B200 asks rose to $7.25–$9.92/hr from about $5 a week earlier while H100 and H200 upper ranges eased; these are marketplace asking prices, not cost per token.

Spotlight
A clinician in scrubs holding a laptop during a consultation.
National Cancer Institute / Unsplash

Letting the doctor look at the patient again

Clinicians burn hours a day typing visit notes into the record instead of facing the patient.

JAMA (Rotenstein et al.), Apr 1, 2026. A peer-reviewed study of 8,581 clinicians across five academic medical centres, independent of the vendors.

How it works

A microphone captures the visit, a language model drafts the structured note in the clinician's format, and the clinician edits and signs.

The economics

Adopters spent 13.4 fewer minutes in the record per 8-hour day. Effects were modest, and only 1,809 took the tool up.

Who it’s for

Clinical operations lead, Health-system CIO, Healthtech founder, Automation lead.

Transferable pattern

Turn a spoken interaction into a structured, editable record. The same capture-and-approve loop fits insurance claim intake, field-service reports, and legal client interviews.

Players to watch
NameWhat they doHQStagePosition
Abridgeclinical conversation intelligence at health-system scalePittsburgh, PennsylvaniaScale-upChallenger
Ambience Healthcaredocumentation joined to coding and clinical workflowsSan FranciscoScale-upSpecialist
Microsoft Dragon Copilotambient documentation inside established clinical systems (ex-Nuance DAX)Redmond, WashingtonListedIncumbent
Nablaambient documentation with broad EHR and Epic integrationParisScale-upChallenger
Sukiambient clinical intelligence across major EHR systemsRedwood City, CaliforniaScale-upChallenger
Heidi Healthclinician-controlled ambient documentation with international reachMelbourneScale-upChallenger
TortusUK ambient documentation deployed across the NHSLondonStartupSpecialist
CortiEuropean clinical-AI APIs for documentation and codingCopenhagenScale-upPlatform
Signals

Our research reads the structure under an innovation market: the economics, the technology, the ecosystem that connects them. .

New research, by email

Insights