Skip to content

HBM

In progress

This is the project’s first content milestone: every generation in the HBM line, with complete spec deltas, fully sourced. It is deliberately the only vertical being filled. Finished and narrow beats sprawling and sixty percent complete.

The document identities and publication dates below are now verified against the JEDEC landing pages. The spec deltas are still empty — bus widths, data rates, per-stack bandwidths. Those figures exist and are well known, and writing them from memory would take five minutes, which is exactly the failure mode this project is built to prevent. They live inside the standards themselves, and the extraction candidates stay in quarantine/ until someone has opened the documents.

Why HBM is the anchor

HBM is the clearest single instance of the project’s thesis. Faced with a compute engine it could no longer feed, the industry did not make the memory faster in the conventional sense. It made the interface wider and moved the memory onto the package — trading the economics of a commodity DIMM for proximity and bus width.

The TPU paper is the other half of the same story from the compute side: production accelerator workloads sitting in the bandwidth-limited region of a roofline, with the paper’s own counterfactual showing achieved throughput gated by the attached memory rather than by the arithmetic.

Which documents there are

The first thing to get right is which standard is which, and that turns out to be less obvious than the generation names suggest. HBM did not stay in one document series: HBM3 broke out into its own number, and HBM4 into a third unrelated one. The rows below are what the JEDEC landing pages themselves state — document number, revision and publication date, read from the page.

Generation Current document Published Non-member access
HBM JESD235D Mar 2021 Purchase, $247
HBM3 JESD238B.01 Apr 2025 Free with registration
HBM4 JESD270-4A (v1.1) Dec 2025 Free with registration

HBM2, HBM2E and HBM3E are intermediate revisions within those series rather than separate current documents, and JEDEC serves only the current revision of a series at its URL. Their edition dates remain unverified and stay in quarantine/.

A JEDEC URL names a series, not an edition. docs/jesd235a serves JESD235D today and will serve JESD235E when there is one; docs/jesd238 served the original JESD238 when its 2022 archive snapshot was taken and serves B.01 now. Read the document number off the page, never off the slug — and treat an archive snapshot as a capture of whichever revision happened to be current that day.

The spec deltas are still empty, and now we know what that costs

Each row will eventually carry bus width, channel and pseudo-channel organisation, per-pin data rate, per-stack bandwidth, stack height, capacity per stack, and supply voltage — with the revision that establishes each figure attached to that figure, not to the row.

Two figures can be stated now, because the landing pages print them: the original HBM channel interface is a 128-bit data bus at DDR rates, and HBM3’s is 64 bits per channel. Everything else is inside the PDFs, and nobody here has opened one.

What is public here — a correction

This project said at bootstrap that the JESD235 line is free to download after registration, and that the common assumption of a paywall is wrong. That is no longer true, and the correction is worth more than the original claim.

JEDEC has moved selected standards to non-member purchase. Checked against the document pages today, the split runs the opposite way to what anyone would guess:

  • JESD235D (HBM) — $247.00 to a non-member
  • JESD79-5D (DDR5) — $423.00
  • JESD238B.01 (HBM3) — free with registration
  • JESD270-4A (HBM4) — free with registration

So the newest and most commercially consequential HBM standards are the free ones, while the older mainline documents have gone behind a per-copy charge. A reader who bounced off the JESD235 price and concluded the HBM standards are closed would be wrong about precisely the generation they most likely want.

JEDEC’s own framing — “most of the content on this site remains free to download with registration” — is accurate as far as it goes. It is just that the exceptions land on the documents this project is built around.

Sources

standardPurchase

JESD235 - High Bandwidth Memory (HBM) DRAM

JEDEC Solid State Technology Association · JESD235, 2013

The original HBM standard and the anchor of the project's first content vertical. Two things about getting hold of it have changed since this record was first written, and both matter to a reader. First, the original edition has no landing page any more. jedec.org/standards-documents/docs/jesd235 now returns 404; the 2016 archive snapshot on this record is the only surviving capture of it. JEDEC serves the current revision of a series at the series slug, so the `url` here resolves to JESD235D (Mar 2021), not to the 2013 document. Cite jedec-jesd235d-hbm-2021 for anything read out of the current revision. Second, this document is no longer free. The JESD235 line has moved to non-member purchase, and the page quotes $247.00. That is a change from the position this project stated at bootstrap and repeated on several pages. Note that it does not generalise: HBM3 and HBM4 are still free with registration — see jedec-jesd238b01-hbm3-2025 and jedec-jesd270-4a-hbm4-2025.

standardPurchase

JESD235D - High Bandwidth Memory (HBM) DRAM

JEDEC Solid State Technology Association · JESD235D, 2021

The current revision of the original HBM line, and the document to cite for anything in the JESD235 series read today rather than from the 2013 edition. The landing page states the document number and a publication date of March 2021. Where it stops, for this project's purposes: the page carries an abstract and the committee assignment, not the parameter tables. Bus width, channel and pseudo-channel organisation, per-pin data rate, per-stack bandwidth, stack height and supply voltage all live inside the PDF, which is $247.00 for non-members. No figure in the HBM generation table may be filled from this record until someone has actually opened the document. Note the slug. JEDEC serves the current revision of a series at a stable series URL, so docs/jesd235a serves JESD235D and will serve JESD235E when there is one. A JEDEC URL identifies a series, not an edition, and an archive snapshot of one captures whichever revision was current on that date. Read the document number off the page rather than off the URL.

standardFree, registration required

JESD238B.01 - High Bandwidth Memory (HBM3) DRAM

JEDEC Solid State Technology Association · JESD238B.01, 2025

HBM3, and the current revision of it. The landing page states the document number and a publication date of April 2025, and offers a free download after registration — no purchase block, unlike the JESD235 line. That contrast is the useful thing this record carries. HBM3 broke out of the JESD235 series into its own document number, and it remained free while the older series moved to paid. Anyone who concluded from a JESD235 paywall that the HBM standards are closed would be wrong about the generation they most likely want. Authoritative for the HBM3 interface as standardised: the page's own abstract states the 64-bit-per-channel data bus at double data rate, against the 128-bit channel of the original HBM. Every other parameter is inside the PDF and none has been read yet, so this record supports no figure in the generation table beyond the two the page itself prints. The slug caveat applies: docs/jesd238 is a series URL and serves whatever revision is current. It served the original JESD238 when the 2022 snapshot was taken and serves B.01 today.

standardFree, registration required

JESD270-4A - High Bandwidth Memory (HBM4) DRAM

JEDEC Solid State Technology Association · JESD270-4A, Version 1.1, 2025

HBM4. The landing page states the document number, Version 1.1, and a publication date of December 2025, and offers a free download after registration. Worth recording for the numbering alone, because it is a trap. HBM4 is not in the JESD235 line and not in the JESD238 line: it is JESD270-4A, a different series entirely. Anyone searching the JEDEC catalogue for the HBM4 standard under a JESD235 or JESD238 number will not find it, and the project's own generation table listed HBM4's standard as unknown for exactly that reason. No parameter has been read from the document. This record establishes that HBM4 is standardised, under which number, as of when, and that it is free to obtain. It supports nothing else, and specifically supports no bandwidth, bus-width or stack figure.

paperPaywalled — preprint available

In-Datacenter Performance Analysis of a Tensor Processing Unit

Norman P. Jouppi, Cliff Young, Nishant Patil, David Patterson · ISCA 2017 (44th Annual International Symposium on Computer Architecture), pp. 1-12, 2017

The memory wall measured in a production accelerator rather than argued in the abstract. Its roofline analysis shows most of the evaluated neural network workloads sitting in the memory-bandwidth-limited region, and the abstract states that substituting the GPU's GDDR5 memory into the TPU would triple achieved TOPS — an accelerator whose headline compute number is gated by the memory it is attached to. 75 authors; the arXiv preprint is complete and freely readable. Also the reference point for how a vendor constructs a TOPS figure, since it documents its own conditions unusually honestly.