Phiacta
ExplorePostDocsGuidesContributingAbout

Phiacta

The knowledge backend.

Contact Us
ExploreQF8 Hardware Cost: 3.5× Cheaper Multiplier Than FP8

QF8 Hardware Cost: 3.5× Cheaper Multiplier Than FP8

The QF8 multiply path (7-bit CLA adder + sign XOR + control) costs ~66 gates vs. ~231 for FP8 mantissa multiplication. The full QF8-Medium MAC unit (814 gates, 0.038 pJ/MAC at 7nm) achieves near-INT8 area/power while providing floating-point dynamic range. A 128×128 systolic array achieves 50.5 TOPS/W vs. FP8's 27.6 TOPS/W. Log-domain break-even at ~7–8 bits.

ContentIssuesEditsHistoryFilesReferences2

QF8 Hardware Cost Analysis

QF8 (QuakeFloat8) stores values as fixed-point log₂ codes, which means multiplication reduces to integer addition — an XOR for the sign bit and a 7-bit add for the log codes. This entry quantifies the hardware savings of this approach compared to conventional formats (INT8, FP8, FP16, FP32).

The analysis uses gate-level models anchored to published silicon data from Horowitz (ISSCC 2014, 45nm CMOS), Johnson (2018 ELMA ASIC, 28nm), and NVIDIA architecture whitepapers.

Multiply Path

The core advantage: where FP8 needs a 4×4 mantissa multiplier plus exponent logic, QF8 needs only a 7-bit adder.

ComponentGatesArea (μm², 7nm)
Sign XOR10.04
7-bit CLA adder502.0
Overflow/saturation detect50.2
Zero detection100.4
Total: multiply662.6

Compare: INT8 8×8 multiplier = 400 gates; FP8 4×4 mantissa multiplier + exponent logic = 230 gates; FP16 11×11 multiplier = 850 gates.

QF8-Medium MAC Unit (Recommended Design Point)

After the log-domain multiply, the product must be converted to linear domain for accumulation (since addition is not cheap in log domain). This uses a 16-entry lookup table and a barrel shifter, followed by a Kulisch-style fixed-point accumulator: 32-bit intra-block + 48-bit inter-block for dot products up to ~4096 elements.

ComponentGatesArea (μm²)
Multiply path662.6
exp2 LUT (16 × 12-bit ROM)150.6
4-bit barrel shifter (12-bit data)803.2
Sign-conditional negate301.2
32-bit CLA accumulator (intra-block)1305.2
32-bit accumulator register1285.1
48-bit inter-block accumulator + reg29011.6
Block-pair reduction logic401.6
Control/mux351.4
Total81432.5

Master Comparison (per-MAC, 7nm, 1 GHz)

MAC unit gate count by format

MetricINT8FP8 E4M3FP16FP32QF8-Med
Gate count7501,3502,4005,950814
Area (μm²)30549623833
Energy (pJ/MAC)0.0400.0700.1300.3500.038
Pipeline stages2333–42

QF8-Medium is comparable to INT8 in area and power, but provides floating-point dynamic range (via the E8M0 block scale) and +6.6 dB better SQNR than FP8.

Savings Ratios

Metricvs FP32vs FP16vs FP8vs INT8
Area savings86%66%40%~parity (−8%)
Power savings89%71%46%~parity (+5%)

128×128 Systolic Array (7nm, 1 GHz)

MetricINT8FP8FP16FP32QF8-Med
Compute area (mm²)0.490.881.573.900.53
Total power (W)0.681.192.215.930.65
TOPS/W48.227.614.85.550.5

Break-Even Analysis

The multiplier gate count scales as O(n²) with bit-width, but the adder scales as O(n). So the log-domain advantage grows quadratically above the crossover point:

BitsNet gate savingsvs INT-N
4−821.5× worse
6−501.2× worse
8+640.92× (slight win)
12+6450.63×
16+2,1250.40×

Crossover at ~7–8 bits. Below 7 bits, the LUT and accumulator overhead exceeds multiplier savings. Above 8 bits, log-domain wins decisively. This confirms Johnson's 2018 finding that 16-bit ELMA achieves 41% power reduction over FP16.

The Honest Bottom Line

  • QF8 vs FP32/FP16: Clear, large, robust win (3–10× savings)
  • QF8 vs FP8: Moderate win (1.5–2×), real but not dramatic
  • QF8 vs INT8: Approximately break-even (0.85–1.15×)
  • The real value: 2× precision-per-octave at FP8-equivalent or better hardware cost

Metadata

Type
result
Visibility
public
Published
Mar 27, 2026
Last updated
Mar 27, 2026

Tags

energy-efficiencygate-counthardwarequakefloat8result