Speed Tests

GLM 5.3 Fast Baseline Test: First Token, Tokens per Second, and Total Time

GLM 5.3 Fast Baseline Test: First Token, Tokens per Second, and Total Time
The baseline speed test for GLM 5.3 Fast measures first-token latency, sustained tokens per second, and total completion time under consistent U.S. home-office conditions.

A useful AI model speed test starts with a clean baseline. For GLM 5.3 Fast the baseline measures three numbers that matter in daily work: first-token latency, sustained tokens per second, and total completion time. These figures are collected under the same ordinary U.S. conditions used for every AI Speed Index test so later comparisons remain meaningful.

The baseline is not a single glamorous run. It is a small series of identical requests designed to show both central tendency and spread. Peak performance on one lucky call is less informative than the pattern that appears across ten controlled runs.

I treat the baseline the same way I treated product instrumentation in my SaaS years: define the measurement, keep the conditions fixed, record every run, and publish the method before the interpretation. That discipline keeps the numbers usable even when a reader weights the metrics differently from the way I do.

Why These Three Metrics

First-token latency answers the question a user feels first: how long until something appears. In interactive tools, chat interfaces, and many internal workflows, the moment the first token arrives shapes the perception of speed more than the final average rate.

Sustained tokens per second answers the next question: once generation starts, does the model keep moving at a usable pace? A model that opens quickly and then slows can still frustrate users on longer responses. Measuring the post-first-token rate isolates that behavior.

Total completion time is the number that appears on a stopwatch when the task is finished. It combines the first-token wait and the generation period into the figure that actually determines whether a workflow stays inside a time budget.

Together the three metrics give a more complete picture than any one of them alone. A model can look strong on peak throughput and still feel slow if first-token latency is high. It can look responsive on the first token and still finish late if generation drags. The baseline records all three so readers can see the trade-offs.

Fixed Conditions for the Baseline

Every baseline run for GLM 5.3 Fast records the same core conditions:

  • Exact model name and version string supplied by the provider

  • API endpoint and region used for the calls

  • Date and local time in U.S. Central

  • Test machine: MacBook Pro on 1 Gbps residential fiber in Austin

  • Prompt text and its tokenized input length

  • Target or observed output length

  • Number of runs in the series

  • Any failures, timeouts, or retries

The prompt itself is kept deliberately ordinary. It is long enough to exercise generation beyond a trivial reply yet short enough to remain representative of common product and operations tasks. Using the same prompt across the series removes one major source of variance so differences between runs are more likely to reflect model or network behavior rather than prompt changes.

A short cool-down interval is observed between runs. The interval is not long enough to constitute a full cold start, but it reduces the chance that temporary warm-up or rate-limit effects from one call immediately distort the next.

Laptop screen displaying a clean run log with timestamps, first-token times, and completion durations for repeated baseline tests

How a Baseline Series Is Executed

A typical baseline series follows a fixed sequence:

  1. Confirm model version and endpoint.

  2. Tokenize the prompt and record the input count.

  3. Send the request and start the wall-clock timer.

  4. Capture the timestamp of the first usable token.

  5. Allow generation to continue until completion or a predefined maximum length.

  6. Record total elapsed time and final output token count.

  7. Calculate tokens per second from the generation interval after the first token.

  8. Log the result or the failure reason.

  9. Wait the cool-down interval and repeat until the planned number of runs is complete.

Ten runs is the default for a baseline. That number is large enough to show a usable average, median, and range without turning the test into a multi-hour exercise. When the observed spread is wide, the range itself becomes an important finding and may prompt additional runs or a concurrent-load follow-up.

Failures are not discarded. A timeout, a truncated response, or an error that forces a retry is recorded as part of the series. The failure rate belongs in the published result because it affects both perceived speed and real cost.

Consistency as a First-Class Result

Average latency and average throughput are useful. They are incomplete without a view of consistency. In automated pipelines and high-volume internal tools, a model that finishes in a tight band is often preferable to a model whose average looks better but whose occasional slow runs disrupt the workflow.

For that reason every baseline reports:

  • Arithmetic mean

  • Median

  • Observed minimum and maximum

  • Simple visual or tabular distribution of the ten runs when the spread is noteworthy

A tight cluster supports higher confidence for repeated use. A wide spread is reported as a characteristic of the model under the tested conditions, not smoothed away.

The same consistency lens is applied later when concurrent requests are introduced. The baseline establishes the single-request reference; concurrent tests then show how far performance moves once multiple calls share the connection.

What the Baseline Does Not Claim

A clear baseline also requires clear limits. The numbers produced by this method do not claim to represent:

  • Every geographic region or network condition

  • Performance under sustained production traffic far above the test load

  • Laboratory isolation free of ordinary residential network variation

  • Theoretical maximum throughput published by the provider

They claim only to be careful observational measurements under the stated home-office conditions, using the stated prompt, on the stated number of runs. That is enough to support comparison with other models tested the same way and to give readers a realistic starting point for their own evaluation.

Pricing is kept separate from the pure speed baseline. Token counts are recorded so that cost can be calculated later, but the speed article itself focuses on time and rate. Mixing the two without clear labels would make both harder to interpret.

Printed summary sheet of first-token latency, tokens per second, and total time results placed next to a laptop with raw data

How Baseline Results Are Presented

When the first GLM 5.3 Fast baseline numbers are published they will follow the standard AI Speed Index closing structure:

  • Use it when…

  • Skip it when…

  • What we measured

  • What we still do not know

The measured section will list the observed first-token latency, tokens-per-second, and total completion time figures together with the consistency summary. The open-questions section will note variables still untested—different prompt lengths, different times of day, concurrent load, longer context, or subsequent model versions.

Because model versions and endpoints can change, the exact version string and the date of the test are treated as part of the primary result. A later test on a newer version is reported as a new baseline rather than silently overwriting the earlier one.

The purpose of the baseline is modest and practical. It gives readers a transparent reference for GLM 5.3 Fast under ordinary conditions so that later workflow tests, concurrent-load tests, and head-to-head comparisons have a common foundation. Fast is a feature. Reliable is the product. A clean baseline is the first step in keeping both statements measurable.

Last updated · 2026-10-21 09:30

Letters

No letters yet — be the first to write.

Leave a letter
© 2026 AI Speed Index. All rights reserved. — grown slowly, toward the light —