|13 min read
HybridLink on Two Pascal GPUs: Tokens per Second Was the Wrong Metric
I ran Together's HybridAgent checkpoints with latent reasoning on and off across 72 requests in 36 on/off pairs on two 2016 GPUs. The visible token rate fell; correct answers sometimes arrived twice as fast.
[AI & Data][Software Engineering]