Rupert said:
Robert Myers wrote:
[SNIP]
Now the article has my attention. I don't care _that_ much about the
details of what a workstation does (certainly not fifteen percent),
but I don't want my workstation to be "shut down" just because I've
got a few things going.
The phrase "shut down" does stretch credibility somewhat.
Mmmm. Another discussion about "responsiveness" and how to characterize
it? Perhaps you would have been less put off if he had said the system
becomes "unresponsive," whatever that means.
I came across a thread about this very subject on realworldtech.com
(which thread references this thread). That's alot of buzz about one
sloppy benchmark for a trade rag and some overblown rhetoric to go with it.
As a discussion generator, overdrawn rhetoric works, and, by that
measure, we should probably acknowledge that nothing here has harmed Mr.
Kennedy's career trajectory or Infoworld's readership.
If the methodology is not published in enough detail to reproduce
the results then personally I will conclude that they know their
results are bogus.
This puts us both in the position of speculating about mindset, but I'll
doubt Mr. Kennedy is as cynical about his results as your comment implies.
I started to type a comment to the realworldtech thread, but stopped
because I realized what a quagmire I was wading into. Benchmarks, like
statistics, are more frequently misused than used in a way that bears
examination.
As it is, though, I'm not quite as dismissive of Mr. Kennedy's little
squib as you are:
<quote>
The Peak CPU Saturation Index, which is calculated from a sampling of
the Processor Queue Length counter as exposed by the Windows Performance
Data Helper libraries, showed that, on average, the Opteron system had
16 percent more waiting threads in its queue -- a clear indication that
the system was in fact CPU-bound and running out of processor bandwidth.
</quote>
That's a remark with content that ostensibly yields insight into what's
actually happening (significantly more denotative than "shut
down")--more than you can expect from the eye-blurring pages of
benchmarks you typically see and have to try to draw some insight from
(because the publisher certainly hasn't provided it).
The details of the benchmark can't be repeated, but the conclusion can
be confirmed or refuted. Design your own bogus benchmark, see what
happens to the Processor Queue Length and publish your results. You
know ahead of time you will have readers. As a freelancer, you could
probably sell it, although probably not for enough to pay for your time.
RM