On The Insider: NPH at the GQ 'Men of the Year' Awards
BNET Business Network:
BNET
TechRepublic
ZDNet

July 4th, 2007

AMD posts blatantly deceptive benchmarks on Barcelona

Posted by George Ou @ 12:37 am

Categories: AMD, Desktop, Hardware, Intel, News, Processors, Servers

Tags: Quad-core, Barcelona, Advanced Micro Devices Inc., George Ou

In Focus » See more posts on: Benchmarks

 Updated 8/16/2007 - AMD caught red handed

[UPDATE 7/6/2007 - AMD intends to drag their feet on removing the deceptive benchmarks]

After AMD admitted the bad news last week that their Barcelona product would be late and underwhelming on clock speed, the AMD propaganda machine has gone in to hyper drive with the latest salvo of blatantly deceptive benchmarks. After claiming to have the high-road on ethics, AMD showed hypocrisy on three separate occasions (one, two, and three). But this latest round of deceptive benchmarks is so outrageous that it’s criminal [UPDATE 7/5/2006 - Criminal might be too strong of a word.  This is blatant deceptive advertising at the very least.]

[UPDATE 7/5/2006 - Despite the fact that AMD has plausible deniability that they created these simulated benchmarks much earlier in the year, the benchmarks were confidential earlier in the year and they're now making its rounds in the blogsphere and press as if it were news of a miraculous triumph by AMD.  The AMD Barcelona spin campaign is in full throttle and this bogus information is posted prominently on AMD's Barcelona Product page.  Fortunately, all this pressure has forced AMD to promise that they will remove the bogus benchmarks on their Website.]

On AMD’s “Barcelona” performance page, AMD shows the following fictitious and outdated information. Apparently some of these misleading numbers are even showing up on Wall Street Journal advertisements.

  • It’s fictitious since AMD doesn’t have a 2.6 GHz Barcelona quad-core CPU and they won’t even have it in September which is already late by AMD’s original timeline. The fastest Barcelona processor coming out in September is 2.0 GHz. It isn’t really clear when AMD will be able to ramp up the clock speed an extra 30% to get to 2.6 GHz but it most likely won’t be any time soon because processors don’t just ramp 30% over night.
  • The numbers AMD posted for Intel’s XEON X5355 and X5160 have been outdated since April 2007 and you need a magnifying glass to see that disclaimer in the fine print on the bottom. The actual up-to-date SPEC.org certified scores for the two Intel products listed are significantly higher. It not like AMD can claim that they forgot to include the very latest scores which were just posted days ago, we’re talking months here so it’s a blatant omission.
  • Intel’s XEON X5365 3.0 GHz quad-core CPU which shipped back in April was deliberately omitted from these results even though AMD showed off numbers for a 2.6 GHz Barcelona chip which doesn’t even have a launch date yet. Putting in 2.0 GHz Barcelona scores would be shady enough since the part hasn’t officially launched yet but including 2.6 GHz Barcelona scores is just outrageous.

Full picture on quad-core SPECint_rate2006 performance:

* Not real product. Fastest Barcelona being released in September is 2.0 GHz

As you can see from above, AMD’s claim that they have a 20% clock-for-clock advantage with Barcelona is simply wrong. Based on the latest certified SPEC.org results, AMD has a little more than a 1% clock-for-clock performance advantage in a dual-socket 8-core Server configuration but they have 50% clock speed deficit when the Barcelona finally launches in September. That means Barcelona will not be the Intel quad-core killer that AMD has been promising for most of this year and it won’t even be close.

The deception doesn’t end with the quad-cores; AMD is also claiming to have an advantage on dual-core processors when in fact they have a major performance deficit. AMD claims to have a 2.5% advantage when Intel actually has a 14.7% advantage when you’re looking at the certified SPEC.org scores.

Full picture on dual-core SPECint_rate2006 performance:**

** UPDATE 7/5/2007 - Hans de Vries pointed out in the talkback that the AMD 2222SE has newer scores. The newer results have been added to this chart.

I’ve seen benchmarks get cherry picked and twisted before but this is just outrageous. AMD is deliberately leaving out Intel’s best scores, leaving out Intel’s best products that shipped months ago, and putting in theoretical Barcelona scores for products that don’t even have a ship date. After Henri Richard (AMD executive) came in front of our ZDNet cameras to slam Intel for “un-ethical behavior” and promising not to do the same, we have caught them on four separate occasions behaving unethically. After this latest incident, it’s clear that AMD has no intention of behaving honestly or ethically.

Updated 8/16/2007 - AMD caught red handed
Since there are a few websites and some individuals that continue to accuse me of wrongly accusing AMD of leaking the bogus simulated Barcelona 2.6 GHz benchmarks, I need to set the record straight.  AMD in mid-July last month was still giving out those benchmarks to the press weeks after they had already removed them from their own website.  Ironically that same week, I had an HD Video conference on July 20th with AMD’s public relations people and they slammed me for implying that AMD had leaked it to the press and that it was a Russian partner of AMD that distributed the benchmarks.  But when TechArp’s Adrian Wong wrote a story using the same benchmarks, I informed Wong that he was using discredited benchmarks that AMD was forced to remove and Wong informed me that AMD had given it to him.  Wong was not happy that he was given junked benchmarks from AMD and posted the following note in his Barcelona article:

Adrian Wong: George also pointed out that AMD removed the “simulated” benchmark results from their website on July 6th, and promised to post proper benchmark results of their Barcelona processor. However, we received the very same benchmark results just last week. If these results have already been officially junked by AMD, why are we still being served the same poo?

AMD initially denied they had given it to TechArp and told me that their European PR manager stated that they stopped distributing those benchmarks in April 2007.  Later in the week on July 25th an anonymous source of mine sent me an AMD PowerPoint presentation that was being given out to partners and I confronted AMD with it.  Four hours later AMD informed me that there was an AMD press event in Kuala Lampur on July 16 and “the simulated benchmark slide was included in the deck that was presented”.

I had originally decided to let this slide and not make another posting of it but it seems that a few individuals still want to smear my reputation for implying that AMD was responsible for leaking the slides to the press.  Because of this I have no choice but to set the record straight that AMD was in fact responsible for distributing these discredited benchmarks even after they had been officially junked.

George Ou is Technical Director of ZDNet. See his full profile and disclosure of his industry affiliations.

  • Talkback
  • Most Recent of 164 Talkback(s)
Message has been deleted.
(Read the rest)
Posted by: kevencage Posted on: 07/19/07  (Edited: 09/12/07 @ 04:39) You are currently: a Guest | | Terms of Use
AMD grasping at straws - get used to the deception  Prognosticator | 07/04/07
Does anyone really care?  GeiselS@... | 07/04/07
Then why did you bother to read it?  James T. Kirk | 07/04/07
Never trust benchmarks when tested by the manufacturer  MacGeek2121 | 07/05/07
Desperation of a failing company  No_Ax_to_Grind | 07/04/07
Yeah., failing...  jasonp@... | 07/05/07
Yea., failing...  thetruthhurts | 07/05/07
Still in business...  jasonp@... | 07/05/07
blah blah blah blah blah  thetruthhurts | 07/05/07
Please double-check your facts...  CFKane | 07/04/07
And AMD is in business to make processors?  lenohere | 07/04/07
AMD posted this on their website and in a WSJ ad  georgeou | 07/04/07
Dates  gtdavies33@... | 07/04/07
Random find  CFKane | 07/04/07
A somewhat clearer picture  CFKane | 07/04/07
At least try to hide your bias  CFKane | 07/04/07
AMD has made it a habbit to ommit Intel's best products and scores  georgeou | 07/04/07
For a reason?  dess3 | 07/04/07
For a reason? OK...  thetruthhurts | 07/04/07
Clocks...  dess3 | 07/04/07
A dual Intel quad-core system is the same price as a dual dual-core AMD  georgeou | 07/05/07
Yeah...  jasonp@... | 07/05/07
everyone knows  gdude@... | 07/05/07
George at his finest!  linux for me | 07/04/07
So you don't trust certified numbers from SPEC.org?  georgeou | 07/04/07
Did you even read the heading  zkiwi | 07/04/07
LOL, and you think there's a SPECint_rate2007?  georgeou | 07/04/07
Duh  zkiwi | 07/04/07
Well at least you admit he is right and your not.  No_Ax_to_Grind | 07/04/07
What does iPhone and Vista have to do with this?  georgeou | 07/04/07
Advertising...  zkiwi | 07/04/07
Double Duh  Rndmacts | 07/05/07
Just so as you know  zkiwi | 07/06/07
Certified?!?  Robert Crocker | 07/05/07
lol...  jasonp@... | 07/05/07
You have got to be kidding????????  Cayble | 07/04/07
Replied to the right message?  CFKane | 07/05/07
I agree with CFKane  mikhey | 07/05/07
Two idiots don't make it right  Rndmacts | 07/05/07
These numbers are from 2006!  dess3 | 07/04/07
That excuse won't fly  georgeou | 07/04/07
And what's your excuse?  dess3 | 07/04/07
I only used the latest CERTIFIED SPEC.org results  georgeou | 07/04/07
Anyway, you should mention...  dess3 | 07/04/07
Anyway, you should mention... *NEW*  thetruthhurts | 07/04/07
What "facts"?  dess3 | 07/04/07
the numbers for the AMD are an estimate ....  ShadeTree | 07/05/07
Not made up  dess3 | 07/06/07
Snap  zkiwi | 07/04/07
CERTIFIED..... Really?  Badgered | 07/05/07
While  Badgered | 07/05/07
Much like watching your favorite sports team lose.  nucrash | 07/04/07
Wrong Intel numbers?  dess3 | 07/04/07
Those are the best scores from SPEC.org  georgeou | 07/04/07
Is this really that simple?  dess3 | 07/04/07
AMD will own the HPC market until Intel comes out with Nehalem  georgeou | 07/04/07
AMD user since 98...  Polytopal | 07/05/07
I don't know what  zkiwi | 07/04/07
ZDNET blunder  Hans de Vries | 07/04/07
These are deceptive any way you slice it  georgeou | 07/04/07
WSJ adds with benchmarks where in April.  Hans de Vries | 07/04/07
WSJ adds with benchmarks where in April.  Hans de Vries | 07/04/07
WSJ adds with benchmarks were in April.  Hans de Vries | 07/04/07
They've cherry picked the scores and used outdated scores before  georgeou | 07/04/07
AMD Posts blatantly deceptive benchmarks on Barcelona  thetruthhurts | 07/04/07
It's a journalist task to keep marketing honest.  Hans de Vries | 07/04/07
It's AMD's fault for not having quad-cores. Don't know why you're crying.  georgeou | 07/04/07
You aren't a journalist.  Hans de Vries | 07/04/07
I'll let you end it there with the cheap shot Hans  georgeou | 07/04/07
"Your" graph uses an outdated AMD result.  Hans de Vries | 07/04/07
Again, you're not addressing the 4 core versus 2 issue you cried about  georgeou | 07/04/07
I don't see your 60.4 2222SE result Hans  georgeou | 07/04/07
Latest SPECint_rate2006 results  Hans de Vries | 07/04/07
And you're using outdated score only on AMD's side now  dess3 | 07/04/07
And you're using outdated score only on AMD's side now  thetruthhurts | 07/04/07
That is besides the point  CFKane | 07/04/07
Welcome to Sales 101  jasonp@... | 07/05/07
Blunder? Psst, let me tell you something...  thetruthhurts | 07/04/07
Read, instead...  dess3 | 07/04/07
LOL  thetruthhurts | 07/04/07
Yahoo?  dess3 | 07/04/07
Let me see real CPU vs imaginary CPU  Rndmacts | 07/05/07
Benchmarks are B.S.  meh130@... | 07/04/07
Stop calling them certified  CFKane | 07/04/07
And you're making a habit of omitting the main point of my criticism  CFKane | 07/04/07
The graph disclaimer is from April, that does not mean it was posted in Apr  georgeou | 07/04/07
Finally found your excuse? happy  dess3 | 07/04/07
That's why I asked you politely to check your facts  CFKane | 07/05/07
This should answer your question  georgeou | 07/05/07
Yes, it does  CFKane | 07/05/07
Sure, but now your claiming it was posted in February  CFKane | 07/05/07
and you are missing the point all together.  ShadeTree | 07/05/07
I'm not defending AMD  CFKane | 07/05/07
"Read my Lips"  thetruthhurts | 07/04/07
I don't think people bought into your story George  D. T. Schmitz | 07/04/07
George brings new meaning to "Sensationalism" (nt)  dragosani | 07/05/07
I see the results  thetruthhurts | 07/04/07
Will you correct your article  dess3 | 07/04/07
Sure when you can show us some real 2.6GHz Barcelona numbers happy  thetruthhurts | 07/05/07
Numbers vs. your incorrectness...  dess3 | 07/05/07
Numbers vs. your incorrectness...  thetruthhurts | 07/05/07
These  dess3 | 07/06/07
George Ou posts blatantly deceptively posts on Amd.  Bozzer | 07/05/07
Sorry you don't like the results. Nothing changes.  georgeou | 07/05/07
Nothing?  dess3 | 07/05/07
Actually, this is pretty accurate  thetruthhurts | 07/05/07
Your frustration  dess3 | 07/06/07
No, these numbers are re-making the rounds  georgeou | 07/05/07
There you go  CFKane | 07/05/07
I'm talking about the NDA slides on DailyTech  georgeou | 07/05/07
Read your own story again  CFKane | 07/06/07
George Ou always tell the truth  pa2004 | 07/05/07
C'mon  another_voice | 07/05/07
Why does AMD post benchmarks of non-existent product  pa2004 | 07/05/07
The whole point was to tell about a future product  another_voice | 07/05/07
At it again, George?  bidemytime | 07/05/07
Is -no-prec-div ethical?  cherullo | 07/05/07
compiler flags ethical now?  thetruthhurts | 07/05/07
In benchmarks, sure  cherullo | 07/05/07
AMD makes good chips at a good price  Protector | 07/05/07
Should pay attention  Chad_z | 07/05/07
Remember this is a blog, and not a real article.  el1jones | 07/05/07
RE: Remember this is a blog, and not a real article.  joe6pack_z | 07/05/07
INTEL is noted for this type advertising  JerryLof | 07/05/07
ZDNet Blatantly deceptive reporters...  Narg | 07/05/07
Same can be said of IDG reporters  thetruthhurts | 07/05/07
writer bias  dshcpa | 07/05/07
Aww...  thetruthhurts | 07/05/07
Here's a bad review for Intel and a positive review for AMD  georgeou | 07/05/07
looser  f1x7777 | 07/05/07
Hey you...  thetruthhurts | 07/05/07
The whole article is based on a lot of wrong assumptions, so pointless  dess3 | 07/05/07
sticks and stones may hurt my bones...  thetruthhurts | 07/05/07
Different topic  dess3 | 07/05/07
The launch of K8...  thetruthhurts | 07/05/07
Xeon 5365 is a 130W TDP part  dess3 | 07/06/07
I can't figure it out...  raymondftz | 07/05/07
Blogs are not news reporting  enovikoff | 07/05/07
loose vs. lose  f1x7777 | 07/05/07
LOL you are a moron  thetruthhurts | 07/05/07
George you cheque is in the mail tx Intel  bilboa | 07/05/07
Good reporting George  narsos | 07/05/07
He-he, that's what I live for  georgeou | 07/05/07
way to "out'em" Ou  ttocsmij | 07/05/07
Thank Dog you corrected the story!  D. T. Schmitz | 07/05/07
I'll be happy to read another story  D. T. Schmitz | 07/05/07
George, you have a point, but you miss everyone else's.  Bill F. | 07/06/07
You "EXPECT" deception?  georgeou | 07/06/07
Yes George, I didn't just fall off the turnip truck.  Bill F. | 07/06/07
You just keep selling that apologist Kool-Aid  georgeou | 07/06/07
Keep on spinning  zkiwi | 07/06/07
And here was me thinking  zkiwi | 07/06/07
What about the bugs in the Intel Processors?  eye4bear | 07/08/07
Those bugs don't mean anything  georgeou | 07/08/07
How much?  omt66@... | 07/08/07
Explain to me why AMD was forced to remove those deceptive slides  georgeou | 07/08/07
Debunking George Ou's rabid attack on AMD  TechExec2 | 07/09/07
Same old TechExec2, SIMULATED BENCHMARKS ARE BOGUS.  georgeou | 07/09/07
Same old George Ou, ESTIMATED BENCHMARKS ARE ESTIMATES  TechExec2 | 07/09/07
Same old George Ou, TELLING FALSE STORIES IS LYING  TechExec2 | 07/09/07
Same old George Ou, TELLING FALSE STORIES ABOUT AMD IS LYING  TechExec2 | 07/09/07
The only thing we hear from TechExec2 is...  thetruthhurts | 07/09/07
Well, George,  Jambalaya Breath | 07/15/07
Message has been deleted.  kevencage | 07/19/07

What do you think?

SponsoredWhite Papers, Webcasts, and Downloads

Click Here
advertisement

Recent Entries

Top Rated

    Archives

    ZDNet Blogs

    White Papers, Webcasts, and Downloads

    SmartPlanet

    Click Here