On MovieTome: Highest Metascore Streaming Movies
BNET Business Network:
BNET
TechRepublic
ZDNet

March 1st, 2009

Five things every Windows beta tester should know

Posted by Ed Bott @ 3:22 pm

Categories: Windows 7

Tags: Microsoft Windows 7, Feedback, Microsoft Corp., Beta Tester, Windows SuperSite, Microsoft Windows, Operating Systems, Software, Ed Bott

Last week my colleague Mary Jo Foley reported on rumblings of discontent from the invitation-only Windows 7 technical beta test community:

A number of Windows 7 testers have complained recently that Microsoft was not sharing enough information about changes it planned to make in response to their feedback.

Windows SuperSite’s Paul Thurrott questioned in a post yesterday whether Microsoft had already locked down Windows 7’s feature set before the majority of technical and public beta testers ever got to see a first release of the product. I’ve wondered the same.

This was all in response to another epic post on the Engineering Windows 7 blog by Steven Sinofsky, who tried to explain how the feedback process worked. The whole thing is worth reading, although at 4700+ words I’m afraid most people will just skim it.

Frankly, I’m having a hard time working up any level of sympathy for those doing the complaining, partly because I heartily approve of the way Windows 7 development is going right now and partly because I have seen the feedback process up close and personal. Microsoft is getting a bad rap from a group of people who are mourning the reality that they’re no longer being treated as privileged elites.

I was going to ignore this whole brouhaha, until I read a post on the subject by WinPatrol developer and Microsoft MVP Bill Pytlovany that included this provocative proposition:

Most Beta Testers Suck

As a developer I can tell you , beta tests aren’t what they used to be.  The number of people who actually report decent bug information is minimal. Most people download the beta just to be an earlier adopter. Developers are lucky if users read the release notes and compatibility list let alone any beta instructions. There are so many different machine configurations that sadly the only way to find some bugs is to have full global adoption of new software.

Bill isn’t going to endear himself to any beta testers with that line of argument, but he does have a point. I’ve read many of the complaints Mary Jo referred to and a few hundred others on the members-only Windows 7 technical beta newsgroups. I think a lot of beta testers need a refresher course in the basics of what it means to be involved in the development of a product as complex as Windows.

In that spirit, here’s my list of five things every Windows 7 beta tester should know:

Continued on next page –>

Pages: 1 2

Ed BottEd Bott is an award-winning technology writer with more than two decades' experience writing for mainstream media outlets and online publications. See his full profile and disclosure of his industry affiliations.

Email Ed Bott

Subscribe to Ed Bott's Microsoft Report via Email alerts or RSS.

  • Talkback
  • Most Recent of 92 Talkback(s)
Dynamic Disks
I don't carry any great opinion one way or the other about dynamic disks. It was just surprising that the Win7 install wouldn't even see the hard drive until I had deleted the partition with an XP CD... (Read the rest)
Posted by: Harris-E Posted on: 04/02/09 You are currently: a Guest | | Terms of Use
Great Write-up....  Gnutella | 03/01/09
Number 2 of your 5  chrome_slinky@... | 03/01/09
Never seen that one  Ed BottZDNet Moderator | 03/01/09
IE Crashes  larrybeay@... | 03/04/09
Huh  nizuse | 03/01/09
There you are.  sjbinaz | 03/02/09
resend link  nizuse | 03/02/09
Not in Email  sjbinaz | 03/02/09
Thanks  nizuse | 03/02/09
keep in touch  sjbinaz | 03/04/09
aaah no success  nizuse | 03/07/09
And a 6th...  Kip Kniskern | 03/01/09
Windows 95: what a disaster  rseiler | 03/01/09
No, I meant Windows 95  Ed BottZDNet Moderator | 03/01/09
Windows ME  Too Old For IT | 03/02/09
Windows 95; immediate victory with a short term failure.  Cayble | 03/01/09
I don't think that's what he meant  mark16_15@... | 03/02/09
Isn't Win7 an SP for Vista?  sykandtyed | 03/02/09
RE: Five things every Windows beta tester should know  Wolfie2K3 | 03/02/09
That makes me shake my head, too.  sjbinaz | 03/02/09
Vista is the new New Coke  zenotek | 03/02/09
Re: Vista is the new New Coke  notsofast | 03/03/09
Most people hate change  donniebnyc@... | 03/03/09
Most people can adapt if given the chance  Northlite | 03/04/09
Bad Beta Babies  DarienHawk67 | 03/02/09
Bad Beta Babies  Giba1 | 03/06/09
RE: Five things every Windows beta tester should know  EricVM | 03/02/09
Alfa and beta testing  pjotr123 | 03/02/09
RE: ...testing  n0neXn0ne | 03/02/09
it's "Alpha", not "alfa".  rtk | 03/02/09
Be nice  Ed BottZDNet Moderator | 03/02/09
Thanks  pjotr123 | 03/02/09
RE: Alpha and Beta testing...  Narg | 03/02/09
apologies to both of you  rtk | 03/02/09
@pjotr123 - it's a matter of scale  de-void | 03/02/09
Too much alpha not enough beta  artfudd | 03/02/09
Good Advice - Now Drop It  jpr75_z | 03/02/09
More of that is on the way  Ed BottZDNet Moderator | 03/02/09
VHD Boot  Joe_Raby | 03/02/09
Unfortunately you need extremists  Michael Kelly | 03/02/09
Nothing wrong with passion  Ed BottZDNet Moderator | 03/02/09
Your logic is flawed.  TheWerewolf | 03/02/09
No.. the logic is not flawed  artfudd | 03/02/09
Maybe MS has a reason to exclude  Drakaran | 03/03/09
YOUR logic is flawed.  AzuMao | 03/02/09
RE: Five things every Windows beta tester should know  ecr@... | 03/02/09
Hmmmmm.....  MGP2 | 03/02/09
Obsession with figures...  SimonUK | 03/02/09
Maccas may not have the best burgeres  Aussie_Troll | 03/02/09
Market share of what ?  Alan Smithie | 03/02/09
Wrong.  AzuMao | 03/02/09
iPhone Devs can at least relax wink  smilajkov | 03/02/09
Windows 7 Beta Testing feedback - Real Estate  ty_pippen@... | 03/02/09
"The Taskbar now takes up twice the room of the Vista Taskbar"  PollyProteus | 03/03/09
RE: Five things every Windows beta tester should know  skatterbrainz | 03/02/09
Number 3 is too thankless  orcmid | 03/02/09
Ahhh, fear not young Jedi ...  de-void | 03/02/09
Too many geek wanna-be's...  Narg | 03/02/09
RE: Five things every Windows beta tester should know  stdo57@... | 03/02/09
but where did winmail go?  PollyProteus | 03/03/09
RE: Five things every Windows beta tester should know  artfudd | 03/02/09
RE: Five things every Windows beta tester should know  johnedwardhall | 03/02/09
Why do you need help submitting feedback?  de-void | 03/05/09
RE: Five things every Windows beta tester should know  g-ssg | 03/02/09
there's beta testing, and beta testing...  Mitch 74 | 03/02/09
You are right !!!  mark16_15@... | 03/02/09
Agree with Ed and Sinofsky. Opposition is good when it leads to solutions.  Solid Jedi Knight | 03/02/09
RE: Five things every Windows beta tester should know  cjc82s | 03/02/09
RE: Five things every Windows beta tester should know  nelson.robert@... | 03/02/09
Life from the tester's perspective  tgilbert@... | 03/02/09
Bill's wealthy let him test his own software  BALTHOR | 03/02/09
RE: Five things every Windows beta tester should know  cdoss3 | 03/02/09
Agree with this post but I think we are testing Vista R2, not a real new OS  olberton@... | 03/02/09
RE: Five things every Windows beta tester should know  greywolf1785 | 03/02/09
Take a wider perspective...  Jeremy W | 03/02/09
Always with the vista  Aussie_Troll | 03/02/09
Win7 UI sux  nospam@... | 03/02/09
RE: Win7 UI sux  rkinne01 | 03/03/09
Win7 GUI is fine...  magius | 03/06/09
Personal opinion.  CobraA1 | 03/10/09
Feature Testing  Drakaran | 03/03/09
Actually, they do both those things  Ed BottZDNet Moderator | 03/03/09
RE: Five things every Windows beta tester should know  eye4bear | 03/03/09
The 6-month rule:  jack@... | 03/03/09
Beta tester equals screwed for free...  mikifinaz1@... | 03/03/09
Re; Windows 7  Aaron A Baker | 03/05/09
RE: Five things every Windows beta tester should know  morwen | 03/10/09
Bug Reporting in Win 7 Beta  ty_pippen@... | 03/24/09
Not if you're a tech beta tester  Ed BottZDNet Moderator | 03/24/09
Dynamic Disks and Win7  Harris-E | 04/02/09
Dynamic disks? Need aspirin...  Ed BottZDNet Moderator | 04/02/09
Dynamic Disks  Harris-E | 04/02/09

What do you think?

SponsoredWhite Papers, Webcasts, and Downloads

Click Here
advertisement

Recent Entries

advertisement

Archives

ZDNet Blogs

White Papers, Webcasts, and Downloads

  • Smart Tech Expert advice on innovations in healthcare and the green technologies that make it happen. Find out more
  • Smart Business Discussion and advice on management issues that revolve around making your world smarter and more useful. More Smart Advice
  • Smart People The best and worst moves in the management and strategy trenches. Learn More