ISO 29119 Debate – A Historical Perspective Part 1

Standardization has been a source of considerable tension between individual, corporate and governing entities since the dawn of industry. The imposition of commercial and industrial standards first started to take off during the Industrial Revolution. In one of the earliest instances of organic, industry-driven adoption of standards, Henry Maudslay’s invention of a screw-cutting machine that could measure to 1/1000th of an inch spread throughout factories across England, which was a factor in fueling that country’s rapid industrial growth in the 19th century.  Similarly, the success of one particular railroad  in the United Kingdom led to the adoption of the Standard Gauge, which eventually won out against the design of other, rival companies. As the 20th century progressed, standards became critical to the development of modern society – from the distribution of electricity, to automobile design standards to the measurement of time.

Railway track

Yes, these are standardized

In more recent times, the standardization wars have eventually been either settled by market consensus (see the VHS vs. Betamax and Blu-ray vs. HD-DVD format wars) or by a governing body choosing to enforce a norm when it deems it to be economically or socially beneficial, as illustrated by the recent push by the EU to standardize phone chargers. At its most basic level, the goal of government or industry-imposed standards is to coordinate to maximize the well being of the industry as a whole by promoting connectivity and reducing redundancy, while simultaneously communicating to end users or consumers that a certain good will work as expected.

Wait…what does all of this have to do with Testing. you ask? The ISO is preparing to complete the final draft of ISO 29119, which seeks to create an “internationally agreed upon standard for software testing that can be used within any software development lifecycle or organization.” At CAST 2014, James Christie offered an impassioned critique of ISO 29119, suggesting that the purpose of these standards was less about certifying a basic level of quality than an exercise in rent-seeking behavior on the part of large testing companies looking to become gatekeepers of “quality,” charging fees for certification and associated learning materials. This, according to Christie and others, would create a norm where companies seek testers with the aforementioned certification, forcing testers and companies to either comply with or ignore the standards, and bear the associated risks of each. He and others support this reasoning by citing the lack of buy-in from many segments within the Testing community, the high barriers for participating in the working groups (located in far-flung locations around the world) and the high cost of downloading copies of the existing portions. Those in support, such as Stuart Reid, take a different tack, citing demand for existing standards, a common, internationally-accepted set of terms and definitions used and a way to communicate to buyers that “good testing practice” was followed.

In the proceeding days and weeks, momentum spread from the conference floor to twitter and resulted in a a petition – which now has over 1000 signatories – opposing the adoption of the standards:

How, then, can one draw a line between the benefits of standardization against the potential dangers outlined by James Christie and others? One way to look at it is that the distinction is that the benefits and drawbacks of design standards for goods are distinct from processes. Design standards for goods tend to be much easier to specify and justify standards than it is for processes. Michael Bolton outlined this distinction in a blog post detailing his opposition to the standard, saying it is “ultimately desirable to describe and standardize widgets – tangible, physical things that have quantifiably measurable attributes…” That isn’t to say that these standards don’t have trade-offs, as designs must be made within the constraints of the standard, but these trade-offs can be much more easily estimated.

In part 2, we will explore the history of process and safety standards from other industries, the details of ISO 29119 and see if we can draw any lessons from the past.

RedditFacebookTwitterGoogle+Hacker NewsLinkedInEmailPinterestShare


  1. Ok, and SmartBear Is not Seeking rent by siding with whom they believe are prominent figures in software testing?

    Let’s be realistic; what is going on with this “debate” on 29119 is the same thing that has always been happening between all the automation tool vendors. SmartBear, Froglogic, TestPlant, etc. everyone is fighting to be the defacto. The problem with this is that it is us,the folks in test, that wind up losing in the end. Because we are the implementors.

  2. Freddie – there’s a difference between competing ideas slugging it out in the commercial and intellectual marketplace, and seeking to rig the market via rent seeking & regulatory capture. ISST & the Context Driven School want to compete on the merits of their ideas. ISO wants to suppress competition.

    • Freddy Vega says:

      James, the end result is the same. There’s a fight going on for control. Who represents all of us other testers that do not subscribe to any “school”? You know the ones that are truly context based and take _all_ viewpoints into consideration.

      Just like the ISO 29119 will not help me, neither will the Context Driven School help me. Both of these organizations are just trying to help themselves and advance their own agenda.

      Lets say that, hypothetically, that the stop petition is successful. I (meaning me) will continue to do my work just like I have always done. Now lets say that, hypothetically, the ISO standard is accepted. I will still continue to do my work just like I always have. You see, it doesn’t affect me. Why? Because testing is testing – no matter how you dress it.

      Do you somehow envision in a world where 29119 is a reality, testers sitting there with the standard by their side following it line by line as they test widget A? Do you envision the standard actually grabbing hold of the testers mind and controlling it? I can assure you this wont happen to testers. This is why we have a brain. What I’m I missing here?

      The more I do research on this debate the more I believe that this is more of a playground fight between two “schools”. And like in any fight bystanders (in this case us testers) will be the only ones hurt at the end of the fight. And this saddens me.


      Freddy Vega

  3. Which would your customers prefer: ISO 29119 compliance, or being supplied and supported by a bunch of software cowboys?

  4. Griffin Jones says:

    @Peat – Please, that is a false choice.

Speak Your Mind