Load-Testing-101-eBook-CTA-1

Performance Testing: The “External Content” Challenge

Content

About a dozen years ago, I had an argument with a client. Actually, that is an understatement. It was an all-out fight that nearly came to blows. For those of you who know me, this may not surprise you overmuch. What is somewhat surprising (or at least disappointing) is what caused the fight. You see, this client wanted me to include “clicking all of the links and loading all the pages” as part of the performance test – and while this might not sound terribly unreasonable on the surface, many of the links he wanted me to click, and pages he wanted me to time the loading of, were outbound links.

In other words, he wanted me to load test the home pages of sites that his company had no control over or relationship to (can you say “Denial of Service Attack?”)

And why did he want me to do this? Because he was absolutely convinced that when a user clicks one of those links, it sends some instruction to his webserver for it to retrieve the page and serve it to the user (while this scenario is possible, trust me, this was not the case).  Therefore, he was convinced that users clicking on those external links—regular old <a href> outbound links, not buttons, not scripts, not even a “user x clicked link y” tracking message being triggered and returned—were going to generate so much overhead on his hardware as to take the site down.

Three weeks, no fewer than six demonstrations, and four “expert consults” from both his developers and the lead architect from the company I was working for later, he finally relented. I don’t think he either understood or believed us, but he relented.

Luckily, I’ve not had this particular problem since, but I’ve had what is essentially the inverse argument regarding third-party ads, tracking scripts, and other inbound content. Of course, these items don’t cause additional load on your servers, but they do have a noticeable impact on the end-user’s real and perceived response time.

Worse, is that this content is notoriously difficult to script and maintain OR remove from the load test. It is even more difficult to set up a test so that only a small percentage of your simulated users load this content, which is what you need to do if you want to time the delta between the responsiveness of what is under your control and what is not under your control.

Of course, the most useful thing to do has historically been the most challenging, which is to execute some tests with the third-party content and some tests without so you can assess their impact. In fact, what that often leads to is the desire to run more tests with specific subsets of the third-party content enabled or disabled. Unfortunately, with most load generators, this process is somewhere between cumbersome and impossible given time and resource constraints.

This is why SmartBear has released what we call the “Host Configurator” with LoadUI Web Pro 2.9. With the Host Configurator, this process amounts to nothing more than identifying the base Host Name of the content you wish to include or exclude for a particular test and check or uncheck the corresponding box for the Host or Hosts you wish to include or exclude from your test.  This amounts to enabling you to run a far greater variety of tests, collect and analyze a greater variety of data, and make far more informed decisions about which or how much third-party content to include in your website or Web app without blowing the schedule.

If you have felt the pain of trying to manage which third-party content to include in your load test like I have, I suggest you give LoadUI Web 2.9 a try.

See Also:

coverage-profiling-technical-article

LoadUIWeb-PRO-Blog-CTA

Comments

  1. Man, just let go, you should explain to him, once, nicely and if he is stupid enough not to listen to reason, then he can find a yes-man to do it for him, good luck with that. This anger and fighting is not worth it..

  2. Isabel Marant Sneakers Isabel Marant Sneakers qdEIK Omega 3.
    Acidi grassi Omega 3 (DHA, EPA e ALA) sono importanti
    per la salute cardiovascolare e le funzioni cerebrali. Isabel Marant Heels Isabel Marant Boots SLGtw In questo caso, prima di pagato dall’intermediario, le
    persone che lavorano per un terzo per pagare l’intermediario.
    In alcuni casi, i subappaltatori lavorano destra Kaboodle Times, circa l’Kaboodle.
    Isabel Marant Boots Isabel Marant Heels NbuAB I sospetti apparso sul
    videotape, Scrubs prigione IFRT South Bay Casa
    di Correzione di Boston davanti a un giudice dell’immigrazione federale negli pstandene mattina aveva
    violato gli studenti visas.Tsarnaev personaggi drlige ogni v seno
    semestri a UMass Dartmouth e il fuoco del debito Più di $ 20.000
    in le fatture in sospeso opplring se l’ingresso stesse persone
    informate Scuola miglio disco che ha chiesto di non essere identificato.

    I funzionari universitari non avrebbero confermare o negare
    i rapporti circa il suo insegnamento lavoro o suoi voti, citando una legge
    federale che vieta il rilascio di istruzione degli studenti ed economica records.John Hoey, rettore per gli affari pubblici
    da UMass Dartmouth, il Kadyrbayev ha detto Phillip e lasciò la Università dopo hstsemesteret.
    Isabel Marant Heels Isabel Marant Sneakers vbhxH
    Come una volta un ex compagno di stanza ha detto: Un sacchetto
    caldo è vestito ancora peggio guardare bene. E
    non cercare di giustificare il lavoro richieste borsa, il costo per uso:
    Balenciaga è di $ 1150, ma se indosso ogni giorno per un anno è di soli
    3,15 dollari al giorno Alla fine pagherà per
    se stessa, pagare, giusto?. Isabel Marant Boots Isabel Marant Sneakers iErua Devo posti dove andare, e mi piace usare i miei
    piedi per arrivarci. Sono d’accordo con Germaine Greer, che una volta ha sottolineato che se una donna che non si toglie le scarpe highheeled, come farà mai sapere fino a che punto potesse camminare o quanto veloce potesse correre?.

    Isabel Marant Boots Isabel Marant Heels cLJkR La maggior parte delle campagne hanno un video e si basano su immagini accattivanti.
    Era in grado di utilizzare i media per mettere in evidenza non solo ciò che di speciale i loro prodotti,
    ma la sua passione e l’entusiasmo pure. Isabel Marant
    Sneakers Isabel Marant Sneakers ZehuV Interno: Ricordate, abbiamo chiamato Saab eccentrico.
    La cabina è tranquillo Exhibit A, con elementi quali prese
    d’aria uovo cassa, misuratori monocromatici bagliore verde e
    tachimetro e gli indicatori del turbo che assomigliano strumentazione di bordo, un cenno
    alla storia dell’aviazione di Saab. Isabel Marant Sneakers Isabel Marant Boots cKHlZ Questo topclass avorio infradito nozze sono sorprendenti, se si desidera aggiungere una certa
    altezza in conformità con la piattaforma
    punto threeinch, restituisce accettato flop, un sostegno supplementare.
    Infradito da sposa sono decorati con pizzo vittoriano e paillettes
    luccicanti.

Speak Your Mind

*