Crowdsourced testing

For the software testing company, see Crowdsourced Testing (Company).

Crowdsourced testing is an emerging trend in software testing which exploits the benefits, effectiveness, and efficiency of crowdsourcing and the cloud platform. It differs from traditional testing methods in that the testing is carried out by a number of different testers from different places, and not by hired consultants and professionals. The software is put to test under diverse realistic platforms which makes it more reliable, cost-effective, fast, and bug-free. In addition, crowdsource testing allows for remote usability testing because specific target groups can be recruited through the crowd.

This method of testing is considered when the software is more user-centric: i.e., software whose success is determined by its user feedback and which has a diverse user space. It is frequently implemented with gaming, mobile applications, when experts who may be difficult to find in one place are required for specific testing, or when the company lacks the resources or time to carry out the testing internally.

System

Crowdsource testing companies provide the platform for the testing cycles, generally free of charge to the companies whose products are being tested. They then crowdsource the product to a community of testers, who register for testing the software voluntarily. These testers are generally paid per bug, depending upon the type of bug and its market price. The crowdsource testing team is usually in addition to the in-house quality assurance team, not a replacement. Depending on the task, some platforms offer access to their crowd through a self-service model, a managed service by the provider, or both.[1]

Advantages of crowdsource testing

There are several advantages to crowdsource testing:

Disadvantages of crowdsource testing

There are several disadvantages to crowdsource testing:[2]

Crowdsource testing vs. outsource testing

The main difference between crowdsource testing and software testing outsourcing is that, in crowdsource testing, testers may belong to different workplaces. When outsourcing testing, the testers are from the same company or workplace that is responsible for outsourcing. In crowdsource testing, people voluntarily test software with the possibility of not being paid (if no bugs are discovered). Outsource testers always get paid for their work.

While for some projects it may be possible to get away with only using one approach or the other, a more thorough approach would use a holistic software testing method,[3] which uses both a dedicated testing team in addition to the crowd. Crowdsource testing is best for things like beta and compatibility testing, which are necessary final steps for testing; however, most software is far too complex for late-stage testing like this to cover all of the possible issues. A dedicated outsourced or in-house testing team will give a better idea of the software's possible defects, but will not give anywhere near the scope of crowdtesting. Therefore, a good solution is to integrate multiple test teams into any development project (and also to develop with the principles of testability[4] in mind from the very beginning.)

Crowdsourcing alone may not give the best feedback on applications. A diverse testing approach that pools both crowdsource testing and a dedicated testing team may be favorable. "Having this diversity of staffing allows you to scale your resources up and down in a fluid manner, meeting tight deadlines during peak periods of development and testing, while controlling costs during slow periods."[5]

References

This article is issued from Wikipedia - version of the Sunday, May 01, 2016. The text is available under the Creative Commons Attribution/Share Alike but additional terms may apply for the media files.