| |
| |
|
|
Software Information |
|
|
|
Making The Decision To Automate Your Software Testing
Not every software testing project can or should be automated. Before your department accepts a new test automation project, you should establish a process by which projects are reviewed and either accepted or rejected. This can be done with a simple Test Automation Acceptance Checklist. Repeatable Test Cases with Static Data The true cost benefit of test automation is achieved only when the same scripts are executed multiple times. The first execution is very expensive because it includes the one-time cost of the automation tools and 100% of the Test Automation engineer's time. When the scripts are executed again, the cost of test automation declines sharply. The tool has already been purchased and the scripts have already been coded. If there have been changes in the application, the scripts may require maintenance before being executed. Maintenance on minor software updates should be minimal. Because test automation is only successful when the scripts can be executed multiple times, only application which require the same test cases to be executed with the same data are good candidates for automation. For example, a mortgage application that needs to be regression tested on a weekly basis could be a good candidate for test automation. Script maintenance is minimal and the scripts can enter a mortgage application using the same group of test data in a fraction of the time it would take a manual tester to test the same functionality. On the other hand, a mortgage origination system, which cannot use the same test data for each iteration would not be a good automation candidate. Due to the nature of mortgage systems, data could be staged in various states of approval or rejection, based on the current data and the departments who have already processed their part of the mortgage application. If the script cannot easily figure out what data to enter in the software, it is not a good automation candidate. Another problem with automating this type of complex system is that the test environment often contains a sampling of production data that is refreshed on a periodic basis. Sometimes this can be overcome by rebuilding the test data when the test environment is refreshed. The feasibility of rebuilding test data on a regular basis depends on the complexity of the application. You will have to make that decision on a case-by-case basis. Application or Environmental Stability Environmental stability is crucial to a successfully automating a software testing project. Scripts cannot be coded in a timely manner if the application environment is unavailable, experiences frequent down-times, or excessive defects and errors. Little or No Application or Environment Downtime It takes longer to write scripts than it does to manually test the same functionality. Most automation tools are watered down version of C or Visual Basic, which means that writing automated scripts is essentially programming and takes adequate time and specialized skills. Unlike manual test cases, which can sometimes be written based off requirements and mock-ups, automated tools require the actual application. When a test environment is unavailable, automation engineers cannot create scripts, which prolongs the project and ends up costing more. Excessive downtime can consist of any of the following: Unstable Environment Effects of Environment Instability on Script Development and Execution When an application or environment is unstable, scripting progress is dramatically slowed or stopped altogether. In some cases, it's possible to continue scripting, but this may causes more work at a later date. For example, if you are scripting in buggy code, you may have to script around error messages and the scripts will have to be revised at a later date. Or, you may only be able to create scripts to a certain point and finish them at a later date. To help avoid and decrease environment instability, read the chapter on Service Level Agreements. Timely Defect Fixes Application defects do not have to be detrimental to an automated software testing project. When defects are fixed in a timely manner, scripting can continue without significant downtime. When estimating an automated testing project, it's always best to add some buffer time that will accommodate for defect reporting and revisions. When defect fixes take an excessive amount of time to resolve and are causing the automated software testing project to be delayed, it's time to pull together a meeting. Invite all the major players and discuss the root of the problem and what everyone can to improve the situation. Maybe development is spending too much time trying to reproduce the problem and having your automation team enter better description would help them turn the defect fixes around faster. Maybe you can work together to classify defects and establish reasonable fix times for each classification. For example, a Critical defect needs to be fixed that day while a High defect needs to be fixed with in 24 hours. Responsive Contact Person When your team takes on a new automated testing project, you will need a contact person. This person is responsible for making sure you have the business requirements and answering questions about how the application works. This will not be his or her main job, so you will need to make sure he or she is responsive. If you cannot get adequate business requirements, test data, or questions answered, your automation project will not be successful. Copyright 2004. Danna Henderson. All Rights Reserved. Danna Henderson has helped many organizations automate their software testing with WinRunner. For information on creating robust, data driven scripts, and successful automated testing, visit WinRunner Experts.
MORE RESOURCES:
Software - Google News |
|
|
|
RELATED ARTICLES
Tools for Customizing Great Plains Microsoft Business Solutions - Great Plains has captured the US market with its integrated business applications for small and mid-size organizations. Its comprehensive accounting and business management capabilities provide businesses with tools to customize various modules of the Great Plains software. What To Do When Windows Wont Boot When Windows fails to boot it is normally caused by you installing a program or device and it has caused a conflict with one or more other programs.This will no doubt give you plenty of heartaches if you're not certain which program caused Windows to not boot up. Software Upgrades Arent Always the Best Move When my daughter was getting into AOL instant messaging (AIM) and using all the cool add-ons, I looked for more as it's a great way to learn about extending applications. While doing research, I learned that if you wanted to use AIM themes, you don't want to upgrade to AIM 5. The Importance of Timely Timesheets Whether you are a small consultancy firm, a medium sized accountancy practice, or a code warrior for hire in a back room of your house then you have at least one thing in common: you are in business to get paid quickly, and for the work you have done. Timesheets are the usual method for tracking time you spent working and thus are the key to timely invoice generation. How To Choose A Fire Wall Software Program In the real world a "fire wall" is a fireproof wall that is built to stop the spread of fire from one part of a building to others. In the Internet world a firewall has a similar purpose in that it stops the spread of harmful viruses and attacks from entering your home or office network. Introduction To ISDN, Part III: PAP Introduction To ISDN, Part III: Configuring PPP PAP AuthenticationNow we know how the ISDN link comes up (interesting traffic), and some scenarios that might cause the link to stay up, we need to look at ISDN authentication schemes. The two methods Cisco certification candidates must be familiar with are PAP and CHAP. Linux - Keyboard Or Mouse Just stress testing one of the latest Linux distributions. Been testing it for about two months. MSN Messenger Is A Sweet Way To Communicate MSN messenger is a pretty cool invention. I mean I'm not really into serious discussions on the email, answers to questions can often take a few days to arrive because people are so busy these days. 10 Ways to Learn a Software Following tips help you to learn a software in lesser time and in an efficient manner:1. After installing a software package, look for any README file in the installed folder. Groove Network. Are you in it? If you are in a business that passes documents around to be reviewed and edited over and over before they are ready to be posted for advertising or for a client, then you have probably already heard of a software solution to help keep your "floating" documents organized from Groove Network. You may not be aware that there is another option out there. .Net Charts and Graphs Interact with Businesses and Customers Bar charts, bar graphs, and any other chart or graph used in financial statements, inventory reports, sales reports, and a slew of other types of reports have typically been paper reports or online reports depicting various levels of complex information for tracking, investing, planning, and buying. However, until the . Theres Gold in Your Websites Server Log Many Webmasters have never bothered to view their website's server log. Ignoring your server log is like flying with a blind pilot. Microsoft CRM and No-Frills Cadillacs In today's business world it's all but impossible to escape Microsoft. Either you're using MS applications, developing your own, or negotiating your company's acquisition by this techno-behemoth. Groupware: Avoid the Ad Hoc Shuffle GroupwareEfforts are continually made to manage the unavoidable ad hoc business process, but ad hoc processes do not necessarily mean a pile of messy, shuffled documents, at least not anymore. Groupware is software which tracks and manages the ad hoc business collaboration. Intro to UNIX Shells A UNIX Shell is in simplest terms, a command line interpreter, that takes the users input and gives it to the Kernel. If you are familiar with DOS, you will remember the 'command. C++ Function Templates C++ Function templates are those functions which can handle different data types without separate code for each of them. For a similar operation on several kinds of data types, a programmer need not write different versions by overloading a function. Microsoft Great Plains Furniture & Fixtures - Implementation & Customization Highlights Microsoft Great Plains, former Great Plains Software Dynamics / eEnterprise was introduced in 1993 as first Microsoft Windows and Macintosh based graphical accounting/ERP application for Mid-Size businesses. Considering the history of furniture retailer and custom assembly lines - they showed up on the market about five decades ago and they have automated their business operations with Unix-based businesses in the late 1960th and earlier 1970th. What is Fleet Maintenance Software? Simply put, fleet maintenance allows companies to monitor and maintain their fleets of commercial vehicles more efficiently.Fleet maintenance requires a great deal of organization and management skills. Linux Dual Boot-How To Format Just the thought of a duel-boot scares many people away, but over the years it's developed into an easier process. Most people are running Windows, so I'm assuming it's your choice of preference:1. Microsoft Great Plains Customization: Project Organization - International Business Example Microsoft Business Solutions Great Plains fits to majority of horizontal niches and clientele in the USA, Canada, Mexico, Latin America, U.K.
|
| home | site map |
| © 2006 |
