TPI® NEXT - Contents
Part 1 Introduction 21
1 The next step in test process improvement 23
2 Positioning testing and TPI NEXT 27
2.1 The scope and value of testing 28
2.1.1 Testing and other quality measures 28
2.1.2 Product risks 29
2.1.3 Test levels within the Software Development Life Cycle 30
2.2 The scope and value of test process improvement 31
2.2.1 Test process improvement enables you to align your test investment with business drivers 32
2.2.2 There are advantages to structuring the test process 33
2.2.3 Test process improvement integrates closely with software process improvement 34
2.3 A reference model is needed to support test process improvement 35
2.3.1 The model has specific properties to ensure its quality and relevance 36
2.3.2 The Business Driven TPI model is an improvement of the original TPI model 37
Part 2 The Business Driven TPI model 39
3 The model 41
3.1 The Business Driven TPI model provides insight into the quality of the test process 41
3.2 Key areas break down the test process into different aspects 43
3.3 Maturity levels provide a scale from Initial through to Optimizing 47
3.4 Checkpoints measure the maturity of each Key area in an objective way 49
3.5 The Test maturity matrix provides a visual overview 50
3.6 For a specific test process the current situation is drawn in the Test maturity matrix 51
3.7 Clusters of Checkpoints make Business Driven TPI a continuous model 52
3.8 The current and target situation are drawn in the Test maturity matrix 53
3.9 Improvement suggestions indicate how Checkpoints can be met 54
3.10 Enablers relate the test process to other SDLC processes 55
4 Key areas 57
4.1 Stakeholder commitment 58
4.2 Degree of involvement 63
4.3 Test strategy 67
4.4 Test organization 72
4.5 Communication 78
4.6 Reporting 83
4.7 Test process management 87
4.8 Estimating and planning 92
4.9 Metrics 96
4.10 Defect management 103
4.11 Testware management 108
4.12 Methodology practice 113
4.13 Tester professionalism 117
4.14 Test case design 121
4.15 Test tools 127
4.16 Test environment 132
Part 3 Improving Test Process Maturity 137
5 BDTPI follows the steps of a generic change process 139
5.1 (Generate) awareness 140
5.2 Determine goal, scope and approach 141
5.2.1 Setting the goals 141
5.2.2 Determining the scope 142
5.2.3 Define the approach 144
5.3 Assess current situation 145
5.3.1 Gathering information 146
5.3.2 Analyzing the information 148
5.3.3 Describe the strengths, weaknesses, opportunities and threats 150
5.4 Define improvements 151
5.5 Make a plan of action 153
5.6 Implement actions 155
5.7 Evaluate and redirect 155
Part 4 Business Driven Improvement 157
6 Business Driven Test Process Improvement 159
6.1 BDTPI aims at a specific result 159
6.2 The BDTPI model used in a business driven manner 160
6.3 Business drivers affect the use of the model 163
6.3.1 BDTPI used to make sure that IT services are reliable and secure 164
6.3.2 BDTPI used to support Effective automated solutions 166
6.3.3 BDTPI used to Shorten the Time to market 168
6.3.4 BDTPI used to Improve cost efficiency of IT 172
6.3.5 BDTPI used to Improve transparency and understanding of IT 176
6.4 Cost and Benefit of Test Process Improvement 180
6.4.1 Introduction 180
6.4.2 Value for money 180
6.4.3 Cost 181
6.4.4 Benefits 182
7 The BDTPI Model can be used in any situation 187
7.1 BDTPI can be used in iterative development methods 187
7.1.1 Iterative development and testing 188
7.1.2 Iterative development and test process improvement 189
7.2 BDTPI can be used in agile development methods 191
7.2.1 Agile development and testing 191
7.2.2 Agile development and test process improvement 193
7.3 BDTPI can help with multiple test processes 201
7.3.1 Multiple test processes and testing 201
7.3.2 Multiple test processes and test process improvement 201
7.4 BDTPI can be used to set up the test process from scratch 203
7.4.1 Testing from scratch 203
7.4.2 Test process improvement from scratch 204
7.5 BDTPI can be used in software maintenance 205
7.5.1 Functional maintenance and testing 205
7.5.2 Functional maintenance and test process improvement 206
7.6 BDTPI can be used within software process improvement 207
7.6.1 SPI and testing 208
7.6.2 SPI and test process improvement 211
7.6.3 Maximizing ROI when combining Business Driven TPI and CMMI 214
7.7 BDTPI can be used with outsourcing and offshoring 217
7.7.1 Outsourcing and testing 218
7.7.2 Outsourcing and test process improvement 218
7.8 BDTPI can be used with managed test services 220
7.8.1 Managed test service 220
7.8.2 Managed test services and test process improvement 221
7.9 BDTPI can be used in development testing 223
7.9.1 Development testing 224
7.9.2 Development testing and test process improvement 226
7.10 BDTPI can be used for evaluation 227
7.10.1 Evaluation and static testing 227
7.10.2 Evaluation and test process improvement 229
7.11 BDTPI can be used for integration 230
7.11.1 Integration and testing 232
7.11.2 Integration and test process improvement 233
8 The BDTPI Model has proven its value in practice 235
8.1 Generate awareness 235
8.2 Determine goals, scope and approach 235
8.3 Assess the current situation 237
8.3.1 Interviews and document study provide the information needed about the test process 237
8.3.2 The results are shown in the Test maturity matrix 240
8.4 Define improvements 243
8.5 Make a plan of action 244
8.6 Implement actions 246
8.7 Evaluate and redirect 247
Appendices 249
Appendix A: Maturity of the use of test tools 251
A.1 Maturity in the use of test tools 251
A.1.1 Tool-specific maturity stages 251
A.1.2 Application of the tool-specific maturity stages 252
A.1.3 Types of tools 253
A.2 Test management tools 253
A.2.1 Test management tools at a tool-focused maturity stage 255
A.2.2 Test management tools at a process-focused maturity stage 255
A.2.3 Test management tools at a goal-focused maturity stage 255
A.3 Automated test execution tools 256
A.3.1 Automated test execution tools at a tool-focused maturity stage 257
A.3.2 Automated test execution tools at a process-focused maturity stage 257
A.3.3 Automated test execution tools at a goal-focused maturity stage 258
A.4 Performance test tools 258
A.4.1 Performance test tools at a tool-focused maturity stage 259
A.4.2 Performance test tools at a process-focused maturity stage 259
A.4.3 Performance test tools at a goal-focused maturity stage 260
Appendix B: Creating new Clusters 261
B.1 Introduction 261
B.2 Cost reduction as an example 261
B.3 Re-clustering 262
B.3.1 Categorized Key areas 263
B.3.2 Shift Checkpoints to new Clusters. 263
B.3.3 Taking dependencies into account 264
B.3.4 Balancing the Clusters 266
Appendix C: Backwards compatibility 269
C.1 Introduction 269
C.2 Transform assessment information to the BDTPI model 269
C.3 Transform the original TPI matrix into the Business Driven TPI matrix 269
C.3.1 Groups of Key areas 269
C.3.2 Two examples of TPI maturity 270
C.3.3 Working with the conversion table 272
C.3.4 After conversion 273
Glossary 275
Bibliography 287
About Sogeti 289
Index 291