Critical thinking is not enough for a tester
Alternative topic: Specification Review tips
I was recently analyzing how I do specification review. I discovered that Edvard De Bono is completely right that Critical Thinking is Excellent but it is not enough. I believe Iâ€™m using what he calls lateral thinking to obtain more ideas, but I need to study it in more details yet. I donâ€™t use the techniques he describes, but have developed my own. I will describe those techniques in details, but I want to note that at least two are somewhat bound to my background: poetry (developed metaphor skills) math (modelling) was my primary hobbies at high school and university. So those techniques may or may not be effective reused by you.
The metaphor technique
- What hybrid would it make if we cross (crossbreed) a snake and a hedgehog?
- Barbed wire!
So project manager comes to me and say we are creating an application named X and you will have to test it. Iâ€™m not sure what he means by X, but certainly means something. Suppose I donâ€™t know what â€œBarbed wireâ€ but PM knows and I ask him is it like cross of a snake and a hedgehog. He would laugh and say â€“ well generally yes. I have chosen this metaphor on a purpose â€“ it combines live creatures and human made item. I may try to imagine the new product as combination of existing or as metaphor from real world.
- â€œWe are creating source control systemâ€, it will support multiple users working in parallel with shared data
- Is it self-organizing like people swimming in the same pool, or managed like hotel rooms with reception giving keys to one person at a time?
- Well itâ€™s something in between â€¦
â€¦ discussion goes on where I better understand the idea of the system. And whenever there is any mismatch bet system specification and metaphor I ask why? If there is an attribute that is logical for metaphor that the system does not possess or there is a feature of a system that does no match with metaphor. It gives ideas, not always right. If I want to jump in a pool I should take a look at whatâ€™s going on there and forecast the next few seconds. Why donâ€™t we have â€œtemporal lockâ€ feature in source control system that assures lock will be removed very soon so you may simply wait a few seconds and repeatâ€¦.
the What Does It Mean technique
In my context in most cases everything begins with reading specs â€“ in whatever form, but there are something written or described in plural by someone. The metaphor technique is usable here as well, but I want to discuss another one. I will use them both together to make sure specs itself do not talk in metaphors.
Sometimes author uses verb or adverb as a metaphor without even realizing it. For example â€œyou canâ€™t rename file if another person use itâ€. How does a person use a file? File is a computer term, an object with well defined operations: copy, move, rename, open, close, etc. There is no operation use. Author most probably means any (or some) of the operations in progress, or any transactional operation started but not finished (like opened but not yet closed). This is where the biggest issue of specs comes from â€“ ambiguity. This is bad if author and developer are different persons, but even if it is the same personâ€¦ the person may be blinded by simplicity of the metaphor and miss to think of complexity of underlying technical aspects. And miss that one of the operation (move) are somewhat different from others because upon itâ€™s completion the file will no longer be there, not only itâ€™s content be updated.
Model provocation technique
Iâ€™ve stolen the name provocation from Edvard De Bono. I never considered it to be a provocation until seen his ideas. My idea was simple â€“ to draw a model with all the expected relations and think of any unexpected ones. Just draw a line between any two objects and ask what does this line could mean? Iâ€™m not going to tell you deails â€“ you could try to realize yourself how this would help to prevent the tragic bug addressed by Cem Kaner in his training materials about impossibility of complete testing.
Or well, OK I know in source control system there are folders with files. Files have versions. What is the relation between file version and folder? None? How about attaching a file into folder that already has such file? Shouldnâ€™t this be treated as adding a new version of a file?
More tips on applying techniques
I do typically put my red hat on. Note that this contrast with black hat â€“ the typically expected for critical thinking.
Whenever I FEEL that author is uncertain about what he say or write, I ask what does it mean. Whenever I FEEL this does not makes sense or are over-complicated stop to analyze it deeper (and search for metaphor). I may need a time to find it so I may ask to come back to it later if itâ€™s a conversation. When I create a model and there are too much items (30 of them) analyzing all pairs means 30*29/2=435. Itâ€™s a ay too much. So I try to draw only the lines I FEEL to be of my interest. More over sometimes I want to analyze 3 or more object complex interaction.