Now that we are about to be ready to test OFN v2 in staging we need a strategy to do it.
First the scope, we separated the full scope in 2 and we have “spree upgrade phase 2”.
So, there are 3 points in time to consider:
1 - now (almost green build)
2 - green build phase 1
3 - phase 2 dev ready
We could wait until the end to start testing, I dont think that is the best approach. Early feedback from testers will be very very valuable! So I recommend the following approach:
At point 1 in time, NOW, I think a couple of hours of testing time on v2 will be very very useful to get a general sense of how the system is behaving. There are know issues, the only significant one is that the orders admin page is not working yet (we could wait for this page to be working to start testing).
At point 2, phase 1 green build, we will need an extensive validation of the system by testers. This will allow us to fix any issues in the core part of the system without having to wait for phase 2.
At point 3, phase 2 green build, we should validate not only the non-core features now working but also the core of the system with the new changes (not many surprises are expected here but I think it needs to be done, it’s a major release afterall).
An integral part of the test strategy is the definition of what tests to execute @sstead has started a doc for this. Maybe you guys can use this thread as well to discuss the test documentation/procedures for v2. or maybe create a new thread…