So, there are 3 points in time to consider:
1 - now (almost green build)
2 - green build phase 1
3 - phase 2 dev ready
We could wait until the end to start testing, I dont think that is the best approach. Early feedback from testers will be very very valuable! So I recommend the following approach:
At point 1 in time, NOW, I think a couple of hours of testing time on v2 will be very very useful to get a general sense of how the system is behaving. There are know issues, the only significant one is that the orders admin page is not working yet (we could wait for this page to be working to start testing).
At point 2, phase 1 green build, we will need an extensive validation of the system by testers. This will allow us to fix any issues in the core part of the system without having to wait for phase 2.
At point 3, phase 2 green build, we should validate not only the non-core features now working but also the core of the system with the new changes (not many surprises are expected here but I think it needs to be done, it’s a major release afterall).
An integral part of the test strategy is the definition of what tests to execute @sstead has started a doc for this. Maybe you guys can use this thread as well to discuss the test documentation/procedures for v2. or maybe create a new thread…
@luisramos0 one clarification question: how to separate the “core” from the “non-core” ? Where is the line ? Did you make a list of the core features so we know what we can test in 1 and 2 ? Like private shop, is it core? Tagging ? etc.
I understand then in 3 we need to test everything as deeply as possible, but we need to draw the line to know what to test on the first round.
When we understand better what is core we can work with @Rachel and @sstead to specify more into details the scope of the stage 1 testing. We can run the test one time after order page is done, then we can run them a second time at step 2.
Let’s start testing parts untouched by “orders page” ! @Rachel given the time you have next week I might be able to give a hand. And hopefully @sstead can do a bit more next Friday !
I think that, between now and the final round of tests, we need to fetch data from one of the main live instances into a staging server so that we test v2 with real data. What live instance should we get the data from?
