Test Plan
Scale testing
- Large number of small objects submitted as a Job Manifest
– This will test ZK interactions with multiple processes and locks
- Small number of very large Jobs
– This will test for timeout conditions
Batch testing
- Errors in Batch creation should fail all jobs and notify
Failure testing
- Jobs set to fail are represented correctly in ZK batch and queue nodes
- Ensure that failed jobs release all ZK locks
Transition/Rules Testing
- Test hold collection before starting batch
- Test hold collection as a large batch is processing
- Release job while collection is held
- Release job after collection hold is released
- Release all jobs for a collection
- Requeue job failure for each phase (document how to force failures)
- Estimating (temp hardcode)
- Provisioning (temp hardcode)
- Downloading (bad manifest url)
- Processing (bad storage node)
- Recording (ask David, turn off inventory and manually fail the step)
- Notify (possibly bad email or callback)