Ubuntu Wiki

• Launchpad Entry: qa-expand-checkbox-coverage

• Created: 2008-12-05

• Contributors: sbeattie, apulido, schwuk, cr3

• Packages affected: checkbox

Summary

Checkbox currently has a limited amount of test coverage, due to its history of being the hardware testing tool. We would like to expand its test coverage by incorporating other existing testsuites, like the security teams qa-regression-testing tests and ldtp based testing.

Rationale

Provide more in-depth and varied testing.

Use Cases

• Provide a larger pool of tests to be run by the security and SRU validation teams to test for general regressions when preparing updates to -security and -updates
• Create a wider base for platform team milestone testing and certification testing

Assumptions

Design

Integrate test cases from other collections.

Questions:

• Should other test collections be pulled in in bulk, or should we cherry-pick?
• How to organise the tests?
• How to maintain them?

Implementation

Candidate suites:

• Security team collection
• Autotest, LTP, LSB
• Phoronix test suite

UI Changes

Should you be able to select a test suite in Checkbox at run time?

Code Changes

Migration

Unresolved issues

This should highlight any issues that should be addressed in further specifications, and not problems with the specification itself; since any specification with problems cannot be approved.

BoF agenda and discussion

Use this section to take notes during the BoF; if you keep it in the approved spec, use it for summarising what was discussed and note any options that were rejected.

CategorySpec