Testing Checklist
This is a testing checklist which must be complete prior to marking a final release is ready. It should be deprecated with T56: Transfer testcases to the actual testcase branch.
Installer tests - 23.04 (Lunar Lobster)
Release date: - 20 April 2023
Final Freeze: - 13 April 2023
Beta release: - 31 March 2023
RC reached at: - 20220414 (Final anyway)
- calamares: 3.3.0-alpha2-0ubuntu4
- calamares-settings-lubuntu 1:23.04.12 (04.11 changed 20230417)
- calamares-settings-ubuntu-common 1:23.04.12 (04.12 changed 20230417)
- lubuntu-default-settings: 23.04.6
- casper 1.480
Ubuntu Release tracking document - https://discourse.ubuntu.com/t/lunar-lobster-23-04-release-status-tracking/33273
Ubuntu Release Schedule - https://discourse.ubuntu.com/t/lunar-lobster-release-schedule/27284
Ubuntu Lunar Lobster Release Notes - https://discourse.ubuntu.com/t/lunar-lobster-release-notes/31910
Lubuntu issue tracker - https://discourse.lubuntu.me/t/lubuntu-lunar-lobster-23-04-issue-tracker/4085
Full disk install tests
| Type | Encryption | Firmware | Internet | Swap (Y/N) | Completed Date | Tester | ISO | pc.detail | paste.for.tracker |
|---|---|---|---|---|---|---|---|---|---|
| Full disk install | no | BIOS | yes | y | 20230418 | @guiverc | 20230417 | hp_dc7700 | testcase: full disk, no-encryption, BIOS, internet, swap |
| Full disk install | yes | BIOS | yes | n | 20230418 | @arraybolt3 | 20230417 | kfocus_xeg1_qemu | testcase: full disk, encryption, BIOS, internet, no-swap |
| Full disk install | no | BIOS | no | y | 20230418 | @guiverc | 20230417 | hp_dc7700 | testcase: full disk, no-encryption, BIOS, no-internet, swap |
| Full disk install | yes | BIOS | no | n | 20230417 | @arraybolt3 | 20230417 | hp_pavilion_dv7 | testcase: full disk, encryption, BIOS, no-internet, no-swap |
| Full disk install | no | EFI | yes | y | 20230418 | @guiverc | 20230417 | svp11216cgb | testcase: full disk, no-encryption, EFI, internet, swap |
| Full disk install | yes | EFI | yes | y | 20230417 | @arraybolt3 | 20230417 | hp_chromebook_g4 | testcase: full disk, encryption, EFI, internet, swap |
| Full disk install | no | EFI | no | n | 20230417 | @arraybolt3 | 20230417 | hp_chromebook_g4 | testcase: full disk, no-encryption, EFI, no-internet, no-swap |
| Full disk install | yes | EFI | no | n | 20230418 | @guiverc | 20230417 | svp11216cgb | testcase: full disk, encryption, EFI, no-internet, no-swap |
| Full disk install | no | EFI + secure boot | yes | y | 20230417 | @kc2bez | 20230417 | Toshiba Satellite C55 | testcase: full disk, no-encryption, secure-EFI, internet, swap |
| Full disk install | yes | EFI + secure boot | yes | n | 20230417 | @kc2bez | 20230417 | Toshiba Satellite C55 | testcase: full disk, encryption, secure-EFI, internet, no-swap |
| Full disk install | no | EFI + secure boot | no | y | 20230417 | @kc2bez | 20230417 | Toshiba Satellite C55 | testcase: full disk, no-encryption, secure-EFI, no-internet, swap |
| Full disk install | yes | EFI + secure boot | no | n | 20230417 | @kc2bez | 20230417 | Toshiba Satellite C55 | testcase: full disk, encryption, secure-EFI, no-internet, no-swap |
Please try and ensure one of SWAP (Y) & NO-SWAP (N) exist for each test type (ie. BIOS, uEFI or Secure-uEFI) for releases of hirsute or later.
Other install types
| Type | Completed Date | Tester | ISO | pc.detail | paste.for.tracker |
|---|---|---|---|---|---|
| Install alongside | 20230418 | @guiverc | 20230417 | hp_dc7700 | testcase: install alongside |
| Replace partition | 20230418 | @guiverc | 20230417 | hp_dc7700 | testcase: replace partition |
| Install using existing partition | 20230418 | @guiverc | 20230417 | dell_opt_780 | testcase: install using existing partition |
| Custom partitioning with separate /home | 20230417 | @arraybolt3 | 20230417 | hp_pavilion_dv7 | testcase: custom partitioning with separate /home |
| Custom partitioning on btrfs | 20230417 | @arraybolt3 | 20230417 | hp_pavilion_dv7 | testcase: custom partitioning with BTRFS |
| Custom partitioning on xfs | 20230418 | @arraybolt3 | 20230417 | hp_chromebook_g4 | testcase: custom partitioning with XFS |
| Install using another language | 20230418 | @arraybolt3 | 0417 | kfocus_xeg1_qemu | |
| Auto-login after install | 20230417 | @arraybolt3 | 20230417 | hp_chromebook_g4 | |
The install using another language, and/or auto-login can be combined with another install, ie. a single QA-test can be used to refresh the details of up to two lines on this checklist (eg. auto-install or install with another language)
Additional testcases
| Test Information | Completed Date | Tester | pc.detail |
|---|---|---|---|
| GUI upgrade¹ from prior release | 20230410 | @Leok | dell_opt_7040 |
| TUI upgrade² from prior release | 20230410 | @Leok | awow.ny41 |
| GUI upgrade¹ from LTS to next LTS release | na | na | na |
| TUI upgrade² from LTS to next LTS release | na | na | na |
| minimal install³ | not applicable | ||
¹do-release-upgrade -d -m desktop -f DistUpgradeViewKDE
²do-release-upgrade -d
³ Currently not implemented
- The purpose of the "Optional box" field is to allow re-tests to be done on a different box to prior time (if possible)
- na is short for not-applicable
To help understanding some of these testcases, the following link maybe helpful - https://discourse.lubuntu.me/t/testing-checklist-understanding-the-testcases/2743
- Last Author
- guiverc
- Last Edited
- Apr 19 2023, 12:41 AM