mbox series

[v3,00/11] Update Avocado testsuite

Message ID 20210317145225.88050-1-amikan@ilbers.de
Headers show
Series Update Avocado testsuite | expand

Message

Anton Mikanovich March 17, 2021, 4:52 a.m. UTC 
This patchset provides implementation of build and vm_start tests
functionality in Python with help of Avocado framework.
Scripts ci_build and vm_smoke_test are rewritten to call Avocado.
ci_build and vm_smoke_test are left for compatibility and
should be replaced by direct avocado calls later.
Original ci_build and vm_smoke_test are renamed to *_legacy.
Build and run logs are hidden now until an error occurs.

---
Debian Avocado package preparation is in progress and will be added in
the next patchset revision.
Changes since v2:
- Make CI call Avocado tests.
- Wait less on vm_start test.
- Split Roman's vm_start commit.
- Put logs to build folder.
- Rearrange patches.
- Split build test to classes.
- Add test case tagging.
- Get rid of avocado-framework-plugin-varianter-yaml-to-mux.
- Get rid of python-subprocess32.
- Improve logging.
Changes since v1:
- Merge start_vm rebuild patches.
- Fix patch comments.

Anton Mikanovich (8):
  vm_boot_test: Fix log file path in vm_boot_test
  vm_boot_test: Remove external varianter
  vm_boot_test: Improve QEMU images checking
  build_test: Refactoring build tests cases
  testsuite: Add Python generations for testsuite in gitignore
  testsuite: Fix test suite prepare guide
  ci_build: Migrate to Avocado
  vm_smoke_test: Migrate to Avocado

Roman Pletnev (3):
  start_vm.py: Fix target name handling
  start_vm.py: Add output and PID file vm_start.py options
  start_vm.py: Add MIPS support

 scripts/ci_build.sh                    | 170 +++---------------
 scripts/ci_build_legacy.sh             | 239 +++++++++++++++++++++++++
 scripts/vm_smoke_test                  | 110 ++----------
 scripts/vm_smoke_test_legacy           | 168 +++++++++++++++++
 testsuite/.gitignore                   |   1 +
 testsuite/README.md                    |  21 +--
 testsuite/build_test/build_test.py     | 137 +++++++++++---
 testsuite/build_test/cibase.py         | 121 +++++++++++++
 testsuite/build_test/cibuilder.py      |  79 ++++++++
 testsuite/build_test/run.sh            |   3 -
 testsuite/build_test/run_fast.sh       |   3 +
 testsuite/build_test/run_full.sh       |   3 +
 testsuite/build_test/variant.yaml      |  22 ---
 testsuite/start_vm.py                  |  20 ++-
 testsuite/vm_boot_test/run.sh          |   3 -
 testsuite/vm_boot_test/run_fast.sh     |   3 +
 testsuite/vm_boot_test/run_full.sh     |   3 +
 testsuite/vm_boot_test/variant.yaml    |  22 ---
 testsuite/vm_boot_test/vm_boot_test.py | 110 ++++++++++--
 19 files changed, 884 insertions(+), 354 deletions(-)
 create mode 100755 scripts/ci_build_legacy.sh
 create mode 100755 scripts/vm_smoke_test_legacy
 create mode 100644 testsuite/.gitignore
 create mode 100644 testsuite/build_test/cibase.py
 create mode 100644 testsuite/build_test/cibuilder.py
 delete mode 100755 testsuite/build_test/run.sh
 create mode 100755 testsuite/build_test/run_fast.sh
 create mode 100755 testsuite/build_test/run_full.sh
 delete mode 100644 testsuite/build_test/variant.yaml
 delete mode 100755 testsuite/vm_boot_test/run.sh
 create mode 100755 testsuite/vm_boot_test/run_fast.sh
 create mode 100755 testsuite/vm_boot_test/run_full.sh
 delete mode 100644 testsuite/vm_boot_test/variant.yaml