Compare commits
35 Commits
f1_variabl
...
ai_integra
| Author | SHA1 | Date | |
|---|---|---|---|
| 358ade8c98 | |||
| 46bdb44cfb | |||
| 41519c97cb | |||
| b9475c6e9b | |||
| d3c5bd01e5 | |||
| 077e1a97c1 | |||
| 35ca0a8b45 | |||
| 4529da7aee | |||
| 8bd9b3e9d6 | |||
| a70b70db54 | |||
| d7f25718d0 | |||
| 9db0f89522 | |||
| f38a24190d | |||
| b16494ef6d | |||
| b175ff4189 | |||
| d66a46736f | |||
| 1b2d427ced | |||
| be540cd304 | |||
| 476b59c6f7 | |||
| bcafbfae18 | |||
| e56a1f72c8 | |||
| 83411482b2 | |||
| a28e644621 | |||
| 4a4a70b5f6 | |||
| 06c4cc62c6 | |||
| 60dbcf0252 | |||
| a3e449cc7d | |||
| 95107117fa | |||
| 88cc410eed | |||
| fa7f8cef7c | |||
| 5a065128be | |||
| b7b930aab1 | |||
| 609ca57202 | |||
| d26b60435b | |||
| de143b6cc3 |
250
CLAUDE.md
Normal file
250
CLAUDE.md
Normal file
@@ -0,0 +1,250 @@
|
||||
# Testium — Claude Context
|
||||
|
||||
## What is testium
|
||||
|
||||
Testium is a test sequencer/runner written in Python. It executes YAML-based test scripts ("`.tum`" files) and supports two execution modes:
|
||||
|
||||
- **GUI mode** (default, no flag): PySide6 Qt application (`src/testium/main_win/`)
|
||||
- **Batch mode** (`-b` / `--batch-execution`): headless, non-interactive, runs tests and exits
|
||||
|
||||
Run from repo root: `./run.sh` (Linux) or `run.bat` / `run.ps1` (Windows).
|
||||
Direct invocation: `python3 -m src/testium [-b] <test_file.tum>`
|
||||
|
||||
## Architecture
|
||||
|
||||
### Entry point
|
||||
`src/testium/__init__.py` — parses CLI args, dispatches to the two modes.
|
||||
`multiprocessing.set_start_method('spawn')` is called early (required for Linux dialog subprocesses).
|
||||
|
||||
### Core execution
|
||||
- `src/testium/interpreter/process.py` — `TestProcess(multiprocessing.Process)`: runs the test in a child process. Stdout is redirected via a `StringQueue` → pipe → parent thread (`capture_stdout`) that writes to real stdout.
|
||||
- `src/testium/interpreter/batch.py` — `Batch`: parent-side orchestrator for `-b` mode. Creates the `msg_queue`, starts `TestProcess`, waits for the "finished" signal.
|
||||
- `src/testium/interpreter/test_set.py` — `TestSet`: builds and executes the tree of test items.
|
||||
- `src/testium/interpreter/test_items/test_item*.py` — one file per test item type (check, cycle, group, let, unittest, py_func, lua_func, console, git, dialogs, report, parallel, …).
|
||||
|
||||
### Communication channels (parent ↔ child process)
|
||||
- `msg_queue` (`multiprocessing.Queue`): carries status messages from child to parent.
|
||||
- Item status: `{"id": <non-None>, "name": ..., "status": "started"|"finished", ...}`
|
||||
- Global dict updates: `{"type": "gd_update"|"gd_delete", "key": ..., "value": ...}` — **no "id" key**
|
||||
- Process finished: `{"id": None, "name": "test_process", "status": "finished"}` — id key present but `None`
|
||||
- `tst_ctrl` (`TestSetController`): sends control commands (execute, stop, pause, close, …) from parent to child.
|
||||
- stdout pipe (`multiprocessing.Pipe`): streams test output from child back to parent's `capture_stdout` thread.
|
||||
|
||||
### Stdout pipeline (batch mode)
|
||||
```
|
||||
test item print()
|
||||
→ sys.stdout (StringQueue, in child)
|
||||
→ send_stdout thread (child) → pipe → capture_stdout thread (parent)
|
||||
→ print() → sys.stdout (TermLog wrapping real stdout, in parent)
|
||||
→ terminal
|
||||
```
|
||||
|
||||
### Global dictionary
|
||||
`src/testium/interpreter/utils/globdict.py` — shared state accessible from test scripts via `tm.gd()` / `tm.setgd()`. When `set_update_queue()` is active (during test execution), every `setgd`/`delgd` on a non-`_`-prefixed key pushes a message to `msg_queue`.
|
||||
|
||||
### Coloring (`-o` disables it)
|
||||
`src/testium/interpreter/utils/termlog.py` — `TermLog` wraps stdout with colorama-based line coloring (PASS=green, FAIL=red, WARN=yellow, …). Applied in parent process for batch mode. Auto-detects light/dark terminal background via (in order): `COLORFGBG` env var, OSC 11 query, default dark.
|
||||
|
||||
### Dialog items in batch mode
|
||||
All dialog items (`dialog_image`, `dialog_question`, `dialog_references`, `dialog_value`, `dialog_message`, `dialog_choices`, `dialog_note`) follow this rule in non-interactive text mode (`-b`):
|
||||
- `auto_result` defined in the `.tum` → result controlled by it (`ok`/`yes` → SUCCESS, `cancel`/`no` → FAIL)
|
||||
- `auto_result` absent → FAIL with `"Dialog not supported in batch mode"`
|
||||
- `sleep dialog: true` → exception: just sleeps normally, no GUI, no failure
|
||||
|
||||
`auto_result` (and `auto_value` for value/note dialogs) is intended for the validation test suite (`test/validation/`) only.
|
||||
|
||||
### `parallel` item
|
||||
`src/testium/interpreter/test_items/test_item_parallel.py` — runs multiple branches concurrently.
|
||||
|
||||
```yaml
|
||||
- parallel:
|
||||
name: My parallel block
|
||||
sync: all # all: wait for all; any: stop as soon as one finishes
|
||||
no_fail: true # (optional) don't propagate branch failures to parent
|
||||
branches:
|
||||
- name: Branch A
|
||||
wait_for: # (optional) poll condition before starting
|
||||
condition: <| expr |>
|
||||
timeout: 10
|
||||
steps:
|
||||
- ...
|
||||
- name: Branch B
|
||||
steps:
|
||||
- ...
|
||||
```
|
||||
|
||||
- `TestItemParallel(TestItemContainer)`: mutates `dict_item["steps"]` to inject synthetic `parallel_branch` items so `load_test_recursively` loads branches normally as children.
|
||||
- `TestItemParallelBranch(TestItemContainer)`: container for one branch. `wait_for` polls every 0.1s up to `timeout` seconds before running steps.
|
||||
- `sync: any` calls `_stop_branch_recursively()` on all other branches when one *actually runs* (SUCCESS/FAILURE). A `NORUN` branch (disabled, condition not met) never wins the race.
|
||||
- Each branch runs in a daemon thread; the parent waits with `.join()`.
|
||||
- Branches stopped late (e.g. user disabled them in the GUI, or another sync:any branch already won) go through the normal `branch.stop() + branch.execute()` path so they always produce a clean DB entry via `addTest()`.
|
||||
- Exceptions raised in a branch's `execute()` are caught by `run_branch`, logged to stdout, and converted to a `FAILURE` result so they never disappear silently.
|
||||
- `sync: all` ignores `NORUN` branches when computing success (matches Group/Cycle semantics): only an actual `FAILURE` fails the parallel.
|
||||
- `TestItemSleep` is interruptible (polls `self._is_stopped` in a loop) so `sync: any` can stop slow branches quickly. `py_func` and `console` items are not interruptible; their full duration is observed before the branch returns.
|
||||
|
||||
### `TestItemContainer` base class
|
||||
`src/testium/interpreter/test_items/test_item_container.py` — shared base for Group, Cycle, Parallel, and ParallelBranch. Provides `_run_children_sequentially()` which handles stop-on-failure, `executedOnStop` items, and returns `(TestResult, stopped_bool)`.
|
||||
|
||||
### Report threading
|
||||
`src/testium/interpreter/test_report/test_report.py` — SQLite report with thread-safe writes:
|
||||
- `sqlite3.connect(..., check_same_thread=False)`
|
||||
- `self._lock = threading.Lock()` guards the SQLite `INSERT` only.
|
||||
- Per-item log capture (`stdio_redir.read()`) is naturally race-free thanks to per-thread buffers (see `StdoutProxy`).
|
||||
|
||||
### Thread-aware stdout (`StdoutProxy`)
|
||||
`src/testium/runtime/stdout_redirect.py` — when `log_stored: True`, `intercept()` installs a `StdoutProxy` as `sys.stdout`/`sys.stderr` instead of a single shared `StringQueue`. The proxy:
|
||||
- Holds one `StringQueue` per thread (registered via `register_thread(buffer=...)`). The main thread uses a default buffer; each parallel branch's thread registers its own at start and unregisters at end. `stdio_redir.read()` reads the calling thread's buffer → `addTest()` of an item running in branch X reads X's clean, non-interleaved output.
|
||||
- For the live stream (terminal in batch / GUI panel), prefixes every line emitted from a branch's thread with `[<branch_name>] ` so concurrent branches stay readable.
|
||||
- Exposes `write` / `writeln` / `flush` (Python 3.14's `unittest` calls `stream.writeln()` directly without `_WritelnDecorator`).
|
||||
|
||||
### Subprocess API contract (py_func / lua_func)
|
||||
|
||||
User test scripts running inside a `py_func` or `lua_func` subprocess **must** use the JSON-RPC bridge to interact with testium state:
|
||||
|
||||
- Python: `import py_func.tm as tm` — auto-generates wrappers for every function in `runtime/api.py:SUPPORTED_API`. `tm.gd`/`tm.setgd`/`tm.delgd` go through JSON-RPC to the parent.
|
||||
- Lua: `local tm = require("tm")` — same idea on the Lua side.
|
||||
|
||||
`api.testium` is the *main-process* implementation; it is **not** exposed to subprocesses by design (not bundled in PyInstaller, not on the subprocess `PYTHONPATH` in pip-installed mode either when isolation is preserved). An import attempt from a subprocess script is a code smell and is detected by `test/validation/items/isolation/`.
|
||||
|
||||
To add a new API call usable from subprocesses:
|
||||
1. Add the function to `api/testium.py`
|
||||
2. Add its name to `SUPPORTED_API` in `runtime/api.py`
|
||||
3. It is auto-exposed via JSON-RPC by `interpreter/utils/api_srv.py` and auto-wrapped by `py_func/tm.py:_make_api`
|
||||
|
||||
### External interpreter resolution (`bins.py`)
|
||||
`src/testium/interpreter/utils/bins.py` — single source of truth for the paths to the external Python and Lua interpreters used by subprocesses.
|
||||
|
||||
- `python_bin()` / `lua_bin()` : resolve once, cache in memory. User can override via the `python_bin` / `lua_bin` global dict keys (typically populated from the YAML config). Falls back to discovery on PATH (candidates: `python3`/`python` and `lua`/`lua5.5`/`lua5.4`/`lua5.3`/`lua5.2`/`lua5.1`).
|
||||
- `ensure(*names)` : called by `TestSet._validate_runtime_deps()` at test load. Always requires `python` (the eval engine always runs); requires `lua` only if a `lua_func` item is in the tree. Fails fast with a clear error citing tried candidates and override key.
|
||||
|
||||
Engines (`PyProcessBase`, `LuaProcessBase`, `EvalExecEngine`) call `bins.python_bin()`/`bins.lua_bin()` themselves — call sites never pass an explicit binary path.
|
||||
|
||||
## Key files
|
||||
|
||||
| Path | Role |
|
||||
|------|------|
|
||||
| `src/testium/__init__.py` | CLI entry, mode dispatch |
|
||||
| `src/testium/interpreter/batch.py` | `-b` mode orchestrator |
|
||||
| `src/testium/interpreter/process.py` | Child test process |
|
||||
| `src/testium/interpreter/test_set.py` | Test tree builder/executor |
|
||||
| `src/testium/interpreter/test_items/test_item_container.py` | Base class for container items |
|
||||
| `src/testium/interpreter/test_items/test_item_parallel.py` | `parallel` and `parallel_branch` items |
|
||||
| `src/testium/interpreter/utils/globdict.py` | Global variable dict |
|
||||
| `src/testium/interpreter/utils/termlog.py` | Terminal color output |
|
||||
| `src/testium/runtime/stdout_redirect.py` | `StdioRedirect` singleton (`stdio_redir`) |
|
||||
| `src/testium/runtime/string_queue.py` | Thread-safe string buffer used for stdout redirection |
|
||||
| `src/testium/api/testium.py` | Public API for test scripts (`tm.*`) |
|
||||
| `src/testium/py_func/` | Python subprocess for `py_func` items (sandboxed: imports only `runtime/` and `py_func/`) |
|
||||
| `src/testium/lua_func/` | Lua subprocess scripts for `lua_func` items |
|
||||
|
||||
## Package layout
|
||||
|
||||
The whole project is a single Python package under `src/testium/`:
|
||||
|
||||
```
|
||||
src/testium/
|
||||
├── __init__.py / __main__.py
|
||||
├── runtime/ internal plumbing (jrpc, stdout_redirect, string_queue, tum_except, api)
|
||||
├── api/ public SDK exposed to test scripts (`import api.testium as tm`)
|
||||
├── interpreter/ test execution engine (NOT visible to py_func/lua_func)
|
||||
├── main_win/ GUI (NOT visible to py_func/lua_func)
|
||||
├── py_func/ subprocess code for python_func items
|
||||
└── lua_func/ subprocess scripts for lua_func items (data files)
|
||||
```
|
||||
|
||||
`subproc_path()` and `testium_path()` both return the package directory. The py_func subprocess is launched with cwd=that directory and `python3 py_func`. The contract that `py_func/` and `lua_func/` only depend on `runtime/` (no `interpreter`, `main_win`, `api`, `testium`) is enforced by `test/validation/items/isolation/`.
|
||||
|
||||
## GUI icons (main_win)
|
||||
|
||||
Icons live in `src/testium/main_win/resources/` with three theme variants:
|
||||
|
||||
| Folder | Theme index | Usage |
|
||||
|--------|-------------|-------|
|
||||
| `color/` | 0 (default) | Coloured icons |
|
||||
| `black/` | 1 | Black silhouette on transparent |
|
||||
| `white/` | 2 | White silhouette on transparent (LA mode) |
|
||||
|
||||
Icons are **64×64 PNG**. Black variants: RGBA with RGB=`(0,0,0)`, alpha varies. White variants: LA with luminance=`255`, alpha varies.
|
||||
|
||||
The mapping item-type → icon filename is in `_ITEM_CONFIG` (`src/testium/main_win/test_tree_items/test_tree_item.py`). At runtime, `icon_prefix()` returns `:/color`, `:/black`, or `:/white` (Qt resource prefix) based on the user preference.
|
||||
|
||||
All icons must be declared in `src/testium/main_win/resources/testium_core_win.qrc` (one entry per theme section). After any QRC change, regenerate the compiled resource file:
|
||||
```
|
||||
cd src/testium/main_win/resources
|
||||
pyside6-rcc testium_core_win.qrc -o testium_core_win_rc.py
|
||||
```
|
||||
|
||||
Icons are assigned once when the test file is loaded (not updated live on theme change — a file reload is required).
|
||||
|
||||
### `run` item
|
||||
`src/testium/interpreter/test_items/test_item_run.py` — launches a `.tum` file in a new testium instance (`-b` in batch mode, `-r` in GUI mode). Result:
|
||||
- **PASS** if the sub-instance launched and ran to completion (exit code is ignored)
|
||||
- **FAIL** if the file is not found, `wait_for_exec` is set without `start_time`/`end_time`, the time window was not reached, or any other launch error
|
||||
|
||||
The sub-test's own pass/fail result is intentionally not propagated.
|
||||
|
||||
### Report exporters & plugins
|
||||
`src/testium/interpreter/test_report/test_report.py` — `_EXPORTER_REGISTRY` dict maps a format name (cmd key in the YAML `report.export`) to a lazy loader. Built-ins: `text`, `json`, `junit` (needs `junit_xml`), `html` (needs `lxml`). `sqlite` is the storage layer, no-op as an export.
|
||||
|
||||
Third-party plugins are discovered at module import via `importlib.metadata.entry_points(group="testium.exporters")` — installing a wheel that declares such an entry point is enough, no testium config change needed:
|
||||
```toml
|
||||
[project.entry-points."testium.exporters"]
|
||||
my_format = "my_pkg:MyExporter"
|
||||
```
|
||||
Exporter contract: `__init__(self, name, con, path, pats, keys, no_header=False)` — the class does its work in `__init__` and writes to `path`.
|
||||
|
||||
Behaviour on errors:
|
||||
- Unknown format → info line `[report] Export skipped: format "X" not found. Available: ...`, run continues.
|
||||
- Optional dependency missing → same info line with a pip-install hint, run continues.
|
||||
|
||||
A real-world test plugin lives at `test/validation/fake_exporter/` (CSV exporter, auto-installed by `scripts/build_env.sh` and exercised by `test/validation/items/report_plugin/`).
|
||||
|
||||
## Packaging
|
||||
|
||||
Three distribution channels coexist, sharing the single `src/testium/` package:
|
||||
|
||||
| Channel | Where | Notes |
|
||||
|---------|-------|-------|
|
||||
| Wheel (`pip install`) | `src/pyproject.toml` | Vanilla Python package; entry point `testium = "testium:main"` |
|
||||
| PyInstaller binary | `package/pyinstaller/` | Single ~130 MB binary. `py_func`, `runtime`, `lua_func` bundled at `_MEIPASS` root so the **host** Python can find them when launched as `python3 py_func`. `api`/`interpreter` are **not** exposed (subprocess isolation). |
|
||||
| Flatpak | `package/flatpak/` | (Existing recipe, not actively maintained in current refactor wave.) |
|
||||
|
||||
The `.deb` work-in-progress lives in `package/deb/`:
|
||||
- `test_distro.sh debian:bookworm | debian:trixie | ubuntu:24.04` spins up a Docker/Podman container, reports system package availability, falls back to pip for what's missing (`pyside6` on bookworm/ubuntu, `telnetlib3`, `junit_xml`), runs the validation suite. Currently green on the three targets.
|
||||
|
||||
## Recent fixes / notable changes
|
||||
- Restructure: single `src/testium/` Python package (was 4 sibling top-levels: `testium`, `lib`, `py_func`, `lua_func`). `lib/` → `runtime/`, `libs/` → `api/`. `pip install` now produces a clean `site-packages/testium/` with no top-level pollution; `.lua` files travel via `package_data`.
|
||||
- `bins.py`: centralised resolution + cache of external `python3` / `lua` binaries. Replaces the scattered `tm.gd("python_bin")`/`tm.gd("lua_bin")` dance and the duplicated discovery logic in `py_process.py`/`lua_process.py`. Validates at test load via `TestSet._validate_runtime_deps()` so missing interpreters fail fast.
|
||||
- Subprocess API contract: user scripts in `py_func`/`lua_func` use the JSON-RPC bridge (`py_func.tm` / Lua `tm`) — never `api.testium` / `interpreter.*` directly. `SUPPORTED_API` extended with `OS`, `get_main_dir`, `init_timestamp`, `timestamp`, `timestamp_as_sec` so subprocess scripts have the same surface as main-process code.
|
||||
- Report exporter plugin registry (`test_report.py`): `_EXPORTER_REGISTRY` + `entry_points("testium.exporters")` discovery. Missing format → info line, run continues.
|
||||
- About dialog rework: `QVBoxLayout` (resizable), version + dirty/branch info in a `QLabel` (auto-sized), copyright + clickable EUPL-1.2 link.
|
||||
- `test_ctrl.control()`: drain stale responses (left over from polled `loaded()` after `clear()` race) instead of failing on a wrong cmd key — fixes a "Unexpected return error in test set controller" seen in GUI mode after a fast reload.
|
||||
- `lua_process.py`: stderr no longer DEVNULL'd so actual Lua errors (missing `cjson`/`socket`) surface instead of "Connection refused".
|
||||
- `run_post_exec`: failure message uses `print_warn` (was `print_debug` — silent in non-debug runs).
|
||||
- Python 3.11 compat: replaced PEP 701 nested-quote f-strings (e.g. `f"... {d["k"]} ..."`) with single-quote inner strings or string concatenation.
|
||||
- `parallel` item: new item with `sync: all|any`, `wait_for`, daemon threads, `_stop_branch_recursively()`. Each branch thread registers a per-thread stdout buffer.
|
||||
- `parallel_branch` icon: distinct single-arrow icon (`parallel_branch.png`).
|
||||
- `parallel` F1 panel: `steps` stripped from each branch dict.
|
||||
- `test_item_container.py`: shared base class extracted from Group/Cycle.
|
||||
- `test_item_sleep.py`: interruptible loop so `sync: any` can stop slow branches quickly.
|
||||
- `stdout_redirect.py`: `StdoutProxy` (thread-aware buffers + branch-prefixed live output, `writeln()` for Python 3.14 unittest).
|
||||
- `test_report.py`: thread-safe SQLite INSERT for parallel branch concurrency.
|
||||
- `terminal.py`: deleted — `-m`/`--terminal` mode removed.
|
||||
- `batch.py`: premature finish bug on `gd_update` (no `"id"` key) — fix uses `"id" in m and m["id"] is None`.
|
||||
- `batch.py`: `control("loaded")` deadlock on TestProcess crash — fix uses daemon thread + `threading.Event` + `is_alive()` polling.
|
||||
- `termlog.py`: light/dark terminal auto-detection (`COLORFGBG`, OSC 11) + write residue bug.
|
||||
- Dialog items: `auto_result`/`auto_value` for non-interactive text mode; dialogs without `auto_result` FAIL immediately in batch.
|
||||
- `run` item: renamed `tum_fime` → `tum`; removed `stdout=PIPE` deadlock; PASS on any completed subprocess.
|
||||
- `unittest` item: renamed from `unittest_file`.
|
||||
- GUI test tree: check and fold state preserved across same-file reloads.
|
||||
- Licence: EUPL-1.2.
|
||||
|
||||
## Validation tests
|
||||
Located in `test/validation/`. Run with `-b` flag:
|
||||
```
|
||||
./run.sh -b -- test/validation/main.tum
|
||||
```
|
||||
Parallel item tests: `test/validation/items/parallel/test.tum`
|
||||
|
||||
## Dependencies
|
||||
See `src/requirements.txt`. Key ones: `pyside6`, `pyyaml`, `jinja2`, `colorama`, `gitpython`, `pexpect`, `matplotlib`.
|
||||
165
CONTRIBUTING.md
Normal file
165
CONTRIBUTING.md
Normal file
@@ -0,0 +1,165 @@
|
||||
# Contributing to testium
|
||||
|
||||
Thank you for your interest in contributing to testium.
|
||||
|
||||
## License of contributions
|
||||
|
||||
testium is licensed under the **European Union Public Licence v. 1.2 (EUPL-1.2)** —
|
||||
see the [LICENSE](LICENSE) file at the repository root.
|
||||
|
||||
By submitting a contribution to this project (pull request, patch, issue
|
||||
attachment, or any other form of code, documentation or media), you agree
|
||||
that your contribution is licensed to the project and to the public under the
|
||||
**same EUPL-1.2** terms (or any later version of the EUPL approved by the
|
||||
European Commission), and you certify that:
|
||||
|
||||
- you are the author of the contribution, or you have the right to submit it
|
||||
under the EUPL-1.2;
|
||||
- to the best of your knowledge, the contribution does not infringe any
|
||||
third-party intellectual-property rights;
|
||||
- the contribution may be redistributed by the project under the EUPL-1.2 and
|
||||
any compatible licence listed in the EUPL-1.2 Appendix.
|
||||
|
||||
This is the **inbound = outbound** rule: contributions come in under the same
|
||||
licence the project ships under.
|
||||
|
||||
You retain copyright on your contribution. The project does **not** ask you
|
||||
to sign a CLA or assign your copyright.
|
||||
|
||||
## SPDX header in new source files
|
||||
|
||||
When creating a new source file, please include the following header at the
|
||||
top of the file (adjust the comment marker to the file's language):
|
||||
|
||||
```python
|
||||
# SPDX-License-Identifier: EUPL-1.2
|
||||
# Copyright (c) <year> <your name>
|
||||
```
|
||||
|
||||
For existing files, keep the header that is already there.
|
||||
|
||||
## How to contribute
|
||||
|
||||
1. Open an issue describing the change you want to make (bug, feature, doc).
|
||||
2. Fork the repository, create a topic branch.
|
||||
3. Commit with a clear message (one logical change per commit).
|
||||
4. Make sure the validation suite still passes:
|
||||
```
|
||||
./run.sh -b -- test/validation/main.tum
|
||||
```
|
||||
5. Open a pull request against `main`.
|
||||
|
||||
## Coding conventions
|
||||
|
||||
- Python ≥ 3.11
|
||||
- Follow existing style in the file you are modifying
|
||||
- Add or update tests in `test/validation/` for new test items or behaviours
|
||||
- Update `CLAUDE.md` and the Sphinx manual for user-visible changes
|
||||
|
||||
## Development
|
||||
|
||||
### Debugging in VSCode
|
||||
|
||||
The recommended workflow:
|
||||
|
||||
1. Add a debug configuration to `.vscode/launch.json`:
|
||||
```json
|
||||
{
|
||||
"configurations": [
|
||||
{
|
||||
"name": "Python : testium",
|
||||
"type": "python",
|
||||
"request": "launch",
|
||||
"program": "${workspaceFolder}/src/testium",
|
||||
"console": "integratedTerminal",
|
||||
"args": ["-g"],
|
||||
"justMyCode": true
|
||||
}
|
||||
]
|
||||
}
|
||||
```
|
||||
2. Install `debugpy` in the venv: `python -m pip install debugpy`.
|
||||
3. Open the *Run and Debug* tab and press play. testium starts; load and
|
||||
run a `.tum` file. Set breakpoints where you want to investigate.
|
||||
|
||||
### Qt GUI modification
|
||||
|
||||
UI files (`*.ui`) are edited in **Qt Creator**. After editing, regenerate
|
||||
the corresponding Python and resource files:
|
||||
|
||||
```sh
|
||||
scripts/qt_generate.sh
|
||||
```
|
||||
|
||||
Icons come from <https://github.com/free-icons/free-icons>.
|
||||
|
||||
### Sphinx documentation
|
||||
|
||||
```sh
|
||||
pip install sphinx linuxdoc
|
||||
doc/manual/sphinx/build_doc.sh
|
||||
```
|
||||
|
||||
PDF generation requires `texlive`:
|
||||
|
||||
```sh
|
||||
sudo apt install texlive-full
|
||||
```
|
||||
|
||||
### Validation suite
|
||||
|
||||
Batch mode (CI-friendly, headless):
|
||||
|
||||
```sh
|
||||
./run.sh -b -- test/validation/main.tum
|
||||
```
|
||||
|
||||
GUI mode (loads the suite, click *Run* to execute and inspect the tree):
|
||||
|
||||
```sh
|
||||
./run.sh test/validation/main.tum
|
||||
```
|
||||
|
||||
GUI run-and-close (executes the suite, then closes):
|
||||
|
||||
```sh
|
||||
./run.sh -r -- test/validation/main.tum
|
||||
```
|
||||
|
||||
Subset run via the `items` define (works in any mode):
|
||||
|
||||
```sh
|
||||
./run.sh -b -d "items=['parallel','common']" -- test/validation/main.tum
|
||||
```
|
||||
|
||||
### Cross-distribution check
|
||||
|
||||
`package/deb/test_distro.sh` spins up a Docker/Podman container of the
|
||||
target image, installs the expected system Python deps via apt (with
|
||||
pip fallback for what is missing), installs the testium wheel and runs
|
||||
the validation suite end-to-end. Currently green on `debian:bookworm`,
|
||||
`debian:trixie`, `ubuntu:24.04`.
|
||||
|
||||
```sh
|
||||
./package/deb/test_distro.sh debian:trixie
|
||||
```
|
||||
|
||||
## Release procedure
|
||||
|
||||
1. Update `release_note.txt`.
|
||||
2. Bump the version in `src/VERSION`.
|
||||
3. Make sure the documentation is up to date — rebuild with
|
||||
`doc/manual/sphinx/build_doc.sh` if needed.
|
||||
4. Push and tag the commit with the new version.
|
||||
5. Build the binary release: `package/pyinstaller/build.sh`.
|
||||
6. Run the validation suite against each generated binary.
|
||||
7. Confirm all validation results are green before publishing.
|
||||
|
||||
## Reporting security issues
|
||||
|
||||
Please do **not** report security vulnerabilities through public GitHub
|
||||
issues. Instead, send an email to the project maintainer directly.
|
||||
|
||||
## Questions
|
||||
|
||||
Open a GitHub Discussion or an issue tagged `question`.
|
||||
315
LICENSE
Normal file
315
LICENSE
Normal file
@@ -0,0 +1,315 @@
|
||||
Copyright (c) 2025-2026 François Dausseur
|
||||
|
||||
Licensed under the EUPL
|
||||
|
||||
|
||||
EUROPEAN UNION PUBLIC LICENCE v. 1.2
|
||||
EUPL © the European Union 2007, 2016
|
||||
|
||||
This European Union Public Licence (the 'EUPL') applies to the Work (as
|
||||
defined below) which is provided under the terms of this Licence. Any use of
|
||||
the Work, other than as authorised under this Licence is prohibited (to the
|
||||
extent such use is covered by a right of the copyright holder of the Work).
|
||||
|
||||
The Work is provided under the terms of this Licence when the Licensor (as
|
||||
defined below) has placed the following notice immediately following the
|
||||
copyright notice for the Work:
|
||||
|
||||
Licensed under the EUPL
|
||||
|
||||
or has expressed by any other means his willingness to license under the EUPL.
|
||||
|
||||
|
||||
1. Definitions
|
||||
|
||||
In this Licence, the following terms have the following meaning:
|
||||
|
||||
- 'The Licence': this Licence.
|
||||
|
||||
- 'The Original Work': the work or software distributed or communicated by the
|
||||
Licensor under this Licence, available as Source Code and also as Executable
|
||||
Code as the case may be.
|
||||
|
||||
- 'Derivative Works': the works or software that could be created by the
|
||||
Licensee, based upon the Original Work or modifications thereof. This Licence
|
||||
does not define the extent of modification or dependence on the Original
|
||||
Work required in order to classify a work as a Derivative Work; this extent
|
||||
is determined by copyright law applicable in the country mentioned in
|
||||
Article 15.
|
||||
|
||||
- 'The Work': the Original Work or its Derivative Works.
|
||||
|
||||
- 'The Source Code': the human-readable form of the Work which is the most
|
||||
convenient for people to study and modify.
|
||||
|
||||
- 'The Executable Code': any code which has generally been compiled and which
|
||||
is meant to be interpreted by a computer as a program.
|
||||
|
||||
- 'The Licensor': the natural or legal person that distributes or communicates
|
||||
the Work under the Licence.
|
||||
|
||||
- 'Contributor(s)': any natural or legal person who modifies the Work under
|
||||
the Licence, or otherwise contributes to the creation of a Derivative Work.
|
||||
|
||||
- 'The Licensee' or 'You': any natural or legal person who makes any usage of
|
||||
the Work under the terms of the Licence.
|
||||
|
||||
- 'Distribution' or 'Communication': any act of selling, giving, lending,
|
||||
renting, distributing, communicating, transmitting, or otherwise making
|
||||
available, online or offline, copies of the Work or providing access to its
|
||||
essential functionalities at the disposal of any other natural or legal
|
||||
person.
|
||||
|
||||
|
||||
2. Scope of the rights granted by the Licence
|
||||
|
||||
The Licensor hereby grants You a worldwide, royalty-free, non-exclusive,
|
||||
sublicensable licence to do the following, for the duration of copyright
|
||||
vested in the Original Work:
|
||||
|
||||
- use the Work in any circumstance and for all usage,
|
||||
- reproduce the Work,
|
||||
- modify the Work, and make Derivative Works based upon the Work,
|
||||
- communicate to the public, including the right to make available or display
|
||||
the Work or copies thereof to the public and perform publicly, as the case
|
||||
may be, the Work,
|
||||
- distribute the Work or copies thereof,
|
||||
- lend and rent the Work or copies thereof,
|
||||
- sublicense rights in the Work or copies thereof.
|
||||
|
||||
Those rights can be exercised on any media, supports and formats, whether now
|
||||
known or later invented, as far as the applicable law permits so.
|
||||
|
||||
In the countries where moral rights apply, the Licensor waives his right to
|
||||
exercise his moral right to the extent allowed by law in order to make
|
||||
effective the licence of the economic rights here above listed.
|
||||
|
||||
The Licensor grants to the Licensee royalty-free, non-exclusive usage rights
|
||||
to any patents held by the Licensor, to the extent necessary to make use of
|
||||
the rights granted on the Work under this Licence.
|
||||
|
||||
|
||||
3. Communication of the Source Code
|
||||
|
||||
The Licensor may provide the Work either in its Source Code form, or as
|
||||
Executable Code. If the Work is provided as Executable Code, the Licensor
|
||||
provides in addition a machine-readable copy of the Source Code of the Work
|
||||
along with each copy of the Work that the Licensor distributes or indicates,
|
||||
in a notice following the copyright notice attached to the Work, a repository
|
||||
where the Source Code is easily and freely accessible for as long as the
|
||||
Licensor continues to distribute or communicate the Work.
|
||||
|
||||
|
||||
4. Limitations on copyright
|
||||
|
||||
Nothing in this Licence is intended to deprive the Licensee of the benefits
|
||||
from any exception or limitation to the exclusive rights of the rights owners
|
||||
in the Work, of the exhaustion of those rights or of other applicable
|
||||
limitations thereto.
|
||||
|
||||
|
||||
5. Obligations of the Licensee
|
||||
|
||||
The grant of the rights mentioned above is subject to some restrictions and
|
||||
obligations imposed on the Licensee. Those obligations are the following:
|
||||
|
||||
Attribution right: The Licensee shall keep intact all copyright, patent or
|
||||
trademarks notices and all notices that refer to the Licence and to the
|
||||
disclaimer of warranties. The Licensee must include a copy of such notices
|
||||
and a copy of the Licence with every copy of the Work he/she distributes or
|
||||
communicates. The Licensee must cause any Derivative Work to carry prominent
|
||||
notices stating that the Work has been modified and the date of modification.
|
||||
|
||||
Copyleft clause: If the Licensee distributes or communicates copies of the
|
||||
Original Works or Derivative Works, this Distribution or Communication will
|
||||
be done under the terms of this Licence or of a later version of this Licence
|
||||
unless the Original Work is expressly distributed only under this version of
|
||||
the Licence — for example by communicating 'EUPL v. 1.2 only'. The Licensee
|
||||
(becoming Licensor) cannot offer or impose any additional terms or conditions
|
||||
on the Work or Derivative Work that alter or restrict the terms of the
|
||||
Licence.
|
||||
|
||||
Compatibility clause: If the Licensee Distributes or Communicates Derivative
|
||||
Works or copies thereof based upon both the Work and another work licensed
|
||||
under a Compatible Licence, this Distribution or Communication can be done
|
||||
under the terms of this Compatible Licence. For the sake of this clause,
|
||||
'Compatible Licence' refers to the licences listed in the appendix attached
|
||||
to this Licence. Should the Licensee's obligations under the Compatible
|
||||
Licence conflict with his/her obligations under this Licence, the obligations
|
||||
of the Compatible Licence shall prevail.
|
||||
|
||||
Provision of Source Code: When distributing or communicating copies of the
|
||||
Work, the Licensee will provide a machine-readable copy of the Source Code or
|
||||
indicate a repository where this Source will be easily and freely available
|
||||
for as long as the Licensee continues to distribute or communicate the Work.
|
||||
|
||||
Legal Protection: This Licence does not grant permission to use the trade
|
||||
names, trademarks, service marks, or names of the Licensor, except as
|
||||
required for reasonable and customary use in describing the origin of the
|
||||
Work and reproducing the content of the copyright notice.
|
||||
|
||||
|
||||
6. Chain of Authorship
|
||||
|
||||
The original Licensor warrants that the copyright in the Original Work
|
||||
granted hereunder is owned by him/her or licensed to him/her and that he/she
|
||||
has the power and authority to grant the Licence.
|
||||
|
||||
Each Contributor warrants that the copyright in the modifications he/she
|
||||
brings to the Work are owned by him/her or licensed to him/her and that
|
||||
he/she has the power and authority to grant the Licence.
|
||||
|
||||
Each time You accept the Licence, the original Licensor and subsequent
|
||||
Contributors grant You a licence to their contributions to the Work, under
|
||||
the terms of this Licence.
|
||||
|
||||
|
||||
7. Disclaimer of Warranty
|
||||
|
||||
The Work is a work in progress, which is continuously improved by numerous
|
||||
Contributors. It is not a finished work and may therefore contain defects or
|
||||
'bugs' inherent to this type of development.
|
||||
|
||||
For the above reason, the Work is provided under the Licence on an 'as is'
|
||||
basis and without warranties of any kind concerning the Work, including
|
||||
without limitation merchantability, fitness for a particular purpose, absence
|
||||
of defects or errors, accuracy, non-infringement of intellectual property
|
||||
rights other than copyright as stated in Article 6 of this Licence.
|
||||
|
||||
This disclaimer of warranty is an essential part of the Licence and a
|
||||
condition for the grant of any rights to the Work.
|
||||
|
||||
|
||||
8. Disclaimer of Liability
|
||||
|
||||
Except in the cases of wilful misconduct or damages directly caused to
|
||||
natural persons, the Licensor will in no event be liable for any direct or
|
||||
indirect, material or moral, damages of any kind, arising out of the Licence
|
||||
or of the use of the Work, including without limitation, damages for loss of
|
||||
goodwill, work stoppage, computer failure or malfunction, loss of data or any
|
||||
commercial damage, even if the Licensor has been advised of the possibility
|
||||
of such damage. However, the Licensor will be liable under statutory product
|
||||
liability laws as far such laws apply to the Work.
|
||||
|
||||
|
||||
9. Additional agreements
|
||||
|
||||
While distributing the Work, You may choose to conclude an additional
|
||||
agreement, defining obligations or services consistent with this Licence.
|
||||
However, if accepting obligations, You may act only on your own behalf and on
|
||||
your sole responsibility, not on behalf of the original Licensor or any other
|
||||
Contributor, and only if You agree to indemnify, defend, and hold each
|
||||
Contributor harmless for any liability incurred by, or claims asserted
|
||||
against such Contributor by the fact You have accepted any warranty or
|
||||
additional liability.
|
||||
|
||||
|
||||
10. Acceptance of the Licence
|
||||
|
||||
The provisions of this Licence can be accepted by clicking on an icon 'I
|
||||
agree' placed under the bottom of a window displaying the text of this
|
||||
Licence or by affirming consent in any other similar way, in accordance with
|
||||
the rules of applicable law. Clicking on that icon indicates your clear and
|
||||
irrevocable acceptance of this Licence and all of its terms and conditions.
|
||||
|
||||
Similarly, you irrevocably accept this Licence and all of its terms and
|
||||
conditions by exercising any rights granted to You by Article 2 of this
|
||||
Licence, such as the use of the Work, the creation by You of a Derivative
|
||||
Work or the Distribution or Communication by You of the Work or copies
|
||||
thereof.
|
||||
|
||||
|
||||
11. Information to the public
|
||||
|
||||
In case of any Distribution or Communication of the Work by means of
|
||||
electronic communication by You (for example, by offering to download the
|
||||
Work from a remote location) the distribution channel or media (for example,
|
||||
a website) must at least provide to the public the information requested by
|
||||
the applicable law regarding the Licensor, the Licence and the way it may be
|
||||
accessible, concluded, stored and reproduced by the Licensee.
|
||||
|
||||
|
||||
12. Termination of the Licence
|
||||
|
||||
The Licence and the rights granted hereunder will terminate automatically
|
||||
upon any breach by the Licensee of the terms of the Licence.
|
||||
|
||||
Such a termination will not terminate the licences of any person who has
|
||||
received the Work from the Licensee under the Licence, provided such persons
|
||||
remain in full compliance with the Licence.
|
||||
|
||||
|
||||
13. Miscellaneous
|
||||
|
||||
Without prejudice of Article 9 above, the Licence represents the complete
|
||||
agreement between the Parties as to the Work.
|
||||
|
||||
If any provision of the Licence is invalid or unenforceable under applicable
|
||||
law, this will not affect the validity or enforceability of the Licence as a
|
||||
whole. Such provision will be construed or reformed so as necessary to make
|
||||
it valid and enforceable.
|
||||
|
||||
The European Commission may publish other linguistic versions or new versions
|
||||
of this Licence or updated versions of the Appendix, so far this is required
|
||||
and reasonable, without reducing the scope of the rights granted by the
|
||||
Licence. New versions of the Licence will be published with a unique version
|
||||
number.
|
||||
|
||||
All linguistic versions of this Licence, approved by the European Commission,
|
||||
have identical value. Parties can take advantage of the linguistic version of
|
||||
their choice.
|
||||
|
||||
|
||||
14. Jurisdiction
|
||||
|
||||
Without prejudice to specific agreement between parties,
|
||||
|
||||
- any litigation resulting from the interpretation of this License, arising
|
||||
between the European Union institutions, bodies, offices or agencies, as a
|
||||
Licensor, and any Licensee, will be subject to the jurisdiction of the
|
||||
Court of Justice of the European Union, as laid down in article 272 of the
|
||||
Treaty on the Functioning of the European Union,
|
||||
|
||||
- any litigation arising between other parties and resulting from the
|
||||
interpretation of this License, will be subject to the exclusive
|
||||
jurisdiction of the competent court where the Licensor resides or conducts
|
||||
its primary business.
|
||||
|
||||
|
||||
15. Applicable Law
|
||||
|
||||
Without prejudice to specific agreement between parties,
|
||||
|
||||
- this Licence shall be governed by the law of the European Union Member
|
||||
State where the Licensor has his seat, resides or has his registered
|
||||
office,
|
||||
|
||||
- this licence shall be governed by Belgian law if the Licensor has no seat,
|
||||
residence or registered office inside a European Union Member State.
|
||||
|
||||
|
||||
Appendix
|
||||
|
||||
|
||||
'Compatible Licences' according to Article 5 EUPL are:
|
||||
|
||||
- GNU General Public License (GPL) v. 2, v. 3
|
||||
- GNU Affero General Public License (AGPL) v. 3
|
||||
- Open Software License (OSL) v. 2.1, v. 3.0
|
||||
- Eclipse Public License (EPL) v. 1.0
|
||||
- CeCILL v. 2.0, v. 2.1
|
||||
- Mozilla Public Licence (MPL) v. 2
|
||||
- GNU Lesser General Public Licence (LGPL) v. 2.1, v. 3
|
||||
- Creative Commons Attribution-ShareAlike v. 3.0 Unported (CC BY-SA 3.0) for
|
||||
works other than software
|
||||
- European Union Public Licence (EUPL) v. 1.1, v. 1.2
|
||||
- Québec Free and Open-Source Licence — Reciprocity (LiLiQ-R) or Strong
|
||||
Reciprocity (LiLiQ-R+).
|
||||
|
||||
The European Commission may update this Appendix to later versions of the
|
||||
above licences without producing a new version of the EUPL, as long as they
|
||||
provide the rights granted in Article 2 of this Licence and protect the
|
||||
covered Source Code from exclusive appropriation.
|
||||
|
||||
All other changes or additions to this Appendix require the production of a
|
||||
new EUPL version.
|
||||
219
README.md
219
README.md
@@ -1,173 +1,110 @@
|
||||
# Documentation
|
||||
# testium
|
||||
|
||||
[See here](doc/manual/testium_manual.pdf).
|
||||
testium is a YAML-driven test sequencer for hardware-in-the-loop and
|
||||
integration testing. A test campaign is described in a `.tum` file as a tree
|
||||
of items (checks, console interactions, Python/Lua functions, parallel blocks,
|
||||
dialogs, …); testium executes the tree, captures results, and produces
|
||||
reports in several formats.
|
||||
|
||||
# run testium
|
||||
## Documentation
|
||||
|
||||
From the root path, on windows `cmd`:
|
||||
* [Quick start](doc/quick_start.md) — install and run your first test in
|
||||
five minutes.
|
||||
* [Tutorial](doc/tutorial.md) — guided walk-through of the most common
|
||||
test items with a runnable example.
|
||||
* [User manual (PDF)](doc/manual/testium_manual.pdf) — full reference.
|
||||
* [`doc/examples/`](doc/examples/) — runnable `.tum` snippets.
|
||||
|
||||
run.bat
|
||||
## Pre-built releases
|
||||
|
||||
On windows powershell:
|
||||
Pre-built artifacts are published at
|
||||
<https://git.beafrancois.fr/v-and-v/testium/releases>:
|
||||
|
||||
run.ps1
|
||||
* **Python wheel** (`testium-<version>-py3-none-any.whl`) — install with
|
||||
`pip install testium-*.whl`. Lighter than the binary; pulls Python
|
||||
dependencies from PyPI on install.
|
||||
* **Self-contained Linux binary** (`testium`, built with PyInstaller) —
|
||||
runnable directly, no Python installation required on the host. Lua
|
||||
support still needs a system `lua` interpreter and the `lua-socket` /
|
||||
`lua-cjson` modules.
|
||||
* **Flatpak** — *coming soon.*
|
||||
|
||||
On linux:
|
||||
## Quick start
|
||||
|
||||
./run.sh
|
||||
From a checkout of the repository:
|
||||
|
||||
The virtual environment is created if needed and *testium* is started.
|
||||
| OS | Command |
|
||||
|----|---------|
|
||||
| Linux | `./run.sh` |
|
||||
| Windows (cmd) | `run.bat` |
|
||||
| Windows (PowerShell) | `run.ps1` |
|
||||
|
||||
# Manual setup
|
||||
The wrapper creates a Python virtual environment on first run and starts
|
||||
testium in GUI mode. Add `-b path/to/test.tum` to run a test in batch mode.
|
||||
|
||||
A python virtual environment should be created:
|
||||
## Manual installation
|
||||
|
||||
python3 -m venv <testium_venv>
|
||||
If the wrapper script does not fit your environment, set up testium manually:
|
||||
|
||||
## Requirements
|
||||
|
||||
In the virtual environment, the following modules must be installed:
|
||||
|
||||
* pyside6
|
||||
* pyserial
|
||||
* pyyaml
|
||||
* pexpect
|
||||
* gitpython
|
||||
* jinja2
|
||||
* colorama
|
||||
* matplotlib
|
||||
* junit-xml
|
||||
* lxml
|
||||
|
||||
A `requirements.txt` file is also available in the git repository in the path `testium/src/`.
|
||||
|
||||
|
||||
## run testium
|
||||
|
||||
from the testium path, execute
|
||||
|
||||
python3 -m src/testium
|
||||
|
||||
# Doc generation
|
||||
|
||||
## Install sphinx
|
||||
|
||||
pip install sphinx
|
||||
|
||||
## Generate the doc
|
||||
|
||||
Execute
|
||||
|
||||
doc/manual/sphinx/./build_doc.sh
|
||||
|
||||
This command works if texlive package has been installed on the system. It can be done by invoking the following command.
|
||||
|
||||
sudo apt install texlive-full
|
||||
|
||||
# QT GUI
|
||||
|
||||
## QT GUI modification
|
||||
|
||||
Open the ".ui" file with `qtcreator` and modify the gui. Then regenerate the python code.
|
||||
|
||||
On linux, a helper script has been created:
|
||||
scripts/./qt_generate.sh
|
||||
|
||||
# Debugging
|
||||
|
||||
In order to debug testium or your python script executed within testium.
|
||||
|
||||
## In VSCODE
|
||||
|
||||
This is the prefered method :
|
||||
|
||||
1. Create a debug configuration like the following:
|
||||
|
||||
```
|
||||
"configurations": [
|
||||
{
|
||||
"name": "Python : testium",
|
||||
"type": "python",
|
||||
"request": "launch",
|
||||
"program": "${workspaceFolder}/src/testium",
|
||||
"console": "integratedTerminal",
|
||||
"args": ["-g"],
|
||||
"justMyCode": true
|
||||
},
|
||||
]
|
||||
```sh
|
||||
python3 -m venv .venv
|
||||
source .venv/bin/activate
|
||||
pip install -r src/requirements.txt
|
||||
```
|
||||
|
||||
2. Install debugpy module in python
|
||||
Required Python packages (see `src/requirements.txt`):
|
||||
`pyside6`, `pyserial`, `pyyaml`, `pexpect`, `gitpython`, `jinja2`, `colorama`,
|
||||
`matplotlib`, `junit-xml`, `lxml`.
|
||||
|
||||
python -m pip install debugpy
|
||||
3. Then get to the "RUN AND DEBUG" tab and press the play button.
|
||||
4. A testium window will pops up ; start execution of your tum.
|
||||
5. Do not forget to put breakpoints where you want to investigate.
|
||||
For tests using `lua_func` items, install Lua (>= 5.1) plus the `socket` and
|
||||
`cjson` modules. On Debian/Ubuntu:
|
||||
|
||||
## Icons
|
||||
```sh
|
||||
sudo apt install lua5.4 lua-socket lua-cjson
|
||||
```
|
||||
|
||||
Icons are coming from the following site: https://github.com/free-icons/free-icons.git
|
||||
Run testium:
|
||||
|
||||
# testium Release
|
||||
```sh
|
||||
python3 src/testium # GUI
|
||||
python3 src/testium -b mytest.tum # batch
|
||||
```
|
||||
|
||||
## Pre-requisite
|
||||
## Troubleshooting
|
||||
|
||||
A `python` virtual environment must have been set as described above.
|
||||
### `wl_proxy_marshal_flags` symbol error
|
||||
|
||||
### Install pyinstaller
|
||||
```
|
||||
testium: symbol lookup error: ... undefined symbol: wl_proxy_marshal_flags
|
||||
```
|
||||
|
||||
Install `pyinstaller` package using pip.
|
||||
Force the X11 Qt backend:
|
||||
|
||||
## Generate the binary package
|
||||
```sh
|
||||
export QT_QPA_PLATFORM=xcb
|
||||
testium
|
||||
```
|
||||
|
||||
The procedure for a binary release is as follows:
|
||||
### `xcb plugin missing`
|
||||
|
||||
1. update the `release_note.txt` file
|
||||
2. modify the version in `src/VERSION` file
|
||||
3. be sure that the documentation is up to date, and if not execute `doc/manual/sphinx/build_doc.sh` script
|
||||
4. push modifications and create a tag with the new version on the git repository
|
||||
5. generate an executable file by calling `package/pyinstaller/./build.sh`
|
||||
6. run the complete validation test for each generated binary
|
||||
7. check that all the validation results are OK
|
||||
```
|
||||
qt.qpa.plugin: Could not load the Qt platform plugin "xcb"
|
||||
```
|
||||
|
||||
# Troubleshooting
|
||||
Install the missing system libraries:
|
||||
|
||||
## The testium exe crashes `wl_proxy_marshal_flags`
|
||||
```sh
|
||||
sudo apt install libxcb-cursor0 libicu-dev libxcb-cursor-dev
|
||||
```
|
||||
|
||||
### Error message
|
||||
## License
|
||||
|
||||
/testium: symbol lookup error: /tmp/_MEIOhDCPF/libQt6WaylandClient.so.6: undefined symbol: wl_proxy_marshal_flags
|
||||
Copyright © 2025-2026 François Dausseur.
|
||||
|
||||
### Solution
|
||||
testium is distributed under the **European Union Public Licence v. 1.2
|
||||
(EUPL-1.2)** — see [`LICENSE`](LICENSE) for the full text. SPDX:
|
||||
`EUPL-1.2`.
|
||||
|
||||
Set the appropriate environment variable
|
||||
|
||||
export QT_QPA_PLATFORM=xcb
|
||||
testium
|
||||
|
||||
## xcb plugin missing
|
||||
|
||||
### Error message
|
||||
|
||||
qt.qpa.plugin: Could not load the Qt platform plugin "xcb" in "" even though it was found.
|
||||
|
||||
### Solution
|
||||
|
||||
A package is missing
|
||||
|
||||
sudo apt install libxcb-cursor0
|
||||
sudo apt-get install libicu-dev
|
||||
sudo apt-get install libxcb-cursor-dev
|
||||
|
||||
## The testium appimage crashes when opening a file
|
||||
|
||||
This is usually because wayland is defined as the default X server.
|
||||
|
||||
To change it :
|
||||
|
||||
* Disable Wayland by uncommenting WaylandEnable=false in the `/etc/gdm3/daemon.conf`
|
||||
* Add `QT_QPA_PLATFORM=xcb` in `/etc/environment`
|
||||
* After a reboot, check that the environment variable value returns `x11`:
|
||||
|
||||
$ echo $XDG_SESSION_TYPE
|
||||
x11
|
||||
Contributions are accepted under the same licence (inbound = outbound).
|
||||
See [`CONTRIBUTING.md`](CONTRIBUTING.md) for development setup, debugging
|
||||
workflow, and the release procedure.
|
||||
|
||||
@@ -1,4 +1,4 @@
|
||||
|
||||
- unittest_file:
|
||||
- unittest:
|
||||
name: Test 5
|
||||
test_file: dummy.py
|
||||
|
||||
@@ -3,7 +3,7 @@ sequence: &endurance_test
|
||||
!include endurance.tum
|
||||
|
||||
sequence:
|
||||
- unittest_file:
|
||||
- unittest:
|
||||
name: Test 3
|
||||
test_file: dummy.py
|
||||
test_method: test_01_pass
|
||||
@@ -11,6 +11,6 @@ sequence:
|
||||
iterator: 10
|
||||
steps:
|
||||
*endurance_test
|
||||
- unittest_file:
|
||||
- unittest:
|
||||
name: Test 4
|
||||
test_file: dummy.py
|
||||
|
||||
@@ -15,7 +15,7 @@ main:
|
||||
- $(reference_1)
|
||||
- $(reference_2)
|
||||
report_show_success: true
|
||||
- unittest_file:
|
||||
- unittest:
|
||||
name: Test 1
|
||||
test_file: dummy.py
|
||||
doc: |
|
||||
@@ -23,7 +23,7 @@ main:
|
||||
Voilà...
|
||||
- sleep:
|
||||
{name: Sleep between one and two, timeout: 10, dialog: true}
|
||||
- unittest_file:
|
||||
- unittest:
|
||||
{name: Test 2, test_file: dummy.py,execute_on_stop: true}
|
||||
- loop:
|
||||
name: Cycle Temperature
|
||||
|
||||
@@ -1,5 +1,5 @@
|
||||
|
||||
import libs.testium as tm
|
||||
import py_func.tm as tm
|
||||
|
||||
def post_exec():
|
||||
print('Success !!!!')
|
||||
|
||||
@@ -14,7 +14,7 @@ main:
|
||||
key: report-key-2
|
||||
stop_on_failure: True
|
||||
steps:
|
||||
- unittest_file:
|
||||
- unittest:
|
||||
name: unittest item
|
||||
doc: |
|
||||
The purpose of this unittest test item is to demonstrate
|
||||
@@ -41,7 +41,7 @@ main:
|
||||
param:
|
||||
- 123
|
||||
|
||||
- unittest_file:
|
||||
- unittest:
|
||||
name: Unittest item
|
||||
test_file: dummy/dummy.py
|
||||
test_method:
|
||||
@@ -98,7 +98,7 @@ main:
|
||||
name: Infine loop unittest step crashes
|
||||
stop_on_failure: True
|
||||
steps:
|
||||
- unittest_file:
|
||||
- unittest:
|
||||
name: Unittest item
|
||||
test_file: dummy/dummy.py
|
||||
test_method:
|
||||
@@ -243,7 +243,7 @@ main:
|
||||
name: Infinite loop
|
||||
skipped: True
|
||||
steps:
|
||||
- unittest_file:
|
||||
- unittest:
|
||||
name: Unittest item
|
||||
test_file: dummy/dummy.py
|
||||
test_method: test_01_pass
|
||||
|
||||
@@ -9,7 +9,7 @@ main:
|
||||
name: Test Sample number one
|
||||
version: 0.1
|
||||
steps:
|
||||
- unittest_file:
|
||||
- unittest:
|
||||
name: Unittest item
|
||||
test_file: dummy/unittest_str.py
|
||||
doc: Unittest test
|
||||
@@ -88,7 +88,7 @@ main:
|
||||
name: cycle item
|
||||
iterator : 3
|
||||
steps:
|
||||
- unittest_file:
|
||||
- unittest:
|
||||
name: Unittest item
|
||||
test_file: dummy/dummy.py
|
||||
test_method: test_01_pass
|
||||
@@ -99,7 +99,7 @@ main:
|
||||
name: cycle item
|
||||
iterator : 3
|
||||
steps:
|
||||
- unittest_file:
|
||||
- unittest:
|
||||
name: Unittest item
|
||||
test_file: dummy/dummy.py
|
||||
test_method: test_01_pass
|
||||
|
||||
@@ -3,7 +3,7 @@ Command Line Interface
|
||||
|
||||
.. code-block:: text
|
||||
|
||||
usage: testium.pyw [-h] [--version] [-b] [-m] [-c CONFIG_FILE [CONFIG_FILE ...]] [-r] [-l LOG_FILE]
|
||||
usage: testium.pyw [-h] [--version] [-b] [-c CONFIG_FILE [CONFIG_FILE ...]] [-r] [-l LOG_FILE]
|
||||
[-d DEFINE [DEFINE ...]] [-p REPORT_FILE] [-t {sqlite,json,junit,html,text}]
|
||||
[-n REPORT_PATTERN [REPORT_PATTERN ...]] [-i INCLUDE_PATH [INCLUDE_PATH ...]] [-o] [-g]
|
||||
[test_file]
|
||||
@@ -16,9 +16,8 @@ Command Line Interface
|
||||
--version Returns the version of testium
|
||||
-b, --batch-execution
|
||||
Executes the test in batch mode
|
||||
-m, --terminal Starts terminal mode
|
||||
-c CONFIG_FILE [CONFIG_FILE ...], --config-file CONFIG_FILE [CONFIG_FILE ...]
|
||||
-o, --no-color Deactivates stdout colors in batch and terminal mode
|
||||
-o, --no-color Deactivates stdout colors in batch mode
|
||||
Configuration file
|
||||
-r, --run-and-close Runs the test then closes the application
|
||||
-l LOG_FILE, --log-file LOG_FILE
|
||||
@@ -45,17 +44,10 @@ Returns what's in the previous section.
|
||||
|
||||
Executes the test in text mode. No need to have QT installed in that case.
|
||||
|
||||
``-m, --terminal``
|
||||
------------------
|
||||
|
||||
Starts a testium interactive console. It allows to run commands and sub-tests manually
|
||||
in a console.
|
||||
|
||||
|
||||
``-o, --no-color``
|
||||
------------------
|
||||
|
||||
Switch allowing to disable the colored output in terminal or batch modes.
|
||||
Switch allowing to disable the colored output in batch mode.
|
||||
|
||||
``-c, --config-file``
|
||||
---------------------
|
||||
|
||||
@@ -4,7 +4,12 @@ Python helper library
|
||||
======================
|
||||
|
||||
A python library including helper function for python modules called from
|
||||
testium.
|
||||
testium ``py_func`` items.
|
||||
|
||||
User scripts run inside the ``py_func`` subprocess and interact with testium
|
||||
through a JSON-RPC bridge — the ``py_func.tm`` module. They must **not**
|
||||
import ``api.testium`` or ``interpreter.*`` directly: those are main-process
|
||||
modules and may not even be reachable in a packaged build (PyInstaller, .deb).
|
||||
|
||||
To include the support of this library in a python script, the following
|
||||
line must be included in the script header:
|
||||
@@ -18,58 +23,38 @@ line must be included in the script header:
|
||||
|
||||
Global variables helper functions
|
||||
----------------------------------
|
||||
To manage values in the global variables dataset, the following testium library API
|
||||
must be used:
|
||||
To manage values in the global variables dataset:
|
||||
|
||||
.. automodule:: py_func.tm
|
||||
:members: gd, setgd, delgd
|
||||
:undoc-members:
|
||||
:no-index:
|
||||
|
||||
Console helper functions
|
||||
------------------------
|
||||
|
||||
Every opened console instance is added to a list with the
|
||||
key ``console_instances`` of the global variables.
|
||||
|
||||
The instance is removed from the list on close step of the ``console`` test item.
|
||||
|
||||
To manage consoles from within ``py_func`` python functions,
|
||||
the following testium library API can be used:
|
||||
|
||||
.. automodule:: libs.testium
|
||||
:members: add_console, remove_console, console
|
||||
:undoc-members:
|
||||
:no-index:
|
||||
|
||||
Plot helper functions
|
||||
------------------------
|
||||
|
||||
Every opened plot window instance is added to a list with the
|
||||
key ``plot_instances`` of the global variables.
|
||||
Add values to a running plot or read the last value from it:
|
||||
|
||||
The instance is removed from the list on close step of the ``plot`` test item.
|
||||
|
||||
To manage plots from within ``py_func`` python functions,
|
||||
the following testium library API can be used:
|
||||
|
||||
.. automodule:: libs.testium
|
||||
:members: add_plot, remove_plot, plot, add_plot_values, last_plot_value
|
||||
.. automodule:: py_func.tm
|
||||
:members: add_plot_values, last_plot_value
|
||||
:undoc-members:
|
||||
:no-index:
|
||||
|
||||
Console and plot **lifecycle** management (``add_console``, ``remove_console``,
|
||||
``console``, ``add_plot``, ``remove_plot``, ``plot``) is performed by the
|
||||
``console`` and ``plot`` test items themselves — not from user ``py_func``
|
||||
scripts. Use those test items to open/close consoles and plots.
|
||||
|
||||
Other helper functions
|
||||
------------------------
|
||||
|
||||
.. automodule:: libs.testium
|
||||
:members: OS, get_main_dir, timestamp, timestamp_as_sec
|
||||
.. automodule:: py_func.tm
|
||||
:members: OS, get_main_dir, init_timestamp, timestamp, timestamp_as_sec, text_mode
|
||||
:undoc-members:
|
||||
:no-index:
|
||||
|
||||
Debug mode
|
||||
------------------------
|
||||
|
||||
.. automodule:: libs.testium
|
||||
:members: debug_enabled, enable_debug, print_debug, print_info, print_warn
|
||||
:undoc-members:
|
||||
:no-index:
|
||||
The ``test_debug`` global variable controls debug-only output. Read or write
|
||||
it via ``tm.gd("test_debug")`` / ``tm.setgd("test_debug", True)``.
|
||||
|
||||
@@ -23,23 +23,3 @@ graphical interface.
|
||||
:caption: call a test in batch mode
|
||||
|
||||
testium -b test/my_test/main.tum
|
||||
|
||||
Terminal mode
|
||||
-------------
|
||||
|
||||
The terminal mode starts *testium* in interactive mode. From this console, some tests and
|
||||
sequences of tests can be called interactively.
|
||||
|
||||
.. code-block:: text
|
||||
:caption: call a test in terminal mode
|
||||
|
||||
$ testium -m
|
||||
Configuration file loaded: /my/execution/path/param.yaml
|
||||
[...]
|
||||
================================================================================
|
||||
====== Test configuration
|
||||
================================================================================
|
||||
Test executed with testium : 2.4.0 (binary release)
|
||||
|
||||
|
||||
(testium)~
|
||||
|
||||
@@ -75,7 +75,7 @@ a tooltip on the test row.
|
||||
name: Test example
|
||||
steps:
|
||||
|
||||
- unittest_file:
|
||||
- unittest:
|
||||
name: unittest item
|
||||
doc: |
|
||||
The purpose of this unittest test item is to demonstrate
|
||||
@@ -93,4 +93,4 @@ See illustration in :numref:`Figure %s<doc-illustration>`.
|
||||
Unittest
|
||||
^^^^^^^^^
|
||||
|
||||
For ``unittest_file`` type test items, the python docstring of the test method is used as documentation.
|
||||
For ``unittest`` type test items, the python docstring of the test method is used as documentation.
|
||||
|
||||
@@ -6,7 +6,7 @@ This software is developed in python and it implements the Qt6 graphical framewo
|
||||
|
||||
It has been developed since 2013 with production and development testing in mind.
|
||||
|
||||
It's function is to automate the execution of tests. It can be invoked either as command line terminal application or as a graphical interface application.
|
||||
It's function is to automate the execution of tests. It can be invoked either as command line application or as a graphical interface application.
|
||||
|
||||
Tests reports generation and customization are also in this tool's scope.
|
||||
|
||||
|
||||
@@ -6,18 +6,25 @@ Reports
|
||||
If a report is required (in addition to the log), the ``report`` YAML element
|
||||
must be added at the root of the TUM main test file.
|
||||
|
||||
The ``report`` YAML element has the following form:
|
||||
The ``report`` element accepts a single export or a list of them under the
|
||||
``export`` key. Each export entry uses the format name as its key:
|
||||
|
||||
.. code-block:: yaml
|
||||
:caption: reports global settings
|
||||
:caption: reports global settings — multiple exports
|
||||
|
||||
report:
|
||||
enabled: True
|
||||
file_name: $(test_name).rep
|
||||
log_stored: True
|
||||
export:
|
||||
- sqlite:
|
||||
path: $(home)/reports
|
||||
pattern: "Console%"
|
||||
export: junit
|
||||
log_stored: False
|
||||
file_name: $(test_name).db
|
||||
- junit:
|
||||
path: $(home)/reports
|
||||
file_name: $(test_name).xml
|
||||
- html:
|
||||
path: $(home)/reports
|
||||
file_name: $(test_name).html
|
||||
|
||||
.. table:: report attributes
|
||||
:widths: 20, 30, 50
|
||||
@@ -27,21 +34,93 @@ The ``report`` YAML element has the following form:
|
||||
+-----------------+-----------------------+-------------------------------------------+
|
||||
| ``enabled`` | ``True`` | Report activated |
|
||||
+-----------------+-----------------------+-------------------------------------------+
|
||||
| ``file_name`` | / | Report file name |
|
||||
| ``log_stored`` | ``False`` | When ``True``, captures stdout per test |
|
||||
| | | item so exports (html, json) can include |
|
||||
| | | the log of each item. |
|
||||
+-----------------+-----------------------+-------------------------------------------+
|
||||
| ``path`` | ``$(report_path)`` | Report storage path By default, it uses |
|
||||
| | | the default one set in the |
|
||||
| | | preferences. |
|
||||
| ``export`` | / | One export entry or a list of them. Each |
|
||||
| | | entry's key is the format name (see |
|
||||
| | | below). |
|
||||
+-----------------+-----------------------+-------------------------------------------+
|
||||
| ``pattern`` | / | The pattern in SQL wildachars syntax |
|
||||
| | | to be applied on test names to |
|
||||
| | | selected reported tests. |
|
||||
|
||||
Each export entry supports the following sub-attributes:
|
||||
|
||||
.. table:: export attributes
|
||||
:widths: 20, 30, 50
|
||||
|
||||
+-----------------+-----------------------+-------------------------------------------+
|
||||
| ``export`` | / | The type of export. For exemple junit. |
|
||||
| | | By default, the sqlite format is |
|
||||
| | | used to generate reports. |
|
||||
| Attribute | default value | Description |
|
||||
+-----------------+-----------------------+-------------------------------------------+
|
||||
| ``log_stored`` | / | Defines if the output log of each |
|
||||
| | | test is accessible to generate the |
|
||||
| | | report export. |
|
||||
| ``path`` | ``$(report_path)`` | Output directory. |
|
||||
+-----------------+-----------------------+-------------------------------------------+
|
||||
| ``file_name`` | / | Output file name. May include |
|
||||
| | | ``$(...)`` global-dict expansions. |
|
||||
+-----------------+-----------------------+-------------------------------------------+
|
||||
| ``pattern`` | / | One or more SQL ``LIKE`` patterns |
|
||||
| | | applied on the test ``name``. |
|
||||
+-----------------+-----------------------+-------------------------------------------+
|
||||
| ``key`` | / | One or more SQL ``LIKE`` patterns |
|
||||
| | | applied on the test ``key`` |
|
||||
| | | (the per-item ``key`` attribute). |
|
||||
+-----------------+-----------------------+-------------------------------------------+
|
||||
|
||||
Built-in formats
|
||||
^^^^^^^^^^^^^^^^
|
||||
|
||||
* ``sqlite`` — raw SQLite database (storage layer; selecting it persists the run).
|
||||
* ``text`` — simple indented text dump of the test tree.
|
||||
* ``json`` — full report as JSON: ``{"header": {...}, "tests": [...]}``.
|
||||
* ``junit`` — JUnit XML (requires the ``junit_xml`` Python package).
|
||||
* ``html`` — single HTML page with header, results table and per-item logs (requires ``lxml``).
|
||||
|
||||
If a format is unknown or its optional dependency is missing, the export is
|
||||
skipped with an ``[report] Export skipped: ...`` info line on stdout — the
|
||||
test run is **not** interrupted.
|
||||
|
||||
.. _sec_reports_plugins:
|
||||
|
||||
Custom export formats (plugins)
|
||||
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
|
||||
|
||||
A third-party Python package can register additional export formats via the
|
||||
``testium.exporters`` setuptools entry point group. Once installed in the same
|
||||
Python environment as testium, the format is auto-detected at startup and can
|
||||
be referenced from the YAML by its declared name.
|
||||
|
||||
Plugin contract — a class with this constructor signature:
|
||||
|
||||
.. code-block:: python
|
||||
:caption: minimal exporter contract
|
||||
|
||||
class MyExporter:
|
||||
def __init__(self, name, con, path, pats, keys, no_header=False):
|
||||
# name : str — report name
|
||||
# con : sqlite3.Connection (read) — tables: header, tests
|
||||
# path : str — output file path (already expansed)
|
||||
# pats : list[str] — LIKE filters on test_name (may be empty)
|
||||
# keys : list[str] — LIKE filters on report_key (may be empty)
|
||||
# no_header : bool — skip header section (set by the inline
|
||||
# `report` test item)
|
||||
... # do the work in __init__ and write to `path`
|
||||
|
||||
Tables and columns of the SQLite report:
|
||||
|
||||
* ``header(key TEXT, value TEXT)`` — keys: ``report_version``, ``test_file``,
|
||||
``test_name``, ``test_result``, ``test_revision``, ``testium_version``,
|
||||
``testrun_date``, ``testrun_time``, ``test_duration``.
|
||||
* ``tests`` — 12 columns: ``timestamp_start``, ``test_id``, ``parent_id``,
|
||||
``level``, ``test_name``, ``test_type``, ``report_key``, ``result``
|
||||
(``PASS``/``FAIL``/``SKIP``), ``message``, ``duration`` (ms),
|
||||
``log`` (captured stdout when ``log_stored: True``), ``data`` (JSON of
|
||||
values reported via ``self.reportValue(...)``).
|
||||
|
||||
Declaration in the plugin's ``pyproject.toml``:
|
||||
|
||||
.. code-block:: toml
|
||||
:caption: registering an exporter via entry-points
|
||||
|
||||
[project.entry-points."testium.exporters"]
|
||||
my_format = "my_pkg:MyExporter"
|
||||
|
||||
The plugin is then usable in any ``.tum`` report block as ``my_format:`` —
|
||||
no testium configuration change required.
|
||||
|
||||
@@ -10,7 +10,7 @@ This element is of the following form:
|
||||
name: Group Item
|
||||
condition: <| "$(OS)" == "Linux" |>
|
||||
steps:
|
||||
- unittest_file:
|
||||
- unittest:
|
||||
test_file: test_prod_alpha_13.py
|
||||
test_method:
|
||||
...
|
||||
|
||||
@@ -33,7 +33,7 @@ if not provided is given in the table as well.
|
||||
| | | It depends on the test item to take it |
|
||||
| | | into account or not. |
|
||||
| | | For example it makes sense to use it |
|
||||
| | | for ``unittest_file`` test type |
|
||||
| | | for ``unittest`` test type |
|
||||
| | | because it can contain many sub-tests, |
|
||||
| | | but not for sleep test type. |
|
||||
| | | In cycles, it means that the child |
|
||||
|
||||
@@ -12,7 +12,7 @@ This element is of the following form:
|
||||
name: Cycle Temperature
|
||||
iterator: 10
|
||||
steps:
|
||||
- unittest_file:
|
||||
- unittest:
|
||||
test_file: test_prod_rio6_8093.py
|
||||
- py_func:
|
||||
name: function test item
|
||||
|
||||
97
doc/manual/sphinx/source/test_items/parallel_test_item.rst
Normal file
97
doc/manual/sphinx/source/test_items/parallel_test_item.rst
Normal file
@@ -0,0 +1,97 @@
|
||||
.. _sec_parallel_item:
|
||||
|
||||
**parallel** test item
|
||||
============================================================
|
||||
|
||||
This element is of the following form:
|
||||
|
||||
.. code-block:: yaml
|
||||
:caption: ``parallel`` test item usage example
|
||||
|
||||
- parallel:
|
||||
name: My parallel block
|
||||
sync: all
|
||||
branches:
|
||||
- name: Branch A
|
||||
steps:
|
||||
- py_func:
|
||||
name: Long operation
|
||||
file: long_op.py
|
||||
func_name: do_work
|
||||
- name: Branch B
|
||||
wait_for:
|
||||
condition: <| "$(ready_flag)" == "True" |>
|
||||
timeout: 30
|
||||
steps:
|
||||
- let:
|
||||
name: Mark done
|
||||
values:
|
||||
- branch_b_done: true
|
||||
|
||||
The ``parallel`` element runs several sequences of items concurrently. Each
|
||||
inner sequence is called a *branch* and runs in its own thread. The parent
|
||||
test item waits for branches to finish according to the ``sync`` policy.
|
||||
|
||||
Attributes
|
||||
--------------------
|
||||
|
||||
* ``branches``: required. A list of branches to execute concurrently. Each
|
||||
branch has a ``name`` and a ``steps`` list (same structure as a ``group``
|
||||
item). It can also declare a ``wait_for`` precondition (see below).
|
||||
* ``sync``: optional, defaults to ``all``.
|
||||
|
||||
* ``all``: the parallel item completes when *every* branch has finished.
|
||||
The result is ``PASS`` if no branch returned ``FAIL`` (skipped or
|
||||
disabled branches are ignored, like in ``group``); otherwise ``FAIL``.
|
||||
* ``any``: the parallel item completes as soon as the *first* branch
|
||||
finishes. The remaining branches are stopped (their next test items
|
||||
are not executed). The result is ``PASS`` if at least one branch
|
||||
succeeded.
|
||||
|
||||
* ``no_fail``: optional. When ``true``, a ``FAIL`` result is forced to
|
||||
``PASS`` for the parallel item itself (same semantics as for any test
|
||||
item). Branches keep their own result.
|
||||
|
||||
Branch attributes
|
||||
--------------------
|
||||
|
||||
Each entry of ``branches`` is a dict with the following attributes:
|
||||
|
||||
* ``name``: required. The branch name. Used in reports and as a prefix
|
||||
in the live log output (each line printed by the branch is prefixed
|
||||
with the branch name in square brackets, e.g. ``[Branch A]``, so
|
||||
concurrent branches stay readable).
|
||||
* ``steps``: required. The list of test items executed sequentially
|
||||
inside the branch.
|
||||
* ``wait_for``: optional. Forces the branch to wait until a condition is
|
||||
met before running its steps. If the timeout elapses, the branch
|
||||
returns ``FAIL`` (the steps are not run). Sub-attributes:
|
||||
|
||||
* ``condition``: a testium expression evaluated repeatedly (every
|
||||
100 ms) until it returns ``True``.
|
||||
* ``timeout``: maximum wait, in seconds. Defaults to 30.
|
||||
|
||||
Reporting
|
||||
--------------------
|
||||
|
||||
Each branch produces its own row in the SQLite report (with type
|
||||
``Parallel branch``), in addition to the parent ``Parallel`` row. The
|
||||
``log`` column of each row contains only the output emitted from that
|
||||
branch's thread, so logs are never mixed between concurrent branches.
|
||||
|
||||
In the live (terminal / GUI) output, lines emitted from a branch are
|
||||
prefixed with the branch name in square brackets (e.g. ``[Branch A]``).
|
||||
The prefix is not stored in the SQLite log column.
|
||||
|
||||
Notes
|
||||
--------------------
|
||||
|
||||
* A ``sleep`` item inside a branch is interruptible: if another
|
||||
``sync: any`` branch wins the race, slow ``sleep`` items are aborted
|
||||
within ~50 ms.
|
||||
* A ``py_func`` or ``console`` item inside a branch is **not**
|
||||
interruptible: a ``sync: any`` stop will only take effect after the
|
||||
current item returns. The branch will then skip its remaining steps.
|
||||
* When a user disables a branch in the GUI tree, the branch returns
|
||||
``SKIP`` instantly without affecting the others (it does *not* win a
|
||||
``sync: any`` race).
|
||||
@@ -13,7 +13,7 @@ class ``py_func`` item
|
||||
|
||||
This is the normal way of calling some custom python code.
|
||||
|
||||
A class must be defined and derived from ``FunctionItem`` from the ``libs.testium`` module.
|
||||
A class must be defined and derived from ``FunctionItem`` from the ``py_func.tm`` module.
|
||||
|
||||
From this class it is possible to define some custom reported values with the following API
|
||||
|
||||
|
||||
@@ -1,16 +1,23 @@
|
||||
**run** test item
|
||||
============================================================
|
||||
|
||||
This test item executes a new instance of testium.
|
||||
This test item executes a new instance of testium with the specified ``.tum`` file.
|
||||
|
||||
* In **batch mode** (``-b``): the sub-instance is started with ``-b``.
|
||||
* In **GUI mode**: the sub-instance is started with ``-r`` (run and close).
|
||||
|
||||
The item result is **PASS** if the sub-instance launched and ran to completion,
|
||||
regardless of whether the sub-tests passed or failed.
|
||||
It is **FAIL** if the file could not be found, the sub-instance could not be
|
||||
launched, or the time window was not reached (see ``start_time`` / ``end_time``).
|
||||
|
||||
.. code-block:: yaml
|
||||
:caption: ``run`` test item usage example
|
||||
|
||||
- run:
|
||||
name: Execute TUM
|
||||
tum_fime: example_cycle.tum
|
||||
tum: example_cycle.tum
|
||||
python_bin: python3
|
||||
testium_path: /home/francois/projets/testium-new-report/testium.pyw
|
||||
log_file: $(home)/reports/test.log
|
||||
report_file: $(home)/reports/test.rep
|
||||
|
||||
@@ -19,12 +26,12 @@ Attributes
|
||||
|
||||
run test item has the following specific attributes:
|
||||
|
||||
* ``tum_fime``: mandatory the path of the file to execute, it can be relative to current execution folder,
|
||||
* ``param_file`` (optional) the path of the parameter file to use, otherwise default parameter file is used.
|
||||
* ``python_bin`` (optional) the path of a specific python to run your scripts,
|
||||
* ``testium_path`` (optional) the path of a specific testium to run your scripts,
|
||||
* ``log_file`` (optional) the path of log file to register, if not provided a file is created with timestamp at the location of TUM file.
|
||||
* ``report_file`` (optional), the path of report file to create
|
||||
* ``start_time`` (optional), start time for the script execution, in HH:MM format.
|
||||
* ``end_time`` (optional), end time for an execution within a time frame, in HH:MM format.
|
||||
* ``wait_for_exec`` (optional). True or False, wait to be in the execution window defined by start_time and end_time to run the script.
|
||||
* ``tum``: mandatory, the path of the file to execute. Can be relative to the current execution folder.
|
||||
* ``param_file`` (optional): the path of the parameter file to use; otherwise the default parameter file is used.
|
||||
* ``python_bin`` (optional): the path of a specific Python interpreter to use.
|
||||
* ``testium_path`` (optional): the path of a specific testium executable to use.
|
||||
* ``log_file`` (optional): the path of the log file. In GUI mode, if not provided, a file is created with a timestamp next to the ``.tum`` file. Not used in batch mode.
|
||||
* ``report_file`` (optional): the path of the report file to create.
|
||||
* ``start_time`` (optional): earliest time to execute the sub-instance, in ``HH:MM`` format.
|
||||
* ``end_time`` (optional): latest time for execution within a time frame, in ``HH:MM`` format.
|
||||
* ``wait_for_exec`` (optional): ``true`` to wait until the time window defined by ``start_time`` and ``end_time`` is reached before running. Requires both ``start_time`` and ``end_time``.
|
||||
@@ -1,15 +1,15 @@
|
||||
**unittest_file** test item
|
||||
**unittest** test item
|
||||
============================================================
|
||||
|
||||
unittest_file test item allows the execution of unittest test script which
|
||||
unittest test item allows the execution of unittest test script which
|
||||
is part of python standard libraries.
|
||||
|
||||
The tum file prototype is as followed:
|
||||
|
||||
.. code-block:: yaml
|
||||
:caption: ``unittest_file`` test item usage example
|
||||
:caption: ``unittest`` test item usage example
|
||||
|
||||
- unittest_file:
|
||||
- unittest:
|
||||
name: unitTest test item
|
||||
test_file: unitTestScript.py
|
||||
test_method:
|
||||
@@ -23,7 +23,7 @@ Beside common test items attributes, unittest test item has specific attribute,
|
||||
|
||||
* ``test_file``: it is the name (and eventually path) of the unittest file
|
||||
to be processed.
|
||||
* ``test_method``: it is an optional unittest_file test sub-item. If one or more
|
||||
* ``test_method``: it is an optional unittest test sub-item. If one or more
|
||||
elements are present, the unittest python script file is parsed and only
|
||||
the corresponding methods are included in the test tree. Otherwise, all
|
||||
the test methods are included in the test tree.
|
||||
@@ -255,11 +255,12 @@ step list attributes.
|
||||
test_items/let_test_item.rst
|
||||
test_items/loop_test_item.rst
|
||||
test_items/lua_func_test_item.rst
|
||||
test_items/parallel_test_item.rst
|
||||
test_items/plot_test_item.rst
|
||||
test_items/report_test_item.rst
|
||||
test_items/run_test_item.rst
|
||||
test_items/sleep_test_item.rst
|
||||
test_items/unittest_file_test_item.rst
|
||||
test_items/unittest_test_item.rst
|
||||
|
||||
|
||||
|
||||
|
||||
Binary file not shown.
66
doc/quick_start.md
Normal file
66
doc/quick_start.md
Normal file
@@ -0,0 +1,66 @@
|
||||
# Quick start
|
||||
|
||||
Five minutes from zero to a passing test.
|
||||
|
||||
## Install
|
||||
|
||||
From a checkout of the repository:
|
||||
|
||||
```sh
|
||||
./run.sh --version # Linux
|
||||
run.bat # Windows cmd
|
||||
```
|
||||
|
||||
The wrapper creates a Python virtual environment on first run and verifies
|
||||
testium starts. If you prefer a manual install, see the README.
|
||||
|
||||
## Your first test
|
||||
|
||||
Create `hello.tum`:
|
||||
|
||||
```yaml
|
||||
main:
|
||||
name: hello world
|
||||
steps:
|
||||
- check:
|
||||
name: 1 + 1 makes 2
|
||||
values:
|
||||
- <| 1 + 1 == 2 |>
|
||||
```
|
||||
|
||||
Run it in batch mode:
|
||||
|
||||
```sh
|
||||
./run.sh -b -- hello.tum
|
||||
```
|
||||
|
||||
You should see something like:
|
||||
|
||||
```
|
||||
-----> step "1 + 1 makes 2" started
|
||||
Check passed
|
||||
<----- step "1 + 1 makes 2" finished: PASS
|
||||
Test run success.
|
||||
```
|
||||
|
||||
Replace `==` with `!=` and re-run — the step now ends with **FAIL** and
|
||||
the process exits with code 1.
|
||||
|
||||
## Open it in the GUI
|
||||
|
||||
```sh
|
||||
./run.sh hello.tum
|
||||
```
|
||||
|
||||
The test tree appears in the left panel; click *Run test* in the toolbar.
|
||||
Each item turns green or red live as it executes. Use `F1` on a selected
|
||||
item to open its detail panel.
|
||||
|
||||
## Where to go next
|
||||
|
||||
* [`doc/tutorial.md`](tutorial.md) — a guided walk-through of the most
|
||||
common test items (`py_func`, `let`, `group`, `condition`, `report`).
|
||||
* [`doc/examples/`](examples/) — runnable `.tum` snippets covering one
|
||||
feature each.
|
||||
* [`doc/manual/testium_manual.pdf`](manual/testium_manual.pdf) —
|
||||
full reference manual.
|
||||
223
doc/tutorial.md
Normal file
223
doc/tutorial.md
Normal file
@@ -0,0 +1,223 @@
|
||||
# Tutorial — testing a small Python utility
|
||||
|
||||
This walk-through builds, step by step, a testium campaign that exercises
|
||||
a small Python module. Each section adds one feature; you can follow
|
||||
along by editing a single `.tum` file and re-running it.
|
||||
|
||||
If you have not yet run testium, start with [`quick_start.md`](quick_start.md).
|
||||
|
||||
## The code under test
|
||||
|
||||
Create `calc.py` next to your `.tum` file:
|
||||
|
||||
```python
|
||||
def add(a, b):
|
||||
return a + b
|
||||
|
||||
def divide(a, b):
|
||||
return a / b
|
||||
```
|
||||
|
||||
## Step 1 — a static check
|
||||
|
||||
The simplest item is `check`: it evaluates an expression and the test
|
||||
passes iff the expression is truthy. Create `tutorial.tum`:
|
||||
|
||||
```yaml
|
||||
main:
|
||||
name: calc.py campaign
|
||||
steps:
|
||||
- check:
|
||||
name: addition is correct
|
||||
values:
|
||||
- <| 2 + 3 == 5 |>
|
||||
```
|
||||
|
||||
The `<| ... |>` markers turn the body into a Python expression evaluated
|
||||
at run time. Run it:
|
||||
|
||||
```sh
|
||||
./run.sh -b -- tutorial.tum
|
||||
```
|
||||
|
||||
## Step 2 — call your code with `py_func`
|
||||
|
||||
`check` only sees Python literals; to exercise `calc.py` we need a
|
||||
`py_func` item. Replace the step:
|
||||
|
||||
```yaml
|
||||
- py_func:
|
||||
name: add 2 and 3
|
||||
file: calc.py
|
||||
func_name: add
|
||||
param: [2, 3]
|
||||
expected_result: 5
|
||||
```
|
||||
|
||||
`expected_result` makes the item PASS only when the function returns
|
||||
exactly that value.
|
||||
|
||||
The result is also stored in the global dict under `pfn_<name>`
|
||||
(here `pfn_add 2 and 3`).
|
||||
|
||||
Anywhere in a `.tum`, `$(key)` is replaced at runtime by the value
|
||||
stored in the global dict under `key`. A subsequent step can read the
|
||||
result back with `$(pfn_<name>)`:
|
||||
|
||||
```yaml
|
||||
- check:
|
||||
name: result was 5
|
||||
values:
|
||||
- <| $(pfn_add 2 and 3) == 5 |>
|
||||
```
|
||||
|
||||
## Step 3 — group several checks
|
||||
|
||||
Wrap the steps in a `group` to keep them visually together and let
|
||||
testium report a per-group status:
|
||||
|
||||
```yaml
|
||||
main:
|
||||
name: calc.py campaign
|
||||
steps:
|
||||
- group:
|
||||
name: add
|
||||
steps:
|
||||
- py_func:
|
||||
name: 2 + 3
|
||||
file: calc.py
|
||||
func_name: add
|
||||
param: [2, 3]
|
||||
expected_result: 5
|
||||
- py_func:
|
||||
name: -1 + 1
|
||||
file: calc.py
|
||||
func_name: add
|
||||
param: [-1, 1]
|
||||
expected_result: 0
|
||||
- group:
|
||||
name: divide
|
||||
steps:
|
||||
- py_func:
|
||||
name: 6 / 2
|
||||
file: calc.py
|
||||
func_name: divide
|
||||
param: [6, 2]
|
||||
expected_result: 3.0
|
||||
```
|
||||
|
||||
A group fails as soon as one of its steps fails (set
|
||||
`stop_on_failure: false` to keep going).
|
||||
|
||||
## Step 4 — define a variable with `let`
|
||||
|
||||
Avoid hard-coding the same number twice with a variable:
|
||||
|
||||
```yaml
|
||||
- let:
|
||||
name: define numerator
|
||||
values:
|
||||
- num: 6
|
||||
- py_func:
|
||||
name: divide num by 2
|
||||
file: calc.py
|
||||
func_name: divide
|
||||
param:
|
||||
- $(num)
|
||||
- 2
|
||||
expected_result: 3.0
|
||||
```
|
||||
|
||||
`$(num)` expands to the global dict entry — when the stored value is a
|
||||
number it is substituted as a number, no need to wrap it in `<| ... |>`.
|
||||
|
||||
## Step 5 — conditional execution
|
||||
|
||||
Skip a step when a condition is false:
|
||||
|
||||
```yaml
|
||||
- py_func:
|
||||
name: divide by zero only on linux
|
||||
condition: <| "$(os)" == "Linux" |>
|
||||
file: calc.py
|
||||
func_name: divide
|
||||
param: [1, 0]
|
||||
```
|
||||
|
||||
Items skipped this way report `SKIP` and do not affect the overall
|
||||
result.
|
||||
|
||||
## Step 6 — generate a report
|
||||
|
||||
Add a `report` block at the root of the file:
|
||||
|
||||
```yaml
|
||||
main:
|
||||
name: calc.py campaign
|
||||
steps:
|
||||
# ... your steps here ...
|
||||
|
||||
report:
|
||||
enabled: true
|
||||
log_stored: true
|
||||
export:
|
||||
- junit:
|
||||
path: ./reports
|
||||
file_name: calc.xml
|
||||
- html:
|
||||
path: ./reports
|
||||
file_name: calc.html
|
||||
```
|
||||
|
||||
The `path` directory must exist before the test runs — testium does not
|
||||
create it. Create it once:
|
||||
|
||||
```sh
|
||||
mkdir -p reports
|
||||
```
|
||||
|
||||
Re-run the test — `./reports/calc.xml` (CI-friendly) and
|
||||
`./reports/calc.html` (human-friendly) are produced. Set
|
||||
`log_stored: true` to include each item's captured stdout.
|
||||
|
||||
## Step 7 — share state between calls
|
||||
|
||||
By default each `py_func` runs in its own short-lived subprocess.
|
||||
To keep state across calls, use `context_id`:
|
||||
|
||||
```yaml
|
||||
- py_func:
|
||||
name: open
|
||||
file: calc.py
|
||||
func_name: open_resource
|
||||
context_id: my_ctx
|
||||
- py_func:
|
||||
name: use
|
||||
file: calc.py
|
||||
func_name: use_resource
|
||||
context_id: my_ctx
|
||||
```
|
||||
|
||||
Both steps share the same persistent Python interpreter, so `calc.py`
|
||||
can store any object in module-level globals or in `tm.setgd()`.
|
||||
|
||||
To share data without `context_id`, write it to the testium global dict
|
||||
via the JSON-RPC bridge:
|
||||
|
||||
```python
|
||||
import py_func.tm as tm
|
||||
|
||||
def producer():
|
||||
tm.setgd("computed", 42)
|
||||
|
||||
def consumer():
|
||||
return tm.gd("computed")
|
||||
```
|
||||
|
||||
## Where to go next
|
||||
|
||||
* [`doc/examples/`](examples/) — one runnable `.tum` per feature
|
||||
(cycles, dialogs, console, plots, parallel, run-of-tum, …).
|
||||
* [`doc/manual/testium_manual.pdf`](manual/testium_manual.pdf) — full
|
||||
reference manual covering every test item, every attribute and the
|
||||
YAML syntax extensions.
|
||||
141
package/deb/test_distro.sh
Executable file
141
package/deb/test_distro.sh
Executable file
@@ -0,0 +1,141 @@
|
||||
#!/usr/bin/env bash
|
||||
# test_distro.sh — verify testium runs on a target Debian/Ubuntu distrib.
|
||||
#
|
||||
# Spins up a Docker container of the requested image, checks which expected
|
||||
# system Python packages are available (apt), installs them, installs the
|
||||
# testium wheel, and runs a smoke test that exercises batch mode + py_func
|
||||
# subprocess.
|
||||
#
|
||||
# Usage:
|
||||
# ./test_distro.sh debian:bookworm
|
||||
# ./test_distro.sh debian:trixie
|
||||
# ./test_distro.sh ubuntu:24.04
|
||||
|
||||
set -euo pipefail
|
||||
|
||||
IMAGE="${1:?Usage: $0 <image> e.g. debian:bookworm | debian:trixie | ubuntu:24.04}"
|
||||
ROOT=$(realpath "$(dirname "$0")/../..")
|
||||
|
||||
# Container runtime: prefer docker if available, fall back to podman
|
||||
if command -v docker >/dev/null 2>&1; then
|
||||
CTR=docker
|
||||
elif command -v podman >/dev/null 2>&1; then
|
||||
CTR=podman
|
||||
else
|
||||
echo "ERROR: neither docker nor podman is installed" >&2
|
||||
exit 1
|
||||
fi
|
||||
echo "[host] Using $CTR"
|
||||
|
||||
# --- Build the wheel on the host if it does not already exist
|
||||
WHEEL_DIR="$ROOT/src/dist"
|
||||
PYTHON_HOST="$ROOT/test/tmp/.venv/bin/python3"
|
||||
[ -x "$PYTHON_HOST" ] || PYTHON_HOST=python3
|
||||
if ! ls "$WHEEL_DIR"/testium-*.whl >/dev/null 2>&1; then
|
||||
echo "[host] Building wheel..."
|
||||
(cd "$ROOT/src" && "$PYTHON_HOST" -m build --wheel >/dev/null)
|
||||
fi
|
||||
WHEEL=$(ls "$WHEEL_DIR"/testium-*.whl | head -1)
|
||||
WHEEL_NAME=$(basename "$WHEEL")
|
||||
echo "[host] Using $WHEEL_NAME"
|
||||
|
||||
# Expected system Python packages on the target distrib
|
||||
APT_PACKAGES=(
|
||||
python3
|
||||
python3-pip
|
||||
python3-setuptools
|
||||
python3-pyside6.qtwidgets
|
||||
python3-yaml
|
||||
python3-jinja2
|
||||
python3-colorama
|
||||
python3-git
|
||||
python3-pexpect
|
||||
python3-matplotlib
|
||||
python3-lxml
|
||||
python3-serial
|
||||
python3-telnetlib3
|
||||
lua5.4
|
||||
lua-cjson
|
||||
lua-socket
|
||||
git
|
||||
)
|
||||
|
||||
echo "=== Testing on $IMAGE ==="
|
||||
|
||||
$CTR run --rm \
|
||||
-v "$ROOT:/testium:ro" \
|
||||
-e WHEEL_NAME="$WHEEL_NAME" \
|
||||
-e PACKAGES="${APT_PACKAGES[*]}" \
|
||||
"$IMAGE" \
|
||||
bash -c '
|
||||
set -e
|
||||
export DEBIAN_FRONTEND=noninteractive
|
||||
apt-get update -qq
|
||||
|
||||
# 1. Availability check
|
||||
echo
|
||||
echo "--- System package availability ---"
|
||||
AVAILABLE=()
|
||||
MISSING=()
|
||||
for pkg in $PACKAGES; do
|
||||
if apt-cache show "$pkg" >/dev/null 2>&1; then
|
||||
AVAILABLE+=("$pkg")
|
||||
echo " OK $pkg"
|
||||
else
|
||||
MISSING+=("$pkg")
|
||||
echo " MISSING $pkg"
|
||||
fi
|
||||
done
|
||||
echo
|
||||
|
||||
# 2. Install available packages
|
||||
echo "--- Installing system packages ---"
|
||||
apt-get install -qq -y --no-install-recommends "${AVAILABLE[@]}" ca-certificates >/dev/null
|
||||
|
||||
# 3. Map missing apt packages to their PyPI equivalents and pip-install
|
||||
# them as a fallback (kept minimal so the run is still a "system"
|
||||
# install for the most part)
|
||||
declare -A PIP_FALLBACK=(
|
||||
[python3-pyside6.qtwidgets]=pyside6
|
||||
[python3-telnetlib3]=telnetlib3
|
||||
)
|
||||
# junit_xml has no Debian package — install it via pip so the
|
||||
# validation post_execution.py can import it.
|
||||
EXTRA_PIP=(junit-xml)
|
||||
PIP_PKGS=()
|
||||
for m in "${MISSING[@]}"; do
|
||||
fallback="${PIP_FALLBACK[$m]:-}"
|
||||
if [ -n "$fallback" ]; then
|
||||
PIP_PKGS+=("$fallback")
|
||||
fi
|
||||
done
|
||||
PIP_PKGS+=("${EXTRA_PIP[@]}")
|
||||
if [ ${#PIP_PKGS[@]} -gt 0 ]; then
|
||||
echo "--- Installing missing deps via pip: ${PIP_PKGS[*]} ---"
|
||||
pip install --break-system-packages "${PIP_PKGS[@]}" >/dev/null
|
||||
fi
|
||||
|
||||
# 4. Install testium wheel
|
||||
echo "--- Installing testium wheel ---"
|
||||
pip install --break-system-packages --no-deps "/testium/src/dist/$WHEEL_NAME" >/dev/null
|
||||
|
||||
# 5. Install the fake_exporter plugin (needed by the report_plugin
|
||||
# validation test which exercises entry-points discovery).
|
||||
# Copy it first because /testium is mounted read-only and the
|
||||
# setuptools backend touches its build dir.
|
||||
echo "--- Installing testium-fake-exporter (test plugin) ---"
|
||||
cp -r /testium/test/validation/fake_exporter /tmp/fake_exporter
|
||||
pip install --break-system-packages /tmp/fake_exporter >/dev/null
|
||||
|
||||
# 6. Run the full validation suite. Outputs are streamed live so
|
||||
# progress is visible — the suite takes a couple of minutes.
|
||||
# Reports go to /tmp/testium-validation since /testium is RO.
|
||||
echo "--- Running validation suite ---"
|
||||
mkdir -p /tmp/testium-validation
|
||||
cd /testium
|
||||
testium -b -o \
|
||||
-d "validation_report_path=/tmp/testium-validation/" \
|
||||
-- test/validation/main.tum
|
||||
'
|
||||
|
||||
echo "=== $IMAGE: PASS ==="
|
||||
@@ -1,23 +1,50 @@
|
||||
# -*- mode: python ; coding: utf-8 -*-
|
||||
import os
|
||||
|
||||
# junit_xml is imported by post_exec scripts running under the *host* Python,
|
||||
# not the frozen interpreter — so bundling it via hiddenimports alone is not
|
||||
# enough. We also drop its source files at the _MEIPASS root so the host
|
||||
# python3 finds them via the PYTHONPATH that py_process.py sets to
|
||||
# tstium_path (= _MEIPASS when frozen).
|
||||
import junit_xml as _junit_xml
|
||||
JUNIT_XML_DIR = os.path.dirname(_junit_xml.__file__)
|
||||
|
||||
a = Analysis(
|
||||
['../../src/testium/__main__.py'],
|
||||
pathex=['../../src/testium',
|
||||
'../../src/testium/main_win/resources'],
|
||||
binaries=[],
|
||||
datas=[ ('../../src/VERSION', '.'),
|
||||
('../../src/lua_func', 'lua_func'),
|
||||
('../../src/py_func', 'py_func'),
|
||||
('../../src/lib', 'lib')],
|
||||
# py_func/ and runtime/ are bundled at the _MEIPASS root because the
|
||||
# py_func subprocess is launched with the *host* Python (not the
|
||||
# frozen interpreter): it needs the source files on disk to find them
|
||||
# via cwd=subproc_path() and `python3 py_func` + `from runtime.*`.
|
||||
# py_func/, lua_func/ and runtime/ are bundled at the _MEIPASS root
|
||||
# because the py_func subprocess is launched with the *host* Python
|
||||
# (not the frozen interpreter): it needs the source files on disk to
|
||||
# find them via cwd=subproc_path() and `python3 py_func` +
|
||||
# `from runtime.*`. api/ and interpreter/ are intentionally NOT
|
||||
# exposed: user py_func scripts must go through py_func.tm
|
||||
# (JSON-RPC bridge) for any testium API call.
|
||||
datas=[('../../src/VERSION', '.'),
|
||||
('../../src/testium/lua_func', 'lua_func'),
|
||||
('../../src/testium/py_func', 'py_func'),
|
||||
('../../src/testium/runtime', 'runtime'),
|
||||
(JUNIT_XML_DIR, 'junit_xml')],
|
||||
hiddenimports=["git",
|
||||
"interpreter",
|
||||
"main_win",
|
||||
"libs",
|
||||
"libs.console",
|
||||
"libs.termconsole",
|
||||
"libs.console_ssh",
|
||||
"libs.raw_tcp_console",
|
||||
"libs.runtime_plot",
|
||||
"runtime",
|
||||
"py_func",
|
||||
"py_func.tm",
|
||||
"py_func.handle",
|
||||
"py_func.func_call",
|
||||
"api",
|
||||
"api.console",
|
||||
"api.termconsole",
|
||||
"api.console_ssh",
|
||||
"api.raw_tcp_console",
|
||||
"api.runtime_plot",
|
||||
"api.testium",
|
||||
"matplotlib.backends.backend_pdf",
|
||||
"telnetlib3",
|
||||
"serial",
|
||||
|
||||
@@ -27,4 +27,10 @@ if [ ! -d "$PY_VENV_DIR" ]; then
|
||||
python3 -m venv "$PY_VENV_DIR"
|
||||
source "$PY_VENV_DIR/bin/activate"
|
||||
pip install --extra-index-url https://pypi.python.org/pypi -r $REQ_PATH
|
||||
# Validation suite plugin used to verify the report-exporter
|
||||
# entry-points discovery end-to-end.
|
||||
FAKE_EXPORTER_DIR="$(dirname "$REQ_PATH")/../test/validation/fake_exporter"
|
||||
if [ -d "$FAKE_EXPORTER_DIR" ]; then
|
||||
pip install -e "$FAKE_EXPORTER_DIR"
|
||||
fi
|
||||
fi
|
||||
|
||||
@@ -1 +1 @@
|
||||
0.1
|
||||
0.2
|
||||
@@ -1,9 +0,0 @@
|
||||
|
||||
SUPPORTED_API = [
|
||||
"gd",
|
||||
"setgd",
|
||||
"delgd",
|
||||
"add_plot_values",
|
||||
"last_plot_value"
|
||||
]
|
||||
|
||||
@@ -1,75 +0,0 @@
|
||||
import sys
|
||||
from threading import (Thread, Event)
|
||||
from lib.string_queue import StringQueue
|
||||
from time import (sleep)
|
||||
|
||||
class StdioRedirect:
|
||||
|
||||
def __init__(self):
|
||||
self.redirect_enabled = False
|
||||
self.spy_enabled = False
|
||||
self.ini_stdout = sys.stdout
|
||||
self.ini_stderr = sys.stderr
|
||||
self.stream = self.ini_stdout
|
||||
|
||||
def redirect(self, stream):
|
||||
if not self.spy_enabled:
|
||||
self.out_stream = stream
|
||||
self.stream = self.out_stream
|
||||
sys.stdout = self.out_stream
|
||||
sys.stderr = self.out_stream
|
||||
self.redirect_enabled = True
|
||||
|
||||
def restore(self):
|
||||
if not self.spy_enabled and self.redirect_enabled:
|
||||
sys.stdout = self.ini_stdout
|
||||
sys.stderr = self.ini_stderr
|
||||
self.redirect_enabled = False
|
||||
|
||||
def intercept(self):
|
||||
if not self.spy_enabled:
|
||||
self.thr_started = Event()
|
||||
self.log_buf = StringQueue()
|
||||
self.in_stream = StringQueue()
|
||||
self.stop_output = Event()
|
||||
self.thrd_out = Thread(target=self.interceptStdOut)
|
||||
self.thrd_out.daemon = True
|
||||
sys.stdout = self.in_stream
|
||||
sys.stderr = self.in_stream
|
||||
self.stream = self.in_stream
|
||||
self.thrd_out.start()
|
||||
self.thr_started.wait()
|
||||
self.spy_enabled = True
|
||||
|
||||
|
||||
def stop(self):
|
||||
if self.spy_enabled:
|
||||
sys.stdout = self.out_stream
|
||||
sys.stderr = self.out_stream
|
||||
self.stream = self.out_stream
|
||||
self.stop_output.set()
|
||||
self.thrd_out.join()
|
||||
del self.log_buf
|
||||
del self.in_stream
|
||||
del self.stop_output
|
||||
del self.thrd_out
|
||||
del self.thr_started
|
||||
|
||||
self.spy_enabled = False
|
||||
|
||||
def interceptStdOut(self):
|
||||
self.thr_started.set()
|
||||
while not self.stop_output.is_set():
|
||||
data = self.in_stream.read()
|
||||
self.log_buf.write(data)
|
||||
self.out_stream.write(data)
|
||||
if data == '':
|
||||
sleep(0.1)
|
||||
|
||||
def read(self):
|
||||
ret = ''
|
||||
if self.spy_enabled:
|
||||
ret = self.log_buf.read()
|
||||
return ret
|
||||
|
||||
stdio_redir = StdioRedirect()
|
||||
@@ -8,9 +8,11 @@ requires-python = ">=3.11"
|
||||
authors = [
|
||||
{name = "François Dausseur", email = "francois@beafrancois.fr"},
|
||||
]
|
||||
license = "EUPL-1.2"
|
||||
license-files = ["../LICENSE"]
|
||||
classifiers = [
|
||||
"Development Status :: 5 - Production/Stable",
|
||||
"Programming Language :: Python"
|
||||
"Programming Language :: Python",
|
||||
]
|
||||
dependencies = [
|
||||
"setuptools",
|
||||
@@ -33,7 +35,9 @@ testium = "testium:main"
|
||||
|
||||
[tool.setuptools.packages.find]
|
||||
where=["."]
|
||||
exclude=["lua_func", "py_func"]
|
||||
|
||||
[tool.setuptools.package-data]
|
||||
"testium.lua_func" = ["*.lua"]
|
||||
|
||||
[tool.setuptools.dynamic]
|
||||
version = {file = ["VERSION"]}
|
||||
|
||||
@@ -21,10 +21,8 @@ def main():
|
||||
help="Returns the version of testium", action='store_true')
|
||||
parser.add_argument("-b", "--batch-execution",
|
||||
help="Executes the test in batch mode", action='store_true')
|
||||
parser.add_argument("-m", "--terminal",
|
||||
help="Starts terminal mode", action='store_true')
|
||||
parser.add_argument("-o", "--no-color",
|
||||
help="Deactivates stdout colors in batch and terminal mode", action='store_true')
|
||||
help="Deactivates stdout colors in batch mode", action='store_true')
|
||||
parser.add_argument("-c", "--config-file", help="Configuration file",
|
||||
nargs='+',
|
||||
default=[])
|
||||
@@ -95,36 +93,13 @@ def main():
|
||||
from interpreter.utils.version import get_testium_version
|
||||
print(get_testium_version())
|
||||
|
||||
elif args.terminal:
|
||||
import select
|
||||
from interpreter.terminal import Terminal
|
||||
|
||||
if (lf != '') or (rf != '') or (tf != '') or (pn != []):
|
||||
print('"-l", "-p", "-t", "-n" options are not supported in this mode.')
|
||||
|
||||
t = Terminal(os.getcwd(), cf, defines, args.no_color)
|
||||
|
||||
loop = 1
|
||||
while loop:
|
||||
try:
|
||||
loop = 0
|
||||
t.cmdloop()
|
||||
except KeyboardInterrupt:
|
||||
print("\n<ctrl-c>")
|
||||
loop = 1
|
||||
except Exception as exc:
|
||||
if str(exc) == 'quit':
|
||||
break
|
||||
print(exc)
|
||||
loop = 1
|
||||
|
||||
|
||||
elif args.batch_execution:
|
||||
if (lf != ''):
|
||||
print('"-l" option is not supported in this mode.')
|
||||
|
||||
from interpreter.batch import Batch
|
||||
b = Batch(tf, cf, defines, rf, args.report_type, pn, args.no_color)
|
||||
b = Batch(tf, cf, defines, rf, args.report_type, pn, args.no_color, text_mode=True)
|
||||
sys.exit(0 if b.success else 1)
|
||||
|
||||
else:
|
||||
from main_win.testium_win import MainWin
|
||||
|
||||
@@ -245,7 +245,7 @@ A {classname}.close() is missing somewhere in your code !'.format(classname=type
|
||||
if not sys.platform.startswith('win'):
|
||||
# import SshConsole if pexpect is installed
|
||||
try:
|
||||
from libs.console_ssh import SshConsole
|
||||
from api.console_ssh import SshConsole
|
||||
|
||||
except ImportError:
|
||||
pass
|
||||
@@ -8,7 +8,7 @@ import os
|
||||
import pexpect
|
||||
from pexpect import ExceptionPexpect, TIMEOUT, EOF, spawn
|
||||
|
||||
from libs.console import Console
|
||||
from api.console import Console
|
||||
|
||||
# Exception classes used by this module.
|
||||
|
||||
@@ -3,7 +3,7 @@ import sys
|
||||
import socket
|
||||
import traceback
|
||||
|
||||
from libs.console import *
|
||||
from api.console import *
|
||||
|
||||
class RawTCPConsole(Console):
|
||||
TYPE = 'rawtcp'
|
||||
@@ -16,9 +16,9 @@ import numpy as np
|
||||
import matplotlib.dates as mdates
|
||||
from datetime import datetime, timedelta, timezone
|
||||
|
||||
import libs.testium as tm
|
||||
import api.testium as tm
|
||||
from interpreter.test_items.test_result import TestValue
|
||||
from lib.tum_except import ETUMRuntimeError
|
||||
from runtime.tum_except import ETUMRuntimeError
|
||||
from interpreter.utils.py_func_exec import PyFuncExecEngine
|
||||
from interpreter.utils.api_srv import api_request
|
||||
from interpreter.utils.eval import post_evaluate
|
||||
@@ -270,7 +270,7 @@ class RuntimePlotPeriodic(PeriodicTimer):
|
||||
self.func_name = func_name
|
||||
self.args = args
|
||||
self.post_eval = post_eval
|
||||
self.proc = PyFuncExecEngine(tm.gd("python_bin", ""), api_request, 10)
|
||||
self.proc = PyFuncExecEngine(api_request, 10)
|
||||
self.proc.start()
|
||||
if not self.proc.wait_ready(10):
|
||||
raise ETUMRuntimeError(
|
||||
@@ -10,7 +10,7 @@ import os
|
||||
|
||||
ourPath = os.path.dirname(__file__)
|
||||
sys.path.append(ourPath)
|
||||
from libs.console import (Console, BytesStore, TIMEOUT_NULL)
|
||||
from api.console import (Console, BytesStore, TIMEOUT_NULL)
|
||||
|
||||
class TermConsole(Console):
|
||||
TYPE = 'term'
|
||||
@@ -4,7 +4,7 @@ import sys
|
||||
import textwrap
|
||||
from time import monotonic
|
||||
import interpreter.utils.globdict as globdict
|
||||
from lib.tum_except import (ETUMSyntaxError)
|
||||
from runtime.tum_except import (ETUMSyntaxError)
|
||||
|
||||
###############################################################################
|
||||
# Console helper functions
|
||||
@@ -14,7 +14,7 @@ def add_console(console):
|
||||
''' Function which adds a ``Console`` class instance to *testium*
|
||||
|
||||
:param console: The ``Console`` instance.
|
||||
:type console: ``libs.console.Console`` or child class instance
|
||||
:type console: ``api.console.Console`` or child class instance
|
||||
:return: No returned value
|
||||
|
||||
'''
|
||||
@@ -48,7 +48,7 @@ def console(name):
|
||||
:param name: The name of the ``Console`` instance.
|
||||
:type name: str
|
||||
:return: The ``Console`` or child class object
|
||||
:rtype: ``libs.console.Console`` or child class instance
|
||||
:rtype: ``api.console.Console`` or child class instance
|
||||
"""
|
||||
cons = None
|
||||
for c in globdict.gd('console_instances', []):
|
||||
@@ -65,7 +65,7 @@ def add_plot(plot: object) -> None:
|
||||
''' Function which adds a ``RuntimePlot`` class instance to *testium*
|
||||
|
||||
:param plot: The ``RuntimePlot`` instance.
|
||||
:type plot: ``libs.runtime_plot.RuntimePlot`` or child class instance
|
||||
:type plot: ``api.runtime_plot.RuntimePlot`` or child class instance
|
||||
:return: No returned value
|
||||
|
||||
'''
|
||||
@@ -99,7 +99,7 @@ def plot(name: str) -> object:
|
||||
:param name: The name of the ``RuntimePlot`` instance.
|
||||
:type name: str
|
||||
:return: The ``RuntimePlot`` or child class object
|
||||
:rtype: ``libs.runtime_plot.RuntimePlot`` or child class instance
|
||||
:rtype: ``api.runtime_plot.RuntimePlot`` or child class instance
|
||||
"""
|
||||
plot = None
|
||||
for g in globdict.gd('plot_instances', []):
|
||||
@@ -209,6 +209,15 @@ def OS():
|
||||
return platform.system()
|
||||
|
||||
|
||||
def text_mode():
|
||||
"""Whether testium is running in text mode (batch ``-b`` or terminal ``-m``).
|
||||
|
||||
:return: ``True`` if running in text mode, ``False`` otherwise.
|
||||
:rtype: bool
|
||||
"""
|
||||
return bool(globdict.gd("_text_mode", False))
|
||||
|
||||
|
||||
def sys_encoding():
|
||||
if OS() == "Windows":
|
||||
enc = "oem"
|
||||
@@ -1,6 +1,7 @@
|
||||
import os
|
||||
import sys
|
||||
import platform
|
||||
import threading
|
||||
from time import sleep
|
||||
from signal import signal, SIGINT
|
||||
from queue import Empty
|
||||
@@ -8,8 +9,8 @@ from multiprocessing import Queue
|
||||
|
||||
from interpreter.process import TestProcess
|
||||
from interpreter.utils.test_ctrl import TestSetController
|
||||
from lib.tum_except import ETUMFileError
|
||||
from lib.stdout_redirect import stdio_redir
|
||||
from runtime.tum_except import ETUMFileError, ETUMRuntimeError
|
||||
from runtime.stdout_redirect import stdio_redir
|
||||
|
||||
|
||||
class Batch:
|
||||
@@ -22,6 +23,7 @@ class Batch:
|
||||
report_type,
|
||||
report_pattern,
|
||||
no_color,
|
||||
text_mode=False,
|
||||
):
|
||||
try:
|
||||
try:
|
||||
@@ -51,6 +53,7 @@ class Batch:
|
||||
|
||||
signal(SIGINT, self.sigint_handler)
|
||||
|
||||
self._success = False
|
||||
msg_queue = Queue()
|
||||
self.tst_ctrl = TestSetController()
|
||||
tst_proc = TestProcess(
|
||||
@@ -59,11 +62,21 @@ class Batch:
|
||||
self.tst_ctrl,
|
||||
config_files,
|
||||
defines,
|
||||
text_mode=text_mode,
|
||||
)
|
||||
tst_proc.start()
|
||||
|
||||
while not self.tst_ctrl.control("loaded"):
|
||||
sleep(0.1)
|
||||
# Wait for TestProcess to finish loading.
|
||||
# Run the blocking control("loaded") in a daemon thread so we
|
||||
# can watch for unexpected process death in the main thread.
|
||||
_loaded_event = threading.Event()
|
||||
def _wait_loaded():
|
||||
self.tst_ctrl.control("loaded")
|
||||
_loaded_event.set()
|
||||
threading.Thread(target=_wait_loaded, daemon=True).start()
|
||||
while not _loaded_event.wait(timeout=0.1):
|
||||
if not tst_proc.is_alive():
|
||||
raise ETUMRuntimeError("TestProcess terminated unexpectedly during load")
|
||||
|
||||
self.tst_ctrl.control(
|
||||
"report",
|
||||
@@ -78,13 +91,17 @@ class Batch:
|
||||
while True:
|
||||
try:
|
||||
m = msg_queue.get(timeout=0.2)
|
||||
if m.get("id", None) is None:
|
||||
# No id -> finished
|
||||
if "id" in m and m["id"] is None:
|
||||
# id key present and None -> finished
|
||||
self._success = m.get("success", False)
|
||||
break
|
||||
except Empty:
|
||||
if not tst_proc.is_alive():
|
||||
break
|
||||
continue
|
||||
|
||||
# Close the process and wait for termination
|
||||
if tst_proc.is_alive():
|
||||
self.tst_ctrl.control("close")
|
||||
tst_proc.join()
|
||||
|
||||
@@ -94,5 +111,12 @@ class Batch:
|
||||
finally:
|
||||
stdio_redir.restore()
|
||||
|
||||
@property
|
||||
def success(self):
|
||||
return self._success
|
||||
|
||||
def sigint_handler(self, signal_received, frame):
|
||||
self.tst_ctrl.control("stop")
|
||||
try:
|
||||
self.tst_ctrl.control("stop", timeout=5)
|
||||
except Exception:
|
||||
pass
|
||||
|
||||
@@ -1,13 +1,14 @@
|
||||
import os
|
||||
import signal
|
||||
from multiprocessing import Process, Queue, Pipe
|
||||
from queue import Empty
|
||||
from threading import Thread
|
||||
from time import sleep
|
||||
import copy
|
||||
|
||||
from lib.string_queue import StringQueue
|
||||
from lib.tum_except import print_exception, ETUMRuntimeError, ETUMSyntaxError
|
||||
import libs.testium as tm
|
||||
from runtime.string_queue import StringQueue
|
||||
from runtime.tum_except import print_exception, ETUMRuntimeError, ETUMSyntaxError
|
||||
import api.testium as tm
|
||||
import interpreter.utils.globdict as globdict
|
||||
from interpreter.utils.params import expanse
|
||||
from interpreter.utils.test_ctrl import TestSetController
|
||||
@@ -25,7 +26,7 @@ from interpreter.utils.test_init import (
|
||||
from interpreter.utils.constants import TestItemType as cst_type
|
||||
from interpreter.test_set import TestSet
|
||||
from interpreter.utils.include import TUMLoader, TUMLoaderNoIncludes, TUMLoaderRawIncludes
|
||||
from lib.stdout_redirect import stdio_redir
|
||||
from runtime.stdout_redirect import stdio_redir
|
||||
from interpreter.utils.template import template_to_test
|
||||
from interpreter.utils.yaml_load import yaml_load
|
||||
from interpreter.utils.py_eval import eval_process_init
|
||||
@@ -41,6 +42,7 @@ class TestProcess(Process):
|
||||
config_files,
|
||||
defines,
|
||||
gui_defaults={},
|
||||
text_mode=False,
|
||||
) -> None:
|
||||
super().__init__()
|
||||
self.__fname = file_name
|
||||
@@ -49,6 +51,7 @@ class TestProcess(Process):
|
||||
self.__cfgf = config_files
|
||||
self.__defs = defines
|
||||
self.__gui_defaults = gui_defaults # default values coming from GUI prefs
|
||||
self.__text_mode = text_mode
|
||||
self.__exec = False
|
||||
self.__loaded = False
|
||||
self.__closed = False
|
||||
@@ -194,6 +197,7 @@ class TestProcess(Process):
|
||||
|
||||
|
||||
def run(self):
|
||||
signal.signal(signal.SIGINT, signal.SIG_IGN)
|
||||
try:
|
||||
try:
|
||||
# Thread for stdout redirection
|
||||
@@ -207,7 +211,7 @@ class TestProcess(Process):
|
||||
env_init()
|
||||
|
||||
# Creation of the python evaluation process for loading of the complete test
|
||||
eval_proc = eval_process_init("", api_request, 10, test_dir)
|
||||
eval_proc = eval_process_init(api_request, 10, test_dir)
|
||||
eval_proc.start()
|
||||
tm.print_debug(f"python bin is: '{eval_proc.python_bin}'.")
|
||||
if not eval_proc.wait_ready(10):
|
||||
@@ -224,6 +228,10 @@ Is the python exec path correct ?"""
|
||||
# Load the test file
|
||||
test_dict, param_files = self._load_test(init_param_files, glob_variables)
|
||||
|
||||
if self.__text_mode:
|
||||
tm.setgd("_text_mode", True)
|
||||
tm.setgd("_interactive", False)
|
||||
|
||||
# Backup the global dict in case of restart of the test
|
||||
gdict = backup_gd()
|
||||
|
||||
@@ -275,7 +283,7 @@ Is the python exec path correct ?"""
|
||||
engine.stop()
|
||||
engine.join()
|
||||
# Sends signal to the GUI
|
||||
self.send_finished()
|
||||
self.send_finished(success=test_set.success())
|
||||
globdict.set_update_queue(None)
|
||||
restore_gd(gdict)
|
||||
except Exception as e:
|
||||
@@ -331,8 +339,10 @@ Is the python exec path correct ?"""
|
||||
stdio_redir.restore()
|
||||
stdio_redir.stop()
|
||||
|
||||
def send_finished(self):
|
||||
def send_finished(self, success=None):
|
||||
status = {"id": None, "name": "test_process", "status": "finished"}
|
||||
if success is not None:
|
||||
status["success"] = success
|
||||
self.__squeue.put(status)
|
||||
|
||||
def execute(self):
|
||||
@@ -421,7 +431,7 @@ Is the python exec path correct ?"""
|
||||
try:
|
||||
# read the pipe data
|
||||
data = cconn.recv()
|
||||
print(data, end="")
|
||||
print(data, end="", flush=True)
|
||||
except EOFError:
|
||||
# exit the loop is the pipe is closed
|
||||
break
|
||||
|
||||
@@ -1,244 +0,0 @@
|
||||
try:
|
||||
import readline
|
||||
except:
|
||||
pass
|
||||
from cmd import Cmd
|
||||
import os
|
||||
import sys
|
||||
from yaml import load, Loader
|
||||
import functools
|
||||
import platform
|
||||
import types
|
||||
import inspect
|
||||
|
||||
# test modules
|
||||
from interpreter.utils.test_init import (
|
||||
env_init, prepare_global, set_standard_gd_keys,
|
||||
update_global, test_run_init, test_run_header, load_test)
|
||||
from interpreter.utils.globdict import (global_dict)
|
||||
import libs.testium as tm
|
||||
from interpreter.utils.constants import TestItemType as cst
|
||||
from interpreter.test_report.test_report import TestReport
|
||||
|
||||
|
||||
class FakeQueue:
|
||||
def put(self, arg):
|
||||
pass
|
||||
|
||||
|
||||
def func(self, args):
|
||||
if not args.startswith("{"):
|
||||
args = "{"+args+"}"
|
||||
y = load(args, Loader)
|
||||
obj = self.current_item(y, status_queue=FakeQueue())
|
||||
obj.report = self.report
|
||||
res = obj.execute()
|
||||
if not (res.value is None):
|
||||
print('result : {}'.format(res.value))
|
||||
print(res.test_result)
|
||||
|
||||
|
||||
class Terminal(Cmd):
|
||||
SUPPORTED_TESTS = [
|
||||
cst.TYPE_SLEEP,
|
||||
cst.TYPE_LET,
|
||||
cst.TYPE_PY_FUNCTION,
|
||||
cst.TYPE_LUA_FUNCTION,
|
||||
cst.TYPE_CONSOLE,
|
||||
cst.TYPE_IMAGE_DLG,
|
||||
cst.TYPE_MESSAGE_DLG,
|
||||
cst.TYPE_QUESTION_DLG,
|
||||
cst.TYPE_VALUE_DLG,
|
||||
]
|
||||
|
||||
SUPPORTED_GROUPS = [
|
||||
cst.TYPE_GROUP,
|
||||
cst.TYPE_CYCLE
|
||||
]
|
||||
|
||||
def __init__(self, working_dir, config_files, defines, no_color):
|
||||
super().__init__()
|
||||
self.working_dir = working_dir
|
||||
self.config_files = config_files
|
||||
self.current_item = None
|
||||
report = TestReport(None)
|
||||
self.report = report
|
||||
|
||||
env_init()
|
||||
prepare_global()
|
||||
# Define the builtin variables
|
||||
set_standard_gd_keys("Unnamed", self.working_dir, '', config_files)
|
||||
update_global([], defines)
|
||||
|
||||
# creation of the functions
|
||||
for tst in self.SUPPORTED_TESTS:
|
||||
meth_name = "do_" + tst.item_cmd
|
||||
# copy of the function
|
||||
f = types.FunctionType(func.__code__, func.__globals__, name=meth_name,
|
||||
argdefs=func.__defaults__,
|
||||
closure=func.__closure__)
|
||||
f = functools.update_wrapper(f, func)
|
||||
f.__kwdefaults__ = func.__kwdefaults__
|
||||
f.__doc__ = tst.item_class.__doc__
|
||||
setattr(self, meth_name, types.MethodType(f, self))
|
||||
|
||||
test_run_init()
|
||||
self.prompt = "(testium)~ "
|
||||
|
||||
# display header
|
||||
print(test_run_header())
|
||||
# redirect output
|
||||
|
||||
if 'Linux' in platform.system() and not no_color:
|
||||
from lib.stdout_redirect import stdio_redir
|
||||
try:
|
||||
from interpreter.utils.termlog import TermLog
|
||||
stdio_redir.redirect(TermLog(sys.stdout))
|
||||
except ModuleNotFoundError:
|
||||
tm.print_info('Colored console not supported by the system.' +
|
||||
' If you want it, please install colorama module')
|
||||
|
||||
def precmd(self, line: str) -> str:
|
||||
c = line.split(" ", 1)[0].strip()
|
||||
self.current_item = None
|
||||
for tst in self.SUPPORTED_TESTS:
|
||||
if c == tst.item_cmd:
|
||||
self.current_item = tst.item_class
|
||||
break
|
||||
return line
|
||||
|
||||
def load_test_recursively(self, tree_parent, parent_seq, status_queue):
|
||||
try:
|
||||
parent_seq_name = parent_seq['name']
|
||||
except KeyError:
|
||||
parent_seq['name'] = "sequence"
|
||||
except TypeError:
|
||||
raise Exception("Syntax error in an item of type {} which is a child of {}".format(
|
||||
tree_parent.type(), tree_parent.parent().name()))
|
||||
try:
|
||||
parent_seq_actions = parent_seq['steps']
|
||||
except KeyError:
|
||||
raise Exception(' No action list found for "%s" sequence'
|
||||
% (parent_seq_name))
|
||||
# if action is a dictionary , we assume it is a single action
|
||||
# that has not been nested in a list, so do it
|
||||
if isinstance(parent_seq_actions, (dict)):
|
||||
parent_seq_actions = [parent_seq_actions]
|
||||
if not isinstance(parent_seq_actions, (list, tuple)):
|
||||
raise Exception('Actions list not valid.')
|
||||
# first we merged to the same level 'sequence dict entries and list within the list
|
||||
counter = 0
|
||||
test_dir = tm.gd('test_directory')
|
||||
while (counter < len(parent_seq_actions)):
|
||||
action = parent_seq_actions[counter]
|
||||
# if action is a list raise up to the the same level,
|
||||
# ie insert action element into the parent_seq_actions
|
||||
if isinstance(action, (list, tuple)):
|
||||
parent_seq_actions[counter:counter+1] = action
|
||||
continue
|
||||
# if action is a NoneType skip and continue
|
||||
# (when pointing to an unused alias for instance)
|
||||
if action is None:
|
||||
counter += 1
|
||||
continue
|
||||
# if action is a sequence we insert its entry into the action list
|
||||
if 'sequence' in action:
|
||||
parent_seq_actions[counter:counter+1] = action['sequence']
|
||||
continue
|
||||
else:
|
||||
executed = False
|
||||
for it in [*self.SUPPORTED_TESTS, *self.SUPPORTED_GROUPS]:
|
||||
if it.item_cmd in action:
|
||||
executed = True
|
||||
item = (it.item_class)(action[it.item_cmd],
|
||||
tree_parent,
|
||||
status_queue)
|
||||
# check for sequence type:
|
||||
if it.item_cmd == cst.TYPE_UNITTEST_FILE.item_cmd:
|
||||
item.setTestDir(test_dir)
|
||||
item.load()
|
||||
elif ((it.item_cmd == cst.TYPE_CYCLE.item_cmd) or
|
||||
(it.item_cmd == cst.TYPE_GROUP.item_cmd)):
|
||||
self.load_test_recursively(
|
||||
item, action[it.item_cmd], status_queue)
|
||||
|
||||
if not executed:
|
||||
raise Exception('action type is not known "{}"'.format(
|
||||
list(action.keys())[0]))
|
||||
|
||||
counter += 1
|
||||
|
||||
def __setReportRecursively(self, parent):
|
||||
for i in range(parent.childCount()):
|
||||
parent.child(i).report = self.report
|
||||
self.__setReportRecursively(parent.child(i))
|
||||
|
||||
def setReport(self, root_item):
|
||||
root_item.report = self.report
|
||||
self.__setReportRecursively(root_item)
|
||||
|
||||
def get_names(self):
|
||||
memb = inspect.getmembers(self)
|
||||
return [n[0] for n in memb if (inspect.ismethod(n[1]) and n[0].startswith("do_"))]
|
||||
|
||||
def do_load(self, args):
|
||||
"""load function.
|
||||
|
||||
This function loads and executes a testium sub-script.
|
||||
|
||||
The loaded sequence can't be a main testium script ("testium -b" option is
|
||||
defined for such a usage).
|
||||
|
||||
Accepted files are with extension "*.tum".
|
||||
|
||||
usage:
|
||||
load path/to/my/sequence.tum
|
||||
"""
|
||||
file = args.strip()
|
||||
suff = file[-4:]
|
||||
if not suff in ['.tum']:
|
||||
raise Exception('Wrong input file extension')
|
||||
|
||||
if not (os.path.exists(file) and os.path.isfile(file)):
|
||||
raise Exception(
|
||||
'"{}" does not exist or is not a file.'.format(file))
|
||||
|
||||
d, _ = load_test(file)
|
||||
if not isinstance(d, list):
|
||||
raise Exception(
|
||||
"The file root object must be a list. A \"main\" tum can't be loaded from here (use batch mode instead).")
|
||||
|
||||
if (len(d) == 1) and isinstance(d[0], dict) and (not d[0].get('sequence', None) is None):
|
||||
d = d[0]['sequence']
|
||||
|
||||
sq = FakeQueue()
|
||||
root_item = (cst.TYPE_ROOT.item_class)(
|
||||
dict_item={'steps': d}, status_queue=sq)
|
||||
self.load_test_recursively(root_item, {'steps': d}, sq)
|
||||
self.setReport(root_item)
|
||||
res = root_item.execute()
|
||||
if not (res.value is None):
|
||||
print('"{}" execution overall result: {}'.format(file, res.value))
|
||||
print(res.test_result)
|
||||
|
||||
def do_gd(self, args):
|
||||
"""Variables lists and values.
|
||||
|
||||
usage:
|
||||
gd
|
||||
gd home
|
||||
"""
|
||||
if args != '':
|
||||
res = tm.gd(args, None)
|
||||
if res is None:
|
||||
raise Exception(
|
||||
'the variable: "{}" has not been found.'.format(args))
|
||||
print(res)
|
||||
return
|
||||
|
||||
for k in global_dict.keys():
|
||||
print('{}: {}'.format(str(k), str(global_dict[k])))
|
||||
|
||||
def do_quit(self, args):
|
||||
'''Quit the application.'''
|
||||
raise Exception('quit')
|
||||
@@ -5,7 +5,7 @@ from itertools import chain
|
||||
|
||||
from PySide6.QtGui import QIcon, QPixmap
|
||||
from PySide6.QtWidgets import QApplication, QDialog, QDialogButtonBox
|
||||
from PySide6.QtCore import Qt, QSettings, QSize
|
||||
from PySide6.QtCore import Qt, QSettings, QTimer, QSize
|
||||
from PySide6.QtGui import QFont, QFontInfo
|
||||
from PySide6.QtWidgets import QTreeWidgetItem
|
||||
|
||||
@@ -207,6 +207,9 @@ def main(args, conn=None):
|
||||
d.connect_checked()
|
||||
|
||||
d.choicesView.setFocus()
|
||||
auto_result = args[4] if len(args) > 4 else None
|
||||
if auto_result is not None:
|
||||
QTimer.singleShot(2000, lambda: d.accept() if auto_result.lower() == 'ok' else d.reject())
|
||||
dres = d.exec()
|
||||
|
||||
if dres == QDialog.Rejected:
|
||||
|
||||
@@ -3,7 +3,7 @@
|
||||
################################################################################
|
||||
## Form generated from reading UI file 'choices_dialog_win.ui'
|
||||
##
|
||||
## Created by: Qt User Interface Compiler version 6.10.1
|
||||
## Created by: Qt User Interface Compiler version 6.11.0
|
||||
##
|
||||
## WARNING! All changes made in this file will be lost when recompiling UI file!
|
||||
################################################################################
|
||||
|
||||
@@ -1,6 +1,6 @@
|
||||
import sys
|
||||
|
||||
from PySide6.QtCore import (Qt)
|
||||
from PySide6.QtCore import Qt, QTimer
|
||||
from PySide6.QtWidgets import (QApplication, QDialog)
|
||||
from PySide6 import (QtGui)
|
||||
|
||||
@@ -38,6 +38,10 @@ def main(args, conn):
|
||||
|
||||
d.labelImage.setPixmap(QtGui.QPixmap.fromImage(image2))
|
||||
|
||||
auto_result = args[3] if len(args) > 3 else None
|
||||
if auto_result is not None:
|
||||
QTimer.singleShot(2000, lambda: d.accept() if auto_result.lower() == 'ok' else d.reject())
|
||||
|
||||
dres = d.exec()
|
||||
|
||||
if dres == QDialog.Rejected:
|
||||
|
||||
@@ -3,7 +3,7 @@
|
||||
################################################################################
|
||||
## Form generated from reading UI file 'dialog_image_win.ui'
|
||||
##
|
||||
## Created by: Qt User Interface Compiler version 6.10.1
|
||||
## Created by: Qt User Interface Compiler version 6.11.0
|
||||
##
|
||||
## WARNING! All changes made in this file will be lost when recompiling UI file!
|
||||
################################################################################
|
||||
|
||||
@@ -2,7 +2,7 @@ import sys
|
||||
from multiprocessing import freeze_support
|
||||
|
||||
from PySide6.QtWidgets import (QApplication, QMessageBox)
|
||||
from PySide6.QtCore import Qt
|
||||
from PySide6.QtCore import Qt, QTimer
|
||||
|
||||
|
||||
def main(args):
|
||||
@@ -15,6 +15,8 @@ def main(args):
|
||||
msg.setText(args[1])
|
||||
msg.setIcon(QMessageBox.Information)
|
||||
msg.setStandardButtons(QMessageBox.Ok)
|
||||
if len(args) > 2:
|
||||
QTimer.singleShot(2000, lambda: msg.button(QMessageBox.Ok).click())
|
||||
msg.exec()
|
||||
|
||||
if hasattr(sys, "frozen"):
|
||||
|
||||
@@ -3,7 +3,7 @@
|
||||
################################################################################
|
||||
## Form generated from reading UI file 'dialog_note_win.ui'
|
||||
##
|
||||
## Created by: Qt User Interface Compiler version 6.10.1
|
||||
## Created by: Qt User Interface Compiler version 6.11.0
|
||||
##
|
||||
## WARNING! All changes made in this file will be lost when recompiling UI file!
|
||||
################################################################################
|
||||
|
||||
@@ -2,7 +2,7 @@ import sys
|
||||
import os
|
||||
|
||||
from PySide6.QtWidgets import (QApplication, QDialog)
|
||||
from PySide6.QtCore import (Qt)
|
||||
from PySide6.QtCore import Qt, QTimer
|
||||
from interpreter.test_items.dialog_note_files import dialog_note_win
|
||||
from multiprocessing import freeze_support
|
||||
|
||||
@@ -23,6 +23,14 @@ def main(args, conn=None):
|
||||
d.setWindowTitle(args[0])
|
||||
d.labelDialog.setText(args[1])
|
||||
d.textEdit.setFocus()
|
||||
auto_result = args[2] if len(args) > 2 else None
|
||||
if auto_result is not None:
|
||||
auto_value = args[3] if len(args) > 3 else None
|
||||
def _auto_close():
|
||||
if auto_value is not None:
|
||||
d.textEdit.setPlainText(auto_value)
|
||||
d.accept() if auto_result.lower() == 'ok' else d.reject()
|
||||
QTimer.singleShot(2000, _auto_close)
|
||||
dres = d.exec()
|
||||
|
||||
if dres == QDialog.Rejected:
|
||||
|
||||
@@ -2,7 +2,7 @@ import sys
|
||||
from multiprocessing import freeze_support
|
||||
|
||||
from PySide6.QtWidgets import (QApplication, QMessageBox)
|
||||
from PySide6.QtCore import Qt
|
||||
from PySide6.QtCore import Qt, QTimer
|
||||
|
||||
|
||||
def main(args, conn):
|
||||
@@ -16,6 +16,10 @@ def main(args, conn):
|
||||
msg.setText(args[1])
|
||||
msg.setIcon(QMessageBox.Question)
|
||||
msg.setStandardButtons(QMessageBox.Yes | QMessageBox.No)
|
||||
auto_result = args[2] if len(args) > 2 else None
|
||||
if auto_result is not None:
|
||||
btn = QMessageBox.Yes if auto_result.lower() == 'yes' else QMessageBox.No
|
||||
QTimer.singleShot(2000, lambda: msg.button(btn).click())
|
||||
reply = msg.exec()
|
||||
conn.send(reply)
|
||||
except Exception as e:
|
||||
|
||||
@@ -3,7 +3,7 @@
|
||||
################################################################################
|
||||
## Form generated from reading UI file 'dialog_sleep_win.ui'
|
||||
##
|
||||
## Created by: Qt User Interface Compiler version 6.10.1
|
||||
## Created by: Qt User Interface Compiler version 6.11.0
|
||||
##
|
||||
## WARNING! All changes made in this file will be lost when recompiling UI file!
|
||||
################################################################################
|
||||
|
||||
@@ -3,7 +3,7 @@
|
||||
################################################################################
|
||||
## Form generated from reading UI file 'dialog_value_win.ui'
|
||||
##
|
||||
## Created by: Qt User Interface Compiler version 6.10.1
|
||||
## Created by: Qt User Interface Compiler version 6.11.0
|
||||
##
|
||||
## WARNING! All changes made in this file will be lost when recompiling UI file!
|
||||
################################################################################
|
||||
|
||||
@@ -2,7 +2,7 @@ import sys
|
||||
import os
|
||||
|
||||
from PySide6.QtWidgets import (QApplication, QDialog)
|
||||
from PySide6.QtCore import (Qt)
|
||||
from PySide6.QtCore import Qt, QTimer
|
||||
|
||||
from interpreter.test_items.dialog_value_files import dialog_value_win
|
||||
from multiprocessing import freeze_support
|
||||
@@ -25,6 +25,14 @@ def main(args, conn=None):
|
||||
d.labelDialog.setText(args[1])
|
||||
d.lineEdit.setText(args[2])
|
||||
d.lineEdit.setFocus()
|
||||
auto_result = args[3] if len(args) > 3 else None
|
||||
if auto_result is not None:
|
||||
auto_value = args[4] if len(args) > 4 else None
|
||||
def _auto_close():
|
||||
if auto_value is not None:
|
||||
d.lineEdit.setText(auto_value)
|
||||
d.accept() if auto_result.lower() == 'ok' else d.reject()
|
||||
QTimer.singleShot(2000, _auto_close)
|
||||
dres = d.exec()
|
||||
|
||||
if dres == QDialog.Rejected:
|
||||
|
||||
@@ -1,4 +1,4 @@
|
||||
from lib.tum_except import ETUMSyntaxError
|
||||
from runtime.tum_except import ETUMSyntaxError
|
||||
from interpreter.test_items.test_item import TestItem, test_run, test_data
|
||||
from interpreter.test_items.test_result import TestResult, TestValue
|
||||
from interpreter.test_items.item_actions.action import TestItemAction
|
||||
|
||||
@@ -3,11 +3,11 @@ from time import sleep
|
||||
import yaml
|
||||
from copy import deepcopy
|
||||
from interpreter.test_items.test_result import TestResult, TestValue
|
||||
import libs.testium as tm
|
||||
import api.testium as tm
|
||||
from interpreter.utils.params import TestItemParams
|
||||
from interpreter.utils.constants import TestItemType as cst_type
|
||||
from interpreter.utils.eval import eval_to_boolean, evaluate, post_evaluate
|
||||
from lib.tum_except import ETUMSyntaxError, item_load_context
|
||||
from runtime.tum_except import ETUMSyntaxError, item_load_context
|
||||
|
||||
LOG_TEST_STOP = '<----- step "{}" finished'
|
||||
LOG_TEST_START = '-----> step "{}" started'
|
||||
|
||||
@@ -1,8 +1,8 @@
|
||||
|
||||
from interpreter.test_items.test_item import (TestItem, test_run)
|
||||
from interpreter.test_items.test_result import TestValue
|
||||
from lib.tum_except import ETUMSyntaxError, item_load_context
|
||||
import libs.testium as tm
|
||||
from runtime.tum_except import ETUMSyntaxError, item_load_context
|
||||
import api.testium as tm
|
||||
from interpreter.utils.constants import TestItemType as cst
|
||||
from interpreter.utils.eval import evaluate
|
||||
|
||||
|
||||
@@ -1,10 +1,9 @@
|
||||
from interpreter.test_items.test_item import test_run
|
||||
from interpreter.test_items.test_result import TestValue
|
||||
from interpreter.test_items.dialog_choices_files import choices_dialog
|
||||
from interpreter.test_items.test_item_dialog_base import TestItemDialogBase
|
||||
from interpreter.test_items.test_item_dialog_base import TestItemDialogBase, _is_text_mode, _is_interactive
|
||||
from interpreter.utils.constants import TestItemType as cst
|
||||
from lib.tum_except import item_load_context
|
||||
import libs.testium as tm
|
||||
from runtime.tum_except import item_load_context
|
||||
import api.testium as tm
|
||||
|
||||
|
||||
class TestItemChoicesDialog(TestItemDialogBase):
|
||||
@@ -17,13 +16,69 @@ class TestItemChoicesDialog(TestItemDialogBase):
|
||||
self._question = self._prms.getParam("question", required=True)
|
||||
self._choices = self._prms.getParam("choices", required=True)
|
||||
self._default_icon = self._prms.getParam("icon", required=False, default=None)
|
||||
self._auto_result = self._prms.getParam("auto_result", required=False, default=None)
|
||||
|
||||
def _print_choices(self, choices, indent=0):
|
||||
if not isinstance(choices, list):
|
||||
return
|
||||
for choice in choices:
|
||||
name = choice.get("name", "")
|
||||
desc = choice.get("description", "")
|
||||
line = " " * indent + f"- {name}"
|
||||
if desc:
|
||||
line += f": {desc}"
|
||||
print(line)
|
||||
sub = choice.get("choices", None)
|
||||
if sub:
|
||||
self._print_choices(sub, indent + 1)
|
||||
|
||||
def _all_checked(self, choices):
|
||||
result = []
|
||||
if not isinstance(choices, list):
|
||||
return result
|
||||
for choice in choices:
|
||||
item = {"name": choice.get("name", ""), "checked": True}
|
||||
sub = choice.get("choices", None)
|
||||
if sub is not None:
|
||||
item["choices"] = self._all_checked(sub)
|
||||
result.append(item)
|
||||
return result
|
||||
|
||||
@test_run
|
||||
def execute(self):
|
||||
q = self._prms.expanse(self._question)
|
||||
choices = self._prms.expanse(self._choices)
|
||||
icon = self._prms.expanse(self._default_icon)
|
||||
result = self._run_dialog_with_result(choices_dialog.main, [self.name(), q, choices, icon])
|
||||
if _is_text_mode():
|
||||
print(f"Choices: {q}")
|
||||
self._print_choices(choices)
|
||||
if _is_interactive():
|
||||
ans = input("Accept all? (y/n) [default: y]: ").strip().lower()
|
||||
if ans in ('n', 'no'):
|
||||
tm.delgd("cs_" + self._name)
|
||||
self.result.set(TestValue.FAILURE, "Cancelled")
|
||||
else:
|
||||
val = self._all_checked(choices)
|
||||
self.result.value = val
|
||||
tm.setgd("cs_" + self._name, val)
|
||||
self.result.set(TestValue.SUCCESS, str(val))
|
||||
else:
|
||||
ar = self._prms.expanse(self._auto_result) if self._auto_result is not None else None
|
||||
if ar is None:
|
||||
self.result.set(TestValue.FAILURE, 'Dialog not supported in batch mode')
|
||||
elif ar == 'cancel':
|
||||
tm.delgd("cs_" + self._name)
|
||||
self.result.set(TestValue.FAILURE, "Cancelled")
|
||||
else:
|
||||
val = self._all_checked(choices)
|
||||
self.result.value = val
|
||||
tm.setgd("cs_" + self._name, val)
|
||||
self.result.set(TestValue.SUCCESS, str(val))
|
||||
return
|
||||
from interpreter.test_items.dialog_choices_files import choices_dialog
|
||||
ar = self._prms.expanse(self._auto_result) if self._auto_result is not None else None
|
||||
args = [self.name(), q, choices, icon] + ([ar] if ar is not None else [])
|
||||
result = self._run_dialog_with_result(choices_dialog.main, args)
|
||||
if result is None:
|
||||
self.result.set(TestValue.FAILURE, "Dialog subprocess exited without returning a result")
|
||||
return
|
||||
|
||||
@@ -3,9 +3,9 @@ import os
|
||||
import importlib
|
||||
import traceback
|
||||
|
||||
import libs.testium as tm
|
||||
from lib.tum_except import ETUMSyntaxError
|
||||
from lib.stdout_redirect import stdio_redir
|
||||
import api.testium as tm
|
||||
from runtime.tum_except import ETUMSyntaxError
|
||||
from runtime.stdout_redirect import stdio_redir
|
||||
from interpreter.test_items.test_item import test_run
|
||||
from interpreter.test_items.item_actions import TestItemActions
|
||||
from interpreter.test_items.item_actions.action import TestItemAction
|
||||
@@ -345,17 +345,17 @@ class TestItemConsole(TestItemActions):
|
||||
self.actions_token = {}
|
||||
|
||||
global console
|
||||
console = importlib.import_module("libs.console")
|
||||
console = importlib.import_module("api.console")
|
||||
|
||||
if not sys.platform.startswith("win"):
|
||||
global console_ssh
|
||||
console_ssh = importlib.import_module("libs.console_ssh")
|
||||
console_ssh = importlib.import_module("api.console_ssh")
|
||||
|
||||
global termconsole
|
||||
termconsole = importlib.import_module("libs.termconsole")
|
||||
termconsole = importlib.import_module("api.termconsole")
|
||||
|
||||
global raw_tcp_console
|
||||
raw_tcp_console = importlib.import_module("libs.raw_tcp_console")
|
||||
raw_tcp_console = importlib.import_module("api.raw_tcp_console")
|
||||
|
||||
self.actions_token["console_name"] = self._prms.getParam(
|
||||
"console_name", required=True
|
||||
|
||||
37
src/testium/interpreter/test_items/test_item_container.py
Normal file
37
src/testium/interpreter/test_items/test_item_container.py
Normal file
@@ -0,0 +1,37 @@
|
||||
from interpreter.test_items.test_item import TestItem, test_run
|
||||
from interpreter.test_items.test_result import TestResult, TestValue
|
||||
|
||||
|
||||
class TestItemContainer(TestItem):
|
||||
"""Base class for items that run a sequence of children sequentially."""
|
||||
|
||||
def __init__(self, item_type, dict_item, parent=None, status_queue=None, filename=""):
|
||||
self._name = item_type.item_name
|
||||
super().__init__(dict_item, parent, status_queue, filename=filename)
|
||||
self._type = item_type
|
||||
self.is_container = True
|
||||
|
||||
def _run_children_sequentially(self):
|
||||
"""Execute all children in order, respecting stop_on_failure and stop requests.
|
||||
Returns a TestResult aggregating all children outcomes."""
|
||||
i = 0
|
||||
to_be_stopped = False
|
||||
while not self.isStopped() and i < self.childCount() and not to_be_stopped:
|
||||
result = self.child(i).execute()
|
||||
if result.test_result == TestValue.FAILURE and self._stop_on_failure:
|
||||
to_be_stopped = True
|
||||
i += 1
|
||||
|
||||
if self.isStopped() or to_be_stopped:
|
||||
for j in range(self.childCount()):
|
||||
if self.child(j).executedOnStop() and j >= i:
|
||||
self.child(j).execute()
|
||||
|
||||
success = TestValue.SUCCESS
|
||||
for j in range(i):
|
||||
if self.child(j).result.test_result == TestValue.FAILURE:
|
||||
success = TestValue.FAILURE
|
||||
break
|
||||
|
||||
stopped = self.isStopped() or to_be_stopped
|
||||
return TestResult(None, success, ""), stopped
|
||||
@@ -1,11 +1,11 @@
|
||||
import traceback
|
||||
|
||||
from lib.tum_except import ETUMSyntaxError, ETUMRuntimeError
|
||||
from runtime.tum_except import ETUMSyntaxError, ETUMRuntimeError
|
||||
from interpreter.utils.py_func_exec import PyFuncExecEngine
|
||||
from interpreter.utils.api_srv import api_request
|
||||
from interpreter.test_items.test_item import TestItem, test_run
|
||||
from interpreter.test_items.test_result import TestResult, TestValue
|
||||
import libs.testium as tm
|
||||
import api.testium as tm
|
||||
from interpreter.utils.params import TestItemParams
|
||||
from interpreter.utils.constants import TestItemType as cst
|
||||
|
||||
@@ -207,7 +207,7 @@ then considered as 'False'""")
|
||||
else:
|
||||
pl = [self._currentLoop]
|
||||
|
||||
proc = PyFuncExecEngine(tm.gd("python_bin", ""), api_request, 10)
|
||||
proc = PyFuncExecEngine(api_request, 10)
|
||||
proc.start()
|
||||
if not proc.wait_ready(10):
|
||||
raise ETUMRuntimeError(
|
||||
|
||||
@@ -1,7 +1,16 @@
|
||||
import multiprocessing
|
||||
|
||||
import api.testium as tm
|
||||
from interpreter.test_items.test_item import TestItem
|
||||
|
||||
|
||||
def _is_text_mode():
|
||||
return tm.text_mode()
|
||||
|
||||
|
||||
def _is_interactive():
|
||||
return bool(tm.gd("_interactive", True))
|
||||
|
||||
_spawn_ctx = multiprocessing.get_context('spawn')
|
||||
|
||||
|
||||
@@ -40,7 +49,10 @@ class TestItemDialogBase(TestItem):
|
||||
result = None
|
||||
while p.is_alive() and not self._is_stopped:
|
||||
if parent_conn.poll(0.5):
|
||||
try:
|
||||
result = parent_conn.recv()
|
||||
except EOFError:
|
||||
pass
|
||||
break
|
||||
self._cleanup_process(p)
|
||||
return result
|
||||
|
||||
@@ -1,7 +1,7 @@
|
||||
from interpreter.test_items.test_item import (TestItem, test_run)
|
||||
from interpreter.test_items.test_result import (TestValue)
|
||||
from interpreter.utils.constants import TestItemType as cst
|
||||
from lib.tum_except import ETUMParamError, ETUMSyntaxError
|
||||
from runtime.tum_except import ETUMParamError, ETUMSyntaxError
|
||||
import interpreter.utils.version as git
|
||||
|
||||
class TestItemGit(TestItem):
|
||||
|
||||
@@ -1,8 +1,8 @@
|
||||
from interpreter.test_items.test_item import (TestItem, test_run)
|
||||
from interpreter.test_items.test_result import (TestResult, TestValue)
|
||||
from interpreter.utils.constants import TestItemType as cst
|
||||
from lib.tum_except import ETUMSyntaxError
|
||||
import libs.testium as tm
|
||||
from runtime.tum_except import ETUMSyntaxError
|
||||
import api.testium as tm
|
||||
|
||||
class TestItemGroup(TestItem):
|
||||
def __init__(self, dict_cycle, parent = None, status_queue=None, filename=""):
|
||||
|
||||
@@ -2,11 +2,10 @@ import os
|
||||
|
||||
from interpreter.test_items.test_item import test_run
|
||||
from interpreter.test_items.test_result import TestValue
|
||||
from interpreter.test_items.dialog_image_files import dialog_image
|
||||
from interpreter.test_items.test_item_dialog_base import TestItemDialogBase
|
||||
from interpreter.test_items.test_item_dialog_base import TestItemDialogBase, _is_text_mode, _is_interactive
|
||||
from interpreter.utils.constants import TestItemType as cst
|
||||
from lib.tum_except import item_load_context
|
||||
import libs.testium as tm
|
||||
from runtime.tum_except import item_load_context
|
||||
import api.testium as tm
|
||||
|
||||
|
||||
class TestItemImageDialog(TestItemDialogBase):
|
||||
@@ -21,6 +20,7 @@ class TestItemImageDialog(TestItemDialogBase):
|
||||
with item_load_context(self.cmd(), self.name(), self.seqFilename()):
|
||||
self._question = self._prms.getParam("question", required=True)
|
||||
self._filename = self._prms.getParam("filename", required=True)
|
||||
self._auto_result = self._prms.getParam("auto_result", required=False, default=None)
|
||||
|
||||
@test_run
|
||||
def execute(self):
|
||||
@@ -31,7 +31,23 @@ class TestItemImageDialog(TestItemDialogBase):
|
||||
image_path = os.path.normpath(
|
||||
os.path.join(tm.gd("test_directory"), image_path)
|
||||
)
|
||||
succ = self._run_dialog_with_result(dialog_image.main, [self.name(), q, image_path])
|
||||
if _is_text_mode():
|
||||
if _is_interactive():
|
||||
ans = input("Accept? (y/n) [default: y]: ").strip().lower()
|
||||
self.result.set(TestValue.FAILURE if ans in ('n', 'no') else TestValue.SUCCESS)
|
||||
else:
|
||||
ar = self._prms.expanse(self._auto_result) if self._auto_result is not None else None
|
||||
if ar is None:
|
||||
self.result.set(TestValue.FAILURE, 'Dialog not supported in batch mode')
|
||||
elif ar == 'cancel':
|
||||
self.result.set(TestValue.FAILURE)
|
||||
else:
|
||||
self.result.set(TestValue.SUCCESS)
|
||||
return
|
||||
from interpreter.test_items.dialog_image_files import dialog_image
|
||||
ar = self._prms.expanse(self._auto_result) if self._auto_result is not None else None
|
||||
args = [self.name(), q, image_path] + ([ar] if ar is not None else [])
|
||||
succ = self._run_dialog_with_result(dialog_image.main, args)
|
||||
if succ is None:
|
||||
self.result.set(TestValue.FAILURE, "Dialog subprocess exited without returning a result")
|
||||
elif succ:
|
||||
|
||||
@@ -2,7 +2,7 @@ import sys
|
||||
import traceback
|
||||
from random import randint
|
||||
|
||||
from lib.tum_except import ETUMSyntaxError
|
||||
from runtime.tum_except import ETUMSyntaxError
|
||||
from interpreter.test_items.test_item import TestItem, test_run
|
||||
from interpreter.test_items.test_result import TestResult, TestValue
|
||||
|
||||
|
||||
@@ -3,9 +3,9 @@ import socket
|
||||
import re
|
||||
import struct
|
||||
|
||||
from lib.tum_except import ETUMRuntimeError
|
||||
import libs.testium as tm
|
||||
from libs.console import Console
|
||||
from runtime.tum_except import ETUMRuntimeError
|
||||
import api.testium as tm
|
||||
from api.console import Console
|
||||
|
||||
|
||||
def is_ip_address(address):
|
||||
|
||||
@@ -5,8 +5,8 @@ import time
|
||||
|
||||
from interpreter.test_items.test_item import (TestItem, test_run)
|
||||
from interpreter.test_items.test_result import (TestResult, TestValue)
|
||||
from lib.tum_except import ETUMSyntaxError, item_load_context
|
||||
import libs.testium as tm
|
||||
from runtime.tum_except import ETUMSyntaxError, item_load_context
|
||||
import api.testium as tm
|
||||
from interpreter.utils.constants import TestItemType as cst
|
||||
|
||||
class TestItemLet(TestItem):
|
||||
|
||||
@@ -4,10 +4,10 @@ import traceback
|
||||
import pprint
|
||||
import textwrap
|
||||
|
||||
from lib.tum_except import ETUMSyntaxError, ETUMRuntimeError, item_load_context
|
||||
from runtime.tum_except import ETUMSyntaxError, ETUMRuntimeError, item_load_context
|
||||
from interpreter.test_items.test_item import TestItem, test_run
|
||||
from interpreter.test_items.test_result import TestValue
|
||||
import libs.testium as tm
|
||||
import api.testium as tm
|
||||
from interpreter.utils.lua_func_exec import LuaFuncExecEngine
|
||||
from interpreter.utils.api_srv import api_request
|
||||
from interpreter.utils.constants import TestItemType as cst
|
||||
@@ -31,7 +31,7 @@ class TestItemLuaFunc(TestItem):
|
||||
self.func_name = self._prms.getParam("func_name", required=True)
|
||||
self.params = self._prms.getParamAll("param")
|
||||
self._context_id = self._prms.getParam("context_id", default=None, processed=False)
|
||||
self._lua_func_proc = LuaFuncExecEngine(tm.gd("lua_bin", ""), api_request, 10)
|
||||
self._lua_func_proc = LuaFuncExecEngine(api_request, 10)
|
||||
|
||||
def _get_engine(self):
|
||||
"""Return (engine, persistent). If context_id is set, use a shared persistent engine."""
|
||||
@@ -41,7 +41,7 @@ class TestItemLuaFunc(TestItem):
|
||||
ctx_id = self._prms.expanse(self._context_id)
|
||||
contexts = tm.gd(_LUA_FUNC_CONTEXTS_KEY, {})
|
||||
if ctx_id not in contexts:
|
||||
contexts[ctx_id] = LuaFuncExecEngine(tm.gd("lua_bin", ""), api_request, 10)
|
||||
contexts[ctx_id] = LuaFuncExecEngine(api_request, 10)
|
||||
tm.setgd(_LUA_FUNC_CONTEXTS_KEY, contexts)
|
||||
return contexts[ctx_id], True
|
||||
|
||||
|
||||
@@ -3,10 +3,9 @@ import sys
|
||||
|
||||
from interpreter.test_items.test_item import test_run
|
||||
from interpreter.test_items.test_result import TestValue
|
||||
from interpreter.test_items.dialog_msg_files import msg_dialog
|
||||
from interpreter.test_items.test_item_dialog_base import TestItemDialogBase
|
||||
from interpreter.test_items.test_item_dialog_base import TestItemDialogBase, _is_text_mode, _is_interactive
|
||||
from interpreter.utils.constants import TestItemType as cst
|
||||
from lib.tum_except import item_load_context
|
||||
from runtime.tum_except import item_load_context
|
||||
|
||||
|
||||
class TestItemMsgDialog(TestItemDialogBase):
|
||||
@@ -20,12 +19,27 @@ class TestItemMsgDialog(TestItemDialogBase):
|
||||
self.is_container = False
|
||||
with item_load_context(self.cmd(), self.name(), self.seqFilename()):
|
||||
self._question = self._prms.getParam('question', required=True)
|
||||
self._auto_result = self._prms.getParam('auto_result', required=False, default=None)
|
||||
|
||||
@test_run
|
||||
def execute(self):
|
||||
q = self._prms.expanse(self._question)
|
||||
print("Message Displayed:\n" + q)
|
||||
exitcode = self._run_dialog(msg_dialog.main, [self.name(), q])
|
||||
if _is_text_mode():
|
||||
if _is_interactive():
|
||||
input("Press Enter to continue...")
|
||||
self.result.set(TestValue.SUCCESS)
|
||||
else:
|
||||
ar = self._prms.expanse(self._auto_result) if self._auto_result is not None else None
|
||||
if ar is not None:
|
||||
self.result.set(TestValue.SUCCESS)
|
||||
else:
|
||||
self.result.set(TestValue.FAILURE, 'Dialog not supported in batch mode')
|
||||
return
|
||||
from interpreter.test_items.dialog_msg_files import msg_dialog
|
||||
ar = self._prms.expanse(self._auto_result) if self._auto_result is not None else None
|
||||
args = [self.name(), q] + ([ar] if ar is not None else [])
|
||||
exitcode = self._run_dialog(msg_dialog.main, args)
|
||||
if exitcode == 0:
|
||||
self.result.set(TestValue.SUCCESS)
|
||||
else:
|
||||
|
||||
@@ -1,10 +1,9 @@
|
||||
from interpreter.test_items.test_item import test_run
|
||||
from interpreter.test_items.test_result import TestValue
|
||||
from interpreter.test_items.dialog_note_files import test_dialog
|
||||
from interpreter.test_items.test_item_dialog_base import TestItemDialogBase
|
||||
from interpreter.test_items.test_item_dialog_base import TestItemDialogBase, _is_text_mode, _is_interactive
|
||||
from interpreter.utils.constants import TestItemType as cst
|
||||
from lib.tum_except import item_load_context
|
||||
import libs.testium as tm
|
||||
from runtime.tum_except import item_load_context
|
||||
import api.testium as tm
|
||||
|
||||
|
||||
class TestItemNoteDialog(TestItemDialogBase):
|
||||
@@ -15,12 +14,50 @@ class TestItemNoteDialog(TestItemDialogBase):
|
||||
self.is_container = False
|
||||
with item_load_context(self.cmd(), self.name(), self.seqFilename()):
|
||||
self._question = self._prms.getParam('question', required=True)
|
||||
self._auto_result = self._prms.getParam('auto_result', required=False, default=None)
|
||||
self._auto_value = self._prms.getParam('auto_value', required=False, default=None)
|
||||
|
||||
@test_run
|
||||
def execute(self):
|
||||
q = self._prms.expanse(self._question)
|
||||
print("Question:\n" + q)
|
||||
result = self._run_dialog_with_result(test_dialog.main, [self.name(), q])
|
||||
if _is_text_mode():
|
||||
if _is_interactive():
|
||||
print("Enter your note (type '.' on a new line to finish, empty line to cancel):")
|
||||
lines = []
|
||||
while True:
|
||||
line = input()
|
||||
if line == '.':
|
||||
break
|
||||
lines.append(line)
|
||||
val = '\n'.join(lines)
|
||||
else:
|
||||
ar = self._prms.expanse(self._auto_result) if self._auto_result is not None else None
|
||||
av = self._prms.expanse(self._auto_value) if self._auto_value is not None else None
|
||||
if ar is None:
|
||||
self.result.set(TestValue.FAILURE, 'Dialog not supported in batch mode')
|
||||
return
|
||||
if ar == 'cancel':
|
||||
self.result.set(TestValue.FAILURE, 'Dialog cancelled')
|
||||
return
|
||||
val = av if av is not None else ''
|
||||
tm.setgd(self.name(), val)
|
||||
print("\n" + ("-" * 80) + "\n")
|
||||
print("- Test note\n")
|
||||
print("-" * 80 + "\n")
|
||||
print(val)
|
||||
print("-" * 80 + "\n")
|
||||
self.result.reported = {'note': val}
|
||||
if val:
|
||||
self.result.set(TestValue.SUCCESS, val)
|
||||
else:
|
||||
self.result.set(TestValue.FAILURE, val)
|
||||
return
|
||||
from interpreter.test_items.dialog_note_files import test_dialog
|
||||
ar = self._prms.expanse(self._auto_result) if self._auto_result is not None else None
|
||||
av = self._prms.expanse(self._auto_value) if self._auto_value is not None else None
|
||||
args = [self.name(), q] + ([ar, av] if ar is not None else [])
|
||||
result = self._run_dialog_with_result(test_dialog.main, args)
|
||||
if result is None:
|
||||
self.result.set(TestValue.FAILURE, "Dialog subprocess exited without returning a result")
|
||||
return
|
||||
|
||||
193
src/testium/interpreter/test_items/test_item_parallel.py
Normal file
193
src/testium/interpreter/test_items/test_item_parallel.py
Normal file
@@ -0,0 +1,193 @@
|
||||
import threading
|
||||
from time import sleep, time
|
||||
|
||||
from interpreter.test_items.test_item_container import TestItemContainer
|
||||
from interpreter.test_items.test_item import test_run
|
||||
from interpreter.test_items.test_result import TestResult, TestValue
|
||||
from interpreter.utils.constants import TestItemType as cst
|
||||
from interpreter.utils.eval import eval_to_boolean
|
||||
from runtime.tum_except import ETUMSyntaxError
|
||||
from runtime.string_queue import StringQueue
|
||||
from runtime.stdout_redirect import stdio_redir
|
||||
|
||||
|
||||
class TestItemParallelBranch(TestItemContainer):
|
||||
"""One branch of a parallel item. Runs its children sequentially,
|
||||
optionally waiting for a condition before starting."""
|
||||
|
||||
def __init__(self, dict_item, parent=None, status_queue=None, filename=""):
|
||||
super().__init__(cst.TYPE_PARALLEL_BRANCH, dict_item, parent, status_queue, filename=filename)
|
||||
self._wait_condition = None
|
||||
self._wait_timeout = 30
|
||||
if "wait_for" in dict_item:
|
||||
wf = dict_item["wait_for"]
|
||||
if not isinstance(wf, dict):
|
||||
raise ETUMSyntaxError(
|
||||
f"'wait_for' in branch '{self.name()}' must be a dict with 'condition' and optional 'timeout'",
|
||||
self.seqFilename(),
|
||||
)
|
||||
self._wait_condition = wf.get("condition", None)
|
||||
self._wait_timeout = float(wf.get("timeout", 30))
|
||||
|
||||
def _wait_start(self):
|
||||
"""Block until wait_for condition is True, or timeout. Returns False on timeout."""
|
||||
if self._wait_condition is None:
|
||||
return True
|
||||
deadline = time() + self._wait_timeout
|
||||
while time() < deadline:
|
||||
if self.isStopped():
|
||||
return False
|
||||
try:
|
||||
c = self._prms.expanse(self._wait_condition)
|
||||
if eval_to_boolean(c):
|
||||
return True
|
||||
except Exception:
|
||||
pass
|
||||
sleep(0.1)
|
||||
return False
|
||||
|
||||
@test_run
|
||||
def execute(self):
|
||||
if not self._wait_start():
|
||||
self.result.set(
|
||||
TestValue.FAILURE,
|
||||
f"wait_for timeout ({self._wait_timeout}s): condition '{self._wait_condition}' not met",
|
||||
)
|
||||
return
|
||||
|
||||
result, stopped = self._run_children_sequentially()
|
||||
|
||||
if stopped:
|
||||
if result.test_result == TestValue.FAILURE:
|
||||
self.result.set(TestValue.FAILURE, "Branch aborted on failure")
|
||||
else:
|
||||
self.result.set(TestValue.NORUN, "Branch aborted on user request")
|
||||
else:
|
||||
self.result.set(result.test_result, "")
|
||||
|
||||
|
||||
class TestItemParallel(TestItemContainer):
|
||||
"""Runs multiple branches concurrently.
|
||||
|
||||
YAML:
|
||||
parallel:
|
||||
name: ...
|
||||
sync: all # all (default): wait for every branch
|
||||
# any: stop as soon as one branch finishes
|
||||
stop_on_failure: false
|
||||
branches:
|
||||
- name: Branch A
|
||||
wait_for:
|
||||
condition: "'$(ready)' == 'True'"
|
||||
timeout: 30
|
||||
steps:
|
||||
- ...
|
||||
- name: Branch B
|
||||
steps:
|
||||
- ...
|
||||
"""
|
||||
|
||||
def __init__(self, dict_item, parent=None, status_queue=None, filename=""):
|
||||
branches = dict_item.get("branches", [])
|
||||
if not branches:
|
||||
raise ETUMSyntaxError(
|
||||
f"'parallel' item requires at least one branch in 'branches'",
|
||||
dict_item.get("seq_filename", ""),
|
||||
)
|
||||
# Inject a synthetic 'steps' key so load_test_recursively can load branches
|
||||
# as TestItemParallelBranch children. The base class' _filter_dict_item
|
||||
# drops 'steps'; we also drop 'branches' (overridden below) so the F1
|
||||
# panel shows only the parallel's own attributes, not the duplicated
|
||||
# tree of branches/steps already displayed in the test tree.
|
||||
dict_item["steps"] = [{"parallel_branch": b} for b in branches]
|
||||
|
||||
super().__init__(cst.TYPE_PARALLEL, dict_item, parent, status_queue, filename=filename)
|
||||
self._sync = str(dict_item.get("sync", "all")).lower()
|
||||
if self._sync not in ("all", "any"):
|
||||
raise ETUMSyntaxError(
|
||||
f"'sync' must be 'all' or 'any', got '{self._sync}'",
|
||||
self.seqFilename(),
|
||||
)
|
||||
|
||||
def _filter_dict_item(self, dict_item):
|
||||
c = super()._filter_dict_item(dict_item)
|
||||
# Keep 'branches' so the F1 panel shows the branch list and their
|
||||
# per-branch attributes (name, wait_for, condition, ...), but strip
|
||||
# the 'steps' inside each branch — the steps are already visible as
|
||||
# children in the test tree and would just duplicate the information.
|
||||
if isinstance(c, dict) and isinstance(c.get("branches"), list):
|
||||
stripped = []
|
||||
for b in c["branches"]:
|
||||
if isinstance(b, dict):
|
||||
stripped.append({k: v for k, v in b.items() if k != "steps"})
|
||||
else:
|
||||
stripped.append(b)
|
||||
c["branches"] = stripped
|
||||
return c
|
||||
|
||||
def _stop_branch_recursively(self, item):
|
||||
item.stop()
|
||||
for i in range(item.childCount()):
|
||||
self._stop_branch_recursively(item.child(i))
|
||||
|
||||
@test_run
|
||||
def execute(self):
|
||||
branch_results = [None] * self.childCount()
|
||||
any_done = threading.Event()
|
||||
|
||||
def run_branch(idx):
|
||||
branch = self.child(idx)
|
||||
stdio_redir.register_thread(buffer=StringQueue(), branch=branch.name())
|
||||
try:
|
||||
# sync:any: if another branch already won the race, mark this
|
||||
# branch as stopped so its execute() skips children but still
|
||||
# goes through the normal addTest path (clean DB entry).
|
||||
if self._sync == "any" and any_done.is_set():
|
||||
branch.stop()
|
||||
try:
|
||||
result = branch.execute()
|
||||
except Exception as e:
|
||||
import traceback
|
||||
print(f"[parallel] Branch '{branch.name()}' crashed: {e}")
|
||||
traceback.print_exc()
|
||||
branch.result.set(TestValue.FAILURE, f"Branch crashed: {e}")
|
||||
result = branch.result
|
||||
branch_results[idx] = result
|
||||
# Only a branch that actually ran (SUCCESS or FAILURE) wins the
|
||||
# sync:any race. A disabled or skipped branch returns NORUN
|
||||
# almost instantly and must not stop legitimate branches.
|
||||
if self._sync == "any" and result.test_result != TestValue.NORUN:
|
||||
any_done.set()
|
||||
for j in range(self.childCount()):
|
||||
if j != idx:
|
||||
self._stop_branch_recursively(self.child(j))
|
||||
finally:
|
||||
stdio_redir.unregister_thread()
|
||||
|
||||
threads = [
|
||||
threading.Thread(target=run_branch, args=(i,), daemon=True)
|
||||
for i in range(self.childCount())
|
||||
]
|
||||
for t in threads:
|
||||
t.start()
|
||||
for t in threads:
|
||||
t.join()
|
||||
|
||||
if self._sync == "all":
|
||||
# Pass if no branch failed; disabled/skipped branches (NORUN) are
|
||||
# ignored, matching how Group/Cycle treat disabled children.
|
||||
success = all(
|
||||
r is not None and r.test_result != TestValue.FAILURE
|
||||
for r in branch_results
|
||||
)
|
||||
else:
|
||||
# Pass if at least one branch ran and succeeded.
|
||||
success = any(
|
||||
r is not None and r.test_result == TestValue.SUCCESS
|
||||
for r in branch_results
|
||||
)
|
||||
|
||||
self.result.set(
|
||||
TestValue.SUCCESS if success else TestValue.FAILURE,
|
||||
f"parallel sync={self._sync}",
|
||||
)
|
||||
@@ -4,10 +4,10 @@ import time
|
||||
import pprint
|
||||
import textwrap
|
||||
|
||||
from lib.tum_except import ETUMSyntaxError, ETUMRuntimeError, item_load_context
|
||||
from runtime.tum_except import ETUMSyntaxError, ETUMRuntimeError, item_load_context
|
||||
from interpreter.test_items.test_item import TestItem, test_run
|
||||
from interpreter.test_items.test_result import TestValue
|
||||
import libs.testium as tm
|
||||
import api.testium as tm
|
||||
from interpreter.utils.py_func_exec import PyFuncExecEngine
|
||||
from interpreter.utils.api_srv import api_request
|
||||
from interpreter.utils.constants import TestItemType as cst
|
||||
@@ -31,7 +31,7 @@ class TestItemPyFunc(TestItem):
|
||||
self.func_name = self._prms.getParam("func_name", required=True)
|
||||
self.params = self._prms.getParamAll("param")
|
||||
self._context_id = self._prms.getParam("context_id", default=None, processed=False)
|
||||
self._py_func_proc = PyFuncExecEngine(tm.gd("python_bin", ""), api_request, 10)
|
||||
self._py_func_proc = PyFuncExecEngine(api_request, 10)
|
||||
|
||||
def _get_engine(self):
|
||||
"""Return (engine, persistent). If context_id is set, use a shared persistent engine."""
|
||||
@@ -41,7 +41,7 @@ class TestItemPyFunc(TestItem):
|
||||
ctx_id = self._prms.expanse(self._context_id)
|
||||
contexts = tm.gd(_PY_FUNC_CONTEXTS_KEY, {})
|
||||
if ctx_id not in contexts:
|
||||
contexts[ctx_id] = PyFuncExecEngine(tm.gd("python_bin", ""), api_request, 10)
|
||||
contexts[ctx_id] = PyFuncExecEngine(api_request, 10)
|
||||
tm.setgd(_PY_FUNC_CONTEXTS_KEY, contexts)
|
||||
return contexts[ctx_id], True
|
||||
|
||||
|
||||
@@ -1,11 +1,8 @@
|
||||
from PySide6.QtWidgets import QMessageBox
|
||||
|
||||
from interpreter.test_items.test_item import test_run
|
||||
from interpreter.test_items.test_result import TestValue
|
||||
from interpreter.test_items.dialog_question_files import question_dialog
|
||||
from interpreter.test_items.test_item_dialog_base import TestItemDialogBase
|
||||
from interpreter.test_items.test_item_dialog_base import TestItemDialogBase, _is_text_mode, _is_interactive
|
||||
from interpreter.utils.constants import TestItemType as cst
|
||||
from lib.tum_except import item_load_context
|
||||
from runtime.tum_except import item_load_context
|
||||
|
||||
|
||||
class TestItemQuestionDialog(TestItemDialogBase):
|
||||
@@ -19,15 +16,40 @@ class TestItemQuestionDialog(TestItemDialogBase):
|
||||
self.is_container = False
|
||||
with item_load_context(self.cmd(), self.name(), self.seqFilename()):
|
||||
self._question = self._prms.getParam('question', required=True)
|
||||
self._auto_result = self._prms.getParam('auto_result', required=False, default=None)
|
||||
|
||||
@test_run
|
||||
def execute(self):
|
||||
q = self._prms.expanse(self._question)
|
||||
print('Question asked:\n' + q + '\n')
|
||||
succ = self._run_dialog_with_result(question_dialog.main, [self.name(), q])
|
||||
if _is_text_mode():
|
||||
if _is_interactive():
|
||||
ans = input("Answer yes (y) or no (n) [default: y]: ").strip().lower()
|
||||
if ans in ('n', 'no'):
|
||||
self.result.set(TestValue.FAILURE)
|
||||
print('Answer: NO\n')
|
||||
else:
|
||||
self.result.set(TestValue.SUCCESS)
|
||||
print('Answer: YES\n')
|
||||
else:
|
||||
ar = self._prms.expanse(self._auto_result) if self._auto_result is not None else None
|
||||
if ar is None:
|
||||
self.result.set(TestValue.FAILURE, 'Dialog not supported in batch mode')
|
||||
elif ar in ('no', 'cancel'):
|
||||
self.result.set(TestValue.FAILURE)
|
||||
print('Answer: NO\n')
|
||||
else:
|
||||
self.result.set(TestValue.SUCCESS)
|
||||
print('Answer: YES\n')
|
||||
return
|
||||
from interpreter.test_items.dialog_question_files import question_dialog
|
||||
ar = self._prms.expanse(self._auto_result) if self._auto_result is not None else None
|
||||
args = [self.name(), q] + ([ar] if ar is not None else [])
|
||||
succ = self._run_dialog_with_result(question_dialog.main, args)
|
||||
if succ is None:
|
||||
self.result.set(TestValue.FAILURE, "Dialog subprocess exited without returning a result")
|
||||
return
|
||||
from PySide6.QtWidgets import QMessageBox
|
||||
if succ == QMessageBox.Yes:
|
||||
self.result.set(TestValue.SUCCESS)
|
||||
print('Answer: YES\n')
|
||||
|
||||
@@ -1,7 +1,7 @@
|
||||
|
||||
from interpreter.test_items.test_item import (TestItem, test_run)
|
||||
from interpreter.test_items.test_result import (TestValue)
|
||||
from lib.tum_except import ETUMSyntaxError
|
||||
from runtime.tum_except import ETUMSyntaxError
|
||||
from interpreter.utils.constants import TestItemType as cst
|
||||
from interpreter.test_report.test_report import Export
|
||||
|
||||
|
||||
@@ -8,9 +8,9 @@ import traceback
|
||||
|
||||
from interpreter.test_items.test_item import (TestItem, test_run)
|
||||
from interpreter.test_items.test_result import (TestValue)
|
||||
import libs.testium as tm
|
||||
import api.testium as tm
|
||||
from interpreter.utils.constants import TestItemType as cst
|
||||
from lib.tum_except import ETUMSyntaxError, ETUMRuntimeError, item_load_context
|
||||
from runtime.tum_except import ETUMSyntaxError, ETUMRuntimeError, item_load_context
|
||||
|
||||
|
||||
def nowInBetween(start, end):
|
||||
@@ -31,7 +31,7 @@ class TestItemRun(TestItem):
|
||||
self._type = cst.TYPE_RUN
|
||||
self.is_container = False
|
||||
with item_load_context(self.cmd(), self.name(), self.seqFilename()):
|
||||
self.tum_fime = self._prms.getParam('tum_fime', required=True)
|
||||
self.tum_file = self._prms.getParam('tum', required=True)
|
||||
self.param_file = self._prms.getParam('param_file', default='')
|
||||
self.python_bin = self._prms.getParam('python_bin', default='')
|
||||
self.testium_path = self._prms.getParam('testium_path', default='')
|
||||
@@ -43,39 +43,43 @@ class TestItemRun(TestItem):
|
||||
|
||||
@test_run
|
||||
def execute(self):
|
||||
res = -1
|
||||
try:
|
||||
file_path = self._prms.expanse(self.tum_fime)
|
||||
file_path = self._prms.expanse(self.tum_file)
|
||||
if not os.path.exists(file_path) and not os.path.isabs(file_path):
|
||||
file_path = os.path.join(tm.gd('test_directory'), self.tum_fime)
|
||||
file_path = os.path.join(tm.gd('test_directory'), file_path)
|
||||
if not os.path.isfile(file_path):
|
||||
raise ETUMRuntimeError(
|
||||
'"{}" file could not be found'.format(file_path))
|
||||
self.tum_fime = file_path
|
||||
self.tum_file = file_path
|
||||
pf = self._prms.expanse(self.param_file)
|
||||
pp = self._prms.expanse(self.python_bin)
|
||||
sp = self._prms.expanse(self.testium_path)
|
||||
lp = self._prms.expanse(self.log_path)
|
||||
rp = self._prms.expanse(self.report_path)
|
||||
cmd = []
|
||||
if sp == '':
|
||||
sp = sys.argv[0]
|
||||
if pp != '':
|
||||
cmd.append(pp)
|
||||
if sp == '':
|
||||
sp = os.path.join(tm.get_main_dir(), "testium.pyw")
|
||||
elif not os.path.isfile(sp) or not os.access(sp, os.X_OK):
|
||||
cmd.append(sys.executable)
|
||||
cmd.append(sp)
|
||||
if lp == '':
|
||||
lp = os.path.splitext(self.tum_fime)[0] + "_" + \
|
||||
datetime.utcnow().isoformat(timespec='seconds') + '.log'
|
||||
if tm.text_mode():
|
||||
cmd.append("-b")
|
||||
else:
|
||||
cmd.append("-r")
|
||||
if lp == '':
|
||||
lp = os.path.splitext(self.tum_file)[0] + "_" + \
|
||||
datetime.utcnow().isoformat(timespec='seconds') + '.log'
|
||||
cmd.append("-l")
|
||||
cmd.append('"' + lp + '"')
|
||||
if pf != '':
|
||||
cmd.append("-c")
|
||||
cmd.append('"' + pf + '"')
|
||||
cmd.append("-l")
|
||||
cmd.append('"' + lp + '"')
|
||||
if rp != '':
|
||||
cmd.append("-p")
|
||||
cmd.append('"' + rp + '"')
|
||||
cmd.append(self.tum_fime)
|
||||
cmd.append(self.tum_file)
|
||||
for c in cmd:
|
||||
print(c, end = ' ')
|
||||
|
||||
@@ -90,31 +94,23 @@ class TestItemRun(TestItem):
|
||||
raise ETUMRuntimeError(
|
||||
'"wait_for_exec" set but not start_time or end_time')
|
||||
|
||||
r = None
|
||||
if self.wait_for_exec:
|
||||
while not nowInBetween(self.start_time, self.end_time):
|
||||
sleep(60)
|
||||
r = subprocess.run(
|
||||
cmd, stdout=subprocess.PIPE, stderr=subprocess.PIPE)
|
||||
r = subprocess.run(cmd)
|
||||
elif self.start_time is not None and self.end_time is not None:
|
||||
if nowInBetween(self.start_time, self.end_time):
|
||||
r = subprocess.run(
|
||||
cmd, stdout=subprocess.PIPE, stderr=subprocess.PIPE)
|
||||
r = subprocess.run(cmd)
|
||||
elif self.start_time is not None:
|
||||
if self.start_time < datetime.now().time():
|
||||
r = subprocess.run(
|
||||
cmd, stdout=subprocess.PIPE, stderr=subprocess.PIPE)
|
||||
r = subprocess.run(cmd)
|
||||
else:
|
||||
r = subprocess.run(
|
||||
cmd, stdout=subprocess.PIPE, stderr=subprocess.PIPE)
|
||||
r = subprocess.run(cmd)
|
||||
if isinstance(r, subprocess.CompletedProcess):
|
||||
print((r.stdout).decode())
|
||||
print(r.stderr.decode())
|
||||
res = r.returncode
|
||||
if res >= 0:
|
||||
self.result.set(TestValue.SUCCESS)
|
||||
else:
|
||||
self.result.set(TestValue.FAILURE,
|
||||
'Test execution returned negative value.')
|
||||
self.result.set(TestValue.FAILURE, 'Sub-test did not execute')
|
||||
except:
|
||||
traceback.print_exception(*sys.exc_info())
|
||||
self.result.set(TestValue.FAILURE, 'Unrecoverable "run" item error')
|
||||
|
||||
@@ -3,8 +3,8 @@ import importlib
|
||||
import traceback
|
||||
from functools import wraps
|
||||
|
||||
import libs.testium as tm
|
||||
from lib.tum_except import ETUMSyntaxError, item_load_context
|
||||
import api.testium as tm
|
||||
from runtime.tum_except import ETUMSyntaxError, item_load_context
|
||||
from interpreter.test_items.test_item import TestItem, test_run
|
||||
from interpreter.test_items.test_result import TestResult, TestValue
|
||||
from interpreter.test_items.item_actions import TestItemActions
|
||||
@@ -40,6 +40,7 @@ class TestItemPlotActionOpen(TestItemPlotAction):
|
||||
try:
|
||||
gname = self._prms.expanse(self.token)
|
||||
lpath = self._prms.expanse(self._log_path)
|
||||
runtime_plot = importlib.import_module("api.runtime_plot")
|
||||
gr = runtime_plot.RuntimePlot(gname, lpath)
|
||||
tm.add_plot(gr)
|
||||
|
||||
@@ -233,6 +234,3 @@ class TestItemPlot(TestItemActions):
|
||||
)
|
||||
|
||||
self.actions_token = self._prms.getParam("plot_name", required=True)
|
||||
|
||||
global runtime_plot
|
||||
runtime_plot = importlib.import_module("libs.runtime_plot")
|
||||
|
||||
@@ -3,11 +3,11 @@ from time import sleep
|
||||
from datetime import timedelta
|
||||
from multiprocessing import Process, Pipe
|
||||
|
||||
import api.testium as tm
|
||||
from interpreter.test_items.test_item import (TestItem, test_run)
|
||||
from interpreter.test_items.test_result import (TestValue)
|
||||
from interpreter.test_items.dialog_sleep_files import dialog_sleep
|
||||
from interpreter.utils.constants import TestItemType as cst
|
||||
from lib.tum_except import ETUMSyntaxError, ETUMRuntimeError, item_load_context
|
||||
from runtime.tum_except import ETUMSyntaxError, ETUMRuntimeError, item_load_context
|
||||
|
||||
class TestItemSleep(TestItem):
|
||||
"""sleep item usage.
|
||||
@@ -43,6 +43,20 @@ class TestItemSleep(TestItem):
|
||||
|
||||
#test core function
|
||||
if has_dialog:
|
||||
if tm.text_mode():
|
||||
import time as _time
|
||||
print(f"Sleep {timeout}s (press Ctrl+C to abort)...")
|
||||
end_time = _time.time() + float(timeout)
|
||||
while _time.time() < end_time and not self._is_stopped:
|
||||
sleep(0.2)
|
||||
if self._is_stopped:
|
||||
print("Aborted")
|
||||
self.result.set(TestValue.FAILURE, 'Sleep aborted')
|
||||
else:
|
||||
self.result.set(TestValue.SUCCESS, f'Sleep {timeout} sec')
|
||||
return
|
||||
|
||||
from interpreter.test_items.dialog_sleep_files import dialog_sleep
|
||||
parent_conn, child_conn = Pipe()
|
||||
p=Process(target=dialog_sleep.main, args=([self.name(), timeout],child_conn))
|
||||
p.start()
|
||||
@@ -62,5 +76,8 @@ class TestItemSleep(TestItem):
|
||||
else:
|
||||
if not isinstance(timeout, (int, float)):
|
||||
raise ETUMRuntimeError(f"Timeout value of sleep test item \"{self.name}\" is not valid: \"{timeout}\".")
|
||||
sleep(timeout)
|
||||
import time as _time
|
||||
end_time = _time.time() + float(timeout)
|
||||
while _time.time() < end_time and not self._is_stopped:
|
||||
sleep(min(0.05, end_time - _time.time()))
|
||||
self.result.set(TestValue.SUCCESS, 'Sleep %s sec' % (str(timeout)))
|
||||
|
||||
@@ -1,10 +1,9 @@
|
||||
from interpreter.test_items.test_item import test_run
|
||||
from interpreter.test_items.test_result import TestValue
|
||||
from interpreter.test_items.tested_references_files import tested_refs_dialog
|
||||
from interpreter.test_items.test_item_dialog_base import TestItemDialogBase
|
||||
from interpreter.test_items.test_item_dialog_base import TestItemDialogBase, _is_text_mode, _is_interactive
|
||||
from interpreter.utils.constants import TestItemType as cst
|
||||
from lib.tum_except import item_load_context
|
||||
import libs.testium as tm
|
||||
from runtime.tum_except import item_load_context
|
||||
import api.testium as tm
|
||||
|
||||
|
||||
class TestItemTestedRefsDialog(TestItemDialogBase):
|
||||
@@ -16,12 +15,40 @@ class TestItemTestedRefsDialog(TestItemDialogBase):
|
||||
with item_load_context(self.cmd(), self.name(), self.seqFilename()):
|
||||
self._question = self._prms.getParam('question', required=True)
|
||||
self._init_values = self._prms.getParamAll('reference', required=False, processed=True)
|
||||
self._auto_result = self._prms.getParam('auto_result', required=False, default=None)
|
||||
|
||||
@test_run
|
||||
def execute(self):
|
||||
q = self._prms.expanse(self._question)
|
||||
init_values = ','.join(self._init_values)
|
||||
result = self._run_dialog_with_result(tested_refs_dialog.main, [self.name(), q, init_values])
|
||||
if _is_text_mode():
|
||||
print(f"References: {q}")
|
||||
rows = init_values.split(',') if init_values else ['']
|
||||
result_rows = []
|
||||
for i, row in enumerate(rows):
|
||||
parts = (row.split('/') + ['', '', ''])[:3]
|
||||
if _is_interactive():
|
||||
ref = input(f"Row {i+1} - Reference [{parts[0]}]: ").strip() or parts[0]
|
||||
rev = input(f"Row {i+1} - Revision [{parts[1]}]: ").strip() or parts[1]
|
||||
serial = input(f"Row {i+1} - Serial [{parts[2]}]: ").strip() or parts[2]
|
||||
else:
|
||||
ref, rev, serial = parts[0], parts[1], parts[2]
|
||||
result_rows.append(f"{ref}/{rev}/{serial}")
|
||||
val = ','.join(result_rows)
|
||||
if _is_interactive():
|
||||
succ = True
|
||||
else:
|
||||
ar = self._prms.expanse(self._auto_result) if self._auto_result is not None else None
|
||||
if ar is None:
|
||||
self.result.set(TestValue.FAILURE, 'Dialog not supported in batch mode')
|
||||
return
|
||||
succ = ar != 'cancel'
|
||||
result = [val, succ]
|
||||
else:
|
||||
from interpreter.test_items.tested_references_files import tested_refs_dialog
|
||||
ar = self._prms.expanse(self._auto_result) if self._auto_result is not None else None
|
||||
args = [self.name(), q, init_values] + ([ar] if ar is not None else [])
|
||||
result = self._run_dialog_with_result(tested_refs_dialog.main, args)
|
||||
if result is None:
|
||||
self.result.set(TestValue.FAILURE, "Dialog subprocess exited without returning a result")
|
||||
return
|
||||
|
||||
@@ -4,14 +4,14 @@ from unittest import (TestCase, TestSuite, TextTestRunner,
|
||||
TextTestResult)
|
||||
from unittest.loader import defaultTestLoader
|
||||
|
||||
import libs.testium as tm
|
||||
from lib.tum_except import (ETUMFileError)
|
||||
import api.testium as tm
|
||||
from runtime.tum_except import (ETUMFileError)
|
||||
from interpreter.utils.modules import load_source
|
||||
from interpreter.test_items.test_item import (TestItem, test_run, LOG_TEST_STOP, LOG_TEST_START)
|
||||
from interpreter.test_items.test_result import (TestResult, TestValue)
|
||||
from interpreter.test_items.test_item import test_data
|
||||
from interpreter.utils.constants import TestItemType as cst
|
||||
from lib.stdout_redirect import stdio_redir
|
||||
from runtime.stdout_redirect import stdio_redir
|
||||
|
||||
class UnittestResult(TextTestResult):
|
||||
"""Test result adapted for unittest test"""
|
||||
@@ -96,10 +96,10 @@ class TestItemUnittestElement(TestItem):
|
||||
|
||||
class TestItemUnittestFile(TestItem):
|
||||
def __init__(self, dict_item, parent = None, status_queue=None, filename=""):
|
||||
self._name = cst.TYPE_UNITTEST_FILE.item_name
|
||||
self._name = cst.TYPE_UNITTEST.item_name
|
||||
super().__init__(dict_item, parent, status_queue, filename=filename)
|
||||
self.is_container = True
|
||||
self._type = cst.TYPE_UNITTEST_FILE
|
||||
self._type = cst.TYPE_UNITTEST
|
||||
self._fileName = self._prms.getParam('test_file', required = True, processed = True)
|
||||
self._testDir = ''
|
||||
self._test_methods = self._prms.getParamAll('test_method', processed=True)
|
||||
@@ -161,7 +161,7 @@ class TestItemUnittestFile(TestItem):
|
||||
if self.isStopped():
|
||||
self.result.set(TestValue.NORUN, 'Group execution aborted on user request')
|
||||
else:
|
||||
self.result.set(result.test_result, 'unittest file ' + str(result.test_result))
|
||||
self.result.set(result.test_result, 'unittest ' + str(result.test_result))
|
||||
|
||||
def load(self):
|
||||
ret = {}
|
||||
|
||||
@@ -1,10 +1,9 @@
|
||||
from interpreter.test_items.test_item import test_run
|
||||
from interpreter.test_items.test_result import TestValue
|
||||
from interpreter.test_items.dialog_value_files import test_dialog
|
||||
from interpreter.test_items.test_item_dialog_base import TestItemDialogBase
|
||||
from interpreter.test_items.test_item_dialog_base import TestItemDialogBase, _is_text_mode, _is_interactive
|
||||
from interpreter.utils.constants import TestItemType as cst
|
||||
from lib.tum_except import item_load_context
|
||||
import libs.testium as tm
|
||||
from runtime.tum_except import item_load_context
|
||||
import api.testium as tm
|
||||
|
||||
|
||||
class TestItemValueDialog(TestItemDialogBase):
|
||||
@@ -19,13 +18,45 @@ class TestItemValueDialog(TestItemDialogBase):
|
||||
with item_load_context(self.cmd(), self.name(), self.seqFilename()):
|
||||
self._question = self._prms.getParam('question', required=True)
|
||||
self._default = self._prms.getParam('default', '')
|
||||
self._auto_result = self._prms.getParam('auto_result', required=False, default=None)
|
||||
self._auto_value = self._prms.getParam('auto_value', required=False, default=None)
|
||||
|
||||
@test_run
|
||||
def execute(self):
|
||||
q = self._prms.expanse(self._question)
|
||||
d = self._prms.expanse(self._default)
|
||||
print("Question:\n" + q)
|
||||
result = self._run_dialog_with_result(test_dialog.main, [self.name(), q, d])
|
||||
if _is_text_mode():
|
||||
if _is_interactive():
|
||||
prompt = f"Enter value [{d}]: " if d else "Enter value: "
|
||||
ans = input(prompt).strip()
|
||||
else:
|
||||
ar = self._prms.expanse(self._auto_result) if self._auto_result is not None else None
|
||||
av = self._prms.expanse(self._auto_value) if self._auto_value is not None else None
|
||||
if ar is None:
|
||||
print("Answer: \nDialog not supported in batch mode")
|
||||
self.result.set(TestValue.FAILURE, 'Dialog not supported in batch mode')
|
||||
return
|
||||
if ar == 'cancel':
|
||||
print("Answer: \nDialog cancelled")
|
||||
self.result.set(TestValue.FAILURE, 'Dialog cancelled')
|
||||
return
|
||||
ans = av if av is not None else ''
|
||||
val = ans if ans else d
|
||||
tm.setgd(self.name(), val)
|
||||
print("Answer: " + str(val))
|
||||
if val:
|
||||
self.result.reported = {'question': q, 'answer': val}
|
||||
self.result.value = val
|
||||
self.result.set(TestValue.SUCCESS, val)
|
||||
else:
|
||||
self.result.set(TestValue.FAILURE, 'No value entered')
|
||||
return
|
||||
from interpreter.test_items.dialog_value_files import test_dialog
|
||||
ar = self._prms.expanse(self._auto_result) if self._auto_result is not None else None
|
||||
av = self._prms.expanse(self._auto_value) if self._auto_value is not None else None
|
||||
args = [self.name(), q, d] + ([ar, av] if ar is not None else [])
|
||||
result = self._run_dialog_with_result(test_dialog.main, args)
|
||||
if result is None:
|
||||
self.result.set(TestValue.FAILURE, "Dialog subprocess exited without returning a result")
|
||||
return
|
||||
|
||||
@@ -1,4 +1,4 @@
|
||||
from lib.tum_except import (ETUMRuntimeError)
|
||||
from runtime.tum_except import (ETUMRuntimeError)
|
||||
|
||||
from datetime import datetime
|
||||
from enum import Enum
|
||||
|
||||
@@ -2,7 +2,7 @@ import sys
|
||||
from multiprocessing import freeze_support
|
||||
|
||||
from PySide6.QtWidgets import (QApplication, QDialog, QTableWidgetItem)
|
||||
from PySide6.QtCore import (Qt, QSettings)
|
||||
from PySide6.QtCore import Qt, QSettings, QTimer
|
||||
|
||||
try:
|
||||
from interpreter.test_items.tested_references_files import tested_refs_win
|
||||
@@ -52,6 +52,9 @@ def main(args, conn=None):
|
||||
i += 1
|
||||
|
||||
d.tableReferences.setFocus()
|
||||
auto_result = args[3] if len(args) > 3 else None
|
||||
if auto_result is not None:
|
||||
QTimer.singleShot(2000, lambda: d.accept() if auto_result.lower() == 'ok' else d.reject())
|
||||
dres = d.exec()
|
||||
|
||||
if dres == QDialog.Rejected:
|
||||
|
||||
@@ -3,7 +3,7 @@
|
||||
################################################################################
|
||||
## Form generated from reading UI file 'tested_refs_win.ui'
|
||||
##
|
||||
## Created by: Qt User Interface Compiler version 6.10.1
|
||||
## Created by: Qt User Interface Compiler version 6.11.0
|
||||
##
|
||||
## WARNING! All changes made in this file will be lost when recompiling UI file!
|
||||
################################################################################
|
||||
@@ -44,13 +44,13 @@ class Ui_Dialog(object):
|
||||
font1 = QFont()
|
||||
font1.setPointSize(10)
|
||||
__qtablewidgetitem = QTableWidgetItem()
|
||||
__qtablewidgetitem.setFont(font1);
|
||||
__qtablewidgetitem.setFont(font1)
|
||||
self.tableReferences.setHorizontalHeaderItem(0, __qtablewidgetitem)
|
||||
__qtablewidgetitem1 = QTableWidgetItem()
|
||||
__qtablewidgetitem1.setFont(font1);
|
||||
__qtablewidgetitem1.setFont(font1)
|
||||
self.tableReferences.setHorizontalHeaderItem(1, __qtablewidgetitem1)
|
||||
__qtablewidgetitem2 = QTableWidgetItem()
|
||||
__qtablewidgetitem2.setFont(font1);
|
||||
__qtablewidgetitem2.setFont(font1)
|
||||
self.tableReferences.setHorizontalHeaderItem(2, __qtablewidgetitem2)
|
||||
self.tableReferences.setObjectName(u"tableReferences")
|
||||
self.tableReferences.setGeometry(QRect(10, 130, 461, 211))
|
||||
@@ -70,10 +70,10 @@ class Ui_Dialog(object):
|
||||
Dialog.setWindowTitle(QCoreApplication.translate("Dialog", u"Dialog", None))
|
||||
self.labelDialog.setText(QCoreApplication.translate("Dialog", u"TextLabel", None))
|
||||
___qtablewidgetitem = self.tableReferences.horizontalHeaderItem(0)
|
||||
___qtablewidgetitem.setText(QCoreApplication.translate("Dialog", u"Reference", None));
|
||||
___qtablewidgetitem.setText(QCoreApplication.translate("Dialog", u"Reference", None))
|
||||
___qtablewidgetitem1 = self.tableReferences.horizontalHeaderItem(1)
|
||||
___qtablewidgetitem1.setText(QCoreApplication.translate("Dialog", u"Revision", None));
|
||||
___qtablewidgetitem1.setText(QCoreApplication.translate("Dialog", u"Revision", None))
|
||||
___qtablewidgetitem2 = self.tableReferences.horizontalHeaderItem(2)
|
||||
___qtablewidgetitem2.setText(QCoreApplication.translate("Dialog", u"Serial number", None));
|
||||
___qtablewidgetitem2.setText(QCoreApplication.translate("Dialog", u"Serial number", None))
|
||||
# retranslateUi
|
||||
|
||||
|
||||
@@ -3,7 +3,7 @@ import os
|
||||
import interpreter.test_report.test_report as tr
|
||||
from interpreter.utils.paths import prepare_file_to_save
|
||||
import interpreter.utils.constants as cst
|
||||
import libs.testium as tm
|
||||
import api.testium as tm
|
||||
|
||||
|
||||
class ReportExport:
|
||||
|
||||
@@ -1,5 +1,5 @@
|
||||
from junit_xml import (TestSuite, TestCase)
|
||||
import libs.testium as tm
|
||||
import api.testium as tm
|
||||
from interpreter.test_items.test_result import (TestValue)
|
||||
import interpreter.test_report.report_export as rpe
|
||||
import interpreter.test_report.test_report as tr
|
||||
|
||||
@@ -10,7 +10,7 @@ class ReportExportTxt(rpe.ReportExport):
|
||||
no_value_types = [cst_type.TYPE_CONSOLE.item_name, cst_type.TYPE_SLEEP.item_name,
|
||||
cst_type.TYPE_IMAGE_DLG.item_name, cst_type.TYPE_LET.item_name, cst_type.TYPE_CHECK,
|
||||
cst_type.TYPE_CYCLE.item_name, cst_type.TYPE_GROUP.item_name,
|
||||
cst_type.TYPE_UNITTEST_FILE.item_name, cst_type.TYPE_MESSAGE_DLG.item_name,
|
||||
cst_type.TYPE_UNITTEST.item_name, cst_type.TYPE_MESSAGE_DLG.item_name,
|
||||
cst_type.TYPE_QUESTION_DLG.item_name]
|
||||
|
||||
def __init__(self, name, report_db, report_file, pattern, key, no_header=False):
|
||||
|
||||
@@ -1,10 +1,11 @@
|
||||
import os
|
||||
import threading
|
||||
from functools import wraps
|
||||
import sqlite3
|
||||
from time import (time, sleep)
|
||||
import traceback
|
||||
from lib.tum_except import (ETUMRuntimeError, ETUMSyntaxError)
|
||||
from lib.stdout_redirect import stdio_redir
|
||||
from runtime.tum_except import (ETUMRuntimeError, ETUMSyntaxError)
|
||||
from runtime.stdout_redirect import stdio_redir
|
||||
from interpreter.utils.params import (expanse)
|
||||
from interpreter.utils.paths import prepare_file_to_save
|
||||
import interpreter.utils.constants as cst
|
||||
@@ -19,6 +20,52 @@ sqlite3.register_converter('JSON', convert_json)
|
||||
TEST_REPORT_FILE_REV = '0.1'
|
||||
|
||||
|
||||
def _load_text():
|
||||
from interpreter.test_report.report_export_txt import ReportExportTxt
|
||||
return ReportExportTxt
|
||||
|
||||
def _load_json():
|
||||
from interpreter.test_report.report_export_json import ReportExportJSON
|
||||
return ReportExportJSON
|
||||
|
||||
def _load_junit():
|
||||
try:
|
||||
from interpreter.test_report.report_export_junit import ReportExportJUnit
|
||||
return ReportExportJUnit
|
||||
except ModuleNotFoundError:
|
||||
raise ETUMRuntimeError(
|
||||
'Report format "junit" requires "junit_xml" — pip install junit-xml')
|
||||
|
||||
def _load_html():
|
||||
try:
|
||||
from interpreter.test_report.report_export_html import ReportExportHTML
|
||||
return ReportExportHTML
|
||||
except ModuleNotFoundError:
|
||||
raise ETUMRuntimeError(
|
||||
'Report format "html" requires "lxml" — pip install lxml')
|
||||
|
||||
_EXPORTER_REGISTRY: dict = {
|
||||
cst.REP_TYPE_TEXT: _load_text,
|
||||
cst.REP_TYPE_JSON: _load_json,
|
||||
cst.REP_TYPE_JUNIT: _load_junit,
|
||||
cst.REP_TYPE_HTML: _load_html,
|
||||
}
|
||||
|
||||
def _discover_plugins():
|
||||
try:
|
||||
from importlib.metadata import entry_points
|
||||
for ep in entry_points(group='testium.exporters'):
|
||||
try:
|
||||
cls = ep.load()
|
||||
_EXPORTER_REGISTRY[ep.name] = lambda c=cls: c
|
||||
except Exception as e:
|
||||
print(f'[testium] Failed to load report exporter plugin "{ep.name}": {e}')
|
||||
except Exception:
|
||||
pass
|
||||
|
||||
_discover_plugins()
|
||||
|
||||
|
||||
def tr_procedure(f):
|
||||
@wraps(f)
|
||||
def wrapper(self, *args, **kwds):
|
||||
@@ -81,28 +128,19 @@ class Export:
|
||||
else:
|
||||
path = os.path.join(path, fname)
|
||||
|
||||
if et == cst.REP_TYPE_TEXT:
|
||||
from interpreter.test_report.report_export_txt import ReportExportTxt
|
||||
ReportExportTxt(name, con, path, pats, keys, no_header)
|
||||
elif et == cst.REP_TYPE_JSON:
|
||||
from interpreter.test_report.report_export_json import ReportExportJSON
|
||||
ReportExportJSON(name, con, path, pats, keys, no_header)
|
||||
elif et == cst.REP_TYPE_JUNIT:
|
||||
try:
|
||||
from interpreter.test_report.report_export_junit import ReportExportJUnit
|
||||
ReportExportJUnit(name, con, path, pats, keys, no_header)
|
||||
except ModuleNotFoundError:
|
||||
raise ETUMRuntimeError('"junit_xml" module not available')
|
||||
elif et == cst.REP_TYPE_HTML:
|
||||
try:
|
||||
from interpreter.test_report.report_export_html import ReportExportHTML
|
||||
ReportExportHTML(name, con, path, pats, keys, no_header)
|
||||
except ModuleNotFoundError:
|
||||
raise ETUMRuntimeError('"lxml" module not available')
|
||||
elif et == cst.REP_TYPE_SQLITE:
|
||||
if et == cst.REP_TYPE_SQLITE:
|
||||
pass
|
||||
elif et in _EXPORTER_REGISTRY:
|
||||
try:
|
||||
cls = _EXPORTER_REGISTRY[et]()
|
||||
cls(name, con, path, pats, keys, no_header)
|
||||
except ETUMRuntimeError as e:
|
||||
print(f'[report] Export skipped: {e}')
|
||||
else:
|
||||
raise ETUMSyntaxError('Report export not recognized')
|
||||
available = ', '.join(
|
||||
sorted(_EXPORTER_REGISTRY.keys()) + [cst.REP_TYPE_SQLITE])
|
||||
print(f'[report] Export skipped: format "{et}" not found. '
|
||||
f'Available: {available}')
|
||||
|
||||
class TestReport:
|
||||
TEST_COLS = [[cst.DB_TEST_TIMESTAMP_START, 'INT'],
|
||||
@@ -143,6 +181,7 @@ class TestReport:
|
||||
self._level = 0
|
||||
self._log_stored = False
|
||||
self._con = None
|
||||
self._lock = threading.Lock()
|
||||
|
||||
if dict_report is None:
|
||||
self._active = False
|
||||
@@ -231,7 +270,7 @@ class TestReport:
|
||||
prepare_file_to_save(rep_path)
|
||||
if not os.path.exists(os.path.dirname(rep_path)):
|
||||
raise ETUMRuntimeError("Report path does not exist: " + rep_path)
|
||||
self._con = sqlite3.connect(rep_path)
|
||||
self._con = sqlite3.connect(rep_path, check_same_thread=False)
|
||||
self.createHeader(header)
|
||||
self.createTestTable()
|
||||
self._con.commit()
|
||||
@@ -334,6 +373,7 @@ class TestReport:
|
||||
req = req + '?,'
|
||||
req = req[:-1] + ')'
|
||||
|
||||
with self._lock:
|
||||
self._con.execute(req, param)
|
||||
|
||||
def incLevel(self):
|
||||
|
||||
@@ -2,13 +2,14 @@ import os
|
||||
import datetime
|
||||
from queue import Queue
|
||||
from interpreter.utils.params import expanse
|
||||
import libs.testium as tm
|
||||
from lib.tum_except import ETUMSyntaxError
|
||||
import api.testium as tm
|
||||
from runtime.tum_except import ETUMSyntaxError
|
||||
import interpreter.utils.settings as prefs
|
||||
from interpreter.test_report.test_report import TestReport
|
||||
from interpreter.utils.py_func_exec import PyFuncExecEngine
|
||||
from interpreter.utils.api_srv import api_request
|
||||
from lib.tum_except import ETUMRuntimeError
|
||||
from interpreter.utils import bins
|
||||
from runtime.tum_except import ETUMRuntimeError
|
||||
from interpreter.utils.constants import TestItemType as cst_type
|
||||
import interpreter.utils.constants as cst
|
||||
from interpreter.utils.constants import TEST_TYPE_LIST
|
||||
@@ -49,6 +50,28 @@ class TestSet:
|
||||
self._tree = self.__loadTestTree(tum_fime)
|
||||
self.dict_report = self._testdict.get("report", None)
|
||||
self.set_post_exec()
|
||||
self._validate_runtime_deps()
|
||||
|
||||
def _validate_runtime_deps(self):
|
||||
"""Resolve external interpreters needed by this test tree and fail
|
||||
early with a clear message if any is missing.
|
||||
|
||||
Python is always required (the eval engine always runs). Lua is
|
||||
only required when at least one ``lua_func`` item is present.
|
||||
"""
|
||||
needed = ["python"]
|
||||
if self.__has_item_type(self._rootItem, cst_type.TYPE_LUA_FUNCTION):
|
||||
needed.append("lua")
|
||||
bins.ensure(*needed)
|
||||
|
||||
def __has_item_type(self, parent, item_type):
|
||||
for i in range(parent.childCount()):
|
||||
child = parent.child(i)
|
||||
if child.type() == item_type.item_name:
|
||||
return True
|
||||
if self.__has_item_type(child, item_type):
|
||||
return True
|
||||
return False
|
||||
|
||||
def execute(self):
|
||||
self._report = TestReport(self.dict_report)
|
||||
@@ -352,7 +375,7 @@ class TestSet:
|
||||
tm.print_debug(f' No file: "{post_exec_file}".')
|
||||
return
|
||||
|
||||
proc = PyFuncExecEngine(tm.gd("python_bin", ""), api_request, 10)
|
||||
proc = PyFuncExecEngine(api_request, 10)
|
||||
# start the process for executing external python
|
||||
proc.start()
|
||||
try:
|
||||
@@ -367,13 +390,13 @@ class TestSet:
|
||||
# tests backup is done here
|
||||
succ, res = proc.func_call(post_exec_file, "post_exec", [])
|
||||
if not succ == TestValue.SUCCESS:
|
||||
tm.print_debug(
|
||||
tm.print_warn(
|
||||
f"Test success but the \"post_exec\" function failed: {res}"
|
||||
)
|
||||
else:
|
||||
succ, res = proc.func_call(post_exec_file, "post_exec_fail", [])
|
||||
if not succ == TestValue.SUCCESS:
|
||||
tm.print_debug(
|
||||
tm.print_warn(
|
||||
f"Test failed but the \"post_exec_fail\" function failed: {res}"
|
||||
)
|
||||
finally:
|
||||
@@ -504,7 +527,7 @@ class TestSet:
|
||||
item.is_folded = is_folded
|
||||
child = {}
|
||||
# case where the test item loads itself its descendants
|
||||
if it == cst_type.TYPE_UNITTEST_FILE:
|
||||
if it == cst_type.TYPE_UNITTEST:
|
||||
item.setTestDir(test_dir)
|
||||
child = item.load()
|
||||
elif issubclass(it.item_class, TestItemActions):
|
||||
|
||||
@@ -1,6 +1,6 @@
|
||||
from lib.api import SUPPORTED_API
|
||||
from runtime.api import SUPPORTED_API
|
||||
|
||||
import libs.testium as tm
|
||||
import api.testium as tm
|
||||
|
||||
# Fill the api_dict with the function of tm
|
||||
api_dict = {k: getattr(tm, k) for k in SUPPORTED_API if hasattr(tm, k)}
|
||||
|
||||
151
src/testium/interpreter/utils/bins.py
Normal file
151
src/testium/interpreter/utils/bins.py
Normal file
@@ -0,0 +1,151 @@
|
||||
"""Centralised resolution of external interpreter paths (Python, Lua).
|
||||
|
||||
The user can override the path through the global dict via the keys
|
||||
``python_bin`` and ``lua_bin`` (typically populated from a YAML config).
|
||||
When unset, the system PATH is searched for known candidates.
|
||||
|
||||
Resolution is cached in memory: each interpreter is resolved at most
|
||||
once per testium process. Subsequent calls return the cached value.
|
||||
|
||||
Public API
|
||||
----------
|
||||
``python_bin()`` : resolved python3 path (or "" if missing)
|
||||
``lua_bin()`` : resolved lua >= 5.1 path (or "" if missing)
|
||||
``ensure(*names)`` : resolve every name and raise a clear error if
|
||||
any is missing — meant for early validation at
|
||||
test load time
|
||||
``reset()`` : clear the cache (mostly useful for tests)
|
||||
"""
|
||||
|
||||
import shutil
|
||||
import subprocess
|
||||
|
||||
import api.testium as tm
|
||||
from interpreter.utils.paths import sys_app_path_lin, sys_app_path_win
|
||||
from runtime.tum_except import ETUMRuntimeError
|
||||
|
||||
|
||||
# ---------- Discovery primitives ---------------------------------------------
|
||||
|
||||
_PYTHON_CANDIDATES = ["python3", "python"]
|
||||
_LUA_CANDIDATES = ["lua", "lua5.5", "lua5.4", "lua5.3", "lua5.2", "lua5.1"]
|
||||
|
||||
|
||||
def _which(name):
|
||||
func = sys_app_path_win if tm.OS() == "Windows" else sys_app_path_lin
|
||||
return func(name)
|
||||
|
||||
|
||||
def _python_version(path):
|
||||
cmd = [path, "-c", "import sys; print(sys.version_info[:3])"]
|
||||
try:
|
||||
r = subprocess.run(
|
||||
cmd, capture_output=True, text=True,
|
||||
encoding=tm.sys_encoding(), timeout=10,
|
||||
)
|
||||
except (FileNotFoundError, PermissionError, subprocess.TimeoutExpired):
|
||||
return None
|
||||
try:
|
||||
return eval(r.stdout)
|
||||
except Exception:
|
||||
return None
|
||||
|
||||
|
||||
def _is_python3(path):
|
||||
v = _python_version(path)
|
||||
return v is not None and v[0] == 3
|
||||
|
||||
|
||||
def _lua_version(path):
|
||||
try:
|
||||
r = subprocess.run(
|
||||
[path, "-v"], capture_output=True, text=True, timeout=10,
|
||||
)
|
||||
except (FileNotFoundError, PermissionError, subprocess.TimeoutExpired):
|
||||
return None
|
||||
# On Windows the version banner goes to stderr.
|
||||
line = r.stdout or r.stderr
|
||||
try:
|
||||
major, minor, _patch = line.split(" ")[1].split(".")
|
||||
return (int(major), int(minor))
|
||||
except (IndexError, ValueError):
|
||||
return None
|
||||
|
||||
|
||||
def _is_lua51(path):
|
||||
v = _lua_version(path)
|
||||
return v is not None and v >= (5, 1)
|
||||
|
||||
|
||||
# ---------- Resolver ---------------------------------------------------------
|
||||
|
||||
# (display name, globdict override key, candidate list, validator)
|
||||
_SPECS = {
|
||||
"python": ("Python 3", "python_bin", _PYTHON_CANDIDATES, _is_python3),
|
||||
"lua": ("Lua 5.1+", "lua_bin", _LUA_CANDIDATES, _is_lua51),
|
||||
}
|
||||
|
||||
_resolved = {}
|
||||
|
||||
|
||||
def _resolve(name):
|
||||
if name in _resolved:
|
||||
return _resolved[name]
|
||||
|
||||
display, gd_key, candidates, validator = _SPECS[name]
|
||||
override = tm.gd(gd_key, "") or ""
|
||||
|
||||
path = ""
|
||||
if override:
|
||||
if shutil.which(override) and validator(override):
|
||||
path = override
|
||||
else:
|
||||
tm.print_warn(
|
||||
f"Configured {display} interpreter '{override}' is not usable; "
|
||||
f"falling back to discovery."
|
||||
)
|
||||
|
||||
if not path:
|
||||
for c in candidates:
|
||||
p = _which(c)
|
||||
if not p:
|
||||
continue
|
||||
if validator(p):
|
||||
path = p
|
||||
break
|
||||
|
||||
_resolved[name] = path
|
||||
return path
|
||||
|
||||
|
||||
def python_bin():
|
||||
return _resolve("python")
|
||||
|
||||
|
||||
def lua_bin():
|
||||
return _resolve("lua")
|
||||
|
||||
|
||||
def ensure(*names):
|
||||
"""Resolve each of the given names; raise if any is missing.
|
||||
|
||||
Meant to be called at test load with the set of interpreters the
|
||||
test tree actually needs, so the user gets a clear error before
|
||||
execution starts instead of deep inside an engine spawn.
|
||||
"""
|
||||
missing = []
|
||||
for n in names:
|
||||
if not _resolve(n):
|
||||
display, gd_key, candidates, _ = _SPECS[n]
|
||||
missing.append(
|
||||
f" - {display}: tried {candidates} on PATH, none usable. "
|
||||
f"Set '{gd_key}' in the YAML config to override."
|
||||
)
|
||||
if missing:
|
||||
raise ETUMRuntimeError(
|
||||
"Required external interpreter(s) not found:\n" + "\n".join(missing)
|
||||
)
|
||||
|
||||
|
||||
def reset():
|
||||
_resolved.clear()
|
||||
@@ -8,7 +8,7 @@ class TestItemEnum():
|
||||
self.item_class = item_class
|
||||
|
||||
class TestItemType(Enum):
|
||||
TYPE_UNITTEST_FILE = TestItemEnum("unittest_file", "unittest file")
|
||||
TYPE_UNITTEST = TestItemEnum("unittest", "unittest")
|
||||
TYPE_UNITTEST_STEP = TestItemEnum("unittest_step", "unittest step")
|
||||
TYPE_CONSOLE = TestItemEnum("console", "Console")
|
||||
TYPE_CONSOLE_ACTION = TestItemEnum("console_action", "Console action")
|
||||
@@ -33,6 +33,8 @@ class TestItemType(Enum):
|
||||
TYPE_RUN = TestItemEnum("run", "Run tum")
|
||||
TYPE_JSON_RPC = TestItemEnum("json_rpc", "JSON-RPC")
|
||||
TYPE_JSON_RPC_ACTION = TestItemEnum("json_rpc_action", "JSON-RPC action")
|
||||
TYPE_PARALLEL = TestItemEnum("parallel", "Parallel")
|
||||
TYPE_PARALLEL_BRANCH = TestItemEnum("parallel_branch", "Parallel branch")
|
||||
TYPE_ROOT = TestItemEnum("default", "default")
|
||||
|
||||
@staticmethod
|
||||
|
||||
@@ -1,6 +1,6 @@
|
||||
import libs.testium as tm
|
||||
import api.testium as tm
|
||||
from interpreter.utils.py_eval import eval_exec
|
||||
from lib.tum_except import ETUMSyntaxError, ETUMRuntimeError
|
||||
from runtime.tum_except import ETUMSyntaxError, ETUMRuntimeError
|
||||
|
||||
|
||||
def evaluate(val, **replacement_dict):
|
||||
|
||||
@@ -1,8 +1,8 @@
|
||||
import yaml
|
||||
import os.path
|
||||
import libs.testium as tm
|
||||
import api.testium as tm
|
||||
from interpreter.utils.params import expanse
|
||||
from lib.tum_except import ETUMFileError
|
||||
from runtime.tum_except import ETUMFileError
|
||||
from interpreter.utils.template import template_to_test
|
||||
from copy import copy
|
||||
from interpreter.utils.globdict import global_dict
|
||||
|
||||
@@ -1,6 +1,6 @@
|
||||
|
||||
from interpreter.utils.lua_process import LuaProcessBase
|
||||
from lib.tum_except import ETUMRuntimeError
|
||||
from runtime.tum_except import ETUMRuntimeError
|
||||
from interpreter.test_items.test_result import TestValue
|
||||
|
||||
|
||||
@@ -29,7 +29,7 @@ class LuaFuncExecEngine(LuaProcessBase):
|
||||
|
||||
# In case an error was encountered in the called function
|
||||
elif "error" in answer:
|
||||
msg = f"{answer["error"]}"
|
||||
msg = f"{answer['error']}"
|
||||
return TestValue.FAILURE, msg
|
||||
|
||||
else:
|
||||
|
||||
@@ -1,92 +1,14 @@
|
||||
import os
|
||||
import sys
|
||||
import shutil
|
||||
import subprocess
|
||||
import socket
|
||||
|
||||
import libs.testium as tm
|
||||
from lib.jrpc import JsonRpcClient
|
||||
import api.testium as tm
|
||||
from runtime.jrpc import JsonRpcClient
|
||||
from interpreter.utils.paths import subproc_path
|
||||
from lib.tum_except import ETUMRuntimeError
|
||||
from interpreter.utils.paths import sys_app_path_lin, sys_app_path_win
|
||||
|
||||
def _lua_version(path: str):
|
||||
cmd = f'"{path}" -v'
|
||||
try:
|
||||
result = subprocess.run(
|
||||
cmd,
|
||||
shell=True,
|
||||
capture_output=True,
|
||||
text=True,
|
||||
encoding=tm.sys_encoding(),
|
||||
timeout=10,
|
||||
)
|
||||
# Under windows, the output is on stderr
|
||||
data = result.stdout or result.stderr
|
||||
except (FileNotFoundError, PermissionError, subprocess.TimeoutExpired) as e:
|
||||
data = ""
|
||||
try:
|
||||
vers = ((data.split(" "))[1]).split(".")
|
||||
if len(vers) != 3:
|
||||
vers = (0, 0, 0)
|
||||
except:
|
||||
vers = (0, 0, 0)
|
||||
return tuple(vers)
|
||||
|
||||
|
||||
def _is_lua51(lua_bin):
|
||||
res = False
|
||||
v = _lua_version(lua_bin)
|
||||
if (v[0] == "5") and (v[1] >= "1"):
|
||||
res = True
|
||||
return res
|
||||
|
||||
|
||||
def _sys_lua_bin():
|
||||
sys_lua_bin = tm.gd("_sys_lua_bin", "")
|
||||
if sys_lua_bin != "":
|
||||
return sys_lua_bin
|
||||
|
||||
cur_os = tm.OS()
|
||||
if cur_os == "Windows":
|
||||
func = sys_app_path_win
|
||||
else:
|
||||
func = sys_app_path_lin
|
||||
|
||||
sys_lua_bin = func("lua")
|
||||
if (sys_lua_bin != "") and not _is_lua51(sys_lua_bin):
|
||||
tm.print_debug(f"'{sys_lua_bin}' not a lua 5.1 min.")
|
||||
sys_lua_bin = ""
|
||||
|
||||
tm.print_debug(f"lua bin is: '{sys_lua_bin}'.")
|
||||
tm.setgd("_sys_lua_bin", sys_lua_bin)
|
||||
return sys_lua_bin
|
||||
|
||||
|
||||
def _is_lua_interpreter(path: str, timeout=2) -> bool:
|
||||
"""
|
||||
Checks if the given path points to a valid Lua interpreter.
|
||||
|
||||
Args:
|
||||
path (str): Path to the executable to check.
|
||||
timeout (int, optional): Timeout for the subprocess in seconds. Defaults to 2.
|
||||
|
||||
Returns:
|
||||
bool: True if the path is a Lua interpreter, False otherwise.
|
||||
"""
|
||||
try:
|
||||
result = subprocess.run(
|
||||
[path, "-v"],
|
||||
stdout=subprocess.PIPE,
|
||||
stderr=subprocess.PIPE,
|
||||
text=True,
|
||||
timeout=timeout,
|
||||
)
|
||||
return (result.returncode == 0) and (
|
||||
(result.stdout.startswith("Lua") or result.stderr.startswith("Lua"))
|
||||
)
|
||||
except (FileNotFoundError, PermissionError, subprocess.TimeoutExpired):
|
||||
return False
|
||||
from runtime.tum_except import ETUMRuntimeError
|
||||
from interpreter.utils import bins
|
||||
from interpreter.utils.proc_drain import drain_to_log
|
||||
|
||||
|
||||
class LuaProcessBase:
|
||||
@@ -96,35 +18,15 @@ class LuaProcessBase:
|
||||
"LUA_CPATH": {"replace": True},
|
||||
}
|
||||
|
||||
def __init__(self, lua_bin="", request_handler=None, timeout=10):
|
||||
"""
|
||||
Initializes the Lua function execution engine.
|
||||
|
||||
Args:
|
||||
lua_bin (str, optional): Path to the Lua interpreter. Defaults to system path.
|
||||
request_handler: Handler for JSON-RPC requests.
|
||||
timeout (int, optional): Timeout for operations in seconds. Defaults to 10.
|
||||
def __init__(self, request_handler=None, timeout=10):
|
||||
"""Initializes the Lua function execution engine.
|
||||
|
||||
Raises:
|
||||
ETUMRuntimeError: If the Lua path is invalid or no interpreter is found.
|
||||
ETUMRuntimeError: If no Lua >= 5.1 interpreter is found.
|
||||
"""
|
||||
if lua_bin != "":
|
||||
if shutil.which(lua_bin) is None:
|
||||
raise ETUMRuntimeError(
|
||||
f"The passed lua path is not pointing to an executable: '{lua_bin}'"
|
||||
)
|
||||
|
||||
if not _is_lua_interpreter(lua_bin):
|
||||
raise ETUMRuntimeError(
|
||||
f"The passed executable is not a lua interpreter: '{lua_bin}'"
|
||||
)
|
||||
else:
|
||||
lua_bin = _sys_lua_bin()
|
||||
if lua_bin == "":
|
||||
raise ETUMRuntimeError(f"No valid lua interpreter found")
|
||||
tm.setgd("lua_bin", lua_bin)
|
||||
|
||||
self._lbin = lua_bin
|
||||
self._lbin = bins.lua_bin()
|
||||
if not self._lbin:
|
||||
raise ETUMRuntimeError("No valid Lua 5.1+ interpreter found")
|
||||
self._req_handler = request_handler
|
||||
self._process = None
|
||||
self._port = 0
|
||||
@@ -189,7 +91,17 @@ class LuaProcessBase:
|
||||
if tm.debug_enabled() and tm.gd("debug_rpc", False):
|
||||
params.append("--verbose")
|
||||
|
||||
self._process = subprocess.Popen(params, env=env, cwd=func_proc_path)
|
||||
self._process = subprocess.Popen(
|
||||
params, env=env, cwd=func_proc_path,
|
||||
stdin=subprocess.DEVNULL,
|
||||
stdout=subprocess.PIPE,
|
||||
stderr=subprocess.PIPE,
|
||||
restore_signals=False,
|
||||
)
|
||||
# Route subprocess stdout/stderr (lua require failures, syntax
|
||||
# errors, anything written to fd 1/2 before the in-script
|
||||
# remote_print is set up) into the parent's log.
|
||||
drain_to_log(self._process, prefix="[lua_func] ")
|
||||
|
||||
self._rpc = JsonRpcClient(
|
||||
"localhost", self._port, req_handler=self._req_handler
|
||||
|
||||
@@ -1,5 +1,5 @@
|
||||
import interpreter.utils.globdict as globdict
|
||||
from lib.tum_except import ETUMSyntaxError, ETUMRuntimeError
|
||||
from runtime.tum_except import ETUMSyntaxError, ETUMRuntimeError
|
||||
|
||||
glob_eval_func = None
|
||||
|
||||
|
||||
@@ -5,7 +5,7 @@ from pathlib import Path
|
||||
import testium
|
||||
from interpreter.utils.params import expanse
|
||||
import subprocess
|
||||
import libs.testium as tm
|
||||
import api.testium as tm
|
||||
|
||||
|
||||
def testium_path():
|
||||
@@ -18,12 +18,9 @@ def testium_path():
|
||||
return str(Path(tp).parent.resolve())
|
||||
|
||||
def subproc_path():
|
||||
if getattr(sys, 'frozen', False):
|
||||
# Exécuté depuis le .exe
|
||||
return sys._MEIPASS
|
||||
|
||||
tp = inspect.getfile(inspect.getmodule(testium))
|
||||
return str(Path(tp).parent.parent.resolve())
|
||||
# py_func and lua_func now live inside the testium package; their cwd
|
||||
# is the testium package root, same as testium_path().
|
||||
return testium_path()
|
||||
|
||||
def prepare_file_to_save(file_name, file_ext=""):
|
||||
iname = file_name
|
||||
|
||||
Some files were not shown because too many files have changed in this diff Show More
Reference in New Issue
Block a user