test: refactor webui test flow

Summary

• chore: align usage of config.getoption in pytest
• chore: more error injection logs
• test: refactor webui test flow

Having two different fixtures binary_path and path_to_binary_with_webui results in weird failures in CI:

FAILED test/int/test_couple.py::test_exit_after_apply - conftest.TarantoolError:
    ('ER_NO_SUCH_PROC', "Procedure 'pico._inject_error' is not defined")

The root cause is that one cargo build overrides another with different features enabled. To resolve the issue this patch significantly refactors the test flow:

1. Web UI tests are skipped by default. One can enable it explicitly with pytest --with-webui

2. New fixture cargo_build behavior depends on environment:

   • In local dev environment it rebuilds the project with required features
   • In CI it skips rebuilding and runs tests against the existing build

3. The path_to_binary_with_webui fixture is removed.

See also:

• https://stackoverflow.com/a/55769818/1182787
• https://docs.pytest.org/en/7.4.x/how-to/writing_hook_functions.html
• https://docs.pytest.org/en/7.4.x/how-to/mark.html
• https://docs.pytest.org/en/7.4.x/example/simple.html#control-skipping-of-tests-according-to-command-line-option

Close #435 (closed)

How it looks like

$ pytest -k http_server

test/int/test_http_server.py::test_http_routes PASSED
test/int/test_http_server.py::test_webui SKIPPED (run: pytest --with-webui)

$ pytest -k http_server --with-webui

test/int/test_http_server.py::test_http_routes PASSED
test/int/test_http_server.py::test_webui PASSED

$ cargo b
$ CI=true pytest -k http_server --with-webui

test/int/test_http_server.py::test_http_routes PASSED
test/int/test_http_server.py::test_webui FAILED

Ensure that

• New code is covered by tests
• API is documented
• Changelog is up to date
• (if Lua API changed) Lua API version is bumped in luamod.rs
• (if necessary) A follow-up doc issue is created in picodata/docs and linked here

assigned to @rosik

changed the description

added 3 commits

• f3902713 - chore: more error injection logs
• 8dce7156 - test: refactor webui test flow
• e9cf0ee3 - chore: align usage of config.getoption in pytest

Compare with previous version

added 7 commits

• e9cf0ee3...6e136341 - 4 commits from branch master
• b48de53a - chore: more error injection logs
• 9bd93cab - test: refactor webui test flow
• fbd26bd0 - chore: align usage of config.getoption in pytest

Compare with previous version

marked the checklist item New code is covered by tests as completed

requested review from @gmoshkin

marked this merge request as ready

changed title from Draft: wip: investigate flaky error injection failure to test: refactor webui test flow

approved this merge request

changed the description

added 2 commits

• c675a19d - test: refactor webui test flow
• ee43248c - chore: align usage of config.getoption in pytest

Compare with previous version

added 4 commits

• 8aa017d6 - 1 commit from branch master
• 7f933cff - chore: more error injection logs
• cb672ab3 - test: refactor webui test flow
• be57e5d3 - chore: align usage of config.getoption in pytest

Compare with previous version

added 2 commits

• 6e8c7d9e - test: refactor webui test flow
• 918b5218 - chore: align usage of config.getoption in pytest

Compare with previous version

added 4 commits

• 813ab25a - 1 commit from branch master
• 77499c10 - chore: more error injection logs
• e9646996 - test: refactor webui test flow
• b81fe99d - chore: align usage of config.getoption in pytest

Compare with previous version

changed the description

merged

mentioned in merge request !789 (closed)