peer with id 1 not found
Вот это прикольно
i3 ругается что пира не знает, но ответ от него получает)))
i1 | 2022-10-27 13:48:10.624 [4129] main/112/raft_main_loop I> switched to configuration, config: Configuration { voters: Configuration { incoming: Configuration { voters: {2} }, outgoing: Configuration { voters: {} } }, learners: {1}, learners_next: {}, auto_leave: false }, raft_id: 1Странно что он решил лернером стать
На эту тему кстати есть тикет #146 (closed) (с ним такой фигни не было бы)
Job 34195 log
[0KRunning with gitlab-runner 15.5.0 (0d4137b8)[0;m
[0K on picodata-docker-1 Pm5UPc3D[0;m
section_start:1666878310:prepare_executor
[0K[0K[36;1mPreparing the "docker" executor[0;m[0;m
[0KUsing Docker executor with image docker-public.binary.picodata.io/build-base:latest ...[0;m
[0KUsing docker image sha256:c3eba8e0a3d6963be00c873c44a3cca469aa506c72a6d71e9abe8c5a72f3c76a for docker-public.binary.picodata.io/build-base:latest with digest docker-public.binary.picodata.io/build-base@sha256:9d5767a40bc0a1f0be4ca951d62cc5b1b6ee6c4e9887dac380539367b43d2b2b ...[0;m
section_end:1666878313:prepare_executor
[0Ksection_start:1666878313:prepare_script
[0K[0K[36;1mPreparing environment[0;m[0;m
Running on runner-pm5upc3d-project-58-concurrent-0 via gitlab-ci...
section_end:1666878314:prepare_script
[0Ksection_start:1666878314:get_sources
[0K[0K[36;1mGetting source from Git repository[0;m[0;m
[32;1mFetching changes...[0;m
Reinitialized existing Git repository in /builds/picodata/picodata/picodata/.git/
[32;1mChecking out 51f7954e as fix/commit-index-in-rpc...[0;m
Removing .cargo/
Removing .mypy_cache/
Removing .pytest_cache/
Removing .venv/
Removing target/
[32;1mUpdating/initializing submodules recursively...[0;m
Synchronizing submodule url for 'tarantool'
Synchronizing submodule url for 'tarantool-sys'
Synchronizing submodule url for 'tarantool-sys/src/lib/msgpuck'
Synchronizing submodule url for 'tarantool-sys/src/lib/small'
Synchronizing submodule url for 'tarantool-sys/test-run'
Synchronizing submodule url for 'tarantool-sys/test-run/lib/checks'
Synchronizing submodule url for 'tarantool-sys/test-run/lib/luatest'
Synchronizing submodule url for 'tarantool-sys/test-run/lib/msgpack-python'
Synchronizing submodule url for 'tarantool-sys/test-run/lib/tarantool-python'
Synchronizing submodule url for 'tarantool-sys/third_party/c-ares'
Synchronizing submodule url for 'tarantool-sys/third_party/c-dt'
Synchronizing submodule url for 'tarantool-sys/third_party/curl'
Synchronizing submodule url for 'tarantool-sys/third_party/decNumber'
Synchronizing submodule url for 'tarantool-sys/third_party/libunwind'
Synchronizing submodule url for 'tarantool-sys/third_party/libyaml'
Synchronizing submodule url for 'tarantool-sys/third_party/lua-zlib'
Synchronizing submodule url for 'tarantool-sys/third_party/luafun'
Synchronizing submodule url for 'tarantool-sys/third_party/luajit'
Synchronizing submodule url for 'tarantool-sys/third_party/luarocks'
Synchronizing submodule url for 'tarantool-sys/third_party/luazip'
Synchronizing submodule url for 'tarantool-sys/third_party/nghttp2'
Synchronizing submodule url for 'tarantool-sys/third_party/tz'
Synchronizing submodule url for 'tarantool-sys/third_party/xxHash'
Synchronizing submodule url for 'tarantool-sys/third_party/zstd'
Synchronizing submodule url for 'vshard'
Synchronizing submodule url for 'vshard/test-run'
Synchronizing submodule url for 'vshard/test-run/lib/checks'
Synchronizing submodule url for 'vshard/test-run/lib/luatest'
Synchronizing submodule url for 'vshard/test-run/lib/msgpack-python'
Synchronizing submodule url for 'vshard/test-run/lib/tarantool-python'
Entering 'tarantool'
Entering 'tarantool-sys'
Removing patches-applied
Removing src/main.cc.orig
Removing static-build/CMakeLists.txt.orig
Entering 'tarantool-sys/src/lib/msgpuck'
Entering 'tarantool-sys/src/lib/small'
Entering 'tarantool-sys/test-run'
Entering 'tarantool-sys/test-run/lib/checks'
Entering 'tarantool-sys/test-run/lib/luatest'
Entering 'tarantool-sys/test-run/lib/msgpack-python'
Entering 'tarantool-sys/test-run/lib/tarantool-python'
Entering 'tarantool-sys/third_party/c-ares'
Entering 'tarantool-sys/third_party/c-dt'
Entering 'tarantool-sys/third_party/curl'
Entering 'tarantool-sys/third_party/decNumber'
Entering 'tarantool-sys/third_party/libunwind'
Entering 'tarantool-sys/third_party/libyaml'
Entering 'tarantool-sys/third_party/lua-zlib'
Entering 'tarantool-sys/third_party/luafun'
Entering 'tarantool-sys/third_party/luajit'
Entering 'tarantool-sys/third_party/luarocks'
Entering 'tarantool-sys/third_party/luazip'
Entering 'tarantool-sys/third_party/nghttp2'
Entering 'tarantool-sys/third_party/tz'
Entering 'tarantool-sys/third_party/xxHash'
Entering 'tarantool-sys/third_party/zstd'
Entering 'vshard'
Entering 'vshard/test-run'
Entering 'vshard/test-run/lib/checks'
Entering 'vshard/test-run/lib/luatest'
Entering 'vshard/test-run/lib/msgpack-python'
Entering 'vshard/test-run/lib/tarantool-python'
Entering 'tarantool'
HEAD is now at bf175d2 feat(raft): remove it
Entering 'tarantool-sys'
HEAD is now at 1ec2a9d15 box/module_cache: remove fiber_gc after the func call
Entering 'tarantool-sys/src/lib/msgpuck'
HEAD is now at 0c6680a Introduce MP_EXT validation capabilities
Entering 'tarantool-sys/src/lib/small'
HEAD is now at 04ea715 rlist: fix ASAN error for aligned struct
Entering 'tarantool-sys/test-run'
HEAD is now at 9ccc40f Read default value for `vardir` option from env
Entering 'tarantool-sys/test-run/lib/checks'
HEAD is now at c97888c Fix license authors
Entering 'tarantool-sys/test-run/lib/luatest'
HEAD is now at 963541f 0.5.7 (#222)
Entering 'tarantool-sys/test-run/lib/msgpack-python'
HEAD is now at d816aa8 Merge pull request #136 from tbeu/patch-1
Entering 'tarantool-sys/test-run/lib/tarantool-python'
HEAD is now at ea942f9 test: move unit/ to test/
Entering 'tarantool-sys/third_party/c-ares'
HEAD is now at bbbffa4 cmake: lower required version to 2.8.12
Entering 'tarantool-sys/third_party/c-dt'
HEAD is now at cec6ace build: add simple github action
Entering 'tarantool-sys/third_party/curl'
HEAD is now at 1669b17d3 RELEASE-NOTES: synced
Entering 'tarantool-sys/third_party/decNumber'
HEAD is now at 5ddfde1 Fix typo in decNumberToUInt64
Entering 'tarantool-sys/third_party/libunwind'
HEAD is now at 3f49295a Add automatically generated configuration files
Entering 'tarantool-sys/third_party/libyaml'
HEAD is now at 7f41d55 Make sure libyaml is C89 compliant
Entering 'tarantool-sys/third_party/lua-zlib'
HEAD is now at 2219aff Merge pull request #45 from MilhouseVH/drop_format
Entering 'tarantool-sys/third_party/luafun'
HEAD is now at 04c99f9 Use rawset() when exporting functions to _G
Entering 'tarantool-sys/third_party/luajit'
HEAD is now at 359bfe09 sysprof: change C configuration API
Entering 'tarantool-sys/third_party/luarocks'
HEAD is now at 954c2f5 Add the chdir option for make
Entering 'tarantool-sys/third_party/luazip'
HEAD is now at e9e9b63 Make luazip work under luajit (tarantool)
Entering 'tarantool-sys/third_party/nghttp2'
HEAD is now at 4483fdae Drop mruby and neverbleed submodules
Entering 'tarantool-sys/third_party/tz'
HEAD is now at 95ecc37d Release 2022a
Entering 'tarantool-sys/third_party/xxHash'
HEAD is now at 94e5f23 Merge pull request #441 from Cyan4973/dev
Entering 'tarantool-sys/third_party/zstd'
HEAD is now at a488ba11 Zstd 1.5.0 Release
Entering 'vshard'
HEAD is now at b47b6c2 error: fix conflicting member names
Entering 'vshard/test-run'
HEAD is now at 2604c46 Enable parallel invocation of fragile tests
Entering 'vshard/test-run/lib/checks'
HEAD is now at c97888c Fix license authors
Entering 'vshard/test-run/lib/luatest'
HEAD is now at 10590e7 0.5.6 (#182)
Entering 'vshard/test-run/lib/msgpack-python'
HEAD is now at d816aa8 Merge pull request #136 from tbeu/patch-1
Entering 'vshard/test-run/lib/tarantool-python'
HEAD is now at ea942f9 test: move unit/ to test/
Entering 'tarantool'
Entering 'tarantool-sys'
Entering 'tarantool-sys/src/lib/msgpuck'
Entering 'tarantool-sys/src/lib/small'
Entering 'tarantool-sys/test-run'
Entering 'tarantool-sys/test-run/lib/checks'
Entering 'tarantool-sys/test-run/lib/luatest'
Entering 'tarantool-sys/test-run/lib/msgpack-python'
Entering 'tarantool-sys/test-run/lib/tarantool-python'
Entering 'tarantool-sys/third_party/c-ares'
Entering 'tarantool-sys/third_party/c-dt'
Entering 'tarantool-sys/third_party/curl'
Entering 'tarantool-sys/third_party/decNumber'
Entering 'tarantool-sys/third_party/libunwind'
Entering 'tarantool-sys/third_party/libyaml'
Entering 'tarantool-sys/third_party/lua-zlib'
Entering 'tarantool-sys/third_party/luafun'
Entering 'tarantool-sys/third_party/luajit'
Entering 'tarantool-sys/third_party/luarocks'
Entering 'tarantool-sys/third_party/luazip'
Entering 'tarantool-sys/third_party/nghttp2'
Entering 'tarantool-sys/third_party/tz'
Entering 'tarantool-sys/third_party/xxHash'
Entering 'tarantool-sys/third_party/zstd'
Entering 'vshard'
Entering 'vshard/test-run'
Entering 'vshard/test-run/lib/checks'
Entering 'vshard/test-run/lib/luatest'
Entering 'vshard/test-run/lib/msgpack-python'
Entering 'vshard/test-run/lib/tarantool-python'
Entering 'tarantool'
Entering 'tarantool-sys'
Entering 'tarantool-sys/src/lib/msgpuck'
Entering 'tarantool-sys/src/lib/small'
Entering 'tarantool-sys/test-run'
Entering 'tarantool-sys/test-run/lib/checks'
Entering 'tarantool-sys/test-run/lib/luatest'
Entering 'tarantool-sys/test-run/lib/msgpack-python'
Entering 'tarantool-sys/test-run/lib/tarantool-python'
Entering 'tarantool-sys/third_party/c-ares'
Entering 'tarantool-sys/third_party/c-dt'
Entering 'tarantool-sys/third_party/curl'
Entering 'tarantool-sys/third_party/decNumber'
Entering 'tarantool-sys/third_party/libunwind'
Entering 'tarantool-sys/third_party/libyaml'
Entering 'tarantool-sys/third_party/lua-zlib'
Entering 'tarantool-sys/third_party/luafun'
Entering 'tarantool-sys/third_party/luajit'
Entering 'tarantool-sys/third_party/luarocks'
Entering 'tarantool-sys/third_party/luazip'
Entering 'tarantool-sys/third_party/nghttp2'
Entering 'tarantool-sys/third_party/tz'
Entering 'tarantool-sys/third_party/xxHash'
Entering 'tarantool-sys/third_party/zstd'
Entering 'vshard'
Entering 'vshard/test-run'
Entering 'vshard/test-run/lib/checks'
Entering 'vshard/test-run/lib/luatest'
Entering 'vshard/test-run/lib/msgpack-python'
Entering 'vshard/test-run/lib/tarantool-python'
section_end:1666878327:get_sources
[0Ksection_start:1666878327:restore_cache
[0K[0K[36;1mRestoring cache[0;m[0;m
[32;1mChecking cache for default-2-non_protected...[0;m
No URL provided, cache will not be downloaded from shared cache server. Instead a local version of cache will be extracted.[0;m
[0;33mWARNING: .venv/bin/python: chmod .venv/bin/python: no such file or directory (suppressing repeats)[0;m
[32;1mSuccessfully extracted cache[0;m
section_end:1666878380:restore_cache
[0Ksection_start:1666878380:step_script
[0K[0K[36;1mExecuting "step_script" stage of the job script[0;m[0;m
[0KUsing docker image sha256:c3eba8e0a3d6963be00c873c44a3cca469aa506c72a6d71e9abe8c5a72f3c76a for docker-public.binary.picodata.io/build-base:latest with digest docker-public.binary.picodata.io/build-base@sha256:9d5767a40bc0a1f0be4ca951d62cc5b1b6ee6c4e9887dac380539367b43d2b2b ...[0;m
[32;1m$ pushd tarantool-sys; git describe; popd[0;m
/builds/picodata/picodata/picodata/tarantool-sys /builds/picodata/picodata/picodata
2.10.0-29-g1ec2a9d
/builds/picodata/picodata/picodata
[32;1m$ pushd tarantool-sys/third_party/luajit; git describe; popd[0;m
/builds/picodata/picodata/picodata/tarantool-sys/third_party/luajit /builds/picodata/picodata/picodata
v2.1.0-beta3-188-g359bfe0
/builds/picodata/picodata/picodata
[32;1m$ export RUST_BACKTRACE=1[0;m
[32;1m$ cargo -V[0;m
cargo 1.64.0 (387270bc7 2022-09-16)
[32;1m$ cargo build --locked[0;m
Compiling picodata v22.7.0 (/builds/picodata/picodata/picodata)
Finished dev [unoptimized + debuginfo] target(s) in 34.09s
[32;1m$ cargo test --locked[0;m
Compiling picodata v22.7.0 (/builds/picodata/picodata/picodata)
warning: 'tarantool-sys/patches-applied' exists, so patching step is skipped
Finished test [unoptimized + debuginfo] target(s) in 34.38s
Running unittests src/main.rs (target/debug/deps/picodata-dbe776194ddf6817)
running 16 tests
test args::tests::test_try_parse_address ... ok
test kvcell::tests::kvcell ... ok
test traft::failover::tests::voters_needed ... ok
test traft::topology::tests::reconfigure_failure_domain ... ok
test traft::topology::tests::failure_domain ... ok
test args::tests::test_parse ... ok
test traft::topology::tests::test_instance_id_collision ... ok
test traft::topology::tests::test_override ... ok
test util::tests::uppercase ... ok
test traft::topology::tests::test_replication_factor ... ok
test traft::topology::tests::test_set_active ... ok
test util::tests::str_eq ... ok
test traft::topology::tests::test_simple ... ok
test discovery::tests::test_discovery_2 ... ok
test discovery::tests::test_discovery_1 ... ok
test discovery::tests::test_discovery_3 ... ok
test result: ok. 16 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.57s
Running test/inner.rs (target/debug/deps/inner-af41acb2e457b5bc)
total 9 tests
test test_storage2_other_state ... [0;32mok[0m
test test_storage2_conf_state ... [0;32mok[0m
test test_storage2_hard_state ... [0;32mok[0m
test test_storage2_log ... [0;32mok[0m
test test_storage2 ... [0;32mok[0m
test test_storage_peers ... [0;32mok[0m
test test_version ... [0;32mok[0m
test test_mailbox ... [0;32mok[0m
test test_traft_pool ... [0;32mok[0m
test result: [0;32mok[0m. 9 passed; 0 failed; 0 skipped; finished in 2.91s
[32;1m$ cargo fmt -- -v --check[0;m
Formatting /builds/picodata/picodata/picodata/build.rs
Spent 0.150 secs in the parsing phase, and 0.078 secs in the formatting phase
Formatting /builds/picodata/picodata/picodata/src/app.rs
Formatting /builds/picodata/picodata/picodata/src/args.rs
Formatting /builds/picodata/picodata/picodata/src/discovery.rs
Formatting /builds/picodata/picodata/picodata/src/ipc.rs
Formatting /builds/picodata/picodata/picodata/src/kvcell.rs
Formatting /builds/picodata/picodata/picodata/src/loop.rs
Formatting /builds/picodata/picodata/picodata/src/mailbox.rs
Formatting /builds/picodata/picodata/picodata/src/main.rs
Formatting /builds/picodata/picodata/picodata/src/tarantool.rs
Formatting /builds/picodata/picodata/picodata/src/tlog.rs
Formatting /builds/picodata/picodata/picodata/src/traft/error.rs
Formatting /builds/picodata/picodata/picodata/src/traft/event.rs
Formatting /builds/picodata/picodata/picodata/src/traft/failover.rs
Formatting /builds/picodata/picodata/picodata/src/traft/governor.rs
Formatting /builds/picodata/picodata/picodata/src/traft/mod.rs
Formatting /builds/picodata/picodata/picodata/src/traft/network.rs
Formatting /builds/picodata/picodata/picodata/src/traft/node.rs
Formatting /builds/picodata/picodata/picodata/src/traft/notify.rs
Formatting /builds/picodata/picodata/picodata/src/traft/raft_storage.rs
Formatting /builds/picodata/picodata/picodata/src/traft/rpc/mod.rs
Formatting /builds/picodata/picodata/picodata/src/traft/rpc/replication.rs
Formatting /builds/picodata/picodata/picodata/src/traft/rpc/sharding.rs
Formatting /builds/picodata/picodata/picodata/src/traft/rpc/sync.rs
Formatting /builds/picodata/picodata/picodata/src/traft/storage.rs
Formatting /builds/picodata/picodata/picodata/src/traft/topology.rs
Formatting /builds/picodata/picodata/picodata/src/util.rs
Spent 0.111 secs in the parsing phase, and 0.182 secs in the formatting phase
Formatting /builds/picodata/picodata/picodata/test/inner.rs
Spent 0.000 secs in the parsing phase, and 0.000 secs in the formatting phase
[32;1m$ cargo clippy --version[0;m
clippy 0.1.64 (a55dd71 2022-09-19)
[32;1m$ cargo clippy -- --deny clippy::all[0;m
Compiling picodata v22.7.0 (/builds/picodata/picodata/picodata)
warning: 'tarantool-sys/patches-applied' exists, so patching step is skipped
Finished dev [unoptimized + debuginfo] target(s) in 11.73s
[32;1m$ PIPENV_VENV_IN_PROJECT=1 PIP_NO_CACHE_DIR=true python3.10 -m pipenv install --deploy[0;m
Installing dependencies from Pipfile.lock (64cf42)...
[32;1m$ pipenv run pytest --numprocesses 2 -v[0;m
============================= test session starts ==============================
platform linux -- Python 3.10.6, pytest-7.1.3, pluggy-1.0.0 -- /builds/picodata/picodata/picodata/.venv/bin/python
cachedir: .pytest_cache
rootdir: /builds/picodata/picodata/picodata, configfile: pytest.ini, testpaths: test/int
plugins: harvest-1.10.4, clarity-1.0.1, forked-1.4.0, xdist-2.5.0
gw0 I / gw1 I
[gw0] linux Python 3.10.6 cwd: /builds/picodata/picodata/picodata
[gw1] linux Python 3.10.6 cwd: /builds/picodata/picodata/picodata
[gw0] Python 3.10.6 (main, Oct 21 2022, 14:27:30) [GCC 7.3.1 20180303 (Red Hat 7.3.1-5)]
[gw1] Python 3.10.6 (main, Oct 21 2022, 14:27:30) [GCC 7.3.1 20180303 (Red Hat 7.3.1-5)]
gw0 [36] / gw1 [36]
scheduling tests via LoadScheduling
test/int/test_basics.py::test_call_normalization
test/int/test_basics.py::test_eval_normalization
[gw1] [ 2%] PASSED test/int/test_basics.py::test_eval_normalization
test/int/test_basics.py::test_propose_eval
[gw0] [ 5%] PASSED test/int/test_basics.py::test_call_normalization
test/int/test_basics.py::test_process_management
[gw1] [ 8%] PASSED test/int/test_basics.py::test_propose_eval
test/int/test_basics.py::test_whoami
[gw0] [ 11%] PASSED test/int/test_basics.py::test_process_management
test/int/test_basics.py::test_graceful_stop
[gw1] [ 13%] PASSED test/int/test_basics.py::test_whoami
test/int/test_couple.py::test_follower_proposal
[gw0] [ 16%] PASSED test/int/test_basics.py::test_graceful_stop
test/int/test_basics.py::test_peer_info
[gw0] [ 19%] PASSED test/int/test_basics.py::test_peer_info
test/int/test_couple.py::test_switchover
[gw1] [ 22%] PASSED test/int/test_couple.py::test_follower_proposal
test/int/test_couple.py::test_failover
[gw0] [ 25%] PASSED test/int/test_couple.py::test_switchover
test/int/test_couple.py::test_gl119_panic_in_on_shutdown
[gw1] [ 27%] PASSED test/int/test_couple.py::test_failover
test/int/test_couple.py::test_restart_follower
[gw0] [ 30%] PASSED test/int/test_couple.py::test_gl119_panic_in_on_shutdown
test/int/test_couple.py::test_gl127_graceul_shutdown
[gw0] [ 33%] PASSED test/int/test_couple.py::test_gl127_graceul_shutdown
test/int/test_expelling.py::test_expel_follower
[gw1] [ 36%] PASSED test/int/test_couple.py::test_restart_follower
test/int/test_couple.py::test_restart_leader
[gw0] [ 38%] PASSED test/int/test_expelling.py::test_expel_follower
test/int/test_expelling.py::test_expel_leader
[gw1] [ 41%] PASSED test/int/test_couple.py::test_restart_leader
test/int/test_couple.py::test_restart_both
[gw1] [ 44%] PASSED test/int/test_couple.py::test_restart_both
test/int/test_couple.py::test_deactivation
[gw1] [ 47%] PASSED test/int/test_couple.py::test_deactivation
test/int/test_joining.py::test_parallel
[gw1] [ 50%] PASSED test/int/test_joining.py::test_parallel
test/int/test_joining.py::test_replication
[gw0] [ 52%] ERROR test/int/test_expelling.py::test_expel_leader
test/int/test_expelling.py::test_expel_by_follower
[gw1] [ 55%] PASSED test/int/test_joining.py::test_replication
test/int/test_joining.py::test_init_replication_factor
[gw0] [ 58%] PASSED test/int/test_expelling.py::test_expel_by_follower
test/int/test_joining.py::test_request_follower
[gw0] [ 61%] PASSED test/int/test_joining.py::test_request_follower
test/int/test_joining.py::test_discovery
[gw1] [ 63%] PASSED test/int/test_joining.py::test_init_replication_factor
test/int/test_joining.py::test_cluster_id_mismatch
[gw1] [ 66%] PASSED test/int/test_joining.py::test_cluster_id_mismatch
test/int/test_joining.py::test_join_without_explicit_instance_id
[gw1] [ 69%] PASSED test/int/test_joining.py::test_join_without_explicit_instance_id
test/int/test_joining.py::test_failure_domains
[gw0] [ 72%] PASSED test/int/test_joining.py::test_discovery
test/int/test_joining.py::test_rebootstrap_follower
[gw0] [ 75%] PASSED test/int/test_joining.py::test_rebootstrap_follower
test/int/test_joining.py::test_fail_to_join
[gw1] [ 77%] PASSED test/int/test_joining.py::test_failure_domains
test/int/test_joining.py::test_reconfigure_failure_domains
[gw0] [ 80%] PASSED test/int/test_joining.py::test_fail_to_join
test/int/test_network_effects.py::test_log_rollback
[gw1] [ 83%] PASSED test/int/test_joining.py::test_reconfigure_failure_domains
test/int/test_network_effects.py::test_leader_disruption
[gw1] [ 86%] PASSED test/int/test_network_effects.py::test_leader_disruption
test/int/test_supervisor.py::test_sigint_parent
[gw1] [ 88%] PASSED test/int/test_supervisor.py::test_sigint_parent
test/int/test_supervisor.py::test_sigsegv_child
[gw0] [ 91%] PASSED test/int/test_network_effects.py::test_log_rollback
test/int/test_supervisor.py::test_instance_kill
[gw0] [ 94%] PASSED test/int/test_supervisor.py::test_instance_kill
[gw1] [ 97%] PASSED test/int/test_supervisor.py::test_sigsegv_child
test/int/test_uninitialized.py::test_raft_api
[gw1] [100%] PASSED test/int/test_uninitialized.py::test_raft_api
==================================== ERRORS ====================================
_____________________ ERROR at setup of test_expel_leader ______________________
[gw0] linux -- Python 3.10.6 /builds/picodata/picodata/picodata/.venv/bin/python
cluster = Cluster("127.0.0.1:3300", n=3)
@pytest.fixture
def cluster3(cluster: Cluster):
> cluster.deploy(instance_count=3)
test/int/test_expelling.py:7:
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _
test/conftest.py:500: in deploy
instance.wait_online()
.venv/lib/python3.10/site-packages/funcy/decorators.py:45: in wrapper
return deco(call, *dargs, **dkwargs)
.venv/lib/python3.10/site-packages/funcy/flow.py:127: in retry
return call()
.venv/lib/python3.10/site-packages/funcy/decorators.py:66: in __call__
return self._func(*self._args, **self._kwargs)
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _
self = Instance(i1, listen=127.0.0.1:3301)
@funcy.retry(tries=30, timeout=0.5)
def wait_online(self):
"""Wait until instance attains Online grade
Raises:
AssertionError: if doesn't succeed
"""
whoami = self.call("picolib.whoami")
assert isinstance(whoami, dict)
assert isinstance(whoami["raft_id"], int)
assert isinstance(whoami["instance_id"], str)
self.raft_id = whoami["raft_id"]
self.instance_id = whoami["instance_id"]
myself = self.call("picolib.peer_info", self.instance_id)
assert isinstance(myself, dict)
> assert myself["current_grade"] == "Online"
E assert == failed. [pytest-clarity diff shown]
E [0m
E [0m[32mLHS[0m vs [31mRHS[0m shown below
E [0m
E [0m[32mReplicated[0m
E [0m[31mOnline[0m
E [0m
test/conftest.py:436: AssertionError
---------------------------- Captured stdout setup -----------------------------
i1 | [supervisor:4097] running StartDiscover
i2 | [supervisor:4105] running StartDiscover
i3 | [supervisor:4108] running StartDiscover
i1 | [supervisor:4097] ipc message from child: Some(IpcMessage { next_entrypoint: StartBoot, drop_db: true })
i1 | [supervisor:4097] subprocess finished: Exited(Pid(4103), 0)
i1 | [supervisor] removing file: /tmp/pytest-of-root/pytest-0/popen-gw0/test_expel_leader0/i1/00000000000000000000.snap
i1 | [supervisor] removing file: /tmp/pytest-of-root/pytest-0/popen-gw0/test_expel_leader0/i1/00000000000000000000.xlog
i1 | [supervisor:4097] running StartBoot
i2 | [supervisor:4105] ipc message from child: Some(IpcMessage { next_entrypoint: StartJoin { leader_address: "127.0.0.1:3301" }, drop_db: true })
i2 | [supervisor:4105] subprocess finished: Exited(Pid(4111), 0)
i2 | [supervisor] removing file: /tmp/pytest-of-root/pytest-0/popen-gw0/test_expel_leader0/i2/00000000000000000000.snap
i2 | [supervisor] removing file: /tmp/pytest-of-root/pytest-0/popen-gw0/test_expel_leader0/i2/00000000000000000000.xlog
i2 | [supervisor:4105] running StartJoin { leader_address: "127.0.0.1:3301" }
i3 | [supervisor:4108] ipc message from child: Some(IpcMessage { next_entrypoint: StartJoin { leader_address: "127.0.0.1:3301" }, drop_db: true })
i3 | [supervisor:4108] subprocess finished: Exited(Pid(4113), 0)
i3 | [supervisor] removing file: /tmp/pytest-of-root/pytest-0/popen-gw0/test_expel_leader0/i3/00000000000000000000.snap
i3 | [supervisor] removing file: /tmp/pytest-of-root/pytest-0/popen-gw0/test_expel_leader0/i3/00000000000000000000.xlog
i3 | [supervisor:4108] running StartJoin { leader_address: "127.0.0.1:3301" }
---------------------------- Captured stderr setup -----------------------------
Instance(i1, listen=127.0.0.1:3301) starting...
Instance(i2, listen=127.0.0.1:3302) starting...
Instance(i3, listen=127.0.0.1:3303) starting...
i1 | >>>>> start_discover()
i1 | 2022-10-27 13:48:10.007 [4103] main/103/interactive I> Tarantool 2.10.0-29-g1ec2a9d
i1 | 2022-10-27 13:48:10.008 [4103] main/103/interactive I> log level 6
i1 | 2022-10-27 13:48:10.008 [4103] main/103/interactive I> wal/engine cleanup is paused
i1 | 2022-10-27 13:48:10.008 [4103] main/103/interactive I> mapping 33554432 bytes for memtx tuple arena...
i1 | 2022-10-27 13:48:10.008 [4103] main/103/interactive I> Actual slab_alloc_factor calculated on the basis of desired slab_alloc_factor = 1.044274
i1 | 2022-10-27 13:48:10.008 [4103] main/103/interactive I> mapping 134217728 bytes for vinyl tuple arena...
i1 | 2022-10-27 13:48:10.011 [4103] main/103/interactive I> update replication_synchro_quorum = 1
i1 | 2022-10-27 13:48:10.011 [4103] main/103/interactive I> instance uuid 55e23c87-d921-4f3b-93ec-4eee2d5decb0
i1 | 2022-10-27 13:48:10.011 [4103] main/103/interactive I> initializing an empty data directory
i1 | 2022-10-27 13:48:10.018 [4103] main/103/interactive V> RAFT: recover {term: 1}
i1 | 2022-10-27 13:48:10.018 [4103] main/103/interactive I> assigned id 1 to replica 55e23c87-d921-4f3b-93ec-4eee2d5decb0
i1 | 2022-10-27 13:48:10.018 [4103] main/103/interactive I> update replication_synchro_quorum = 1
i1 | 2022-10-27 13:48:10.019 [4103] main/103/interactive I> cluster uuid ccd9ad20-4b1f-4dd9-93a9-55f84e39b4d9
i1 | 2022-10-27 13:48:10.019 [4103] snapshot/101/main I> saving snapshot `/tmp/pytest-of-root/pytest-0/popen-gw0/test_expel_leader0/i1/00000000000000000000.snap.inprogress'
i1 | 2022-10-27 13:48:10.027 [4103] snapshot/101/main I> done
i2 | >>>>> start_discover()
i2 | 2022-10-27 13:48:10.031 [4111] main/103/interactive I> Tarantool 2.10.0-29-g1ec2a9d
i2 | 2022-10-27 13:48:10.032 [4111] main/103/interactive I> log level 6
i2 | 2022-10-27 13:48:10.032 [4111] main/103/interactive I> wal/engine cleanup is paused
i2 | 2022-10-27 13:48:10.032 [4111] main/103/interactive I> mapping 33554432 bytes for memtx tuple arena...
i2 | 2022-10-27 13:48:10.032 [4111] main/103/interactive I> Actual slab_alloc_factor calculated on the basis of desired slab_alloc_factor = 1.044274
i2 | 2022-10-27 13:48:10.032 [4111] main/103/interactive I> mapping 134217728 bytes for vinyl tuple arena...
i1 | 2022-10-27 13:48:10.033 [4103] main/103/interactive I> RAFT: fencing enabled
i1 | 2022-10-27 13:48:10.033 [4103] main/103/interactive I> RAFT: start state machine
i1 | 2022-10-27 13:48:10.033 [4103] main/103/interactive I> ready to accept requests
i1 | 2022-10-27 13:48:10.033 [4103] main/103/interactive I> RAFT: bump term to 2, follow
i1 | 2022-10-27 13:48:10.033 [4103] main/105/gc I> wal/engine cleanup is resumed
i1 | 2022-10-27 13:48:10.034 [4103] main/111/raft_worker I> RAFT: persisted state {term: 2}
i1 | 2022-10-27 13:48:10.034 [4103] main/111/raft_worker I> RAFT: vote for 1, follow
i1 | 2022-10-27 13:48:10.034 [4103] main/111/raft_worker I> RAFT: persisted state {term: 2, vote: 1}
i1 | 2022-10-27 13:48:10.034 [4103] main/111/raft_worker I> RAFT: enter leader state with quorum 1
i1 | 2022-10-27 13:48:10.034 [4103] main/103/interactive V> feedback_daemon stopped
i1 | 2022-10-27 13:48:10.034 [4103] main/103/interactive V> feedback_daemon stopped
i1 | 2022-10-27 13:48:10.034 [4103] main/103/interactive V> feedback_daemon started
i1 | 2022-10-27 13:48:10.034 [4103] main/103/interactive I> set 'log_level' configuration option to 6
i1 | 2022-10-27 13:48:10.034 [4103] main/103/interactive V> feedback_daemon stopped
i1 | 2022-10-27 13:48:10.034 [4103] main/103/interactive V> feedback_daemon stopped
i1 | 2022-10-27 13:48:10.034 [4103] main/103/interactive V> feedback_daemon started
i1 | 2022-10-27 13:48:10.034 [4103] main/103/interactive I> set 'election_mode' configuration option to "manual"
i1 | 2022-10-27 13:48:10.034 [4103] main/103/interactive V> feedback_daemon stopped
i1 | 2022-10-27 13:48:10.034 [4103] main/103/interactive V> feedback_daemon stopped
i1 | 2022-10-27 13:48:10.034 [4103] main/103/interactive V> feedback_daemon started
i1 | 2022-10-27 13:48:10.034 [4103] main/103/interactive I> set 'feedback_enabled' configuration option to false
i1 | 2022-10-27 13:48:10.034 [4103] main/103/interactive I> set 'log_format' configuration option to "plain"
i1 | 2022-10-27 13:48:10.034 [4103] main/103/interactive I> set 'memtx_memory' configuration option to 33554432
i1 | 2022-10-27 13:48:10.034 [4103] main/103/interactive V> feedback_daemon stopped
i1 | 2022-10-27 13:48:10.034 [4103] main/103/interactive V> feedback_daemon stopped
i1 | 2022-10-27 13:48:10.034 [4103] main/103/interactive V> feedback_daemon started
i1 | 2022-10-27 13:48:10.034 [4103] main/103/interactive I> set 'replication_connect_quorum' configuration option to 32
i1 | 2022-10-27 13:48:10.034 [4103] main/103/interactive I> set 'replication' configuration option to []
i1 | 2022-10-27 13:48:10.034 [4103] main/106/checkpoint_daemon I> scheduled next checkpoint for Thu Oct 27 14:54:00 2022
i2 | 2022-10-27 13:48:10.040 [4111] main/103/interactive I> update replication_synchro_quorum = 1
i2 | 2022-10-27 13:48:10.040 [4111] main/103/interactive I> instance uuid 0aec09e7-a780-4336-899a-0f0031f09077
i2 | 2022-10-27 13:48:10.041 [4111] main/103/interactive I> initializing an empty data directory
i1 | 2022-10-27 13:48:10.047 [4103] main/103/interactive I> tx_binary: bound to 127.0.0.1:3301
i1 | 2022-10-27 13:48:10.047 [4103] main/103/interactive I> set 'listen' configuration option to "127.0.0.1:3301"
i2 | 2022-10-27 13:48:10.048 [4111] main/103/interactive V> RAFT: recover {term: 1}
i2 | 2022-10-27 13:48:10.048 [4111] main/103/interactive I> assigned id 1 to replica 0aec09e7-a780-4336-899a-0f0031f09077
i2 | 2022-10-27 13:48:10.048 [4111] main/103/interactive I> update replication_synchro_quorum = 1
i2 | 2022-10-27 13:48:10.048 [4111] main/103/interactive I> cluster uuid 504c66c5-3985-4731-b9ce-7c89efa25a52
i2 | 2022-10-27 13:48:10.049 [4111] snapshot/101/main I> saving snapshot `/tmp/pytest-of-root/pytest-0/popen-gw0/test_expel_leader0/i2/00000000000000000000.snap.inprogress'
i2 | 2022-10-27 13:48:10.058 [4111] snapshot/101/main I> done
i2 | 2022-10-27 13:48:10.064 [4111] main/103/interactive I> RAFT: fencing enabled
i2 | 2022-10-27 13:48:10.064 [4111] main/103/interactive I> RAFT: start state machine
i2 | 2022-10-27 13:48:10.064 [4111] main/103/interactive I> ready to accept requests
i2 | 2022-10-27 13:48:10.064 [4111] main/103/interactive I> RAFT: bump term to 2, follow
i2 | 2022-10-27 13:48:10.064 [4111] main/105/gc I> wal/engine cleanup is resumed
i3 | >>>>> start_discover()
i2 | 2022-10-27 13:48:10.068 [4111] main/111/raft_worker I> RAFT: persisted state {term: 2}
i2 | 2022-10-27 13:48:10.068 [4111] main/111/raft_worker I> RAFT: vote for 1, follow
i3 | 2022-10-27 13:48:10.069 [4113] main/103/interactive I> Tarantool 2.10.0-29-g1ec2a9d
i3 | 2022-10-27 13:48:10.069 [4113] main/103/interactive I> log level 6
i3 | 2022-10-27 13:48:10.069 [4113] main/103/interactive I> wal/engine cleanup is paused
i3 | 2022-10-27 13:48:10.069 [4113] main/103/interactive I> mapping 33554432 bytes for memtx tuple arena...
i3 | 2022-10-27 13:48:10.069 [4113] main/103/interactive I> Actual slab_alloc_factor calculated on the basis of desired slab_alloc_factor = 1.044274
i3 | 2022-10-27 13:48:10.069 [4113] main/103/interactive I> mapping 134217728 bytes for vinyl tuple arena...
i2 | 2022-10-27 13:48:10.069 [4111] main/111/raft_worker I> RAFT: persisted state {term: 2, vote: 1}
i2 | 2022-10-27 13:48:10.069 [4111] main/111/raft_worker I> RAFT: enter leader state with quorum 1
i2 | 2022-10-27 13:48:10.069 [4111] main/103/interactive V> feedback_daemon stopped
i2 | 2022-10-27 13:48:10.069 [4111] main/103/interactive V> feedback_daemon stopped
i2 | 2022-10-27 13:48:10.070 [4111] main/103/interactive V> feedback_daemon started
i2 | 2022-10-27 13:48:10.070 [4111] main/103/interactive I> set 'log_level' configuration option to 6
i2 | 2022-10-27 13:48:10.070 [4111] main/103/interactive V> feedback_daemon stopped
i2 | 2022-10-27 13:48:10.070 [4111] main/103/interactive V> feedback_daemon stopped
i2 | 2022-10-27 13:48:10.070 [4111] main/103/interactive V> feedback_daemon started
i2 | 2022-10-27 13:48:10.070 [4111] main/103/interactive I> set 'election_mode' configuration option to "manual"
i2 | 2022-10-27 13:48:10.070 [4111] main/103/interactive V> feedback_daemon stopped
i2 | 2022-10-27 13:48:10.070 [4111] main/103/interactive V> feedback_daemon stopped
i2 | 2022-10-27 13:48:10.070 [4111] main/103/interactive V> feedback_daemon started
i2 | 2022-10-27 13:48:10.070 [4111] main/103/interactive I> set 'feedback_enabled' configuration option to false
i2 | 2022-10-27 13:48:10.070 [4111] main/103/interactive I> set 'log_format' configuration option to "plain"
i2 | 2022-10-27 13:48:10.070 [4111] main/103/interactive I> set 'memtx_memory' configuration option to 33554432
i2 | 2022-10-27 13:48:10.070 [4111] main/103/interactive V> feedback_daemon stopped
i2 | 2022-10-27 13:48:10.070 [4111] main/103/interactive V> feedback_daemon stopped
i2 | 2022-10-27 13:48:10.070 [4111] main/103/interactive V> feedback_daemon started
i2 | 2022-10-27 13:48:10.070 [4111] main/103/interactive I> set 'replication_connect_quorum' configuration option to 32
i2 | 2022-10-27 13:48:10.070 [4111] main/103/interactive I> set 'replication' configuration option to []
i2 | 2022-10-27 13:48:10.070 [4111] main/106/checkpoint_daemon I> scheduled next checkpoint for Thu Oct 27 15:24:09 2022
i3 | 2022-10-27 13:48:10.075 [4113] main/103/interactive I> update replication_synchro_quorum = 1
i3 | 2022-10-27 13:48:10.075 [4113] main/103/interactive I> instance uuid c70fd91e-3448-4e6f-b248-6d40e4e1caa2
i3 | 2022-10-27 13:48:10.075 [4113] main/103/interactive I> initializing an empty data directory
i3 | 2022-10-27 13:48:10.084 [4113] main/103/interactive V> RAFT: recover {term: 1}
i3 | 2022-10-27 13:48:10.084 [4113] main/103/interactive I> assigned id 1 to replica c70fd91e-3448-4e6f-b248-6d40e4e1caa2
i3 | 2022-10-27 13:48:10.084 [4113] main/103/interactive I> update replication_synchro_quorum = 1
i3 | 2022-10-27 13:48:10.084 [4113] main/103/interactive I> cluster uuid d0986d30-c6fb-4f24-9fe3-49ee95dd9f68
i3 | 2022-10-27 13:48:10.085 [4113] snapshot/101/main I> saving snapshot `/tmp/pytest-of-root/pytest-0/popen-gw0/test_expel_leader0/i3/00000000000000000000.snap.inprogress'
i2 | 2022-10-27 13:48:10.085 [4111] main/103/interactive I> tx_binary: bound to 127.0.0.1:3302
i2 | 2022-10-27 13:48:10.086 [4111] main/103/interactive I> set 'listen' configuration option to "127.0.0.1:3302"
i3 | 2022-10-27 13:48:10.094 [4113] snapshot/101/main I> done
i3 | 2022-10-27 13:48:10.095 [4113] main/103/interactive I> RAFT: fencing enabled
i3 | 2022-10-27 13:48:10.095 [4113] main/103/interactive I> RAFT: start state machine
i3 | 2022-10-27 13:48:10.095 [4113] main/103/interactive I> ready to accept requests
i3 | 2022-10-27 13:48:10.095 [4113] main/103/interactive I> RAFT: bump term to 2, follow
i3 | 2022-10-27 13:48:10.095 [4113] main/105/gc I> wal/engine cleanup is resumed
i3 | 2022-10-27 13:48:10.095 [4113] main/111/raft_worker I> RAFT: persisted state {term: 2}
i3 | 2022-10-27 13:48:10.095 [4113] main/111/raft_worker I> RAFT: vote for 1, follow
i3 | 2022-10-27 13:48:10.095 [4113] main/111/raft_worker I> RAFT: persisted state {term: 2, vote: 1}
i3 | 2022-10-27 13:48:10.095 [4113] main/111/raft_worker I> RAFT: enter leader state with quorum 1
i3 | 2022-10-27 13:48:10.095 [4113] main/103/interactive V> feedback_daemon stopped
i3 | 2022-10-27 13:48:10.095 [4113] main/103/interactive V> feedback_daemon stopped
i3 | 2022-10-27 13:48:10.095 [4113] main/103/interactive V> feedback_daemon started
i3 | 2022-10-27 13:48:10.095 [4113] main/103/interactive I> set 'log_level' configuration option to 6
i3 | 2022-10-27 13:48:10.095 [4113] main/103/interactive V> feedback_daemon stopped
i3 | 2022-10-27 13:48:10.095 [4113] main/103/interactive V> feedback_daemon stopped
i3 | 2022-10-27 13:48:10.095 [4113] main/103/interactive V> feedback_daemon started
i3 | 2022-10-27 13:48:10.095 [4113] main/103/interactive I> set 'election_mode' configuration option to "manual"
i3 | 2022-10-27 13:48:10.095 [4113] main/103/interactive V> feedback_daemon stopped
i3 | 2022-10-27 13:48:10.095 [4113] main/103/interactive V> feedback_daemon stopped
i3 | 2022-10-27 13:48:10.095 [4113] main/103/interactive V> feedback_daemon started
i3 | 2022-10-27 13:48:10.095 [4113] main/103/interactive I> set 'feedback_enabled' configuration option to false
i3 | 2022-10-27 13:48:10.095 [4113] main/103/interactive I> set 'log_format' configuration option to "plain"
i3 | 2022-10-27 13:48:10.095 [4113] main/103/interactive I> set 'memtx_memory' configuration option to 33554432
i3 | 2022-10-27 13:48:10.095 [4113] main/103/interactive V> feedback_daemon stopped
i3 | 2022-10-27 13:48:10.095 [4113] main/103/interactive V> feedback_daemon stopped
i3 | 2022-10-27 13:48:10.095 [4113] main/103/interactive V> feedback_daemon started
i3 | 2022-10-27 13:48:10.095 [4113] main/103/interactive I> set 'replication_connect_quorum' configuration option to 32
i3 | 2022-10-27 13:48:10.095 [4113] main/103/interactive I> set 'replication' configuration option to []
i3 | 2022-10-27 13:48:10.095 [4113] main/106/checkpoint_daemon I> scheduled next checkpoint for Thu Oct 27 15:08:28 2022
i3 | 2022-10-27 13:48:10.107 [4113] main/103/interactive I> tx_binary: bound to 127.0.0.1:3303
i3 | 2022-10-27 13:48:10.107 [4113] main/103/interactive I> set 'listen' configuration option to "127.0.0.1:3303"
i1 | >>>>> start_boot()
i1 | 2022-10-27 13:48:10.296 [4129] main/103/interactive I> Tarantool 2.10.0-29-g1ec2a9d
i1 | 2022-10-27 13:48:10.296 [4129] main/103/interactive I> log level 6
i1 | 2022-10-27 13:48:10.296 [4129] main/103/interactive I> wal/engine cleanup is paused
i1 | 2022-10-27 13:48:10.296 [4129] main/103/interactive I> mapping 33554432 bytes for memtx tuple arena...
i1 | 2022-10-27 13:48:10.296 [4129] main/103/interactive I> Actual slab_alloc_factor calculated on the basis of desired slab_alloc_factor = 1.044274
i1 | 2022-10-27 13:48:10.296 [4129] main/103/interactive I> mapping 134217728 bytes for vinyl tuple arena...
i1 | 2022-10-27 13:48:10.298 [4129] main/103/interactive I> update replication_synchro_quorum = 1
i1 | 2022-10-27 13:48:10.298 [4129] main/103/interactive I> instance uuid 68d4a766-4144-3248-aeb4-e212356716e4
i1 | 2022-10-27 13:48:10.298 [4129] main/103/interactive I> initializing an empty data directory
i1 | 2022-10-27 13:48:10.305 [4129] main/103/interactive V> RAFT: recover {term: 1}
i1 | 2022-10-27 13:48:10.305 [4129] main/103/interactive I> assigned id 1 to replica 68d4a766-4144-3248-aeb4-e212356716e4
i1 | 2022-10-27 13:48:10.305 [4129] main/103/interactive I> update replication_synchro_quorum = 1
i1 | 2022-10-27 13:48:10.305 [4129] main/103/interactive I> cluster uuid e0df68c5-e7f9-395f-86b3-30ad9e1b7b07
i1 | 2022-10-27 13:48:10.306 [4129] snapshot/101/main I> saving snapshot `/tmp/pytest-of-root/pytest-0/popen-gw0/test_expel_leader0/i1/00000000000000000000.snap.inprogress'
i1 | 2022-10-27 13:48:10.319 [4129] snapshot/101/main I> done
i1 | 2022-10-27 13:48:10.321 [4129] main/103/interactive I> RAFT: fencing enabled
i1 | 2022-10-27 13:48:10.321 [4129] main/103/interactive I> RAFT: start state machine
i1 | 2022-10-27 13:48:10.321 [4129] main/103/interactive I> ready to accept requests
i1 | 2022-10-27 13:48:10.321 [4129] main/103/interactive I> RAFT: bump term to 2, follow
i1 | 2022-10-27 13:48:10.321 [4129] main/105/gc I> wal/engine cleanup is resumed
i1 | 2022-10-27 13:48:10.322 [4129] main/111/raft_worker I> RAFT: persisted state {term: 2}
i1 | 2022-10-27 13:48:10.322 [4129] main/111/raft_worker I> RAFT: vote for 1, follow
i1 | 2022-10-27 13:48:10.322 [4129] main/111/raft_worker I> RAFT: persisted state {term: 2, vote: 1}
i1 | 2022-10-27 13:48:10.322 [4129] main/111/raft_worker I> RAFT: enter leader state with quorum 1
i1 | 2022-10-27 13:48:10.322 [4129] main/103/interactive V> feedback_daemon stopped
i1 | 2022-10-27 13:48:10.322 [4129] main/103/interactive V> feedback_daemon stopped
i1 | 2022-10-27 13:48:10.322 [4129] main/103/interactive V> feedback_daemon started
i1 | 2022-10-27 13:48:10.322 [4129] main/103/interactive I> set 'log_level' configuration option to 6
i1 | 2022-10-27 13:48:10.322 [4129] main/103/interactive V> feedback_daemon stopped
i1 | 2022-10-27 13:48:10.322 [4129] main/103/interactive V> feedback_daemon stopped
i1 | 2022-10-27 13:48:10.322 [4129] main/103/interactive V> feedback_daemon started
i1 | 2022-10-27 13:48:10.322 [4129] main/103/interactive I> set 'election_mode' configuration option to "manual"
i1 | 2022-10-27 13:48:10.322 [4129] main/103/interactive V> feedback_daemon stopped
i1 | 2022-10-27 13:48:10.322 [4129] main/103/interactive V> feedback_daemon stopped
i1 | 2022-10-27 13:48:10.322 [4129] main/103/interactive V> feedback_daemon started
i1 | 2022-10-27 13:48:10.322 [4129] main/103/interactive I> set 'feedback_enabled' configuration option to false
i1 | 2022-10-27 13:48:10.322 [4129] main/103/interactive I> set 'log_format' configuration option to "plain"
i1 | 2022-10-27 13:48:10.322 [4129] main/103/interactive I> set 'memtx_memory' configuration option to 33554432
i1 | 2022-10-27 13:48:10.322 [4129] main/103/interactive I> set 'instance_uuid' configuration option to "68d4a766-4144-3248-aeb4-e212356716e4"
i1 | 2022-10-27 13:48:10.322 [4129] main/103/interactive V> feedback_daemon stopped
i1 | 2022-10-27 13:48:10.322 [4129] main/103/interactive V> feedback_daemon stopped
i1 | 2022-10-27 13:48:10.322 [4129] main/103/interactive V> feedback_daemon started
i1 | 2022-10-27 13:48:10.322 [4129] main/103/interactive I> set 'replication_connect_quorum' configuration option to 32
i1 | 2022-10-27 13:48:10.322 [4129] main/103/interactive I> set 'replication' configuration option to []
i1 | 2022-10-27 13:48:10.322 [4129] main/106/checkpoint_daemon I> scheduled next checkpoint for Thu Oct 27 15:41:14 2022
i1 | 2022-10-27 13:48:10.322 [4129] main/103/interactive I> set 'replicaset_uuid' configuration option to "e0df68c5-e7f9-395f-86b3-30ad9e1b7b07"
i1 | 2022-10-27 13:48:10.334 [4129] main/103/interactive I> >>>>> postjoin()
i1 | 2022-10-27 13:48:10.334 [4129] main/103/interactive I> leaving orphan mode
i1 | 2022-10-27 13:48:10.334 [4129] main/103/interactive I> set 'replication_connect_quorum' configuration option to 0
i1 | 2022-10-27 13:48:10.334 [4129] main/103/interactive I> switched to configuration, config: Configuration { voters: Configuration { incoming: Configuration { voters: {1} }, outgoing: Configuration { voters: {} } }, learners: {}, learners_next: {}, auto_leave: false }, raft_id: 1
i1 | 2022-10-27 13:48:10.335 [4129] main/103/interactive V> reset election timeout 0 -> 35 at 0, election_elapsed: 0, timeout: 35, prev_timeout: 0, raft_id: 1
i1 | 2022-10-27 13:48:10.335 [4129] main/103/interactive I> became follower at term 1, term: 1, raft_id: 1
i1 | 2022-10-27 13:48:10.335 [4129] main/103/interactive I> newRaft, peers: Configuration { incoming: Configuration { voters: {1} }, outgoing: Configuration { voters: {} } }, last term: 1, last index: 4, applied: 0, commit: 4, term: 1, raft_id: 1
i1 | 2022-10-27 13:48:10.335 [4129] main/103/interactive I> RawNode created with id 1., id: 1, raft_id: 1
i1 | 2022-10-27 13:48:10.336 [4129] main/112/raft_main_loop I> switched to configuration, config: Configuration { voters: Configuration { incoming: Configuration { voters: {1} }, outgoing: Configuration { voters: {} } }, learners: {}, learners_next: {}, auto_leave: false }, raft_id: 1
i1 | 2022-10-27 13:48:10.336 [4129] main/112/raft_main_loop V> broadcast, event: raft.entry-applied
i1 | 2022-10-27 13:48:10.336 [4129] main/103/interactive I> this is the only voter in cluster, triggering election immediately
i1 | 2022-10-27 13:48:10.336 [4129] main/103/interactive V> mutex was locked at src/traft/node.rs:877:44
i1 | 2022-10-27 13:48:10.336 [4129] main/112/raft_main_loop V> broadcast, event: raft.topology-changed
i1 | 2022-10-27 13:48:10.336 [4129] main/103/interactive I> starting a new election, term: 1, raft_id: 1
i1 | 2022-10-27 13:48:10.336 [4129] main/103/interactive I> became pre-candidate at term 1, term: 1, raft_id: 1
i1 | 2022-10-27 13:48:10.336 [4129] main/103/interactive V> reset election timeout 35 -> 24 at 2, election_elapsed: 2, timeout: 24, prev_timeout: 35, raft_id: 1
i1 | 2022-10-27 13:48:10.336 [4129] main/103/interactive I> became candidate at term 2, term: 2, raft_id: 1
i1 | 2022-10-27 13:48:10.336 [4129] main/103/interactive V> reset election timeout 24 -> 31 at 0, election_elapsed: 0, timeout: 31, prev_timeout: 24, raft_id: 1
i2 | >>>>> start_join(127.0.0.1:3301)
i1 | 2022-10-27 13:48:10.342 [4129] main/103/interactive I> became leader at term 2, term: 2, raft_id: 1
i1 | 2022-10-27 13:48:10.342 [4129] main/112/raft_main_loop V> broadcast, event: raft.status-changed
i1 | 2022-10-27 13:48:10.343 [4129] main/103/interactive I> tx_binary: bound to 127.0.0.1:3301
i1 | 2022-10-27 13:48:10.343 [4129] main/112/raft_main_loop V> persisted index 5, raft_id: 1
i1 | 2022-10-27 13:48:10.343 [4129] main/112/raft_main_loop V> committing index 5, index: 5, raft_id: 1
i1 | 2022-10-27 13:48:10.343 [4129] main/112/raft_main_loop V> broadcast, event: raft.entry-applied
i1 | 2022-10-27 13:48:10.343 [4129] main/103/interactive I> set 'listen' configuration option to "127.0.0.1:3301"
i1 | 2022-10-27 13:48:10.343 [4129] main/103/interactive V> Getting a read barrier...
i1 | 2022-10-27 13:48:10.343 [4129] main/103/interactive V> mutex was locked at src/traft/node.rs:877:44
i1 | 2022-10-27 13:48:10.343 [4129] main/103/interactive I> Read barrier aquired, raft is ready
i1 | 2022-10-27 13:48:10.344 [4129] main/103/interactive I> initiating self-activation of i1
i1 | 2022-10-27 13:48:10.345 [4129] main/112/raft_main_loop V> persisted index 6, raft_id: 1
i1 | 2022-10-27 13:48:10.345 [4129] main/112/raft_main_loop V> committing index 6, index: 6, raft_id: 1
i1 | 2022-10-27 13:48:10.345 [4129] main/112/raft_main_loop V> broadcast, event: raft.entry-applied
i1 | 2022-10-27 13:48:10.346 [4129] main/112/raft_main_loop V> broadcast, event: raft.topology-changed
i1 | 2022-10-27 13:48:10.346 [4129] main/116/lua V> established connection to peer, raft_id: 1, peer: 127.0.0.1:3301
i1 | 2022-10-27 13:48:10.346 [4129] main I> entering the event loop
i1 | 2022-10-27 13:48:10.347 [4129] main/113/raft_conf_change_loop I> peer synced, instance_id: i1, commit: 6
i1 | 2022-10-27 13:48:10.347 [4129] main/112/raft_main_loop V> persisted index 7, raft_id: 1
i1 | 2022-10-27 13:48:10.347 [4129] main/112/raft_main_loop V> committing index 7, index: 7, raft_id: 1
i1 | 2022-10-27 13:48:10.347 [4129] main/112/raft_main_loop V> broadcast, event: raft.entry-applied
i1 | 2022-10-27 13:48:10.347 [4129] main/113/raft_conf_change_loop I> raft sync processed
i1 | 2022-10-27 13:48:10.348 [4129] main/110/main I> connecting to 1 replicas
i1 | 2022-10-27 13:48:10.348 [4129] main/110/main C> failed to connect to 1 out of 1 replicas
i1 | 2022-10-27 13:48:10.348 [4129] main/110/main I> leaving orphan mode
i1 | 2022-10-27 13:48:10.348 [4129] main/110/main I> set 'replication' configuration option to ["127.0.0.1:3301"]
i1 | 2022-10-27 13:48:10.348 [4129] main/112/raft_main_loop V> broadcast, event: raft.topology-changed
i1 | 2022-10-27 13:48:10.348 [4129] main/113/raft_conf_change_loop I> configured replication with peer, lsn: 25, instance_id: i1
i1 | 2022-10-27 13:48:10.349 [4129] main/120/applier/127.0.0.1:3301 I> remote master 68d4a766-4144-3248-aeb4-e212356716e4 at 127.0.0.1:3301 running Tarantool 2.10.0
i1 | 2022-10-27 13:48:10.349 [4129] main/112/raft_main_loop V> persisted index 8, raft_id: 1
i1 | 2022-10-27 13:48:10.349 [4129] main/112/raft_main_loop V> committing index 8, index: 8, raft_id: 1
i1 | 2022-10-27 13:48:10.349 [4129] main/112/raft_main_loop V> broadcast, event: raft.entry-applied
i1 | 2022-10-27 13:48:10.350 [4129] main/113/raft_conf_change_loop V> mutex was locked at src/traft/node.rs:877:44
i1 | 2022-10-27 13:48:10.350 [4129] main/120/applier/127.0.0.1:3301 I> leaving orphan mode
i1 | 2022-10-27 13:48:10.350 [4129] main/110/main V> mutex was locked at src/traft/node.rs:877:44
i1 | 2022-10-27 13:48:10.350 [4129] main/112/raft_main_loop V> broadcast, event: raft.topology-changed
i1 | 2022-10-27 13:48:10.351 [4129] main/112/raft_main_loop V> persisted index 10, raft_id: 1
i1 | 2022-10-27 13:48:10.351 [4129] main/112/raft_main_loop V> committing index 10, index: 10, raft_id: 1
i1 | 2022-10-27 13:48:10.351 [4129] main/112/raft_main_loop V> broadcast, event: raft.entry-applied
i1 | 2022-10-27 13:48:10.351 [4129] main/113/raft_conf_change_loop I> configured replication, replicaset_id: r1
i1 | 2022-10-27 13:48:10.351 [4129] main/113/raft_conf_change_loop V> mutex was locked at src/traft/node.rs:877:44
i1 | 2022-10-27 13:48:10.352 [4129] main/112/raft_main_loop V> broadcast, event: raft.topology-changed
i1 | 2022-10-27 13:48:10.352 [4129] main/113/raft_conf_change_loop V> broadcast, event: raft.joint-state-enter
i1 | 2022-10-27 13:48:10.352 [4129] main/112/raft_main_loop V> persisted index 11, raft_id: 1
i1 | 2022-10-27 13:48:10.352 [4129] main/112/raft_main_loop V> committing index 11, index: 11, raft_id: 1
i1 | 2022-10-27 13:48:10.352 [4129] main/112/raft_main_loop I> switched to configuration, config: Configuration { voters: Configuration { incoming: Configuration { voters: {2} }, outgoing: Configuration { voters: {1} } }, learners: {}, learners_next: {1}, auto_leave: true }, raft_id: 1
i1 | 2022-10-27 13:48:10.353 [4129] main/112/raft_main_loop V> Sending from 1 to 2, msg: msg_type: MsgAppend to: 2 log_term: 2 index: 10 entries {entry_type: EntryConfChangeV2 term: 2 index: 11 data: "\022\004\010\002\020\001\022\002\020\002"} commit: 11, to: 2, from: 1, raft_id: 1
i1 | 2022-10-27 13:48:10.353 [4129] main/112/raft_main_loop V> broadcast, event: raft.entry-applied
i1 | 2022-10-27 13:48:10.353 [4129] main/112/raft_main_loop I> initiating automatic transition out of joint configuration, config: Configuration { voters: Configuration { incoming: Configuration { voters: {2} }, outgoing: Configuration { voters: {1} } }, learners: {}, learners_next: {1}, auto_leave: true }, raft_id: 1
i2 | 2022-10-27 13:48:10.355 [4130] main/103/interactive I> Tarantool 2.10.0-29-g1ec2a9d
i2 | 2022-10-27 13:48:10.355 [4130] main/103/interactive I> log level 6
i2 | 2022-10-27 13:48:10.355 [4130] main/103/interactive I> wal/engine cleanup is paused
i2 | 2022-10-27 13:48:10.355 [4130] main/103/interactive I> mapping 33554432 bytes for memtx tuple arena...
i2 | 2022-10-27 13:48:10.355 [4130] main/103/interactive I> Actual slab_alloc_factor calculated on the basis of desired slab_alloc_factor = 1.044274
i2 | 2022-10-27 13:48:10.355 [4130] main/103/interactive I> mapping 134217728 bytes for vinyl tuple arena...
i2 | 2022-10-27 13:48:10.364 [4130] main/103/interactive I> update replication_synchro_quorum = 1
i2 | 2022-10-27 13:48:10.364 [4130] main/103/interactive I> instance uuid 24c4ac5f-4981-3441-879c-aee1edb608a6
i2 | 2022-10-27 13:48:10.364 [4130] main/103/interactive I> tx_binary: bound to 127.0.0.1:3302
i2 | 2022-10-27 13:48:10.364 [4130] main/103/interactive I> connecting to 1 replicas
i2 | 2022-10-27 13:48:10.365 [4130] main/113/applier/127.0.0.1:3302 I> remote master 24c4ac5f-4981-3441-879c-aee1edb608a6 at 127.0.0.1:3302 running Tarantool 2.10.0
i2 | 2022-10-27 13:48:10.365 [4130] main/103/interactive I> connected to 1 replicas
i2 | 2022-10-27 13:48:10.365 [4130] main/103/interactive I> initializing an empty data directory
i2 | 2022-10-27 13:48:10.371 [4130] main/103/interactive V> RAFT: recover {term: 1}
i2 | 2022-10-27 13:48:10.371 [4130] main/103/interactive I> assigned id 1 to replica 24c4ac5f-4981-3441-879c-aee1edb608a6
i2 | 2022-10-27 13:48:10.372 [4130] main/103/interactive I> update replication_synchro_quorum = 1
i2 | 2022-10-27 13:48:10.372 [4130] main/103/interactive I> cluster uuid eff4449e-feb2-3d73-87bc-75807cb23191
i3 | >>>>> start_join(127.0.0.1:3301)
i2 | 2022-10-27 13:48:10.373 [4130] snapshot/101/main I> saving snapshot `/tmp/pytest-of-root/pytest-0/popen-gw0/test_expel_leader0/i2/00000000000000000000.snap.inprogress'
i1 | 2022-10-27 13:48:10.378 [4129] main/122/lua V> established connection to peer, raft_id: 2, peer: 127.0.0.1:3302
i1 | 2022-10-27 13:48:10.379 [4129] main/122/lua V> error when sending message to peer: Server responded with error: Execute access to function '.raft_interact' is denied for user 'guest', peer: 2
i2 | 2022-10-27 13:48:10.386 [4130] snapshot/101/main I> done
i1 | 2022-10-27 13:48:10.387 [4129] main/112/raft_main_loop V> persisted index 13, raft_id: 1
i2 | 2022-10-27 13:48:10.391 [4130] main/103/interactive I> RAFT: fencing enabled
i2 | 2022-10-27 13:48:10.391 [4130] main/103/interactive I> RAFT: start state machine
i2 | 2022-10-27 13:48:10.391 [4130] main/103/interactive I> ready to accept requests
i2 | 2022-10-27 13:48:10.391 [4130] main/103/interactive I> RAFT: bump term to 2, follow
i2 | 2022-10-27 13:48:10.391 [4130] main/107/gc I> wal/engine cleanup is resumed
i2 | 2022-10-27 13:48:10.391 [4130] main/113/applier/127.0.0.1:3302 I> leaving orphan mode
i2 | 2022-10-27 13:48:10.391 [4130] main/114/raft_worker I> RAFT: persisted state {term: 2}
i2 | 2022-10-27 13:48:10.391 [4130] main/114/raft_worker I> RAFT: vote for 1, follow
i2 | 2022-10-27 13:48:10.391 [4130] main/114/raft_worker I> RAFT: persisted state {term: 2, vote: 1}
i2 | 2022-10-27 13:48:10.391 [4130] main/114/raft_worker I> RAFT: enter leader state with quorum 1
i2 | 2022-10-27 13:48:10.392 [4130] main/103/interactive V> feedback_daemon stopped
i2 | 2022-10-27 13:48:10.392 [4130] main/103/interactive V> feedback_daemon stopped
i2 | 2022-10-27 13:48:10.392 [4130] main/103/interactive V> feedback_daemon started
i2 | 2022-10-27 13:48:10.392 [4130] main/103/interactive I> set 'log_level' configuration option to 6
i2 | 2022-10-27 13:48:10.392 [4130] main/103/interactive V> feedback_daemon stopped
i2 | 2022-10-27 13:48:10.392 [4130] main/103/interactive V> feedback_daemon stopped
i2 | 2022-10-27 13:48:10.392 [4130] main/103/interactive V> feedback_daemon started
i2 | 2022-10-27 13:48:10.392 [4130] main/103/interactive I> set 'election_mode' configuration option to "manual"
i2 | 2022-10-27 13:48:10.392 [4130] main/103/interactive V> feedback_daemon stopped
i2 | 2022-10-27 13:48:10.392 [4130] main/103/interactive V> feedback_daemon stopped
i2 | 2022-10-27 13:48:10.392 [4130] main/103/interactive V> feedback_daemon started
i2 | 2022-10-27 13:48:10.392 [4130] main/103/interactive I> set 'feedback_enabled' configuration option to false
i2 | 2022-10-27 13:48:10.392 [4130] main/103/interactive I> set 'log_format' configuration option to "plain"
i2 | 2022-10-27 13:48:10.392 [4130] main/103/interactive I> set 'memtx_memory' configuration option to 33554432
i2 | 2022-10-27 13:48:10.392 [4130] main/103/interactive I> set 'instance_uuid' configuration option to "24c4ac5f-4981-3441-879c-aee1edb608a6"
i2 | 2022-10-27 13:48:10.392 [4130] main/103/interactive I> set 'listen' configuration option to "127.0.0.1:3302"
i2 | 2022-10-27 13:48:10.392 [4130] main/103/interactive V> feedback_daemon stopped
i2 | 2022-10-27 13:48:10.392 [4130] main/103/interactive V> feedback_daemon stopped
i2 | 2022-10-27 13:48:10.392 [4130] main/103/interactive V> feedback_daemon started
i2 | 2022-10-27 13:48:10.392 [4130] main/103/interactive I> set 'replication_connect_quorum' configuration option to 32
i2 | 2022-10-27 13:48:10.392 [4130] main/103/interactive I> set 'replication' configuration option to ["127.0.0.1:3302"]
i2 | 2022-10-27 13:48:10.392 [4130] main/108/checkpoint_daemon I> scheduled next checkpoint for Thu Oct 27 14:54:18 2022
i2 | 2022-10-27 13:48:10.392 [4130] main/103/interactive I> set 'replicaset_uuid' configuration option to "eff4449e-feb2-3d73-87bc-75807cb23191"
i2 | 2022-10-27 13:48:10.409 [4130] main/103/interactive I> >>>>> postjoin()
i2 | 2022-10-27 13:48:10.411 [4130] main/103/interactive I> leaving orphan mode
i2 | 2022-10-27 13:48:10.411 [4130] main/103/interactive I> set 'replication_connect_quorum' configuration option to 0
i2 | 2022-10-27 13:48:10.411 [4130] main/103/interactive I> switched to configuration, config: Configuration { voters: Configuration { incoming: Configuration { voters: {} }, outgoing: Configuration { voters: {} } }, learners: {}, learners_next: {}, auto_leave: false }, raft_id: 2
i2 | 2022-10-27 13:48:10.412 [4130] main/103/interactive V> reset election timeout 0 -> 21 at 0, election_elapsed: 0, timeout: 21, prev_timeout: 0, raft_id: 2
i2 | 2022-10-27 13:48:10.412 [4130] main/103/interactive I> became follower at term 0, term: 0, raft_id: 2
i2 | 2022-10-27 13:48:10.412 [4130] main/103/interactive I> newRaft, peers: Configuration { incoming: Configuration { voters: {} }, outgoing: Configuration { voters: {} } }, last term: 0, last index: 0, applied: 0, commit: 0, term: 0, raft_id: 2
i2 | 2022-10-27 13:48:10.412 [4130] main/103/interactive I> RawNode created with id 2., id: 2, raft_id: 2
i2 | 2022-10-27 13:48:10.412 [4130] main/103/interactive V> Getting a read barrier...
i1 | 2022-10-27 13:48:10.588 [4129] main/112/raft_main_loop V> Sending from 1 to 2, msg: msg_type: MsgHeartbeat to: 2, to: 2, from: 1, raft_id: 1
i2 | 2022-10-27 13:48:10.589 [4130] main/112/main I> received a message with higher term from 1, msg type: MsgHeartbeat, message_term: 2, term: 0, from: 1, raft_id: 2
i2 | 2022-10-27 13:48:10.589 [4130] main/112/main V> reset election timeout 21 -> 24 at 1, election_elapsed: 1, timeout: 24, prev_timeout: 21, raft_id: 2
i2 | 2022-10-27 13:48:10.589 [4130] main/112/main I> became follower at term 2, term: 2, raft_id: 2
i2 | 2022-10-27 13:48:10.591 [4130] main/112/main V> Sending from 2 to 1, msg: msg_type: MsgHeartbeatResponse to: 1, to: 1, from: 2, raft_id: 2
i2 | 2022-10-27 13:48:10.591 [4130] main/115/raft_main_loop V> broadcast, event: raft.status-changed
i2 | 2022-10-27 13:48:10.591 [4130] main/103/interactive V> mutex was locked at src/traft/node.rs:877:44
i1 | 2022-10-27 13:48:10.592 [4129] main/122/lua V> received response, peer: 2
i2 | 2022-10-27 13:48:10.592 [4130] main/117/lua V> established connection to peer, raft_id: 1, peer: 127.0.0.1:3301
i2 | 2022-10-27 13:48:10.593 [4130] main/103/interactive V> Sending from 2 to 1, msg: msg_type: MsgReadIndex to: 1 entries {data: "\202\242lc\203\242id\002\243gen\001\245count\001\242op\201\244kind\243nop"}, to: 1, from: 2, raft_id: 2
i1 | 2022-10-27 13:48:10.594 [4129] main/121/main V> Sending from 1 to 2, msg: msg_type: MsgAppend to: 2 log_term: 2 index: 10 entries {entry_type: EntryConfChangeV2 term: 2 index: 11 data: "\022\004\010\002\020\001\022\002\020\002"} commit: 11, to: 2, from: 1, raft_id: 1
i1 | 2022-10-27 13:48:10.594 [4129] main/125/main V> Sending from 1 to 2, msg: msg_type: MsgHeartbeat to: 2 context: "\202\242lc\203\242id\002\243gen\001\245count\001\242op\201\244kind\243nop", to: 2, from: 1, raft_id: 1
i2 | 2022-10-27 13:48:10.594 [4130] main/112/main V> rejected msgApp [logterm: 2, index: 10] from 1, logterm: Ok(0), index: 10, from: 1, msg_index: 10, msg_log_term: 2, raft_id: 2
i2 | 2022-10-27 13:48:10.595 [4130] main/112/main V> Sending from 2 to 1, msg: msg_type: MsgAppendResponse to: 1 index: 10 reject: true, to: 1, from: 2, raft_id: 2
i2 | 2022-10-27 13:48:10.595 [4130] main/120/main V> Sending from 2 to 1, msg: msg_type: MsgHeartbeatResponse to: 1 context: "\202\242lc\203\242id\002\243gen\001\245count\001\242op\201\244kind\243nop", to: 1, from: 2, raft_id: 2
i1 | 2022-10-27 13:48:10.595 [4129] main/122/lua V> received response, peer: 2
i1 | 2022-10-27 13:48:10.595 [4129] main/122/lua V> received response, peer: 2
i2 | 2022-10-27 13:48:10.595 [4130] main/117/lua V> received response, peer: 1
i2 | 2022-10-27 13:48:10.595 [4130] main/117/lua V> received response, peer: 1
i1 | 2022-10-27 13:48:10.596 [4129] main/125/main V> received msgAppend rejection, index: 10, from: 2, reject_hint_term: 0, reject_hint_index: 0, raft_id: 1
i1 | 2022-10-27 13:48:10.596 [4129] main/125/main V> decreased progress of 2, progress: Progress { matched: 0, next_idx: 1, state: Probe, paused: false, pending_snapshot: 0, pending_request_snapshot: 0, recent_active: true, ins: Inflights { start: 0, count: 0, buffer: [] }, commit_group_id: 0, committed_index: 0 }, raft_id: 1
i1 | 2022-10-27 13:48:10.597 [4129] main/125/main V> Sending from 1 to 2, msg: msg_type: MsgAppend to: 2 entries {term: 1 index: 1 context: "\202\242lc\203\242id\001\243gen\000\245count\001\242op\202\244kind\254persist_peer\244peer\213\253instance_id\242i1\255instance_uuid\331$68d4a766-4144-3248-aeb4-e212356716e4\247raft_id\001\254peer_address\256127.0.0.1:3301\255replicaset_id\242r1\257replicaset_uuid\331$e0df68c5-e7f9-395f-86b3-30ad9e1b7b07\251is_master\302\254commit_index\001\255current_grade\247Offline\254target_grade\247Offline\256failure_domain\200"} commit: 11, to: 2, from: 1, raft_id: 1
i1 | 2022-10-27 13:48:10.598 [4129] main/121/main V> Sending from 1 to 2, msg: msg_type: MsgAppend to: 2 entries {term: 1 index: 1 context: "\202\242lc\203\242id\001\243gen\000\245count\001\242op\202\244kind\254persist_peer\244peer\213\253instance_id\242i1\255instance_uuid\331$68d4a766-4144-3248-aeb4-e212356716e4\247raft_id\001\254peer_address\256127.0.0.1:3301\255replicaset_id\242r1\257replicaset_uuid\331$e0df68c5-e7f9-395f-86b3-30ad9e1b7b07\251is_master\302\254commit_index\001\255current_grade\247Offline\254target_grade\247Offline\256failure_domain\200"} commit: 11, to: 2, from: 1, raft_id: 1
i1 | 2022-10-27 13:48:10.598 [4129] main/121/main V> Sending from 1 to 2, msg: msg_type: MsgReadIndexResp to: 2 index: 11 entries {data: "\202\242lc\203\242id\002\243gen\001\245count\001\242op\201\244kind\243nop"}, to: 2, from: 1, raft_id: 1
i2 | 2022-10-27 13:48:10.598 [4130] main/120/main V> Sending from 2 to 1, msg: msg_type: MsgAppendResponse to: 1 index: 1 commit: 1, to: 1, from: 2, raft_id: 2
i2 | 2022-10-27 13:48:10.599 [4130] main/112/main V> got message with lower index than committed., raft_id: 2
i2 | 2022-10-27 13:48:10.599 [4130] main/112/main V> Sending from 2 to 1, msg: msg_type: MsgAppendResponse to: 1 index: 1 commit: 1, to: 1, from: 2, raft_id: 2
i1 | 2022-10-27 13:48:10.599 [4129] main/122/lua V> received response, peer: 2
i1 | 2022-10-27 13:48:10.600 [4129] main/122/lua V> received response, peer: 2
i1 | 2022-10-27 13:48:10.600 [4129] main/122/lua V> received response, peer: 2
i2 | 2022-10-27 13:48:10.600 [4130] main/117/lua V> received response, peer: 1
i2 | 2022-10-27 13:48:10.600 [4130] main/117/lua V> received response, peer: 1
i2 | 2022-10-27 13:48:10.600 [4130] main/103/interactive I> Read barrier aquired, raft is ready
i2 | 2022-10-27 13:48:10.600 [4130] main/103/interactive I> initiating self-activation of i2
i2 | 2022-10-27 13:48:10.602 [4130] main/115/raft_main_loop V> persisted index 1, raft_id: 2
i1 | 2022-10-27 13:48:10.602 [4129] main/112/raft_main_loop V> persisted index 14, raft_id: 1
i2 | 2022-10-27 13:48:10.602 [4130] main/115/raft_main_loop V> broadcast, event: raft.entry-applied
i1 | 2022-10-27 13:48:10.603 [4129] main/125/main V> Sending from 1 to 2, msg: msg_type: MsgAppend to: 2 log_term: 1 index: 1 entries {term: 1 index: 2 context: "\202\242lc\203\242id\001\243gen\000\245count\002\242op\202\244kind\243dml\246Insert\202\245space\255cluster_state\245tuple\304\025\222\262replication_factor\001"} commit: 11, to: 2, from: 1, raft_id: 1
i1 | 2022-10-27 13:48:10.604 [4129] main/125/main V> Sending from 1 to 2, msg: msg_type: MsgAppend to: 2 log_term: 1 index: 2 entries {term: 1 index: 3 context: "\202\242lc\203\242id\001\243gen\000\245count\003\242op\202\244kind\243dml\246Insert\202\245space\255cluster_state\245tuple\304\025\222\262replicaset_weights\200"} commit: 11, to: 2, from: 1, raft_id: 1
i2 | 2022-10-27 13:48:10.604 [4130] main/115/raft_main_loop V> broadcast, event: raft.topology-changed
i1 | 2022-10-27 13:48:10.605 [4129] main/125/main V> Sending from 1 to 2, msg: msg_type: MsgAppend to: 2 log_term: 1 index: 3 entries {entry_type: EntryConfChange term: 1 index: 4 data: "\030\001"} commit: 11, to: 2, from: 1, raft_id: 1
i1 | 2022-10-27 13:48:10.606 [4129] main/125/main V> Sending from 1 to 2, msg: msg_type: MsgAppend to: 2 log_term: 1 index: 4 entries {term: 2 index: 5} commit: 11, to: 2, from: 1, raft_id: 1
i1 | 2022-10-27 13:48:10.607 [4129] main/125/main V> Sending from 1 to 2, msg: msg_type: MsgAppend to: 2 log_term: 2 index: 5 entries {term: 2 index: 6 context: "\202\242lc\203\242id\001\243gen\001\245count\002\242op\202\244kind\254persist_peer\244peer\213\253instance_id\242i1\255instance_uuid\331$68d4a766-4144-3248-aeb4-e212356716e4\247raft_id\001\254peer_address\256127.0.0.1:3301\255replicaset_id\242r1\257replicaset_uuid\331$e0df68c5-e7f9-395f-86b3-30ad9e1b7b07\251is_master\302\254commit_index\006\255current_grade\247Offline\254target_grade\246Online\256failure_domain\200"} commit: 11, to: 2, from: 1, raft_id: 1
i1 | 2022-10-27 13:48:10.608 [4129] main/125/main V> Sending from 1 to 2, msg: msg_type: MsgAppend to: 2 log_term: 2 index: 6 entries {term: 2 index: 7 context: "\202\242lc\203\242id\001\243gen\001\245count\003\242op\202\244kind\254persist_peer\244peer\213\253instance_id\242i1\255instance_uuid\331$68d4a766-4144-3248-aeb4-e212356716e4\247raft_id\001\254peer_address\256127.0.0.1:3301\255replicaset_id\242r1\257replicaset_uuid\331$e0df68c5-e7f9-395f-86b3-30ad9e1b7b07\251is_master\302\254commit_index\007\255current_grade\252RaftSynced\254target_grade\246Online\256failure_domain\200"} commit: 11, to: 2, from: 1, raft_id: 1
i1 | 2022-10-27 13:48:10.608 [4129] main/125/main V> Sending from 1 to 2, msg: msg_type: MsgAppend to: 2 log_term: 2 index: 7 entries {term: 2 index: 8 context: "\202\242lc\203\242id\001\243gen\001\245count\004\242op\202\244kind\254persist_peer\244peer\213\253instance_id\242i1\255instance_uuid\331$68d4a766-4144-3248-aeb4-e212356716e4\247raft_id\001\254peer_address\256127.0.0.1:3301\255replicaset_id\242r1\257replicaset_uuid\331$e0df68c5-e7f9-395f-86b3-30ad9e1b7b07\251is_master\303\254commit_index\010\255current_grade\252Replicated\254target_grade\246Online\256failure_domain\200"} commit: 11, to: 2, from: 1, raft_id: 1
i1 | 2022-10-27 13:48:10.609 [4129] main/125/main V> Sending from 1 to 2, msg: msg_type: MsgAppend to: 2 log_term: 2 index: 8 entries {term: 2 index: 9 context: "\202\242lc\203\242id\001\243gen\001\245count\005\242op\202\244kind\243dml\246Update\203\245space\255cluster_state\243key\304\024\221\262replicaset_weights\243ops\221\304\034\223\241=\257[\'value\'][\'r1\']\313?\360\000\000\000\000\000\000"} commit: 11, to: 2, from: 1, raft_id: 1
i1 | 2022-10-27 13:48:10.610 [4129] main/125/main V> Sending from 1 to 2, msg: msg_type: MsgAppend to: 2 log_term: 2 index: 9 entries {term: 2 index: 10 context: "\202\242lc\203\242id\001\243gen\001\245count\006\242op\202\244kind\254persist_peer\244peer\213\253instance_id\242i2\255instance_uuid\331$24c4ac5f-4981-3441-879c-aee1edb608a6\247raft_id\002\254peer_address\256127.0.0.1:3302\255replicaset_id\242r2\257replicaset_uuid\331$eff4449e-feb2-3d73-87bc-75807cb23191\251is_master\302\254commit_index\n\255current_grade\247Offline\254target_grade\247Offline\256failure_domain\200"} commit: 11, to: 2, from: 1, raft_id: 1
i1 | 2022-10-27 13:48:10.610 [4129] main/125/main V> Sending from 1 to 2, msg: msg_type: MsgAppend to: 2 log_term: 2 index: 10 entries {entry_type: EntryConfChangeV2 term: 2 index: 11 data: "\022\004\010\002\020\001\022\002\020\002"} commit: 11, to: 2, from: 1, raft_id: 1
i1 | 2022-10-27 13:48:10.611 [4129] main/125/main V> Sending from 1 to 2, msg: msg_type: MsgAppend to: 2 log_term: 2 index: 11 entries {entry_type: EntryConfChangeV2 term: 2 index: 12} commit: 11, to: 2, from: 1, raft_id: 1
i1 | 2022-10-27 13:48:10.611 [4129] main/125/main V> Sending from 1 to 2, msg: msg_type: MsgAppend to: 2 log_term: 2 index: 12 entries {term: 2 index: 13 context: "\202\242lc\203\242id\001\243gen\001\245count\007\242op\202\244kind\254persist_peer\244peer\213\253instance_id\242i3\255instance_uuid\331$5d7a7353-3e82-30fd-af0d-261436544389\247raft_id\003\254peer_address\256127.0.0.1:3303\255replicaset_id\242r3\257replicaset_uuid\331$1e94f382-b6a4-3ab8-ac07-35dba02e5f0a\251is_master\302\254commit_index\r\255current_grade\247Offline\254target_grade\247Offline\256failure_domain\200"} commit: 11, to: 2, from: 1, raft_id: 1
i1 | 2022-10-27 13:48:10.611 [4129] main/125/main V> Sending from 1 to 2, msg: msg_type: MsgAppend to: 2 log_term: 2 index: 13 entries {term: 2 index: 14 context: "\202\242lc\203\242id\001\243gen\001\245count\010\242op\202\244kind\254persist_peer\244peer\213\253instance_id\242i2\255instance_uuid\331$24c4ac5f-4981-3441-879c-aee1edb608a6\247raft_id\002\254peer_address\256127.0.0.1:3302\255replicaset_id\242r2\257replicaset_uuid\331$eff4449e-feb2-3d73-87bc-75807cb23191\251is_master\302\254commit_index\016\255current_grade\247Offline\254target_grade\246Online\256failure_domain\200"} commit: 11, to: 2, from: 1, raft_id: 1
i2 | 2022-10-27 13:48:10.612 [4130] main/117/lua V> received response, peer: 1
i2 | 2022-10-27 13:48:10.612 [4130] main/117/lua V> received response, peer: 1
i2 | 2022-10-27 13:48:10.613 [4130] main/121/main V> Sending from 2 to 1, msg: msg_type: MsgAppendResponse to: 1 index: 2 commit: 2, to: 1, from: 2, raft_id: 2
i2 | 2022-10-27 13:48:10.613 [4130] main/112/main V> Sending from 2 to 1, msg: msg_type: MsgAppendResponse to: 1 index: 3 commit: 3, to: 1, from: 2, raft_id: 2
i2 | 2022-10-27 13:48:10.613 [4130] main/120/main V> Sending from 2 to 1, msg: msg_type: MsgAppendResponse to: 1 index: 4 commit: 4, to: 1, from: 2, raft_id: 2
i2 | 2022-10-27 13:48:10.613 [4130] main/124/main V> Sending from 2 to 1, msg: msg_type: MsgAppendResponse to: 1 index: 5 commit: 5, to: 1, from: 2, raft_id: 2
i2 | 2022-10-27 13:48:10.614 [4130] main/125/main V> Sending from 2 to 1, msg: msg_type: MsgAppendResponse to: 1 index: 6 commit: 6, to: 1, from: 2, raft_id: 2
i2 | 2022-10-27 13:48:10.614 [4130] main/126/main V> Sending from 2 to 1, msg: msg_type: MsgAppendResponse to: 1 index: 7 commit: 7, to: 1, from: 2, raft_id: 2
i2 | 2022-10-27 13:48:10.614 [4130] main/127/main V> Sending from 2 to 1, msg: msg_type: MsgAppendResponse to: 1 index: 8 commit: 8, to: 1, from: 2, raft_id: 2
i2 | 2022-10-27 13:48:10.614 [4130] main/128/main V> Sending from 2 to 1, msg: msg_type: MsgAppendResponse to: 1 index: 9 commit: 9, to: 1, from: 2, raft_id: 2
i2 | 2022-10-27 13:48:10.615 [4130] main/129/main V> Sending from 2 to 1, msg: msg_type: MsgAppendResponse to: 1 index: 10 commit: 10, to: 1, from: 2, raft_id: 2
i2 | 2022-10-27 13:48:10.615 [4130] main/130/main V> Sending from 2 to 1, msg: msg_type: MsgAppendResponse to: 1 index: 11 commit: 11, to: 1, from: 2, raft_id: 2
i2 | 2022-10-27 13:48:10.615 [4130] main/131/main V> Sending from 2 to 1, msg: msg_type: MsgAppendResponse to: 1 index: 12 commit: 11, to: 1, from: 2, raft_id: 2
i2 | 2022-10-27 13:48:10.615 [4130] main/132/main V> Sending from 2 to 1, msg: msg_type: MsgAppendResponse to: 1 index: 13 commit: 11, to: 1, from: 2, raft_id: 2
i2 | 2022-10-27 13:48:10.616 [4130] main/133/main V> Sending from 2 to 1, msg: msg_type: MsgAppendResponse to: 1 index: 14 commit: 11, to: 1, from: 2, raft_id: 2
i2 | 2022-10-27 13:48:10.617 [4130] main/115/raft_main_loop V> persisted index 14, raft_id: 2
i2 | 2022-10-27 13:48:10.619 [4130] main/115/raft_main_loop I> switched to configuration, config: Configuration { voters: Configuration { incoming: Configuration { voters: {1} }, outgoing: Configuration { voters: {} } }, learners: {}, learners_next: {}, auto_leave: false }, raft_id: 2
i2 | 2022-10-27 13:48:10.619 [4130] main/115/raft_main_loop I> switched to configuration, config: Configuration { voters: Configuration { incoming: Configuration { voters: {2} }, outgoing: Configuration { voters: {1} } }, learners: {}, learners_next: {1}, auto_leave: true }, raft_id: 2
i2 | 2022-10-27 13:48:10.619 [4130] main/115/raft_main_loop V> broadcast, event: raft.entry-applied
i2 | 2022-10-27 13:48:10.620 [4130] main/115/raft_main_loop V> broadcast, event: raft.topology-changed
i1 | 2022-10-27 13:48:10.620 [4129] main/122/lua V> received response, peer: 2
i1 | 2022-10-27 13:48:10.620 [4129] main/122/lua V> received response, peer: 2
i1 | 2022-10-27 13:48:10.621 [4129] main/122/lua V> received response, peer: 2
i1 | 2022-10-27 13:48:10.621 [4129] main/122/lua V> received response, peer: 2
i1 | 2022-10-27 13:48:10.621 [4129] main/122/lua V> received response, peer: 2
i1 | 2022-10-27 13:48:10.621 [4129] main/122/lua V> received response, peer: 2
i1 | 2022-10-27 13:48:10.621 [4129] main/122/lua V> received response, peer: 2
i1 | 2022-10-27 13:48:10.621 [4129] main/122/lua V> received response, peer: 2
i1 | 2022-10-27 13:48:10.621 [4129] main/122/lua V> received response, peer: 2
i1 | 2022-10-27 13:48:10.621 [4129] main/122/lua V> received response, peer: 2
i1 | 2022-10-27 13:48:10.621 [4129] main/122/lua V> received response, peer: 2
i1 | 2022-10-27 13:48:10.621 [4129] main/122/lua V> received response, peer: 2
i1 | 2022-10-27 13:48:10.622 [4129] main/122/lua V> received response, peer: 2
i1 | 2022-10-27 13:48:10.622 [4129] main/135/main V> committing index 12, index: 12, raft_id: 1
i1 | 2022-10-27 13:48:10.623 [4129] main/135/main V> Sending from 1 to 2, msg: msg_type: MsgAppend to: 2 log_term: 2 index: 14 commit: 12, to: 2, from: 1, raft_id: 1
i1 | 2022-10-27 13:48:10.623 [4129] main/136/main V> committing index 13, index: 13, raft_id: 1
i1 | 2022-10-27 13:48:10.623 [4129] main/136/main V> Sending from 1 to 2, msg: msg_type: MsgAppend to: 2 log_term: 2 index: 14 commit: 13, to: 2, from: 1, raft_id: 1
i1 | 2022-10-27 13:48:10.623 [4129] main/137/main V> committing index 14, index: 14, raft_id: 1
i1 | 2022-10-27 13:48:10.624 [4129] main/137/main V> Sending from 1 to 2, msg: msg_type: MsgAppend to: 2 log_term: 2 index: 14 commit: 14, to: 2, from: 1, raft_id: 1
i1 | 2022-10-27 13:48:10.624 [4129] main/112/raft_main_loop V> broadcast, event: raft.joint-state-leave
i1 | 2022-10-27 13:48:10.624 [4129] main/112/raft_main_loop V> broadcast, event: raft.demoted
i1 | 2022-10-27 13:48:10.624 [4129] main/112/raft_main_loop I> switched to configuration, config: Configuration { voters: Configuration { incoming: Configuration { voters: {2} }, outgoing: Configuration { voters: {} } }, learners: {1}, learners_next: {}, auto_leave: false }, raft_id: 1
i1 | 2022-10-27 13:48:10.625 [4129] main/112/raft_main_loop V> broadcast, event: raft.entry-applied
i2 | 2022-10-27 13:48:10.625 [4130] main/117/lua V> received response, peer: 1
i2 | 2022-10-27 13:48:10.625 [4130] main/117/lua V> received response, peer: 1
i2 | 2022-10-27 13:48:10.625 [4130] main/117/lua V> received response, peer: 1
i2 | 2022-10-27 13:48:10.626 [4130] main/117/lua V> received response, peer: 1
i2 | 2022-10-27 13:48:10.626 [4130] main/117/lua V> received response, peer: 1
i2 | 2022-10-27 13:48:10.626 [4130] main/117/lua V> received response, peer: 1
i2 | 2022-10-27 13:48:10.626 [4130] main/117/lua V> received response, peer: 1
i2 | 2022-10-27 13:48:10.626 [4130] main/117/lua V> received response, peer: 1
i2 | 2022-10-27 13:48:10.626 [4130] main/117/lua V> received response, peer: 1
i2 | 2022-10-27 13:48:10.626 [4130] main/117/lua V> received response, peer: 1
i2 | 2022-10-27 13:48:10.627 [4130] main/117/lua V> received response, peer: 1
i2 | 2022-10-27 13:48:10.627 [4130] main/117/lua V> received response, peer: 1
i2 | 2022-10-27 13:48:10.627 [4130] main/117/lua V> received response, peer: 1
i1 | 2022-10-27 13:48:10.627 [4129] main/113/raft_conf_change_loop I> conf_change processed
i1 | 2022-10-27 13:48:10.627 [4129] main/113/raft_conf_change_loop V> mutex was locked at src/traft/node.rs:877:44
i3 | 2022-10-27 13:48:10.630 [4135] main/103/interactive I> Tarantool 2.10.0-29-g1ec2a9d
i3 | 2022-10-27 13:48:10.630 [4135] main/103/interactive I> log level 6
i3 | 2022-10-27 13:48:10.630 [4135] main/103/interactive I> wal/engine cleanup is paused
i3 | 2022-10-27 13:48:10.630 [4135] main/103/interactive I> mapping 33554432 bytes for memtx tuple arena...
i3 | 2022-10-27 13:48:10.630 [4135] main/103/interactive I> Actual slab_alloc_factor calculated on the basis of desired slab_alloc_factor = 1.044274
i3 | 2022-10-27 13:48:10.630 [4135] main/103/interactive I> mapping 134217728 bytes for vinyl tuple arena...
i2 | 2022-10-27 13:48:10.631 [4130] main I> entering the event loop
i2 | 2022-10-27 13:48:10.632 [4130] main/133/main V> Sending from 2 to 1, msg: msg_type: MsgAppendResponse to: 1 index: 14 commit: 12, to: 1, from: 2, raft_id: 2
i2 | 2022-10-27 13:48:10.632 [4130] main/132/main V> Sending from 2 to 1, msg: msg_type: MsgAppendResponse to: 1 index: 14 commit: 13, to: 1, from: 2, raft_id: 2
i2 | 2022-10-27 13:48:10.632 [4130] main/131/main V> Sending from 2 to 1, msg: msg_type: MsgAppendResponse to: 1 index: 14 commit: 14, to: 1, from: 2, raft_id: 2
i2 | 2022-10-27 13:48:10.633 [4130] main/115/raft_main_loop I> switched to configuration, config: Configuration { voters: Configuration { incoming: Configuration { voters: {2} }, outgoing: Configuration { voters: {} } }, learners: {1}, learners_next: {}, auto_leave: false }, raft_id: 2
i2 | 2022-10-27 13:48:10.633 [4130] main/115/raft_main_loop V> broadcast, event: raft.entry-applied
i2 | 2022-10-27 13:48:10.633 [4130] main/115/raft_main_loop V> broadcast, event: raft.topology-changed
i1 | 2022-10-27 13:48:10.634 [4129] main/122/lua V> received response, peer: 2
i1 | 2022-10-27 13:48:10.634 [4129] main/122/lua V> received response, peer: 2
i1 | 2022-10-27 13:48:10.634 [4129] main/122/lua V> received response, peer: 2
i1 | 2022-10-27 13:48:10.634 [4129] main/121/main V> mutex was locked at src/traft/node.rs:877:44
i1 | 2022-10-27 13:48:10.634 [4129] main/110/main V> mutex was locked at src/traft/node.rs:877:44
i1 | 2022-10-27 13:48:10.634 [4129] main/137/main V> mutex was locked at src/traft/node.rs:877:44
i1 | 2022-10-27 13:48:10.634 [4129] main/112/raft_main_loop V> broadcast, event: raft.topology-changed
i1 | 2022-10-27 13:48:10.635 [4129] main/113/raft_conf_change_loop V> Sending from 1 to 2, msg: msg_type: MsgAppend to: 2 log_term: 2 index: 14 entries {entry_type: EntryConfChangeV2 term: 2 index: 15 data: "\022\004\010\002\020\002\022\002\020\003"} commit: 14, to: 2, from: 1, raft_id: 1
i1 | 2022-10-27 13:48:10.635 [4129] main/113/raft_conf_change_loop V> broadcast, event: raft.joint-state-enter
i1 | 2022-10-27 13:48:10.635 [4129] main/112/raft_main_loop V> mutex was locked at unknown location
i2 | 2022-10-27 13:48:10.635 [4130] main/117/lua V> received response, peer: 1
i2 | 2022-10-27 13:48:10.636 [4130] main/117/lua V> received response, peer: 1
i2 | 2022-10-27 13:48:10.636 [4130] main/117/lua V> received response, peer: 1
i2 | 2022-10-27 13:48:10.636 [4130] main/131/main V> Sending from 2 to 1, msg: msg_type: MsgAppendResponse to: 1 index: 15 commit: 14, to: 1, from: 2, raft_id: 2
i2 | 2022-10-27 13:48:10.637 [4130] main/115/raft_main_loop V> persisted index 15, raft_id: 2
i1 | 2022-10-27 13:48:10.637 [4129] main/122/lua V> received response, peer: 2
i1 | 2022-10-27 13:48:10.637 [4129] main/137/main V> mutex was locked at src/traft/node.rs:877:44
i3 | 2022-10-27 13:48:10.638 [4135] main/103/interactive I> update replication_synchro_quorum = 1
i3 | 2022-10-27 13:48:10.638 [4135] main/103/interactive I> instance uuid 5d7a7353-3e82-30fd-af0d-261436544389
i1 | 2022-10-27 13:48:10.638 [4129] main/112/raft_main_loop V> persisted index 15, raft_id: 1
i1 | 2022-10-27 13:48:10.638 [4129] main/137/main V> committing index 15, index: 15, raft_id: 1
i1 | 2022-10-27 13:48:10.639 [4129] main/137/main V> Sending from 1 to 2, msg: msg_type: MsgAppend to: 2 log_term: 2 index: 15 commit: 15, to: 2, from: 1, raft_id: 1
i1 | 2022-10-27 13:48:10.639 [4129] main/112/raft_main_loop I> switched to configuration, config: Configuration { voters: Configuration { incoming: Configuration { voters: {3} }, outgoing: Configuration { voters: {2} } }, learners: {1}, learners_next: {2}, auto_leave: true }, raft_id: 1
i1 | 2022-10-27 13:48:10.639 [4129] main/112/raft_main_loop V> broadcast, event: raft.entry-applied
i2 | 2022-10-27 13:48:10.639 [4130] main/117/lua V> received response, peer: 1
i2 | 2022-10-27 13:48:10.640 [4130] main/131/main V> Sending from 2 to 1, msg: msg_type: MsgAppendResponse to: 1 index: 15 commit: 15, to: 1, from: 2, raft_id: 2
i2 | 2022-10-27 13:48:10.640 [4130] main/115/raft_main_loop I> switched to configuration, config: Configuration { voters: Configuration { incoming: Configuration { voters: {3} }, outgoing: Configuration { voters: {2} } }, learners: {1}, learners_next: {2}, auto_leave: true }, raft_id: 2
i2 | 2022-10-27 13:48:10.640 [4130] main/115/raft_main_loop V> broadcast, event: raft.entry-applied
i1 | 2022-10-27 13:48:10.641 [4129] main/122/lua V> received response, peer: 2
i1 | 2022-10-27 13:48:10.641 [4129] main/137/main V> mutex was locked at src/traft/node.rs:877:44
i3 | 2022-10-27 13:48:10.641 [4135] main/103/interactive I> tx_binary: bound to 127.0.0.1:3303
i3 | 2022-10-27 13:48:10.641 [4135] main/103/interactive I> connecting to 1 replicas
i1 | 2022-10-27 13:48:10.642 [4129] main/112/raft_main_loop I> initiating automatic transition out of joint configuration, config: Configuration { voters: Configuration { incoming: Configuration { voters: {3} }, outgoing: Configuration { voters: {2} } }, learners: {1}, learners_next: {2}, auto_leave: true }, raft_id: 1
i2 | 2022-10-27 13:48:10.642 [4130] main/117/lua V> received response, peer: 1
i3 | 2022-10-27 13:48:10.642 [4135] main/113/applier/127.0.0.1:3303 I> remote master 5d7a7353-3e82-30fd-af0d-261436544389 at 127.0.0.1:3303 running Tarantool 2.10.0
i3 | 2022-10-27 13:48:10.642 [4135] main/103/interactive I> connected to 1 replicas
i3 | 2022-10-27 13:48:10.642 [4135] main/103/interactive I> initializing an empty data directory
i3 | 2022-10-27 13:48:10.649 [4135] main/103/interactive V> RAFT: recover {term: 1}
i3 | 2022-10-27 13:48:10.649 [4135] main/103/interactive I> assigned id 1 to replica 5d7a7353-3e82-30fd-af0d-261436544389
i3 | 2022-10-27 13:48:10.649 [4135] main/103/interactive I> update replication_synchro_quorum = 1
i3 | 2022-10-27 13:48:10.650 [4135] main/103/interactive I> cluster uuid 1e94f382-b6a4-3ab8-ac07-35dba02e5f0a
i1 | 2022-10-27 13:48:10.650 [4129] main/112/raft_main_loop V> persisted index 16, raft_id: 1
i3 | 2022-10-27 13:48:10.650 [4135] snapshot/101/main I> saving snapshot `/tmp/pytest-of-root/pytest-0/popen-gw0/test_expel_leader0/i3/00000000000000000000.snap.inprogress'
i3 | 2022-10-27 13:48:10.661 [4135] snapshot/101/main I> done
i3 | 2022-10-27 13:48:10.665 [4135] main/103/interactive I> RAFT: fencing enabled
i3 | 2022-10-27 13:48:10.665 [4135] main/103/interactive I> RAFT: start state machine
i3 | 2022-10-27 13:48:10.665 [4135] main/103/interactive I> ready to accept requests
i3 | 2022-10-27 13:48:10.665 [4135] main/103/interactive I> RAFT: bump term to 2, follow
i3 | 2022-10-27 13:48:10.665 [4135] main/107/gc I> wal/engine cleanup is resumed
i3 | 2022-10-27 13:48:10.666 [4135] main/113/applier/127.0.0.1:3303 I> leaving orphan mode
i3 | 2022-10-27 13:48:10.666 [4135] main/114/raft_worker I> RAFT: persisted state {term: 2}
i3 | 2022-10-27 13:48:10.666 [4135] main/114/raft_worker I> RAFT: vote for 1, follow
i3 | 2022-10-27 13:48:10.666 [4135] main/114/raft_worker I> RAFT: persisted state {term: 2, vote: 1}
i3 | 2022-10-27 13:48:10.666 [4135] main/114/raft_worker I> RAFT: enter leader state with quorum 1
i3 | 2022-10-27 13:48:10.666 [4135] main/103/interactive V> feedback_daemon stopped
i3 | 2022-10-27 13:48:10.666 [4135] main/103/interactive V> feedback_daemon stopped
i3 | 2022-10-27 13:48:10.666 [4135] main/103/interactive V> feedback_daemon started
i3 | 2022-10-27 13:48:10.666 [4135] main/103/interactive I> set 'log_level' configuration option to 6
i3 | 2022-10-27 13:48:10.666 [4135] main/103/interactive V> feedback_daemon stopped
i3 | 2022-10-27 13:48:10.666 [4135] main/103/interactive V> feedback_daemon stopped
i3 | 2022-10-27 13:48:10.666 [4135] main/103/interactive V> feedback_daemon started
i3 | 2022-10-27 13:48:10.666 [4135] main/103/interactive I> set 'election_mode' configuration option to "manual"
i3 | 2022-10-27 13:48:10.666 [4135] main/103/interactive V> feedback_daemon stopped
i3 | 2022-10-27 13:48:10.666 [4135] main/103/interactive V> feedback_daemon stopped
i3 | 2022-10-27 13:48:10.666 [4135] main/103/interactive V> feedback_daemon started
i3 | 2022-10-27 13:48:10.666 [4135] main/103/interactive I> set 'feedback_enabled' configuration option to false
i3 | 2022-10-27 13:48:10.666 [4135] main/103/interactive I> set 'log_format' configuration option to "plain"
i3 | 2022-10-27 13:48:10.666 [4135] main/103/interactive I> set 'memtx_memory' configuration option to 33554432
i3 | 2022-10-27 13:48:10.666 [4135] main/103/interactive I> set 'instance_uuid' configuration option to "5d7a7353-3e82-30fd-af0d-261436544389"
i3 | 2022-10-27 13:48:10.666 [4135] main/103/interactive I> set 'listen' configuration option to "127.0.0.1:3303"
i3 | 2022-10-27 13:48:10.666 [4135] main/103/interactive V> feedback_daemon stopped
i3 | 2022-10-27 13:48:10.666 [4135] main/103/interactive V> feedback_daemon stopped
i3 | 2022-10-27 13:48:10.667 [4135] main/103/interactive V> feedback_daemon started
i3 | 2022-10-27 13:48:10.667 [4135] main/103/interactive I> set 'replication_connect_quorum' configuration option to 32
i3 | 2022-10-27 13:48:10.667 [4135] main/103/interactive I> set 'replication' configuration option to ["127.0.0.1:3303"]
i3 | 2022-10-27 13:48:10.667 [4135] main/108/checkpoint_daemon I> scheduled next checkpoint for Thu Oct 27 15:05:01 2022
i3 | 2022-10-27 13:48:10.667 [4135] main/103/interactive I> set 'replicaset_uuid' configuration option to "1e94f382-b6a4-3ab8-ac07-35dba02e5f0a"
i3 | 2022-10-27 13:48:10.678 [4135] main/103/interactive I> >>>>> postjoin()
i3 | 2022-10-27 13:48:10.679 [4135] main/103/interactive I> leaving orphan mode
i3 | 2022-10-27 13:48:10.679 [4135] main/103/interactive I> set 'replication_connect_quorum' configuration option to 0
i3 | 2022-10-27 13:48:10.679 [4135] main/103/interactive I> switched to configuration, config: Configuration { voters: Configuration { incoming: Configuration { voters: {} }, outgoing: Configuration { voters: {} } }, learners: {}, learners_next: {}, auto_leave: false }, raft_id: 3
i3 | 2022-10-27 13:48:10.679 [4135] main/103/interactive V> reset election timeout 0 -> 22 at 0, election_elapsed: 0, timeout: 22, prev_timeout: 0, raft_id: 3
i3 | 2022-10-27 13:48:10.680 [4135] main/103/interactive I> became follower at term 0, term: 0, raft_id: 3
i3 | 2022-10-27 13:48:10.680 [4135] main/103/interactive I> newRaft, peers: Configuration { incoming: Configuration { voters: {} }, outgoing: Configuration { voters: {} } }, last term: 0, last index: 0, applied: 0, commit: 0, term: 0, raft_id: 3
i3 | 2022-10-27 13:48:10.680 [4135] main/103/interactive I> RawNode created with id 3., id: 3, raft_id: 3
i3 | 2022-10-27 13:48:10.680 [4135] main/103/interactive V> Getting a read barrier...
i1 | 2022-10-27 13:48:10.851 [4129] main/112/raft_main_loop V> Sending from 1 to 2, msg: msg_type: MsgHeartbeat to: 2 commit: 15, to: 2, from: 1, raft_id: 1
i1 | 2022-10-27 13:48:10.851 [4129] main/112/raft_main_loop V> Sending from 1 to 3, msg: msg_type: MsgHeartbeat to: 3, to: 3, from: 1, raft_id: 1
i1 | 2022-10-27 13:48:10.851 [4129] main/138/lua V> established connection to peer, raft_id: 3, peer: 127.0.0.1:3303
i2 | 2022-10-27 13:48:10.852 [4130] main/131/main V> Sending from 2 to 1, msg: msg_type: MsgHeartbeatResponse to: 1 commit: 15, to: 1, from: 2, raft_id: 2
i1 | 2022-10-27 13:48:10.852 [4129] main/137/main V> Sending from 1 to 2, msg: msg_type: MsgAppend to: 2 log_term: 2 index: 15 entries {entry_type: EntryConfChangeV2 term: 2 index: 16} commit: 15, to: 2, from: 1, raft_id: 1
i1 | 2022-10-27 13:48:10.853 [4129] main/122/lua V> received response, peer: 2
i2 | 2022-10-27 13:48:10.853 [4130] main/117/lua V> received response, peer: 1
i2 | 2022-10-27 13:48:10.853 [4130] main/131/main V> Sending from 2 to 1, msg: msg_type: MsgAppendResponse to: 1 index: 16 commit: 15, to: 1, from: 2, raft_id: 2
i2 | 2022-10-27 13:48:10.853 [4130] main/115/raft_main_loop V> persisted index 16, raft_id: 2
i1 | 2022-10-27 13:48:10.854 [4129] main/122/lua V> received response, peer: 2
i2 | 2022-10-27 13:48:10.854 [4130] main/117/lua V> received response, peer: 1
i3 | 2022-10-27 13:48:10.855 [4135] main/112/main I> received a message with higher term from 1, msg type: MsgHeartbeat, message_term: 2, term: 0, from: 1, raft_id: 3
i3 | 2022-10-27 13:48:10.855 [4135] main/112/main V> reset election timeout 22 -> 30 at 1, election_elapsed: 1, timeout: 30, prev_timeout: 22, raft_id: 3
i3 | 2022-10-27 13:48:10.855 [4135] main/112/main I> became follower at term 2, term: 2, raft_id: 3
i3 | 2022-10-27 13:48:10.857 [4135] main/112/main V> Sending from 3 to 1, msg: msg_type: MsgHeartbeatResponse to: 1, to: 1, from: 3, raft_id: 3
i3 | 2022-10-27 13:48:10.857 [4135] main/115/raft_main_loop V> broadcast, event: raft.status-changed
i1 | 2022-10-27 13:48:10.858 [4129] main/138/lua V> received response, peer: 3
i3 | 2022-10-27 13:48:10.858 [4135] main/103/interactive V> mutex was locked at src/traft/node.rs:877:44
i3 | 2022-10-27 13:48:10.858 [4135] main/115/raft_main_loop node.rs:707 E> peer with id 1 not found
i3 | 2022-10-27 13:48:10.858 [4135] main/103/interactive V> Sending from 3 to 1, msg: msg_type: MsgReadIndex to: 1 entries {data: "\202\242lc\203\242id\003\243gen\001\245count\001\242op\201\244kind\243nop"}, to: 1, from: 3, raft_id: 3
i3 | 2022-10-27 13:48:10.858 [4135] main/115/raft_main_loop node.rs:707 E> peer with id 1 not found
i1 | 2022-10-27 13:48:11.054 [4129] main/112/raft_main_loop V> Sending from 1 to 2, msg: msg_type: MsgHeartbeat to: 2 commit: 15, to: 2, from: 1, raft_id: 1
i1 | 2022-10-27 13:48:11.054 [4129] main/112/raft_main_loop V> Sending from 1 to 3, msg: msg_type: MsgHeartbeat to: 3, to: 3, from: 1, raft_id: 1
i3 | 2022-10-27 13:48:11.055 [4135] main/112/main V> Sending from 3 to 1, msg: msg_type: MsgHeartbeatResponse to: 1, to: 1, from: 3, raft_id: 3
i3 | 2022-10-27 13:48:11.055 [4135] main/115/raft_main_loop node.rs:707 E> peer with id 1 not found
i2 | 2022-10-27 13:48:11.055 [4130] main/131/main V> Sending from 2 to 1, msg: msg_type: MsgHeartbeatResponse to: 1 commit: 15, to: 1, from: 2, raft_id: 2
i1 | 2022-10-27 13:48:11.056 [4129] main/122/lua V> received response, peer: 2
i1 | 2022-10-27 13:48:11.056 [4129] main/138/lua V> received response, peer: 3
i2 | 2022-10-27 13:48:11.056 [4130] main/117/lua V> received response, peer: 1
i1 | 2022-10-27 13:48:11.257 [4129] main/112/raft_main_loop V> Sending from 1 to 2, msg: msg_type: MsgHeartbeat to: 2 commit: 15, to: 2, from: 1, raft_id: 1
i1 | 2022-10-27 13:48:11.257 [4129] main/112/raft_main_loop V> Sending from 1 to 3, msg: msg_type: MsgHeartbeat to: 3, to: 3, from: 1, raft_id: 1
i3 | 2022-10-27 13:48:11.258 [4135] main/112/main V> Sending from 3 to 1, msg: msg_type: MsgHeartbeatResponse to: 1, to: 1, from: 3, raft_id: 3
i3 | 2022-10-27 13:48:11.258 [4135] main/115/raft_main_loop node.rs:707 E> peer with id 1 not found
i2 | 2022-10-27 13:48:11.258 [4130] main/131/main V> Sending from 2 to 1, msg: msg_type: MsgHeartbeatResponse to: 1 commit: 15, to: 1, from: 2, raft_id: 2
i1 | 2022-10-27 13:48:11.259 [4129] main/122/lua V> received response, peer: 2
i1 | 2022-10-27 13:48:11.259 [4129] main/138/lua V> received response, peer: 3
i2 | 2022-10-27 13:48:11.259 [4130] main/117/lua V> received response, peer: 1
i1 | 2022-10-27 13:48:11.459 [4129] main/112/raft_main_loop V> Sending from 1 to 2, msg: msg_type: MsgHeartbeat to: 2 commit: 15, to: 2, from: 1, raft_id: 1
i1 | 2022-10-27 13:48:11.459 [4129] main/112/raft_main_loop V> Sending from 1 to 3, msg: msg_type: MsgHeartbeat to: 3, to: 3, from: 1, raft_id: 1
i3 | 2022-10-27 13:48:11.460 [4135] main/112/main V> Sending from 3 to 1, msg: msg_type: MsgHeartbeatResponse to: 1, to: 1, from: 3, raft_id: 3
i3 | 2022-10-27 13:48:11.460 [4135] main/115/raft_main_loop node.rs:707 E> peer with id 1 not found
i2 | 2022-10-27 13:48:11.460 [4130] main/121/main V> Sending from 2 to 1, msg: msg_type: MsgHeartbeatResponse to: 1 commit: 15, to: 1, from: 2, raft_id: 2
i1 | 2022-10-27 13:48:11.461 [4129] main/122/lua V> received response, peer: 2
i1 | 2022-10-27 13:48:11.461 [4129] main/138/lua V> received response, peer: 3
i2 | 2022-10-27 13:48:11.461 [4130] main/117/lua V> received response, peer: 1
i1 | 2022-10-27 13:48:11.662 [4129] main/112/raft_main_loop V> Sending from 1 to 2, msg: msg_type: MsgHeartbeat to: 2 commit: 15, to: 2, from: 1, raft_id: 1
i1 | 2022-10-27 13:48:11.662 [4129] main/112/raft_main_loop V> Sending from 1 to 3, msg: msg_type: MsgHeartbeat to: 3, to: 3, from: 1, raft_id: 1
i2 | 2022-10-27 13:48:11.663 [4130] main/121/main V> Sending from 2 to 1, msg: msg_type: MsgHeartbeatResponse to: 1 commit: 15, to: 1, from: 2, raft_id: 2
i3 | 2022-10-27 13:48:11.663 [4135] main/112/main V> Sending from 3 to 1, msg: msg_type: MsgHeartbeatResponse to: 1, to: 1, from: 3, raft_id: 3
i3 | 2022-10-27 13:48:11.663 [4135] main/115/raft_main_loop node.rs:707 E> peer with id 1 not found
i1 | 2022-10-27 13:48:11.664 [4129] main/138/lua V> received response, peer: 3
i1 | 2022-10-27 13:48:11.664 [4129] main/122/lua V> received response, peer: 2
i2 | 2022-10-27 13:48:11.664 [4130] main/117/lua V> received response, peer: 1
i1 | 2022-10-27 13:48:11.864 [4129] main/112/raft_main_loop V> Sending from 1 to 2, msg: msg_type: MsgHeartbeat to: 2 commit: 15, to: 2, from: 1, raft_id: 1
i1 | 2022-10-27 13:48:11.864 [4129] main/112/raft_main_loop V> Sending from 1 to 3, msg: msg_type: MsgHeartbeat to: 3, to: 3, from: 1, raft_id: 1
i3 | 2022-10-27 13:48:11.865 [4135] main/112/main V> Sending from 3 to 1, msg: msg_type: MsgHeartbeatResponse to: 1, to: 1, from: 3, raft_id: 3
i2 | 2022-10-27 13:48:11.865 [4130] main/121/main V> Sending from 2 to 1, msg: msg_type: MsgHeartbeatResponse to: 1 commit: 15, to: 1, from: 2, raft_id: 2
i3 | 2022-10-27 13:48:11.866 [4135] main/115/raft_main_loop node.rs:707 E> peer with id 1 not found
i1 | 2022-10-27 13:48:11.866 [4129] main/138/lua V> received response, peer: 3
i1 | 2022-10-27 13:48:11.866 [4129] main/122/lua V> received response, peer: 2
i2 | 2022-10-27 13:48:11.867 [4130] main/117/lua V> received response, peer: 1
i1 | 2022-10-27 13:48:12.067 [4129] main/112/raft_main_loop V> Sending from 1 to 2, msg: msg_type: MsgHeartbeat to: 2 commit: 15, to: 2, from: 1, raft_id: 1
i1 | 2022-10-27 13:48:12.067 [4129] main/112/raft_main_loop V> Sending from 1 to 3, msg: msg_type: MsgHeartbeat to: 3, to: 3, from: 1, raft_id: 1
i2 | 2022-10-27 13:48:12.068 [4130] main/121/main V> Sending from 2 to 1, msg: msg_type: MsgHeartbeatResponse to: 1 commit: 15, to: 1, from: 2, raft_id: 2
i3 | 2022-10-27 13:48:12.068 [4135] main/112/main V> Sending from 3 to 1, msg: msg_type: MsgHeartbeatResponse to: 1, to: 1, from: 3, raft_id: 3
i3 | 2022-10-27 13:48:12.068 [4135] main/115/raft_main_loop node.rs:707 E> peer with id 1 not found
i1 | 2022-10-27 13:48:12.069 [4129] main/138/lua V> received response, peer: 3
i2 | 2022-10-27 13:48:12.069 [4130] main/117/lua V> received response, peer: 1
i1 | 2022-10-27 13:48:12.069 [4129] main/122/lua V> received response, peer: 2
i1 | 2022-10-27 13:48:12.269 [4129] main/112/raft_main_loop V> Sending from 1 to 2, msg: msg_type: MsgHeartbeat to: 2 commit: 15, to: 2, from: 1, raft_id: 1
i1 | 2022-10-27 13:48:12.269 [4129] main/112/raft_main_loop V> Sending from 1 to 3, msg: msg_type: MsgHeartbeat to: 3, to: 3, from: 1, raft_id: 1
i3 | 2022-10-27 13:48:12.270 [4135] main/112/main V> Sending from 3 to 1, msg: msg_type: MsgHeartbeatResponse to: 1, to: 1, from: 3, raft_id: 3
i3 | 2022-10-27 13:48:12.270 [4135] main/115/raft_main_loop node.rs:707 E> peer with id 1 not found
i2 | 2022-10-27 13:48:12.270 [4130] main/121/main V> Sending from 2 to 1, msg: msg_type: MsgHeartbeatResponse to: 1 commit: 15, to: 1, from: 2, raft_id: 2
i1 | 2022-10-27 13:48:12.271 [4129] main/122/lua V> received response, peer: 2
i1 | 2022-10-27 13:48:12.271 [4129] main/138/lua V> received response, peer: 3
i2 | 2022-10-27 13:48:12.271 [4130] main/117/lua V> received response, peer: 1
i1 | 2022-10-27 13:48:12.472 [4129] main/112/raft_main_loop V> Sending from 1 to 2, msg: msg_type: MsgHeartbeat to: 2 commit: 15, to: 2, from: 1, raft_id: 1
i1 | 2022-10-27 13:48:12.472 [4129] main/112/raft_main_loop V> Sending from 1 to 3, msg: msg_type: MsgHeartbeat to: 3, to: 3, from: 1, raft_id: 1
i3 | 2022-10-27 13:48:12.472 [4135] main/112/main V> Sending from 3 to 1, msg: msg_type: MsgHeartbeatResponse to: 1, to: 1, from: 3, raft_id: 3
i3 | 2022-10-27 13:48:12.472 [4135] main/115/raft_main_loop node.rs:707 E> peer with id 1 not found
i2 | 2022-10-27 13:48:12.473 [4130] main/121/main V> Sending from 2 to 1, msg: msg_type: MsgHeartbeatResponse to: 1 commit: 15, to: 1, from: 2, raft_id: 2
i1 | 2022-10-27 13:48:12.473 [4129] main/122/lua V> received response, peer: 2
i1 | 2022-10-27 13:48:12.473 [4129] main/138/lua V> received response, peer: 3
i2 | 2022-10-27 13:48:12.473 [4130] main/117/lua V> received response, peer: 1
i2 | 2022-10-27 13:48:12.678 [4130] main/121/main V> Sending from 2 to 1, msg: msg_type: MsgHeartbeatResponse to: 1 commit: 15, to: 1, from: 2, raft_id: 2
i3 | 2022-10-27 13:48:12.679 [4135] main/112/main V> Sending from 3 to 1, msg: msg_type: MsgHeartbeatResponse to: 1, to: 1, from: 3, raft_id: 3
i3 | 2022-10-27 13:48:12.679 [4135] main/115/raft_main_loop node.rs:707 E> peer with id 1 not found
i2 | 2022-10-27 13:48:12.679 [4130] main/117/lua V> received response, peer: 1
i1 | 2022-10-27 13:48:12.677 [4129] main/112/raft_main_loop V> Sending from 1 to 2, msg: msg_type: MsgHeartbeat to: 2 commit: 15, to: 2, from: 1, raft_id: 1
i1 | 2022-10-27 13:48:12.677 [4129] main/112/raft_main_loop V> Sending from 1 to 3, msg: msg_type: MsgHeartbeat to: 3, to: 3, from: 1, raft_id: 1
i1 | 2022-10-27 13:48:12.679 [4129] main/122/lua V> received response, peer: 2
i1 | 2022-10-27 13:48:12.679 [4129] main/138/lua V> received response, peer: 3
i1 | 2022-10-27 13:48:12.880 [4129] main/112/raft_main_loop V> Sending from 1 to 2, msg: msg_type: MsgHeartbeat to: 2 commit: 15, to: 2, from: 1, raft_id: 1
i1 | 2022-10-27 13:48:12.880 [4129] main/112/raft_main_loop V> Sending from 1 to 3, msg: msg_type: MsgHeartbeat to: 3, to: 3, from: 1, raft_id: 1
i2 | 2022-10-27 13:48:12.880 [4130] main/121/main V> Sending from 2 to 1, msg: msg_type: MsgHeartbeatResponse to: 1 commit: 15, to: 1, from: 2, raft_id: 2
i1 | 2022-10-27 13:48:12.881 [4129] main/122/lua V> received response, peer: 2
i3 | 2022-10-27 13:48:12.881 [4135] main/112/main V> Sending from 3 to 1, msg: msg_type: MsgHeartbeatResponse to: 1, to: 1, from: 3, raft_id: 3
i3 | 2022-10-27 13:48:12.881 [4135] main/115/raft_main_loop node.rs:707 E> peer with id 1 not found
i1 | 2022-10-27 13:48:12.881 [4129] main/138/lua V> received response, peer: 3
i2 | 2022-10-27 13:48:12.881 [4130] main/117/lua V> received response, peer: 1
i1 | 2022-10-27 13:48:13.082 [4129] main/112/raft_main_loop V> Sending from 1 to 2, msg: msg_type: MsgHeartbeat to: 2 commit: 15, to: 2, from: 1, raft_id: 1
i1 | 2022-10-27 13:48:13.082 [4129] main/112/raft_main_loop V> Sending from 1 to 3, msg: msg_type: MsgHeartbeat to: 3, to: 3, from: 1, raft_id: 1
i2 | 2022-10-27 13:48:13.083 [4130] main/121/main V> Sending from 2 to 1, msg: msg_type: MsgHeartbeatResponse to: 1 commit: 15, to: 1, from: 2, raft_id: 2
i1 | 2022-10-27 13:48:13.083 [4129] main/122/lua V> received response, peer: 2
i3 | 2022-10-27 13:48:13.083 [4135] main/112/main V> Sending from 3 to 1, msg: msg_type: MsgHeartbeatResponse to: 1, to: 1, from: 3, raft_id: 3
i3 | 2022-10-27 13:48:13.083 [4135] main/115/raft_main_loop node.rs:707 E> peer with id 1 not found
i1 | 2022-10-27 13:48:13.083 [4129] main/138/lua V> received response, peer: 3
i2 | 2022-10-27 13:48:13.083 [4130] main/117/lua V> received response, peer: 1
i1 | 2022-10-27 13:48:13.284 [4129] main/112/raft_main_loop V> Sending from 1 to 2, msg: msg_type: MsgHeartbeat to: 2 commit: 15, to: 2, from: 1, raft_id: 1
i1 | 2022-10-27 13:48:13.284 [4129] main/112/raft_main_loop V> Sending from 1 to 3, msg: msg_type: MsgHeartbeat to: 3, to: 3, from: 1, raft_id: 1
i2 | 2022-10-27 13:48:13.285 [4130] main/121/main V> Sending from 2 to 1, msg: msg_type: MsgHeartbeatResponse to: 1 commit: 15, to: 1, from: 2, raft_id: 2
i1 | 2022-10-27 13:48:13.285 [4129] main/122/lua V> received response, peer: 2
i3 | 2022-10-27 13:48:13.285 [4135] main/112/main V> Sending from 3 to 1, msg: msg_type: MsgHeartbeatResponse to: 1, to: 1, from: 3, raft_id: 3
i3 | 2022-10-27 13:48:13.285 [4135] main/115/raft_main_loop node.rs:707 E> peer with id 1 not found
i1 | 2022-10-27 13:48:13.285 [4129] main/138/lua V> received response, peer: 3
i2 | 2022-10-27 13:48:13.286 [4130] main/117/lua V> received response, peer: 1
i1 | 2022-10-27 13:48:13.486 [4129] main/112/raft_main_loop V> Sending from 1 to 2, msg: msg_type: MsgHeartbeat to: 2 commit: 15, to: 2, from: 1, raft_id: 1
i1 | 2022-10-27 13:48:13.486 [4129] main/112/raft_main_loop V> Sending from 1 to 3, msg: msg_type: MsgHeartbeat to: 3, to: 3, from: 1, raft_id: 1
i2 | 2022-10-27 13:48:13.486 [4130] main/121/main V> Sending from 2 to 1, msg: msg_type: MsgHeartbeatResponse to: 1 commit: 15, to: 1, from: 2, raft_id: 2
i1 | 2022-10-27 13:48:13.487 [4129] main/122/lua V> received response, peer: 2
i3 | 2022-10-27 13:48:13.487 [4135] main/112/main V> Sending from 3 to 1, msg: msg_type: MsgHeartbeatResponse to: 1, to: 1, from: 3, raft_id: 3
i3 | 2022-10-27 13:48:13.487 [4135] main/115/raft_main_loop node.rs:707 E> peer with id 1 not found
i1 | 2022-10-27 13:48:13.487 [4129] main/138/lua V> received response, peer: 3
i2 | 2022-10-27 13:48:13.487 [4130] main/117/lua V> received response, peer: 1
i2 | 2022-10-27 13:48:13.705 [4130] main/121/main V> Sending from 2 to 1, msg: msg_type: MsgHeartbeatResponse to: 1 commit: 15, to: 1, from: 2, raft_id: 2
i1 | 2022-10-27 13:48:13.701 [4129] main/112/raft_main_loop V> Sending from 1 to 2, msg: msg_type: MsgHeartbeat to: 2 commit: 15, to: 2, from: 1, raft_id: 1
i1 | 2022-10-27 13:48:13.701 [4129] main/112/raft_main_loop V> Sending from 1 to 3, msg: msg_type: MsgHeartbeat to: 3, to: 3, from: 1, raft_id: 1
i2 | 2022-10-27 13:48:13.706 [4130] main/117/lua V> received response, peer: 1
i3 | 2022-10-27 13:48:13.705 [4135] main/112/main V> Sending from 3 to 1, msg: msg_type: MsgHeartbeatResponse to: 1, to: 1, from: 3, raft_id: 3
i3 | 2022-10-27 13:48:13.705 [4135] main/115/raft_main_loop node.rs:707 E> peer with id 1 not found
i1 | 2022-10-27 13:48:13.706 [4129] main/122/lua V> received response, peer: 2
i1 | 2022-10-27 13:48:13.707 [4129] main/138/lua V> received response, peer: 3
i1 | 2022-10-27 13:48:13.907 [4129] main/112/raft_main_loop V> Sending from 1 to 2, msg: msg_type: MsgHeartbeat to: 2 commit: 15, to: 2, from: 1, raft_id: 1
i1 | 2022-10-27 13:48:13.907 [4129] main/112/raft_main_loop V> Sending from 1 to 3, msg: msg_type: MsgHeartbeat to: 3, to: 3, from: 1, raft_id: 1
i3 | 2022-10-27 13:48:13.907 [4135] main/112/main V> Sending from 3 to 1, msg: msg_type: MsgHeartbeatResponse to: 1, to: 1, from: 3, raft_id: 3
i3 | 2022-10-27 13:48:13.907 [4135] main/115/raft_main_loop node.rs:707 E> peer with id 1 not found
i2 | 2022-10-27 13:48:13.907 [4130] main/121/main V> Sending from 2 to 1, msg: msg_type: MsgHeartbeatResponse to: 1 commit: 15, to: 1, from: 2, raft_id: 2
i1 | 2022-10-27 13:48:13.908 [4129] main/138/lua V> received response, peer: 3
i1 | 2022-10-27 13:48:13.908 [4129] main/122/lua V> received response, peer: 2
i2 | 2022-10-27 13:48:13.908 [4130] main/117/lua V> received response, peer: 1
i1 | 2022-10-27 13:48:14.115 [4129] main/112/raft_main_loop V> Sending from 1 to 2, msg: msg_type: MsgHeartbeat to: 2 commit: 15, to: 2, from: 1, raft_id: 1
i1 | 2022-10-27 13:48:14.116 [4129] main/112/raft_main_loop V> Sending from 1 to 3, msg: msg_type: MsgHeartbeat to: 3, to: 3, from: 1, raft_id: 1
i2 | 2022-10-27 13:48:14.116 [4130] main/121/main V> Sending from 2 to 1, msg: msg_type: MsgHeartbeatResponse to: 1 commit: 15, to: 1, from: 2, raft_id: 2
i1 | 2022-10-27 13:48:14.116 [4129] main/122/lua V> received response, peer: 2
i3 | 2022-10-27 13:48:14.116 [4135] main/112/main V> Sending from 3 to 1, msg: msg_type: MsgHeartbeatResponse to: 1, to: 1, from: 3, raft_id: 3
i3 | 2022-10-27 13:48:14.117 [4135] main/115/raft_main_loop node.rs:707 E> peer with id 1 not found
i2 | 2022-10-27 13:48:14.117 [4130] main/117/lua V> received response, peer: 1
i1 | 2022-10-27 13:48:14.121 [4129] main/138/lua V> received response, peer: 3
i1 | 2022-10-27 13:48:14.321 [4129] main/112/raft_main_loop V> Sending from 1 to 2, msg: msg_type: MsgHeartbeat to: 2 commit: 15, to: 2, from: 1, raft_id: 1
i1 | 2022-10-27 13:48:14.321 [4129] main/112/raft_main_loop V> Sending from 1 to 3, msg: msg_type: MsgHeartbeat to: 3, to: 3, from: 1, raft_id: 1
i3 | 2022-10-27 13:48:14.322 [4135] main/112/main V> Sending from 3 to 1, msg: msg_type: MsgHeartbeatResponse to: 1, to: 1, from: 3, raft_id: 3
i2 | 2022-10-27 13:48:14.322 [4130] main/121/main V> Sending from 2 to 1, msg: msg_type: MsgHeartbeatResponse to: 1 commit: 15, to: 1, from: 2, raft_id: 2
i3 | 2022-10-27 13:48:14.322 [4135] main/115/raft_main_loop node.rs:707 E> peer with id 1 not found
i1 | 2022-10-27 13:48:14.322 [4129] main/138/lua V> received response, peer: 3
i1 | 2022-10-27 13:48:14.322 [4129] main/122/lua V> received response, peer: 2
i2 | 2022-10-27 13:48:14.323 [4130] main/117/lua V> received response, peer: 1
i1 | 2022-10-27 13:48:14.523 [4129] main/112/raft_main_loop V> Sending from 1 to 2, msg: msg_type: MsgHeartbeat to: 2 commit: 15, to: 2, from: 1, raft_id: 1
i1 | 2022-10-27 13:48:14.523 [4129] main/112/raft_main_loop V> Sending from 1 to 3, msg: msg_type: MsgHeartbeat to: 3, to: 3, from: 1, raft_id: 1
i3 | 2022-10-27 13:48:14.524 [4135] main/112/main V> Sending from 3 to 1, msg: msg_type: MsgHeartbeatResponse to: 1, to: 1, from: 3, raft_id: 3
i3 | 2022-10-27 13:48:14.524 [4135] main/115/raft_main_loop node.rs:707 E> peer with id 1 not found
i2 | 2022-10-27 13:48:14.524 [4130] main/121/main V> Sending from 2 to 1, msg: msg_type: MsgHeartbeatResponse to: 1 commit: 15, to: 1, from: 2, raft_id: 2
i1 | 2022-10-27 13:48:14.524 [4129] main/122/lua V> received response, peer: 2
i1 | 2022-10-27 13:48:14.524 [4129] main/138/lua V> received response, peer: 3
i2 | 2022-10-27 13:48:14.524 [4130] main/117/lua V> received response, peer: 1
i1 | 2022-10-27 13:48:14.725 [4129] main/112/raft_main_loop V> Sending from 1 to 2, msg: msg_type: MsgHeartbeat to: 2 commit: 15, to: 2, from: 1, raft_id: 1
i1 | 2022-10-27 13:48:14.725 [4129] main/112/raft_main_loop V> Sending from 1 to 3, msg: msg_type: MsgHeartbeat to: 3, to: 3, from: 1, raft_id: 1
i3 | 2022-10-27 13:48:14.725 [4135] main/112/main V> Sending from 3 to 1, msg: msg_type: MsgHeartbeatResponse to: 1, to: 1, from: 3, raft_id: 3
i3 | 2022-10-27 13:48:14.725 [4135] main/115/raft_main_loop node.rs:707 E> peer with id 1 not found
i2 | 2022-10-27 13:48:14.725 [4130] main/121/main V> Sending from 2 to 1, msg: msg_type: MsgHeartbeatResponse to: 1 commit: 15, to: 1, from: 2, raft_id: 2
i1 | 2022-10-27 13:48:14.726 [4129] main/138/lua V> received response, peer: 3
i1 | 2022-10-27 13:48:14.726 [4129] main/122/lua V> received response, peer: 2
i2 | 2022-10-27 13:48:14.726 [4130] main/117/lua V> received response, peer: 1
i1 | 2022-10-27 13:48:14.930 [4129] main/112/raft_main_loop V> Sending from 1 to 2, msg: msg_type: MsgHeartbeat to: 2 commit: 15, to: 2, from: 1, raft_id: 1
i1 | 2022-10-27 13:48:14.930 [4129] main/112/raft_main_loop V> Sending from 1 to 3, msg: msg_type: MsgHeartbeat to: 3, to: 3, from: 1, raft_id: 1
i2 | 2022-10-27 13:48:14.930 [4130] main/121/main V> Sending from 2 to 1, msg: msg_type: MsgHeartbeatResponse to: 1 commit: 15, to: 1, from: 2, raft_id: 2
i3 | 2022-10-27 13:48:14.931 [4135] main/112/main V> Sending from 3 to 1, msg: msg_type: MsgHeartbeatResponse to: 1, to: 1, from: 3, raft_id: 3
i3 | 2022-10-27 13:48:14.931 [4135] main/115/raft_main_loop node.rs:707 E> peer with id 1 not found
i2 | 2022-10-27 13:48:14.932 [4130] main/117/lua V> received response, peer: 1
i1 | 2022-10-27 13:48:14.931 [4129] main/122/lua V> received response, peer: 2
i1 | 2022-10-27 13:48:14.931 [4129] main/138/lua V> received response, peer: 3
i1 | 2022-10-27 13:48:15.132 [4129] main/112/raft_main_loop V> Sending from 1 to 2, msg: msg_type: MsgHeartbeat to: 2 commit: 15, to: 2, from: 1, raft_id: 1
i1 | 2022-10-27 13:48:15.132 [4129] main/112/raft_main_loop V> Sending from 1 to 3, msg: msg_type: MsgHeartbeat to: 3, to: 3, from: 1, raft_id: 1
i2 | 2022-10-27 13:48:15.133 [4130] main/121/main V> Sending from 2 to 1, msg: msg_type: MsgHeartbeatResponse to: 1 commit: 15, to: 1, from: 2, raft_id: 2
i3 | 2022-10-27 13:48:15.133 [4135] main/112/main V> Sending from 3 to 1, msg: msg_type: MsgHeartbeatResponse to: 1, to: 1, from: 3, raft_id: 3
i3 | 2022-10-27 13:48:15.133 [4135] main/115/raft_main_loop node.rs:707 E> peer with id 1 not found
i1 | 2022-10-27 13:48:15.133 [4129] main/122/lua V> received response, peer: 2
i1 | 2022-10-27 13:48:15.134 [4129] main/138/lua V> received response, peer: 3
i2 | 2022-10-27 13:48:15.136 [4130] main/117/lua V> received response, peer: 1
i1 | 2022-10-27 13:48:15.335 [4129] main/112/raft_main_loop V> Sending from 1 to 2, msg: msg_type: MsgHeartbeat to: 2 commit: 15, to: 2, from: 1, raft_id: 1
i1 | 2022-10-27 13:48:15.335 [4129] main/112/raft_main_loop V> Sending from 1 to 3, msg: msg_type: MsgHeartbeat to: 3, to: 3, from: 1, raft_id: 1
i2 | 2022-10-27 13:48:15.335 [4130] main/121/main V> Sending from 2 to 1, msg: msg_type: MsgHeartbeatResponse to: 1 commit: 15, to: 1, from: 2, raft_id: 2
i1 | 2022-10-27 13:48:15.336 [4129] main/122/lua V> received response, peer: 2
i3 | 2022-10-27 13:48:15.336 [4135] main/112/main V> Sending from 3 to 1, msg: msg_type: MsgHeartbeatResponse to: 1, to: 1, from: 3, raft_id: 3
i3 | 2022-10-27 13:48:15.336 [4135] main/115/raft_main_loop node.rs:707 E> peer with id 1 not found
i1 | 2022-10-27 13:48:15.336 [4129] main/138/lua V> received response, peer: 3
i2 | 2022-10-27 13:48:15.336 [4130] main/117/lua V> received response, peer: 1
i1 | 2022-10-27 13:48:15.538 [4129] main/112/raft_main_loop V> Sending from 1 to 2, msg: msg_type: MsgHeartbeat to: 2 commit: 15, to: 2, from: 1, raft_id: 1
i1 | 2022-10-27 13:48:15.538 [4129] main/112/raft_main_loop V> Sending from 1 to 3, msg: msg_type: MsgHeartbeat to: 3, to: 3, from: 1, raft_id: 1
i2 | 2022-10-27 13:48:15.539 [4130] main/121/main V> Sending from 2 to 1, msg: msg_type: MsgHeartbeatResponse to: 1 commit: 15, to: 1, from: 2, raft_id: 2
i1 | 2022-10-27 13:48:15.539 [4129] main/122/lua V> received response, peer: 2
i3 | 2022-10-27 13:48:15.541 [4135] main/112/main V> Sending from 3 to 1, msg: msg_type: MsgHeartbeatResponse to: 1, to: 1, from: 3, raft_id: 3
i3 | 2022-10-27 13:48:15.541 [4135] main/115/raft_main_loop node.rs:707 E> peer with id 1 not found
i1 | 2022-10-27 13:48:15.545 [4129] main/138/lua V> received response, peer: 3
i2 | 2022-10-27 13:48:15.553 [4130] main/117/lua V> received response, peer: 1
i1 | 2022-10-27 13:48:15.747 [4129] main/112/raft_main_loop V> Sending from 1 to 2, msg: msg_type: MsgHeartbeat to: 2 commit: 15, to: 2, from: 1, raft_id: 1
i1 | 2022-10-27 13:48:15.747 [4129] main/112/raft_main_loop V> Sending from 1 to 3, msg: msg_type: MsgHeartbeat to: 3, to: 3, from: 1, raft_id: 1
i2 | 2022-10-27 13:48:15.747 [4130] main/121/main V> Sending from 2 to 1, msg: msg_type: MsgHeartbeatResponse to: 1 commit: 15, to: 1, from: 2, raft_id: 2
i2 | 2022-10-27 13:48:15.748 [4130] main/117/lua V> received response, peer: 1
i1 | 2022-10-27 13:48:15.748 [4129] main/122/lua V> received response, peer: 2
i3 | 2022-10-27 13:48:15.749 [4135] main/112/main V> Sending from 3 to 1, msg: msg_type: MsgHeartbeatResponse to: 1, to: 1, from: 3, raft_id: 3
i3 | 2022-10-27 13:48:15.749 [4135] main/115/raft_main_loop node.rs:707 E> peer with id 1 not found
i1 | 2022-10-27 13:48:15.749 [4129] main/138/lua V> received response, peer: 3
i1 | 2022-10-27 13:48:15.953 [4129] main/112/raft_main_loop V> Sending from 1 to 2, msg: msg_type: MsgHeartbeat to: 2 commit: 15, to: 2, from: 1, raft_id: 1
i1 | 2022-10-27 13:48:15.953 [4129] main/112/raft_main_loop V> Sending from 1 to 3, msg: msg_type: MsgHeartbeat to: 3, to: 3, from: 1, raft_id: 1
i3 | 2022-10-27 13:48:15.954 [4135] main/112/main V> Sending from 3 to 1, msg: msg_type: MsgHeartbeatResponse to: 1, to: 1, from: 3, raft_id: 3
i3 | 2022-10-27 13:48:15.955 [4135] main/115/raft_main_loop node.rs:707 E> peer with id 1 not found
i1 | 2022-10-27 13:48:15.958 [4129] main/138/lua V> received response, peer: 3
i2 | 2022-10-27 13:48:15.957 [4130] main/121/main V> Sending from 2 to 1, msg: msg_type: MsgHeartbeatResponse to: 1 commit: 15, to: 1, from: 2, raft_id: 2
i2 | 2022-10-27 13:48:15.958 [4130] main/117/lua V> received response, peer: 1
i1 | 2022-10-27 13:48:15.965 [4129] main/122/lua V> received response, peer: 2
i1 | 2022-10-27 13:48:16.159 [4129] main/112/raft_main_loop V> Sending from 1 to 2, msg: msg_type: MsgHeartbeat to: 2 commit: 15, to: 2, from: 1, raft_id: 1
i1 | 2022-10-27 13:48:16.159 [4129] main/112/raft_main_loop V> Sending from 1 to 3, msg: msg_type: MsgHeartbeat to: 3, to: 3, from: 1, raft_id: 1
i2 | 2022-10-27 13:48:16.159 [4130] main/121/main V> Sending from 2 to 1, msg: msg_type: MsgHeartbeatResponse to: 1 commit: 15, to: 1, from: 2, raft_id: 2
i3 | 2022-10-27 13:48:16.159 [4135] main/112/main V> Sending from 3 to 1, msg: msg_type: MsgHeartbeatResponse to: 1, to: 1, from: 3, raft_id: 3
i3 | 2022-10-27 13:48:16.159 [4135] main/115/raft_main_loop node.rs:707 E> peer with id 1 not found
i1 | 2022-10-27 13:48:16.160 [4129] main/122/lua V> received response, peer: 2
i1 | 2022-10-27 13:48:16.160 [4129] main/138/lua V> received response, peer: 3
i2 | 2022-10-27 13:48:16.160 [4130] main/117/lua V> received response, peer: 1
i1 | 2022-10-27 13:48:16.360 [4129] main/112/raft_main_loop V> Sending from 1 to 2, msg: msg_type: MsgHeartbeat to: 2 commit: 15, to: 2, from: 1, raft_id: 1
i1 | 2022-10-27 13:48:16.361 [4129] main/112/raft_main_loop V> Sending from 1 to 3, msg: msg_type: MsgHeartbeat to: 3, to: 3, from: 1, raft_id: 1
i2 | 2022-10-27 13:48:16.361 [4130] main/121/main V> Sending from 2 to 1, msg: msg_type: MsgHeartbeatResponse to: 1 commit: 15, to: 1, from: 2, raft_id: 2
i3 | 2022-10-27 13:48:16.361 [4135] main/112/main V> Sending from 3 to 1, msg: msg_type: MsgHeartbeatResponse to: 1, to: 1, from: 3, raft_id: 3
i3 | 2022-10-27 13:48:16.361 [4135] main/115/raft_main_loop node.rs:707 E> peer with id 1 not found
i2 | 2022-10-27 13:48:16.362 [4130] main/117/lua V> received response, peer: 1
i1 | 2022-10-27 13:48:16.362 [4129] main/138/lua V> received response, peer: 3
i1 | 2022-10-27 13:48:16.362 [4129] main/122/lua V> received response, peer: 2
i1 | 2022-10-27 13:48:16.563 [4129] main/112/raft_main_loop V> Sending from 1 to 2, msg: msg_type: MsgHeartbeat to: 2 commit: 15, to: 2, from: 1, raft_id: 1
i1 | 2022-10-27 13:48:16.563 [4129] main/112/raft_main_loop V> Sending from 1 to 3, msg: msg_type: MsgHeartbeat to: 3, to: 3, from: 1, raft_id: 1
i2 | 2022-10-27 13:48:16.563 [4130] main/121/main V> Sending from 2 to 1, msg: msg_type: MsgHeartbeatResponse to: 1 commit: 15, to: 1, from: 2, raft_id: 2
i3 | 2022-10-27 13:48:16.563 [4135] main/112/main V> Sending from 3 to 1, msg: msg_type: MsgHeartbeatResponse to: 1, to: 1, from: 3, raft_id: 3
i3 | 2022-10-27 13:48:16.563 [4135] main/115/raft_main_loop node.rs:707 E> peer with id 1 not found
i1 | 2022-10-27 13:48:16.564 [4129] main/138/lua V> received response, peer: 3
i1 | 2022-10-27 13:48:16.564 [4129] main/122/lua V> received response, peer: 2
i2 | 2022-10-27 13:48:16.564 [4130] main/117/lua V> received response, peer: 1
i1 | 2022-10-27 13:48:16.764 [4129] main/112/raft_main_loop V> Sending from 1 to 2, msg: msg_type: MsgHeartbeat to: 2 commit: 15, to: 2, from: 1, raft_id: 1
i1 | 2022-10-27 13:48:16.765 [4129] main/112/raft_main_loop V> Sending from 1 to 3, msg: msg_type: MsgHeartbeat to: 3, to: 3, from: 1, raft_id: 1
i2 | 2022-10-27 13:48:16.765 [4130] main/121/main V> Sending from 2 to 1, msg: msg_type: MsgHeartbeatResponse to: 1 commit: 15, to: 1, from: 2, raft_id: 2
i3 | 2022-10-27 13:48:16.765 [4135] main/112/main V> Sending from 3 to 1, msg: msg_type: MsgHeartbeatResponse to: 1, to: 1, from: 3, raft_id: 3
i3 | 2022-10-27 13:48:16.765 [4135] main/115/raft_main_loop node.rs:707 E> peer with id 1 not found
i1 | 2022-10-27 13:48:16.766 [4129] main/138/lua V> received response, peer: 3
i1 | 2022-10-27 13:48:16.766 [4129] main/122/lua V> received response, peer: 2
i2 | 2022-10-27 13:48:16.766 [4130] main/117/lua V> received response, peer: 1
i1 | 2022-10-27 13:48:16.967 [4129] main/112/raft_main_loop V> Sending from 1 to 2, msg: msg_type: MsgHeartbeat to: 2 commit: 15, to: 2, from: 1, raft_id: 1
i1 | 2022-10-27 13:48:16.967 [4129] main/112/raft_main_loop V> Sending from 1 to 3, msg: msg_type: MsgHeartbeat to: 3, to: 3, from: 1, raft_id: 1
i3 | 2022-10-27 13:48:16.969 [4135] main/112/main V> Sending from 3 to 1, msg: msg_type: MsgHeartbeatResponse to: 1, to: 1, from: 3, raft_id: 3
i3 | 2022-10-27 13:48:16.969 [4135] main/115/raft_main_loop node.rs:707 E> peer with id 1 not found
i1 | 2022-10-27 13:48:16.969 [4129] main/138/lua V> received response, peer: 3
i2 | 2022-10-27 13:48:16.969 [4130] main/121/main V> Sending from 2 to 1, msg: msg_type: MsgHeartbeatResponse to: 1 commit: 15, to: 1, from: 2, raft_id: 2
i1 | 2022-10-27 13:48:16.970 [4129] main/122/lua V> received response, peer: 2
i2 | 2022-10-27 13:48:16.970 [4130] main/117/lua V> received response, peer: 1
i1 | 2022-10-27 13:48:17.170 [4129] main/112/raft_main_loop V> Sending from 1 to 2, msg: msg_type: MsgHeartbeat to: 2 commit: 15, to: 2, from: 1, raft_id: 1
i1 | 2022-10-27 13:48:17.171 [4129] main/112/raft_main_loop V> Sending from 1 to 3, msg: msg_type: MsgHeartbeat to: 3, to: 3, from: 1, raft_id: 1
i2 | 2022-10-27 13:48:17.171 [4130] main/121/main V> Sending from 2 to 1, msg: msg_type: MsgHeartbeatResponse to: 1 commit: 15, to: 1, from: 2, raft_id: 2
i1 | 2022-10-27 13:48:17.172 [4129] main/122/lua V> received response, peer: 2
i3 | 2022-10-27 13:48:17.172 [4135] main/112/main V> Sending from 3 to 1, msg: msg_type: MsgHeartbeatResponse to: 1, to: 1, from: 3, raft_id: 3
i3 | 2022-10-27 13:48:17.172 [4135] main/115/raft_main_loop node.rs:707 E> peer with id 1 not found
i2 | 2022-10-27 13:48:17.172 [4130] main/117/lua V> received response, peer: 1
i1 | 2022-10-27 13:48:17.172 [4129] main/138/lua V> received response, peer: 3
i1 | 2022-10-27 13:48:17.373 [4129] main/112/raft_main_loop V> Sending from 1 to 2, msg: msg_type: MsgHeartbeat to: 2 commit: 15, to: 2, from: 1, raft_id: 1
i1 | 2022-10-27 13:48:17.373 [4129] main/112/raft_main_loop V> Sending from 1 to 3, msg: msg_type: MsgHeartbeat to: 3, to: 3, from: 1, raft_id: 1
i2 | 2022-10-27 13:48:17.373 [4130] main/121/main V> Sending from 2 to 1, msg: msg_type: MsgHeartbeatResponse to: 1 commit: 15, to: 1, from: 2, raft_id: 2
i3 | 2022-10-27 13:48:17.373 [4135] main/112/main V> Sending from 3 to 1, msg: msg_type: MsgHeartbeatResponse to: 1, to: 1, from: 3, raft_id: 3
i3 | 2022-10-27 13:48:17.373 [4135] main/115/raft_main_loop node.rs:707 E> peer with id 1 not found
i1 | 2022-10-27 13:48:17.374 [4129] main/122/lua V> received response, peer: 2
i1 | 2022-10-27 13:48:17.374 [4129] main/138/lua V> received response, peer: 3
i2 | 2022-10-27 13:48:17.374 [4130] main/117/lua V> received response, peer: 1
i1 | 2022-10-27 13:48:17.575 [4129] main/112/raft_main_loop V> Sending from 1 to 2, msg: msg_type: MsgHeartbeat to: 2 commit: 15, to: 2, from: 1, raft_id: 1
i1 | 2022-10-27 13:48:17.575 [4129] main/112/raft_main_loop V> Sending from 1 to 3, msg: msg_type: MsgHeartbeat to: 3, to: 3, from: 1, raft_id: 1
i3 | 2022-10-27 13:48:17.575 [4135] main/112/main V> Sending from 3 to 1, msg: msg_type: MsgHeartbeatResponse to: 1, to: 1, from: 3, raft_id: 3
i2 | 2022-10-27 13:48:17.575 [4130] main/121/main V> Sending from 2 to 1, msg: msg_type: MsgHeartbeatResponse to: 1 commit: 15, to: 1, from: 2, raft_id: 2
i3 | 2022-10-27 13:48:17.575 [4135] main/115/raft_main_loop node.rs:707 E> peer with id 1 not found
i1 | 2022-10-27 13:48:17.576 [4129] main/138/lua V> received response, peer: 3
i1 | 2022-10-27 13:48:17.576 [4129] main/122/lua V> received response, peer: 2
i2 | 2022-10-27 13:48:17.576 [4130] main/117/lua V> received response, peer: 1
i1 | 2022-10-27 13:48:17.776 [4129] main/112/raft_main_loop V> Sending from 1 to 2, msg: msg_type: MsgHeartbeat to: 2 commit: 15, to: 2, from: 1, raft_id: 1
i1 | 2022-10-27 13:48:17.777 [4129] main/112/raft_main_loop V> Sending from 1 to 3, msg: msg_type: MsgHeartbeat to: 3, to: 3, from: 1, raft_id: 1
i3 | 2022-10-27 13:48:17.777 [4135] main/112/main V> Sending from 3 to 1, msg: msg_type: MsgHeartbeatResponse to: 1, to: 1, from: 3, raft_id: 3
i2 | 2022-10-27 13:48:17.777 [4130] main/121/main V> Sending from 2 to 1, msg: msg_type: MsgHeartbeatResponse to: 1 commit: 15, to: 1, from: 2, raft_id: 2
i3 | 2022-10-27 13:48:17.777 [4135] main/115/raft_main_loop node.rs:707 E> peer with id 1 not found
i1 | 2022-10-27 13:48:17.777 [4129] main/122/lua V> received response, peer: 2
i1 | 2022-10-27 13:48:17.777 [4129] main/138/lua V> received response, peer: 3
i2 | 2022-10-27 13:48:17.778 [4130] main/117/lua V> received response, peer: 1
i1 | 2022-10-27 13:48:17.979 [4129] main/112/raft_main_loop V> Sending from 1 to 2, msg: msg_type: MsgHeartbeat to: 2 commit: 15, to: 2, from: 1, raft_id: 1
i1 | 2022-10-27 13:48:17.979 [4129] main/112/raft_main_loop V> Sending from 1 to 3, msg: msg_type: MsgHeartbeat to: 3, to: 3, from: 1, raft_id: 1
i3 | 2022-10-27 13:48:17.980 [4135] main/112/main V> Sending from 3 to 1, msg: msg_type: MsgHeartbeatResponse to: 1, to: 1, from: 3, raft_id: 3
i2 | 2022-10-27 13:48:17.980 [4130] main/121/main V> Sending from 2 to 1, msg: msg_type: MsgHeartbeatResponse to: 1 commit: 15, to: 1, from: 2, raft_id: 2
i3 | 2022-10-27 13:48:17.980 [4135] main/115/raft_main_loop node.rs:707 E> peer with id 1 not found
i1 | 2022-10-27 13:48:17.980 [4129] main/122/lua V> received response, peer: 2
i1 | 2022-10-27 13:48:17.980 [4129] main/138/lua V> received response, peer: 3
i2 | 2022-10-27 13:48:17.980 [4130] main/117/lua V> received response, peer: 1
i1 | 2022-10-27 13:48:18.181 [4129] main/112/raft_main_loop V> Sending from 1 to 2, msg: msg_type: MsgHeartbeat to: 2 commit: 15, to: 2, from: 1, raft_id: 1
i1 | 2022-10-27 13:48:18.181 [4129] main/112/raft_main_loop V> Sending from 1 to 3, msg: msg_type: MsgHeartbeat to: 3, to: 3, from: 1, raft_id: 1
i2 | 2022-10-27 13:48:18.181 [4130] main/121/main V> Sending from 2 to 1, msg: msg_type: MsgHeartbeatResponse to: 1 commit: 15, to: 1, from: 2, raft_id: 2
i3 | 2022-10-27 13:48:18.181 [4135] main/112/main V> Sending from 3 to 1, msg: msg_type: MsgHeartbeatResponse to: 1, to: 1, from: 3, raft_id: 3
i3 | 2022-10-27 13:48:18.181 [4135] main/115/raft_main_loop node.rs:707 E> peer with id 1 not found
i2 | 2022-10-27 13:48:18.182 [4130] main/117/lua V> received response, peer: 1
i1 | 2022-10-27 13:48:18.182 [4129] main/122/lua V> received response, peer: 2
i1 | 2022-10-27 13:48:18.182 [4129] main/138/lua V> received response, peer: 3
i1 | 2022-10-27 13:48:18.382 [4129] main/112/raft_main_loop V> Sending from 1 to 2, msg: msg_type: MsgHeartbeat to: 2 commit: 15, to: 2, from: 1, raft_id: 1
i1 | 2022-10-27 13:48:18.382 [4129] main/112/raft_main_loop V> Sending from 1 to 3, msg: msg_type: MsgHeartbeat to: 3, to: 3, from: 1, raft_id: 1
i2 | 2022-10-27 13:48:18.383 [4130] main/121/main V> Sending from 2 to 1, msg: msg_type: MsgHeartbeatResponse to: 1 commit: 15, to: 1, from: 2, raft_id: 2
i1 | 2022-10-27 13:48:18.384 [4129] main/122/lua V> received response, peer: 2
i2 | 2022-10-27 13:48:18.384 [4130] main/117/lua V> received response, peer: 1
i3 | 2022-10-27 13:48:18.385 [4135] main/112/main V> Sending from 3 to 1, msg: msg_type: MsgHeartbeatResponse to: 1, to: 1, from: 3, raft_id: 3
i3 | 2022-10-27 13:48:18.385 [4135] main/115/raft_main_loop node.rs:707 E> peer with id 1 not found
i1 | 2022-10-27 13:48:18.386 [4129] main/138/lua V> received response, peer: 3
i1 | 2022-10-27 13:48:18.585 [4129] main/112/raft_main_loop V> Sending from 1 to 2, msg: msg_type: MsgHeartbeat to: 2 commit: 15, to: 2, from: 1, raft_id: 1
i1 | 2022-10-27 13:48:18.585 [4129] main/112/raft_main_loop V> Sending from 1 to 3, msg: msg_type: MsgHeartbeat to: 3, to: 3, from: 1, raft_id: 1
i2 | 2022-10-27 13:48:18.586 [4130] main/121/main V> Sending from 2 to 1, msg: msg_type: MsgHeartbeatResponse to: 1 commit: 15, to: 1, from: 2, raft_id: 2
i1 | 2022-10-27 13:48:18.586 [4129] main/122/lua V> received response, peer: 2
i3 | 2022-10-27 13:48:18.587 [4135] main/112/main V> Sending from 3 to 1, msg: msg_type: MsgHeartbeatResponse to: 1, to: 1, from: 3, raft_id: 3
i3 | 2022-10-27 13:48:18.587 [4135] main/115/raft_main_loop node.rs:707 E> peer with id 1 not found
i2 | 2022-10-27 13:48:18.587 [4130] main/117/lua V> received response, peer: 1
i1 | 2022-10-27 13:48:18.588 [4129] main/138/lua V> received response, peer: 3
i1 | 2022-10-27 13:48:18.787 [4129] main/112/raft_main_loop V> Sending from 1 to 2, msg: msg_type: MsgHeartbeat to: 2 commit: 15, to: 2, from: 1, raft_id: 1
i1 | 2022-10-27 13:48:18.787 [4129] main/112/raft_main_loop V> Sending from 1 to 3, msg: msg_type: MsgHeartbeat to: 3, to: 3, from: 1, raft_id: 1
i3 | 2022-10-27 13:48:18.788 [4135] main/112/main V> Sending from 3 to 1, msg: msg_type: MsgHeartbeatResponse to: 1, to: 1, from: 3, raft_id: 3
i3 | 2022-10-27 13:48:18.788 [4135] main/115/raft_main_loop node.rs:707 E> peer with id 1 not found
i2 | 2022-10-27 13:48:18.789 [4130] main/121/main V> Sending from 2 to 1, msg: msg_type: MsgHeartbeatResponse to: 1 commit: 15, to: 1, from: 2, raft_id: 2
i1 | 2022-10-27 13:48:18.789 [4129] main/122/lua V> received response, peer: 2
i1 | 2022-10-27 13:48:18.789 [4129] main/138/lua V> received response, peer: 3
i2 | 2022-10-27 13:48:18.790 [4130] main/117/lua V> received response, peer: 1
i1 | 2022-10-27 13:48:18.990 [4129] main/112/raft_main_loop V> Sending from 1 to 2, msg: msg_type: MsgHeartbeat to: 2 commit: 15, to: 2, from: 1, raft_id: 1
i1 | 2022-10-27 13:48:18.991 [4129] main/112/raft_main_loop V> Sending from 1 to 3, msg: msg_type: MsgHeartbeat to: 3, to: 3, from: 1, raft_id: 1
i3 | 2022-10-27 13:48:18.991 [4135] main/112/main V> Sending from 3 to 1, msg: msg_type: MsgHeartbeatResponse to: 1, to: 1, from: 3, raft_id: 3
i3 | 2022-10-27 13:48:18.991 [4135] main/115/raft_main_loop node.rs:707 E> peer with id 1 not found
i2 | 2022-10-27 13:48:18.991 [4130] main/121/main V> Sending from 2 to 1, msg: msg_type: MsgHeartbeatResponse to: 1 commit: 15, to: 1, from: 2, raft_id: 2
i1 | 2022-10-27 13:48:18.992 [4129] main/138/lua V> received response, peer: 3
i1 | 2022-10-27 13:48:18.992 [4129] main/122/lua V> received response, peer: 2
i2 | 2022-10-27 13:48:18.992 [4130] main/117/lua V> received response, peer: 1
i1 | 2022-10-27 13:48:19.192 [4129] main/112/raft_main_loop V> Sending from 1 to 2, msg: msg_type: MsgHeartbeat to: 2 commit: 15, to: 2, from: 1, raft_id: 1
i1 | 2022-10-27 13:48:19.193 [4129] main/112/raft_main_loop V> Sending from 1 to 3, msg: msg_type: MsgHeartbeat to: 3, to: 3, from: 1, raft_id: 1
i3 | 2022-10-27 13:48:19.193 [4135] main/112/main V> Sending from 3 to 1, msg: msg_type: MsgHeartbeatResponse to: 1, to: 1, from: 3, raft_id: 3
i2 | 2022-10-27 13:48:19.193 [4130] main/121/main V> Sending from 2 to 1, msg: msg_type: MsgHeartbeatResponse to: 1 commit: 15, to: 1, from: 2, raft_id: 2
i3 | 2022-10-27 13:48:19.193 [4135] main/115/raft_main_loop node.rs:707 E> peer with id 1 not found
i1 | 2022-10-27 13:48:19.193 [4129] main/122/lua V> received response, peer: 2
i1 | 2022-10-27 13:48:19.193 [4129] main/138/lua V> received response, peer: 3
i2 | 2022-10-27 13:48:19.194 [4130] main/117/lua V> received response, peer: 1
i1 | 2022-10-27 13:48:19.394 [4129] main/112/raft_main_loop V> Sending from 1 to 2, msg: msg_type: MsgHeartbeat to: 2 commit: 15, to: 2, from: 1, raft_id: 1
i1 | 2022-10-27 13:48:19.394 [4129] main/112/raft_main_loop V> Sending from 1 to 3, msg: msg_type: MsgHeartbeat to: 3, to: 3, from: 1, raft_id: 1
i2 | 2022-10-27 13:48:19.395 [4130] main/121/main V> Sending from 2 to 1, msg: msg_type: MsgHeartbeatResponse to: 1 commit: 15, to: 1, from: 2, raft_id: 2
i3 | 2022-10-27 13:48:19.395 [4135] main/112/main V> Sending from 3 to 1, msg: msg_type: MsgHeartbeatResponse to: 1, to: 1, from: 3, raft_id: 3
i3 | 2022-10-27 13:48:19.395 [4135] main/115/raft_main_loop node.rs:707 E> peer with id 1 not found
i1 | 2022-10-27 13:48:19.395 [4129] main/138/lua V> received response, peer: 3
i1 | 2022-10-27 13:48:19.395 [4129] main/122/lua V> received response, peer: 2
i2 | 2022-10-27 13:48:19.395 [4130] main/117/lua V> received response, peer: 1
i1 | 2022-10-27 13:48:19.597 [4129] main/112/raft_main_loop V> Sending from 1 to 2, msg: msg_type: MsgHeartbeat to: 2 commit: 15, to: 2, from: 1, raft_id: 1
i1 | 2022-10-27 13:48:19.597 [4129] main/112/raft_main_loop V> Sending from 1 to 3, msg: msg_type: MsgHeartbeat to: 3, to: 3, from: 1, raft_id: 1
i2 | 2022-10-27 13:48:19.598 [4130] main/121/main V> Sending from 2 to 1, msg: msg_type: MsgHeartbeatResponse to: 1 commit: 15, to: 1, from: 2, raft_id: 2
i3 | 2022-10-27 13:48:19.598 [4135] main/112/main V> Sending from 3 to 1, msg: msg_type: MsgHeartbeatResponse to: 1, to: 1, from: 3, raft_id: 3
i3 | 2022-10-27 13:48:19.598 [4135] main/115/raft_main_loop node.rs:707 E> peer with id 1 not found
i1 | 2022-10-27 13:48:19.599 [4129] main/138/lua V> received response, peer: 3
i1 | 2022-10-27 13:48:19.599 [4129] main/122/lua V> received response, peer: 2
i2 | 2022-10-27 13:48:19.599 [4130] main/117/lua V> received response, peer: 1
i1 | 2022-10-27 13:48:19.799 [4129] main/112/raft_main_loop V> Sending from 1 to 2, msg: msg_type: MsgHeartbeat to: 2 commit: 15, to: 2, from: 1, raft_id: 1
i1 | 2022-10-27 13:48:19.799 [4129] main/112/raft_main_loop V> Sending from 1 to 3, msg: msg_type: MsgHeartbeat to: 3, to: 3, from: 1, raft_id: 1
i2 | 2022-10-27 13:48:19.800 [4130] main/121/main V> Sending from 2 to 1, msg: msg_type: MsgHeartbeatResponse to: 1 commit: 15, to: 1, from: 2, raft_id: 2
i3 | 2022-10-27 13:48:19.800 [4135] main/112/main V> Sending from 3 to 1, msg: msg_type: MsgHeartbeatResponse to: 1, to: 1, from: 3, raft_id: 3
i3 | 2022-10-27 13:48:19.800 [4135] main/115/raft_main_loop node.rs:707 E> peer with id 1 not found
i1 | 2022-10-27 13:48:19.800 [4129] main/122/lua V> received response, peer: 2
i1 | 2022-10-27 13:48:19.800 [4129] main/138/lua V> received response, peer: 3
i2 | 2022-10-27 13:48:19.800 [4130] main/117/lua V> received response, peer: 1
i1 | 2022-10-27 13:48:20.001 [4129] main/112/raft_main_loop V> Sending from 1 to 2, msg: msg_type: MsgHeartbeat to: 2 commit: 15, to: 2, from: 1, raft_id: 1
i1 | 2022-10-27 13:48:20.002 [4129] main/112/raft_main_loop V> Sending from 1 to 3, msg: msg_type: MsgHeartbeat to: 3, to: 3, from: 1, raft_id: 1
i2 | 2022-10-27 13:48:20.002 [4130] main/121/main V> Sending from 2 to 1, msg: msg_type: MsgHeartbeatResponse to: 1 commit: 15, to: 1, from: 2, raft_id: 2
i3 | 2022-10-27 13:48:20.003 [4135] main/112/main V> Sending from 3 to 1, msg: msg_type: MsgHeartbeatResponse to: 1, to: 1, from: 3, raft_id: 3
i3 | 2022-10-27 13:48:20.003 [4135] main/115/raft_main_loop node.rs:707 E> peer with id 1 not found
i2 | 2022-10-27 13:48:20.003 [4130] main/117/lua V> received response, peer: 1
i1 | 2022-10-27 13:48:20.003 [4129] main/122/lua V> received response, peer: 2
i1 | 2022-10-27 13:48:20.003 [4129] main/138/lua V> received response, peer: 3
i1 | 2022-10-27 13:48:20.204 [4129] main/112/raft_main_loop V> Sending from 1 to 2, msg: msg_type: MsgHeartbeat to: 2 commit: 15, to: 2, from: 1, raft_id: 1
i1 | 2022-10-27 13:48:20.204 [4129] main/112/raft_main_loop V> Sending from 1 to 3, msg: msg_type: MsgHeartbeat to: 3, to: 3, from: 1, raft_id: 1
i2 | 2022-10-27 13:48:20.204 [4130] main/121/main V> Sending from 2 to 1, msg: msg_type: MsgHeartbeatResponse to: 1 commit: 15, to: 1, from: 2, raft_id: 2
i3 | 2022-10-27 13:48:20.205 [4135] main/112/main V> Sending from 3 to 1, msg: msg_type: MsgHeartbeatResponse to: 1, to: 1, from: 3, raft_id: 3
i3 | 2022-10-27 13:48:20.205 [4135] main/115/raft_main_loop node.rs:707 E> peer with id 1 not found
i1 | 2022-10-27 13:48:20.205 [4129] main/122/lua V> received response, peer: 2
i2 | 2022-10-27 13:48:20.205 [4130] main/117/lua V> received response, peer: 1
i1 | 2022-10-27 13:48:20.205 [4129] main/138/lua V> received response, peer: 3
i1 | 2022-10-27 13:48:20.406 [4129] main/112/raft_main_loop V> Sending from 1 to 2, msg: msg_type: MsgHeartbeat to: 2 commit: 15, to: 2, from: 1, raft_id: 1
i1 | 2022-10-27 13:48:20.406 [4129] main/112/raft_main_loop V> Sending from 1 to 3, msg: msg_type: MsgHeartbeat to: 3, to: 3, from: 1, raft_id: 1
i2 | 2022-10-27 13:48:20.407 [4130] main/121/main V> Sending from 2 to 1, msg: msg_type: MsgHeartbeatResponse to: 1 commit: 15, to: 1, from: 2, raft_id: 2
i3 | 2022-10-27 13:48:20.407 [4135] main/112/main V> Sending from 3 to 1, msg: msg_type: MsgHeartbeatResponse to: 1, to: 1, from: 3, raft_id: 3
i3 | 2022-10-27 13:48:20.407 [4135] main/115/raft_main_loop node.rs:707 E> peer with id 1 not found
i1 | 2022-10-27 13:48:20.407 [4129] main/122/lua V> received response, peer: 2
i2 | 2022-10-27 13:48:20.407 [4130] main/117/lua V> received response, peer: 1
i1 | 2022-10-27 13:48:20.407 [4129] main/138/lua V> received response, peer: 3
i1 | 2022-10-27 13:48:20.608 [4129] main/112/raft_main_loop V> Sending from 1 to 2, msg: msg_type: MsgHeartbeat to: 2 commit: 15, to: 2, from: 1, raft_id: 1
i1 | 2022-10-27 13:48:20.608 [4129] main/112/raft_main_loop V> Sending from 1 to 3, msg: msg_type: MsgHeartbeat to: 3, to: 3, from: 1, raft_id: 1
i2 | 2022-10-27 13:48:20.609 [4130] main/121/main V> Sending from 2 to 1, msg: msg_type: MsgHeartbeatResponse to: 1 commit: 15, to: 1, from: 2, raft_id: 2
i3 | 2022-10-27 13:48:20.609 [4135] main/112/main V> Sending from 3 to 1, msg: msg_type: MsgHeartbeatResponse to: 1, to: 1, from: 3, raft_id: 3
i3 | 2022-10-27 13:48:20.610 [4135] main/115/raft_main_loop node.rs:707 E> peer with id 1 not found
i1 | 2022-10-27 13:48:20.610 [4129] main/122/lua V> received response, peer: 2
i2 | 2022-10-27 13:48:20.610 [4130] main/117/lua V> received response, peer: 1
i1 | 2022-10-27 13:48:20.610 [4129] main/138/lua V> received response, peer: 3
i1 | 2022-10-27 13:48:20.811 [4129] main/112/raft_main_loop V> Sending from 1 to 2, msg: msg_type: MsgHeartbeat to: 2 commit: 15, to: 2, from: 1, raft_id: 1
i1 | 2022-10-27 13:48:20.811 [4129] main/112/raft_main_loop V> Sending from 1 to 3, msg: msg_type: MsgHeartbeat to: 3, to: 3, from: 1, raft_id: 1
i2 | 2022-10-27 13:48:20.811 [4130] main/121/main V> Sending from 2 to 1, msg: msg_type: MsgHeartbeatResponse to: 1 commit: 15, to: 1, from: 2, raft_id: 2
i3 | 2022-10-27 13:48:20.811 [4135] main/112/main V> Sending from 3 to 1, msg: msg_type: MsgHeartbeatResponse to: 1, to: 1, from: 3, raft_id: 3
i3 | 2022-10-27 13:48:20.812 [4135] main/115/raft_main_loop node.rs:707 E> peer with id 1 not found
i1 | 2022-10-27 13:48:20.812 [4129] main/122/lua V> received response, peer: 2
i2 | 2022-10-27 13:48:20.812 [4130] main/117/lua V> received response, peer: 1
i1 | 2022-10-27 13:48:20.812 [4129] main/138/lua V> received response, peer: 3
i3 | 2022-10-27 13:48:20.859 [4135] main/103/interactive V> unable to get a read barrier: timeout
i3 | 2022-10-27 13:48:20.960 [4135] main/103/interactive V> Sending from 3 to 1, msg: msg_type: MsgReadIndex to: 1 entries {data: "\202\242lc\203\242id\003\243gen\001\245count\002\242op\201\244kind\243nop"}, to: 1, from: 3, raft_id: 3
i3 | 2022-10-27 13:48:20.960 [4135] main/115/raft_main_loop node.rs:707 E> peer with id 1 not found
i1 | 2022-10-27 13:48:21.013 [4129] main/112/raft_main_loop V> Sending from 1 to 2, msg: msg_type: MsgHeartbeat to: 2 commit: 15, to: 2, from: 1, raft_id: 1
i1 | 2022-10-27 13:48:21.013 [4129] main/112/raft_main_loop V> Sending from 1 to 3, msg: msg_type: MsgHeartbeat to: 3, to: 3, from: 1, raft_id: 1
i3 | 2022-10-27 13:48:21.013 [4135] main/112/main V> Sending from 3 to 1, msg: msg_type: MsgHeartbeatResponse to: 1, to: 1, from: 3, raft_id: 3
i3 | 2022-10-27 13:48:21.014 [4135] main/115/raft_main_loop node.rs:707 E> peer with id 1 not found
i2 | 2022-10-27 13:48:21.013 [4130] main/121/main V> Sending from 2 to 1, msg: msg_type: MsgHeartbeatResponse to: 1 commit: 15, to: 1, from: 2, raft_id: 2
i1 | 2022-10-27 13:48:21.014 [4129] main/138/lua V> received response, peer: 3
i1 | 2022-10-27 13:48:21.014 [4129] main/122/lua V> received response, peer: 2
i2 | 2022-10-27 13:48:21.015 [4130] main/117/lua V> received response, peer: 1
i1 | 2022-10-27 13:48:21.217 [4129] main/112/raft_main_loop V> Sending from 1 to 2, msg: msg_type: MsgHeartbeat to: 2 commit: 15, to: 2, from: 1, raft_id: 1
i1 | 2022-10-27 13:48:21.217 [4129] main/112/raft_main_loop V> Sending from 1 to 3, msg: msg_type: MsgHeartbeat to: 3, to: 3, from: 1, raft_id: 1
i2 | 2022-10-27 13:48:21.218 [4130] main/121/main V> Sending from 2 to 1, msg: msg_type: MsgHeartbeatResponse to: 1 commit: 15, to: 1, from: 2, raft_id: 2
i1 | 2022-10-27 13:48:21.219 [4129] main/122/lua V> received response, peer: 2
i2 | 2022-10-27 13:48:21.219 [4130] main/117/lua V> received response, peer: 1
i1 | 2022-10-27 13:48:21.223 [4129] main/138/lua V> received response, peer: 3
i3 | 2022-10-27 13:48:21.221 [4135] main/112/main V> Sending from 3 to 1, msg: msg_type: MsgHeartbeatResponse to: 1, to: 1, from: 3, raft_id: 3
i3 | 2022-10-27 13:48:21.221 [4135] main/115/raft_main_loop node.rs:707 E> peer with id 1 not found
i1 | 2022-10-27 13:48:21.419 [4129] main/112/raft_main_loop V> Sending from 1 to 2, msg: msg_type: MsgHeartbeat to: 2 commit: 15, to: 2, from: 1, raft_id: 1
i1 | 2022-10-27 13:48:21.419 [4129] main/112/raft_main_loop V> Sending from 1 to 3, msg: msg_type: MsgHeartbeat to: 3, to: 3, from: 1, raft_id: 1
i3 | 2022-10-27 13:48:21.420 [4135] main/112/main V> Sending from 3 to 1, msg: msg_type: MsgHeartbeatResponse to: 1, to: 1, from: 3, raft_id: 3
i3 | 2022-10-27 13:48:21.420 [4135] main/115/raft_main_loop node.rs:707 E> peer with id 1 not found
i2 | 2022-10-27 13:48:21.420 [4130] main/121/main V> Sending from 2 to 1, msg: msg_type: MsgHeartbeatResponse to: 1 commit: 15, to: 1, from: 2, raft_id: 2
i1 | 2022-10-27 13:48:21.420 [4129] main/122/lua V> received response, peer: 2
i1 | 2022-10-27 13:48:21.420 [4129] main/138/lua V> received response, peer: 3
i2 | 2022-10-27 13:48:21.421 [4130] main/117/lua V> received response, peer: 1
i3 | 2022-10-27 13:48:21.623 [4135] main/112/main V> Sending from 3 to 1, msg: msg_type: MsgHeartbeatResponse to: 1, to: 1, from: 3, raft_id: 3
i3 | 2022-10-27 13:48:21.623 [4135] main/115/raft_main_loop node.rs:707 E> peer with id 1 not found
i2 | 2022-10-27 13:48:21.622 [4130] main/121/main V> Sending from 2 to 1, msg: msg_type: MsgHeartbeatResponse to: 1 commit: 15, to: 1, from: 2, raft_id: 2
i2 | 2022-10-27 13:48:21.623 [4130] main/117/lua V> received response, peer: 1
i1 | 2022-10-27 13:48:21.621 [4129] main/112/raft_main_loop V> Sending from 1 to 2, msg: msg_type: MsgHeartbeat to: 2 commit: 15, to: 2, from: 1, raft_id: 1
i1 | 2022-10-27 13:48:21.621 [4129] main/112/raft_main_loop V> Sending from 1 to 3, msg: msg_type: MsgHeartbeat to: 3, to: 3, from: 1, raft_id: 1
i1 | 2022-10-27 13:48:21.622 [4129] main/122/lua V> received response, peer: 2
i1 | 2022-10-27 13:48:21.626 [4129] main/138/lua V> received response, peer: 3
i1 | 2022-10-27 13:48:21.824 [4129] main/112/raft_main_loop V> Sending from 1 to 2, msg: msg_type: MsgHeartbeat to: 2 commit: 15, to: 2, from: 1, raft_id: 1
i1 | 2022-10-27 13:48:21.824 [4129] main/112/raft_main_loop V> Sending from 1 to 3, msg: msg_type: MsgHeartbeat to: 3, to: 3, from: 1, raft_id: 1
i3 | 2022-10-27 13:48:21.825 [4135] main/112/main V> Sending from 3 to 1, msg: msg_type: MsgHeartbeatResponse to: 1, to: 1, from: 3, raft_id: 3
i3 | 2022-10-27 13:48:21.825 [4135] main/115/raft_main_loop node.rs:707 E> peer with id 1 not found
i2 | 2022-10-27 13:48:21.825 [4130] main/121/main V> Sending from 2 to 1, msg: msg_type: MsgHeartbeatResponse to: 1 commit: 15, to: 1, from: 2, raft_id: 2
i1 | 2022-10-27 13:48:21.826 [4129] main/138/lua V> received response, peer: 3
i1 | 2022-10-27 13:48:21.826 [4129] main/122/lua V> received response, peer: 2
i2 | 2022-10-27 13:48:21.826 [4130] main/117/lua V> received response, peer: 1
i1 | 2022-10-27 13:48:22.027 [4129] main/112/raft_main_loop V> Sending from 1 to 2, msg: msg_type: MsgHeartbeat to: 2 commit: 15, to: 2, from: 1, raft_id: 1
i1 | 2022-10-27 13:48:22.027 [4129] main/112/raft_main_loop V> Sending from 1 to 3, msg: msg_type: MsgHeartbeat to: 3, to: 3, from: 1, raft_id: 1
i2 | 2022-10-27 13:48:22.027 [4130] main/121/main V> Sending from 2 to 1, msg: msg_type: MsgHeartbeatResponse to: 1 commit: 15, to: 1, from: 2, raft_id: 2
i3 | 2022-10-27 13:48:22.028 [4135] main/112/main V> Sending from 3 to 1, msg: msg_type: MsgHeartbeatResponse to: 1, to: 1, from: 3, raft_id: 3
i3 | 2022-10-27 13:48:22.028 [4135] main/115/raft_main_loop node.rs:707 E> peer with id 1 not found
i1 | 2022-10-27 13:48:22.028 [4129] main/138/lua V> received response, peer: 3
i1 | 2022-10-27 13:48:22.028 [4129] main/122/lua V> received response, peer: 2
i2 | 2022-10-27 13:48:22.029 [4130] main/117/lua V> received response, peer: 1
i1 | 2022-10-27 13:48:22.229 [4129] main/112/raft_main_loop V> Sending from 1 to 2, msg: msg_type: MsgHeartbeat to: 2 commit: 15, to: 2, from: 1, raft_id: 1
i1 | 2022-10-27 13:48:22.230 [4129] main/112/raft_main_loop V> Sending from 1 to 3, msg: msg_type: MsgHeartbeat to: 3, to: 3, from: 1, raft_id: 1
i3 | 2022-10-27 13:48:22.230 [4135] main/112/main V> Sending from 3 to 1, msg: msg_type: MsgHeartbeatResponse to: 1, to: 1, from: 3, raft_id: 3
i3 | 2022-10-27 13:48:22.230 [4135] main/115/raft_main_loop node.rs:707 E> peer with id 1 not found
i2 | 2022-10-27 13:48:22.230 [4130] main/121/main V> Sending from 2 to 1, msg: msg_type: MsgHeartbeatResponse to: 1 commit: 15, to: 1, from: 2, raft_id: 2
i1 | 2022-10-27 13:48:22.231 [4129] main/122/lua V> received response, peer: 2
i1 | 2022-10-27 13:48:22.231 [4129] main/138/lua V> received response, peer: 3
i2 | 2022-10-27 13:48:22.231 [4130] main/117/lua V> received response, peer: 1
i1 | 2022-10-27 13:48:22.432 [4129] main/112/raft_main_loop V> Sending from 1 to 2, msg: msg_type: MsgHeartbeat to: 2 commit: 15, to: 2, from: 1, raft_id: 1
i1 | 2022-10-27 13:48:22.432 [4129] main/112/raft_main_loop V> Sending from 1 to 3, msg: msg_type: MsgHeartbeat to: 3, to: 3, from: 1, raft_id: 1
i2 | 2022-10-27 13:48:22.432 [4130] main/121/main V> Sending from 2 to 1, msg: msg_type: MsgHeartbeatResponse to: 1 commit: 15, to: 1, from: 2, raft_id: 2
i1 | 2022-10-27 13:48:22.433 [4129] main/122/lua V> received response, peer: 2
i3 | 2022-10-27 13:48:22.433 [4135] main/112/main V> Sending from 3 to 1, msg: msg_type: MsgHeartbeatResponse to: 1, to: 1, from: 3, raft_id: 3
i3 | 2022-10-27 13:48:22.433 [4135] main/115/raft_main_loop node.rs:707 E> peer with id 1 not found
i2 | 2022-10-27 13:48:22.433 [4130] main/117/lua V> received response, peer: 1
i1 | 2022-10-27 13:48:22.434 [4129] main/138/lua V> received response, peer: 3
i1 | 2022-10-27 13:48:22.634 [4129] main/112/raft_main_loop V> Sending from 1 to 2, msg: msg_type: MsgHeartbeat to: 2 commit: 15, to: 2, from: 1, raft_id: 1
i1 | 2022-10-27 13:48:22.634 [4129] main/112/raft_main_loop V> Sending from 1 to 3, msg: msg_type: MsgHeartbeat to: 3, to: 3, from: 1, raft_id: 1
i2 | 2022-10-27 13:48:22.635 [4130] main/121/main V> Sending from 2 to 1, msg: msg_type: MsgHeartbeatResponse to: 1 commit: 15, to: 1, from: 2, raft_id: 2
i1 | 2022-10-27 13:48:22.636 [4129] main/138/lua V> received response, peer: 3
i3 | 2022-10-27 13:48:22.635 [4135] main/112/main V> Sending from 3 to 1, msg: msg_type: MsgHeartbeatResponse to: 1, to: 1, from: 3, raft_id: 3
i3 | 2022-10-27 13:48:22.635 [4135] main/115/raft_main_loop node.rs:707 E> peer with id 1 not found
i2 | 2022-10-27 13:48:22.641 [4130] main/117/lua V> received response, peer: 1
i1 | 2022-10-27 13:48:22.636 [4129] main/122/lua V> received response, peer: 2
i1 | 2022-10-27 13:48:22.837 [4129] main/112/raft_main_loop V> Sending from 1 to 2, msg: msg_type: MsgHeartbeat to: 2 commit: 15, to: 2, from: 1, raft_id: 1
i1 | 2022-10-27 13:48:22.837 [4129] main/112/raft_main_loop V> Sending from 1 to 3, msg: msg_type: MsgHeartbeat to: 3, to: 3, from: 1, raft_id: 1
i2 | 2022-10-27 13:48:22.837 [4130] main/121/main V> Sending from 2 to 1, msg: msg_type: MsgHeartbeatResponse to: 1 commit: 15, to: 1, from: 2, raft_id: 2
i1 | 2022-10-27 13:48:22.838 [4129] main/122/lua V> received response, peer: 2
i3 | 2022-10-27 13:48:22.838 [4135] main/112/main V> Sending from 3 to 1, msg: msg_type: MsgHeartbeatResponse to: 1, to: 1, from: 3, raft_id: 3
i3 | 2022-10-27 13:48:22.838 [4135] main/115/raft_main_loop node.rs:707 E> peer with id 1 not found
i1 | 2022-10-27 13:48:22.839 [4129] main/138/lua V> received response, peer: 3
i2 | 2022-10-27 13:48:22.839 [4130] main/117/lua V> received response, peer: 1
i1 | 2022-10-27 13:48:23.039 [4129] main/112/raft_main_loop V> Sending from 1 to 2, msg: msg_type: MsgHeartbeat to: 2 commit: 15, to: 2, from: 1, raft_id: 1
i1 | 2022-10-27 13:48:23.039 [4129] main/112/raft_main_loop V> Sending from 1 to 3, msg: msg_type: MsgHeartbeat to: 3, to: 3, from: 1, raft_id: 1
i3 | 2022-10-27 13:48:23.040 [4135] main/112/main V> Sending from 3 to 1, msg: msg_type: MsgHeartbeatResponse to: 1, to: 1, from: 3, raft_id: 3
i3 | 2022-10-27 13:48:23.040 [4135] main/115/raft_main_loop node.rs:707 E> peer with id 1 not found
i2 | 2022-10-27 13:48:23.040 [4130] main/121/main V> Sending from 2 to 1, msg: msg_type: MsgHeartbeatResponse to: 1 commit: 15, to: 1, from: 2, raft_id: 2
i1 | 2022-10-27 13:48:23.040 [4129] main/122/lua V> received response, peer: 2
i1 | 2022-10-27 13:48:23.041 [4129] main/138/lua V> received response, peer: 3
i2 | 2022-10-27 13:48:23.041 [4130] main/117/lua V> received response, peer: 1
i1 | 2022-10-27 13:48:23.245 [4129] main/112/raft_main_loop V> Sending from 1 to 2, msg: msg_type: MsgHeartbeat to: 2 commit: 15, to: 2, from: 1, raft_id: 1
i1 | 2022-10-27 13:48:23.245 [4129] main/112/raft_main_loop V> Sending from 1 to 3, msg: msg_type: MsgHeartbeat to: 3, to: 3, from: 1, raft_id: 1
i2 | 2022-10-27 13:48:23.246 [4130] main/121/main V> Sending from 2 to 1, msg: msg_type: MsgHeartbeatResponse to: 1 commit: 15, to: 1, from: 2, raft_id: 2
i2 | 2022-10-27 13:48:23.249 [4130] main/117/lua V> received response, peer: 1
i1 | 2022-10-27 13:48:23.247 [4129] main/138/lua V> received response, peer: 3
i1 | 2022-10-27 13:48:23.247 [4129] main/122/lua V> received response, peer: 2
i3 | 2022-10-27 13:48:23.246 [4135] main/112/main V> Sending from 3 to 1, msg: msg_type: MsgHeartbeatResponse to: 1, to: 1, from: 3, raft_id: 3
i3 | 2022-10-27 13:48:23.246 [4135] main/115/raft_main_loop node.rs:707 E> peer with id 1 not found
i1 | 2022-10-27 13:48:23.447 [4129] main/112/raft_main_loop V> Sending from 1 to 2, msg: msg_type: MsgHeartbeat to: 2 commit: 15, to: 2, from: 1, raft_id: 1
i1 | 2022-10-27 13:48:23.447 [4129] main/112/raft_main_loop V> Sending from 1 to 3, msg: msg_type: MsgHeartbeat to: 3, to: 3, from: 1, raft_id: 1
i2 | 2022-10-27 13:48:23.448 [4130] main/121/main V> Sending from 2 to 1, msg: msg_type: MsgHeartbeatResponse to: 1 commit: 15, to: 1, from: 2, raft_id: 2
i1 | 2022-10-27 13:48:23.448 [4129] main/122/lua V> received response, peer: 2
i3 | 2022-10-27 13:48:23.448 [4135] main/112/main V> Sending from 3 to 1, msg: msg_type: MsgHeartbeatResponse to: 1, to: 1, from: 3, raft_id: 3
i3 | 2022-10-27 13:48:23.449 [4135] main/115/raft_main_loop node.rs:707 E> peer with id 1 not found
i2 | 2022-10-27 13:48:23.449 [4130] main/117/lua V> received response, peer: 1
i1 | 2022-10-27 13:48:23.449 [4129] main/138/lua V> received response, peer: 3
i1 | 2022-10-27 13:48:23.650 [4129] main/112/raft_main_loop V> Sending from 1 to 2, msg: msg_type: MsgHeartbeat to: 2 commit: 15, to: 2, from: 1, raft_id: 1
i1 | 2022-10-27 13:48:23.651 [4129] main/112/raft_main_loop V> Sending from 1 to 3, msg: msg_type: MsgHeartbeat to: 3, to: 3, from: 1, raft_id: 1
i1 | 2022-10-27 13:48:23.652 [4129] main/122/lua V> received response, peer: 2
i2 | 2022-10-27 13:48:23.651 [4130] main/121/main V> Sending from 2 to 1, msg: msg_type: MsgHeartbeatResponse to: 1 commit: 15, to: 1, from: 2, raft_id: 2
i2 | 2022-10-27 13:48:23.652 [4130] main/117/lua V> received response, peer: 1
i3 | 2022-10-27 13:48:23.651 [4135] main/112/main V> Sending from 3 to 1, msg: msg_type: MsgHeartbeatResponse to: 1, to: 1, from: 3, raft_id: 3
i3 | 2022-10-27 13:48:23.652 [4135] main/115/raft_main_loop node.rs:707 E> peer with id 1 not found
i1 | 2022-10-27 13:48:23.657 [4129] main/138/lua V> received response, peer: 3
i1 | 2022-10-27 13:48:23.854 [4129] main/112/raft_main_loop V> Sending from 1 to 2, msg: msg_type: MsgHeartbeat to: 2 commit: 15, to: 2, from: 1, raft_id: 1
i1 | 2022-10-27 13:48:23.854 [4129] main/112/raft_main_loop V> Sending from 1 to 3, msg: msg_type: MsgHeartbeat to: 3, to: 3, from: 1, raft_id: 1
i2 | 2022-10-27 13:48:23.857 [4130] main/121/main V> Sending from 2 to 1, msg: msg_type: MsgHeartbeatResponse to: 1 commit: 15, to: 1, from: 2, raft_id: 2
i3 | 2022-10-27 13:48:23.857 [4135] main/112/main V> Sending from 3 to 1, msg: msg_type: MsgHeartbeatResponse to: 1, to: 1, from: 3, raft_id: 3
i3 | 2022-10-27 13:48:23.857 [4135] main/115/raft_main_loop node.rs:707 E> peer with id 1 not found
i2 | 2022-10-27 13:48:23.862 [4130] main/117/lua V> received response, peer: 1
i1 | 2022-10-27 13:48:23.862 [4129] main/122/lua V> received response, peer: 2
i1 | 2022-10-27 13:48:23.862 [4129] main/138/lua V> received response, peer: 3
i1 | 2022-10-27 13:48:24.066 [4129] main/112/raft_main_loop V> Sending from 1 to 2, msg: msg_type: MsgHeartbeat to: 2 commit: 15, to: 2, from: 1, raft_id: 1
i1 | 2022-10-27 13:48:24.066 [4129] main/112/raft_main_loop V> Sending from 1 to 3, msg: msg_type: MsgHeartbeat to: 3, to: 3, from: 1, raft_id: 1
i3 | 2022-10-27 13:48:24.066 [4135] main/112/main V> Sending from 3 to 1, msg: msg_type: MsgHeartbeatResponse to: 1, to: 1, from: 3, raft_id: 3
i2 | 2022-10-27 13:48:24.066 [4130] main/121/main V> Sending from 2 to 1, msg: msg_type: MsgHeartbeatResponse to: 1 commit: 15, to: 1, from: 2, raft_id: 2
i3 | 2022-10-27 13:48:24.067 [4135] main/115/raft_main_loop node.rs:707 E> peer with id 1 not found
i1 | 2022-10-27 13:48:24.067 [4129] main/138/lua V> received response, peer: 3
i1 | 2022-10-27 13:48:24.067 [4129] main/122/lua V> received response, peer: 2
i2 | 2022-10-27 13:48:24.067 [4130] main/117/lua V> received response, peer: 1
i1 | 2022-10-27 13:48:24.268 [4129] main/112/raft_main_loop V> Sending from 1 to 2, msg: msg_type: MsgHeartbeat to: 2 commit: 15, to: 2, from: 1, raft_id: 1
i1 | 2022-10-27 13:48:24.268 [4129] main/112/raft_main_loop V> Sending from 1 to 3, msg: msg_type: MsgHeartbeat to: 3, to: 3, from: 1, raft_id: 1
i3 | 2022-10-27 13:48:24.268 [4135] main/112/main V> Sending from 3 to 1, msg: msg_type: MsgHeartbeatResponse to: 1, to: 1, from: 3, raft_id: 3
i2 | 2022-10-27 13:48:24.268 [4130] main/121/main V> Sending from 2 to 1, msg: msg_type: MsgHeartbeatResponse to: 1 commit: 15, to: 1, from: 2, raft_id: 2
i3 | 2022-10-27 13:48:24.268 [4135] main/115/raft_main_loop node.rs:707 E> peer with id 1 not found
i1 | 2022-10-27 13:48:24.269 [4129] main/138/lua V> received response, peer: 3
i1 | 2022-10-27 13:48:24.269 [4129] main/122/lua V> received response, peer: 2
i2 | 2022-10-27 13:48:24.273 [4130] main/117/lua V> received response, peer: 1
i1 | 2022-10-27 13:48:24.471 [4129] main/112/raft_main_loop V> Sending from 1 to 2, msg: msg_type: MsgHeartbeat to: 2 commit: 15, to: 2, from: 1, raft_id: 1
i1 | 2022-10-27 13:48:24.471 [4129] main/112/raft_main_loop V> Sending from 1 to 3, msg: msg_type: MsgHeartbeat to: 3, to: 3, from: 1, raft_id: 1
i3 | 2022-10-27 13:48:24.471 [4135] main/112/main V> Sending from 3 to 1, msg: msg_type: MsgHeartbeatResponse to: 1, to: 1, from: 3, raft_id: 3
i2 | 2022-10-27 13:48:24.471 [4130] main/121/main V> Sending from 2 to 1, msg: msg_type: MsgHeartbeatResponse to: 1 commit: 15, to: 1, from: 2, raft_id: 2
i3 | 2022-10-27 13:48:24.471 [4135] main/115/raft_main_loop node.rs:707 E> peer with id 1 not found
i1 | 2022-10-27 13:48:24.472 [4129] main/138/lua V> received response, peer: 3
i1 | 2022-10-27 13:48:24.472 [4129] main/122/lua V> received response, peer: 2
i2 | 2022-10-27 13:48:24.472 [4130] main/117/lua V> received response, peer: 1
i1 | 2022-10-27 13:48:24.673 [4129] main/112/raft_main_loop V> Sending from 1 to 2, msg: msg_type: MsgHeartbeat to: 2 commit: 15, to: 2, from: 1, raft_id: 1
i1 | 2022-10-27 13:48:24.673 [4129] main/112/raft_main_loop V> Sending from 1 to 3, msg: msg_type: MsgHeartbeat to: 3, to: 3, from: 1, raft_id: 1
i2 | 2022-10-27 13:48:24.673 [4130] main/121/main V> Sending from 2 to 1, msg: msg_type: MsgHeartbeatResponse to: 1 commit: 15, to: 1, from: 2, raft_id: 2
i3 | 2022-10-27 13:48:24.673 [4135] main/112/main V> Sending from 3 to 1, msg: msg_type: MsgHeartbeatResponse to: 1, to: 1, from: 3, raft_id: 3
i3 | 2022-10-27 13:48:24.673 [4135] main/115/raft_main_loop node.rs:707 E> peer with id 1 not found
i1 | 2022-10-27 13:48:24.674 [4129] main/138/lua V> received response, peer: 3
i1 | 2022-10-27 13:48:24.674 [4129] main/122/lua V> received response, peer: 2
i2 | 2022-10-27 13:48:24.674 [4130] main/117/lua V> received response, peer: 1
i1 | 2022-10-27 13:48:24.878 [4129] main/112/raft_main_loop V> Sending from 1 to 2, msg: msg_type: MsgHeartbeat to: 2 commit: 15, to: 2, from: 1, raft_id: 1
i1 | 2022-10-27 13:48:24.878 [4129] main/112/raft_main_loop V> Sending from 1 to 3, msg: msg_type: MsgHeartbeat to: 3, to: 3, from: 1, raft_id: 1
i3 | 2022-10-27 13:48:24.878 [4135] main/112/main V> Sending from 3 to 1, msg: msg_type: MsgHeartbeatResponse to: 1, to: 1, from: 3, raft_id: 3
i2 | 2022-10-27 13:48:24.878 [4130] main/121/main V> Sending from 2 to 1, msg: msg_type: MsgHeartbeatResponse to: 1 commit: 15, to: 1, from: 2, raft_id: 2
i3 | 2022-10-27 13:48:24.878 [4135] main/115/raft_main_loop node.rs:707 E> peer with id 1 not found
i1 | 2022-10-27 13:48:24.879 [4129] main/138/lua V> received response, peer: 3
i1 | 2022-10-27 13:48:24.879 [4129] main/122/lua V> received response, peer: 2
i2 | 2022-10-27 13:48:24.879 [4130] main/117/lua V> received response, peer: 1
i1 | 2022-10-27 13:48:25.079 [4129] main/112/raft_main_loop V> Sending from 1 to 2, msg: msg_type: MsgHeartbeat to: 2 commit: 15, to: 2, from: 1, raft_id: 1
i1 | 2022-10-27 13:48:25.079 [4129] main/112/raft_main_loop V> Sending from 1 to 3, msg: msg_type: MsgHeartbeat to: 3, to: 3, from: 1, raft_id: 1
i3 | 2022-10-27 13:48:25.080 [4135] main/112/main V> Sending from 3 to 1, msg: msg_type: MsgHeartbeatResponse to: 1, to: 1, from: 3, raft_id: 3
i2 | 2022-10-27 13:48:25.080 [4130] main/121/main V> Sending from 2 to 1, msg: msg_type: MsgHeartbeatResponse to: 1 commit: 15, to: 1, from: 2, raft_id: 2
i3 | 2022-10-27 13:48:25.080 [4135] main/115/raft_main_loop node.rs:707 E> peer with id 1 not found
i1 | 2022-10-27 13:48:25.080 [4129] main/138/lua V> received response, peer: 3
i1 | 2022-10-27 13:48:25.081 [4129] main/122/lua V> received response, peer: 2
i2 | 2022-10-27 13:48:25.081 [4130] main/117/lua V> received response, peer: 1
i1 | 2022-10-27 13:48:25.282 [4129] main/112/raft_main_loop V> Sending from 1 to 2, msg: msg_type: MsgHeartbeat to: 2 commit: 15, to: 2, from: 1, raft_id: 1
i1 | 2022-10-27 13:48:25.282 [4129] main/112/raft_main_loop V> Sending from 1 to 3, msg: msg_type: MsgHeartbeat to: 3, to: 3, from: 1, raft_id: 1
i2 | 2022-10-27 13:48:25.282 [4130] main/121/main V> Sending from 2 to 1, msg: msg_type: MsgHeartbeatResponse to: 1 commit: 15, to: 1, from: 2, raft_id: 2
i3 | 2022-10-27 13:48:25.283 [4135] main/112/main V> Sending from 3 to 1, msg: msg_type: MsgHeartbeatResponse to: 1, to: 1, from: 3, raft_id: 3
i3 | 2022-10-27 13:48:25.283 [4135] main/115/raft_main_loop node.rs:707 E> peer with id 1 not found
i1 | 2022-10-27 13:48:25.283 [4129] main/138/lua V> received response, peer: 3
i1 | 2022-10-27 13:48:25.283 [4129] main/122/lua V> received response, peer: 2
i2 | 2022-10-27 13:48:25.283 [4130] main/117/lua V> received response, peer: 1
=========================== short test summary info ============================
ERROR test/int/test_expelling.py::test_expel_leader - assert == failed. [pyte...
========================= 35 passed, 1 error in 55.54s =========================
section_end:1666878531:step_script
[0Ksection_start:1666878531:cleanup_file_variables
[0K[0K[36;1mCleaning up project directory and file based variables[0;m[0;m
section_end:1666878539:cleanup_file_variables
[0K[31;1mERROR: Job failed: exit code 1
[0;mJob 34199 log
[0KRunning with gitlab-runner 15.5.0 (0d4137b8)[0;m
[0K on picodata-docker-1 Pm5UPc3D[0;m
section_start:1666878691:prepare_executor
[0K[0K[36;1mPreparing the "docker" executor[0;m[0;m
[0KUsing Docker executor with image docker-public.binary.picodata.io/build-base:latest ...[0;m
[0KUsing docker image sha256:c3eba8e0a3d6963be00c873c44a3cca469aa506c72a6d71e9abe8c5a72f3c76a for docker-public.binary.picodata.io/build-base:latest with digest docker-public.binary.picodata.io/build-base@sha256:9d5767a40bc0a1f0be4ca951d62cc5b1b6ee6c4e9887dac380539367b43d2b2b ...[0;m
section_end:1666878714:prepare_executor
[0Ksection_start:1666878714:prepare_script
[0K[0K[36;1mPreparing environment[0;m[0;m
Running on runner-pm5upc3d-project-58-concurrent-4 via gitlab-ci...
section_end:1666878722:prepare_script
[0Ksection_start:1666878722:get_sources
[0K[0K[36;1mGetting source from Git repository[0;m[0;m
[32;1mFetching changes...[0;m
Initialized empty Git repository in /builds/picodata/picodata/picodata/.git/
[32;1mCreated fresh repository.[0;m
[32;1mChecking out 51f7954e as fix/commit-index-in-rpc...[0;m
[32;1mUpdating/initializing submodules recursively...[0;m
Submodule 'tarantool' (https://gitlab-ci-token:[MASKED]@git.picodata.io/picodata/picodata/tarantool-module.git) registered for path 'tarantool'
Submodule 'tarantool-sys' (https://gitlab-ci-token:[MASKED]@git.picodata.io/picodata/tarantool.git) registered for path 'tarantool-sys'
Submodule 'vshard' (https://github.com/tarantool/vshard) registered for path 'vshard'
Synchronizing submodule url for 'tarantool'
Synchronizing submodule url for 'tarantool-sys'
Synchronizing submodule url for 'vshard'
Cloning into '/builds/picodata/picodata/picodata/tarantool'...
Cloning into '/builds/picodata/picodata/picodata/tarantool-sys'...
Cloning into '/builds/picodata/picodata/picodata/vshard'...
Submodule path 'tarantool': checked out 'bf175d207365e7167958521d933361346cef6107'
Submodule path 'tarantool-sys': checked out '1ec2a9d15f2904f07f44021bfae5e67ce55b3214'
Submodule 'src/lib/msgpuck' (https://github.com/tarantool/msgpuck.git) registered for path 'tarantool-sys/src/lib/msgpuck'
Submodule 'src/lib/small' (https://github.com/tarantool/small.git) registered for path 'tarantool-sys/src/lib/small'
Submodule 'test-run' (https://github.com/tarantool/test-run.git) registered for path 'tarantool-sys/test-run'
Submodule 'third_party/c-ares' (https://github.com/tarantool/c-ares.git) registered for path 'tarantool-sys/third_party/c-ares'
Submodule 'third_party/c-dt' (https://github.com/tarantool/c-dt.git) registered for path 'tarantool-sys/third_party/c-dt'
Submodule 'third_party/curl' (https://github.com/tarantool/curl.git) registered for path 'tarantool-sys/third_party/curl'
Submodule 'third_party/decNumber' (https://github.com/tarantool/decNumber.git) registered for path 'tarantool-sys/third_party/decNumber'
Submodule 'third_party/libunwind' (https://github.com/tarantool/libunwind.git) registered for path 'tarantool-sys/third_party/libunwind'
Submodule 'third_party/libyaml' (https://github.com/tarantool/libyaml.git) registered for path 'tarantool-sys/third_party/libyaml'
Submodule 'third_party/lua-zlib' (https://github.com/tarantool/lua-zlib.git) registered for path 'tarantool-sys/third_party/lua-zlib'
Submodule 'third_party/luafun' (https://github.com/luafun/luafun.git) registered for path 'tarantool-sys/third_party/luafun'
Submodule 'third_party/luajit' (https://github.com/tarantool/luajit.git) registered for path 'tarantool-sys/third_party/luajit'
Submodule 'third_party/luarocks' (https://github.com/tarantool/luarocks.git) registered for path 'tarantool-sys/third_party/luarocks'
Submodule 'third_party/luazip' (https://github.com/tarantool/luazip.git) registered for path 'tarantool-sys/third_party/luazip'
Submodule 'third_party/nghttp2' (https://github.com/tarantool/nghttp2.git) registered for path 'tarantool-sys/third_party/nghttp2'
Submodule 'third_party/tz' (https://github.com/tarantool/tz.git) registered for path 'tarantool-sys/third_party/tz'
Submodule 'third_party/xxHash' (https://github.com/tarantool/xxHash) registered for path 'tarantool-sys/third_party/xxHash'
Submodule 'third_party/zstd' (https://github.com/tarantool/zstd.git) registered for path 'tarantool-sys/third_party/zstd'
Cloning into '/builds/picodata/picodata/picodata/tarantool-sys/src/lib/msgpuck'...
Cloning into '/builds/picodata/picodata/picodata/tarantool-sys/src/lib/small'...
Cloning into '/builds/picodata/picodata/picodata/tarantool-sys/test-run'...
Cloning into '/builds/picodata/picodata/picodata/tarantool-sys/third_party/c-ares'...
Cloning into '/builds/picodata/picodata/picodata/tarantool-sys/third_party/c-dt'...
Cloning into '/builds/picodata/picodata/picodata/tarantool-sys/third_party/curl'...
Cloning into '/builds/picodata/picodata/picodata/tarantool-sys/third_party/decNumber'...
Cloning into '/builds/picodata/picodata/picodata/tarantool-sys/third_party/libunwind'...
Cloning into '/builds/picodata/picodata/picodata/tarantool-sys/third_party/libyaml'...
Cloning into '/builds/picodata/picodata/picodata/tarantool-sys/third_party/lua-zlib'...
Cloning into '/builds/picodata/picodata/picodata/tarantool-sys/third_party/luafun'...
Cloning into '/builds/picodata/picodata/picodata/tarantool-sys/third_party/luajit'...
Cloning into '/builds/picodata/picodata/picodata/tarantool-sys/third_party/luarocks'...
Cloning into '/builds/picodata/picodata/picodata/tarantool-sys/third_party/luazip'...
Cloning into '/builds/picodata/picodata/picodata/tarantool-sys/third_party/nghttp2'...
Cloning into '/builds/picodata/picodata/picodata/tarantool-sys/third_party/tz'...
Cloning into '/builds/picodata/picodata/picodata/tarantool-sys/third_party/xxHash'...
Cloning into '/builds/picodata/picodata/picodata/tarantool-sys/third_party/zstd'...
Submodule path 'tarantool-sys/src/lib/msgpuck': checked out '0c6680a300e31714f475a7f90c2d95a02d001d80'
Submodule path 'tarantool-sys/src/lib/small': checked out '04ea71530aa048ff7c70a9cc4f3a052da31a8305'
Submodule path 'tarantool-sys/test-run': checked out '9ccc40fad03a4707be751ed55578ea41b453feb6'
Submodule 'lib/checks' (https://github.com/tarantool/checks.git) registered for path 'tarantool-sys/test-run/lib/checks'
Submodule 'lib/luatest' (https://github.com/tarantool/luatest.git) registered for path 'tarantool-sys/test-run/lib/luatest'
Submodule 'lib/msgpack-python' (https://github.com/msgpack/msgpack-python.git) registered for path 'tarantool-sys/test-run/lib/msgpack-python'
Submodule 'lib/tarantool-python' (https://github.com/tarantool/tarantool-python.git) registered for path 'tarantool-sys/test-run/lib/tarantool-python'
Cloning into '/builds/picodata/picodata/picodata/tarantool-sys/test-run/lib/checks'...
Cloning into '/builds/picodata/picodata/picodata/tarantool-sys/test-run/lib/luatest'...
Cloning into '/builds/picodata/picodata/picodata/tarantool-sys/test-run/lib/msgpack-python'...
Cloning into '/builds/picodata/picodata/picodata/tarantool-sys/test-run/lib/tarantool-python'...
Submodule path 'tarantool-sys/test-run/lib/checks': checked out 'c97888c8d4a5ffb0255267d2d82fd60bae17916a'
Submodule path 'tarantool-sys/test-run/lib/luatest': checked out '963541f33d20dc6159a688072b638c456c59dac1'
Submodule path 'tarantool-sys/test-run/lib/msgpack-python': checked out 'd816aa80402dcce8fa806d4d43d0c087d86d6152'
Submodule path 'tarantool-sys/test-run/lib/tarantool-python': checked out 'ea942f981158a3dcf7d5d343ad3acf89edd4b15b'
From https://github.com/tarantool/c-ares
* branch bbbffa4da8baf35b0e4e1c376e38018f9a8bcb4e -> FETCH_HEAD
Submodule path 'tarantool-sys/third_party/c-ares': checked out 'bbbffa4da8baf35b0e4e1c376e38018f9a8bcb4e'
Submodule path 'tarantool-sys/third_party/c-dt': checked out 'cec6acebb54d9e73ea0b99c63898732abd7683a6'
Submodule path 'tarantool-sys/third_party/curl': checked out '1669b17d3a1a1fd824308544ca0ec02a2a4f50ea'
Submodule path 'tarantool-sys/third_party/decNumber': checked out '5ddfde194cd68f7d8b9763d51c04b51d782df185'
Submodule path 'tarantool-sys/third_party/libunwind': checked out '3f49295a7b0b8abea7f5ec0dacbeae74e6b5e0c0'
Submodule path 'tarantool-sys/third_party/libyaml': checked out '7f41d551a44a9b947dc341dd5b6c8779b5d83f00'
Submodule path 'tarantool-sys/third_party/lua-zlib': checked out '2219aff270036650c4b9d478d10d44256c9df751'
Submodule path 'tarantool-sys/third_party/luafun': checked out '04c99f9c393e54a604adde4b25b794f48104e0d0'
Submodule path 'tarantool-sys/third_party/luajit': checked out '359bfe09d71869064e619c4affd749127ad5218f'
Submodule path 'tarantool-sys/third_party/luarocks': checked out '954c2f5784cedd7d70f1b0f5d6af6e36c21e94be'
Submodule path 'tarantool-sys/third_party/luazip': checked out 'e9e9b6351d3ff96d6cd53ad753f4f59ada4642c1'
Submodule path 'tarantool-sys/third_party/nghttp2': checked out '4483fdae7ae777960e2d95bcb22bcca05bee36f9'
Submodule path 'tarantool-sys/third_party/tz': checked out '95ecc37d29c2f5cf711af43b0ef3a35fc2847aa1'
Submodule path 'tarantool-sys/third_party/xxHash': checked out '94e5f23e736f2bb67ebdf90727353e65344f9fc0'
Submodule path 'tarantool-sys/third_party/zstd': checked out 'a488ba114ec17ea1054b9057c26a046fc122b3b6'
Submodule path 'vshard': checked out 'b47b6c29a7bf5e63af89138730402bab34965a67'
Submodule 'test/test-run' (https://github.com/tarantool/test-run.git) registered for path 'vshard/test-run'
Cloning into '/builds/picodata/picodata/picodata/vshard/test-run'...
Submodule path 'vshard/test-run': checked out '2604c46c7b6368dbde59489d5303ce3d1d430331'
Submodule 'lib/checks' (https://github.com/tarantool/checks.git) registered for path 'vshard/test-run/lib/checks'
Submodule 'lib/luatest' (https://github.com/tarantool/luatest.git) registered for path 'vshard/test-run/lib/luatest'
Submodule 'lib/msgpack-python' (https://github.com/msgpack/msgpack-python.git) registered for path 'vshard/test-run/lib/msgpack-python'
Submodule 'lib/tarantool-python' (https://github.com/tarantool/tarantool-python.git) registered for path 'vshard/test-run/lib/tarantool-python'
Cloning into '/builds/picodata/picodata/picodata/vshard/test-run/lib/checks'...
Cloning into '/builds/picodata/picodata/picodata/vshard/test-run/lib/luatest'...
Cloning into '/builds/picodata/picodata/picodata/vshard/test-run/lib/msgpack-python'...
Cloning into '/builds/picodata/picodata/picodata/vshard/test-run/lib/tarantool-python'...
Submodule path 'vshard/test-run/lib/checks': checked out 'c97888c8d4a5ffb0255267d2d82fd60bae17916a'
Submodule path 'vshard/test-run/lib/luatest': checked out '10590e70204d6e49a96e77cce2e8d80783f19000'
Submodule path 'vshard/test-run/lib/msgpack-python': checked out 'd816aa80402dcce8fa806d4d43d0c087d86d6152'
Submodule path 'vshard/test-run/lib/tarantool-python': checked out 'ea942f981158a3dcf7d5d343ad3acf89edd4b15b'
Entering 'tarantool'
Entering 'tarantool-sys'
Entering 'tarantool-sys/src/lib/msgpuck'
Entering 'tarantool-sys/src/lib/small'
Entering 'tarantool-sys/test-run'
Entering 'tarantool-sys/test-run/lib/checks'
Entering 'tarantool-sys/test-run/lib/luatest'
Entering 'tarantool-sys/test-run/lib/msgpack-python'
Entering 'tarantool-sys/test-run/lib/tarantool-python'
Entering 'tarantool-sys/third_party/c-ares'
Entering 'tarantool-sys/third_party/c-dt'
Entering 'tarantool-sys/third_party/curl'
Entering 'tarantool-sys/third_party/decNumber'
Entering 'tarantool-sys/third_party/libunwind'
Entering 'tarantool-sys/third_party/libyaml'
Entering 'tarantool-sys/third_party/lua-zlib'
Entering 'tarantool-sys/third_party/luafun'
Entering 'tarantool-sys/third_party/luajit'
Entering 'tarantool-sys/third_party/luarocks'
Entering 'tarantool-sys/third_party/luazip'
Entering 'tarantool-sys/third_party/nghttp2'
Entering 'tarantool-sys/third_party/tz'
Entering 'tarantool-sys/third_party/xxHash'
Entering 'tarantool-sys/third_party/zstd'
Entering 'vshard'
Entering 'vshard/test-run'
Entering 'vshard/test-run/lib/checks'
Entering 'vshard/test-run/lib/luatest'
Entering 'vshard/test-run/lib/msgpack-python'
Entering 'vshard/test-run/lib/tarantool-python'
Entering 'tarantool'
Entering 'tarantool-sys'
Entering 'tarantool-sys/src/lib/msgpuck'
Entering 'tarantool-sys/src/lib/small'
Entering 'tarantool-sys/test-run'
Entering 'tarantool-sys/test-run/lib/checks'
Entering 'tarantool-sys/test-run/lib/luatest'
Entering 'tarantool-sys/test-run/lib/msgpack-python'
Entering 'tarantool-sys/test-run/lib/tarantool-python'
Entering 'tarantool-sys/third_party/c-ares'
Entering 'tarantool-sys/third_party/c-dt'
Entering 'tarantool-sys/third_party/curl'
Entering 'tarantool-sys/third_party/decNumber'
Entering 'tarantool-sys/third_party/libunwind'
Entering 'tarantool-sys/third_party/libyaml'
Entering 'tarantool-sys/third_party/lua-zlib'
Entering 'tarantool-sys/third_party/luafun'
Entering 'tarantool-sys/third_party/luajit'
Entering 'tarantool-sys/third_party/luarocks'
Entering 'tarantool-sys/third_party/luazip'
Entering 'tarantool-sys/third_party/nghttp2'
Entering 'tarantool-sys/third_party/tz'
Entering 'tarantool-sys/third_party/xxHash'
Entering 'tarantool-sys/third_party/zstd'
Entering 'vshard'
Entering 'vshard/test-run'
Entering 'vshard/test-run/lib/checks'
Entering 'vshard/test-run/lib/luatest'
Entering 'vshard/test-run/lib/msgpack-python'
Entering 'vshard/test-run/lib/tarantool-python'
section_end:1666878815:get_sources
[0Ksection_start:1666878815:restore_cache
[0K[0K[36;1mRestoring cache[0;m[0;m
[32;1mChecking cache for default-2-non_protected...[0;m
No URL provided, cache will not be downloaded from shared cache server. Instead a local version of cache will be extracted.[0;m
[32;1mSuccessfully extracted cache[0;m
section_end:1666878816:restore_cache
[0Ksection_start:1666878816:step_script
[0K[0K[36;1mExecuting "step_script" stage of the job script[0;m[0;m
[0KUsing docker image sha256:c3eba8e0a3d6963be00c873c44a3cca469aa506c72a6d71e9abe8c5a72f3c76a for docker-public.binary.picodata.io/build-base:latest with digest docker-public.binary.picodata.io/build-base@sha256:9d5767a40bc0a1f0be4ca951d62cc5b1b6ee6c4e9887dac380539367b43d2b2b ...[0;m
[32;1m$ pushd tarantool-sys; git describe; popd[0;m
/builds/picodata/picodata/picodata/tarantool-sys /builds/picodata/picodata/picodata
2.10.0-29-g1ec2a9d
/builds/picodata/picodata/picodata
[32;1m$ pushd tarantool-sys/third_party/luajit; git describe; popd[0;m
/builds/picodata/picodata/picodata/tarantool-sys/third_party/luajit /builds/picodata/picodata/picodata
v2.1.0-beta3-188-g359bfe0
/builds/picodata/picodata/picodata
[32;1m$ export RUST_BACKTRACE=1[0;m
[32;1m$ cargo -V[0;m
cargo 1.64.0 (387270bc7 2022-09-16)
[32;1m$ cargo build --locked[0;m
Updating crates.io index
Downloading crates ...
Downloaded cfg-if v1.0.0
Downloaded cc v1.0.72
Downloaded generic-array v0.14.4
Downloaded getrandom v0.2.3
Downloaded arc-swap v1.5.0
Downloaded bitflags v1.3.2
Downloaded autocfg v1.0.1
Downloaded atty v0.2.14
Downloaded aho-corasick v0.7.18
Downloaded clap v3.1.12
Downloaded chrono v0.4.19
Downloaded crossbeam-channel v0.5.1
Downloaded cpufeatures v0.2.1
Downloaded block-buffer v0.9.0
Downloaded clap_derive v3.1.7
Downloaded derivative v2.2.0
Downloaded indexmap v1.8.1
Downloaded digest v0.9.0
Downloaded crypto-common v0.1.3
Downloaded decnumber-sys v0.1.5
Downloaded heck v0.4.0
Downloaded md-5 v0.10.1
Downloaded getset v0.1.2
Downloaded errno v0.2.8
Downloaded itoa v1.0.1
Downloaded lazy_static v1.4.0
Downloaded memoffset v0.6.5
Downloaded memchr v2.4.1
Downloaded hashbrown v0.11.2
Downloaded inventory v0.2.1
Downloaded either v1.6.1
Downloaded dirs-sys-next v0.1.2
Downloaded quote v0.6.13
Downloaded quote v1.0.10
Downloaded proc-macro-error-attr v1.0.4
Downloaded opaque-debug v0.3.0
Downloaded nix v0.23.1
Downloaded ryu v1.0.9
Downloaded once_cell v1.9.0
Downloaded refpool v0.4.3
Downloaded raft-proto v0.6.0
Downloaded proc-macro2 v0.4.30
Downloaded os_str_bytes v6.0.0
Downloaded itertools v0.10.3
Downloaded slog-envlogger v2.2.0
Downloaded slog-async v2.7.0
Downloaded slog v2.7.0
Downloaded proc-macro-error v1.0.4
Downloaded static_assertions v1.1.0
Downloaded slog-stdlog v4.1.0
Downloaded rand v0.8.5
Downloaded version_check v0.9.3
Downloaded proc-macro2 v1.0.43
Downloaded unicode-ident v1.0.3
Downloaded ppv-lite86 v0.2.15
Downloaded num-traits v0.2.14
Downloaded protobuf-codegen v2.27.1
Downloaded protobuf v2.27.1
Downloaded serde_derive v1.0.133
Downloaded fxhash v0.2.1
Downloaded thread_local v1.1.3
Downloaded thiserror v1.0.30
Downloaded uuid v0.8.2
Downloaded term v0.7.0
Downloaded remove_dir_all v0.5.3
Downloaded strsim v0.10.0
Downloaded uuid v1.0.0
Downloaded unindent v0.1.7
Downloaded textwrap v0.15.0
Downloaded syn v1.0.99
Downloaded block-buffer v0.10.2
Downloaded termcolor v1.1.3
Downloaded dec v0.4.8
Downloaded serde v1.0.133
Downloaded slog-term v2.8.0
Downloaded ctor v0.1.21
Downloaded va_list v0.1.3
Downloaded rand_chacha v0.3.1
Downloaded rmpv v1.0.0
Downloaded typenum v1.14.0
Downloaded unicode-xid v0.1.0
Downloaded regex-syntax v0.6.25
Downloaded libc v0.2.126
Downloaded slog-scope v4.4.0
Downloaded raft v0.6.0
Downloaded base64 v0.13.0
Downloaded nix v0.24.1
Downloaded digest v0.10.3
Downloaded bytes v1.1.0
Downloaded log v0.4.14
Downloaded indoc v1.0.3
Downloaded crossbeam-utils v0.8.5
Downloaded rand_core v0.6.3
Downloaded dlopen_derive v0.1.4
Downloaded dlopen v0.1.8
Downloaded dirs-next v2.0.0
Downloaded ghost v0.1.2
Downloaded clap_lex v0.1.1
Downloaded tempfile v3.2.0
Downloaded take_mut v0.2.2
Downloaded serde_json v1.0.73
Downloaded byteorder v1.4.3
Downloaded time v0.1.43
Downloaded thiserror-impl v1.0.30
Downloaded syn v0.15.44
Downloaded num-integer v0.1.44
Downloaded num-derive v0.3.3
Downloaded sha-1 v0.9.8
Downloaded serde_bytes v0.11.5
Downloaded rmp-serde v1.0.0
Downloaded rmp v0.8.10
Downloaded regex v1.5.4
Downloaded cmake v0.1.48
Downloaded protobuf-build v0.12.3
Compiling proc-macro2 v1.0.43
Compiling unicode-ident v1.0.3
Compiling libc v0.2.126
Compiling syn v1.0.99
Compiling autocfg v1.0.1
Compiling version_check v0.9.3
Compiling cfg-if v1.0.0
Compiling typenum v1.14.0
Compiling memchr v2.4.1
Compiling lazy_static v1.4.0
Compiling bitflags v1.3.2
Compiling serde_derive v1.0.133
Compiling cc v1.0.72
Compiling slog v2.7.0
Compiling serde v1.0.133
Compiling protobuf v2.27.1
Compiling proc-macro2 v0.4.30
Compiling bytes v1.1.0
Compiling regex-syntax v0.6.25
Compiling byteorder v1.4.3
Compiling log v0.4.14
Compiling unicode-xid v0.1.0
Compiling crossbeam-utils v0.8.5
Compiling once_cell v1.9.0
Compiling syn v0.15.44
Compiling arc-swap v1.5.0
Compiling ppv-lite86 v0.2.15
Compiling slog-async v2.7.0
Compiling take_mut v0.2.2
Compiling serde_json v1.0.73
Compiling ryu v1.0.9
Compiling hashbrown v0.11.2
Compiling heck v0.4.0
Compiling os_str_bytes v6.0.0
Compiling static_assertions v1.1.0
Compiling opaque-debug v0.3.0
Compiling itoa v1.0.1
Compiling cpufeatures v0.2.1
Compiling base64 v0.13.0
Compiling remove_dir_all v0.5.3
Compiling either v1.6.1
Compiling va_list v0.1.3
Compiling refpool v0.4.3
Compiling textwrap v0.15.0
Compiling strsim v0.10.0
Compiling unindent v0.1.7
Compiling termcolor v1.1.3
Compiling uuid v0.8.2
Compiling generic-array v0.14.4
Compiling proc-macro-error-attr v1.0.4
Compiling proc-macro-error v1.0.4
Compiling num-traits v0.2.14
Compiling num-integer v0.1.44
Compiling memoffset v0.6.5
Compiling indexmap v1.8.1
Compiling cmake v0.1.48
Compiling fxhash v0.2.1
Compiling thread_local v1.1.3
Compiling clap_lex v0.1.1
Compiling itertools v0.10.3
Compiling decnumber-sys v0.1.5
Compiling indoc v1.0.3
Compiling picodata v22.7.0 (/builds/picodata/picodata/picodata)
Compiling aho-corasick v0.7.18
Compiling quote v1.0.10
Compiling slog-scope v4.4.0
Compiling dirs-sys-next v0.1.2
Compiling getrandom v0.2.3
Compiling time v0.1.43
Compiling atty v0.2.14
Compiling errno v0.2.8
Compiling quote v0.6.13
Compiling crossbeam-channel v0.5.1
Compiling slog-stdlog v4.1.0
Compiling dirs-next v2.0.0
Compiling regex v1.5.4
Compiling rand_core v0.6.3
Compiling rmp v0.8.10
Compiling block-buffer v0.10.2
Compiling crypto-common v0.1.3
Compiling digest v0.9.0
Compiling block-buffer v0.9.0
Compiling nix v0.24.1
Compiling nix v0.23.1
Compiling term v0.7.0
Compiling rand_chacha v0.3.1
Compiling chrono v0.4.19
Compiling digest v0.10.3
Compiling sha-1 v0.9.8
Compiling protobuf-codegen v2.27.1
Compiling dec v0.4.8
Compiling rand v0.8.5
Compiling dlopen_derive v0.1.4
Compiling md-5 v0.10.1
Compiling slog-term v2.8.0
Compiling protobuf-build v0.12.3
Compiling uuid v1.0.0
Compiling tempfile v3.2.0
Compiling slog-envlogger v2.2.0
Compiling dlopen v0.1.8
Compiling thiserror-impl v1.0.30
Compiling tlua-derive v0.1.3 (/builds/picodata/picodata/picodata/tarantool/tlua-derive)
Compiling ctor v0.1.21
Compiling num-derive v0.3.3
Compiling getset v0.1.2
Compiling clap_derive v3.1.7
Compiling derivative v2.2.0
Compiling ghost v0.1.2
Compiling tarantool-proc v0.1.2 (/builds/picodata/picodata/picodata/tarantool/tarantool-proc)
Compiling raft-proto v0.6.0
Compiling inventory v0.2.1
Compiling clap v3.1.12
Compiling thiserror v1.0.30
Compiling raft v0.6.0
Compiling serde_bytes v0.11.5
Compiling rmp-serde v1.0.0
Compiling tlua v0.6.3 (/builds/picodata/picodata/picodata/tarantool/tlua)
Compiling rmpv v1.0.0
Compiling tarantool v0.6.4 (/builds/picodata/picodata/picodata/tarantool/tarantool)
Finished dev [unoptimized + debuginfo] target(s) in 6m 26s
[32;1m$ cargo test --locked[0;m
Downloading crates ...
Downloaded assert_cmd v2.0.2
Downloaded predicates-tree v1.0.4
Downloaded predicates-core v1.0.2
Downloaded float-cmp v0.9.0
Downloaded pretty_assertions v0.6.1
Downloaded ansi_term v0.11.0
Downloaded doc-comment v0.3.3
Downloaded difflib v0.4.0
Downloaded normalize-line-endings v0.3.0
Downloaded difference v2.0.0
Downloaded bstr v0.2.17
Downloaded predicates v2.1.0
Downloaded regex-automata v0.1.10
Downloaded wait-timeout v0.2.0
Downloaded termtree v0.2.3
Compiling predicates-core v1.0.2
Compiling doc-comment v0.3.3
Compiling termtree v0.2.3
Compiling regex-automata v0.1.10
Compiling difflib v0.4.0
Compiling normalize-line-endings v0.3.0
Compiling difference v2.0.0
Compiling ansi_term v0.11.0
Compiling wait-timeout v0.2.0
Compiling picodata v22.7.0 (/builds/picodata/picodata/picodata)
Compiling predicates-tree v1.0.4
Compiling float-cmp v0.9.0
Compiling pretty_assertions v0.6.1
Compiling bstr v0.2.17
Compiling predicates v2.1.0
Compiling assert_cmd v2.0.2
warning: 'tarantool-sys/patches-applied' exists, so patching step is skipped
Finished test [unoptimized + debuginfo] target(s) in 25.47s
Running unittests src/main.rs (target/debug/deps/picodata-dbe776194ddf6817)
running 16 tests
test args::tests::test_try_parse_address ... ok
test kvcell::tests::kvcell ... ok
test traft::failover::tests::voters_needed ... ok
test traft::topology::tests::failure_domain ... ok
test traft::topology::tests::test_replication_factor ... ok
test traft::topology::tests::test_set_active ... ok
test traft::topology::tests::test_simple ... ok
test util::tests::str_eq ... ok
test util::tests::uppercase ... ok
test traft::topology::tests::reconfigure_failure_domain ... ok
test traft::topology::tests::test_instance_id_collision ... ok
test traft::topology::tests::test_override ... ok
test args::tests::test_parse ... ok
test discovery::tests::test_discovery_2 ... ok
test discovery::tests::test_discovery_1 ... ok
test discovery::tests::test_discovery_3 ... ok
test result: ok. 16 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.52s
Running test/inner.rs (target/debug/deps/inner-af41acb2e457b5bc)
total 9 tests
test test_storage2_other_state ... [0;32mok[0m
test test_storage2_conf_state ... [0;32mok[0m
test test_storage2_hard_state ... [0;32mok[0m
test test_storage2_log ... [0;32mok[0m
test test_storage2 ... [0;32mok[0m
test test_storage_peers ... [0;32mok[0m
test test_version ... [0;32mok[0m
test test_mailbox ... [0;32mok[0m
test test_traft_pool ... [0;32mok[0m
test result: [0;32mok[0m. 9 passed; 0 failed; 0 skipped; finished in 0.68s
[32;1m$ cargo fmt -- -v --check[0;m
Formatting /builds/picodata/picodata/picodata/build.rs
Spent 0.002 secs in the parsing phase, and 0.004 secs in the formatting phase
Formatting /builds/picodata/picodata/picodata/src/app.rs
Formatting /builds/picodata/picodata/picodata/src/args.rs
Formatting /builds/picodata/picodata/picodata/src/discovery.rs
Formatting /builds/picodata/picodata/picodata/src/ipc.rs
Formatting /builds/picodata/picodata/picodata/src/kvcell.rs
Formatting /builds/picodata/picodata/picodata/src/loop.rs
Formatting /builds/picodata/picodata/picodata/src/mailbox.rs
Formatting /builds/picodata/picodata/picodata/src/main.rs
Formatting /builds/picodata/picodata/picodata/src/tarantool.rs
Formatting /builds/picodata/picodata/picodata/src/tlog.rs
Formatting /builds/picodata/picodata/picodata/src/traft/error.rs
Formatting /builds/picodata/picodata/picodata/src/traft/event.rs
Formatting /builds/picodata/picodata/picodata/src/traft/failover.rs
Formatting /builds/picodata/picodata/picodata/src/traft/governor.rs
Formatting /builds/picodata/picodata/picodata/src/traft/mod.rs
Formatting /builds/picodata/picodata/picodata/src/traft/network.rs
Formatting /builds/picodata/picodata/picodata/src/traft/node.rs
Formatting /builds/picodata/picodata/picodata/src/traft/notify.rs
Formatting /builds/picodata/picodata/picodata/src/traft/raft_storage.rs
Formatting /builds/picodata/picodata/picodata/src/traft/rpc/mod.rs
Formatting /builds/picodata/picodata/picodata/src/traft/rpc/replication.rs
Formatting /builds/picodata/picodata/picodata/src/traft/rpc/sharding.rs
Formatting /builds/picodata/picodata/picodata/src/traft/rpc/sync.rs
Formatting /builds/picodata/picodata/picodata/src/traft/storage.rs
Formatting /builds/picodata/picodata/picodata/src/traft/topology.rs
Formatting /builds/picodata/picodata/picodata/src/util.rs
Spent 0.034 secs in the parsing phase, and 0.096 secs in the formatting phase
Formatting /builds/picodata/picodata/picodata/test/inner.rs
Spent 0.000 secs in the parsing phase, and 0.000 secs in the formatting phase
[32;1m$ cargo clippy --version[0;m
clippy 0.1.64 (a55dd71 2022-09-19)
[32;1m$ cargo clippy -- --deny clippy::all[0;m
Checking cfg-if v1.0.0
Checking lazy_static v1.4.0
Checking byteorder v1.4.3
Checking once_cell v1.9.0
Checking bitflags v1.3.2
Checking arc-swap v1.5.0
Checking ppv-lite86 v0.2.15
Checking regex-syntax v0.6.25
Checking bytes v1.1.0
Checking take_mut v0.2.2
Checking static_assertions v1.1.0
Checking cpufeatures v0.2.1
Checking itoa v1.0.1
Checking ryu v1.0.9
Checking os_str_bytes v6.0.0
Checking opaque-debug v0.3.0
Checking hashbrown v0.11.2
Checking refpool v0.4.3
Checking textwrap v0.15.0
Checking remove_dir_all v0.5.3
Checking either v1.6.1
Checking strsim v0.10.0
Checking va_list v0.1.3
Checking base64 v0.13.0
Checking uuid v0.8.2
Checking termcolor v1.1.3
Checking thread_local v1.1.3
Checking fxhash v0.2.1
Checking clap_lex v0.1.1
Checking itertools v0.10.3
Checking libc v0.2.126
Checking memchr v2.4.1
Checking typenum v1.14.0
Checking protobuf v2.27.1
Checking slog v2.7.0
Compiling picodata v22.7.0 (/builds/picodata/picodata/picodata)
Checking crossbeam-utils v0.8.5
Checking log v0.4.14
Checking num-traits v0.2.14
Checking memoffset v0.6.5
Checking indexmap v1.8.1
Checking slog-scope v4.4.0
Checking crossbeam-channel v0.5.1
Checking aho-corasick v0.7.18
Checking generic-array v0.14.4
Checking slog-stdlog v4.1.0
Checking num-integer v0.1.44
Checking rmp v0.8.10
Checking slog-async v2.7.0
Checking serde v1.0.133
Checking thiserror v1.0.30
Checking inventory v0.2.1
Checking getrandom v0.2.3
Checking dirs-sys-next v0.1.2
Checking atty v0.2.14
Checking time v0.1.43
Checking decnumber-sys v0.1.5
Checking nix v0.24.1
Checking nix v0.23.1
Checking errno v0.2.8
Checking dlopen v0.1.8
Checking block-buffer v0.10.2
Checking crypto-common v0.1.3
Checking digest v0.9.0
Checking block-buffer v0.9.0
Checking regex v1.5.4
Checking dirs-next v2.0.0
Checking rand_core v0.6.3
Checking clap v3.1.12
Checking dec v0.4.8
Checking chrono v0.4.19
Checking digest v0.10.3
Checking sha-1 v0.9.8
Checking term v0.7.0
Checking rand_chacha v0.3.1
Checking raft-proto v0.6.0
Checking md-5 v0.10.1
Checking slog-term v2.8.0
Checking rand v0.8.5
Checking uuid v1.0.0
Checking slog-envlogger v2.2.0
Checking serde_bytes v0.11.5
Checking serde_json v1.0.73
Checking rmp-serde v1.0.0
Checking tlua v0.6.3 (/builds/picodata/picodata/picodata/tarantool/tlua)
Checking rmpv v1.0.0
Checking raft v0.6.0
Checking tempfile v3.2.0
warning: 'tarantool-sys/patches-applied' exists, so patching step is skipped
Checking tarantool v0.6.4 (/builds/picodata/picodata/picodata/tarantool/tarantool)
Finished dev [unoptimized + debuginfo] target(s) in 18.86s
[32;1m$ PIPENV_VENV_IN_PROJECT=1 PIP_NO_CACHE_DIR=true python3.10 -m pipenv install --deploy[0;m
Warning: the environment variable LANG is not set!
We recommend setting this in ~/.profile (or equivalent) for proper expected behavior.
Creating a virtualenv for this project...
Pipfile: /builds/picodata/picodata/picodata/Pipfile
Using /usr/local/bin/python3.10 (3.10.6) to create virtualenv...
created virtual environment CPython3.10.6.final.0-64 in 534ms
creator CPython3Posix(dest=/builds/picodata/picodata/picodata/.venv, clear=False, no_vcs_ignore=False, global=False)
seeder FromAppData(download=False, pip=bundle, setuptools=bundle, wheel=bundle, via=copy, app_data_dir=/root/.local/share/virtualenv)
added seed packages: pip==22.0.4, setuptools==62.1.0, wheel==0.37.1
activators BashActivator,CShellActivator,FishActivator,NushellActivator,PowerShellActivator,PythonActivator
Successfully created virtual environment!
Virtualenv location: /builds/picodata/picodata/picodata/.venv
Installing dependencies from Pipfile.lock (64cf42)...
[32;1m$ pipenv run pytest --numprocesses 2 -v[0;m
============================= test session starts ==============================
platform linux -- Python 3.10.6, pytest-7.1.3, pluggy-1.0.0 -- /builds/picodata/picodata/picodata/.venv/bin/python
cachedir: .pytest_cache
rootdir: /builds/picodata/picodata/picodata, configfile: pytest.ini, testpaths: test/int
plugins: harvest-1.10.4, clarity-1.0.1, forked-1.4.0, xdist-2.5.0
gw0 I / gw1 I
[gw0] linux Python 3.10.6 cwd: /builds/picodata/picodata/picodata
[gw1] linux Python 3.10.6 cwd: /builds/picodata/picodata/picodata
[gw0] Python 3.10.6 (main, Oct 21 2022, 14:27:30) [GCC 7.3.1 20180303 (Red Hat 7.3.1-5)]
[gw1] Python 3.10.6 (main, Oct 21 2022, 14:27:30) [GCC 7.3.1 20180303 (Red Hat 7.3.1-5)]
gw0 [36] / gw1 [36]
scheduling tests via LoadScheduling
test/int/test_basics.py::test_call_normalization
test/int/test_basics.py::test_eval_normalization
[gw1] [ 2%] PASSED test/int/test_basics.py::test_eval_normalization
test/int/test_basics.py::test_propose_eval
[gw0] [ 5%] PASSED test/int/test_basics.py::test_call_normalization
test/int/test_basics.py::test_process_management
[gw1] [ 8%] PASSED test/int/test_basics.py::test_propose_eval
test/int/test_basics.py::test_whoami
[gw0] [ 11%] PASSED test/int/test_basics.py::test_process_management
test/int/test_basics.py::test_graceful_stop
[gw1] [ 13%] PASSED test/int/test_basics.py::test_whoami
test/int/test_couple.py::test_follower_proposal
[gw0] [ 16%] PASSED test/int/test_basics.py::test_graceful_stop
test/int/test_basics.py::test_peer_info
[gw0] [ 19%] PASSED test/int/test_basics.py::test_peer_info
test/int/test_couple.py::test_switchover
[gw1] [ 22%] PASSED test/int/test_couple.py::test_follower_proposal
test/int/test_couple.py::test_failover
[gw1] [ 25%] PASSED test/int/test_couple.py::test_failover
test/int/test_couple.py::test_restart_follower
[gw0] [ 27%] PASSED test/int/test_couple.py::test_switchover
test/int/test_couple.py::test_gl119_panic_in_on_shutdown
[gw0] [ 30%] PASSED test/int/test_couple.py::test_gl119_panic_in_on_shutdown
test/int/test_couple.py::test_gl127_graceul_shutdown
[gw1] [ 33%] PASSED test/int/test_couple.py::test_restart_follower
test/int/test_couple.py::test_restart_leader
[gw0] [ 36%] PASSED test/int/test_couple.py::test_gl127_graceul_shutdown
test/int/test_expelling.py::test_expel_follower
[gw0] [ 38%] PASSED test/int/test_expelling.py::test_expel_follower
test/int/test_expelling.py::test_expel_leader
[gw1] [ 41%] PASSED test/int/test_couple.py::test_restart_leader
test/int/test_couple.py::test_restart_both
[gw0] [ 44%] PASSED test/int/test_expelling.py::test_expel_leader
test/int/test_expelling.py::test_expel_by_follower
[gw0] [ 47%] PASSED test/int/test_expelling.py::test_expel_by_follower
test/int/test_joining.py::test_request_follower
[gw1] [ 50%] PASSED test/int/test_couple.py::test_restart_both
test/int/test_couple.py::test_deactivation
[gw0] [ 52%] PASSED test/int/test_joining.py::test_request_follower
test/int/test_joining.py::test_discovery
[gw1] [ 55%] PASSED test/int/test_couple.py::test_deactivation
test/int/test_joining.py::test_parallel
[gw1] [ 58%] PASSED test/int/test_joining.py::test_parallel
test/int/test_joining.py::test_replication
[gw0] [ 61%] PASSED test/int/test_joining.py::test_discovery
test/int/test_joining.py::test_init_replication_factor
[gw0] [ 63%] PASSED test/int/test_joining.py::test_init_replication_factor
test/int/test_joining.py::test_cluster_id_mismatch
[gw1] [ 66%] PASSED test/int/test_joining.py::test_replication
test/int/test_joining.py::test_rebootstrap_follower
[gw0] [ 69%] PASSED test/int/test_joining.py::test_cluster_id_mismatch
test/int/test_joining.py::test_join_without_explicit_instance_id
[gw0] [ 72%] PASSED test/int/test_joining.py::test_join_without_explicit_instance_id
test/int/test_joining.py::test_reconfigure_failure_domains
[gw1] [ 75%] PASSED test/int/test_joining.py::test_rebootstrap_follower
test/int/test_joining.py::test_failure_domains
[gw0] [ 77%] PASSED test/int/test_joining.py::test_reconfigure_failure_domains
test/int/test_joining.py::test_fail_to_join
[gw1] [ 80%] PASSED test/int/test_joining.py::test_failure_domains
test/int/test_network_effects.py::test_log_rollback
[gw0] [ 83%] PASSED test/int/test_joining.py::test_fail_to_join
test/int/test_network_effects.py::test_leader_disruption
[gw0] [ 86%] PASSED test/int/test_network_effects.py::test_leader_disruption
test/int/test_supervisor.py::test_sigint_parent
[gw0] [ 88%] PASSED test/int/test_supervisor.py::test_sigint_parent
test/int/test_supervisor.py::test_sigsegv_child
[gw0] [ 91%] PASSED test/int/test_supervisor.py::test_sigsegv_child
test/int/test_uninitialized.py::test_raft_api
[gw0] [ 94%] PASSED test/int/test_uninitialized.py::test_raft_api
[gw1] [ 97%] ERROR test/int/test_network_effects.py::test_log_rollback
test/int/test_supervisor.py::test_instance_kill
[gw1] [100%] PASSED test/int/test_supervisor.py::test_instance_kill
==================================== ERRORS ====================================
_____________________ ERROR at setup of test_log_rollback ______________________
[gw1] linux -- Python 3.10.6 /builds/picodata/picodata/picodata/.venv/bin/python
cluster = Cluster("127.0.0.1:3500", n=3)
@pytest.fixture
def cluster3(cluster: Cluster):
> cluster.deploy(instance_count=3)
test/int/test_network_effects.py:13:
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _
test/conftest.py:500: in deploy
instance.wait_online()
.venv/lib/python3.10/site-packages/funcy/decorators.py:45: in wrapper
return deco(call, *dargs, **dkwargs)
.venv/lib/python3.10/site-packages/funcy/flow.py:127: in retry
return call()
.venv/lib/python3.10/site-packages/funcy/decorators.py:66: in __call__
return self._func(*self._args, **self._kwargs)
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _
self = Instance(i1, listen=127.0.0.1:3501)
@funcy.retry(tries=30, timeout=0.5)
def wait_online(self):
"""Wait until instance attains Online grade
Raises:
AssertionError: if doesn't succeed
"""
whoami = self.call("picolib.whoami")
assert isinstance(whoami, dict)
assert isinstance(whoami["raft_id"], int)
assert isinstance(whoami["instance_id"], str)
self.raft_id = whoami["raft_id"]
self.instance_id = whoami["instance_id"]
myself = self.call("picolib.peer_info", self.instance_id)
assert isinstance(myself, dict)
> assert myself["current_grade"] == "Online"
E assert == failed. [pytest-clarity diff shown]
E [0m
E [0m[32mLHS[0m vs [31mRHS[0m shown below
E [0m
E [0m[32mReplicated[0m
E [0m[31mOnline[0m
E [0m
test/conftest.py:436: AssertionError
---------------------------- Captured stdout setup -----------------------------
i2 | [supervisor:54537] running StartDiscover
i1 | [supervisor:54534] running StartDiscover
i3 | [supervisor:54540] running StartDiscover
i1 | [supervisor:54534] ipc message from child: Some(IpcMessage { next_entrypoint: StartBoot, drop_db: true })
i1 | [supervisor:54534] subprocess finished: Exited(Pid(54545), 0)
i1 | [supervisor] removing file: /tmp/pytest-of-root/pytest-0/popen-gw1/test_log_rollback0/i1/00000000000000000000.snap
i1 | [supervisor] removing file: /tmp/pytest-of-root/pytest-0/popen-gw1/test_log_rollback0/i1/00000000000000000000.xlog
i1 | [supervisor:54534] running StartBoot
i3 | [supervisor:54540] ipc message from child: Some(IpcMessage { next_entrypoint: StartJoin { leader_address: "127.0.0.1:3501" }, drop_db: true })
i2 | [supervisor:54537] ipc message from child: Some(IpcMessage { next_entrypoint: StartJoin { leader_address: "127.0.0.1:3501" }, drop_db: true })
i2 | [supervisor:54537] subprocess finished: Exited(Pid(54544), 0)
i3 | [supervisor:54540] subprocess finished: Exited(Pid(54546), 0)
i3 | [supervisor] removing file: /tmp/pytest-of-root/pytest-0/popen-gw1/test_log_rollback0/i3/00000000000000000000.snap
i3 | [supervisor] removing file: /tmp/pytest-of-root/pytest-0/popen-gw1/test_log_rollback0/i3/00000000000000000000.xlog
i3 | [supervisor:54540] running StartJoin { leader_address: "127.0.0.1:3501" }
i2 | [supervisor] removing file: /tmp/pytest-of-root/pytest-0/popen-gw1/test_log_rollback0/i2/00000000000000000000.snap
i2 | [supervisor] removing file: /tmp/pytest-of-root/pytest-0/popen-gw1/test_log_rollback0/i2/00000000000000000000.xlog
i2 | [supervisor:54537] running StartJoin { leader_address: "127.0.0.1:3501" }
---------------------------- Captured stderr setup -----------------------------
Instance(i1, listen=127.0.0.1:3501) starting...
Instance(i2, listen=127.0.0.1:3502) starting...
Instance(i3, listen=127.0.0.1:3503) starting...
i2 | >>>>> start_discover()
i1 | >>>>> start_discover()
i2 | 2022-10-27 14:01:55.641 [54544] main/103/interactive I> Tarantool 2.10.0-29-g1ec2a9d
i2 | 2022-10-27 14:01:55.641 [54544] main/103/interactive I> log level 6
i2 | 2022-10-27 14:01:55.642 [54544] main/103/interactive I> wal/engine cleanup is paused
i2 | 2022-10-27 14:01:55.642 [54544] main/103/interactive I> mapping 33554432 bytes for memtx tuple arena...
i2 | 2022-10-27 14:01:55.642 [54544] main/103/interactive I> Actual slab_alloc_factor calculated on the basis of desired slab_alloc_factor = 1.044274
i2 | 2022-10-27 14:01:55.642 [54544] main/103/interactive I> mapping 134217728 bytes for vinyl tuple arena...
i1 | 2022-10-27 14:01:55.642 [54545] main/103/interactive I> Tarantool 2.10.0-29-g1ec2a9d
i1 | 2022-10-27 14:01:55.643 [54545] main/103/interactive I> log level 6
i1 | 2022-10-27 14:01:55.643 [54545] main/103/interactive I> wal/engine cleanup is paused
i1 | 2022-10-27 14:01:55.643 [54545] main/103/interactive I> mapping 33554432 bytes for memtx tuple arena...
i1 | 2022-10-27 14:01:55.643 [54545] main/103/interactive I> Actual slab_alloc_factor calculated on the basis of desired slab_alloc_factor = 1.044274
i1 | 2022-10-27 14:01:55.643 [54545] main/103/interactive I> mapping 134217728 bytes for vinyl tuple arena...
i2 | 2022-10-27 14:01:55.644 [54544] main/103/interactive I> update replication_synchro_quorum = 1
i2 | 2022-10-27 14:01:55.644 [54544] main/103/interactive I> instance uuid 4952f082-4a53-4119-9bbd-df021d8de3fc
i2 | 2022-10-27 14:01:55.644 [54544] main/103/interactive I> initializing an empty data directory
i1 | 2022-10-27 14:01:55.645 [54545] main/103/interactive I> update replication_synchro_quorum = 1
i1 | 2022-10-27 14:01:55.645 [54545] main/103/interactive I> instance uuid 981d6be3-767b-4e0f-ab5e-1a1951f1da9a
i1 | 2022-10-27 14:01:55.645 [54545] main/103/interactive I> initializing an empty data directory
i3 | >>>>> start_discover()
i3 | 2022-10-27 14:01:55.647 [54546] main/103/interactive I> Tarantool 2.10.0-29-g1ec2a9d
i3 | 2022-10-27 14:01:55.647 [54546] main/103/interactive I> log level 6
i3 | 2022-10-27 14:01:55.647 [54546] main/103/interactive I> wal/engine cleanup is paused
i3 | 2022-10-27 14:01:55.647 [54546] main/103/interactive I> mapping 33554432 bytes for memtx tuple arena...
i3 | 2022-10-27 14:01:55.647 [54546] main/103/interactive I> Actual slab_alloc_factor calculated on the basis of desired slab_alloc_factor = 1.044274
i3 | 2022-10-27 14:01:55.647 [54546] main/103/interactive I> mapping 134217728 bytes for vinyl tuple arena...
i3 | 2022-10-27 14:01:55.649 [54546] main/103/interactive I> update replication_synchro_quorum = 1
i3 | 2022-10-27 14:01:55.649 [54546] main/103/interactive I> instance uuid dca74876-7a83-4019-ad51-2ca974efc4cb
i3 | 2022-10-27 14:01:55.649 [54546] main/103/interactive I> initializing an empty data directory
i2 | 2022-10-27 14:01:55.651 [54544] main/103/interactive V> RAFT: recover {term: 1}
i2 | 2022-10-27 14:01:55.651 [54544] main/103/interactive I> assigned id 1 to replica 4952f082-4a53-4119-9bbd-df021d8de3fc
i2 | 2022-10-27 14:01:55.651 [54544] main/103/interactive I> update replication_synchro_quorum = 1
i2 | 2022-10-27 14:01:55.651 [54544] main/103/interactive I> cluster uuid b6d523bd-b15e-4dcd-af85-4002a5d9554a
i2 | 2022-10-27 14:01:55.652 [54544] snapshot/101/main I> saving snapshot `/tmp/pytest-of-root/pytest-0/popen-gw1/test_log_rollback0/i2/00000000000000000000.snap.inprogress'
i1 | 2022-10-27 14:01:55.651 [54545] main/103/interactive V> RAFT: recover {term: 1}
i1 | 2022-10-27 14:01:55.652 [54545] main/103/interactive I> assigned id 1 to replica 981d6be3-767b-4e0f-ab5e-1a1951f1da9a
i1 | 2022-10-27 14:01:55.652 [54545] main/103/interactive I> update replication_synchro_quorum = 1
i1 | 2022-10-27 14:01:55.652 [54545] main/103/interactive I> cluster uuid f59009dc-9553-470f-bbee-b6596c499aa3
i1 | 2022-10-27 14:01:55.652 [54545] snapshot/101/main I> saving snapshot `/tmp/pytest-of-root/pytest-0/popen-gw1/test_log_rollback0/i1/00000000000000000000.snap.inprogress'
i3 | 2022-10-27 14:01:55.656 [54546] main/103/interactive V> RAFT: recover {term: 1}
i3 | 2022-10-27 14:01:55.656 [54546] main/103/interactive I> assigned id 1 to replica dca74876-7a83-4019-ad51-2ca974efc4cb
i3 | 2022-10-27 14:01:55.656 [54546] main/103/interactive I> update replication_synchro_quorum = 1
i3 | 2022-10-27 14:01:55.656 [54546] main/103/interactive I> cluster uuid 3487c5c3-8d5b-4fdf-aa25-9045e18fe693
i3 | 2022-10-27 14:01:55.657 [54546] snapshot/101/main I> saving snapshot `/tmp/pytest-of-root/pytest-0/popen-gw1/test_log_rollback0/i3/00000000000000000000.snap.inprogress'
i1 | 2022-10-27 14:01:55.768 [54545] snapshot/101/main I> done
i3 | 2022-10-27 14:01:55.768 [54546] snapshot/101/main I> done
i1 | 2022-10-27 14:01:55.769 [54545] main/103/interactive I> RAFT: fencing enabled
i1 | 2022-10-27 14:01:55.769 [54545] main/103/interactive I> RAFT: start state machine
i1 | 2022-10-27 14:01:55.769 [54545] main/103/interactive I> ready to accept requests
i1 | 2022-10-27 14:01:55.769 [54545] main/103/interactive I> RAFT: bump term to 2, follow
i1 | 2022-10-27 14:01:55.769 [54545] main/105/gc I> wal/engine cleanup is resumed
i3 | 2022-10-27 14:01:55.769 [54546] main/103/interactive I> RAFT: fencing enabled
i3 | 2022-10-27 14:01:55.769 [54546] main/103/interactive I> RAFT: start state machine
i3 | 2022-10-27 14:01:55.769 [54546] main/103/interactive I> ready to accept requests
i1 | 2022-10-27 14:01:55.769 [54545] main/111/raft_worker I> RAFT: persisted state {term: 2}
i1 | 2022-10-27 14:01:55.769 [54545] main/111/raft_worker I> RAFT: vote for 1, follow
i2 | 2022-10-27 14:01:55.768 [54544] snapshot/101/main I> done
i2 | 2022-10-27 14:01:55.769 [54544] main/103/interactive I> RAFT: fencing enabled
i2 | 2022-10-27 14:01:55.769 [54544] main/103/interactive I> RAFT: start state machine
i2 | 2022-10-27 14:01:55.769 [54544] main/103/interactive I> ready to accept requests
i2 | 2022-10-27 14:01:55.769 [54544] main/103/interactive I> RAFT: bump term to 2, follow
i2 | 2022-10-27 14:01:55.769 [54544] main/105/gc I> wal/engine cleanup is resumed
i2 | 2022-10-27 14:01:55.769 [54544] main/111/raft_worker I> RAFT: persisted state {term: 2}
i2 | 2022-10-27 14:01:55.769 [54544] main/111/raft_worker I> RAFT: vote for 1, follow
i2 | 2022-10-27 14:01:55.769 [54544] main/111/raft_worker I> RAFT: persisted state {term: 2, vote: 1}
i1 | 2022-10-27 14:01:55.770 [54545] main/111/raft_worker I> RAFT: persisted state {term: 2, vote: 1}
i2 | 2022-10-27 14:01:55.769 [54544] main/111/raft_worker I> RAFT: enter leader state with quorum 1
i2 | 2022-10-27 14:01:55.769 [54544] main/103/interactive V> feedback_daemon stopped
i2 | 2022-10-27 14:01:55.769 [54544] main/103/interactive V> feedback_daemon stopped
i2 | 2022-10-27 14:01:55.769 [54544] main/103/interactive V> feedback_daemon started
i2 | 2022-10-27 14:01:55.769 [54544] main/103/interactive I> set 'log_level' configuration option to 6
i2 | 2022-10-27 14:01:55.769 [54544] main/103/interactive V> feedback_daemon stopped
i2 | 2022-10-27 14:01:55.769 [54544] main/103/interactive V> feedback_daemon stopped
i2 | 2022-10-27 14:01:55.769 [54544] main/103/interactive V> feedback_daemon started
i2 | 2022-10-27 14:01:55.769 [54544] main/103/interactive I> set 'election_mode' configuration option to "manual"
i2 | 2022-10-27 14:01:55.769 [54544] main/103/interactive V> feedback_daemon stopped
i2 | 2022-10-27 14:01:55.769 [54544] main/103/interactive V> feedback_daemon stopped
i2 | 2022-10-27 14:01:55.769 [54544] main/103/interactive V> feedback_daemon started
i2 | 2022-10-27 14:01:55.769 [54544] main/103/interactive I> set 'feedback_enabled' configuration option to false
i2 | 2022-10-27 14:01:55.769 [54544] main/103/interactive I> set 'log_format' configuration option to "plain"
i2 | 2022-10-27 14:01:55.769 [54544] main/103/interactive I> set 'memtx_memory' configuration option to 33554432
i2 | 2022-10-27 14:01:55.769 [54544] main/103/interactive V> feedback_daemon stopped
i2 | 2022-10-27 14:01:55.769 [54544] main/103/interactive V> feedback_daemon stopped
i2 | 2022-10-27 14:01:55.769 [54544] main/103/interactive V> feedback_daemon started
i3 | 2022-10-27 14:01:55.769 [54546] main/103/interactive I> RAFT: bump term to 2, follow
i3 | 2022-10-27 14:01:55.769 [54546] main/105/gc I> wal/engine cleanup is resumed
i3 | 2022-10-27 14:01:55.770 [54546] main/111/raft_worker I> RAFT: persisted state {term: 2}
i3 | 2022-10-27 14:01:55.770 [54546] main/111/raft_worker I> RAFT: vote for 1, follow
i2 | 2022-10-27 14:01:55.769 [54544] main/103/interactive I> set 'replication_connect_quorum' configuration option to 32
i2 | 2022-10-27 14:01:55.769 [54544] main/103/interactive I> set 'replication' configuration option to []
i2 | 2022-10-27 14:01:55.769 [54544] main/106/checkpoint_daemon I> scheduled next checkpoint for Thu Oct 27 15:49:24 2022
i3 | 2022-10-27 14:01:55.770 [54546] main/111/raft_worker I> RAFT: persisted state {term: 2, vote: 1}
i3 | 2022-10-27 14:01:55.770 [54546] main/111/raft_worker I> RAFT: enter leader state with quorum 1
i3 | 2022-10-27 14:01:55.770 [54546] main/103/interactive V> feedback_daemon stopped
i3 | 2022-10-27 14:01:55.770 [54546] main/103/interactive V> feedback_daemon stopped
i3 | 2022-10-27 14:01:55.770 [54546] main/103/interactive V> feedback_daemon started
i3 | 2022-10-27 14:01:55.770 [54546] main/103/interactive I> set 'log_level' configuration option to 6
i3 | 2022-10-27 14:01:55.770 [54546] main/103/interactive V> feedback_daemon stopped
i3 | 2022-10-27 14:01:55.770 [54546] main/103/interactive V> feedback_daemon stopped
i3 | 2022-10-27 14:01:55.770 [54546] main/103/interactive V> feedback_daemon started
i3 | 2022-10-27 14:01:55.770 [54546] main/103/interactive I> set 'election_mode' configuration option to "manual"
i3 | 2022-10-27 14:01:55.770 [54546] main/103/interactive V> feedback_daemon stopped
i3 | 2022-10-27 14:01:55.770 [54546] main/103/interactive V> feedback_daemon stopped
i3 | 2022-10-27 14:01:55.770 [54546] main/103/interactive V> feedback_daemon started
i3 | 2022-10-27 14:01:55.770 [54546] main/103/interactive I> set 'feedback_enabled' configuration option to false
i1 | 2022-10-27 14:01:55.770 [54545] main/111/raft_worker I> RAFT: enter leader state with quorum 1
i3 | 2022-10-27 14:01:55.770 [54546] main/103/interactive I> set 'log_format' configuration option to "plain"
i3 | 2022-10-27 14:01:55.770 [54546] main/103/interactive I> set 'memtx_memory' configuration option to 33554432
i1 | 2022-10-27 14:01:55.770 [54545] main/103/interactive V> feedback_daemon stopped
i1 | 2022-10-27 14:01:55.770 [54545] main/103/interactive V> feedback_daemon stopped
i3 | 2022-10-27 14:01:55.770 [54546] main/103/interactive V> feedback_daemon stopped
i3 | 2022-10-27 14:01:55.770 [54546] main/103/interactive V> feedback_daemon stopped
i3 | 2022-10-27 14:01:55.770 [54546] main/103/interactive V> feedback_daemon started
i3 | 2022-10-27 14:01:55.770 [54546] main/103/interactive I> set 'replication_connect_quorum' configuration option to 32
i3 | 2022-10-27 14:01:55.770 [54546] main/103/interactive I> set 'replication' configuration option to []
i3 | 2022-10-27 14:01:55.770 [54546] main/106/checkpoint_daemon I> scheduled next checkpoint for Thu Oct 27 15:28:40 2022
i1 | 2022-10-27 14:01:55.770 [54545] main/103/interactive V> feedback_daemon started
i1 | 2022-10-27 14:01:55.770 [54545] main/103/interactive I> set 'log_level' configuration option to 6
i1 | 2022-10-27 14:01:55.770 [54545] main/103/interactive V> feedback_daemon stopped
i1 | 2022-10-27 14:01:55.770 [54545] main/103/interactive V> feedback_daemon stopped
i1 | 2022-10-27 14:01:55.770 [54545] main/103/interactive V> feedback_daemon started
i1 | 2022-10-27 14:01:55.770 [54545] main/103/interactive I> set 'election_mode' configuration option to "manual"
i1 | 2022-10-27 14:01:55.770 [54545] main/103/interactive V> feedback_daemon stopped
i1 | 2022-10-27 14:01:55.770 [54545] main/103/interactive V> feedback_daemon stopped
i1 | 2022-10-27 14:01:55.770 [54545] main/103/interactive V> feedback_daemon started
i1 | 2022-10-27 14:01:55.770 [54545] main/103/interactive I> set 'feedback_enabled' configuration option to false
i1 | 2022-10-27 14:01:55.770 [54545] main/103/interactive I> set 'log_format' configuration option to "plain"
i1 | 2022-10-27 14:01:55.770 [54545] main/103/interactive I> set 'memtx_memory' configuration option to 33554432
i1 | 2022-10-27 14:01:55.770 [54545] main/103/interactive V> feedback_daemon stopped
i1 | 2022-10-27 14:01:55.770 [54545] main/103/interactive V> feedback_daemon stopped
i1 | 2022-10-27 14:01:55.770 [54545] main/103/interactive V> feedback_daemon started
i1 | 2022-10-27 14:01:55.770 [54545] main/103/interactive I> set 'replication_connect_quorum' configuration option to 32
i1 | 2022-10-27 14:01:55.770 [54545] main/103/interactive I> set 'replication' configuration option to []
i1 | 2022-10-27 14:01:55.770 [54545] main/106/checkpoint_daemon I> scheduled next checkpoint for Thu Oct 27 15:51:47 2022
i2 | 2022-10-27 14:01:55.781 [54544] main/103/interactive I> tx_binary: bound to 127.0.0.1:3502
i2 | 2022-10-27 14:01:55.782 [54544] main/103/interactive I> set 'listen' configuration option to "127.0.0.1:3502"
i3 | 2022-10-27 14:01:55.782 [54546] main/103/interactive I> tx_binary: bound to 127.0.0.1:3503
i3 | 2022-10-27 14:01:55.782 [54546] main/103/interactive I> set 'listen' configuration option to "127.0.0.1:3503"
i2 | 2022-10-27 14:01:55.782 [54544] main/103/interactive tarantool.rs:296 W> net_box_call failed: IO error: Connection refused (os error 111), fn: .proc_discover, peer: 127.0.0.1:3501
i3 | 2022-10-27 14:01:55.783 [54546] main/103/interactive tarantool.rs:296 W> net_box_call failed: IO error: Connection refused (os error 111), fn: .proc_discover, peer: 127.0.0.1:3501
i1 | 2022-10-27 14:01:55.783 [54545] main/103/interactive I> tx_binary: bound to 127.0.0.1:3501
i1 | 2022-10-27 14:01:55.783 [54545] main/103/interactive I> set 'listen' configuration option to "127.0.0.1:3501"
i1 | >>>>> start_boot()
i1 | 2022-10-27 14:01:56.032 [54570] main/103/interactive I> Tarantool 2.10.0-29-g1ec2a9d
i1 | 2022-10-27 14:01:56.032 [54570] main/103/interactive I> log level 6
i1 | 2022-10-27 14:01:56.032 [54570] main/103/interactive I> wal/engine cleanup is paused
i1 | 2022-10-27 14:01:56.032 [54570] main/103/interactive I> mapping 33554432 bytes for memtx tuple arena...
i1 | 2022-10-27 14:01:56.032 [54570] main/103/interactive I> Actual slab_alloc_factor calculated on the basis of desired slab_alloc_factor = 1.044274
i1 | 2022-10-27 14:01:56.032 [54570] main/103/interactive I> mapping 134217728 bytes for vinyl tuple arena...
i1 | 2022-10-27 14:01:56.034 [54570] main/103/interactive I> update replication_synchro_quorum = 1
i1 | 2022-10-27 14:01:56.035 [54570] main/103/interactive I> instance uuid 68d4a766-4144-3248-aeb4-e212356716e4
i1 | 2022-10-27 14:01:56.035 [54570] main/103/interactive I> initializing an empty data directory
i1 | 2022-10-27 14:01:56.041 [54570] main/103/interactive V> RAFT: recover {term: 1}
i1 | 2022-10-27 14:01:56.041 [54570] main/103/interactive I> assigned id 1 to replica 68d4a766-4144-3248-aeb4-e212356716e4
i1 | 2022-10-27 14:01:56.042 [54570] main/103/interactive I> update replication_synchro_quorum = 1
i1 | 2022-10-27 14:01:56.042 [54570] main/103/interactive I> cluster uuid e0df68c5-e7f9-395f-86b3-30ad9e1b7b07
i1 | 2022-10-27 14:01:56.042 [54570] snapshot/101/main I> saving snapshot `/tmp/pytest-of-root/pytest-0/popen-gw1/test_log_rollback0/i1/00000000000000000000.snap.inprogress'
i1 | 2022-10-27 14:01:56.309 [54570] snapshot/101/main I> done
i1 | 2022-10-27 14:01:56.310 [54570] main/103/interactive I> RAFT: fencing enabled
i1 | 2022-10-27 14:01:56.310 [54570] main/103/interactive I> RAFT: start state machine
i1 | 2022-10-27 14:01:56.310 [54570] main/103/interactive I> ready to accept requests
i1 | 2022-10-27 14:01:56.310 [54570] main/103/interactive I> RAFT: bump term to 2, follow
i1 | 2022-10-27 14:01:56.310 [54570] main/105/gc I> wal/engine cleanup is resumed
i1 | 2022-10-27 14:01:56.310 [54570] main/111/raft_worker I> RAFT: persisted state {term: 2}
i1 | 2022-10-27 14:01:56.310 [54570] main/111/raft_worker I> RAFT: vote for 1, follow
i1 | 2022-10-27 14:01:56.310 [54570] main/111/raft_worker I> RAFT: persisted state {term: 2, vote: 1}
i1 | 2022-10-27 14:01:56.310 [54570] main/111/raft_worker I> RAFT: enter leader state with quorum 1
i1 | 2022-10-27 14:01:56.311 [54570] main/103/interactive V> feedback_daemon stopped
i1 | 2022-10-27 14:01:56.311 [54570] main/103/interactive V> feedback_daemon stopped
i1 | 2022-10-27 14:01:56.311 [54570] main/103/interactive V> feedback_daemon started
i1 | 2022-10-27 14:01:56.311 [54570] main/103/interactive I> set 'log_level' configuration option to 6
i1 | 2022-10-27 14:01:56.311 [54570] main/103/interactive V> feedback_daemon stopped
i1 | 2022-10-27 14:01:56.311 [54570] main/103/interactive V> feedback_daemon stopped
i1 | 2022-10-27 14:01:56.311 [54570] main/103/interactive V> feedback_daemon started
i1 | 2022-10-27 14:01:56.311 [54570] main/103/interactive I> set 'election_mode' configuration option to "manual"
i1 | 2022-10-27 14:01:56.311 [54570] main/103/interactive V> feedback_daemon stopped
i1 | 2022-10-27 14:01:56.311 [54570] main/103/interactive V> feedback_daemon stopped
i1 | 2022-10-27 14:01:56.311 [54570] main/103/interactive V> feedback_daemon started
i1 | 2022-10-27 14:01:56.311 [54570] main/103/interactive I> set 'feedback_enabled' configuration option to false
i1 | 2022-10-27 14:01:56.311 [54570] main/103/interactive I> set 'log_format' configuration option to "plain"
i1 | 2022-10-27 14:01:56.311 [54570] main/103/interactive I> set 'memtx_memory' configuration option to 33554432
i1 | 2022-10-27 14:01:56.311 [54570] main/103/interactive I> set 'instance_uuid' configuration option to "68d4a766-4144-3248-aeb4-e212356716e4"
i1 | 2022-10-27 14:01:56.311 [54570] main/103/interactive V> feedback_daemon stopped
i1 | 2022-10-27 14:01:56.311 [54570] main/103/interactive V> feedback_daemon stopped
i1 | 2022-10-27 14:01:56.311 [54570] main/103/interactive V> feedback_daemon started
i1 | 2022-10-27 14:01:56.311 [54570] main/103/interactive I> set 'replication_connect_quorum' configuration option to 32
i1 | 2022-10-27 14:01:56.311 [54570] main/103/interactive I> set 'replication' configuration option to []
i1 | 2022-10-27 14:01:56.311 [54570] main/106/checkpoint_daemon I> scheduled next checkpoint for Thu Oct 27 15:22:09 2022
i1 | 2022-10-27 14:01:56.311 [54570] main/103/interactive I> set 'replicaset_uuid' configuration option to "e0df68c5-e7f9-395f-86b3-30ad9e1b7b07"
i1 | 2022-10-27 14:01:56.323 [54570] main/103/interactive I> >>>>> postjoin()
i1 | 2022-10-27 14:01:56.324 [54570] main/103/interactive I> leaving orphan mode
i1 | 2022-10-27 14:01:56.324 [54570] main/103/interactive I> set 'replication_connect_quorum' configuration option to 0
i1 | 2022-10-27 14:01:56.324 [54570] main/103/interactive I> switched to configuration, config: Configuration { voters: Configuration { incoming: Configuration { voters: {1} }, outgoing: Configuration { voters: {} } }, learners: {}, learners_next: {}, auto_leave: false }, raft_id: 1
i1 | 2022-10-27 14:01:56.324 [54570] main/103/interactive V> reset election timeout 0 -> 30 at 0, election_elapsed: 0, timeout: 30, prev_timeout: 0, raft_id: 1
i1 | 2022-10-27 14:01:56.324 [54570] main/103/interactive I> became follower at term 1, term: 1, raft_id: 1
i1 | 2022-10-27 14:01:56.324 [54570] main/103/interactive I> newRaft, peers: Configuration { incoming: Configuration { voters: {1} }, outgoing: Configuration { voters: {} } }, last term: 1, last index: 4, applied: 0, commit: 4, term: 1, raft_id: 1
i1 | 2022-10-27 14:01:56.325 [54570] main/103/interactive I> RawNode created with id 1., id: 1, raft_id: 1
i1 | 2022-10-27 14:01:56.325 [54570] main/112/raft_main_loop I> switched to configuration, config: Configuration { voters: Configuration { incoming: Configuration { voters: {1} }, outgoing: Configuration { voters: {} } }, learners: {}, learners_next: {}, auto_leave: false }, raft_id: 1
i1 | 2022-10-27 14:01:56.325 [54570] main/112/raft_main_loop V> broadcast, event: raft.entry-applied
i1 | 2022-10-27 14:01:56.326 [54570] main/103/interactive I> this is the only voter in cluster, triggering election immediately
i1 | 2022-10-27 14:01:56.326 [54570] main/103/interactive V> mutex was locked at src/traft/node.rs:877:44
i1 | 2022-10-27 14:01:56.326 [54570] main/112/raft_main_loop V> broadcast, event: raft.topology-changed
i1 | 2022-10-27 14:01:56.326 [54570] main/103/interactive I> starting a new election, term: 1, raft_id: 1
i1 | 2022-10-27 14:01:56.326 [54570] main/103/interactive I> became pre-candidate at term 1, term: 1, raft_id: 1
i1 | 2022-10-27 14:01:56.326 [54570] main/103/interactive V> reset election timeout 30 -> 36 at 2, election_elapsed: 2, timeout: 36, prev_timeout: 30, raft_id: 1
i1 | 2022-10-27 14:01:56.326 [54570] main/103/interactive I> became candidate at term 2, term: 2, raft_id: 1
i1 | 2022-10-27 14:01:56.326 [54570] main/103/interactive V> reset election timeout 36 -> 23 at 0, election_elapsed: 0, timeout: 23, prev_timeout: 36, raft_id: 1
i1 | 2022-10-27 14:01:56.328 [54570] main/103/interactive I> became leader at term 2, term: 2, raft_id: 1
i1 | 2022-10-27 14:01:56.328 [54570] main/112/raft_main_loop V> broadcast, event: raft.status-changed
i1 | 2022-10-27 14:01:56.328 [54570] main/103/interactive I> tx_binary: bound to 127.0.0.1:3501
i1 | 2022-10-27 14:01:56.328 [54570] main/112/raft_main_loop V> persisted index 5, raft_id: 1
i1 | 2022-10-27 14:01:56.328 [54570] main/112/raft_main_loop V> committing index 5, index: 5, raft_id: 1
i1 | 2022-10-27 14:01:56.329 [54570] main/112/raft_main_loop V> broadcast, event: raft.entry-applied
i1 | 2022-10-27 14:01:56.329 [54570] main/103/interactive I> set 'listen' configuration option to "127.0.0.1:3501"
i1 | 2022-10-27 14:01:56.329 [54570] main/103/interactive V> Getting a read barrier...
i1 | 2022-10-27 14:01:56.329 [54570] main/103/interactive I> Read barrier aquired, raft is ready
i1 | 2022-10-27 14:01:56.329 [54570] main/103/interactive I> initiating self-activation of i1
i1 | 2022-10-27 14:01:56.331 [54570] main/112/raft_main_loop V> persisted index 6, raft_id: 1
i1 | 2022-10-27 14:01:56.331 [54570] main/112/raft_main_loop V> committing index 6, index: 6, raft_id: 1
i1 | 2022-10-27 14:01:56.331 [54570] main/112/raft_main_loop V> broadcast, event: raft.entry-applied
i1 | 2022-10-27 14:01:56.331 [54570] main/112/raft_main_loop V> broadcast, event: raft.topology-changed
i1 | 2022-10-27 14:01:56.331 [54570] main/116/lua V> established connection to peer, raft_id: 1, peer: 127.0.0.1:3501
i1 | 2022-10-27 14:01:56.332 [54570] main I> entering the event loop
i1 | 2022-10-27 14:01:56.332 [54570] main/113/raft_conf_change_loop I> peer synced, instance_id: i1, commit: 6
i1 | 2022-10-27 14:01:56.333 [54570] main/112/raft_main_loop V> persisted index 7, raft_id: 1
i1 | 2022-10-27 14:01:56.333 [54570] main/112/raft_main_loop V> committing index 7, index: 7, raft_id: 1
i1 | 2022-10-27 14:01:56.333 [54570] main/112/raft_main_loop V> broadcast, event: raft.entry-applied
i1 | 2022-10-27 14:01:56.333 [54570] main/113/raft_conf_change_loop I> raft sync processed
i1 | 2022-10-27 14:01:56.333 [54570] main/112/raft_main_loop V> broadcast, event: raft.topology-changed
i1 | 2022-10-27 14:01:56.334 [54570] main/110/main I> connecting to 1 replicas
i1 | 2022-10-27 14:01:56.334 [54570] main/110/main C> failed to connect to 1 out of 1 replicas
i1 | 2022-10-27 14:01:56.334 [54570] main/110/main I> leaving orphan mode
i1 | 2022-10-27 14:01:56.334 [54570] main/110/main I> set 'replication' configuration option to ["127.0.0.1:3501"]
i3 | >>>>> start_join(127.0.0.1:3501)
i1 | 2022-10-27 14:01:56.335 [54570] main/113/raft_conf_change_loop I> configured replication with peer, lsn: 25, instance_id: i1
i1 | 2022-10-27 14:01:56.335 [54570] main/120/applier/127.0.0.1:3501 I> remote master 68d4a766-4144-3248-aeb4-e212356716e4 at 127.0.0.1:3501 running Tarantool 2.10.0
i1 | 2022-10-27 14:01:56.335 [54570] main/112/raft_main_loop V> persisted index 8, raft_id: 1
i1 | 2022-10-27 14:01:56.335 [54570] main/112/raft_main_loop V> committing index 8, index: 8, raft_id: 1
i1 | 2022-10-27 14:01:56.335 [54570] main/112/raft_main_loop V> broadcast, event: raft.entry-applied
i1 | 2022-10-27 14:01:56.335 [54570] main/113/raft_conf_change_loop V> mutex was locked at src/traft/node.rs:877:44
i1 | 2022-10-27 14:01:56.336 [54570] main/120/applier/127.0.0.1:3501 I> leaving orphan mode
i1 | 2022-10-27 14:01:56.336 [54570] main/110/main V> mutex was locked at src/traft/node.rs:877:44
i1 | 2022-10-27 14:01:56.336 [54570] main/112/raft_main_loop V> broadcast, event: raft.topology-changed
i2 | >>>>> start_join(127.0.0.1:3501)
i1 | 2022-10-27 14:01:56.336 [54570] main/112/raft_main_loop V> persisted index 10, raft_id: 1
i1 | 2022-10-27 14:01:56.337 [54570] main/112/raft_main_loop V> committing index 10, index: 10, raft_id: 1
i1 | 2022-10-27 14:01:56.337 [54570] main/112/raft_main_loop V> broadcast, event: raft.entry-applied
i1 | 2022-10-27 14:01:56.337 [54570] main/113/raft_conf_change_loop I> configured replication, replicaset_id: r1
i1 | 2022-10-27 14:01:56.337 [54570] main/113/raft_conf_change_loop V> mutex was locked at src/traft/node.rs:877:44
i1 | 2022-10-27 14:01:56.338 [54570] main/110/main V> mutex was locked at src/traft/node.rs:877:44
i1 | 2022-10-27 14:01:56.338 [54570] main/112/raft_main_loop V> broadcast, event: raft.topology-changed
i1 | 2022-10-27 14:01:56.338 [54570] main/113/raft_conf_change_loop V> broadcast, event: raft.joint-state-enter
i1 | 2022-10-27 14:01:56.338 [54570] main/112/raft_main_loop V> persisted index 12, raft_id: 1
i1 | 2022-10-27 14:01:56.338 [54570] main/112/raft_main_loop V> committing index 12, index: 12, raft_id: 1
i1 | 2022-10-27 14:01:56.339 [54570] main/112/raft_main_loop I> switched to configuration, config: Configuration { voters: Configuration { incoming: Configuration { voters: {2} }, outgoing: Configuration { voters: {1} } }, learners: {}, learners_next: {1}, auto_leave: true }, raft_id: 1
i1 | 2022-10-27 14:01:56.339 [54570] main/112/raft_main_loop V> Sending from 1 to 2, msg: msg_type: MsgAppend to: 2 log_term: 2 index: 11 entries {term: 2 index: 12 context: "\202\242lc\203\242id\001\243gen\001\245count\007\242op\202\244kind\254persist_peer\244peer\213\253instance_id\242i2\255instance_uuid\331$24c4ac5f-4981-3441-879c-aee1edb608a6\247raft_id\003\254peer_address\256127.0.0.1:3502\255replicaset_id\242r3\257replicaset_uuid\331$1e94f382-b6a4-3ab8-ac07-35dba02e5f0a\251is_master\302\254commit_index\014\255current_grade\247Offline\254target_grade\247Offline\256failure_domain\200"} commit: 12, to: 2, from: 1, raft_id: 1
i3 | 2022-10-27 14:01:56.339 [54577] main/103/interactive I> Tarantool 2.10.0-29-g1ec2a9d
i3 | 2022-10-27 14:01:56.339 [54577] main/103/interactive I> log level 6
i1 | 2022-10-27 14:01:56.339 [54570] main/112/raft_main_loop V> broadcast, event: raft.entry-applied
i3 | 2022-10-27 14:01:56.339 [54577] main/103/interactive I> wal/engine cleanup is paused
i3 | 2022-10-27 14:01:56.340 [54577] main/103/interactive I> mapping 33554432 bytes for memtx tuple arena...
i3 | 2022-10-27 14:01:56.340 [54577] main/103/interactive I> Actual slab_alloc_factor calculated on the basis of desired slab_alloc_factor = 1.044274
i3 | 2022-10-27 14:01:56.340 [54577] main/103/interactive I> mapping 134217728 bytes for vinyl tuple arena...
i1 | 2022-10-27 14:01:56.340 [54570] main/112/raft_main_loop I> initiating automatic transition out of joint configuration, config: Configuration { voters: Configuration { incoming: Configuration { voters: {2} }, outgoing: Configuration { voters: {1} } }, learners: {}, learners_next: {1}, auto_leave: true }, raft_id: 1
i1 | 2022-10-27 14:01:56.340 [54570] main/112/raft_main_loop V> broadcast, event: raft.topology-changed
i2 | 2022-10-27 14:01:56.341 [54578] main/103/interactive I> Tarantool 2.10.0-29-g1ec2a9d
i2 | 2022-10-27 14:01:56.341 [54578] main/103/interactive I> log level 6
i2 | 2022-10-27 14:01:56.342 [54578] main/103/interactive I> wal/engine cleanup is paused
i3 | 2022-10-27 14:01:56.342 [54577] main/103/interactive I> update replication_synchro_quorum = 1
i2 | 2022-10-27 14:01:56.342 [54578] main/103/interactive I> mapping 33554432 bytes for memtx tuple arena...
i3 | 2022-10-27 14:01:56.342 [54577] main/103/interactive I> instance uuid 5d7a7353-3e82-30fd-af0d-261436544389
i3 | 2022-10-27 14:01:56.342 [54577] main/103/interactive I> tx_binary: bound to 127.0.0.1:3503
i2 | 2022-10-27 14:01:56.342 [54578] main/103/interactive I> Actual slab_alloc_factor calculated on the basis of desired slab_alloc_factor = 1.044274
i3 | 2022-10-27 14:01:56.342 [54577] main/103/interactive I> connecting to 1 replicas
i2 | 2022-10-27 14:01:56.342 [54578] main/103/interactive I> mapping 134217728 bytes for vinyl tuple arena...
i3 | 2022-10-27 14:01:56.342 [54577] main/113/applier/127.0.0.1:3503 I> remote master 5d7a7353-3e82-30fd-af0d-261436544389 at 127.0.0.1:3503 running Tarantool 2.10.0
i3 | 2022-10-27 14:01:56.342 [54577] main/103/interactive I> connected to 1 replicas
i3 | 2022-10-27 14:01:56.342 [54577] main/103/interactive I> initializing an empty data directory
i2 | 2022-10-27 14:01:56.344 [54578] main/103/interactive I> update replication_synchro_quorum = 1
i2 | 2022-10-27 14:01:56.344 [54578] main/103/interactive I> instance uuid 24c4ac5f-4981-3441-879c-aee1edb608a6
i2 | 2022-10-27 14:01:56.344 [54578] main/103/interactive I> tx_binary: bound to 127.0.0.1:3502
i2 | 2022-10-27 14:01:56.345 [54578] main/103/interactive I> connecting to 1 replicas
i2 | 2022-10-27 14:01:56.345 [54578] main/113/applier/127.0.0.1:3502 I> remote master 24c4ac5f-4981-3441-879c-aee1edb608a6 at 127.0.0.1:3502 running Tarantool 2.10.0
i2 | 2022-10-27 14:01:56.345 [54578] main/103/interactive I> connected to 1 replicas
i2 | 2022-10-27 14:01:56.345 [54578] main/103/interactive I> initializing an empty data directory
i3 | 2022-10-27 14:01:56.349 [54577] main/103/interactive V> RAFT: recover {term: 1}
i3 | 2022-10-27 14:01:56.349 [54577] main/103/interactive I> assigned id 1 to replica 5d7a7353-3e82-30fd-af0d-261436544389
i3 | 2022-10-27 14:01:56.349 [54577] main/103/interactive I> update replication_synchro_quorum = 1
i3 | 2022-10-27 14:01:56.349 [54577] main/103/interactive I> cluster uuid eff4449e-feb2-3d73-87bc-75807cb23191
i3 | 2022-10-27 14:01:56.350 [54577] snapshot/101/main I> saving snapshot `/tmp/pytest-of-root/pytest-0/popen-gw1/test_log_rollback0/i3/00000000000000000000.snap.inprogress'
i2 | 2022-10-27 14:01:56.352 [54578] main/103/interactive V> RAFT: recover {term: 1}
i2 | 2022-10-27 14:01:56.352 [54578] main/103/interactive I> assigned id 1 to replica 24c4ac5f-4981-3441-879c-aee1edb608a6
i2 | 2022-10-27 14:01:56.352 [54578] main/103/interactive I> update replication_synchro_quorum = 1
i2 | 2022-10-27 14:01:56.352 [54578] main/103/interactive I> cluster uuid 1e94f382-b6a4-3ab8-ac07-35dba02e5f0a
i2 | 2022-10-27 14:01:56.359 [54578] snapshot/101/main I> saving snapshot `/tmp/pytest-of-root/pytest-0/popen-gw1/test_log_rollback0/i2/00000000000000000000.snap.inprogress'
i1 | 2022-10-27 14:01:56.441 [54570] main/122/lua V> established connection to peer, raft_id: 2, peer: 127.0.0.1:3503
i1 | 2022-10-27 14:01:56.441 [54570] main/112/raft_main_loop V> persisted index 13, raft_id: 1
i1 | 2022-10-27 14:01:56.442 [54570] main/122/lua V> error when sending message to peer: Server responded with error: Execute access to function '.raft_interact' is denied for user 'guest', peer: 2
i1 | 2022-10-27 14:01:56.542 [54570] main/112/raft_main_loop V> Sending from 1 to 2, msg: msg_type: MsgHeartbeat to: 2, to: 2, from: 1, raft_id: 1
i1 | 2022-10-27 14:01:56.543 [54570] main/122/lua V> error when sending message to peer: Server responded with error: Execute access to function '.raft_interact' is denied for user 'guest', peer: 2
i3 | 2022-10-27 14:01:56.543 [54577] snapshot/101/main I> done
i2 | 2022-10-27 14:01:56.543 [54578] snapshot/101/main I> done
i3 | 2022-10-27 14:01:56.544 [54577] main/103/interactive I> RAFT: fencing enabled
i3 | 2022-10-27 14:01:56.544 [54577] main/103/interactive I> RAFT: start state machine
i3 | 2022-10-27 14:01:56.544 [54577] main/103/interactive I> ready to accept requests
i3 | 2022-10-27 14:01:56.544 [54577] main/103/interactive I> RAFT: bump term to 2, follow
i3 | 2022-10-27 14:01:56.544 [54577] main/107/gc I> wal/engine cleanup is resumed
i3 | 2022-10-27 14:01:56.544 [54577] main/113/applier/127.0.0.1:3503 I> leaving orphan mode
i2 | 2022-10-27 14:01:56.544 [54578] main/103/interactive I> RAFT: fencing enabled
i2 | 2022-10-27 14:01:56.544 [54578] main/103/interactive I> RAFT: start state machine
i2 | 2022-10-27 14:01:56.544 [54578] main/103/interactive I> ready to accept requests
i2 | 2022-10-27 14:01:56.544 [54578] main/103/interactive I> RAFT: bump term to 2, follow
i2 | 2022-10-27 14:01:56.544 [54578] main/107/gc I> wal/engine cleanup is resumed
i2 | 2022-10-27 14:01:56.544 [54578] main/113/applier/127.0.0.1:3502 I> leaving orphan mode
i3 | 2022-10-27 14:01:56.544 [54577] main/114/raft_worker I> RAFT: persisted state {term: 2}
i3 | 2022-10-27 14:01:56.545 [54577] main/114/raft_worker I> RAFT: vote for 1, follow
i2 | 2022-10-27 14:01:56.545 [54578] main/114/raft_worker I> RAFT: persisted state {term: 2}
i2 | 2022-10-27 14:01:56.545 [54578] main/114/raft_worker I> RAFT: vote for 1, follow
i3 | 2022-10-27 14:01:56.545 [54577] main/114/raft_worker I> RAFT: persisted state {term: 2, vote: 1}
i3 | 2022-10-27 14:01:56.545 [54577] main/114/raft_worker I> RAFT: enter leader state with quorum 1
i3 | 2022-10-27 14:01:56.545 [54577] main/103/interactive V> feedback_daemon stopped
i3 | 2022-10-27 14:01:56.545 [54577] main/103/interactive V> feedback_daemon stopped
i3 | 2022-10-27 14:01:56.545 [54577] main/103/interactive V> feedback_daemon started
i3 | 2022-10-27 14:01:56.545 [54577] main/103/interactive I> set 'log_level' configuration option to 6
i3 | 2022-10-27 14:01:56.545 [54577] main/103/interactive V> feedback_daemon stopped
i3 | 2022-10-27 14:01:56.545 [54577] main/103/interactive V> feedback_daemon stopped
i3 | 2022-10-27 14:01:56.545 [54577] main/103/interactive V> feedback_daemon started
i3 | 2022-10-27 14:01:56.545 [54577] main/103/interactive I> set 'election_mode' configuration option to "manual"
i3 | 2022-10-27 14:01:56.545 [54577] main/103/interactive V> feedback_daemon stopped
i3 | 2022-10-27 14:01:56.545 [54577] main/103/interactive V> feedback_daemon stopped
i3 | 2022-10-27 14:01:56.545 [54577] main/103/interactive V> feedback_daemon started
i3 | 2022-10-27 14:01:56.545 [54577] main/103/interactive I> set 'feedback_enabled' configuration option to false
i3 | 2022-10-27 14:01:56.545 [54577] main/103/interactive I> set 'log_format' configuration option to "plain"
i3 | 2022-10-27 14:01:56.545 [54577] main/103/interactive I> set 'memtx_memory' configuration option to 33554432
i3 | 2022-10-27 14:01:56.545 [54577] main/103/interactive I> set 'instance_uuid' configuration option to "5d7a7353-3e82-30fd-af0d-261436544389"
i3 | 2022-10-27 14:01:56.545 [54577] main/103/interactive I> set 'listen' configuration option to "127.0.0.1:3503"
i3 | 2022-10-27 14:01:56.545 [54577] main/103/interactive V> feedback_daemon stopped
i3 | 2022-10-27 14:01:56.545 [54577] main/103/interactive V> feedback_daemon stopped
i2 | 2022-10-27 14:01:56.545 [54578] main/114/raft_worker I> RAFT: persisted state {term: 2, vote: 1}
i2 | 2022-10-27 14:01:56.545 [54578] main/114/raft_worker I> RAFT: enter leader state with quorum 1
i2 | 2022-10-27 14:01:56.545 [54578] main/103/interactive V> feedback_daemon stopped
i2 | 2022-10-27 14:01:56.545 [54578] main/103/interactive V> feedback_daemon stopped
i2 | 2022-10-27 14:01:56.545 [54578] main/103/interactive V> feedback_daemon started
i2 | 2022-10-27 14:01:56.545 [54578] main/103/interactive I> set 'log_level' configuration option to 6
i2 | 2022-10-27 14:01:56.545 [54578] main/103/interactive V> feedback_daemon stopped
i2 | 2022-10-27 14:01:56.545 [54578] main/103/interactive V> feedback_daemon stopped
i2 | 2022-10-27 14:01:56.545 [54578] main/103/interactive V> feedback_daemon started
i2 | 2022-10-27 14:01:56.546 [54578] main/103/interactive I> set 'election_mode' configuration option to "manual"
i2 | 2022-10-27 14:01:56.546 [54578] main/103/interactive V> feedback_daemon stopped
i2 | 2022-10-27 14:01:56.546 [54578] main/103/interactive V> feedback_daemon stopped
i2 | 2022-10-27 14:01:56.546 [54578] main/103/interactive V> feedback_daemon started
i2 | 2022-10-27 14:01:56.546 [54578] main/103/interactive I> set 'feedback_enabled' configuration option to false
i2 | 2022-10-27 14:01:56.546 [54578] main/103/interactive I> set 'log_format' configuration option to "plain"
i2 | 2022-10-27 14:01:56.546 [54578] main/103/interactive I> set 'memtx_memory' configuration option to 33554432
i2 | 2022-10-27 14:01:56.546 [54578] main/103/interactive I> set 'instance_uuid' configuration option to "24c4ac5f-4981-3441-879c-aee1edb608a6"
i2 | 2022-10-27 14:01:56.546 [54578] main/103/interactive I> set 'listen' configuration option to "127.0.0.1:3502"
i2 | 2022-10-27 14:01:56.546 [54578] main/103/interactive V> feedback_daemon stopped
i2 | 2022-10-27 14:01:56.546 [54578] main/103/interactive V> feedback_daemon stopped
i2 | 2022-10-27 14:01:56.546 [54578] main/103/interactive V> feedback_daemon started
i2 | 2022-10-27 14:01:56.546 [54578] main/103/interactive I> set 'replication_connect_quorum' configuration option to 32
i2 | 2022-10-27 14:01:56.546 [54578] main/103/interactive I> set 'replication' configuration option to ["127.0.0.1:3502"]
i2 | 2022-10-27 14:01:56.546 [54578] main/108/checkpoint_daemon I> scheduled next checkpoint for Thu Oct 27 16:01:42 2022
i3 | 2022-10-27 14:01:56.545 [54577] main/103/interactive V> feedback_daemon started
i3 | 2022-10-27 14:01:56.545 [54577] main/103/interactive I> set 'replication_connect_quorum' configuration option to 32
i3 | 2022-10-27 14:01:56.545 [54577] main/103/interactive I> set 'replication' configuration option to ["127.0.0.1:3503"]
i3 | 2022-10-27 14:01:56.545 [54577] main/108/checkpoint_daemon I> scheduled next checkpoint for Thu Oct 27 15:12:02 2022
i3 | 2022-10-27 14:01:56.546 [54577] main/103/interactive I> set 'replicaset_uuid' configuration option to "eff4449e-feb2-3d73-87bc-75807cb23191"
i2 | 2022-10-27 14:01:56.553 [54578] main/103/interactive I> set 'replicaset_uuid' configuration option to "1e94f382-b6a4-3ab8-ac07-35dba02e5f0a"
i2 | 2022-10-27 14:01:56.570 [54578] main/103/interactive I> >>>>> postjoin()
i2 | 2022-10-27 14:01:56.570 [54578] main/103/interactive I> leaving orphan mode
i2 | 2022-10-27 14:01:56.570 [54578] main/103/interactive I> set 'replication_connect_quorum' configuration option to 0
i3 | 2022-10-27 14:01:56.570 [54577] main/103/interactive I> >>>>> postjoin()
i3 | 2022-10-27 14:01:56.571 [54577] main/103/interactive I> leaving orphan mode
i3 | 2022-10-27 14:01:56.571 [54577] main/103/interactive I> set 'replication_connect_quorum' configuration option to 0
i2 | 2022-10-27 14:01:56.571 [54578] main/103/interactive I> switched to configuration, config: Configuration { voters: Configuration { incoming: Configuration { voters: {} }, outgoing: Configuration { voters: {} } }, learners: {}, learners_next: {}, auto_leave: false }, raft_id: 3
i2 | 2022-10-27 14:01:56.571 [54578] main/103/interactive V> reset election timeout 0 -> 35 at 0, election_elapsed: 0, timeout: 35, prev_timeout: 0, raft_id: 3
i2 | 2022-10-27 14:01:56.571 [54578] main/103/interactive I> became follower at term 0, term: 0, raft_id: 3
i2 | 2022-10-27 14:01:56.571 [54578] main/103/interactive I> newRaft, peers: Configuration { incoming: Configuration { voters: {} }, outgoing: Configuration { voters: {} } }, last term: 0, last index: 0, applied: 0, commit: 0, term: 0, raft_id: 3
i2 | 2022-10-27 14:01:56.571 [54578] main/103/interactive I> RawNode created with id 3., id: 3, raft_id: 3
i2 | 2022-10-27 14:01:56.572 [54578] main/103/interactive V> Getting a read barrier...
i3 | 2022-10-27 14:01:56.572 [54577] main/103/interactive I> switched to configuration, config: Configuration { voters: Configuration { incoming: Configuration { voters: {} }, outgoing: Configuration { voters: {} } }, learners: {}, learners_next: {}, auto_leave: false }, raft_id: 2
i3 | 2022-10-27 14:01:56.572 [54577] main/103/interactive V> reset election timeout 0 -> 21 at 0, election_elapsed: 0, timeout: 21, prev_timeout: 0, raft_id: 2
i3 | 2022-10-27 14:01:56.572 [54577] main/103/interactive I> became follower at term 0, term: 0, raft_id: 2
i3 | 2022-10-27 14:01:56.572 [54577] main/103/interactive I> newRaft, peers: Configuration { incoming: Configuration { voters: {} }, outgoing: Configuration { voters: {} } }, last term: 0, last index: 0, applied: 0, commit: 0, term: 0, raft_id: 2
i3 | 2022-10-27 14:01:56.572 [54577] main/103/interactive I> RawNode created with id 2., id: 2, raft_id: 2
i3 | 2022-10-27 14:01:56.572 [54577] main/103/interactive V> Getting a read barrier...
i1 | 2022-10-27 14:01:56.743 [54570] main/112/raft_main_loop V> Sending from 1 to 2, msg: msg_type: MsgHeartbeat to: 2, to: 2, from: 1, raft_id: 1
i3 | 2022-10-27 14:01:56.744 [54577] main/112/main I> received a message with higher term from 1, msg type: MsgHeartbeat, message_term: 2, term: 0, from: 1, raft_id: 2
i3 | 2022-10-27 14:01:56.744 [54577] main/112/main V> reset election timeout 21 -> 31 at 2, election_elapsed: 2, timeout: 31, prev_timeout: 21, raft_id: 2
i3 | 2022-10-27 14:01:56.744 [54577] main/112/main I> became follower at term 2, term: 2, raft_id: 2
i3 | 2022-10-27 14:01:56.746 [54577] main/112/main V> Sending from 2 to 1, msg: msg_type: MsgHeartbeatResponse to: 1, to: 1, from: 2, raft_id: 2
i3 | 2022-10-27 14:01:56.746 [54577] main/115/raft_main_loop V> broadcast, event: raft.status-changed
i3 | 2022-10-27 14:01:56.747 [54577] main/103/interactive V> mutex was locked at src/traft/node.rs:877:44
i1 | 2022-10-27 14:01:56.747 [54570] main/122/lua V> received response, peer: 2
i3 | 2022-10-27 14:01:56.747 [54577] main/117/lua V> established connection to peer, raft_id: 1, peer: 127.0.0.1:3501
i3 | 2022-10-27 14:01:56.748 [54577] main/103/interactive V> Sending from 2 to 1, msg: msg_type: MsgReadIndex to: 1 entries {data: "\202\242lc\203\242id\002\243gen\001\245count\001\242op\201\244kind\243nop"}, to: 1, from: 2, raft_id: 2
i1 | 2022-10-27 14:01:56.748 [54570] main/110/main V> Sending from 1 to 2, msg: msg_type: MsgAppend to: 2 log_term: 2 index: 11 entries {term: 2 index: 12 context: "\202\242lc\203\242id\001\243gen\001\245count\007\242op\202\244kind\254persist_peer\244peer\213\253instance_id\242i2\255instance_uuid\331$24c4ac5f-4981-3441-879c-aee1edb608a6\247raft_id\003\254peer_address\256127.0.0.1:3502\255replicaset_id\242r3\257replicaset_uuid\331$1e94f382-b6a4-3ab8-ac07-35dba02e5f0a\251is_master\302\254commit_index\014\255current_grade\247Offline\254target_grade\247Offline\256failure_domain\200"} commit: 12, to: 2, from: 1, raft_id: 1
i1 | 2022-10-27 14:01:56.749 [54570] main/121/main V> Sending from 1 to 2, msg: msg_type: MsgHeartbeat to: 2 context: "\202\242lc\203\242id\002\243gen\001\245count\001\242op\201\244kind\243nop", to: 2, from: 1, raft_id: 1
i3 | 2022-10-27 14:01:56.749 [54577] main/117/lua V> received response, peer: 1
i3 | 2022-10-27 14:01:56.749 [54577] main/117/lua V> received response, peer: 1
i3 | 2022-10-27 14:01:56.749 [54577] main/112/main V> rejected msgApp [logterm: 2, index: 11] from 1, logterm: Ok(0), index: 11, from: 1, msg_index: 11, msg_log_term: 2, raft_id: 2
i3 | 2022-10-27 14:01:56.749 [54577] main/112/main V> Sending from 2 to 1, msg: msg_type: MsgAppendResponse to: 1 index: 11 reject: true, to: 1, from: 2, raft_id: 2
i3 | 2022-10-27 14:01:56.749 [54577] main/120/main V> Sending from 2 to 1, msg: msg_type: MsgHeartbeatResponse to: 1 context: "\202\242lc\203\242id\002\243gen\001\245count\001\242op\201\244kind\243nop", to: 1, from: 2, raft_id: 2
i1 | 2022-10-27 14:01:56.750 [54570] main/122/lua V> received response, peer: 2
i1 | 2022-10-27 14:01:56.750 [54570] main/122/lua V> received response, peer: 2
i1 | 2022-10-27 14:01:56.750 [54570] main/121/main V> received msgAppend rejection, index: 11, from: 2, reject_hint_term: 0, reject_hint_index: 0, raft_id: 1
i1 | 2022-10-27 14:01:56.750 [54570] main/121/main V> decreased progress of 2, progress: Progress { matched: 0, next_idx: 1, state: Probe, paused: false, pending_snapshot: 0, pending_request_snapshot: 0, recent_active: true, ins: Inflights { start: 0, count: 0, buffer: [] }, commit_group_id: 0, committed_index: 0 }, raft_id: 1
i1 | 2022-10-27 14:01:56.751 [54570] main/121/main V> Sending from 1 to 2, msg: msg_type: MsgAppend to: 2 entries {term: 1 index: 1 context: "\202\242lc\203\242id\001\243gen\000\245count\001\242op\202\244kind\254persist_peer\244peer\213\253instance_id\242i1\255instance_uuid\331$68d4a766-4144-3248-aeb4-e212356716e4\247raft_id\001\254peer_address\256127.0.0.1:3501\255replicaset_id\242r1\257replicaset_uuid\331$e0df68c5-e7f9-395f-86b3-30ad9e1b7b07\251is_master\302\254commit_index\001\255current_grade\247Offline\254target_grade\247Offline\256failure_domain\200"} commit: 12, to: 2, from: 1, raft_id: 1
i1 | 2022-10-27 14:01:56.752 [54570] main/110/main V> Sending from 1 to 2, msg: msg_type: MsgAppend to: 2 entries {term: 1 index: 1 context: "\202\242lc\203\242id\001\243gen\000\245count\001\242op\202\244kind\254persist_peer\244peer\213\253instance_id\242i1\255instance_uuid\331$68d4a766-4144-3248-aeb4-e212356716e4\247raft_id\001\254peer_address\256127.0.0.1:3501\255replicaset_id\242r1\257replicaset_uuid\331$e0df68c5-e7f9-395f-86b3-30ad9e1b7b07\251is_master\302\254commit_index\001\255current_grade\247Offline\254target_grade\247Offline\256failure_domain\200"} commit: 12, to: 2, from: 1, raft_id: 1
i1 | 2022-10-27 14:01:56.752 [54570] main/110/main V> Sending from 1 to 2, msg: msg_type: MsgReadIndexResp to: 2 index: 12 entries {data: "\202\242lc\203\242id\002\243gen\001\245count\001\242op\201\244kind\243nop"}, to: 2, from: 1, raft_id: 1
i3 | 2022-10-27 14:01:56.752 [54577] main/117/lua V> received response, peer: 1
i3 | 2022-10-27 14:01:56.752 [54577] main/117/lua V> received response, peer: 1
i3 | 2022-10-27 14:01:56.753 [54577] main/120/main V> Sending from 2 to 1, msg: msg_type: MsgAppendResponse to: 1 index: 1 commit: 1, to: 1, from: 2, raft_id: 2
i3 | 2022-10-27 14:01:56.753 [54577] main/112/main V> got message with lower index than committed., raft_id: 2
i3 | 2022-10-27 14:01:56.753 [54577] main/112/main V> Sending from 2 to 1, msg: msg_type: MsgAppendResponse to: 1 index: 1 commit: 1, to: 1, from: 2, raft_id: 2
i3 | 2022-10-27 14:01:56.753 [54577] main/103/interactive I> Read barrier aquired, raft is ready
i3 | 2022-10-27 14:01:56.753 [54577] main/103/interactive I> initiating self-activation of i3
i1 | 2022-10-27 14:01:56.753 [54570] main/122/lua V> received response, peer: 2
i1 | 2022-10-27 14:01:56.753 [54570] main/122/lua V> received response, peer: 2
i1 | 2022-10-27 14:01:56.753 [54570] main/122/lua V> received response, peer: 2
i3 | 2022-10-27 14:01:56.754 [54577] main/115/raft_main_loop V> persisted index 1, raft_id: 2
i3 | 2022-10-27 14:01:56.754 [54577] main/115/raft_main_loop V> broadcast, event: raft.entry-applied
i3 | 2022-10-27 14:01:56.754 [54577] main/115/raft_main_loop V> broadcast, event: raft.topology-changed
i1 | 2022-10-27 14:01:56.755 [54570] main/110/main V> Sending from 1 to 2, msg: msg_type: MsgAppend to: 2 log_term: 1 index: 1 entries {term: 1 index: 2 context: "\202\242lc\203\242id\001\243gen\000\245count\002\242op\202\244kind\243dml\246Insert\202\245space\255cluster_state\245tuple\304\025\222\262replication_factor\001"} commit: 12, to: 2, from: 1, raft_id: 1
i1 | 2022-10-27 14:01:56.756 [54570] main/110/main V> Sending from 1 to 2, msg: msg_type: MsgAppend to: 2 log_term: 1 index: 2 entries {term: 1 index: 3 context: "\202\242lc\203\242id\001\243gen\000\245count\003\242op\202\244kind\243dml\246Insert\202\245space\255cluster_state\245tuple\304\025\222\262replicaset_weights\200"} commit: 12, to: 2, from: 1, raft_id: 1
i1 | 2022-10-27 14:01:56.756 [54570] main/110/main V> Sending from 1 to 2, msg: msg_type: MsgAppend to: 2 log_term: 1 index: 3 entries {entry_type: EntryConfChange term: 1 index: 4 data: "\030\001"} commit: 12, to: 2, from: 1, raft_id: 1
i1 | 2022-10-27 14:01:56.757 [54570] main/110/main V> Sending from 1 to 2, msg: msg_type: MsgAppend to: 2 log_term: 1 index: 4 entries {term: 2 index: 5} commit: 12, to: 2, from: 1, raft_id: 1
i1 | 2022-10-27 14:01:56.758 [54570] main/110/main V> Sending from 1 to 2, msg: msg_type: MsgAppend to: 2 log_term: 2 index: 5 entries {term: 2 index: 6 context: "\202\242lc\203\242id\001\243gen\001\245count\002\242op\202\244kind\254persist_peer\244peer\213\253instance_id\242i1\255instance_uuid\331$68d4a766-4144-3248-aeb4-e212356716e4\247raft_id\001\254peer_address\256127.0.0.1:3501\255replicaset_id\242r1\257replicaset_uuid\331$e0df68c5-e7f9-395f-86b3-30ad9e1b7b07\251is_master\302\254commit_index\006\255current_grade\247Offline\254target_grade\246Online\256failure_domain\200"} commit: 12, to: 2, from: 1, raft_id: 1
i1 | 2022-10-27 14:01:56.758 [54570] main/110/main V> Sending from 1 to 2, msg: msg_type: MsgAppend to: 2 log_term: 2 index: 6 entries {term: 2 index: 7 context: "\202\242lc\203\242id\001\243gen\001\245count\003\242op\202\244kind\254persist_peer\244peer\213\253instance_id\242i1\255instance_uuid\331$68d4a766-4144-3248-aeb4-e212356716e4\247raft_id\001\254peer_address\256127.0.0.1:3501\255replicaset_id\242r1\257replicaset_uuid\331$e0df68c5-e7f9-395f-86b3-30ad9e1b7b07\251is_master\302\254commit_index\007\255current_grade\252RaftSynced\254target_grade\246Online\256failure_domain\200"} commit: 12, to: 2, from: 1, raft_id: 1
i1 | 2022-10-27 14:01:56.759 [54570] main/110/main V> Sending from 1 to 2, msg: msg_type: MsgAppend to: 2 log_term: 2 index: 7 entries {term: 2 index: 8 context: "\202\242lc\203\242id\001\243gen\001\245count\004\242op\202\244kind\254persist_peer\244peer\213\253instance_id\242i1\255instance_uuid\331$68d4a766-4144-3248-aeb4-e212356716e4\247raft_id\001\254peer_address\256127.0.0.1:3501\255replicaset_id\242r1\257replicaset_uuid\331$e0df68c5-e7f9-395f-86b3-30ad9e1b7b07\251is_master\303\254commit_index\010\255current_grade\252Replicated\254target_grade\246Online\256failure_domain\200"} commit: 12, to: 2, from: 1, raft_id: 1
i1 | 2022-10-27 14:01:56.759 [54570] main/110/main V> Sending from 1 to 2, msg: msg_type: MsgAppend to: 2 log_term: 2 index: 8 entries {term: 2 index: 9 context: "\202\242lc\203\242id\001\243gen\001\245count\005\242op\202\244kind\243dml\246Update\203\245space\255cluster_state\243key\304\024\221\262replicaset_weights\243ops\221\304\034\223\241=\257[\'value\'][\'r1\']\313?\360\000\000\000\000\000\000"} commit: 12, to: 2, from: 1, raft_id: 1
i1 | 2022-10-27 14:01:56.760 [54570] main/110/main V> Sending from 1 to 2, msg: msg_type: MsgAppend to: 2 log_term: 2 index: 9 entries {term: 2 index: 10 context: "\202\242lc\203\242id\001\243gen\001\245count\006\242op\202\244kind\254persist_peer\244peer\213\253instance_id\242i3\255instance_uuid\331$5d7a7353-3e82-30fd-af0d-261436544389\247raft_id\002\254peer_address\256127.0.0.1:3503\255replicaset_id\242r2\257replicaset_uuid\331$eff4449e-feb2-3d73-87bc-75807cb23191\251is_master\302\254commit_index\n\255current_grade\247Offline\254target_grade\247Offline\256failure_domain\200"} commit: 12, to: 2, from: 1, raft_id: 1
i1 | 2022-10-27 14:01:56.760 [54570] main/110/main V> Sending from 1 to 2, msg: msg_type: MsgAppend to: 2 log_term: 2 index: 10 entries {entry_type: EntryConfChangeV2 term: 2 index: 11 data: "\022\004\010\002\020\001\022\002\020\002"} commit: 12, to: 2, from: 1, raft_id: 1
i1 | 2022-10-27 14:01:56.760 [54570] main/110/main V> Sending from 1 to 2, msg: msg_type: MsgAppend to: 2 log_term: 2 index: 11 entries {term: 2 index: 12 context: "\202\242lc\203\242id\001\243gen\001\245count\007\242op\202\244kind\254persist_peer\244peer\213\253instance_id\242i2\255instance_uuid\331$24c4ac5f-4981-3441-879c-aee1edb608a6\247raft_id\003\254peer_address\256127.0.0.1:3502\255replicaset_id\242r3\257replicaset_uuid\331$1e94f382-b6a4-3ab8-ac07-35dba02e5f0a\251is_master\302\254commit_index\014\255current_grade\247Offline\254target_grade\247Offline\256failure_domain\200"} commit: 12, to: 2, from: 1, raft_id: 1
i1 | 2022-10-27 14:01:56.760 [54570] main/110/main V> Sending from 1 to 2, msg: msg_type: MsgAppend to: 2 log_term: 2 index: 12 entries {entry_type: EntryConfChangeV2 term: 2 index: 13} commit: 12, to: 2, from: 1, raft_id: 1
i1 | 2022-10-27 14:01:56.761 [54570] main/121/main V> Sending from 1 to 2, msg: msg_type: MsgAppend to: 2 log_term: 2 index: 13 entries {term: 2 index: 14 context: "\202\242lc\203\242id\001\243gen\001\245count\010\242op\202\244kind\254persist_peer\244peer\213\253instance_id\242i3\255instance_uuid\331$5d7a7353-3e82-30fd-af0d-261436544389\247raft_id\002\254peer_address\256127.0.0.1:3503\255replicaset_id\242r2\257replicaset_uuid\331$eff4449e-feb2-3d73-87bc-75807cb23191\251is_master\302\254commit_index\016\255current_grade\247Offline\254target_grade\246Online\256failure_domain\200"} commit: 12, to: 2, from: 1, raft_id: 1
i1 | 2022-10-27 14:01:56.762 [54570] main/112/raft_main_loop V> persisted index 14, raft_id: 1
i3 | 2022-10-27 14:01:56.762 [54577] main/121/main V> Sending from 2 to 1, msg: msg_type: MsgAppendResponse to: 1 index: 2 commit: 2, to: 1, from: 2, raft_id: 2
i3 | 2022-10-27 14:01:56.762 [54577] main/112/main V> Sending from 2 to 1, msg: msg_type: MsgAppendResponse to: 1 index: 3 commit: 3, to: 1, from: 2, raft_id: 2
i3 | 2022-10-27 14:01:56.762 [54577] main/120/main V> Sending from 2 to 1, msg: msg_type: MsgAppendResponse to: 1 index: 4 commit: 4, to: 1, from: 2, raft_id: 2
i3 | 2022-10-27 14:01:56.763 [54577] main/124/main V> Sending from 2 to 1, msg: msg_type: MsgAppendResponse to: 1 index: 5 commit: 5, to: 1, from: 2, raft_id: 2
i3 | 2022-10-27 14:01:56.763 [54577] main/125/main V> Sending from 2 to 1, msg: msg_type: MsgAppendResponse to: 1 index: 6 commit: 6, to: 1, from: 2, raft_id: 2
i3 | 2022-10-27 14:01:56.763 [54577] main/126/main V> Sending from 2 to 1, msg: msg_type: MsgAppendResponse to: 1 index: 7 commit: 7, to: 1, from: 2, raft_id: 2
i3 | 2022-10-27 14:01:56.763 [54577] main/127/main V> Sending from 2 to 1, msg: msg_type: MsgAppendResponse to: 1 index: 8 commit: 8, to: 1, from: 2, raft_id: 2
i3 | 2022-10-27 14:01:56.763 [54577] main/128/main V> Sending from 2 to 1, msg: msg_type: MsgAppendResponse to: 1 index: 9 commit: 9, to: 1, from: 2, raft_id: 2
i3 | 2022-10-27 14:01:56.764 [54577] main/129/main V> Sending from 2 to 1, msg: msg_type: MsgAppendResponse to: 1 index: 10 commit: 10, to: 1, from: 2, raft_id: 2
i3 | 2022-10-27 14:01:56.764 [54577] main/130/main V> Sending from 2 to 1, msg: msg_type: MsgAppendResponse to: 1 index: 11 commit: 11, to: 1, from: 2, raft_id: 2
i3 | 2022-10-27 14:01:56.765 [54577] main/131/main V> Sending from 2 to 1, msg: msg_type: MsgAppendResponse to: 1 index: 12 commit: 12, to: 1, from: 2, raft_id: 2
i3 | 2022-10-27 14:01:56.765 [54577] main/132/main V> Sending from 2 to 1, msg: msg_type: MsgAppendResponse to: 1 index: 13 commit: 12, to: 1, from: 2, raft_id: 2
i3 | 2022-10-27 14:01:56.765 [54577] main/133/main V> Sending from 2 to 1, msg: msg_type: MsgAppendResponse to: 1 index: 14 commit: 12, to: 1, from: 2, raft_id: 2
i3 | 2022-10-27 14:01:56.766 [54577] main/117/lua V> received response, peer: 1
i3 | 2022-10-27 14:01:56.766 [54577] main/117/lua V> received response, peer: 1
i3 | 2022-10-27 14:01:56.766 [54577] main/115/raft_main_loop V> persisted index 14, raft_id: 2
i1 | 2022-10-27 14:01:56.766 [54570] main/122/lua V> received response, peer: 2
i1 | 2022-10-27 14:01:56.766 [54570] main/122/lua V> received response, peer: 2
i1 | 2022-10-27 14:01:56.766 [54570] main/122/lua V> received response, peer: 2
i1 | 2022-10-27 14:01:56.766 [54570] main/122/lua V> received response, peer: 2
i1 | 2022-10-27 14:01:56.766 [54570] main/122/lua V> received response, peer: 2
i1 | 2022-10-27 14:01:56.766 [54570] main/122/lua V> received response, peer: 2
i1 | 2022-10-27 14:01:56.766 [54570] main/122/lua V> received response, peer: 2
i1 | 2022-10-27 14:01:56.766 [54570] main/122/lua V> received response, peer: 2
i1 | 2022-10-27 14:01:56.766 [54570] main/122/lua V> received response, peer: 2
i1 | 2022-10-27 14:01:56.766 [54570] main/122/lua V> received response, peer: 2
i1 | 2022-10-27 14:01:56.766 [54570] main/122/lua V> received response, peer: 2
i1 | 2022-10-27 14:01:56.766 [54570] main/122/lua V> received response, peer: 2
i1 | 2022-10-27 14:01:56.766 [54570] main/122/lua V> received response, peer: 2
i3 | 2022-10-27 14:01:56.767 [54577] main/115/raft_main_loop I> switched to configuration, config: Configuration { voters: Configuration { incoming: Configuration { voters: {1} }, outgoing: Configuration { voters: {} } }, learners: {}, learners_next: {}, auto_leave: false }, raft_id: 2
i3 | 2022-10-27 14:01:56.768 [54577] main/115/raft_main_loop I> switched to configuration, config: Configuration { voters: Configuration { incoming: Configuration { voters: {2} }, outgoing: Configuration { voters: {1} } }, learners: {}, learners_next: {1}, auto_leave: true }, raft_id: 2
i3 | 2022-10-27 14:01:56.768 [54577] main/115/raft_main_loop V> broadcast, event: raft.entry-applied
i3 | 2022-10-27 14:01:56.768 [54577] main/115/raft_main_loop V> broadcast, event: raft.topology-changed
i1 | 2022-10-27 14:01:56.769 [54570] main/135/main V> committing index 13, index: 13, raft_id: 1
i1 | 2022-10-27 14:01:56.769 [54570] main/135/main V> Sending from 1 to 2, msg: msg_type: MsgAppend to: 2 log_term: 2 index: 14 commit: 13, to: 2, from: 1, raft_id: 1
i1 | 2022-10-27 14:01:56.769 [54570] main/136/main V> committing index 14, index: 14, raft_id: 1
i1 | 2022-10-27 14:01:56.770 [54570] main/136/main V> Sending from 1 to 2, msg: msg_type: MsgAppend to: 2 log_term: 2 index: 14 commit: 14, to: 2, from: 1, raft_id: 1
i1 | 2022-10-27 14:01:56.770 [54570] main/112/raft_main_loop V> broadcast, event: raft.joint-state-leave
i1 | 2022-10-27 14:01:56.770 [54570] main/112/raft_main_loop V> broadcast, event: raft.demoted
i1 | 2022-10-27 14:01:56.770 [54570] main/112/raft_main_loop I> switched to configuration, config: Configuration { voters: Configuration { incoming: Configuration { voters: {2} }, outgoing: Configuration { voters: {} } }, learners: {1}, learners_next: {}, auto_leave: false }, raft_id: 1
i1 | 2022-10-27 14:01:56.770 [54570] main/112/raft_main_loop V> broadcast, event: raft.entry-applied
i1 | 2022-10-27 14:01:56.770 [54570] main/113/raft_conf_change_loop I> conf_change processed
i1 | 2022-10-27 14:01:56.771 [54570] main/113/raft_conf_change_loop V> mutex was locked at src/traft/node.rs:877:44
i3 | 2022-10-27 14:01:56.771 [54577] main/117/lua V> received response, peer: 1
i1 | 2022-10-27 14:01:56.771 [54570] main/112/raft_main_loop V> broadcast, event: raft.topology-changed
i3 | 2022-10-27 14:01:56.771 [54577] main/117/lua V> received response, peer: 1
i3 | 2022-10-27 14:01:56.771 [54577] main/117/lua V> received response, peer: 1
i3 | 2022-10-27 14:01:56.771 [54577] main/117/lua V> received response, peer: 1
i3 | 2022-10-27 14:01:56.771 [54577] main/117/lua V> received response, peer: 1
i3 | 2022-10-27 14:01:56.771 [54577] main/117/lua V> received response, peer: 1
i3 | 2022-10-27 14:01:56.771 [54577] main/117/lua V> received response, peer: 1
i3 | 2022-10-27 14:01:56.771 [54577] main/117/lua V> received response, peer: 1
i3 | 2022-10-27 14:01:56.771 [54577] main/117/lua V> received response, peer: 1
i3 | 2022-10-27 14:01:56.771 [54577] main/117/lua V> received response, peer: 1
i3 | 2022-10-27 14:01:56.771 [54577] main/117/lua V> received response, peer: 1
i3 | 2022-10-27 14:01:56.771 [54577] main/117/lua V> received response, peer: 1
i3 | 2022-10-27 14:01:56.771 [54577] main/117/lua V> received response, peer: 1
i1 | 2022-10-27 14:01:56.771 [54570] main/113/raft_conf_change_loop V> Sending from 1 to 2, msg: msg_type: MsgAppend to: 2 log_term: 2 index: 14 entries {entry_type: EntryConfChangeV2 term: 2 index: 15 data: "\022\004\010\002\020\002\022\002\020\003"} commit: 14, to: 2, from: 1, raft_id: 1
i3 | 2022-10-27 14:01:56.771 [54577] main/133/main V> Sending from 2 to 1, msg: msg_type: MsgAppendResponse to: 1 index: 14 commit: 13, to: 1, from: 2, raft_id: 2
i1 | 2022-10-27 14:01:56.771 [54570] main/113/raft_conf_change_loop V> broadcast, event: raft.joint-state-enter
i1 | 2022-10-27 14:01:56.771 [54570] main/112/raft_main_loop V> persisted index 15, raft_id: 1
i3 | 2022-10-27 14:01:56.771 [54577] main/132/main V> Sending from 2 to 1, msg: msg_type: MsgAppendResponse to: 1 index: 14 commit: 14, to: 1, from: 2, raft_id: 2
i3 | 2022-10-27 14:01:56.771 [54577] main/115/raft_main_loop I> switched to configuration, config: Configuration { voters: Configuration { incoming: Configuration { voters: {2} }, outgoing: Configuration { voters: {} } }, learners: {1}, learners_next: {}, auto_leave: false }, raft_id: 2
i3 | 2022-10-27 14:01:56.772 [54577] main/115/raft_main_loop V> broadcast, event: raft.entry-applied
i3 | 2022-10-27 14:01:56.772 [54577] main I> entering the event loop
i3 | 2022-10-27 14:01:56.772 [54577] main/132/main V> mutex was locked at src/traft/node.rs:877:44
i1 | 2022-10-27 14:01:56.772 [54570] main/122/lua V> received response, peer: 2
i1 | 2022-10-27 14:01:56.772 [54570] main/122/lua V> received response, peer: 2
i3 | 2022-10-27 14:01:56.772 [54577] main/115/raft_main_loop V> broadcast, event: raft.topology-changed
i3 | 2022-10-27 14:01:56.772 [54577] main/132/main V> Sending from 2 to 1, msg: msg_type: MsgAppendResponse to: 1 index: 15 commit: 14, to: 1, from: 2, raft_id: 2
i3 | 2022-10-27 14:01:56.772 [54577] main/115/raft_main_loop V> persisted index 15, raft_id: 2
i1 | 2022-10-27 14:01:56.773 [54570] main/122/lua V> received response, peer: 2
i3 | 2022-10-27 14:01:56.773 [54577] main/117/lua V> received response, peer: 1
i1 | 2022-10-27 14:01:56.773 [54570] main/136/main V> committing index 15, index: 15, raft_id: 1
i3 | 2022-10-27 14:01:56.773 [54577] main/117/lua V> received response, peer: 1
i1 | 2022-10-27 14:01:56.773 [54570] main/136/main V> Sending from 1 to 2, msg: msg_type: MsgAppend to: 2 log_term: 2 index: 15 commit: 15, to: 2, from: 1, raft_id: 1
i1 | 2022-10-27 14:01:56.773 [54570] main/112/raft_main_loop I> switched to configuration, config: Configuration { voters: Configuration { incoming: Configuration { voters: {3} }, outgoing: Configuration { voters: {2} } }, learners: {1}, learners_next: {2}, auto_leave: true }, raft_id: 1
i1 | 2022-10-27 14:01:56.773 [54570] main/112/raft_main_loop V> broadcast, event: raft.entry-applied
i3 | 2022-10-27 14:01:56.773 [54577] main/117/lua V> received response, peer: 1
i1 | 2022-10-27 14:01:56.773 [54570] main/112/raft_main_loop I> initiating automatic transition out of joint configuration, config: Configuration { voters: Configuration { incoming: Configuration { voters: {3} }, outgoing: Configuration { voters: {2} } }, learners: {1}, learners_next: {2}, auto_leave: true }, raft_id: 1
i3 | 2022-10-27 14:01:56.774 [54577] main/132/main V> Sending from 2 to 1, msg: msg_type: MsgAppendResponse to: 1 index: 15 commit: 15, to: 1, from: 2, raft_id: 2
i3 | 2022-10-27 14:01:56.774 [54577] main/115/raft_main_loop I> switched to configuration, config: Configuration { voters: Configuration { incoming: Configuration { voters: {3} }, outgoing: Configuration { voters: {2} } }, learners: {1}, learners_next: {2}, auto_leave: true }, raft_id: 2
i3 | 2022-10-27 14:01:56.774 [54577] main/115/raft_main_loop V> broadcast, event: raft.entry-applied
i1 | 2022-10-27 14:01:56.774 [54570] main/122/lua V> received response, peer: 2
i1 | 2022-10-27 14:01:56.774 [54570] main/112/raft_main_loop V> persisted index 16, raft_id: 1
i3 | 2022-10-27 14:01:56.774 [54577] main/117/lua V> received response, peer: 1
i1 | 2022-10-27 14:01:56.975 [54570] main/112/raft_main_loop V> Sending from 1 to 2, msg: msg_type: MsgHeartbeat to: 2 commit: 15, to: 2, from: 1, raft_id: 1
i1 | 2022-10-27 14:01:56.975 [54570] main/112/raft_main_loop V> Sending from 1 to 3, msg: msg_type: MsgHeartbeat to: 3, to: 3, from: 1, raft_id: 1
i1 | 2022-10-27 14:01:56.976 [54570] main/137/lua V> established connection to peer, raft_id: 3, peer: 127.0.0.1:3502
i3 | 2022-10-27 14:01:56.976 [54577] main/132/main V> Sending from 2 to 1, msg: msg_type: MsgHeartbeatResponse to: 1 commit: 15, to: 1, from: 2, raft_id: 2
i1 | 2022-10-27 14:01:56.977 [54570] main/122/lua V> received response, peer: 2
i2 | 2022-10-27 14:01:56.977 [54578] main/112/main I> received a message with higher term from 1, msg type: MsgHeartbeat, message_term: 2, term: 0, from: 1, raft_id: 3
i2 | 2022-10-27 14:01:56.977 [54578] main/112/main V> reset election timeout 35 -> 38 at 4, election_elapsed: 4, timeout: 38, prev_timeout: 35, raft_id: 3
i2 | 2022-10-27 14:01:56.977 [54578] main/112/main I> became follower at term 2, term: 2, raft_id: 3
i1 | 2022-10-27 14:01:56.977 [54570] main/136/main V> Sending from 1 to 2, msg: msg_type: MsgAppend to: 2 log_term: 2 index: 15 entries {entry_type: EntryConfChangeV2 term: 2 index: 16} commit: 15, to: 2, from: 1, raft_id: 1
i3 | 2022-10-27 14:01:56.977 [54577] main/117/lua V> received response, peer: 1
i3 | 2022-10-27 14:01:56.977 [54577] main/132/main V> Sending from 2 to 1, msg: msg_type: MsgAppendResponse to: 1 index: 16 commit: 15, to: 1, from: 2, raft_id: 2
i1 | 2022-10-27 14:01:56.978 [54570] main/122/lua V> received response, peer: 2
i2 | 2022-10-27 14:01:56.979 [54578] main/112/main V> Sending from 3 to 1, msg: msg_type: MsgHeartbeatResponse to: 1, to: 1, from: 3, raft_id: 3
i2 | 2022-10-27 14:01:56.980 [54578] main/115/raft_main_loop V> broadcast, event: raft.status-changed
i2 | 2022-10-27 14:01:56.980 [54578] main/103/interactive V> mutex was locked at src/traft/node.rs:877:44
i1 | 2022-10-27 14:01:56.980 [54570] main/137/lua V> received response, peer: 3
i3 | 2022-10-27 14:01:56.980 [54577] main/115/raft_main_loop V> persisted index 16, raft_id: 2
i2 | 2022-10-27 14:01:56.980 [54578] main/115/raft_main_loop node.rs:707 E> peer with id 1 not found
i2 | 2022-10-27 14:01:56.980 [54578] main/103/interactive V> Sending from 3 to 1, msg: msg_type: MsgReadIndex to: 1 entries {data: "\202\242lc\203\242id\003\243gen\001\245count\001\242op\201\244kind\243nop"}, to: 1, from: 3, raft_id: 3
i2 | 2022-10-27 14:01:56.980 [54578] main/115/raft_main_loop node.rs:707 E> peer with id 1 not found
i3 | 2022-10-27 14:01:56.981 [54577] main/117/lua V> received response, peer: 1
i1 | 2022-10-27 14:01:57.181 [54570] main/112/raft_main_loop V> Sending from 1 to 2, msg: msg_type: MsgHeartbeat to: 2 commit: 15, to: 2, from: 1, raft_id: 1
i3 | 2022-10-27 14:01:57.181 [54577] main/132/main V> Sending from 2 to 1, msg: msg_type: MsgHeartbeatResponse to: 1 commit: 15, to: 1, from: 2, raft_id: 2
i3 | 2022-10-27 14:01:57.182 [54577] main/117/lua V> received response, peer: 1
i1 | 2022-10-27 14:01:57.181 [54570] main/112/raft_main_loop V> Sending from 1 to 3, msg: msg_type: MsgHeartbeat to: 3, to: 3, from: 1, raft_id: 1
i1 | 2022-10-27 14:01:57.182 [54570] main/122/lua V> received response, peer: 2
i1 | 2022-10-27 14:01:57.182 [54570] main/137/lua V> received response, peer: 3
i2 | 2022-10-27 14:01:57.182 [54578] main/112/main V> Sending from 3 to 1, msg: msg_type: MsgHeartbeatResponse to: 1, to: 1, from: 3, raft_id: 3
i2 | 2022-10-27 14:01:57.182 [54578] main/115/raft_main_loop node.rs:707 E> peer with id 1 not found
i1 | 2022-10-27 14:01:57.383 [54570] main/112/raft_main_loop V> Sending from 1 to 2, msg: msg_type: MsgHeartbeat to: 2 commit: 15, to: 2, from: 1, raft_id: 1
i1 | 2022-10-27 14:01:57.383 [54570] main/112/raft_main_loop V> Sending from 1 to 3, msg: msg_type: MsgHeartbeat to: 3, to: 3, from: 1, raft_id: 1
i2 | 2022-10-27 14:01:57.383 [54578] main/112/main V> Sending from 3 to 1, msg: msg_type: MsgHeartbeatResponse to: 1, to: 1, from: 3, raft_id: 3
i2 | 2022-10-27 14:01:57.383 [54578] main/115/raft_main_loop node.rs:707 E> peer with id 1 not found
i3 | 2022-10-27 14:01:57.384 [54577] main/121/main V> Sending from 2 to 1, msg: msg_type: MsgHeartbeatResponse to: 1 commit: 15, to: 1, from: 2, raft_id: 2
i1 | 2022-10-27 14:01:57.384 [54570] main/137/lua V> received response, peer: 3
i1 | 2022-10-27 14:01:57.384 [54570] main/122/lua V> received response, peer: 2
i3 | 2022-10-27 14:01:57.384 [54577] main/117/lua V> received response, peer: 1
i1 | 2022-10-27 14:01:57.585 [54570] main/112/raft_main_loop V> Sending from 1 to 2, msg: msg_type: MsgHeartbeat to: 2 commit: 15, to: 2, from: 1, raft_id: 1
i1 | 2022-10-27 14:01:57.585 [54570] main/112/raft_main_loop V> Sending from 1 to 3, msg: msg_type: MsgHeartbeat to: 3, to: 3, from: 1, raft_id: 1
i3 | 2022-10-27 14:01:57.585 [54577] main/121/main V> Sending from 2 to 1, msg: msg_type: MsgHeartbeatResponse to: 1 commit: 15, to: 1, from: 2, raft_id: 2
i1 | 2022-10-27 14:01:57.586 [54570] main/122/lua V> received response, peer: 2
i2 | 2022-10-27 14:01:57.586 [54578] main/112/main V> Sending from 3 to 1, msg: msg_type: MsgHeartbeatResponse to: 1, to: 1, from: 3, raft_id: 3
i2 | 2022-10-27 14:01:57.586 [54578] main/115/raft_main_loop node.rs:707 E> peer with id 1 not found
i1 | 2022-10-27 14:01:57.586 [54570] main/137/lua V> received response, peer: 3
i3 | 2022-10-27 14:01:57.586 [54577] main/117/lua V> received response, peer: 1
i1 | 2022-10-27 14:01:57.787 [54570] main/112/raft_main_loop V> Sending from 1 to 2, msg: msg_type: MsgHeartbeat to: 2 commit: 15, to: 2, from: 1, raft_id: 1
i1 | 2022-10-27 14:01:57.787 [54570] main/112/raft_main_loop V> Sending from 1 to 3, msg: msg_type: MsgHeartbeat to: 3, to: 3, from: 1, raft_id: 1
i2 | 2022-10-27 14:01:57.788 [54578] main/112/main V> Sending from 3 to 1, msg: msg_type: MsgHeartbeatResponse to: 1, to: 1, from: 3, raft_id: 3
i2 | 2022-10-27 14:01:57.788 [54578] main/115/raft_main_loop node.rs:707 E> peer with id 1 not found
i3 | 2022-10-27 14:01:57.788 [54577] main/121/main V> Sending from 2 to 1, msg: msg_type: MsgHeartbeatResponse to: 1 commit: 15, to: 1, from: 2, raft_id: 2
i1 | 2022-10-27 14:01:57.788 [54570] main/137/lua V> received response, peer: 3
i1 | 2022-10-27 14:01:57.788 [54570] main/122/lua V> received response, peer: 2
i3 | 2022-10-27 14:01:57.789 [54577] main/117/lua V> received response, peer: 1
i1 | 2022-10-27 14:01:57.989 [54570] main/112/raft_main_loop V> Sending from 1 to 2, msg: msg_type: MsgHeartbeat to: 2 commit: 15, to: 2, from: 1, raft_id: 1
i1 | 2022-10-27 14:01:57.989 [54570] main/112/raft_main_loop V> Sending from 1 to 3, msg: msg_type: MsgHeartbeat to: 3, to: 3, from: 1, raft_id: 1
i3 | 2022-10-27 14:01:57.990 [54577] main/121/main V> Sending from 2 to 1, msg: msg_type: MsgHeartbeatResponse to: 1 commit: 15, to: 1, from: 2, raft_id: 2
i1 | 2022-10-27 14:01:57.990 [54570] main/122/lua V> received response, peer: 2
i2 | 2022-10-27 14:01:57.990 [54578] main/112/main V> Sending from 3 to 1, msg: msg_type: MsgHeartbeatResponse to: 1, to: 1, from: 3, raft_id: 3
i2 | 2022-10-27 14:01:57.990 [54578] main/115/raft_main_loop node.rs:707 E> peer with id 1 not found
i3 | 2022-10-27 14:01:57.990 [54577] main/117/lua V> received response, peer: 1
i1 | 2022-10-27 14:01:57.990 [54570] main/137/lua V> received response, peer: 3
i1 | 2022-10-27 14:01:58.191 [54570] main/112/raft_main_loop V> Sending from 1 to 2, msg: msg_type: MsgHeartbeat to: 2 commit: 15, to: 2, from: 1, raft_id: 1
i1 | 2022-10-27 14:01:58.191 [54570] main/112/raft_main_loop V> Sending from 1 to 3, msg: msg_type: MsgHeartbeat to: 3, to: 3, from: 1, raft_id: 1
i3 | 2022-10-27 14:01:58.192 [54577] main/121/main V> Sending from 2 to 1, msg: msg_type: MsgHeartbeatResponse to: 1 commit: 15, to: 1, from: 2, raft_id: 2
i1 | 2022-10-27 14:01:58.192 [54570] main/122/lua V> received response, peer: 2
i2 | 2022-10-27 14:01:58.192 [54578] main/112/main V> Sending from 3 to 1, msg: msg_type: MsgHeartbeatResponse to: 1, to: 1, from: 3, raft_id: 3
i2 | 2022-10-27 14:01:58.192 [54578] main/115/raft_main_loop node.rs:707 E> peer with id 1 not found
i3 | 2022-10-27 14:01:58.192 [54577] main/117/lua V> received response, peer: 1
i1 | 2022-10-27 14:01:58.192 [54570] main/137/lua V> received response, peer: 3
i1 | 2022-10-27 14:01:58.393 [54570] main/112/raft_main_loop V> Sending from 1 to 2, msg: msg_type: MsgHeartbeat to: 2 commit: 15, to: 2, from: 1, raft_id: 1
i1 | 2022-10-27 14:01:58.393 [54570] main/112/raft_main_loop V> Sending from 1 to 3, msg: msg_type: MsgHeartbeat to: 3, to: 3, from: 1, raft_id: 1
i3 | 2022-10-27 14:01:58.394 [54577] main/121/main V> Sending from 2 to 1, msg: msg_type: MsgHeartbeatResponse to: 1 commit: 15, to: 1, from: 2, raft_id: 2
i1 | 2022-10-27 14:01:58.394 [54570] main/122/lua V> received response, peer: 2
i2 | 2022-10-27 14:01:58.394 [54578] main/112/main V> Sending from 3 to 1, msg: msg_type: MsgHeartbeatResponse to: 1, to: 1, from: 3, raft_id: 3
i2 | 2022-10-27 14:01:58.394 [54578] main/115/raft_main_loop node.rs:707 E> peer with id 1 not found
i3 | 2022-10-27 14:01:58.394 [54577] main/117/lua V> received response, peer: 1
i1 | 2022-10-27 14:01:58.394 [54570] main/137/lua V> received response, peer: 3
i1 | 2022-10-27 14:01:58.595 [54570] main/112/raft_main_loop V> Sending from 1 to 2, msg: msg_type: MsgHeartbeat to: 2 commit: 15, to: 2, from: 1, raft_id: 1
i1 | 2022-10-27 14:01:58.595 [54570] main/112/raft_main_loop V> Sending from 1 to 3, msg: msg_type: MsgHeartbeat to: 3, to: 3, from: 1, raft_id: 1
i3 | 2022-10-27 14:01:58.596 [54577] main/121/main V> Sending from 2 to 1, msg: msg_type: MsgHeartbeatResponse to: 1 commit: 15, to: 1, from: 2, raft_id: 2
i1 | 2022-10-27 14:01:58.596 [54570] main/122/lua V> received response, peer: 2
i2 | 2022-10-27 14:01:58.596 [54578] main/112/main V> Sending from 3 to 1, msg: msg_type: MsgHeartbeatResponse to: 1, to: 1, from: 3, raft_id: 3
i2 | 2022-10-27 14:01:58.596 [54578] main/115/raft_main_loop node.rs:707 E> peer with id 1 not found
i1 | 2022-10-27 14:01:58.596 [54570] main/137/lua V> received response, peer: 3
i3 | 2022-10-27 14:01:58.596 [54577] main/117/lua V> received response, peer: 1
i1 | 2022-10-27 14:01:58.797 [54570] main/112/raft_main_loop V> Sending from 1 to 2, msg: msg_type: MsgHeartbeat to: 2 commit: 15, to: 2, from: 1, raft_id: 1
i1 | 2022-10-27 14:01:58.797 [54570] main/112/raft_main_loop V> Sending from 1 to 3, msg: msg_type: MsgHeartbeat to: 3, to: 3, from: 1, raft_id: 1
i2 | 2022-10-27 14:01:58.798 [54578] main/112/main V> Sending from 3 to 1, msg: msg_type: MsgHeartbeatResponse to: 1, to: 1, from: 3, raft_id: 3
i2 | 2022-10-27 14:01:58.798 [54578] main/115/raft_main_loop node.rs:707 E> peer with id 1 not found
i3 | 2022-10-27 14:01:58.799 [54577] main/121/main V> Sending from 2 to 1, msg: msg_type: MsgHeartbeatResponse to: 1 commit: 15, to: 1, from: 2, raft_id: 2
i1 | 2022-10-27 14:01:58.799 [54570] main/137/lua V> received response, peer: 3
i1 | 2022-10-27 14:01:58.799 [54570] main/122/lua V> received response, peer: 2
i3 | 2022-10-27 14:01:58.799 [54577] main/117/lua V> received response, peer: 1
i1 | 2022-10-27 14:01:59.000 [54570] main/112/raft_main_loop V> Sending from 1 to 2, msg: msg_type: MsgHeartbeat to: 2 commit: 15, to: 2, from: 1, raft_id: 1
i1 | 2022-10-27 14:01:59.000 [54570] main/112/raft_main_loop V> Sending from 1 to 3, msg: msg_type: MsgHeartbeat to: 3, to: 3, from: 1, raft_id: 1
i3 | 2022-10-27 14:01:59.000 [54577] main/121/main V> Sending from 2 to 1, msg: msg_type: MsgHeartbeatResponse to: 1 commit: 15, to: 1, from: 2, raft_id: 2
i1 | 2022-10-27 14:01:59.001 [54570] main/122/lua V> received response, peer: 2
i2 | 2022-10-27 14:01:59.001 [54578] main/112/main V> Sending from 3 to 1, msg: msg_type: MsgHeartbeatResponse to: 1, to: 1, from: 3, raft_id: 3
i2 | 2022-10-27 14:01:59.001 [54578] main/115/raft_main_loop node.rs:707 E> peer with id 1 not found
i1 | 2022-10-27 14:01:59.001 [54570] main/137/lua V> received response, peer: 3
i3 | 2022-10-27 14:01:59.001 [54577] main/117/lua V> received response, peer: 1
i1 | 2022-10-27 14:01:59.202 [54570] main/112/raft_main_loop V> Sending from 1 to 2, msg: msg_type: MsgHeartbeat to: 2 commit: 15, to: 2, from: 1, raft_id: 1
i1 | 2022-10-27 14:01:59.203 [54570] main/112/raft_main_loop V> Sending from 1 to 3, msg: msg_type: MsgHeartbeat to: 3, to: 3, from: 1, raft_id: 1
i3 | 2022-10-27 14:01:59.203 [54577] main/121/main V> Sending from 2 to 1, msg: msg_type: MsgHeartbeatResponse to: 1 commit: 15, to: 1, from: 2, raft_id: 2
i1 | 2022-10-27 14:01:59.203 [54570] main/122/lua V> received response, peer: 2
i2 | 2022-10-27 14:01:59.203 [54578] main/112/main V> Sending from 3 to 1, msg: msg_type: MsgHeartbeatResponse to: 1, to: 1, from: 3, raft_id: 3
i3 | 2022-10-27 14:01:59.204 [54577] main/117/lua V> received response, peer: 1
i1 | 2022-10-27 14:01:59.204 [54570] main/137/lua V> received response, peer: 3
i2 | 2022-10-27 14:01:59.204 [54578] main/115/raft_main_loop node.rs:707 E> peer with id 1 not found
i1 | 2022-10-27 14:01:59.404 [54570] main/112/raft_main_loop V> Sending from 1 to 2, msg: msg_type: MsgHeartbeat to: 2 commit: 15, to: 2, from: 1, raft_id: 1
i1 | 2022-10-27 14:01:59.404 [54570] main/112/raft_main_loop V> Sending from 1 to 3, msg: msg_type: MsgHeartbeat to: 3, to: 3, from: 1, raft_id: 1
i1 | 2022-10-27 14:01:59.405 [54570] main/122/lua V> received response, peer: 2
i3 | 2022-10-27 14:01:59.405 [54577] main/121/main V> Sending from 2 to 1, msg: msg_type: MsgHeartbeatResponse to: 1 commit: 15, to: 1, from: 2, raft_id: 2
i1 | 2022-10-27 14:01:59.405 [54570] main/137/lua V> received response, peer: 3
i3 | 2022-10-27 14:01:59.406 [54577] main/117/lua V> received response, peer: 1
i2 | 2022-10-27 14:01:59.405 [54578] main/112/main V> Sending from 3 to 1, msg: msg_type: MsgHeartbeatResponse to: 1, to: 1, from: 3, raft_id: 3
i2 | 2022-10-27 14:01:59.405 [54578] main/115/raft_main_loop node.rs:707 E> peer with id 1 not found
i1 | 2022-10-27 14:01:59.606 [54570] main/112/raft_main_loop V> Sending from 1 to 2, msg: msg_type: MsgHeartbeat to: 2 commit: 15, to: 2, from: 1, raft_id: 1
i1 | 2022-10-27 14:01:59.606 [54570] main/112/raft_main_loop V> Sending from 1 to 3, msg: msg_type: MsgHeartbeat to: 3, to: 3, from: 1, raft_id: 1
i2 | 2022-10-27 14:01:59.607 [54578] main/112/main V> Sending from 3 to 1, msg: msg_type: MsgHeartbeatResponse to: 1, to: 1, from: 3, raft_id: 3
i3 | 2022-10-27 14:01:59.607 [54577] main/121/main V> Sending from 2 to 1, msg: msg_type: MsgHeartbeatResponse to: 1 commit: 15, to: 1, from: 2, raft_id: 2
i2 | 2022-10-27 14:01:59.607 [54578] main/115/raft_main_loop node.rs:707 E> peer with id 1 not found
i1 | 2022-10-27 14:01:59.607 [54570] main/122/lua V> received response, peer: 2
i1 | 2022-10-27 14:01:59.607 [54570] main/137/lua V> received response, peer: 3
i3 | 2022-10-27 14:01:59.607 [54577] main/117/lua V> received response, peer: 1
i1 | 2022-10-27 14:01:59.808 [54570] main/112/raft_main_loop V> Sending from 1 to 2, msg: msg_type: MsgHeartbeat to: 2 commit: 15, to: 2, from: 1, raft_id: 1
i1 | 2022-10-27 14:01:59.808 [54570] main/112/raft_main_loop V> Sending from 1 to 3, msg: msg_type: MsgHeartbeat to: 3, to: 3, from: 1, raft_id: 1
i2 | 2022-10-27 14:01:59.809 [54578] main/112/main V> Sending from 3 to 1, msg: msg_type: MsgHeartbeatResponse to: 1, to: 1, from: 3, raft_id: 3
i3 | 2022-10-27 14:01:59.809 [54577] main/121/main V> Sending from 2 to 1, msg: msg_type: MsgHeartbeatResponse to: 1 commit: 15, to: 1, from: 2, raft_id: 2
i2 | 2022-10-27 14:01:59.809 [54578] main/115/raft_main_loop node.rs:707 E> peer with id 1 not found
i1 | 2022-10-27 14:01:59.809 [54570] main/122/lua V> received response, peer: 2
i1 | 2022-10-27 14:01:59.809 [54570] main/137/lua V> received response, peer: 3
i3 | 2022-10-27 14:01:59.809 [54577] main/117/lua V> received response, peer: 1
i1 | 2022-10-27 14:02:00.010 [54570] main/112/raft_main_loop V> Sending from 1 to 2, msg: msg_type: MsgHeartbeat to: 2 commit: 15, to: 2, from: 1, raft_id: 1
i1 | 2022-10-27 14:02:00.010 [54570] main/112/raft_main_loop V> Sending from 1 to 3, msg: msg_type: MsgHeartbeat to: 3, to: 3, from: 1, raft_id: 1
i3 | 2022-10-27 14:02:00.010 [54577] main/121/main V> Sending from 2 to 1, msg: msg_type: MsgHeartbeatResponse to: 1 commit: 15, to: 1, from: 2, raft_id: 2
i2 | 2022-10-27 14:02:00.010 [54578] main/112/main V> Sending from 3 to 1, msg: msg_type: MsgHeartbeatResponse to: 1, to: 1, from: 3, raft_id: 3
i2 | 2022-10-27 14:02:00.011 [54578] main/115/raft_main_loop node.rs:707 E> peer with id 1 not found
i1 | 2022-10-27 14:02:00.011 [54570] main/122/lua V> received response, peer: 2
i1 | 2022-10-27 14:02:00.011 [54570] main/137/lua V> received response, peer: 3
i3 | 2022-10-27 14:02:00.011 [54577] main/117/lua V> received response, peer: 1
i1 | 2022-10-27 14:02:00.212 [54570] main/112/raft_main_loop V> Sending from 1 to 2, msg: msg_type: MsgHeartbeat to: 2 commit: 15, to: 2, from: 1, raft_id: 1
i3 | 2022-10-27 14:02:00.212 [54577] main/121/main V> Sending from 2 to 1, msg: msg_type: MsgHeartbeatResponse to: 1 commit: 15, to: 1, from: 2, raft_id: 2
i2 | 2022-10-27 14:02:00.212 [54578] main/112/main V> Sending from 3 to 1, msg: msg_type: MsgHeartbeatResponse to: 1, to: 1, from: 3, raft_id: 3
i1 | 2022-10-27 14:02:00.212 [54570] main/112/raft_main_loop V> Sending from 1 to 3, msg: msg_type: MsgHeartbeat to: 3, to: 3, from: 1, raft_id: 1
i1 | 2022-10-27 14:02:00.213 [54570] main/122/lua V> received response, peer: 2
i1 | 2022-10-27 14:02:00.213 [54570] main/137/lua V> received response, peer: 3
i3 | 2022-10-27 14:02:00.213 [54577] main/117/lua V> received response, peer: 1
i2 | 2022-10-27 14:02:00.213 [54578] main/115/raft_main_loop node.rs:707 E> peer with id 1 not found
i1 | 2022-10-27 14:02:00.414 [54570] main/112/raft_main_loop V> Sending from 1 to 2, msg: msg_type: MsgHeartbeat to: 2 commit: 15, to: 2, from: 1, raft_id: 1
i1 | 2022-10-27 14:02:00.414 [54570] main/112/raft_main_loop V> Sending from 1 to 3, msg: msg_type: MsgHeartbeat to: 3, to: 3, from: 1, raft_id: 1
i3 | 2022-10-27 14:02:00.414 [54577] main/121/main V> Sending from 2 to 1, msg: msg_type: MsgHeartbeatResponse to: 1 commit: 15, to: 1, from: 2, raft_id: 2
i2 | 2022-10-27 14:02:00.414 [54578] main/112/main V> Sending from 3 to 1, msg: msg_type: MsgHeartbeatResponse to: 1, to: 1, from: 3, raft_id: 3
i2 | 2022-10-27 14:02:00.414 [54578] main/115/raft_main_loop node.rs:707 E> peer with id 1 not found
i1 | 2022-10-27 14:02:00.415 [54570] main/122/lua V> received response, peer: 2
i1 | 2022-10-27 14:02:00.415 [54570] main/137/lua V> received response, peer: 3
i3 | 2022-10-27 14:02:00.415 [54577] main/117/lua V> received response, peer: 1
i1 | 2022-10-27 14:02:00.616 [54570] main/112/raft_main_loop V> Sending from 1 to 2, msg: msg_type: MsgHeartbeat to: 2 commit: 15, to: 2, from: 1, raft_id: 1
i1 | 2022-10-27 14:02:00.616 [54570] main/112/raft_main_loop V> Sending from 1 to 3, msg: msg_type: MsgHeartbeat to: 3, to: 3, from: 1, raft_id: 1
i3 | 2022-10-27 14:02:00.616 [54577] main/121/main V> Sending from 2 to 1, msg: msg_type: MsgHeartbeatResponse to: 1 commit: 15, to: 1, from: 2, raft_id: 2
i1 | 2022-10-27 14:02:00.617 [54570] main/122/lua V> received response, peer: 2
i3 | 2022-10-27 14:02:00.617 [54577] main/117/lua V> received response, peer: 1
i1 | 2022-10-27 14:02:00.617 [54570] main/137/lua V> received response, peer: 3
i2 | 2022-10-27 14:02:00.616 [54578] main/112/main V> Sending from 3 to 1, msg: msg_type: MsgHeartbeatResponse to: 1, to: 1, from: 3, raft_id: 3
i2 | 2022-10-27 14:02:00.616 [54578] main/115/raft_main_loop node.rs:707 E> peer with id 1 not found
i1 | 2022-10-27 14:02:00.818 [54570] main/112/raft_main_loop V> Sending from 1 to 2, msg: msg_type: MsgHeartbeat to: 2 commit: 15, to: 2, from: 1, raft_id: 1
i3 | 2022-10-27 14:02:00.819 [54577] main/121/main V> Sending from 2 to 1, msg: msg_type: MsgHeartbeatResponse to: 1 commit: 15, to: 1, from: 2, raft_id: 2
i3 | 2022-10-27 14:02:00.820 [54577] main/117/lua V> received response, peer: 1
i1 | 2022-10-27 14:02:00.818 [54570] main/112/raft_main_loop V> Sending from 1 to 3, msg: msg_type: MsgHeartbeat to: 3, to: 3, from: 1, raft_id: 1
i1 | 2022-10-27 14:02:00.819 [54570] main/122/lua V> received response, peer: 2
i1 | 2022-10-27 14:02:00.820 [54570] main/137/lua V> received response, peer: 3
i2 | 2022-10-27 14:02:00.819 [54578] main/112/main V> Sending from 3 to 1, msg: msg_type: MsgHeartbeatResponse to: 1, to: 1, from: 3, raft_id: 3
i2 | 2022-10-27 14:02:00.819 [54578] main/115/raft_main_loop node.rs:707 E> peer with id 1 not found
i1 | 2022-10-27 14:02:01.020 [54570] main/112/raft_main_loop V> Sending from 1 to 2, msg: msg_type: MsgHeartbeat to: 2 commit: 15, to: 2, from: 1, raft_id: 1
i1 | 2022-10-27 14:02:01.020 [54570] main/112/raft_main_loop V> Sending from 1 to 3, msg: msg_type: MsgHeartbeat to: 3, to: 3, from: 1, raft_id: 1
i3 | 2022-10-27 14:02:01.021 [54577] main/121/main V> Sending from 2 to 1, msg: msg_type: MsgHeartbeatResponse to: 1 commit: 15, to: 1, from: 2, raft_id: 2
i2 | 2022-10-27 14:02:01.021 [54578] main/112/main V> Sending from 3 to 1, msg: msg_type: MsgHeartbeatResponse to: 1, to: 1, from: 3, raft_id: 3
i2 | 2022-10-27 14:02:01.021 [54578] main/115/raft_main_loop node.rs:707 E> peer with id 1 not found
i1 | 2022-10-27 14:02:01.021 [54570] main/122/lua V> received response, peer: 2
i1 | 2022-10-27 14:02:01.022 [54570] main/137/lua V> received response, peer: 3
i3 | 2022-10-27 14:02:01.022 [54577] main/117/lua V> received response, peer: 1
i1 | 2022-10-27 14:02:01.222 [54570] main/112/raft_main_loop V> Sending from 1 to 2, msg: msg_type: MsgHeartbeat to: 2 commit: 15, to: 2, from: 1, raft_id: 1
i1 | 2022-10-27 14:02:01.222 [54570] main/112/raft_main_loop V> Sending from 1 to 3, msg: msg_type: MsgHeartbeat to: 3, to: 3, from: 1, raft_id: 1
i2 | 2022-10-27 14:02:01.223 [54578] main/112/main V> Sending from 3 to 1, msg: msg_type: MsgHeartbeatResponse to: 1, to: 1, from: 3, raft_id: 3
i3 | 2022-10-27 14:02:01.223 [54577] main/121/main V> Sending from 2 to 1, msg: msg_type: MsgHeartbeatResponse to: 1 commit: 15, to: 1, from: 2, raft_id: 2
i2 | 2022-10-27 14:02:01.223 [54578] main/115/raft_main_loop node.rs:707 E> peer with id 1 not found
i1 | 2022-10-27 14:02:01.224 [54570] main/122/lua V> received response, peer: 2
i1 | 2022-10-27 14:02:01.224 [54570] main/137/lua V> received response, peer: 3
i3 | 2022-10-27 14:02:01.224 [54577] main/117/lua V> received response, peer: 1
i1 | 2022-10-27 14:02:01.424 [54570] main/112/raft_main_loop V> Sending from 1 to 2, msg: msg_type: MsgHeartbeat to: 2 commit: 15, to: 2, from: 1, raft_id: 1
i1 | 2022-10-27 14:02:01.425 [54570] main/112/raft_main_loop V> Sending from 1 to 3, msg: msg_type: MsgHeartbeat to: 3, to: 3, from: 1, raft_id: 1
i3 | 2022-10-27 14:02:01.425 [54577] main/121/main V> Sending from 2 to 1, msg: msg_type: MsgHeartbeatResponse to: 1 commit: 15, to: 1, from: 2, raft_id: 2
i2 | 2022-10-27 14:02:01.425 [54578] main/112/main V> Sending from 3 to 1, msg: msg_type: MsgHeartbeatResponse to: 1, to: 1, from: 3, raft_id: 3
i2 | 2022-10-27 14:02:01.425 [54578] main/115/raft_main_loop node.rs:707 E> peer with id 1 not found
i1 | 2022-10-27 14:02:01.426 [54570] main/122/lua V> received response, peer: 2
i1 | 2022-10-27 14:02:01.426 [54570] main/137/lua V> received response, peer: 3
i3 | 2022-10-27 14:02:01.426 [54577] main/117/lua V> received response, peer: 1
i1 | 2022-10-27 14:02:01.626 [54570] main/112/raft_main_loop V> Sending from 1 to 2, msg: msg_type: MsgHeartbeat to: 2 commit: 15, to: 2, from: 1, raft_id: 1
i1 | 2022-10-27 14:02:01.627 [54570] main/112/raft_main_loop V> Sending from 1 to 3, msg: msg_type: MsgHeartbeat to: 3, to: 3, from: 1, raft_id: 1
i3 | 2022-10-27 14:02:01.627 [54577] main/121/main V> Sending from 2 to 1, msg: msg_type: MsgHeartbeatResponse to: 1 commit: 15, to: 1, from: 2, raft_id: 2
i2 | 2022-10-27 14:02:01.627 [54578] main/112/main V> Sending from 3 to 1, msg: msg_type: MsgHeartbeatResponse to: 1, to: 1, from: 3, raft_id: 3
i2 | 2022-10-27 14:02:01.627 [54578] main/115/raft_main_loop node.rs:707 E> peer with id 1 not found
i1 | 2022-10-27 14:02:01.628 [54570] main/122/lua V> received response, peer: 2
i1 | 2022-10-27 14:02:01.628 [54570] main/137/lua V> received response, peer: 3
i3 | 2022-10-27 14:02:01.628 [54577] main/117/lua V> received response, peer: 1
i1 | 2022-10-27 14:02:01.829 [54570] main/112/raft_main_loop V> Sending from 1 to 2, msg: msg_type: MsgHeartbeat to: 2 commit: 15, to: 2, from: 1, raft_id: 1
i1 | 2022-10-27 14:02:01.829 [54570] main/112/raft_main_loop V> Sending from 1 to 3, msg: msg_type: MsgHeartbeat to: 3, to: 3, from: 1, raft_id: 1
i3 | 2022-10-27 14:02:01.830 [54577] main/121/main V> Sending from 2 to 1, msg: msg_type: MsgHeartbeatResponse to: 1 commit: 15, to: 1, from: 2, raft_id: 2
i2 | 2022-10-27 14:02:01.830 [54578] main/112/main V> Sending from 3 to 1, msg: msg_type: MsgHeartbeatResponse to: 1, to: 1, from: 3, raft_id: 3
i2 | 2022-10-27 14:02:01.830 [54578] main/115/raft_main_loop node.rs:707 E> peer with id 1 not found
i1 | 2022-10-27 14:02:01.830 [54570] main/122/lua V> received response, peer: 2
i1 | 2022-10-27 14:02:01.830 [54570] main/137/lua V> received response, peer: 3
i3 | 2022-10-27 14:02:01.830 [54577] main/117/lua V> received response, peer: 1
i1 | 2022-10-27 14:02:02.031 [54570] main/112/raft_main_loop V> Sending from 1 to 2, msg: msg_type: MsgHeartbeat to: 2 commit: 15, to: 2, from: 1, raft_id: 1
i1 | 2022-10-27 14:02:02.031 [54570] main/112/raft_main_loop V> Sending from 1 to 3, msg: msg_type: MsgHeartbeat to: 3, to: 3, from: 1, raft_id: 1
i3 | 2022-10-27 14:02:02.032 [54577] main/121/main V> Sending from 2 to 1, msg: msg_type: MsgHeartbeatResponse to: 1 commit: 15, to: 1, from: 2, raft_id: 2
i2 | 2022-10-27 14:02:02.032 [54578] main/112/main V> Sending from 3 to 1, msg: msg_type: MsgHeartbeatResponse to: 1, to: 1, from: 3, raft_id: 3
i2 | 2022-10-27 14:02:02.032 [54578] main/115/raft_main_loop node.rs:707 E> peer with id 1 not found
i1 | 2022-10-27 14:02:02.032 [54570] main/122/lua V> received response, peer: 2
i1 | 2022-10-27 14:02:02.032 [54570] main/137/lua V> received response, peer: 3
i3 | 2022-10-27 14:02:02.032 [54577] main/117/lua V> received response, peer: 1
i1 | 2022-10-27 14:02:02.233 [54570] main/112/raft_main_loop V> Sending from 1 to 2, msg: msg_type: MsgHeartbeat to: 2 commit: 15, to: 2, from: 1, raft_id: 1
i1 | 2022-10-27 14:02:02.233 [54570] main/112/raft_main_loop V> Sending from 1 to 3, msg: msg_type: MsgHeartbeat to: 3, to: 3, from: 1, raft_id: 1
i2 | 2022-10-27 14:02:02.234 [54578] main/112/main V> Sending from 3 to 1, msg: msg_type: MsgHeartbeatResponse to: 1, to: 1, from: 3, raft_id: 3
i3 | 2022-10-27 14:02:02.234 [54577] main/121/main V> Sending from 2 to 1, msg: msg_type: MsgHeartbeatResponse to: 1 commit: 15, to: 1, from: 2, raft_id: 2
i2 | 2022-10-27 14:02:02.234 [54578] main/115/raft_main_loop node.rs:707 E> peer with id 1 not found
i1 | 2022-10-27 14:02:02.234 [54570] main/122/lua V> received response, peer: 2
i1 | 2022-10-27 14:02:02.234 [54570] main/137/lua V> received response, peer: 3
i3 | 2022-10-27 14:02:02.235 [54577] main/117/lua V> received response, peer: 1
i1 | 2022-10-27 14:02:02.435 [54570] main/112/raft_main_loop V> Sending from 1 to 2, msg: msg_type: MsgHeartbeat to: 2 commit: 15, to: 2, from: 1, raft_id: 1
i1 | 2022-10-27 14:02:02.435 [54570] main/112/raft_main_loop V> Sending from 1 to 3, msg: msg_type: MsgHeartbeat to: 3, to: 3, from: 1, raft_id: 1
i2 | 2022-10-27 14:02:02.435 [54578] main/112/main V> Sending from 3 to 1, msg: msg_type: MsgHeartbeatResponse to: 1, to: 1, from: 3, raft_id: 3
i3 | 2022-10-27 14:02:02.435 [54577] main/121/main V> Sending from 2 to 1, msg: msg_type: MsgHeartbeatResponse to: 1 commit: 15, to: 1, from: 2, raft_id: 2
i2 | 2022-10-27 14:02:02.436 [54578] main/115/raft_main_loop node.rs:707 E> peer with id 1 not found
i1 | 2022-10-27 14:02:02.436 [54570] main/122/lua V> received response, peer: 2
i1 | 2022-10-27 14:02:02.436 [54570] main/137/lua V> received response, peer: 3
i3 | 2022-10-27 14:02:02.436 [54577] main/117/lua V> received response, peer: 1
i1 | 2022-10-27 14:02:02.637 [54570] main/112/raft_main_loop V> Sending from 1 to 2, msg: msg_type: MsgHeartbeat to: 2 commit: 15, to: 2, from: 1, raft_id: 1
i1 | 2022-10-27 14:02:02.637 [54570] main/112/raft_main_loop V> Sending from 1 to 3, msg: msg_type: MsgHeartbeat to: 3, to: 3, from: 1, raft_id: 1
i2 | 2022-10-27 14:02:02.637 [54578] main/112/main V> Sending from 3 to 1, msg: msg_type: MsgHeartbeatResponse to: 1, to: 1, from: 3, raft_id: 3
i3 | 2022-10-27 14:02:02.637 [54577] main/121/main V> Sending from 2 to 1, msg: msg_type: MsgHeartbeatResponse to: 1 commit: 15, to: 1, from: 2, raft_id: 2
i2 | 2022-10-27 14:02:02.638 [54578] main/115/raft_main_loop node.rs:707 E> peer with id 1 not found
i1 | 2022-10-27 14:02:02.638 [54570] main/122/lua V> received response, peer: 2
i1 | 2022-10-27 14:02:02.638 [54570] main/137/lua V> received response, peer: 3
i3 | 2022-10-27 14:02:02.638 [54577] main/117/lua V> received response, peer: 1
i1 | 2022-10-27 14:02:02.839 [54570] main/112/raft_main_loop V> Sending from 1 to 2, msg: msg_type: MsgHeartbeat to: 2 commit: 15, to: 2, from: 1, raft_id: 1
i1 | 2022-10-27 14:02:02.840 [54570] main/112/raft_main_loop V> Sending from 1 to 3, msg: msg_type: MsgHeartbeat to: 3, to: 3, from: 1, raft_id: 1
i3 | 2022-10-27 14:02:02.840 [54577] main/121/main V> Sending from 2 to 1, msg: msg_type: MsgHeartbeatResponse to: 1 commit: 15, to: 1, from: 2, raft_id: 2
i2 | 2022-10-27 14:02:02.841 [54578] main/112/main V> Sending from 3 to 1, msg: msg_type: MsgHeartbeatResponse to: 1, to: 1, from: 3, raft_id: 3
i2 | 2022-10-27 14:02:02.841 [54578] main/115/raft_main_loop node.rs:707 E> peer with id 1 not found
i1 | 2022-10-27 14:02:02.841 [54570] main/122/lua V> received response, peer: 2
i3 | 2022-10-27 14:02:02.841 [54577] main/117/lua V> received response, peer: 1
i1 | 2022-10-27 14:02:02.841 [54570] main/137/lua V> received response, peer: 3
i1 | 2022-10-27 14:02:03.042 [54570] main/112/raft_main_loop V> Sending from 1 to 2, msg: msg_type: MsgHeartbeat to: 2 commit: 15, to: 2, from: 1, raft_id: 1
i1 | 2022-10-27 14:02:03.042 [54570] main/112/raft_main_loop V> Sending from 1 to 3, msg: msg_type: MsgHeartbeat to: 3, to: 3, from: 1, raft_id: 1
i3 | 2022-10-27 14:02:03.042 [54577] main/121/main V> Sending from 2 to 1, msg: msg_type: MsgHeartbeatResponse to: 1 commit: 15, to: 1, from: 2, raft_id: 2
i2 | 2022-10-27 14:02:03.043 [54578] main/112/main V> Sending from 3 to 1, msg: msg_type: MsgHeartbeatResponse to: 1, to: 1, from: 3, raft_id: 3
i2 | 2022-10-27 14:02:03.043 [54578] main/115/raft_main_loop node.rs:707 E> peer with id 1 not found
i1 | 2022-10-27 14:02:03.043 [54570] main/122/lua V> received response, peer: 2
i3 | 2022-10-27 14:02:03.043 [54577] main/117/lua V> received response, peer: 1
i1 | 2022-10-27 14:02:03.043 [54570] main/137/lua V> received response, peer: 3
i1 | 2022-10-27 14:02:03.244 [54570] main/112/raft_main_loop V> Sending from 1 to 2, msg: msg_type: MsgHeartbeat to: 2 commit: 15, to: 2, from: 1, raft_id: 1
i1 | 2022-10-27 14:02:03.244 [54570] main/112/raft_main_loop V> Sending from 1 to 3, msg: msg_type: MsgHeartbeat to: 3, to: 3, from: 1, raft_id: 1
i3 | 2022-10-27 14:02:03.245 [54577] main/121/main V> Sending from 2 to 1, msg: msg_type: MsgHeartbeatResponse to: 1 commit: 15, to: 1, from: 2, raft_id: 2
i2 | 2022-10-27 14:02:03.245 [54578] main/112/main V> Sending from 3 to 1, msg: msg_type: MsgHeartbeatResponse to: 1, to: 1, from: 3, raft_id: 3
i2 | 2022-10-27 14:02:03.245 [54578] main/115/raft_main_loop node.rs:707 E> peer with id 1 not found
i1 | 2022-10-27 14:02:03.245 [54570] main/122/lua V> received response, peer: 2
i3 | 2022-10-27 14:02:03.246 [54577] main/117/lua V> received response, peer: 1
i1 | 2022-10-27 14:02:03.246 [54570] main/137/lua V> received response, peer: 3
i1 | 2022-10-27 14:02:03.446 [54570] main/112/raft_main_loop V> Sending from 1 to 2, msg: msg_type: MsgHeartbeat to: 2 commit: 15, to: 2, from: 1, raft_id: 1
i1 | 2022-10-27 14:02:03.446 [54570] main/112/raft_main_loop V> Sending from 1 to 3, msg: msg_type: MsgHeartbeat to: 3, to: 3, from: 1, raft_id: 1
i3 | 2022-10-27 14:02:03.446 [54577] main/121/main V> Sending from 2 to 1, msg: msg_type: MsgHeartbeatResponse to: 1 commit: 15, to: 1, from: 2, raft_id: 2
i2 | 2022-10-27 14:02:03.447 [54578] main/112/main V> Sending from 3 to 1, msg: msg_type: MsgHeartbeatResponse to: 1, to: 1, from: 3, raft_id: 3
i2 | 2022-10-27 14:02:03.447 [54578] main/115/raft_main_loop node.rs:707 E> peer with id 1 not found
i1 | 2022-10-27 14:02:03.447 [54570] main/122/lua V> received response, peer: 2
i3 | 2022-10-27 14:02:03.447 [54577] main/117/lua V> received response, peer: 1
i1 | 2022-10-27 14:02:03.447 [54570] main/137/lua V> received response, peer: 3
i1 | 2022-10-27 14:02:03.648 [54570] main/112/raft_main_loop V> Sending from 1 to 2, msg: msg_type: MsgHeartbeat to: 2 commit: 15, to: 2, from: 1, raft_id: 1
i1 | 2022-10-27 14:02:03.648 [54570] main/112/raft_main_loop V> Sending from 1 to 3, msg: msg_type: MsgHeartbeat to: 3, to: 3, from: 1, raft_id: 1
i3 | 2022-10-27 14:02:03.649 [54577] main/121/main V> Sending from 2 to 1, msg: msg_type: MsgHeartbeatResponse to: 1 commit: 15, to: 1, from: 2, raft_id: 2
i2 | 2022-10-27 14:02:03.649 [54578] main/112/main V> Sending from 3 to 1, msg: msg_type: MsgHeartbeatResponse to: 1, to: 1, from: 3, raft_id: 3
i2 | 2022-10-27 14:02:03.649 [54578] main/115/raft_main_loop node.rs:707 E> peer with id 1 not found
i1 | 2022-10-27 14:02:03.649 [54570] main/122/lua V> received response, peer: 2
i3 | 2022-10-27 14:02:03.649 [54577] main/117/lua V> received response, peer: 1
i1 | 2022-10-27 14:02:03.650 [54570] main/137/lua V> received response, peer: 3
i1 | 2022-10-27 14:02:03.850 [54570] main/112/raft_main_loop V> Sending from 1 to 2, msg: msg_type: MsgHeartbeat to: 2 commit: 15, to: 2, from: 1, raft_id: 1
i1 | 2022-10-27 14:02:03.850 [54570] main/112/raft_main_loop V> Sending from 1 to 3, msg: msg_type: MsgHeartbeat to: 3, to: 3, from: 1, raft_id: 1
i3 | 2022-10-27 14:02:03.851 [54577] main/121/main V> Sending from 2 to 1, msg: msg_type: MsgHeartbeatResponse to: 1 commit: 15, to: 1, from: 2, raft_id: 2
i2 | 2022-10-27 14:02:03.851 [54578] main/112/main V> Sending from 3 to 1, msg: msg_type: MsgHeartbeatResponse to: 1, to: 1, from: 3, raft_id: 3
i2 | 2022-10-27 14:02:03.851 [54578] main/115/raft_main_loop node.rs:707 E> peer with id 1 not found
i1 | 2022-10-27 14:02:03.851 [54570] main/122/lua V> received response, peer: 2
i3 | 2022-10-27 14:02:03.852 [54577] main/117/lua V> received response, peer: 1
i1 | 2022-10-27 14:02:03.852 [54570] main/137/lua V> received response, peer: 3
i1 | 2022-10-27 14:02:04.052 [54570] main/112/raft_main_loop V> Sending from 1 to 2, msg: msg_type: MsgHeartbeat to: 2 commit: 15, to: 2, from: 1, raft_id: 1
i1 | 2022-10-27 14:02:04.052 [54570] main/112/raft_main_loop V> Sending from 1 to 3, msg: msg_type: MsgHeartbeat to: 3, to: 3, from: 1, raft_id: 1
i3 | 2022-10-27 14:02:04.052 [54577] main/121/main V> Sending from 2 to 1, msg: msg_type: MsgHeartbeatResponse to: 1 commit: 15, to: 1, from: 2, raft_id: 2
i2 | 2022-10-27 14:02:04.053 [54578] main/112/main V> Sending from 3 to 1, msg: msg_type: MsgHeartbeatResponse to: 1, to: 1, from: 3, raft_id: 3
i2 | 2022-10-27 14:02:04.053 [54578] main/115/raft_main_loop node.rs:707 E> peer with id 1 not found
i1 | 2022-10-27 14:02:04.053 [54570] main/122/lua V> received response, peer: 2
i3 | 2022-10-27 14:02:04.053 [54577] main/117/lua V> received response, peer: 1
i1 | 2022-10-27 14:02:04.053 [54570] main/137/lua V> received response, peer: 3
i1 | 2022-10-27 14:02:04.254 [54570] main/112/raft_main_loop V> Sending from 1 to 2, msg: msg_type: MsgHeartbeat to: 2 commit: 15, to: 2, from: 1, raft_id: 1
i1 | 2022-10-27 14:02:04.254 [54570] main/112/raft_main_loop V> Sending from 1 to 3, msg: msg_type: MsgHeartbeat to: 3, to: 3, from: 1, raft_id: 1
i3 | 2022-10-27 14:02:04.255 [54577] main/121/main V> Sending from 2 to 1, msg: msg_type: MsgHeartbeatResponse to: 1 commit: 15, to: 1, from: 2, raft_id: 2
i2 | 2022-10-27 14:02:04.255 [54578] main/112/main V> Sending from 3 to 1, msg: msg_type: MsgHeartbeatResponse to: 1, to: 1, from: 3, raft_id: 3
i2 | 2022-10-27 14:02:04.255 [54578] main/115/raft_main_loop node.rs:707 E> peer with id 1 not found
i1 | 2022-10-27 14:02:04.255 [54570] main/122/lua V> received response, peer: 2
i3 | 2022-10-27 14:02:04.255 [54577] main/117/lua V> received response, peer: 1
i1 | 2022-10-27 14:02:04.256 [54570] main/137/lua V> received response, peer: 3
i1 | 2022-10-27 14:02:04.457 [54570] main/112/raft_main_loop V> Sending from 1 to 2, msg: msg_type: MsgHeartbeat to: 2 commit: 15, to: 2, from: 1, raft_id: 1
i1 | 2022-10-27 14:02:04.457 [54570] main/112/raft_main_loop V> Sending from 1 to 3, msg: msg_type: MsgHeartbeat to: 3, to: 3, from: 1, raft_id: 1
i3 | 2022-10-27 14:02:04.458 [54577] main/121/main V> Sending from 2 to 1, msg: msg_type: MsgHeartbeatResponse to: 1 commit: 15, to: 1, from: 2, raft_id: 2
i2 | 2022-10-27 14:02:04.458 [54578] main/112/main V> Sending from 3 to 1, msg: msg_type: MsgHeartbeatResponse to: 1, to: 1, from: 3, raft_id: 3
i2 | 2022-10-27 14:02:04.458 [54578] main/115/raft_main_loop node.rs:707 E> peer with id 1 not found
i1 | 2022-10-27 14:02:04.458 [54570] main/122/lua V> received response, peer: 2
i3 | 2022-10-27 14:02:04.458 [54577] main/117/lua V> received response, peer: 1
i1 | 2022-10-27 14:02:04.458 [54570] main/137/lua V> received response, peer: 3
i1 | 2022-10-27 14:02:04.659 [54570] main/112/raft_main_loop V> Sending from 1 to 2, msg: msg_type: MsgHeartbeat to: 2 commit: 15, to: 2, from: 1, raft_id: 1
i1 | 2022-10-27 14:02:04.659 [54570] main/112/raft_main_loop V> Sending from 1 to 3, msg: msg_type: MsgHeartbeat to: 3, to: 3, from: 1, raft_id: 1
i3 | 2022-10-27 14:02:04.660 [54577] main/121/main V> Sending from 2 to 1, msg: msg_type: MsgHeartbeatResponse to: 1 commit: 15, to: 1, from: 2, raft_id: 2
i2 | 2022-10-27 14:02:04.660 [54578] main/112/main V> Sending from 3 to 1, msg: msg_type: MsgHeartbeatResponse to: 1, to: 1, from: 3, raft_id: 3
i2 | 2022-10-27 14:02:04.660 [54578] main/115/raft_main_loop node.rs:707 E> peer with id 1 not found
i1 | 2022-10-27 14:02:04.660 [54570] main/122/lua V> received response, peer: 2
i3 | 2022-10-27 14:02:04.661 [54577] main/117/lua V> received response, peer: 1
i1 | 2022-10-27 14:02:04.661 [54570] main/137/lua V> received response, peer: 3
i1 | 2022-10-27 14:02:04.861 [54570] main/112/raft_main_loop V> Sending from 1 to 2, msg: msg_type: MsgHeartbeat to: 2 commit: 15, to: 2, from: 1, raft_id: 1
i1 | 2022-10-27 14:02:04.861 [54570] main/112/raft_main_loop V> Sending from 1 to 3, msg: msg_type: MsgHeartbeat to: 3, to: 3, from: 1, raft_id: 1
i3 | 2022-10-27 14:02:04.862 [54577] main/121/main V> Sending from 2 to 1, msg: msg_type: MsgHeartbeatResponse to: 1 commit: 15, to: 1, from: 2, raft_id: 2
i2 | 2022-10-27 14:02:04.863 [54578] main/112/main V> Sending from 3 to 1, msg: msg_type: MsgHeartbeatResponse to: 1, to: 1, from: 3, raft_id: 3
i2 | 2022-10-27 14:02:04.863 [54578] main/115/raft_main_loop node.rs:707 E> peer with id 1 not found
i1 | 2022-10-27 14:02:04.862 [54570] main/122/lua V> received response, peer: 2
i3 | 2022-10-27 14:02:04.863 [54577] main/117/lua V> received response, peer: 1
i1 | 2022-10-27 14:02:04.863 [54570] main/137/lua V> received response, peer: 3
i1 | 2022-10-27 14:02:05.064 [54570] main/112/raft_main_loop V> Sending from 1 to 2, msg: msg_type: MsgHeartbeat to: 2 commit: 15, to: 2, from: 1, raft_id: 1
i1 | 2022-10-27 14:02:05.064 [54570] main/112/raft_main_loop V> Sending from 1 to 3, msg: msg_type: MsgHeartbeat to: 3, to: 3, from: 1, raft_id: 1
i3 | 2022-10-27 14:02:05.064 [54577] main/121/main V> Sending from 2 to 1, msg: msg_type: MsgHeartbeatResponse to: 1 commit: 15, to: 1, from: 2, raft_id: 2
i2 | 2022-10-27 14:02:05.065 [54578] main/112/main V> Sending from 3 to 1, msg: msg_type: MsgHeartbeatResponse to: 1, to: 1, from: 3, raft_id: 3
i2 | 2022-10-27 14:02:05.065 [54578] main/115/raft_main_loop node.rs:707 E> peer with id 1 not found
i1 | 2022-10-27 14:02:05.065 [54570] main/122/lua V> received response, peer: 2
i3 | 2022-10-27 14:02:05.065 [54577] main/117/lua V> received response, peer: 1
i1 | 2022-10-27 14:02:05.065 [54570] main/137/lua V> received response, peer: 3
i1 | 2022-10-27 14:02:05.266 [54570] main/112/raft_main_loop V> Sending from 1 to 2, msg: msg_type: MsgHeartbeat to: 2 commit: 15, to: 2, from: 1, raft_id: 1
i1 | 2022-10-27 14:02:05.266 [54570] main/112/raft_main_loop V> Sending from 1 to 3, msg: msg_type: MsgHeartbeat to: 3, to: 3, from: 1, raft_id: 1
i3 | 2022-10-27 14:02:05.267 [54577] main/121/main V> Sending from 2 to 1, msg: msg_type: MsgHeartbeatResponse to: 1 commit: 15, to: 1, from: 2, raft_id: 2
i2 | 2022-10-27 14:02:05.267 [54578] main/112/main V> Sending from 3 to 1, msg: msg_type: MsgHeartbeatResponse to: 1, to: 1, from: 3, raft_id: 3
i2 | 2022-10-27 14:02:05.267 [54578] main/115/raft_main_loop node.rs:707 E> peer with id 1 not found
i1 | 2022-10-27 14:02:05.267 [54570] main/122/lua V> received response, peer: 2
i3 | 2022-10-27 14:02:05.267 [54577] main/117/lua V> received response, peer: 1
i1 | 2022-10-27 14:02:05.268 [54570] main/137/lua V> received response, peer: 3
i1 | 2022-10-27 14:02:05.468 [54570] main/112/raft_main_loop V> Sending from 1 to 2, msg: msg_type: MsgHeartbeat to: 2 commit: 15, to: 2, from: 1, raft_id: 1
i1 | 2022-10-27 14:02:05.468 [54570] main/112/raft_main_loop V> Sending from 1 to 3, msg: msg_type: MsgHeartbeat to: 3, to: 3, from: 1, raft_id: 1
i3 | 2022-10-27 14:02:05.469 [54577] main/121/main V> Sending from 2 to 1, msg: msg_type: MsgHeartbeatResponse to: 1 commit: 15, to: 1, from: 2, raft_id: 2
i2 | 2022-10-27 14:02:05.469 [54578] main/112/main V> Sending from 3 to 1, msg: msg_type: MsgHeartbeatResponse to: 1, to: 1, from: 3, raft_id: 3
i2 | 2022-10-27 14:02:05.470 [54578] main/115/raft_main_loop node.rs:707 E> peer with id 1 not found
i3 | 2022-10-27 14:02:05.470 [54577] main/117/lua V> received response, peer: 1
i1 | 2022-10-27 14:02:05.469 [54570] main/122/lua V> received response, peer: 2
i1 | 2022-10-27 14:02:05.470 [54570] main/137/lua V> received response, peer: 3
i1 | 2022-10-27 14:02:05.670 [54570] main/112/raft_main_loop V> Sending from 1 to 2, msg: msg_type: MsgHeartbeat to: 2 commit: 15, to: 2, from: 1, raft_id: 1
i1 | 2022-10-27 14:02:05.670 [54570] main/112/raft_main_loop V> Sending from 1 to 3, msg: msg_type: MsgHeartbeat to: 3, to: 3, from: 1, raft_id: 1
i3 | 2022-10-27 14:02:05.671 [54577] main/121/main V> Sending from 2 to 1, msg: msg_type: MsgHeartbeatResponse to: 1 commit: 15, to: 1, from: 2, raft_id: 2
i2 | 2022-10-27 14:02:05.671 [54578] main/112/main V> Sending from 3 to 1, msg: msg_type: MsgHeartbeatResponse to: 1, to: 1, from: 3, raft_id: 3
i2 | 2022-10-27 14:02:05.672 [54578] main/115/raft_main_loop node.rs:707 E> peer with id 1 not found
i1 | 2022-10-27 14:02:05.671 [54570] main/122/lua V> received response, peer: 2
i3 | 2022-10-27 14:02:05.672 [54577] main/117/lua V> received response, peer: 1
i1 | 2022-10-27 14:02:05.672 [54570] main/137/lua V> received response, peer: 3
i1 | 2022-10-27 14:02:05.873 [54570] main/112/raft_main_loop V> Sending from 1 to 2, msg: msg_type: MsgHeartbeat to: 2 commit: 15, to: 2, from: 1, raft_id: 1
i1 | 2022-10-27 14:02:05.873 [54570] main/112/raft_main_loop V> Sending from 1 to 3, msg: msg_type: MsgHeartbeat to: 3, to: 3, from: 1, raft_id: 1
i3 | 2022-10-27 14:02:05.873 [54577] main/121/main V> Sending from 2 to 1, msg: msg_type: MsgHeartbeatResponse to: 1 commit: 15, to: 1, from: 2, raft_id: 2
i1 | 2022-10-27 14:02:05.874 [54570] main/122/lua V> received response, peer: 2
i2 | 2022-10-27 14:02:05.874 [54578] main/112/main V> Sending from 3 to 1, msg: msg_type: MsgHeartbeatResponse to: 1, to: 1, from: 3, raft_id: 3
i2 | 2022-10-27 14:02:05.874 [54578] main/115/raft_main_loop node.rs:707 E> peer with id 1 not found
i3 | 2022-10-27 14:02:05.874 [54577] main/117/lua V> received response, peer: 1
i1 | 2022-10-27 14:02:05.874 [54570] main/137/lua V> received response, peer: 3
i1 | 2022-10-27 14:02:06.074 [54570] main/112/raft_main_loop V> Sending from 1 to 2, msg: msg_type: MsgHeartbeat to: 2 commit: 15, to: 2, from: 1, raft_id: 1
i1 | 2022-10-27 14:02:06.074 [54570] main/112/raft_main_loop V> Sending from 1 to 3, msg: msg_type: MsgHeartbeat to: 3, to: 3, from: 1, raft_id: 1
i3 | 2022-10-27 14:02:06.075 [54577] main/121/main V> Sending from 2 to 1, msg: msg_type: MsgHeartbeatResponse to: 1 commit: 15, to: 1, from: 2, raft_id: 2
i2 | 2022-10-27 14:02:06.075 [54578] main/112/main V> Sending from 3 to 1, msg: msg_type: MsgHeartbeatResponse to: 1, to: 1, from: 3, raft_id: 3
i2 | 2022-10-27 14:02:06.075 [54578] main/115/raft_main_loop node.rs:707 E> peer with id 1 not found
i1 | 2022-10-27 14:02:06.075 [54570] main/122/lua V> received response, peer: 2
i3 | 2022-10-27 14:02:06.075 [54577] main/117/lua V> received response, peer: 1
i1 | 2022-10-27 14:02:06.076 [54570] main/137/lua V> received response, peer: 3
i1 | 2022-10-27 14:02:06.276 [54570] main/112/raft_main_loop V> Sending from 1 to 2, msg: msg_type: MsgHeartbeat to: 2 commit: 15, to: 2, from: 1, raft_id: 1
i1 | 2022-10-27 14:02:06.276 [54570] main/112/raft_main_loop V> Sending from 1 to 3, msg: msg_type: MsgHeartbeat to: 3, to: 3, from: 1, raft_id: 1
i3 | 2022-10-27 14:02:06.277 [54577] main/121/main V> Sending from 2 to 1, msg: msg_type: MsgHeartbeatResponse to: 1 commit: 15, to: 1, from: 2, raft_id: 2
i2 | 2022-10-27 14:02:06.277 [54578] main/112/main V> Sending from 3 to 1, msg: msg_type: MsgHeartbeatResponse to: 1, to: 1, from: 3, raft_id: 3
i2 | 2022-10-27 14:02:06.278 [54578] main/115/raft_main_loop node.rs:707 E> peer with id 1 not found
i1 | 2022-10-27 14:02:06.277 [54570] main/122/lua V> received response, peer: 2
i3 | 2022-10-27 14:02:06.278 [54577] main/117/lua V> received response, peer: 1
i1 | 2022-10-27 14:02:06.278 [54570] main/137/lua V> received response, peer: 3
i1 | 2022-10-27 14:02:06.479 [54570] main/112/raft_main_loop V> Sending from 1 to 2, msg: msg_type: MsgHeartbeat to: 2 commit: 15, to: 2, from: 1, raft_id: 1
i1 | 2022-10-27 14:02:06.479 [54570] main/112/raft_main_loop V> Sending from 1 to 3, msg: msg_type: MsgHeartbeat to: 3, to: 3, from: 1, raft_id: 1
i3 | 2022-10-27 14:02:06.479 [54577] main/121/main V> Sending from 2 to 1, msg: msg_type: MsgHeartbeatResponse to: 1 commit: 15, to: 1, from: 2, raft_id: 2
i1 | 2022-10-27 14:02:06.480 [54570] main/122/lua V> received response, peer: 2
i2 | 2022-10-27 14:02:06.480 [54578] main/112/main V> Sending from 3 to 1, msg: msg_type: MsgHeartbeatResponse to: 1, to: 1, from: 3, raft_id: 3
i2 | 2022-10-27 14:02:06.480 [54578] main/115/raft_main_loop node.rs:707 E> peer with id 1 not found
i3 | 2022-10-27 14:02:06.480 [54577] main/117/lua V> received response, peer: 1
i1 | 2022-10-27 14:02:06.480 [54570] main/137/lua V> received response, peer: 3
i1 | 2022-10-27 14:02:06.681 [54570] main/112/raft_main_loop V> Sending from 1 to 2, msg: msg_type: MsgHeartbeat to: 2 commit: 15, to: 2, from: 1, raft_id: 1
i1 | 2022-10-27 14:02:06.681 [54570] main/112/raft_main_loop V> Sending from 1 to 3, msg: msg_type: MsgHeartbeat to: 3, to: 3, from: 1, raft_id: 1
i3 | 2022-10-27 14:02:06.681 [54577] main/121/main V> Sending from 2 to 1, msg: msg_type: MsgHeartbeatResponse to: 1 commit: 15, to: 1, from: 2, raft_id: 2
i2 | 2022-10-27 14:02:06.682 [54578] main/112/main V> Sending from 3 to 1, msg: msg_type: MsgHeartbeatResponse to: 1, to: 1, from: 3, raft_id: 3
i2 | 2022-10-27 14:02:06.682 [54578] main/115/raft_main_loop node.rs:707 E> peer with id 1 not found
i1 | 2022-10-27 14:02:06.682 [54570] main/122/lua V> received response, peer: 2
i3 | 2022-10-27 14:02:06.682 [54577] main/117/lua V> received response, peer: 1
i1 | 2022-10-27 14:02:06.682 [54570] main/137/lua V> received response, peer: 3
i1 | 2022-10-27 14:02:06.883 [54570] main/112/raft_main_loop V> Sending from 1 to 2, msg: msg_type: MsgHeartbeat to: 2 commit: 15, to: 2, from: 1, raft_id: 1
i1 | 2022-10-27 14:02:06.883 [54570] main/112/raft_main_loop V> Sending from 1 to 3, msg: msg_type: MsgHeartbeat to: 3, to: 3, from: 1, raft_id: 1
i3 | 2022-10-27 14:02:06.884 [54577] main/121/main V> Sending from 2 to 1, msg: msg_type: MsgHeartbeatResponse to: 1 commit: 15, to: 1, from: 2, raft_id: 2
i2 | 2022-10-27 14:02:06.884 [54578] main/112/main V> Sending from 3 to 1, msg: msg_type: MsgHeartbeatResponse to: 1, to: 1, from: 3, raft_id: 3
i2 | 2022-10-27 14:02:06.884 [54578] main/115/raft_main_loop node.rs:707 E> peer with id 1 not found
i1 | 2022-10-27 14:02:06.884 [54570] main/122/lua V> received response, peer: 2
i3 | 2022-10-27 14:02:06.884 [54577] main/117/lua V> received response, peer: 1
i1 | 2022-10-27 14:02:06.885 [54570] main/137/lua V> received response, peer: 3
i2 | 2022-10-27 14:02:06.981 [54578] main/103/interactive V> unable to get a read barrier: timeout
i2 | 2022-10-27 14:02:07.081 [54578] main/103/interactive V> Sending from 3 to 1, msg: msg_type: MsgReadIndex to: 1 entries {data: "\202\242lc\203\242id\003\243gen\001\245count\002\242op\201\244kind\243nop"}, to: 1, from: 3, raft_id: 3
i2 | 2022-10-27 14:02:07.082 [54578] main/115/raft_main_loop node.rs:707 E> peer with id 1 not found
i1 | 2022-10-27 14:02:07.085 [54570] main/112/raft_main_loop V> Sending from 1 to 2, msg: msg_type: MsgHeartbeat to: 2 commit: 15, to: 2, from: 1, raft_id: 1
i1 | 2022-10-27 14:02:07.085 [54570] main/112/raft_main_loop V> Sending from 1 to 3, msg: msg_type: MsgHeartbeat to: 3, to: 3, from: 1, raft_id: 1
i3 | 2022-10-27 14:02:07.086 [54577] main/121/main V> Sending from 2 to 1, msg: msg_type: MsgHeartbeatResponse to: 1 commit: 15, to: 1, from: 2, raft_id: 2
i2 | 2022-10-27 14:02:07.086 [54578] main/112/main V> Sending from 3 to 1, msg: msg_type: MsgHeartbeatResponse to: 1, to: 1, from: 3, raft_id: 3
i1 | 2022-10-27 14:02:07.086 [54570] main/122/lua V> received response, peer: 2
i2 | 2022-10-27 14:02:07.086 [54578] main/115/raft_main_loop node.rs:707 E> peer with id 1 not found
i3 | 2022-10-27 14:02:07.086 [54577] main/117/lua V> received response, peer: 1
i1 | 2022-10-27 14:02:07.087 [54570] main/137/lua V> received response, peer: 3
i1 | 2022-10-27 14:02:07.287 [54570] main/112/raft_main_loop V> Sending from 1 to 2, msg: msg_type: MsgHeartbeat to: 2 commit: 15, to: 2, from: 1, raft_id: 1
i1 | 2022-10-27 14:02:07.287 [54570] main/112/raft_main_loop V> Sending from 1 to 3, msg: msg_type: MsgHeartbeat to: 3, to: 3, from: 1, raft_id: 1
i3 | 2022-10-27 14:02:07.288 [54577] main/121/main V> Sending from 2 to 1, msg: msg_type: MsgHeartbeatResponse to: 1 commit: 15, to: 1, from: 2, raft_id: 2
i1 | 2022-10-27 14:02:07.288 [54570] main/122/lua V> received response, peer: 2
i2 | 2022-10-27 14:02:07.288 [54578] main/112/main V> Sending from 3 to 1, msg: msg_type: MsgHeartbeatResponse to: 1, to: 1, from: 3, raft_id: 3
i2 | 2022-10-27 14:02:07.288 [54578] main/115/raft_main_loop node.rs:707 E> peer with id 1 not found
i3 | 2022-10-27 14:02:07.289 [54577] main/117/lua V> received response, peer: 1
i1 | 2022-10-27 14:02:07.289 [54570] main/137/lua V> received response, peer: 3
i1 | 2022-10-27 14:02:07.490 [54570] main/112/raft_main_loop V> Sending from 1 to 2, msg: msg_type: MsgHeartbeat to: 2 commit: 15, to: 2, from: 1, raft_id: 1
i1 | 2022-10-27 14:02:07.490 [54570] main/112/raft_main_loop V> Sending from 1 to 3, msg: msg_type: MsgHeartbeat to: 3, to: 3, from: 1, raft_id: 1
i3 | 2022-10-27 14:02:07.491 [54577] main/121/main V> Sending from 2 to 1, msg: msg_type: MsgHeartbeatResponse to: 1 commit: 15, to: 1, from: 2, raft_id: 2
i1 | 2022-10-27 14:02:07.491 [54570] main/122/lua V> received response, peer: 2
i2 | 2022-10-27 14:02:07.491 [54578] main/112/main V> Sending from 3 to 1, msg: msg_type: MsgHeartbeatResponse to: 1, to: 1, from: 3, raft_id: 3
i1 | 2022-10-27 14:02:07.491 [54570] main/137/lua V> received response, peer: 3
i2 | 2022-10-27 14:02:07.491 [54578] main/115/raft_main_loop node.rs:707 E> peer with id 1 not found
i3 | 2022-10-27 14:02:07.491 [54577] main/117/lua V> received response, peer: 1
i1 | 2022-10-27 14:02:07.692 [54570] main/112/raft_main_loop V> Sending from 1 to 2, msg: msg_type: MsgHeartbeat to: 2 commit: 15, to: 2, from: 1, raft_id: 1
i1 | 2022-10-27 14:02:07.692 [54570] main/112/raft_main_loop V> Sending from 1 to 3, msg: msg_type: MsgHeartbeat to: 3, to: 3, from: 1, raft_id: 1
i3 | 2022-10-27 14:02:07.693 [54577] main/121/main V> Sending from 2 to 1, msg: msg_type: MsgHeartbeatResponse to: 1 commit: 15, to: 1, from: 2, raft_id: 2
i1 | 2022-10-27 14:02:07.693 [54570] main/122/lua V> received response, peer: 2
i2 | 2022-10-27 14:02:07.693 [54578] main/112/main V> Sending from 3 to 1, msg: msg_type: MsgHeartbeatResponse to: 1, to: 1, from: 3, raft_id: 3
i2 | 2022-10-27 14:02:07.694 [54578] main/115/raft_main_loop node.rs:707 E> peer with id 1 not found
i3 | 2022-10-27 14:02:07.694 [54577] main/117/lua V> received response, peer: 1
i1 | 2022-10-27 14:02:07.694 [54570] main/137/lua V> received response, peer: 3
i1 | 2022-10-27 14:02:07.894 [54570] main/112/raft_main_loop V> Sending from 1 to 2, msg: msg_type: MsgHeartbeat to: 2 commit: 15, to: 2, from: 1, raft_id: 1
i1 | 2022-10-27 14:02:07.894 [54570] main/112/raft_main_loop V> Sending from 1 to 3, msg: msg_type: MsgHeartbeat to: 3, to: 3, from: 1, raft_id: 1
i3 | 2022-10-27 14:02:07.895 [54577] main/121/main V> Sending from 2 to 1, msg: msg_type: MsgHeartbeatResponse to: 1 commit: 15, to: 1, from: 2, raft_id: 2
i1 | 2022-10-27 14:02:07.895 [54570] main/122/lua V> received response, peer: 2
i2 | 2022-10-27 14:02:07.896 [54578] main/112/main V> Sending from 3 to 1, msg: msg_type: MsgHeartbeatResponse to: 1, to: 1, from: 3, raft_id: 3
i2 | 2022-10-27 14:02:07.896 [54578] main/115/raft_main_loop node.rs:707 E> peer with id 1 not found
i3 | 2022-10-27 14:02:07.896 [54577] main/117/lua V> received response, peer: 1
i1 | 2022-10-27 14:02:07.896 [54570] main/137/lua V> received response, peer: 3
i1 | 2022-10-27 14:02:08.096 [54570] main/112/raft_main_loop V> Sending from 1 to 2, msg: msg_type: MsgHeartbeat to: 2 commit: 15, to: 2, from: 1, raft_id: 1
i1 | 2022-10-27 14:02:08.097 [54570] main/112/raft_main_loop V> Sending from 1 to 3, msg: msg_type: MsgHeartbeat to: 3, to: 3, from: 1, raft_id: 1
i3 | 2022-10-27 14:02:08.097 [54577] main/121/main V> Sending from 2 to 1, msg: msg_type: MsgHeartbeatResponse to: 1 commit: 15, to: 1, from: 2, raft_id: 2
i1 | 2022-10-27 14:02:08.097 [54570] main/122/lua V> received response, peer: 2
i2 | 2022-10-27 14:02:08.098 [54578] main/112/main V> Sending from 3 to 1, msg: msg_type: MsgHeartbeatResponse to: 1, to: 1, from: 3, raft_id: 3
i3 | 2022-10-27 14:02:08.098 [54577] main/117/lua V> received response, peer: 1
i2 | 2022-10-27 14:02:08.098 [54578] main/115/raft_main_loop node.rs:707 E> peer with id 1 not found
i1 | 2022-10-27 14:02:08.098 [54570] main/137/lua V> received response, peer: 3
i1 | 2022-10-27 14:02:08.299 [54570] main/112/raft_main_loop V> Sending from 1 to 2, msg: msg_type: MsgHeartbeat to: 2 commit: 15, to: 2, from: 1, raft_id: 1
i1 | 2022-10-27 14:02:08.299 [54570] main/112/raft_main_loop V> Sending from 1 to 3, msg: msg_type: MsgHeartbeat to: 3, to: 3, from: 1, raft_id: 1
i3 | 2022-10-27 14:02:08.299 [54577] main/121/main V> Sending from 2 to 1, msg: msg_type: MsgHeartbeatResponse to: 1 commit: 15, to: 1, from: 2, raft_id: 2
i1 | 2022-10-27 14:02:08.300 [54570] main/122/lua V> received response, peer: 2
i2 | 2022-10-27 14:02:08.300 [54578] main/112/main V> Sending from 3 to 1, msg: msg_type: MsgHeartbeatResponse to: 1, to: 1, from: 3, raft_id: 3
i2 | 2022-10-27 14:02:08.300 [54578] main/115/raft_main_loop node.rs:707 E> peer with id 1 not found
i3 | 2022-10-27 14:02:08.300 [54577] main/117/lua V> received response, peer: 1
i1 | 2022-10-27 14:02:08.300 [54570] main/137/lua V> received response, peer: 3
i1 | 2022-10-27 14:02:08.501 [54570] main/112/raft_main_loop V> Sending from 1 to 2, msg: msg_type: MsgHeartbeat to: 2 commit: 15, to: 2, from: 1, raft_id: 1
i1 | 2022-10-27 14:02:08.501 [54570] main/112/raft_main_loop V> Sending from 1 to 3, msg: msg_type: MsgHeartbeat to: 3, to: 3, from: 1, raft_id: 1
i3 | 2022-10-27 14:02:08.501 [54577] main/121/main V> Sending from 2 to 1, msg: msg_type: MsgHeartbeatResponse to: 1 commit: 15, to: 1, from: 2, raft_id: 2
i1 | 2022-10-27 14:02:08.502 [54570] main/122/lua V> received response, peer: 2
i2 | 2022-10-27 14:02:08.502 [54578] main/112/main V> Sending from 3 to 1, msg: msg_type: MsgHeartbeatResponse to: 1, to: 1, from: 3, raft_id: 3
i2 | 2022-10-27 14:02:08.502 [54578] main/115/raft_main_loop node.rs:707 E> peer with id 1 not found
i3 | 2022-10-27 14:02:08.502 [54577] main/117/lua V> received response, peer: 1
i1 | 2022-10-27 14:02:08.502 [54570] main/137/lua V> received response, peer: 3
i1 | 2022-10-27 14:02:08.703 [54570] main/112/raft_main_loop V> Sending from 1 to 2, msg: msg_type: MsgHeartbeat to: 2 commit: 15, to: 2, from: 1, raft_id: 1
i1 | 2022-10-27 14:02:08.703 [54570] main/112/raft_main_loop V> Sending from 1 to 3, msg: msg_type: MsgHeartbeat to: 3, to: 3, from: 1, raft_id: 1
i3 | 2022-10-27 14:02:08.704 [54577] main/121/main V> Sending from 2 to 1, msg: msg_type: MsgHeartbeatResponse to: 1 commit: 15, to: 1, from: 2, raft_id: 2
i1 | 2022-10-27 14:02:08.704 [54570] main/122/lua V> received response, peer: 2
i2 | 2022-10-27 14:02:08.704 [54578] main/112/main V> Sending from 3 to 1, msg: msg_type: MsgHeartbeatResponse to: 1, to: 1, from: 3, raft_id: 3
i3 | 2022-10-27 14:02:08.704 [54577] main/117/lua V> received response, peer: 1
i2 | 2022-10-27 14:02:08.704 [54578] main/115/raft_main_loop node.rs:707 E> peer with id 1 not found
i1 | 2022-10-27 14:02:08.705 [54570] main/137/lua V> received response, peer: 3
i1 | 2022-10-27 14:02:08.905 [54570] main/112/raft_main_loop V> Sending from 1 to 2, msg: msg_type: MsgHeartbeat to: 2 commit: 15, to: 2, from: 1, raft_id: 1
i1 | 2022-10-27 14:02:08.905 [54570] main/112/raft_main_loop V> Sending from 1 to 3, msg: msg_type: MsgHeartbeat to: 3, to: 3, from: 1, raft_id: 1
i3 | 2022-10-27 14:02:08.906 [54577] main/121/main V> Sending from 2 to 1, msg: msg_type: MsgHeartbeatResponse to: 1 commit: 15, to: 1, from: 2, raft_id: 2
i1 | 2022-10-27 14:02:08.906 [54570] main/122/lua V> received response, peer: 2
i2 | 2022-10-27 14:02:08.906 [54578] main/112/main V> Sending from 3 to 1, msg: msg_type: MsgHeartbeatResponse to: 1, to: 1, from: 3, raft_id: 3
i2 | 2022-10-27 14:02:08.907 [54578] main/115/raft_main_loop node.rs:707 E> peer with id 1 not found
i3 | 2022-10-27 14:02:08.907 [54577] main/117/lua V> received response, peer: 1
i1 | 2022-10-27 14:02:08.907 [54570] main/137/lua V> received response, peer: 3
i1 | 2022-10-27 14:02:09.108 [54570] main/112/raft_main_loop V> Sending from 1 to 2, msg: msg_type: MsgHeartbeat to: 2 commit: 15, to: 2, from: 1, raft_id: 1
i1 | 2022-10-27 14:02:09.108 [54570] main/112/raft_main_loop V> Sending from 1 to 3, msg: msg_type: MsgHeartbeat to: 3, to: 3, from: 1, raft_id: 1
i3 | 2022-10-27 14:02:09.108 [54577] main/121/main V> Sending from 2 to 1, msg: msg_type: MsgHeartbeatResponse to: 1 commit: 15, to: 1, from: 2, raft_id: 2
i1 | 2022-10-27 14:02:09.109 [54570] main/122/lua V> received response, peer: 2
i2 | 2022-10-27 14:02:09.109 [54578] main/112/main V> Sending from 3 to 1, msg: msg_type: MsgHeartbeatResponse to: 1, to: 1, from: 3, raft_id: 3
i2 | 2022-10-27 14:02:09.109 [54578] main/115/raft_main_loop node.rs:707 E> peer with id 1 not found
i3 | 2022-10-27 14:02:09.109 [54577] main/117/lua V> received response, peer: 1
i1 | 2022-10-27 14:02:09.109 [54570] main/137/lua V> received response, peer: 3
i1 | 2022-10-27 14:02:09.310 [54570] main/112/raft_main_loop V> Sending from 1 to 2, msg: msg_type: MsgHeartbeat to: 2 commit: 15, to: 2, from: 1, raft_id: 1
i1 | 2022-10-27 14:02:09.310 [54570] main/112/raft_main_loop V> Sending from 1 to 3, msg: msg_type: MsgHeartbeat to: 3, to: 3, from: 1, raft_id: 1
i3 | 2022-10-27 14:02:09.311 [54577] main/121/main V> Sending from 2 to 1, msg: msg_type: MsgHeartbeatResponse to: 1 commit: 15, to: 1, from: 2, raft_id: 2
i1 | 2022-10-27 14:02:09.311 [54570] main/122/lua V> received response, peer: 2
i2 | 2022-10-27 14:02:09.311 [54578] main/112/main V> Sending from 3 to 1, msg: msg_type: MsgHeartbeatResponse to: 1, to: 1, from: 3, raft_id: 3
i2 | 2022-10-27 14:02:09.311 [54578] main/115/raft_main_loop node.rs:707 E> peer with id 1 not found
i3 | 2022-10-27 14:02:09.311 [54577] main/117/lua V> received response, peer: 1
i1 | 2022-10-27 14:02:09.312 [54570] main/137/lua V> received response, peer: 3
i1 | 2022-10-27 14:02:09.512 [54570] main/112/raft_main_loop V> Sending from 1 to 2, msg: msg_type: MsgHeartbeat to: 2 commit: 15, to: 2, from: 1, raft_id: 1
i1 | 2022-10-27 14:02:09.512 [54570] main/112/raft_main_loop V> Sending from 1 to 3, msg: msg_type: MsgHeartbeat to: 3, to: 3, from: 1, raft_id: 1
i3 | 2022-10-27 14:02:09.513 [54577] main/121/main V> Sending from 2 to 1, msg: msg_type: MsgHeartbeatResponse to: 1 commit: 15, to: 1, from: 2, raft_id: 2
i1 | 2022-10-27 14:02:09.513 [54570] main/122/lua V> received response, peer: 2
i2 | 2022-10-27 14:02:09.514 [54578] main/112/main V> Sending from 3 to 1, msg: msg_type: MsgHeartbeatResponse to: 1, to: 1, from: 3, raft_id: 3
i2 | 2022-10-27 14:02:09.514 [54578] main/115/raft_main_loop node.rs:707 E> peer with id 1 not found
i3 | 2022-10-27 14:02:09.514 [54577] main/117/lua V> received response, peer: 1
i1 | 2022-10-27 14:02:09.514 [54570] main/137/lua V> received response, peer: 3
i1 | 2022-10-27 14:02:09.715 [54570] main/112/raft_main_loop V> Sending from 1 to 2, msg: msg_type: MsgHeartbeat to: 2 commit: 15, to: 2, from: 1, raft_id: 1
i1 | 2022-10-27 14:02:09.715 [54570] main/112/raft_main_loop V> Sending from 1 to 3, msg: msg_type: MsgHeartbeat to: 3, to: 3, from: 1, raft_id: 1
i3 | 2022-10-27 14:02:09.715 [54577] main/121/main V> Sending from 2 to 1, msg: msg_type: MsgHeartbeatResponse to: 1 commit: 15, to: 1, from: 2, raft_id: 2
i1 | 2022-10-27 14:02:09.716 [54570] main/122/lua V> received response, peer: 2
i2 | 2022-10-27 14:02:09.716 [54578] main/112/main V> Sending from 3 to 1, msg: msg_type: MsgHeartbeatResponse to: 1, to: 1, from: 3, raft_id: 3
i2 | 2022-10-27 14:02:09.716 [54578] main/115/raft_main_loop node.rs:707 E> peer with id 1 not found
i3 | 2022-10-27 14:02:09.716 [54577] main/117/lua V> received response, peer: 1
i1 | 2022-10-27 14:02:09.716 [54570] main/137/lua V> received response, peer: 3
i1 | 2022-10-27 14:02:09.917 [54570] main/112/raft_main_loop V> Sending from 1 to 2, msg: msg_type: MsgHeartbeat to: 2 commit: 15, to: 2, from: 1, raft_id: 1
i1 | 2022-10-27 14:02:09.917 [54570] main/112/raft_main_loop V> Sending from 1 to 3, msg: msg_type: MsgHeartbeat to: 3, to: 3, from: 1, raft_id: 1
i3 | 2022-10-27 14:02:09.917 [54577] main/121/main V> Sending from 2 to 1, msg: msg_type: MsgHeartbeatResponse to: 1 commit: 15, to: 1, from: 2, raft_id: 2
i1 | 2022-10-27 14:02:09.918 [54570] main/122/lua V> received response, peer: 2
i2 | 2022-10-27 14:02:09.918 [54578] main/112/main V> Sending from 3 to 1, msg: msg_type: MsgHeartbeatResponse to: 1, to: 1, from: 3, raft_id: 3
i2 | 2022-10-27 14:02:09.918 [54578] main/115/raft_main_loop node.rs:707 E> peer with id 1 not found
i3 | 2022-10-27 14:02:09.918 [54577] main/117/lua V> received response, peer: 1
i1 | 2022-10-27 14:02:09.918 [54570] main/137/lua V> received response, peer: 3
i1 | 2022-10-27 14:02:10.120 [54570] main/112/raft_main_loop V> Sending from 1 to 2, msg: msg_type: MsgHeartbeat to: 2 commit: 15, to: 2, from: 1, raft_id: 1
i1 | 2022-10-27 14:02:10.120 [54570] main/112/raft_main_loop V> Sending from 1 to 3, msg: msg_type: MsgHeartbeat to: 3, to: 3, from: 1, raft_id: 1
i3 | 2022-10-27 14:02:10.120 [54577] main/121/main V> Sending from 2 to 1, msg: msg_type: MsgHeartbeatResponse to: 1 commit: 15, to: 1, from: 2, raft_id: 2
i1 | 2022-10-27 14:02:10.121 [54570] main/122/lua V> received response, peer: 2
i2 | 2022-10-27 14:02:10.121 [54578] main/112/main V> Sending from 3 to 1, msg: msg_type: MsgHeartbeatResponse to: 1, to: 1, from: 3, raft_id: 3
i2 | 2022-10-27 14:02:10.121 [54578] main/115/raft_main_loop node.rs:707 E> peer with id 1 not found
i3 | 2022-10-27 14:02:10.121 [54577] main/117/lua V> received response, peer: 1
i1 | 2022-10-27 14:02:10.121 [54570] main/137/lua V> received response, peer: 3
i1 | 2022-10-27 14:02:10.322 [54570] main/112/raft_main_loop V> Sending from 1 to 2, msg: msg_type: MsgHeartbeat to: 2 commit: 15, to: 2, from: 1, raft_id: 1
i1 | 2022-10-27 14:02:10.322 [54570] main/112/raft_main_loop V> Sending from 1 to 3, msg: msg_type: MsgHeartbeat to: 3, to: 3, from: 1, raft_id: 1
i3 | 2022-10-27 14:02:10.323 [54577] main/121/main V> Sending from 2 to 1, msg: msg_type: MsgHeartbeatResponse to: 1 commit: 15, to: 1, from: 2, raft_id: 2
i1 | 2022-10-27 14:02:10.323 [54570] main/122/lua V> received response, peer: 2
i2 | 2022-10-27 14:02:10.323 [54578] main/112/main V> Sending from 3 to 1, msg: msg_type: MsgHeartbeatResponse to: 1, to: 1, from: 3, raft_id: 3
i2 | 2022-10-27 14:02:10.323 [54578] main/115/raft_main_loop node.rs:707 E> peer with id 1 not found
i3 | 2022-10-27 14:02:10.323 [54577] main/117/lua V> received response, peer: 1
i1 | 2022-10-27 14:02:10.324 [54570] main/137/lua V> received response, peer: 3
i1 | 2022-10-27 14:02:10.524 [54570] main/112/raft_main_loop V> Sending from 1 to 2, msg: msg_type: MsgHeartbeat to: 2 commit: 15, to: 2, from: 1, raft_id: 1
i1 | 2022-10-27 14:02:10.524 [54570] main/112/raft_main_loop V> Sending from 1 to 3, msg: msg_type: MsgHeartbeat to: 3, to: 3, from: 1, raft_id: 1
i3 | 2022-10-27 14:02:10.525 [54577] main/121/main V> Sending from 2 to 1, msg: msg_type: MsgHeartbeatResponse to: 1 commit: 15, to: 1, from: 2, raft_id: 2
i1 | 2022-10-27 14:02:10.525 [54570] main/122/lua V> received response, peer: 2
i2 | 2022-10-27 14:02:10.525 [54578] main/112/main V> Sending from 3 to 1, msg: msg_type: MsgHeartbeatResponse to: 1, to: 1, from: 3, raft_id: 3
i2 | 2022-10-27 14:02:10.526 [54578] main/115/raft_main_loop node.rs:707 E> peer with id 1 not found
i3 | 2022-10-27 14:02:10.526 [54577] main/117/lua V> received response, peer: 1
i1 | 2022-10-27 14:02:10.526 [54570] main/137/lua V> received response, peer: 3
=========================== short test summary info ============================
ERROR test/int/test_network_effects.py::test_log_rollback - assert == failed....
========================= 35 passed, 1 error in 50.34s =========================
section_end:1666879332:step_script
[0Ksection_start:1666879332:cleanup_file_variables
[0K[0K[36;1mCleaning up project directory and file based variables[0;m[0;m
section_end:1666879334:cleanup_file_variables
[0K[31;1mERROR: Job failed: exit code 1
[0;m