Дмитрий Кольцов authored 7 months ago and Дмитрий Кольцов committed 7 months ago

Add services to each tier and list of installed
plugins to cluster info

Closes #809

Georgy Moshkin authored 7 months ago and Dmitry Rodionov committed 7 months ago

Closes #653

- sbroad submodule was already updated and
has commit supporting inferring sk from pk
- add integration test to check inference
is working

- Currently we use Retriable for handling flaky
sql tests (temporary solution). If our sql query
succeeded but on client the timeout was raised,
Retriable will execute the query again. This
may lead to situation, when we will get an
error for violating unique index. This commit
ignores this error

Dmitry Rodionov authored 7 months ago and Yaroslav Dynnikov committed 7 months ago

Previously function was ~700 loc. The patch splits out the logic of
conversion from ir node to operation. Previously there were two stages,
initial validation that constructed intermediate structure and then
intermediate structure was transformed into Op potentially several times
in case of retries. The patch removes intermediate conversion by
direct mapping from ir node to op. It makes reading more convenient
since there is no need to jump back and forth between initial checks and
actual Op construction. Another benefit is that some checks need to be
repeated on each retry since retries originate from conflicts and
conflicts change system state. So in newer state operation may no longer
make sense. By coupling both operations together there is no way a check
can be missed in the retry phase.

We still do some cloning here and there. We can probably improve on that
by constructing Op once and then adjusting it in place for conflicts but
since retries should be rare in practice it shouldnt be a problem.

Additionally we do a lot of conversion between SmolStr and String. We
need to use SmolStr in more placese inside picodata so we dont need to
do that.

We use migration file from the manifest file to store it in the system tables
and to display logging messages.

But the full filepath is used for reading files from the disk.