The patch adds support of ldap auth method to pgproto. For ldap we
request user password in clear text using corresponding protocol
message. Afterwards password is passed to tarantool `authenticate`
method which handles ldap based auth.

Important: since password is transferred as clear text it is advised to
setup ssl.

BREAKING CHANGE: as soon as PostgreSQL protocol
is enabled by default, we must be careful with
`--pg-listen` cli flag when creating more than
a single instance, because we will suddenly get
a port confict error (busy port)

TopologyCache is a collection of deserialized structures with
information about cluster topology. This currently includes data from
_pico_instance, _pico_replicaset, _pico_tier & _pico_service_route_table.
The info is automatically kept up to date with the corresponding system
tables. The TopologyCache also caches the immutable info related to the
current instance, like instance name, replicaset uuid, etc.

From now on we should be reading this data from TopologyCache whenever
possible instead of going directly to system tables as we were doing
previosly.

At the moment only the plugin RPC module has transitioned to using
TopologyCache but other modules should be refactored as well.
Especially governor.

This patch boils down to the following improvements:

* Various linkage-related shenanigans have been documented and revamped.
* All logic to build tarantool-sys is now encapsulated in tarantool-build.
* Most of the magic `println!`s are now encapsulated in build-rs-helpers.
* Unsound function `export_symbols` has been dropped in favor of
  explicit linker flags (`--require-defined` for linux & `-u` for mac).
* `TarantoolBuildRoot` is now in charge of building and linking
  tarantool libs. It defines the build tree via path helper functions.
* Picodata's `build.rs` should be a little easier to read.

Closes #1077

Maksim Kaitmazian authored 5 months ago and Dmitry Ivanov committed 4 months ago

Disabling the tracing feature has shown a significant performance improvement
of 72.50%, as demonstrated in https://git.picodata.io/picodata/picodata/picodata/-/issues/1026#note_107222.

This commit disables "tracing" feature for sbroad and eliminates
the opentelemetry wrappers and statistics tables.

Close #764

Georgy Moshkin authored 5 months ago and Dmitry Rodionov committed 5 months ago

Previous implementation would call functions over the ffi boundary which
weren't defined with the required `extern` specifiers, which is not allowed.

Dmitry Ivanov authored 5 months ago and Dmitry Ivanov committed 5 months ago

Log:

```
i1  | 2024-10-09 02:40:07.850 [135492] main/133/main C> panicked at library/core/src/panicking.rs:221:5:
i1  | panic in a function that cannot unwind
i1  | 2024-10-09 02:40:07.850 [135492] main/133/main C> backtrace:
i1  | disabled backtrace
i1  | 2024-10-09 02:40:07.850 [135492] main/133/main C> aborting due to panic
i1  | [supervisor:135482] no ipc message from child
i1  | [supervisor:135482] subprocess 135492 was signaled with SIGABRT
i1  | [supervisor:135482] core dumped
```

Up to this patch `instance_uuid` and `replicaset_uuid` were generated
using name-based UUID v3. So all instances named `i1` in all clusters
had the same UUID.

With this patch UUIDs become random v4. Particular UUID values are
generated in two locations:

1. `start_boot` (src/lib.rs)
2. `handle_join_request_and_wait` -> `build_instance` (src/rpc/join.rs)

Function `Instance::new()` is removed in favor of explicit struct
construction.

Kurdakov Alexander authored 6 months ago and Yaroslav Dynnikov committed 6 months ago

Do not ban admin console via unix socket
after several failed attempts via `picodata connect`.

This moves most of the logic from the supervisor process which helps
with a number of problems with the main_cord stuff. For example in a
following commit the context will only be parsed in tarantool::main_cb
which means config parameters aren't accessible in supervisor.

This also moves us towards getting rid of the supervisor process in the
future.

1. A better VDBE caching was implemented for local SQL.
2. Local SQL is called via C API rather then Lua.
3. A new prepare-unprepare fiber added to manage SQL statement
   cache.

godzie44 authored 8 months ago and Georgy Moshkin committed 7 months ago

Closes 798