godzie44 authored 1 year ago and Konstantin D committed 1 year ago

Add `current_cord_name` function to get a name of the current cord,
add `cord_is_main_dont_create` function.
Add exports for `cord_is_main`, `cord_is_main_dont_create` and
`current_cord_name` functions.

NO_DOC=internal
NO_TEST=internal
NO_CHANGELOG=internal

godzie44 authored 1 year ago and Konstantin D committed 1 year ago

Add `log_default_logger` to get a default logger.
Add exports for `log_set_format`, `log_set_level` and `log_default_logger` functions.

NO_DOC=internal
NO_TEST=internal
NO_CHANGELOG=internal

This patch makes schema_object_type to be exported.

NO_DOC=picodata internal patch
NO_CHANGELOG=picodata internal patch
NO_TEST=picodata internal patch

NO_DOC=picodata internal patch
NO_CHANGELOG=picodata internal patch
NO_TEST=picodata internal patch

NO_CHANGELOG=bug fix for unreleased feature
NO_DOC=bug fix for unreleased feature

1. Pass `docker build --build-arg TARANTOOL_VERSION=...` to ensure the
   resulting image contains the correct version.
2. Pass it in the CI trigger variables.
3. Fix CI jobs relationships: "docker" stage needs "deploy-packages".
4. Minor fixes in job names.

NO_DOC=internal
NO_TEST=internal
NO_CHANGELOG=internal

Nikita Zheleztsov authored 1 year ago and Дмитрий Кольцов committed 1 year ago

Commit/rollback triggers are run asynchronously, upon receiving the
write status from WAL. We can't run them in the original fiber that
submitted the WAL request, because it would open a time window between
writing a transaction to WAL and committing it in tx, which could lead
to violating the cascading rolback principles. As a result,
commit/rollback triggers run with admin privileges.

The issue was already solved for confirming async transaction, but
session and user are still not correct, when the transaction is
confirmed by the limbo. Let's fix this issue by temporarily setting
session and credentials to the original fiberfor running
commit/rollback triggers.

Closes #8742

NO_DOC=bugfix

(cherry picked from commit 8cd0cd09)

Nikita Zheleztsov authored 1 year ago and Дмитрий Кольцов committed 1 year ago

Currently some transactions on synchronous space fail to complete with
the `ER_CURSOR_NO_TRANSACTION` error, when on_rollback/on_commit triggers
are set.

This is caused due to the fact, that some rollback/commit triggers
require in_txn fiber variable to be set but it's not done when a
transaction is completed from the limbo. Callbacks, which are used to
work with iterators (`lbox_txn_pairs` and `lbox_txn_iterator_next`),
acquire tnx statements from the current transactions, but they cannot
do that, when this transaction is not assigned to the current fiber, so
`ER_CURSOR_NO_TRANSACTION` is thrown.

Let's assign in_txn variable when we complete transaction from the limbo.
Moreover, let's add assertions, which check whether in_txn() is correct,
in order to be sure, that `txn_complete_success/fail` always run with
in_txn set.

Closes #8505

NO_DOC=bugfix

(cherry picked from commit 6fadc8a0)

Dmitry Ivanov authored 1 year ago and Dmitry Rodionov committed 1 year ago

This patch helps us create and write to non-default
loggers provided by `say.h`. We'll use this mainly
for audit log in picodata.

NO_DOC=internal
NO_TEST=internal
NO_CHANGELOG=internal

Dmitry Ivanov authored 1 year ago and Dmitry Rodionov committed 1 year ago

Turns out Cyrus SASL doesn't use AM_MAINTAINER_MODE or anything to
prevent autotools from re-configuring the project at build time.
This patch "fixes" that by maiming autotools' paths in Makefile.

NO_DOC=internal
NO_TEST=internal
NO_CHANGELOG=internal

Kurdakov Alexander authored 1 year ago and Dmitry Rodionov committed 1 year ago

Add to console lua api function that overrides sql executor

NO_DOC=picodata internal patch
NO_CHANGELOG=picodata internal patch
NO_TEST=picodata internal patch

Feodor Alexandrov authored 1 year ago and Dmitry Rodionov committed 1 year ago

Picodata is built statically, and name crypto clashes between
`src/lib/crypto` and libcrypto from `openssl`. To resolve the
ambiguity this patch renames tarantool library to `tcrypto`.

NO_DOC=picodata internal patch
NO_CHANGELOG=picodata internal patch
NO_TEST=picodata internal patch

Dmitry Ivanov authored 1 year ago and Dmitry Rodionov committed 1 year ago

NO_DOC=picodata internal patch
NO_CHANGELOG=picodata internal patch
NO_TEST=picodata internal patch

Maksim Kaitmazian authored 1 year ago and Dmitry Rodionov committed 1 year ago

In the picodata-support branch, the tarantool.a library is built
instead of a tarantool executable. So tests cannot be launched because
of the lack of the executable. This commit adds this executable.

NO_DOC=just an executable is added
NO_TEST=just an executable is added
NO_CHANGELOG=just an executable is added

Georgy Moshkin authored 1 year ago and Dmitry Rodionov committed 1 year ago

NO_DOC=picodata internal patch
NO_CHANGELOG=picodata internal patch
NO_TEST=picodata internal patch

Georgy Moshkin authored 2 years ago and Dmitry Rodionov committed 1 year ago

Was broken because `tarantool_free` checks if the current process is the
main one and not the child, which was forked at some point (at what
point?). This check was implemented by saving the original process's id
in the static variable master_pid, which got set when the code got
loaded the first time into memory.

So we broke this when we started forking the process in picodata, which
resulted in `master_pid` being set to the pid of the picodata's
"supervisor" process, which doesn't even enter tarantool runtime.

The fix is simple - save master_pid first thing when running
tarantool_main.

Georgy Moshkin authored 2 years ago and Dmitry Rodionov committed 1 year ago

- tarantool is now a static library
- main(argc, argv) -> tarantool_main(argc, argv, cb, cb_data)
- callback is called before running lua script

Closes #9237

Add exports for fiber_set_name_n, fiber_name, fiber_id, fiber_csw &
fiber_find.

Also make fiber_set_joinable, fiber_set_ctx & fiber_get_ctx interpret
NULL as the current fiber.

@TarantoolBot document
Title: add basic fiber api to ffi exports.

5 basic functions can now be used via ffi api, which were previously
only accessible via lua api: fiber_set_name_n, fiber_name, fiber_id,
fiber_csw & fiber_find.

fiber_set_joinable now interprets NULL as current fiber.

NO_DOC=internal change
NO_TEST=internal change

Rename the members as well. Keep uint16_t in box_check_acess_space
as it is for other exported functions

NO_DOC=picodata internal patch
NO_CHANGELOG=picodata internal patch
NO_TEST=picodata internal patch

NO_DOC=picodata internal patch
NO_CHANGELOG=picodata internal patch
NO_TEST=picodata internal patch

Co-authored-by: Yaroslav Dynnikov <yaroslav.dynnikov@gmail.com>

This reverts commit 0d8458d4.

Alexey Protsenko authored 1 year ago and Yaroslav Dynnikov committed 1 year ago

Add a trigger to run tarantool-module CI tests when a new docker image
is released (on tag).

NO_DOC=internal
NO_TEST=internal
NO_CHANGELOG=internal

NO_DOC=internal
NO_TEST=internal
NO_CHANGELOG=internal

Introduce API for opening a read view over the specified spaces and
indexes and creating iterators over the index read views.

NO_DOC=picodata patch

box_auth_data_prepare() method declared to return a tuple while in
reality it returned a region allocated message pack string. Fixed.

NO_DOC=picodata internal patch
NO_CHANGELOG=picodata internal patch
NO_TEST=picodata internal patch

test-run.py sets OMP_NUM_THREADS which causes this test to misbehave:
it doesn't expect to see a warning regarding the use of this env var
as the first log line.

Alternatively, we could update test-run's submodule, but in practice
this breaks other tests e.g. replication-luatest/linearizable_test.lua.

NO_DOC=internal
NO_TEST=internal
NO_CHANGELOG=internal

Ilya Verbin authored 1 year ago and Dmitry Ivanov committed 1 year ago

OpenMP is no longer used since commit 4f617b70 ("box: introduce
memtx_sort_threads config parameter"). All dependencies on libgomp
should be removed.

Follow-up #7689

NO_DOC=build
NO_TEST=build

Nikolay Shirokovskiy authored 1 year ago and Dmitry Ivanov committed 1 year ago

Closes #3389
Closes #7689
Closes #4646

@TarantoolBot document
Title: new box.cfg parameter memtx_sort_threads

The parameter sets the number of threads used to sort keys of secondary
indexes on loading memtx database. The parameter cannot be changed
dynamically (as it does not make sense).

Maximum value is 256, minimum is 1. Default is to use all available cores.

Usage example:
```
box.cfg{memtx_sort_threads=4}
```

Nikolay Shirokovskiy authored 1 year ago and Dmitry Ivanov committed 1 year ago

The algorithm runs sort in multiple threads and does not use OpenMP. It
has better threads utilization right from the beginning but probably
a worse constant than parallel qsort. See details in code comments.

Besides sort is not performed in calling thread but instead in spawned
worker threads. Calling thread yields waiting for worker threads to
finish. Exception is small data size, in this case sorting is executed
in calling thread saving time on spawning a thread. This should speed up
test execution. This is existing behaviour of qsort_arg but data size
threshold is reduced from 128000 to 1024.

Part of #3389

NO_CHANGELOG=internal
NO_DOC=internal

1. Current commit introduces 'box_auth_data_prepare()' to prepare
   a data string for any supported authentication methods.
2. The user name argument is refactored in the auth methods: the
   null-terminated string is replaced with an address range approach.
   Now Rust users don't need to re-allocate username with CString.
3. Password length type was set to uint32_t (previously it was size_t,
   int, uint32_t for different functions). Tarantool uses murmur3a,
   so all the hashed strings should be up to 32 bit long.

NO_DOC=picodata internal patch
NO_CHANGELOG=picodata internal patch
NO_TEST=picodata internal patch

Дмитрий Кибирев authored 1 year ago and Yaroslav Dynnikov committed 1 year ago

Add the temporary path for macos CI.

NO_DOC=picodata internal patch
NO_CHANGELOG=picodata internal patch
NO_TEST=picodata internal patch