Skip to content
Snippets Groups Projects
  1. Jul 11, 2017
  2. Jul 10, 2017
    • Vladimir Davydov's avatar
      vinyl: get rid of vy_run_iterator->coio_read · eeb9a81e
      Vladimir Davydov authored
      Instead introduce vy_run_env_enable_coio(), which starts reader threads,
      and make vy_run_iterator automatically switch to coio if reader threads
      are running. With this patch, vy_read_iterator doesn't need a pointer to
      vy_env to add a run as a source, only vy_run_env.
      
      While we are at it, cleanup vy_conf a bit.
      
      Needed for #1906
      eeb9a81e
    • Vladimir Davydov's avatar
      vinyl: fix use-after-free of last_stmt in vy_run_write_page · 63f59df4
      Vladimir Davydov authored
      vy_run_write_page() doesn't take a reference to last_stmt, because it
      assumes that the write iterator guarantees it won't be deleted until
      'next' is called again. The iterator does pin a statement if it is read
      from a run file - see vy_write_iterator_set_tuple() - however there's a
      case when the last returned statement can go away under us. This will
      happen if the iterator is used for major compaction and the last source
      statement is a DELETE. In this case the iterator will unreference the
      last statement it returned to the caller, take a reference to the DELETE
      instead, but won't return the DELETE - see vy_write_iterator_next(). As
      a result, the caller, i.e. vy_run_write_page(), will hit use-after-free
      on an attempt to read last_stmt.
      
      To fix this bug, let's make vy_run_write_page() take a reference to
      last_stmt as it used to before the write iterator was reworked. A test
      case will be added later, after all iterator-related issues have been
      fixed.
      
      Closes #2578
      63f59df4
    • Georgy Kirichenko's avatar
      Add iconv support · aff6235c
      Georgy Kirichenko authored
      Iconv is a library to convert a sequence of characters in one
      character encoding to a sequence of characters in another character
      encoding. Example below converts utf-16 big endian string into utf-8
      string:
      
          convertor = require('iconv').new('UTF-16BE', 'UTF-8')
          converted_string = convertor(source_string)
      
      Closes #2587
      aff6235c
    • Vladimir Davydov's avatar
      vinyl: add missing mem_list_version increment · 3a73e5dc
      Vladimir Davydov authored
      vy_task_dump_new() deletes empty in-memory trees right away, but
      doesn't increment vy_index->mem_list_version, which may result in
      a read iterator crash accessing a deleted vy_mem.
      3a73e5dc
    • alyapunov's avatar
      Use open MP sort optimisation only for huge arrays · 2e864b5a
      alyapunov authored
      Now open MP sort is used for any size of an array.
      For small arrays it's an overkill and even can cause overhead
      due to thread pool creation.
      
      Invoke open MP sort only for big arrays and use old good
      single-thread qsort for small arrays.
      
      Fix #2431
      2e864b5a
    • Roman Tsisyk's avatar
      Fix logging of box.cfg.replication option · 6015e0df
      Roman Tsisyk authored
      Print original uri as is if it doesn't contain sensitive
      information.
      
      Closes #2292
      6015e0df
  3. Jul 09, 2017
  4. Jul 08, 2017
    • Vladimir Davydov's avatar
      vinyl: move read_set from vy_index to tx_manager · 56871b94
      Vladimir Davydov authored
      Needed to remove dependency of vy_index on struct txv.
      
      Needed for #1906
      56871b94
    • Konstantin Osipov's avatar
    • Georgy Kirichenko's avatar
      Altering a space takes effect immediately. · 8631ffb2
      Georgy Kirichenko authored
      Before this patch, the new space, created by alter specification,
      would be put into space cache only after successful WAL write.
      
      This behaviour is not linearizable: on a replica, the WAL is
      played sequentially, and the order of events could differ from the
      master.
      
      Besides, it could crash, as demonstrated in gh-2074 test case.
      
      Since we use a cascading rollback for all transactions on WAL
      write error, it's OK to put a space into space cache
      before WAL write, so that the new transactions apply to the new
      space.
      
      This patch does exactly that.
      
      All subsequent requests are executed against the new space.
      
      This patch also removes on_replace trigger in the old space, since
      all checks against the new tuple format are performed using the new
      space.
      
      Fixes #2074.
      8631ffb2
  5. Jul 07, 2017
  6. Jul 06, 2017
    • Konstantin Osipov's avatar
    • Konstantin Osipov's avatar
      alter: MoveIndex review fixes · 7b1028a4
      Konstantin Osipov authored
      * update comments
      * add a test case for altering a primary key on the fly
      * rename AddIndex to CreateIndex
      * factor out common code into a function
      7b1028a4
    • Georgy Kirichenko's avatar
      alter: introduce MoveIndex and RebuildIndex operations · 8c854d7f
      Georgy Kirichenko authored
      MoveIndex operation is used to move an existing index from the old space
      to the new one. Semantically it's a no-op.
      
      RebuildIndex is introduced for case when essential index properties are
      changed, so it is necessary to drop the old index and create a new one in
      its place in the new space.
      
      AlterSpaceOp::prepare() is removed: all checks are moved to
      on_replace trigger in _index system space from it.
      All checks are done before any alter operation is created.
      
      Necessary for gh-2074 and gh-1796.
      8c854d7f
    • alyapunov's avatar
      alter: move modify vs rebuild index check · 4c87d443
      alyapunov authored
      Move the check which decides on an alter strategy whenever
      a row in _index space is changed, from AlterSpaceOp::preapre()
      to on_replace trigger on _index space.
      
      The check chooses between two options: a heavy-weight index rebuild,
      invoked when index definition, such as key parts, is changed, vs.
      lightweight modify, invoked when index name or minor options are
      modified..
      
      Before this patch, index alteration creates a pair of operations
      (DropIndex + AddIndex) in all cases, but later
      replaces two operations with one at AlterSpaceOp::prepare() phase.
      
      This is bad by several reasons:
      
      - it's done while traversing of a linked list of operations,
        and it changes the list being traversed.
      
      - an order in the list of operations is required for this
      to work: drop must precede add.
      
      - needless allocation and deallocation of operations makes the logic
        unnecessarily complex.
      
      Necessary for gh-1796.
      4c87d443
    • Konstantin Osipov's avatar
      space: create the primary key index first. · 25a99f42
      Konstantin Osipov authored
      Always first create the primary key index in a space. Put
      the primary key key def first in the array of key_defs, passed
      into tuple_format_new(). This is necessary for gh-1796.
      25a99f42
    • Konstantin Osipov's avatar
      space add an assert on state of space object · 5bca3f7c
      Konstantin Osipov authored
      Assert that we can't create a space with secondary key but no primary.
      5bca3f7c
    • alyapunov's avatar
      Move drop primary index check to the stage before new space creation · f6d06b9f
      alyapunov authored
      Now drop primary index checks are made in alter triggers after
      new space creation. Such an implementation leads to temporary
      creation of a space with invalid index set. Fix it and check
      the index set before space_new call.
      f6d06b9f
    • Georgy Kirichenko's avatar
      Add swap_index_def function · 8ec3e3ed
      Georgy Kirichenko authored
      Non destructive swap_index_def function sould be used because memtx_tree
      stores a pointer to an index_def used while tree creation. Fixed #2570
      8ec3e3ed
    • Kirill Yukhin's avatar
      sql: Fix test · 35052b97
      Kirill Yukhin authored
      Use `net.box` instead of `console`.
      35052b97
    • Kirill Yukhin's avatar
      sql: Reduce maximal trigger call chain · 0bf0a00c
      Kirill Yukhin authored
      LLVM is more eager for frame size than GCC
      Current maximal call chain length may corrupt stack then.
      Reduce maximal call chain length to 30.
      
      Related to #2550
      0bf0a00c
    • Kirill Yukhin's avatar
      sql: Intialize SQL subsystem after config is over · 1f04f5d5
      Kirill Yukhin authored
      If after recovery first client to invoke SQL differs from
      ADMIN, then initialization of SQL subsystem will fail due to
      insufficient access rights. Problem is that SQL invokes
      create_from_tuple() to fill space_def structure, which in turn
      verifies access right.
      As far as SQL is a static part of Tarantool, there's no sense
      to initialize the system by demand. Change performs data dictionary
      initialization upon config completion.
      Regression test added as well.
      
      Closes #2483
      1f04f5d5
  7. Jul 05, 2017
Loading