plugin rpc sdk

Summary

1. feat: allow calling static picodata procs using .proc syntax

   Use "/path" RPC routes to call plugin-defined endpoints. Use ".proc" RPC routes to call builtin picodata endpoints (for example .proc_instance_info)

2. feat: introduce picoplugin::transport::rpc module

   • use RouteBuilder to register rpc endpoints (input and ouptut is raw bytes for now)
   • use RequestBuilder to send RPC requests to other instances which are running a specified plugin.service (guarded by version)
     • supported routing by
       • explicit instance_id
       • replicaset_id
       • bucket_id
       • any available instance with given service
   • use context::Context to extract information about request or add custom fields at runtime (middleware not yet implemented)

3. chore: add a internal_tests feature in picoplugin for unit tests

4. test: set fiber name in internal tests

5. refactor: make a ConnectionPool for plugins

6. fixup extract stop_service

7. feat: add plugin_name, service_name & service_version to PicoContext

8. refactor: extract stop_service function

9. feat: introduce picoplugin::util::FfiSafeStr for simple string passing over ffi

10. fix: allow sending ?Sized types and receiving RawBytesBuf via ConnectionPool

11. debug: table.keys & table.values utility functions

12. chore: tweak traft::Error::NoSuchInstance

13. feat: add _pico_replicaset_uuid index to _pico_replicaset table

14. chore: clippy warning

15. feat: introduce custom picodata specific error codes for BoxError

---

• Close #693 (closed)
• Changes should be cherry-picked to 24.2: no
• Docs follow-up:
  • schema changes: docs#302 (closed)
  • plugin sdk: docs#282 (closed)

assigned to @gmoshkin

added 1 commit

• c3646582 - WIP: rpc sdk poc

Compare with previous version

added 126 commits

• c3646582...4c2bf489 - 124 commits from branch master
• b463295f - fix: make define_clusterwide_tables macro match <Table>::index_definitions
• 19460687 - WIP: rpc sdk poc

Compare with previous version

added 5 commits

• 0718c130 - feat(plugins): add data migration mechanism for plugins
• 9cb5d5f3 - feature(plugin): new plugin sdk module structure
• ea58134b - feature(plugins): add `internal` module for plugin sdk
• cd539ea9 - fix: make define_clusterwide_tables macro match <Table>::index_definitions
• 659d9638 - WIP: rpc sdk poc

Compare with previous version

changed target branch from master to derevtsov/plugin_sdk_1

added 1 commit

• 0ecce2e3 - WIP: rpc sdk poc

Compare with previous version

deleted the derevtsov/plugin_sdk_1 branch. This merge request now targets the derevtsov/plugin_sdk_0 branch

added 85 commits

• 0ecce2e3...692b13e5 - 68 commits from branch derevtsov/plugin_sdk_0
• 692b13e5...9fe8897d - 7 earlier commits
• a28f4708 - fix: allow sending ?Sized types and receiving RawBytesBuf via ConnectionPool
• 8dbaec49 - feat: introduce picoplugin::util::FfiSafeStr for simple string passing over ffi
• 3ae6f609 - refactor: extract stop_service function
• 8362834c - feat: add plugin_name, service_name & service_version to PicoContext
• cbe3791e - fixup extract stop_service
• e87a24b9 - refactor: make a ConnectionPool for plugins
• b278659c - test: set fiber name in internal tests
• 6cba7b25 - chore: add a internal_tests feature in picoplugin for unit tests
• 186d37ba - feat: introduce picoplugin::transport::rpc module
• acfdfc64 - feat: allow calling static picodata procs using .proc syntax

Compare with previous version

marked this merge request as ready

changed target branch from derevtsov/plugin_sdk_0 to gmoshkin/plugin-ffi-build-time-checks

changed title from WIP: rpc sdk poc to plugin rpc sdk

changed the description

requested review from @k.derevtsov

changed the description

added 7 commits

• f4ca27df - refactor: extract stop_service function
• 015b2ff3 - feat: add plugin_name, service_name & service_version to PicoContext
• d4f93338 - refactor: make a ConnectionPool for plugins
• ccb4028c - test: set fiber name in internal tests
• 9a05dbf1 - chore: add a internal_tests feature in picoplugin for unit tests
• 52539dfb - feat: introduce picoplugin::transport::rpc module
• a2b038cb - feat: allow calling static picodata procs using .proc syntax

Compare with previous version

changed the description

added 12 commits

• a2b038cb...c018e743 - 2 earlier commits
• 52125a4e - debug: table.keys & table.values utility functions
• 79ac6218 - fix: allow sending ?Sized types and receiving RawBytesBuf via ConnectionPool
• f10f92f4 - feat: introduce picoplugin::util::FfiSafeStr for simple string passing over ffi
• 25058b24 - refactor: extract stop_service function
• 6d1ad390 - feat: add plugin_name, service_name & service_version to PicoContext
• 61ff4aa6 - refactor: make a ConnectionPool for plugins
• 1eb704bf - test: set fiber name in internal tests
• ccd71c07 - chore: add a internal_tests feature in picoplugin for unit tests
• 94271629 - feat: introduce picoplugin::transport::rpc module
• 567895fe - feat: allow calling static picodata procs using .proc syntax

Compare with previous version

added 1 commit

• dd34cc8e - feat: set fiber name when executing plugin RPC handlers

Compare with previous version