Commit Graph

19712 Commits

Author SHA1 Message Date
Thales Macedo Garitezi 4736012d0a
Merge pull request #12317 from thalesmg/fix-mongo-batch-schema-m-20240112
fix(mongodb_action): make `batch_size` hidden and fixed in the API
2024-01-12 14:51:38 -03:00
Andrew Mayorov eca2f972bc
Merge pull request #12237 from keynslug/fix/EMQX-11483/broker
feat(routing): add route sync process pool
2024-01-12 14:44:31 +01:00
Zaiming (Stone) Shi 34681ec7a2 chore: update scripts and ci from old release-xx branch to release-55 2024-01-12 14:15:34 +01:00
Thales Macedo Garitezi a5e7db793b fix(mongodb_action): make `batch_size` hidden and fixed in the API
Fixes https://emqx.atlassian.net/browse/ED-1171

The old bridge schema already had this override, but it had not been ported to actions.
2024-01-12 10:04:32 -03:00
lafirest 1c0ca72877
Merge pull request #12316 from lafirest/fix/iotdb
fix(iotdb): move the iot_version into IoTDB connector
2024-01-12 20:56:10 +08:00
Zaiming (Stone) Shi 61417f26d4 chore: bump versions to 5.5.x 2024-01-12 13:54:35 +01:00
Andrew Mayorov b4eac25678
chore(broker): fix code style issue
Co-Authored-By: Zaiming (Stone) Shi <zmstone@gmail.com>
2024-01-12 13:54:23 +01:00
Ivan Dyachkov 41e931d90a
Merge pull request #12315 from id/0112-ci-fix-pip-command-line
ci: explicitly use --require-hashes for pip install
2024-01-12 13:22:02 +01:00
Thales Macedo Garitezi d1ae6f5195
Merge pull request #12306 from thalesmg/fix-password-deobfuscate-m-20240111
fix(bridge_api): correctly deobfuscate secrets during dry run
2024-01-12 09:13:20 -03:00
firest b15106c753 fix(iotdb): robustify type verification
1. let the type is not case sensitive
2. return error if type is invalid
2024-01-12 19:22:06 +08:00
Andrew Mayorov 2f98f1faaf
fix(route-sync): ensure batch sync preserve idemopotency 2024-01-12 11:57:26 +01:00
Andrew Mayorov e21a3497c7
chore(route-sync): turn TODO into comment 2024-01-12 11:57:26 +01:00
Andrew Mayorov 8f4758d9d4
feat(route-sync): use the smallest possible min sync delay 2024-01-12 11:57:26 +01:00
Andrew Mayorov 2ac6cddf19
fix(route-sync): handle batch sync errors gracefully 2024-01-12 11:57:25 +01:00
Andrew Mayorov a28fc7bfa8
feat(route-sync): do not run empty batches 2024-01-12 11:57:25 +01:00
Andrew Mayorov 2dffd44985
feat(route-sync): allow to enable syncer pool only on cores/replicants
So we would able to roll it out and test more gradually.
2024-01-12 11:57:25 +01:00
Andrew Mayorov 884f784c1c
refactor(router): don't `emqx_broker_helper:monitor/1` in batches
As per out current understanding, this doesn't changes much in terms of
observability, since other nodes call `ekka:monitor(membership)` anyway,
so they will observe nodedowns without explicitly writing an entry into
the `?ROUTING_NODE` table.
2024-01-12 11:57:25 +01:00
Andrew Mayorov d6f731c4fc
fix(route-sync): use public function as mria activity target 2024-01-12 11:57:25 +01:00
Andrew Mayorov 7d037cfe91
chore(route-sync): clarify why wait indefinitely for reply 2024-01-12 11:57:24 +01:00
Andrew Mayorov 498b7a922d
chore(syncer): fix code style issues
Co-Authored-By: Zaiming (Stone) Shi <zmstone@gmail.com>
2024-01-12 11:57:24 +01:00
Andrew Mayorov 0b3f5f7c37
feat(syncer): allow to turn syncer pool on/off through config 2024-01-12 11:57:24 +01:00
Andrew Mayorov 38e13f2337
fix(syncer): start syncer pool before broker pool
As the latter depends on the former.
2024-01-12 11:57:24 +01:00
Andrew Mayorov a1ccf85c66
test(routesync): verify that syncer preserves consistency
Under a highly concurrent load. Be aware that this testcase is not
deterministic.
2024-01-12 11:57:24 +01:00
Andrew Mayorov 5aeff20f8b
fix(routesync): ensure causal relationships are preserved
At the cost of strict FIFO semantics though.
2024-01-12 11:57:23 +01:00
Andrew Mayorov f92b5b3f32
feat(stream): add simple stream over process message queue 2024-01-12 11:57:23 +01:00
Andrew Mayorov 54f8b47455
feat(routing): add route sync process pool
Dedicated to synchronizing local state updates with the global view
of the routing state.
2024-01-12 11:57:18 +01:00
Ivan Dyachkov 3b9dc434ac ci: pin dockerfiles by digest 2024-01-12 11:55:51 +01:00
Ivan Dyachkov 775edd9f5c ci: explicitly use --require-hashes for pip install 2024-01-12 11:29:22 +01:00
Kinplemelon 5cabc6b368 chore: upgrade dashboard to e1.5.0-beta.3 for ee 2024-01-12 18:21:40 +08:00
firest 0f1aaa65bc fix(iotdb): move the `iot_version` into IoTDB connector 2024-01-12 17:52:31 +08:00
Ivan Dyachkov 479ceb8596
Merge pull request #12309 from id/0111-ci-pin-more-dependencies
ci: pin more dependencies by sha
2024-01-12 10:51:20 +01:00
JianBo He 9e85b53c39
Merge pull request #12296 from HJianBo/fix-delayed-message-http-api-500
fix(delayed): fix http 500 error
2024-01-12 09:37:41 +08:00
Ivan Dyachkov 4c9078d05f ci: pin more dependencies 2024-01-11 22:08:38 +01:00
Thales Macedo Garitezi d932fa593b
Merge pull request #12310 from thalesmg/ci-bump-elixir-vsn-sched-m-20240111
ci: fix elixir version in cron build job
2024-01-11 16:49:24 -03:00
Thales Macedo Garitezi efde3ae490 ci: fix elixir version in cron build job 2024-01-11 16:16:28 -03:00
Thales Macedo Garitezi 79a4a041e4 fix(bridge_api): correctly deobfuscate secrets during dry run
Fixes https://emqx.atlassian.net/browse/EMQX-11733
2024-01-11 15:42:14 -03:00
Ivan Dyachkov fb44bfcbe6
Merge pull request #12302 from id/0111-ci-restrict-token-permissions-and-pin-deps
ci: restrict token permissions and pin deps
2024-01-11 18:57:21 +01:00
Ivan Dyachkov beb70265a6 ci: downgrade actions/checkout and actions/upload-artifact version in build_packages
Starting from v4.0.0 actions/checkout has been using node20 runtime.
On Amazon Linux 2, EL7 and Ubuntu 18.04 GLIBC it's too old for node to run:
/__e/node20/bin/node: /lib64/libm.so.6: version `GLIBC_2.27' not found (required by /__e/node20/bin/node)
/__e/node20/bin/node: /lib64/libc.so.6: version `GLIBC_2.28' not found (required by /__e/node20/bin/node)
2024-01-11 18:23:14 +01:00
Ilya Averyanov ef0850c71f
Merge pull request #12305 from savonarola/1101-fix-channel-info-update
fix(conn): avoid storing incomplete channel info
2024-01-11 18:48:53 +02:00
Ilya Averyanov 4c66a1135b
Merge pull request #12303 from savonarola/0111-fix-indexing
fix(retainer): fix topic search by index
2024-01-11 18:44:56 +02:00
Thales Macedo Garitezi c4ea79db1e
Merge pull request #12304 from thalesmg/fix-gcp-deprecated-resopts-m-20240111
fix(gcp_pubsub_producer): mark connector resource opts fields as deprecated
2024-01-11 13:24:04 -03:00
Ivan Dyachkov f65ab9b48c ci: fix actions/upload-artifact v4 compatibility 2024-01-11 16:52:42 +01:00
Ilya Averyanov 7b0b2a0527 fix(conn): avoid storing incomplete channel info 2024-01-11 18:08:13 +03:00
Ilya Averyanov 09d524144b fix(retainer): fix topic search by index 2024-01-11 16:00:58 +03:00
Thales Macedo Garitezi 6ddbfd7b43 fix(gcp_pubsub_producer): mark connector resource opts fields as deprecated
Fixes https://emqx.atlassian.net/browse/EMQX-11703
2024-01-11 09:53:36 -03:00
Thales Macedo Garitezi 3dd3f4803f
Merge pull request #12293 from thalesmg/dev-fix-dev-script-m-20240110
ci: fix `dev` script support for elixir on OTP 26+
2024-01-11 09:21:47 -03:00
Ivan Dyachkov bd6375e2cf ci: bump actions versions in local actions 2024-01-11 12:52:04 +01:00
lafirest c026d3f18a
Merge pull request #12300 from lafirest/fix/clients_api
fix(api): fix `api/v5/clients ` may crash when a client authenticate with JWT
2024-01-11 19:10:54 +08:00
Ivan Dyachkov 06b7d8c293 ci: run CodeQL on release-54 as well as on master 2024-01-11 11:34:46 +01:00
Ivan Dyachkov b2a6e94961 ci: enable dependabot 2024-01-11 11:34:46 +01:00