Commit Graph

19516 Commits

Author SHA1 Message Date
Thales Macedo Garitezi
6a0c54b40e ci(dev): add .git/ to .gitignore
For some reason, some tools like [ripgrep](https://github.com/BurntSushi/ripgrep) will
search `.git` when using the `-.`/`--hidden` flag, even when not using `--no-ignore-vcs`.
This leads to several unwanted results.
2024-01-16 17:31:28 -03:00
SergeTupchiy
23c0dc58fb
Merge pull request #12337 from SergeTupchiy/refactor-emqx-cm-test-flush
test(emqx_cm_SUITE): use one helper function `emqx_pool:flush_async_tasks/1`
2024-01-16 20:15:16 +02:00
Serge Tupchii
80e82db282 test(emqx_cm_SUITE): use one helper function: emqx_pool:flush_async_tasks/1 2024-01-16 19:42:37 +02:00
SergeTupchiy
ed78f2488b
Merge pull request #12336 from SergeTupchiy/EMQX-11743-dedicated-channel-cleanup-pool
perf(emqx_cm): use a dedicated pool for channel cleanup
2024-01-16 19:38:15 +02:00
Serge Tupchii
b472b56883 perf(emqx_cm): use a dedicated pool for channel cleanup
This is to isolate channels cleanup from other async tasks (like routes cleanup),
as channels cleanup can be quite slow under high network latency conditions.

Fixes: EMQX-11743
2024-01-16 19:08:02 +02:00
yanzhiemq
33aa6da15c
Merge pull request #12323 from emqx/yanzhiemq-patch-1
ci: run scheduled packages build of release-55
2024-01-15 15:55:01 +08:00
yanzhiemq
ac6ce3b72c
ci: run scheduled packages build of release-55 2024-01-15 09:26:23 +08:00
Thales Macedo Garitezi
4736012d0a
Merge pull request #12317 from thalesmg/fix-mongo-batch-schema-m-20240112
fix(mongodb_action): make `batch_size` hidden and fixed in the API
2024-01-12 14:51:38 -03:00
Andrew Mayorov
eca2f972bc
Merge pull request #12237 from keynslug/fix/EMQX-11483/broker
feat(routing): add route sync process pool
2024-01-12 14:44:31 +01:00
Thales Macedo Garitezi
a5e7db793b fix(mongodb_action): make batch_size hidden and fixed in the API
Fixes https://emqx.atlassian.net/browse/ED-1171

The old bridge schema already had this override, but it had not been ported to actions.
2024-01-12 10:04:32 -03:00
lafirest
1c0ca72877
Merge pull request #12316 from lafirest/fix/iotdb
fix(iotdb): move the iot_version into IoTDB connector
2024-01-12 20:56:10 +08:00
Andrew Mayorov
b4eac25678
chore(broker): fix code style issue
Co-Authored-By: Zaiming (Stone) Shi <zmstone@gmail.com>
2024-01-12 13:54:23 +01:00
Ivan Dyachkov
41e931d90a
Merge pull request #12315 from id/0112-ci-fix-pip-command-line
ci: explicitly use --require-hashes for pip install
2024-01-12 13:22:02 +01:00
Thales Macedo Garitezi
d1ae6f5195
Merge pull request #12306 from thalesmg/fix-password-deobfuscate-m-20240111
fix(bridge_api): correctly deobfuscate secrets during dry run
2024-01-12 09:13:20 -03:00
firest
b15106c753 fix(iotdb): robustify type verification
1. let the type is not case sensitive
2. return error if type is invalid
2024-01-12 19:22:06 +08:00
Andrew Mayorov
2f98f1faaf
fix(route-sync): ensure batch sync preserve idemopotency 2024-01-12 11:57:26 +01:00
Andrew Mayorov
e21a3497c7
chore(route-sync): turn TODO into comment 2024-01-12 11:57:26 +01:00
Andrew Mayorov
8f4758d9d4
feat(route-sync): use the smallest possible min sync delay 2024-01-12 11:57:26 +01:00
Andrew Mayorov
2ac6cddf19
fix(route-sync): handle batch sync errors gracefully 2024-01-12 11:57:25 +01:00
Andrew Mayorov
a28fc7bfa8
feat(route-sync): do not run empty batches 2024-01-12 11:57:25 +01:00
Andrew Mayorov
2dffd44985
feat(route-sync): allow to enable syncer pool only on cores/replicants
So we would able to roll it out and test more gradually.
2024-01-12 11:57:25 +01:00
Andrew Mayorov
884f784c1c
refactor(router): don't emqx_broker_helper:monitor/1 in batches
As per out current understanding, this doesn't changes much in terms of
observability, since other nodes call `ekka:monitor(membership)` anyway,
so they will observe nodedowns without explicitly writing an entry into
the `?ROUTING_NODE` table.
2024-01-12 11:57:25 +01:00
Andrew Mayorov
d6f731c4fc
fix(route-sync): use public function as mria activity target 2024-01-12 11:57:25 +01:00
Andrew Mayorov
7d037cfe91
chore(route-sync): clarify why wait indefinitely for reply 2024-01-12 11:57:24 +01:00
Andrew Mayorov
498b7a922d
chore(syncer): fix code style issues
Co-Authored-By: Zaiming (Stone) Shi <zmstone@gmail.com>
2024-01-12 11:57:24 +01:00
Andrew Mayorov
0b3f5f7c37
feat(syncer): allow to turn syncer pool on/off through config 2024-01-12 11:57:24 +01:00
Andrew Mayorov
38e13f2337
fix(syncer): start syncer pool before broker pool
As the latter depends on the former.
2024-01-12 11:57:24 +01:00
Andrew Mayorov
a1ccf85c66
test(routesync): verify that syncer preserves consistency
Under a highly concurrent load. Be aware that this testcase is not
deterministic.
2024-01-12 11:57:24 +01:00
Andrew Mayorov
5aeff20f8b
fix(routesync): ensure causal relationships are preserved
At the cost of strict FIFO semantics though.
2024-01-12 11:57:23 +01:00
Andrew Mayorov
f92b5b3f32
feat(stream): add simple stream over process message queue 2024-01-12 11:57:23 +01:00
Andrew Mayorov
54f8b47455
feat(routing): add route sync process pool
Dedicated to synchronizing local state updates with the global view
of the routing state.
2024-01-12 11:57:18 +01:00
Ivan Dyachkov
3b9dc434ac ci: pin dockerfiles by digest 2024-01-12 11:55:51 +01:00
Ivan Dyachkov
775edd9f5c ci: explicitly use --require-hashes for pip install 2024-01-12 11:29:22 +01:00
firest
0f1aaa65bc fix(iotdb): move the iot_version into IoTDB connector 2024-01-12 17:52:31 +08:00
Ivan Dyachkov
479ceb8596
Merge pull request #12309 from id/0111-ci-pin-more-dependencies
ci: pin more dependencies by sha
2024-01-12 10:51:20 +01:00
JianBo He
9e85b53c39
Merge pull request #12296 from HJianBo/fix-delayed-message-http-api-500
fix(delayed): fix http 500 error
2024-01-12 09:37:41 +08:00
Ivan Dyachkov
4c9078d05f ci: pin more dependencies 2024-01-11 22:08:38 +01:00
Thales Macedo Garitezi
d932fa593b
Merge pull request #12310 from thalesmg/ci-bump-elixir-vsn-sched-m-20240111
ci: fix elixir version in cron build job
2024-01-11 16:49:24 -03:00
Thales Macedo Garitezi
efde3ae490 ci: fix elixir version in cron build job 2024-01-11 16:16:28 -03:00
Thales Macedo Garitezi
79a4a041e4 fix(bridge_api): correctly deobfuscate secrets during dry run
Fixes https://emqx.atlassian.net/browse/EMQX-11733
2024-01-11 15:42:14 -03:00
Ivan Dyachkov
fb44bfcbe6
Merge pull request #12302 from id/0111-ci-restrict-token-permissions-and-pin-deps
ci: restrict token permissions and pin deps
2024-01-11 18:57:21 +01:00
Ivan Dyachkov
beb70265a6 ci: downgrade actions/checkout and actions/upload-artifact version in build_packages
Starting from v4.0.0 actions/checkout has been using node20 runtime.
On Amazon Linux 2, EL7 and Ubuntu 18.04 GLIBC it's too old for node to run:
/__e/node20/bin/node: /lib64/libm.so.6: version `GLIBC_2.27' not found (required by /__e/node20/bin/node)
/__e/node20/bin/node: /lib64/libc.so.6: version `GLIBC_2.28' not found (required by /__e/node20/bin/node)
2024-01-11 18:23:14 +01:00
Ilya Averyanov
ef0850c71f
Merge pull request #12305 from savonarola/1101-fix-channel-info-update
fix(conn): avoid storing incomplete channel info
2024-01-11 18:48:53 +02:00
Ilya Averyanov
4c66a1135b
Merge pull request #12303 from savonarola/0111-fix-indexing
fix(retainer): fix topic search by index
2024-01-11 18:44:56 +02:00
Thales Macedo Garitezi
c4ea79db1e
Merge pull request #12304 from thalesmg/fix-gcp-deprecated-resopts-m-20240111
fix(gcp_pubsub_producer): mark connector resource opts fields as deprecated
2024-01-11 13:24:04 -03:00
Ivan Dyachkov
f65ab9b48c ci: fix actions/upload-artifact v4 compatibility 2024-01-11 16:52:42 +01:00
Ilya Averyanov
7b0b2a0527 fix(conn): avoid storing incomplete channel info 2024-01-11 18:08:13 +03:00
Ilya Averyanov
09d524144b fix(retainer): fix topic search by index 2024-01-11 16:00:58 +03:00
Thales Macedo Garitezi
6ddbfd7b43 fix(gcp_pubsub_producer): mark connector resource opts fields as deprecated
Fixes https://emqx.atlassian.net/browse/EMQX-11703
2024-01-11 09:53:36 -03:00
Thales Macedo Garitezi
3dd3f4803f
Merge pull request #12293 from thalesmg/dev-fix-dev-script-m-20240110
ci: fix `dev` script support for elixir on OTP 26+
2024-01-11 09:21:47 -03:00