yuanbiao/emqx
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
19,512 Commits 393 Branches 684 Tags 74 MiB
b472b56883
Commit Graph

10451 Commits

Author SHA1 Message Date
Serge Tupchii
b472b56883 perf(emqx_cm): use a dedicated pool for channel cleanup 
This is to isolate channels cleanup from other async tasks (like routes cleanup),
as channels cleanup can be quite slow under high network latency conditions.

Fixes: EMQX-11743
 2024-01-16 19:08:02 +02:00
Thales Macedo Garitezi
4736012d0a
Merge pull request #12317 from thalesmg/fix-mongo-batch-schema-m-20240112 
fix(mongodb_action): make `batch_size` hidden and fixed in the API
 2024-01-12 14:51:38 -03:00
Andrew Mayorov
eca2f972bc
Merge pull request #12237 from keynslug/fix/EMQX-11483/broker 
feat(routing): add route sync process pool
 2024-01-12 14:44:31 +01:00
Thales Macedo Garitezi
a5e7db793b fix(mongodb_action): make batch_size hidden and fixed in the API 
Fixes https://emqx.atlassian.net/browse/ED-1171

The old bridge schema already had this override, but it had not been ported to actions.
 2024-01-12 10:04:32 -03:00
lafirest
1c0ca72877
Merge pull request #12316 from lafirest/fix/iotdb 
fix(iotdb): move the iot_version into IoTDB connector
 2024-01-12 20:56:10 +08:00
Andrew Mayorov
b4eac25678
chore(broker): fix code style issue 
Co-Authored-By: Zaiming (Stone) Shi <zmstone@gmail.com>
 2024-01-12 13:54:23 +01:00
Thales Macedo Garitezi
d1ae6f5195
Merge pull request #12306 from thalesmg/fix-password-deobfuscate-m-20240111 
fix(bridge_api): correctly deobfuscate secrets during dry run
 2024-01-12 09:13:20 -03:00
firest
b15106c753 fix(iotdb): robustify type verification 
1. let the type is not case sensitive
2. return error if type is invalid
 2024-01-12 19:22:06 +08:00
Andrew Mayorov
2f98f1faaf
fix(route-sync): ensure batch sync preserve idemopotency 2024-01-12 11:57:26 +01:00
Andrew Mayorov
e21a3497c7
chore(route-sync): turn TODO into comment 2024-01-12 11:57:26 +01:00
Andrew Mayorov
8f4758d9d4
feat(route-sync): use the smallest possible min sync delay 2024-01-12 11:57:26 +01:00
Andrew Mayorov
2ac6cddf19
fix(route-sync): handle batch sync errors gracefully 2024-01-12 11:57:25 +01:00
Andrew Mayorov
a28fc7bfa8
feat(route-sync): do not run empty batches 2024-01-12 11:57:25 +01:00
Andrew Mayorov
2dffd44985
feat(route-sync): allow to enable syncer pool only on cores/replicants 
So we would able to roll it out and test more gradually.
 2024-01-12 11:57:25 +01:00
Andrew Mayorov
884f784c1c
refactor(router): don't emqx_broker_helper:monitor/1 in batches 
As per out current understanding, this doesn't changes much in terms of
observability, since other nodes call `ekka:monitor(membership)` anyway,
so they will observe nodedowns without explicitly writing an entry into
the `?ROUTING_NODE` table.
 2024-01-12 11:57:25 +01:00
Andrew Mayorov
d6f731c4fc
fix(route-sync): use public function as mria activity target 2024-01-12 11:57:25 +01:00
Andrew Mayorov
7d037cfe91
chore(route-sync): clarify why wait indefinitely for reply 2024-01-12 11:57:24 +01:00
Andrew Mayorov
498b7a922d
chore(syncer): fix code style issues 
Co-Authored-By: Zaiming (Stone) Shi <zmstone@gmail.com>
 2024-01-12 11:57:24 +01:00
Andrew Mayorov
0b3f5f7c37
feat(syncer): allow to turn syncer pool on/off through config 2024-01-12 11:57:24 +01:00
Andrew Mayorov
38e13f2337
fix(syncer): start syncer pool before broker pool 
As the latter depends on the former.
 2024-01-12 11:57:24 +01:00
Andrew Mayorov
a1ccf85c66
test(routesync): verify that syncer preserves consistency 
Under a highly concurrent load. Be aware that this testcase is not
deterministic.
 2024-01-12 11:57:24 +01:00
Andrew Mayorov
5aeff20f8b
fix(routesync): ensure causal relationships are preserved 
At the cost of strict FIFO semantics though.
 2024-01-12 11:57:23 +01:00
Andrew Mayorov
f92b5b3f32
feat(stream): add simple stream over process message queue 2024-01-12 11:57:23 +01:00
Andrew Mayorov
54f8b47455
feat(routing): add route sync process pool 
Dedicated to synchronizing local state updates with the global view
of the routing state.
 2024-01-12 11:57:18 +01:00
firest
0f1aaa65bc fix(iotdb): move the iot_version into IoTDB connector 2024-01-12 17:52:31 +08:00
JianBo He
9e85b53c39
Merge pull request #12296 from HJianBo/fix-delayed-message-http-api-500 
fix(delayed): fix http 500 error
 2024-01-12 09:37:41 +08:00
Thales Macedo Garitezi
79a4a041e4 fix(bridge_api): correctly deobfuscate secrets during dry run 
Fixes https://emqx.atlassian.net/browse/EMQX-11733
 2024-01-11 15:42:14 -03:00
Ilya Averyanov
ef0850c71f
Merge pull request #12305 from savonarola/1101-fix-channel-info-update 
fix(conn): avoid storing incomplete channel info
 2024-01-11 18:48:53 +02:00
Ilya Averyanov
4c66a1135b
Merge pull request #12303 from savonarola/0111-fix-indexing 
fix(retainer): fix topic search by index
 2024-01-11 18:44:56 +02:00
Ilya Averyanov
7b0b2a0527 fix(conn): avoid storing incomplete channel info 2024-01-11 18:08:13 +03:00
Ilya Averyanov
09d524144b fix(retainer): fix topic search by index 2024-01-11 16:00:58 +03:00
Thales Macedo Garitezi
6ddbfd7b43 fix(gcp_pubsub_producer): mark connector resource opts fields as deprecated 
Fixes https://emqx.atlassian.net/browse/EMQX-11703
 2024-01-11 09:53:36 -03:00
lafirest
c026d3f18a
Merge pull request #12300 from lafirest/fix/clients_api 
fix(api): fix `api/v5/clients ` may crash when a client authenticate with JWT
 2024-01-11 19:10:54 +08:00
lafirest
f042462d53
Merge pull request #12290 from lafirest/fix/retain_match 
fix(retain): add `hasnext` into the meta data for the `GET /retain/messages`
 2024-01-11 18:09:29 +08:00
firest
aca9942fd4 fix(api): fix api/v5/clients may crash when a client authenticate with JWT 2024-01-11 16:53:02 +08:00
firest
f896cf2f4f fix(retain): add hasnext into the meta data for the GET /retain/messages 2024-01-11 16:14:40 +08:00
JianBo He
596607d549 chore: update bpapi.versions 2024-01-11 14:56:02 +08:00
JianBo He
c4dd083fd9 fix(delayed): delete delayed messge on all nodes 2024-01-11 14:12:30 +08:00
JianBo He
eea0ec135f fix(delayed): fix http 500 error 2024-01-11 10:36:55 +08:00
JianBo He
b16920e796
Merge pull request #12285 from HJianBo/shorten-coap-params 
feat(coap): support short param names
 2024-01-11 09:09:09 +08:00
SergeTupchiy
8bea0711ac
Merge pull request #12196 from SergeTupchiy/EMQX-10891-route-cleanup-optimization 
EMQX-10891 route cleanup optimization
 2024-01-10 17:26:24 +02:00
Thales Macedo Garitezi
8532e0cf59
Merge pull request #12292 from thalesmg/fix-syskeeper-v2-only-m-20240110 
fix(syskeeper_bridge): mark syskeeper forwarder as a v2-only action
 2024-01-10 11:42:24 -03:00
Serge Tupchii
965ce5d446 perf: use mria:match_delete/2 to cleanup routes 
This must be much more network efficient since both Mria and Mnesia
need only to replicate one op, e.g.: `{MatchPattern, clear_table}`
instead of replicating one per each key to be deleted.
 2024-01-10 16:23:58 +02:00
Serge Tupchii
febaaefc38 chore: upgrade ekka to 0.18.1 (mria 0.8.1) 
Mria 0.8.1 release implements `mria:match_delete/2` function
 2024-01-10 16:23:58 +02:00
Thales Macedo Garitezi
b395924569
Merge pull request #12283 from thalesmg/fix-gcp-pubsub-produ-resopts-m-20240109 
fix(gcp_pubsub_producer): fix connector `resource_opts` schema
 2024-01-10 11:08:39 -03:00
Zaiming (Stone) Shi
7c8a36fc06
Merge pull request #12289 from zmstone/0108-support-acl-cache-masks 
0108 support acl cache excludes
 2024-01-10 13:40:29 +00:00
Andrew Mayorov
8d61f4665a
Merge pull request #12291 from keynslug/fix/bump-hocon-0.44.4 
fix(conf): bump to hocon 0.40.4
 2024-01-10 14:32:17 +01:00
Zaiming (Stone) Shi
1d46175a7d
Merge pull request #12286 from lafirest/fix/iotdb_enum 
fix(iotdb): improve the schema by gathering atoms into enums
 2024-01-10 13:25:53 +00:00
Thales Macedo Garitezi
b69fc9af15 fix(gcp_pubsub_producer): fix connector resource_opts schema 
Fixes https://emqx.atlassian.net/browse/EMQX-11703
 2024-01-10 10:13:11 -03:00
Thales Macedo Garitezi
787f952ad8 fix(syskeeper_bridge): mark syskeeeper as a v2-only action 
Fixes https://emqx.atlassian.net/browse/EMQX-11706
 2024-01-10 10:09:51 -03:00