7895e9cc45
feat(dsstore): make WAL-less mode optional
...
And make the upper layer choose when to use it.
2024-06-26 20:44:32 +02:00
0c0757b8c2
feat(dsrepl): enable WAL-less batch writes
2024-06-26 20:44:32 +02:00
2705226eb5
feat(dsrepl): release log entries occasionally
...
Also make tracepoints in `apply/3` callback implementation more
uniform.
2024-06-26 20:44:32 +02:00
b6894c18fa
chore(dsrepl): improve tracepoints usability a bit
2024-06-26 20:44:32 +02:00
263e654208
Merge pull request #13340 from thalesmg/20240626-r572-fix-docs-conf-load
...
fix: don't crash if application is already loaded
2024-06-26 15:15:49 -03:00
e81494a132
fix: don't crash if application is already loaded
...
```
Runtime terminating during boot ({{badmatch,{error,{already_loaded,wolff}}},[{emqx_conf,load,2,[{file,"emqx_conf.erl"},{line,167}]},{lists,foreach_1,2,[{file,"lists.erl"},{line,1686}]},{emqx_conf,dump_schema,2,[{file,"emqx_conf.erl"},{line,150}]},{erl_eval,do_apply,7,[{file,"erl_eval.erl"},{line,746}]},{erl_eval,expr,6,[{file,"erl_eval.erl"},{line,494}]},{erl_eval,exprs,6,[{file,"erl_eval.erl"},{line,136}]},{init,start_it,1,[]},{init,start_em,1,[]}]})
```
2024-06-26 13:41:32 -03:00
954adc71c4
test: attempt to fix flaky test
...
https://github.com/emqx/emqx/actions/runs/9662725303/job/26653594859?pr=13328#step:6:186
```
%%% emqx_resource_SUITE ==> t_expiration_retry: FAILED
%%% emqx_resource_SUITE ==> {{panic,
#{msg => "Unexpected result",
result =>
{run_stage_failed,error,
{badmatch,{ok,timeout}},
[{emqx_resource_SUITE,'-do_t_expiration_retry/0-fun-12-',0,
[{file,
"/__w/emqx/emqx/apps/emqx_resource/test/emqx_resource_SUITE.erl"},
{line,2569}]},
{emqx_resource_SUITE,do_t_expiration_retry,0,
[{file,
"/__w/emqx/emqx/apps/emqx_resource/test/emqx_resource_SUITE.erl"},
{line,2518}]}]}}},
[{emqx_resource_SUITE,do_t_expiration_retry,0,
[{file,"/__w/emqx/emqx/apps/emqx_resource/test/emqx_resource_SUITE.erl"},
{line,2594}]},
{test_server,ts_tc,3,[{file,"test_server.erl"},{line,1793}]},
{test_server,run_test_case_eval1,6,[{file,"test_server.erl"},{line,1302}]},
{test_server,run_test_case_eval,9,[{file,"test_server.erl"},{line,1234}]}]}
```
2024-06-26 13:40:49 -03:00
ef1b6d2a55
chore: keep enterprise edition version updated as well
2024-06-26 11:40:49 +02:00
465ae507d8
chore: update release version to v5.7.1
2024-06-26 10:49:59 +02:00
af9bfc21cb
Merge pull request #13312 from zmstone/0621-fix-regex_extract-docs
...
doc: fix regex_extract function doc
2024-06-26 10:48:40 +02:00
7f73f27d56
docs: fix typo
2024-06-26 10:18:08 +02:00
4942f6f75a
feat: improve keepalive_multiplier and keepalive_check_interval
2024-06-26 15:43:48 +08:00
21c01f32ff
Merge pull request #13305 from kjellwinblad/kjell/redis_conn_always_time_out_no_username_password/EMQX-12557
...
fix: redis connector should not timeout because no username and password
2024-06-25 16:06:21 -03:00
da214be5a1
test(bridge-s3): adapt testcase to different CI environment
2024-06-25 18:35:53 +02:00
10e9fed22b
Merge pull request #13326 from keynslug/fix/ct/api-clients-flaky
...
test(api-clients): refactor suite to isolate flakiness
2024-06-25 18:26:42 +02:00
ed130fdc57
test: MQTT CONNECT flags check
2024-06-25 23:25:42 +08:00
02a9885aa5
fix(mqtt): check password flag to respect protocol spec
2024-06-25 23:25:36 +08:00
983f02ea1b
refactor: separate CONNECT flags validation funcs
2024-06-25 23:15:39 +08:00
130571b56e
fix: code improvements thanks to comments from @thalesmg
2024-06-25 12:00:36 -03:00
6190192cbc
fix: redis connector should not timeout because no username and password
...
A redis connector of type single or sentinel always got a timeout error
when doing the connector test in the dashboard if no username or
password was provided. This commit makes sure that the user instead get
an informative error message. Additionally, this commit adds more
more error information for all redis connector types.
Fixes:
https://emqx.atlassian.net/browse/EMQX-12557
2024-06-25 12:00:36 -03:00
cc89a20ed9
Merge pull request #13318 from thalesmg/test-flaky-gcp-consu-r57-20240621
...
test(gcp consumer): stabilize flaky test
2024-06-25 11:52:20 -03:00
486a041adf
feat(bridge-s3): also map credentials / aggreg upload errors
2024-06-25 16:51:07 +02:00
fb9afd8313
feat(bridge-s3): beautify posix write errors
2024-06-25 16:51:07 +02:00
f3ffbd4710
feat(bridge-s3): provide more meaningful error details in status
2024-06-25 16:51:06 +02:00
98e4ea6fde
feat(bridge-s3): make validation errors more readable
...
And also turn them into schema-level validations, instead of
bridge-level error conditions.
2024-06-25 16:51:06 +02:00
1a497bcaf2
fix(greptime): correctly define grpc options for `grpcbox_channel`
...
Will probably fix CI flakiness.
2024-06-25 09:47:31 -03:00
c9ec5ac87b
test(gcp consumer): stabilize flaky test
...
https://github.com/emqx/emqx/actions/runs/9614788348/job/26526973635?pr=13317#step:5:1463
```
%%% emqx_bridge_gcp_pubsub_consumer_SUITE ==> t_connection_down_before_starting: FAILED
%%% emqx_bridge_gcp_pubsub_consumer_SUITE ==> {{panic,
#{msg => "Unexpected result",
result =>
{run_stage_failed,error,
{assertMatch,
[{module,emqx_bridge_gcp_pubsub_consumer_SUITE},
{line,1451},
{expression,"health_check ( Config )"},
{pattern,"{ ok , connecting }"},
{value,{ok,disconnected}}]},
[{emqx_bridge_gcp_pubsub_consumer_SUITE,
'-t_connection_down_before_starting/1-fun-11-',4,
[{file,
"/emqx/apps/emqx_bridge_gcp_pubsub/test/emqx_bridge_gcp_pubsub_consumer_SUITE.erl"},
{line,1451}]},
{emqx_bridge_gcp_pubsub_consumer_SUITE,
t_connection_down_before_starting,1,
[{file,
"/emqx/apps/emqx_bridge_gcp_pubsub/test/emqx_bridge_gcp_pubsub_consumer_SUITE.erl"},
{line,1427}]}]}}},
[{emqx_bridge_gcp_pubsub_consumer_SUITE,t_connection_down_before_starting,1,
[{file,
"/emqx/apps/emqx_bridge_gcp_pubsub/test/emqx_bridge_gcp_pubsub_consumer_SUITE.erl"},
{line,1462}]},
{test_server,ts_tc,3,[{file,"test_server.erl"},{line,1793}]},
{test_server,run_test_case_eval1,6,[{file,"test_server.erl"},{line,1302}]},
{test_server,run_test_case_eval,9,[{file,"test_server.erl"},{line,1234}]}]}
```
2024-06-25 09:36:55 -03:00
9f30da334f
Merge pull request #13248 from ieQu1/dev/EMQX-12491-local-backend
...
replace builtin DS backend with builtin_local and builtin_raft
2024-06-24 23:07:57 +02:00
d349f84f04
fix(ds): Apply remarks
2024-06-24 20:20:40 +02:00
d12b985507
test(api-clients): refactor suite to isolate flakiness
2024-06-24 16:54:20 +02:00
5d1608f34b
chore: minimize oss/platform diff
2024-06-24 15:30:03 +02:00
debf1e6cd5
Merge pull request #13316 from thalesmg/fix-mt-read-user-prop-m-20240621
...
fix(message transformation): correctly read from user properties in context
2024-06-24 09:31:48 -03:00
abc255bb02
fix(oidc): make CI happy
2024-06-24 18:11:02 +08:00
892420e2c6
feat(oidc): be more compatible with okta
2024-06-24 16:51:54 +08:00
ddb197951e
feat(oidc): implement JWKS, private_key_jwt, DPoP
2024-06-24 16:51:43 +08:00
9c0df3c0a8
feat(oidc): support the PKCE extension
2024-06-24 16:51:32 +08:00
5e2693c9b4
feat(oidc): implement session management
2024-06-24 16:51:20 +08:00
512b4b9cbb
feat(sso): add OIDC support
2024-06-24 16:50:58 +08:00
23acbb664e
Merge pull request #13258 from HJianBo/fix-boot-order-for-gws
...
fix: gateway app must depends on all auth apps
2024-06-24 16:31:27 +08:00
f9e17d6c25
Merge pull request #13269 from JimMoen/improve-plugin-behavior
...
fix: mark fresh install to cp the default configuration file directly
2024-06-24 09:17:25 +02:00
4a81c3ac18
Merge pull request #13298 from qzhuyan/fix/william/hot-conf-disable-partial-chain
...
fix(tls): disable partial_chain in hot config
2024-06-24 09:02:07 +02:00
c0472a06f1
test(ds): Set initial conditions in repl. suite explicitly
2024-06-22 02:55:05 +02:00
ec83d999bf
Merge remote-tracking branch 'origin/release-57' into 20240621-sync-r57-m
2024-06-21 14:11:08 -03:00
9a58d71378
fix(ds): Move DS backend supervision trees to their own apps
2024-06-21 18:22:04 +02:00
3d69ec496a
fix(schema): Transform config of `singleton' discovery_strategy
2024-06-21 17:16:25 +02:00
d7d878fd43
test(ds): Fix emqx standalone test profile selection
2024-06-21 17:16:25 +02:00
8aa27488b6
test: Disable certain DS-related suites in CE
2024-06-21 17:16:24 +02:00
1d3b1868fb
test(ds): Use close_db API
2024-06-21 17:16:24 +02:00
b2f7815a7f
test(ds): Don't start raft explicitly
2024-06-21 17:16:24 +02:00
3851fc189f
fix(ds): Avoid reverse dependencies from storage to repl. layer
2024-06-21 17:16:24 +02:00
bc915216a0
feat(ds): Support metrics for builtin_local backend
2024-06-21 17:16:24 +02:00
be6c5e172f
fix(ds): Disable DS management APIs for builtin_local backend
2024-06-21 17:16:24 +02:00
99c9b56cf3
feat(ds_buffer): Add `ls' function to list all local buffers
2024-06-21 17:16:24 +02:00
5a8818edf3
feat(ds): Add schema for builtin_local backend
2024-06-21 17:16:24 +02:00
4484f30021
feat(ds_schema): Add schema for builtin_local backend
2024-06-21 17:16:24 +02:00
8990b1312b
refactor(ds_schema): Rename backend builtin -> builtin_raft
2024-06-21 17:16:24 +02:00
ea48b1265d
refactor(ds_schema): Extract common builtin fields
2024-06-21 17:16:24 +02:00
abe41de19b
refactor(ds_schema): builtin_local_buffer -> builtin_buffer
2024-06-21 17:16:24 +02:00
ecb172b07e
refactor(ds): Rename egress metrics to 'buffer'
2024-06-21 17:16:24 +02:00
09c3ae795d
refactor(ds_raft): Replace egress server with common emqx_ds_buffer
2024-06-21 17:16:24 +02:00
a0fbd37e58
refactor(emqx): Use emqx_ds_backends application
2024-06-21 17:16:24 +02:00
ef09cfcd71
feat(ds): Add `emqx_ds_backends` application
2024-06-21 17:16:24 +02:00
279619fc80
feat(ds): Add `builtin_local' backend
2024-06-21 17:16:24 +02:00
a8ea0ae4e5
refactor(ds): Extract DS replication layer to a separate application
2024-06-21 17:16:24 +02:00
63f1856a2c
feat(ds): Dynamic backend registration
2024-06-21 17:16:24 +02:00
83dc8f4d77
fix(ds): Fix return values of emqx_ds_storage_layer functions
2024-06-21 17:16:23 +02:00
a18d1987a2
test(ds): Add a helper function for diffing messages
2024-06-21 17:16:23 +02:00
f1b8c356a6
Merge pull request #13299 from savonarola/0617-shared-sub-leader-poc
...
feat(queue): implement PoC version of session ↔️ shared group leader interaction
2024-06-21 16:45:17 +03:00
28c7d94bd2
fix(message transformation): correctly read from user properties in context
...
Fixes https://emqx.atlassian.net/browse/EMQX-12582
2024-06-21 09:39:22 -03:00
db28a042d5
feat(queue): handle renew_lease_timeout
2024-06-21 15:18:37 +03:00
75a524c916
test: add more debug msg to flaky cluster_rpc SUITE
2024-06-21 18:04:24 +08:00
2096755ad6
feat(queue): reorganize group sm callbacks and methods
2024-06-21 13:01:38 +03:00
b9c5911883
feat(queue): implement `find_leader_timeout` event and so the `connecting` group_sm state
2024-06-21 12:22:17 +03:00
fb266fbf8c
Merge pull request #13300 from SergeTupchiy/EMQX-12195-cluster-link-conf-backup
...
cluster link conf backup
2024-06-21 11:42:57 +03:00
8a99995810
docs: fix regex_extract function doc
2024-06-21 09:25:09 +02:00
d8e6c07ca0
chore: fix failed tests
2024-06-21 11:04:23 +08:00
a8af90f912
chore: add changes
2024-06-21 09:39:14 +08:00
08f085d823
fix: gateway app must depends on all auth apps
2024-06-21 09:39:14 +08:00
979fb58e50
feat(queue): use tp to trace new lease events
2024-06-20 21:12:15 +03:00
1205e34650
feat(queue): remove too useless header file
2024-06-20 20:48:56 +03:00
acc8bf3405
Merge pull request #13222 from JimMoen/fix-will-qos-retain-flag-check
...
fix: check willretain and willqos when WillFlag set to `true`
2024-06-21 01:28:23 +08:00
ba4fb0d3f9
Merge pull request #13290 from kjellwinblad/kjell/format_rule_cli/EMQX-12548
...
fix: do not crash when showing rule unsing the cmd interface
2024-06-20 14:55:33 +02:00
2a0071aa01
Merge pull request #13295 from thalesmg/test-flaky-greptime-mkII-r57-20240619
...
test(greptime): attempt to fix flaky tests (attempt without driver patch)
2024-06-20 14:49:21 +02:00
be175d205c
feat(queue): add JIRA task links for TODOs
2024-06-20 15:38:16 +03:00
a9c976b6c1
feat(queue): fix notes about the usage of agent<->leader protocol-related data structures
2024-06-20 15:24:25 +03:00
d0cff63ed6
feat(queue): remove unused hrl-guard
2024-06-20 15:18:47 +03:00
a92460d38f
feat(queue): improve hints for macro clauses
2024-06-20 15:17:08 +03:00
ac8762be10
chore: upgrade ekka to 0.19.5 (mria 0.8.8)
...
mria 0.8.8 heals a network partition once majority of core nodes are alive.
Previously, the autoheal worked only when all core nodes were reachable.
Fixes: EMQX-10974
2024-06-20 12:53:58 +03:00
464a0a82f0
fix(tls): move default_root_fun to ?CONST_MOD_V1
2024-06-20 11:38:52 +02:00
7d32275ebe
chore: minimize oss/platform diff
2024-06-20 10:36:01 +02:00
12859b8959
fix: handle yet another action format
2024-06-20 10:03:49 +02:00
675abd7512
test: will retain and willqos in connect flags
2024-06-20 10:32:15 +08:00
cf9d6943d5
fix: check willretain and willqos when WillFlag set to `true`
2024-06-20 10:32:15 +08:00
c307c1dfc2
chore: cut v5.7.1-alpha.1
2024-06-20 09:40:42 +08:00
6da10036dc
feat(queue): fix dialyzer issues
2024-06-19 22:25:53 +03:00
a4bbab4aa2
feat(queue): document general entity layout
2024-06-19 22:24:20 +03:00
ff742d926a
fix: `?SLOG` with msg field
2024-06-20 02:18:26 +08:00
71f5eaf11e
fix(data_backup): import `cluster.links` conf
2024-06-19 20:47:06 +03:00
ef5cf4fac3
chore(clusterlink): fix comment
2024-06-19 20:46:00 +03:00
2b0146663a
feat(queue): add smoke test for ds shared subs
2024-06-19 19:32:23 +03:00
Andrew Mayorov