4d912516c8
fix: don't override authn users when import_user from authn.boostrap_file
2024-07-02 21:18:37 +08:00
bd0c8f0204
fix: bad conflict resolution
2024-07-02 09:47:49 -03:00
89bd69eb50
fix(bridge v1 api): return correct http response code when incompatible
2024-07-02 09:46:06 -03:00
8843fcbbf4
perf: use manifest to track proto file compilation
2024-07-02 09:45:47 -03:00
19f3b030f9
chore: preparing to run common tests / eunit with mix
2024-07-02 09:45:45 -03:00
b74828d7ea
perf: "mixify" project to improve release speed
...
Fixes https://emqx.atlassian.net/browse/EMQX-12527
2024-07-02 09:39:48 -03:00
dea2bf19b1
Merge pull request #13389 from lafirest/fix/builtin_acl
...
fix: fix two minor issues of bulti-in authn/authz
2024-07-02 20:19:53 +08:00
5a0bae2318
Merge pull request #13367 from thalesmg/20240628-r57-test-flaky-authz-cache
...
test(authz cache): attempt to fix flaky test
2024-07-02 09:14:06 -03:00
24ac241727
Merge pull request #13380 from thalesmg/20240701-r57-fix-http-bridge-hc-return-value
...
fix(http action): use correct return value for channel health check
2024-07-02 09:13:53 -03:00
db07a1ebea
feat(message transformation): add more read-only fields to context
...
Fixes https://emqx.atlassian.net/browse/EMQX-12583
2024-07-02 09:13:19 -03:00
686f79c036
fix: fix two minor issues of bulti-in authn/authz
...
1. the `Derived Key Length` for `pbkdf2` should be a positive integer.
2. fix topics in the authorization rules might be parsed incorrectly
2024-07-02 19:35:48 +08:00
a46440d00a
feat(log): allows custom the encoding of payload in the log
2024-07-02 19:33:31 +08:00
7e0bcd4eda
chore: tests in otp26
2024-07-02 15:26:07 +08:00
317b29451f
test(gcp consumer): attempt to stabilize flaky test
...
```
%%% emqx_bridge_kafka_impl_consumer_SUITE ==> ssl.t_start_and_consume_ok: FAILED
%%% emqx_bridge_kafka_impl_consumer_SUITE ==> {{panic,
#{msg => "Unexpected result",
result =>
{run_stage_failed,error,
{badmatch,{{1,0},timeout}},
[{emqx_bridge_kafka_impl_consumer_SUITE,
'-t_start_and_consume_ok/1-fun-12-',4,
[{file,
"/emqx/apps/emqx_bridge_kafka/test/emqx_bridge_kafka_impl_consumer_SUITE.erl"},
{line,1184}]},
{emqx_bridge_kafka_impl_consumer_SUITE,
t_start_and_consume_ok,1,
[{file,
"/emqx/apps/emqx_bridge_kafka/test/emqx_bridge_kafka_impl_consumer_SUITE.erl"},
{line,1171}]}]}}},
[{emqx_bridge_kafka_impl_consumer_SUITE,t_start_and_consume_ok,1,
[{file,
"/emqx/apps/emqx_bridge_kafka/test/emqx_bridge_kafka_impl_consumer_SUITE.erl"},
{line,1240}]},
```
2024-07-01 17:57:17 -03:00
c04e93838f
test(eviction agent): attempt to stabilize flaky test
...
```
%%% emqx_eviction_agent_SUITE ==> t_session_serialization: FAILED
%%% emqx_eviction_agent_SUITE ==>
Failure/Error: ?assertEqual(1, emqx_eviction_agent : session_count ( ))
expected: 1
got: 2
line: 348
```
2024-07-01 16:10:32 -03:00
59084dbfbe
fix(message transformation): correctly read from user properties in context
...
Port of https://github.com/emqx/emqx/pull/13316 to release-57
Fixes https://emqx.atlassian.net/browse/EMQX-12582
2024-07-01 14:53:42 -03:00
6dbb561944
Merge pull request #13355 from thalesmg/20240627-r57-fix-connector-api-bad-ssl-config
...
fix(connector api): handle bad tls config file conversion errors
2024-07-01 14:26:09 -03:00
b14856cf1a
refactor: improve error messages
2024-07-01 13:21:17 -03:00
72664780df
fix(http action): use correct return value for channel health check
...
Fixes https://emqx.atlassian.net/browse/EMQX-12622
2024-07-01 11:17:57 -03:00
532f04da9d
Merge pull request #13373 from id/0701-sync-release-57
...
sync release-57
2024-07-01 16:02:29 +02:00
d1e9b097d1
Merge pull request #13365 from thalesmg/20240628-r57-fix-dashboard-add-default-user-concurrently
...
fix(dashboard): handle add default user race condition
2024-07-01 10:22:32 -03:00
505f568c32
chore: bump apps versions
2024-07-01 13:52:27 +02:00
e28750b522
Merge remote-tracking branch 'upstream/release-57' into 0701-sync-release-57
2024-07-01 13:52:14 +02:00
bd075caf56
Merge pull request #13358 from lafirest/fix/authn_reason
...
fix(events): fixed the reason format of the `authn_complete_event`
2024-07-01 18:46:18 +08:00
6c665037de
Merge pull request #13372 from lafirest/fix/gateway_license
...
fix: limit gateway connections with license
2024-07-01 18:46:05 +08:00
a0644d4612
chore: update app version
2024-07-01 16:32:08 +08:00
b5d507bad8
fix: limit gateway connections with license
2024-06-30 20:06:04 +08:00
ec6e862539
test(authz cache): attempt to fix flaky test
...
Hypothesis: some race condition involving the previous test case, which uses the same
clientid.
```
Testing apps.emqx.emqx_authz_cache_SUITE: *** FAILED test case 3 of 3 ***
%%% emqx_authz_cache_SUITE ==> t_drain_authz_cache: FAILED
%%% emqx_authz_cache_SUITE ==>
Failure/Error: ?assertEqual([], list_cache ( ClientPid ))
expected: []
got: [{{#{qos => 0,action_type => publish,retain => false},<<"t1">>},
{allow,1719599365019}}]
line: 72
```
2024-06-28 15:40:55 -03:00
9215b3710f
Merge pull request #13327 from thalesmg/fix-kprodu-delete-wolff-r57-20240624
...
fix(kafka and derivatives): add `alias` config to avoid clashes with same topic
2024-06-28 15:22:11 -03:00
b69f298058
fix(dashboard): handle add default user race condition
...
This can happen at least in tests, when nodes boot concurrently.
2024-06-28 15:18:23 -03:00
795d280861
fix(connector api): handle bad tls config file conversion errors
...
Fixes https://emqx.atlassian.net/browse/EMQX-12581
2024-06-28 14:31:31 -03:00
9ede62c9b1
Merge pull request #13356 from thalesmg/20240626-m-test-sparkplug-empty-roundtrip
...
test(schema registry): add test asserting the behavior of empty message roundtrip
2024-06-28 12:08:38 -03:00
2a9c27d206
Merge pull request #13345 from thalesmg/20240626-r572-fix-validate-schema-reg-name
...
fix(schema registry api): validate schema name when creating
2024-06-28 12:08:27 -03:00
063e7657b5
Merge pull request #13344 from thalesmg/20240626-r572-multi-node-bulk-subscribe
...
fix(client mgmt api): make bulk subscribe work again in clusters
2024-06-28 12:08:16 -03:00
067beece75
chore: add count to thrown error
2024-06-28 12:06:47 -03:00
7cf0e69fdf
chore: fix failed tests
2024-06-28 14:07:59 +08:00
e8176b80a6
fix(events): fixed the reason format of the `authn_complete_event`
2024-06-28 11:09:28 +08:00
b39557f6fd
Merge pull request #13336 from zhongwencool/authn-boostrap-file
...
feat: support bootstrap_file on authentication for build-in-database
2024-06-28 09:07:53 +08:00
2c48d7e0f0
Merge pull request #13347 from zhongwencool/improve-check-oom-log
...
chore: log shutdown reason for check_oom trace log
2024-06-28 08:06:11 +08:00
79f15b1daa
test(schema registry): add test asserting the behavior of empty message roundtrip
...
Relates to https://emqx.atlassian.net/browse/EMQX-10866
2024-06-27 17:49:57 -03:00
e76e94b497
perf(mgmt): optimize bulk unsubscribe when registry is enabled
2024-06-27 10:32:55 -03:00
0b329dbf06
perf(mgmt): optimize bulk subscribe when registry is enabled
2024-06-27 10:32:55 -03:00
c49900af50
perf(mgmt): optimize clientid lookup when registry is enabled
2024-06-27 10:32:55 -03:00
7b7f44b9ac
fix(client mgmt api): make bulk subscribe work again in clusters
...
Fixes https://emqx.atlassian.net/browse/EMQX-12337
2024-06-27 09:37:55 -03:00
6f00df6452
fix(schema registry api): validate schema name when creating
...
Fixes https://emqx.atlassian.net/browse/EMQX-10958
2024-06-27 09:26:41 -03:00
ff8c2bc1d8
feat(authz): add `ignore` metric for each source type
...
Fixes https://emqx.atlassian.net/browse/EMQX-12411
2024-06-27 09:22:45 -03:00
4bd0abc93f
chore: bump app vsns
2024-06-27 09:22:06 -03:00
4c3c86e919
chore: bump wolff -> 2.0.0
2024-06-27 09:20:00 -03:00
164a507899
test(pulsar): add testcase for different producers using the same topic
2024-06-27 09:20:00 -03:00
ed5e6599d9
fix(buffer worker, kafka): send reply when async call fails immediately
...
Fixes https://emqx.atlassian.net/browse/EMQX-12585
2024-06-27 09:20:00 -03:00
6023012f8b
fix(kafka and derivatives): add `alias` config to avoid clashes with same topic
...
Fixes https://emqx.atlassian.net/browse/EMQX-12592
2024-06-27 09:20:00 -03:00
3b21c41690
feat: support to extract the client peersni field to clientinfo
2024-06-27 17:13:10 +08:00
b6e7d7566d
Merge remote-tracking branch 'origin/release-572' into release-57
2024-06-27 11:09:02 +02:00
ef28579c4a
Merge pull request #13334 from JimMoen/fix-mqtt-username-password-flag
...
fix(mqtt): check password flag to respect protocol spec
2024-06-27 16:16:53 +08:00
6a78951715
chore: log shutdown reason for check_oom trace log
2024-06-27 14:52:22 +08:00
68d747b7b9
Merge pull request #13324 from lafirest/feat/oidc-572
...
feat(sso): add OIDC support
2024-06-27 11:24:05 +08:00
3d398873f1
fix(oidc): return to dashboard when provider calls back
...
fixed a bug when updating config
2024-06-27 10:22:07 +08:00
9594b6df32
chore: warning overrided when restart authn
2024-06-27 10:16:04 +08:00
24d2534641
chore: apply review suggestion
2024-06-27 10:16:04 +08:00
5265c3cc1f
feat: support bootstrap_file on build-in-db authn
2024-06-27 10:16:04 +08:00
557a843c69
chore: minimize oss/platform diff
2024-06-26 22:48:50 +02:00
82e7b75a02
chore: bump app versions
2024-06-26 22:47:18 +02:00
98f70ea8d8
Merge remote-tracking branch 'origin/release-572' into release-57
2024-06-26 22:28:08 +02:00
d8963c836e
Merge pull request #13332 from keynslug/ft/EMQX-12571/error-mapping
...
feat(bridge-s3): provide more meaningful error details in status
2024-06-26 21:13:51 +02:00
e1de18ef10
test(dsrepl): await stable state before running testcase
2024-06-26 20:44:35 +02:00
30efa1f57e
test(dsrepl): relax crash-recover testcase to tolerate message loss
...
Which is quite an expected occasion for this kind of stress test.
2024-06-26 20:44:34 +02:00
3d296abde9
fix(dsrepl): classify ra error conditions more carefully
...
Most importantly: avoid automatic retries of `shutdown` and `nodedown`
errors as this could easily lead to Raft log entries duplication.
2024-06-26 20:44:34 +02:00
733751fadd
refactor(dsstore): keep passing `Options` to both prepare + commit
2024-06-26 20:44:34 +02:00
5b5f33c421
chore(dsstore): resurrect `prepare_batch` entry tracepoint
2024-06-26 20:44:34 +02:00
8ff48ac5ea
feat(dsrepl): rely on accumulated log size to decide when to flush
2024-06-26 20:44:34 +02:00
b6a249baa9
feat(cth-peer): add brutal `kill/1` facility
2024-06-26 20:44:34 +02:00
8db70b5bbc
test(dsrepl): add crash-restart-recover testcase
...
That verifies nothing is lost in the event of abrupt node failures.
2024-06-26 20:44:33 +02:00
ae89b61af0
feat(cth-cluster): make `restart/1` more generic
2024-06-26 20:44:33 +02:00
5fd5fc76e5
fix(dsstore): ensure backward compatibility
2024-06-26 20:44:33 +02:00
8538a5a5b6
test(dsrepl): anticipate transitionless membership changes
...
E.g. when a membership change is applied twice in a row.
2024-06-26 20:44:33 +02:00
cd0663074e
test(dsrepl): add `add_generation` events into the mix
...
They usually cause storage layer to perform flushes, and thus enable
testing `handle_flush/1` codepath in different circumstances.
2024-06-26 20:44:33 +02:00
2180cc7c26
fix(dsstore): avoid storing `cf_refs()` in the RocksDB itself
...
This is both pointless and confusing.
2024-06-26 20:44:33 +02:00
80ea2e62f7
fix(stream): ensure that `chain/1` preserves the order
2024-06-26 20:44:32 +02:00
7895e9cc45
feat(dsstore): make WAL-less mode optional
...
And make the upper layer choose when to use it.
2024-06-26 20:44:32 +02:00
0c0757b8c2
feat(dsrepl): enable WAL-less batch writes
2024-06-26 20:44:32 +02:00
2705226eb5
feat(dsrepl): release log entries occasionally
...
Also make tracepoints in `apply/3` callback implementation more
uniform.
2024-06-26 20:44:32 +02:00
b6894c18fa
chore(dsrepl): improve tracepoints usability a bit
2024-06-26 20:44:32 +02:00
263e654208
Merge pull request #13340 from thalesmg/20240626-r572-fix-docs-conf-load
...
fix: don't crash if application is already loaded
2024-06-26 15:15:49 -03:00
e81494a132
fix: don't crash if application is already loaded
...
```
Runtime terminating during boot ({{badmatch,{error,{already_loaded,wolff}}},[{emqx_conf,load,2,[{file,"emqx_conf.erl"},{line,167}]},{lists,foreach_1,2,[{file,"lists.erl"},{line,1686}]},{emqx_conf,dump_schema,2,[{file,"emqx_conf.erl"},{line,150}]},{erl_eval,do_apply,7,[{file,"erl_eval.erl"},{line,746}]},{erl_eval,expr,6,[{file,"erl_eval.erl"},{line,494}]},{erl_eval,exprs,6,[{file,"erl_eval.erl"},{line,136}]},{init,start_it,1,[]},{init,start_em,1,[]}]})
```
2024-06-26 13:41:32 -03:00
954adc71c4
test: attempt to fix flaky test
...
https://github.com/emqx/emqx/actions/runs/9662725303/job/26653594859?pr=13328#step:6:186
```
%%% emqx_resource_SUITE ==> t_expiration_retry: FAILED
%%% emqx_resource_SUITE ==> {{panic,
#{msg => "Unexpected result",
result =>
{run_stage_failed,error,
{badmatch,{ok,timeout}},
[{emqx_resource_SUITE,'-do_t_expiration_retry/0-fun-12-',0,
[{file,
"/__w/emqx/emqx/apps/emqx_resource/test/emqx_resource_SUITE.erl"},
{line,2569}]},
{emqx_resource_SUITE,do_t_expiration_retry,0,
[{file,
"/__w/emqx/emqx/apps/emqx_resource/test/emqx_resource_SUITE.erl"},
{line,2518}]}]}}},
[{emqx_resource_SUITE,do_t_expiration_retry,0,
[{file,"/__w/emqx/emqx/apps/emqx_resource/test/emqx_resource_SUITE.erl"},
{line,2594}]},
{test_server,ts_tc,3,[{file,"test_server.erl"},{line,1793}]},
{test_server,run_test_case_eval1,6,[{file,"test_server.erl"},{line,1302}]},
{test_server,run_test_case_eval,9,[{file,"test_server.erl"},{line,1234}]}]}
```
2024-06-26 13:40:49 -03:00
ef1b6d2a55
chore: keep enterprise edition version updated as well
2024-06-26 11:40:49 +02:00
465ae507d8
chore: update release version to v5.7.1
2024-06-26 10:49:59 +02:00
af9bfc21cb
Merge pull request #13312 from zmstone/0621-fix-regex_extract-docs
...
doc: fix regex_extract function doc
2024-06-26 10:48:40 +02:00
7f73f27d56
docs: fix typo
2024-06-26 10:18:08 +02:00
4942f6f75a
feat: improve keepalive_multiplier and keepalive_check_interval
2024-06-26 15:43:48 +08:00
21c01f32ff
Merge pull request #13305 from kjellwinblad/kjell/redis_conn_always_time_out_no_username_password/EMQX-12557
...
fix: redis connector should not timeout because no username and password
2024-06-25 16:06:21 -03:00
da214be5a1
test(bridge-s3): adapt testcase to different CI environment
2024-06-25 18:35:53 +02:00
10e9fed22b
Merge pull request #13326 from keynslug/fix/ct/api-clients-flaky
...
test(api-clients): refactor suite to isolate flakiness
2024-06-25 18:26:42 +02:00
ed130fdc57
test: MQTT CONNECT flags check
2024-06-25 23:25:42 +08:00
02a9885aa5
fix(mqtt): check password flag to respect protocol spec
2024-06-25 23:25:36 +08:00
983f02ea1b
refactor: separate CONNECT flags validation funcs
2024-06-25 23:15:39 +08:00
130571b56e
fix: code improvements thanks to comments from @thalesmg
2024-06-25 12:00:36 -03:00
6190192cbc
fix: redis connector should not timeout because no username and password
...
A redis connector of type single or sentinel always got a timeout error
when doing the connector test in the dashboard if no username or
password was provided. This commit makes sure that the user instead get
an informative error message. Additionally, this commit adds more
more error information for all redis connector types.
Fixes:
https://emqx.atlassian.net/browse/EMQX-12557
2024-06-25 12:00:36 -03:00
cc89a20ed9
Merge pull request #13318 from thalesmg/test-flaky-gcp-consu-r57-20240621
...
test(gcp consumer): stabilize flaky test
2024-06-25 11:52:20 -03:00
486a041adf
feat(bridge-s3): also map credentials / aggreg upload errors
2024-06-25 16:51:07 +02:00
zhongwencool