yuanbiao/emqx

Author	SHA1	Message	Date
JimMoen	e9de7316b6	test: shared-sub topics/subscription api	2023-10-30 14:42:59 +08:00
JimMoen	814e22feb3	fix: topics/subscripton mgmt api searching	2023-10-30 14:42:47 +08:00
zhongwencool	0634ff61c0	fix: dialyzer warning	2023-10-30 09:57:30 +08:00
JimMoen	a2015f37ae	Merge pull request #10976 from JimMoen/fix-shared-sub-unsub	2023-10-27 21:22:27 +08:00
lafirest	e63602c4b0	Merge pull request #11811 from lafirest/fix/api_rbac fix(rbac): for compatibility with old data schema, extend the existing field as an extra	2023-10-27 17:56:54 +08:00
JimMoen	d563121284	refactor: move ?REDISPATCH_TO macro to emqx_mqtt.hrl	2023-10-27 17:54:14 +08:00
firest	4ba34f8f3e	chore(rbac): fix CI errors & update change	2023-10-27 17:17:04 +08:00
JimMoen	3b5cc912e7	fix: add `redispatch_to` header to all msgs when deliver shared-sub - to find correct SubOpts for shared-sub dispatch - use previous key `redispatch_to` to ensure rolling upgrade compatibility	2023-10-27 16:15:23 +08:00
zhongwencool	22223dc536	fix: return 400 when audit log is disabled	2023-10-27 16:11:30 +08:00
zhongwencool	995948f0e8	refactor: remove seq from audit record	2023-10-27 14:07:19 +08:00
zhongwencool	9bb22507df	fix: dont use transation on audit log	2023-10-27 11:41:12 +08:00
JimMoen	53383991d9	fix: rewrite #share{} and return #share{}, not formated $share/group/topic	2023-10-27 09:23:44 +08:00
JimMoen	afec6fa2f6	fix: TopicFilter may modified by `client.subscribe` hook	2023-10-27 09:23:44 +08:00
JimMoen	802a36c670	fix: find SubOpts by shared_record, not deliver topic	2023-10-27 09:23:44 +08:00
JimMoen	eaa5459509	chore: bump apps vsn	2023-10-27 09:23:43 +08:00
JimMoen	0ca725ff25	fix: deprecated `share` in `subopts`	2023-10-27 09:23:43 +08:00
JimMoen	b5411da770	refactor: subscribe process to fix shared-sub	2023-10-27 09:23:43 +08:00
Andrew Mayorov	44b4205561	fix(secret): do not treat missing file secrets as config error They are intended to be used mostly in the context of resources, which have their own feedback mechanism: statuses, retries, etc. Also turn the error into a throw exception, so that it can be interpreted as a regular error condition, for example by the resource manager.	2023-10-26 14:37:14 +07:00
firest	cbfd02d1b0	refactor(ldap): merge the `ldap-bind` backend as a type for the `ldap` backend	2023-10-26 11:04:44 +08:00
Zaiming (Stone) Shi	97601171a5	Merge pull request #11818 from zmstone/1025-fix-flaky-test test: fix a flaky test case emqx_crl_cache_SUITE:t_revoked	2023-10-25 20:46:31 +02:00
Zaiming (Stone) Shi	76a8b0efd4	test: fix a flaky test case emqx_crl_cache_SUITE:t_revoked	2023-10-25 16:08:31 +02:00
William Yang	f52b4a9e32	fix: gen_rpc tcp client port align with server port	2023-10-25 12:11:35 +02:00
William Yang	37dd44c3d7	Merge pull request #11813 from qzhuyan/fix/william/genrpc-ssl-port-align Fix/william/genrpc ssl port align	2023-10-25 09:04:19 +02:00
William Yang	6346e0d28a	fix(gen_rpc): ssl client port align with server port	2023-10-24 22:33:52 +02:00
firest	ec41479633	feat(rbac): supports setting role in API bootstrap file	2023-10-24 23:03:18 +08:00
firest	e175c213a1	fix(rbac): for compatibility with old data schema, extend the existing field as extra	2023-10-24 22:28:53 +08:00
Zaiming (Stone) Shi	abcb3166f6	fix: use binary string for raw default values	2023-10-24 14:46:01 +02:00
firest	7a8a5926ab	fix(rbac): adjust the role names	2023-10-24 19:01:12 +08:00
Stefan Strigler	6e12569260	Merge pull request #11797 from sstrigler/EMQX-1057-fix-authz-api-donot-return-200 fix: return 404 if built_in_database not configured as auth source	2023-10-24 12:08:53 +02:00
Andrew Mayorov	52f4519eeb	feat(mqttbridge): support file-sourced secrets as passwords	2023-10-24 16:24:52 +07:00
Andrew Mayorov	1c2f9321d1	feat(emqx): add file-sourced generic secrets These secrets follow the same `emqx_secret` convention of 0-arity functions. Also provide a simple HOCON schema module for use in application schemas.	2023-10-24 16:24:51 +07:00
Stefan Strigler	ea9228108b	fix: use minirest filter	2023-10-24 09:57:08 +02:00
JimMoen	99fab8dc5d	chore: missing change log for duplicated apikey fixing	2023-10-24 09:44:39 +08:00
Thales Macedo Garitezi	d392c9989f	Merge pull request #11793 from thalesmg/test-rule-engine-foreach-m-20231019 test(rule_engine): add test to exemplify `foreach` with json array payload	2023-10-23 13:43:33 -03:00
Stefan Strigler	4e0e755b28	fix: return 404 if built_in_database not configured as auth source	2023-10-23 16:26:41 +02:00
Ilya Averyanov	8c6f6b56b8	chore(tests): report more friendly about unset PROFILE variable	2023-10-23 13:48:42 +03:00
Ilya Averyanov	edde661da3	fix(authn): fix pbkdf2 option validation	2023-10-23 10:26:11 +03:00
William Yang	a9b42af8b3	Merge pull request #11796 from qzhuyan/fix/william/gen_rpc-driver fix(gen_rpc): ensure client/server use same driver	2023-10-23 08:24:17 +02:00
JimMoen	e6576951ef	test: cleanup duplicated apikey with different name	2023-10-20 22:33:26 +08:00
JimMoen	d467289bb2	fix: avoid duplicated apikey from data import	2023-10-20 21:13:04 +08:00
William Yang	dd5807b797	fix(gen_rpc): ensure client/server use same driver Also bump to gen_rpc 3.2.1	2023-10-20 12:17:49 +02:00
zhongwencool	ef692596f7	fix: don't crash when 401 and 403 unauthorize	2023-10-20 15:22:30 +08:00
zhongwencool	6a8b2dc1f9	fix: bad high frequency request name	2023-10-20 14:57:31 +08:00
zhongwencool	c97fe796e3	chore: update emqx_audit's license	2023-10-20 14:47:24 +08:00
JimMoen	f381961108	fix: macro EMQX_RELEASE_EDITION when `emqx` run as standalnoe app	2023-10-20 14:47:24 +08:00
zhongwencool	32c1f1cca6	chore: inlude emqx as emqx_audit's deps	2023-10-20 14:47:24 +08:00
zhongwencool	1d7aa9495a	chore: make spellcheck happy	2023-10-20 14:47:24 +08:00
zhongwencool	befc484544	chore: add changelog entry and fix xref warning	2023-10-20 14:47:24 +08:00
zhongwencool	141061c1e2	feat: add max_filter_size and ignore_high_frequency_request config	2023-10-20 14:47:24 +08:00
zhongwencool	926c804314	feat: add /audit http api to filter audit log	2023-10-20 14:47:24 +08:00
zhongwencool	8b5ec2a4d5	fix: xref failed	2023-10-20 11:46:31 +08:00
zhongwencool	281add1464	Merge branch 'master' into sync-master-to-release-54	2023-10-20 10:11:39 +08:00
lafirest	74442b0d31	Merge pull request #11766 from lafirest/feat/rbac feat(api_key): add RBAC feature for the API key	2023-10-20 09:24:41 +08:00
Thales Macedo Garitezi	8c4beec6f0	test(rule_engine): add test to exemplify `foreach` with json array payload Relates to https://emqx.atlassian.net/browse/EMQX-11174	2023-10-19 18:19:42 -03:00
Ilya Averyanov	0b4600c293	feat(auth): improve redis command parsing and validation	2023-10-19 23:01:35 +03:00
Thales Macedo Garitezi	eda82caf65	Merge pull request #11791 from thalesmg/fix-coap-heartbeat-m-20231018 fix(coap): increase received packet counter for keepalive	2023-10-19 13:12:41 -03:00
Ilya Averyanov	8d82c30b00	Merge pull request #11771 from savonarola/1015-validate-bcrypt-schema-in-api feat(authn): allow authn providers to define a separate schama for API	2023-10-19 15:34:34 +03:00
Ilya Averyanov	8f9ac6c1f3	Merge pull request #11776 from savonarola/1017-auth-cleanup-2 chore(authn): remove dead code	2023-10-19 15:28:35 +03:00
Thales Macedo Garitezi	5b9866f630	fix(coap): increase received packet counter for keepalive Fixes https://emqx.atlassian.net/browse/EMQX-11193 Fixes https://github.com/emqx/emqx/issues/11779	2023-10-18 16:35:33 -03:00
zhongwencool	2388d36b09	fix: allow viewers to change their own passwords	2023-10-18 18:40:02 +08:00
Ilya Averyanov	e1c8317779	chore(authn): remove dead code	2023-10-18 10:57:55 +03:00
JimMoen	1f8478623f	chore: bump esaml to support Entra ID && bump app.src	2023-10-18 10:01:34 +08:00
JimMoen	b2948666fb	chore: add saml sso redirect login log	2023-10-18 10:01:34 +08:00
Ilya Averyanov	c0ebaf9b6f	Merge pull request #11541 from savonarola/0829-duplicate-ft-responses Support asynchronous mode of receiving responses to FT operations	2023-10-17 17:08:00 +03:00
Ilya Averyanov	6354f3b04f	feat(authn): allow authn providers to define a separate schama for API	2023-10-17 13:19:11 +03:00
Zaiming (Stone) Shi	55618dd28a	Merge pull request #11731 from zmstone/1008-expose-file-transfer-host-conf fix(api-docs): add file-transfer config to hot-config scope	2023-10-17 11:23:16 +02:00
firest	467a2bc9b1	test(rbac): add test cases for RBAC in REST API	2023-10-17 16:23:38 +08:00
firest	26ec860d96	feat(backup): add migration mechanism when import backup data	2023-10-17 16:23:32 +08:00
Zaiming (Stone) Shi	dfa5909392	Merge pull request #11752 from zmstone/1011-change-default-rpc-module-for-mria refactor: change mria default rpc module from 'gen_rpc' to 'rpc'	2023-10-17 10:21:14 +02:00
firest	db3915d472	fix(rbac): update changes && fix CI errors	2023-10-17 13:44:37 +08:00
Zaiming (Stone) Shi	162b901be6	Merge pull request #11763 from zmstone/1114-sync-release-53 Merge release-53 back to master	2023-10-16 21:42:02 +02:00
firest	e095de7367	feat(api_key): add RBAC feature for the API key	2023-10-16 14:10:01 +08:00
JianBo He	16cc816bd3	Merge pull request #11757 from zhongwencool/trace-api-return-500 fix: 500 error response when downloading non-existent trace files	2023-10-16 13:40:18 +08:00
Zaiming (Stone) Shi	6eb3bb7cff	Merge remote-tracking branch 'origin/release-53' into 1114-sync-release-53	2023-10-14 10:16:38 +02:00
Zaiming (Stone) Shi	7c022c2c6a	refactor: change mria default rpc module from 'gen_rpc' to 'rpc' Erlang distribution seems to outperform gen_rpc (unless gen_rpc clients are scaled up, but this is not easy to achive for shard transport as it may reorder events).	2023-10-14 10:13:31 +02:00
Ilya Averyanov	cd2752117c	Merge pull request #11762 from savonarola/1013-fix-mnesia-authz-destroy fix(mnesia authz): destroy authz records on mnesia authz destroy	2023-10-13 20:54:14 +03:00
Ilya Averyanov	bde8800f2e	fix(mnesia authz): destroy authz records on mnesia authz destroy	2023-10-13 18:29:45 +03:00
Ilya Averyanov	90a0c093bf	Merge pull request #11750 from savonarola/1011-redact-auth-http-request Do not trace authn http request bodies	2023-10-13 17:25:28 +03:00
Ilya Averyanov	4f14e8df22	chore(source dir): split out postgresql connector	2023-10-13 16:58:57 +03:00
Thales Macedo Garitezi	7a6c756b7c	Merge pull request #11754 from thalesmg/fix-postgres-error-reason-log-m-20231011 fix(postgres): format unicode error messages from driver	2023-10-13 09:58:28 -03:00
Andrew Mayorov	0144ed9981	Merge pull request #11753 from keynslug/chore/smaller-ci-artifacts chore(ci): try to reduce CI artifacts footprint	2023-10-13 16:56:47 +07:00
Andrew Mayorov	51c57a5f0a	fix(cass): avoid using aggregates in healthcheck query Otherwise, this query will produce warning message per each healthcheck, telling the user: ``` WARN <...> - Aggregation query used without partition key ```	2023-10-13 16:50:19 +07:00
Andrew Mayorov	083e2da347	chore(bpapicheck): make some failures more user-friendly	2023-10-13 15:42:08 +07:00
Andrew Mayorov	0b9ac24c1e	fix(bpapicheck): stop depending on git index	2023-10-13 15:40:49 +07:00
lafirest	96c546c187	Merge pull request #11725 from lafirest/feat/os-ldap chore: change the LDAP integration to opensource	2023-10-13 15:05:39 +08:00
Zaiming (Stone) Shi	dd03be29a6	Merge pull request #11751 from zmstone/1011-refactor-move-emqx_license-app-to-apps 1011 refactor move emqx_license app to apps	2023-10-13 06:45:49 +02:00
firest	33ff5d5588	chore: update auth header file	2023-10-13 10:16:47 +08:00
Ilya Averyanov	68f31a9da2	fix(authn): do not trace authn requests	2023-10-12 16:32:16 +03:00
Ilya Averyanov	08795f559c	Merge pull request #11336 from savonarola/0724-trace-authz Trace non-resultative authz calls	2023-10-12 14:51:15 +03:00
Andrew Mayorov	6413afd0bc	fix(gcpdev): restore original shard in mnesia tab definition Changing the shard is not backward compatible, and leads to a crash when upgrading from 5.2.x.	2023-10-12 17:30:07 +07:00
Ilya Averyanov	4ecd5e17a2	chore(authz): trace non-resultative authz calls to backend modules	2023-10-12 12:29:39 +03:00
firest	3e658b3da9	chore: update changes	2023-10-12 17:15:47 +08:00
firest	9b4def885a	chore: change the LDAP integration to opensource	2023-10-12 16:37:32 +08:00
zhongwencool	1021088f5f	fix: 500 error response when downloading non-existent trace files	2023-10-12 15:23:23 +08:00
Thales Macedo Garitezi	b07dddd49e	fix(postgres): format unicode error messages from driver Fixes https://emqx.atlassian.net/browse/EMQX-11024 Sample error: ``` {error, error, <<"42501">>, insufficient_privilege, <<229,175,185,232,161,168,32,109,113,116,116,95,117,115,101,114,32,230,157,131,233,153,144,228,184,141,229,164,159>>, []} ```	2023-10-11 17:56:12 -03:00
Ilya Averyanov	534c9bdc13	feat(ft): add additional operation status report channel	2023-10-11 19:51:36 +03:00
Zaiming (Stone) Shi	d9859b6b49	Merge pull request #11749 from thalesmg/test-fix-flaky-http-suite-r53-20231011 test: attempt to fix flaky http bridge suite	2023-10-11 16:07:17 +02:00
William Yang	e6358ca18c	Merge pull request #11747 from qzhuyan/dev/william/quicer-0.0.202 bump to quicer 0.0.202	2023-10-11 15:43:47 +02:00
Zaiming (Stone) Shi	e069680bca	refactor: move emqx_license app from lib-ee to apps	2023-10-11 15:41:35 +02:00
Thales Macedo Garitezi	ab662f506d	test: attempt to fix flaky http bridge suite ``` =CRASH REPORT==== 10-Oct-2023::05:35:30.911371 === crasher: initial call: ehttpc:init/1 pid: <0.23358.2> registered_name: [] exception error: bad argument in function persistent_term:get/1 called as persistent_term:get({emqx_bridge_http_SUITE, do_t_async_retries,attempts}) *** argument 1: no persistent term stored with this key in call from emqx_bridge_http_SUITE:'-do_t_async_retries/3-fun-2-'/0 (/__w/emqx/emqx/apps/emqx_bridge_http/test/emqx_bridge_http_SUITE.erl, line 697) in call from emqx_bridge_http_SUITE:'-do_t_async_retries/3-fun-4-'/6 (/__w/emqx/emqx/apps/emqx_bridge_http/test/emqx_bridge_http_SUITE.erl, line 705) ```	2023-10-11 09:13:25 -03:00
Ilya Averyanov	57655854d1	Merge pull request #11743 from savonarola/1010-auth-leftovers chore(auth): cleanup code	2023-10-11 15:09:07 +03:00
William Yang	a69c53455f	fix: bump to quicer 0.0.202 bring in urgent fixs from msquic 2.2.3	2023-10-11 13:12:32 +02:00
zhongwencool	cc392cadb8	chore: update apps/emqx_retainer/src/emqx_retainer_mnesia_cli.erl Co-authored-by: Zaiming (Stone) Shi <zmstone@gmail.com>	2023-10-11 18:40:09 +08:00
Ilya Averyanov	03ae5bf3c8	chore(auth): cleanup code	2023-10-11 13:13:50 +03:00
zhongwencool	f4a88f717b	feat: support retainer Start Length command	2023-10-11 11:47:37 +08:00
zhongwencool	8e7ba16c3a	fix: nothing show when run clients list command	2023-10-11 11:47:15 +08:00
zhongwencool	574dc2f243	fix: observer load command crash when loading noexist module	2023-10-11 10:36:33 +08:00
Zaiming (Stone) Shi	a2e86c67db	Merge pull request #11733 from keynslug/fix/EMQX-10827/sesson-takeover fix(cm): bring back pre-v5.3.0 compat in `takeover_session_begin/1`	2023-10-10 19:03:29 +02:00
Zaiming (Stone) Shi	0f07f678e7	Merge pull request #11742 from zmstone/1010-sync-release-53-to-master 1010 sync release-53 to master	2023-10-10 18:56:23 +02:00
Thales Macedo Garitezi	196b24c0cb	Merge pull request #11741 from thalesmg/test-fix-flaky-http-test-m-20231010 test: attempt to fix flaky http bridge suite	2023-10-10 13:52:08 -03:00
Thales Macedo Garitezi	ee45145fb5	Merge pull request #11724 from thalesmg/fix-kprodu-sync-metrics-m-20231006 fix({kafka,pulsar}_producer): correctly handle metrics for connectors that have internal buffers	2023-10-10 12:13:33 -03:00
Thales Macedo Garitezi	ec588f94e2	test: attempt to fix flaky http bridge suite ``` =CRASH REPORT==== 10-Oct-2023::05:35:30.911371 === crasher: initial call: ehttpc:init/1 pid: <0.23358.2> registered_name: [] exception error: bad argument in function persistent_term:get/1 called as persistent_term:get({emqx_bridge_http_SUITE, do_t_async_retries,attempts}) *** argument 1: no persistent term stored with this key in call from emqx_bridge_http_SUITE:'-do_t_async_retries/3-fun-2-'/0 (/__w/emqx/emqx/apps/emqx_bridge_http/test/emqx_bridge_http_SUITE.erl, line 697) in call from emqx_bridge_http_SUITE:'-do_t_async_retries/3-fun-4-'/6 (/__w/emqx/emqx/apps/emqx_bridge_http/test/emqx_bridge_http_SUITE.erl, line 705) ```	2023-10-10 09:50:53 -03:00
Ivan Dyachkov	bfb2218392	chore: fix release version	2023-10-10 14:50:49 +02:00
Thales Macedo Garitezi	cf2075d7d8	chore: remove mention of `is_buffer_supported` from typespec	2023-10-10 09:49:18 -03:00
Zaiming (Stone) Shi	143673b703	chore: bump release version to 5.3.1-alpha.1	2023-10-10 14:35:46 +02:00
Zaiming (Stone) Shi	0a9e1dfa88	Merge pull request #11734 from zmstone/1002-support-ipv6-only-clustering Make IPv6 clustering options configurable	2023-10-10 14:29:52 +02:00
Andrew Mayorov	5fff2ffe45	test(kafka): try to stabilize `t_dynamic_mqtt_topic/1` testcase	2023-10-10 17:18:24 +07:00
Andrew Mayorov	9b573834f9	Merge pull request #11736 from keynslug/fix/eval-erl-audit fix(audit): handle abstract forms when logging `eval_erl`	2023-10-10 15:49:19 +07:00
Zaiming (Stone) Shi	2626d793a7	test: try to resolve schema module from PROFILE in tests	2023-10-10 10:24:10 +02:00
Zaiming (Stone) Shi	808237364c	fix(api-docs): add file-transfer config to hot-config scope	2023-10-10 10:24:10 +02:00
Zaiming (Stone) Shi	e7e696cd66	feat(rpc): add ipv6_only config	2023-10-10 10:05:14 +02:00
firest	e07937a3ef	fix(ldap): escape the escape character (\)	2023-10-10 13:49:36 +08:00
Andrew Mayorov	2a291dfd27	fix(audit): handle abstract forms when logging `eval_erl`	2023-10-10 12:31:19 +07:00
Andrew Mayorov	522302fee1	fix(cm): bring back pre-v5.3.0 compat in `takeover_session_begin/1` Which was accidentally broken in `bf164175`.	2023-10-10 01:34:10 +07:00
Zaiming (Stone) Shi	1e93d2f1fc	chore: upgrade to ekka 0.15.16 gen_rpc 3.2.0 * ekka 0.15.16 supports 'inet6_tls' as ekka.proto_dist * gen_rpc 3.2.0 supports true \| false as gen_rpc.ipv6_only	2023-10-09 20:03:21 +02:00
Zaiming (Stone) Shi	497e08448d	feat(cluster): support ipv6 and tls on ipv6 for clustering Made possible to configure inet6_tls for Erlang distribution Also, added support to configure ipv6 listener for gen_rpc	2023-10-09 20:03:21 +02:00
Zaiming (Stone) Shi	03d8e06ff7	chore(emqx_rule_funcs): regroup export functions	2023-10-09 20:03:21 +02:00
Thales Macedo Garitezi	d6781efee2	fix(resource): change how buffer workers are started	2023-10-09 15:02:25 -03:00
Thales Macedo Garitezi	902b1d6ec5	fix(pulsar_producer): use `simple_async_internal_buffer` query mode for Pulsar Since it has internal buffering, it necessitates the same fix as Kafka producer.	2023-10-09 15:02:25 -03:00
Thales Macedo Garitezi	eebfb44f72	fix(resource): create `simple_async_internal_buffer` query mode for bridges with internal buffering Since authn/authz backends also use simple async/sync queries, we may want to avoid them calling the connector when it's not connected.	2023-10-09 15:02:25 -03:00
Thales Macedo Garitezi	79cf0a2ced	fix(kafka_producer): correctly handle metrics for connector that have internal buffers Fixes https://emqx.atlassian.net/browse/EMQX-11086 There’s currently a metric inconsistency due to the internal buffering nature of Kafka Producer (wolff). We use simple_sync_query to call the Kafka Producer bridge. If that times out, the call is accounted as failed, even though the message is buffered in wolff and later sent successfully.	2023-10-09 15:02:25 -03:00
Zaiming (Stone) Shi	c60915293a	Merge pull request #11634 from savonarola/0919-auth-refactor Auth refactor	2023-10-09 19:51:26 +02:00
lafirest	8f4cdc3fcf	Merge pull request #11732 from lafirest/test/sso_cli test(ldap): add test suite for SSO CLI	2023-10-09 20:35:23 +08:00
Zaiming (Stone) Shi	9ab49a7ae3	Merge remote-tracking branch 'origin/master' into 0919-auth-refactor	2023-10-09 14:18:10 +02:00
lafirest	2c7e5eb1cb	Merge pull request #11728 from lafirest/fix/ldap_filter fix(ldap): improve the filter lex && parse	2023-10-09 18:24:57 +08:00
firest	e3550fc07b	test(ldap): add test suite for SSO CLI	2023-10-09 16:05:56 +08:00
zhongwencool	0c89b6b213	docs: swagger api tags should camel case	2023-10-09 15:21:51 +08:00
firest	b2a6724dc2	fix(ldap): improve the filter lex && parse 1. auto escape special chars in the filter 2. fix a bug that the value can't be `dn`	2023-10-08 18:39:20 +08:00
zhongwencool	482e82f914	fix: cli's args in audit log should be array	2023-10-07 17:38:02 +08:00
Thales Macedo Garitezi	34186fcc74	fix(kafka_producer): send messages to wolff producer to buffer even when connector is in `connecting` state Fixes https://emqx.atlassian.net/browse/EMQX-11085 Messages would not be sent to wolff if the connection was down, so they were effectively lost.	2023-10-06 11:43:29 -03:00
Ilya Averyanov	398a62031e	chore: update app versions	2023-10-05 13:41:50 +03:00
Ilya Averyanov	5dff36474d	chore(auth): get rid of hardcoded schema modules in auth	2023-10-05 13:41:50 +03:00
Ilya Averyanov	c2c56ba481	chore(auth): update tests	2023-10-05 13:41:50 +03:00
Ilya Averyanov	1eb75b43c4	chore(auth): split emqx_authn and emqx_authz apps	2023-10-05 13:41:50 +03:00
Zaiming (Stone) Shi	fd75dc895d	fix(authn): "authentication" importance should not be "hidden"	2023-10-03 11:18:21 +02:00
Zaiming (Stone) Shi	ca8da5723a	Merge pull request #11704 from zmstone/0928-sync-release-53 0928 sync release 53	2023-10-02 21:57:32 +02:00
Zaiming (Stone) Shi	3f6e0e890b	chore: bump emqx_durable_storage and emqx_license app vsn	2023-10-02 20:13:09 +02:00
Thales Macedo Garitezi	2358d67908	refactor: move session stuff from `emqx_ds` to `emqx_persistent_session_ds` Part of https://emqx.atlassian.net/browse/EMQX-10942	2023-09-29 18:00:24 -03:00
Zaiming (Stone) Shi	bce8fd2fbc	chore: bump app versions	2023-09-29 18:56:52 +02:00
Zaiming (Stone) Shi	ed5b456d62	Merge remote-tracking branch 'origin/release-53' into 0928-sync-release-53	2023-09-29 18:24:44 +02:00
Zaiming (Stone) Shi	a852400fb3	chore: add 5.3.bpapi	2023-09-29 16:34:04 +02:00
Zaiming (Stone) Shi	fe01aaff4f	chore: prepare for e5.3.0 promotion	2023-09-29 13:32:57 +02:00
Zaiming (Stone) Shi	ce5bd0a3ce	Merge remote-tracking branch 'origin/release-53' into 0928-sync-release-53	2023-09-29 11:36:32 +02:00
Zaiming (Stone) Shi	c64e599e81	docs: document how to retrieve peercert	2023-09-29 10:33:57 +02:00
Zaiming (Stone) Shi	dc147fd310	fix(rule-engine): console action has no args field	2023-09-29 10:33:33 +02:00
Zaiming (Stone) Shi	1177a32310	chore: bump version to 5.3.0-rc.2	2023-09-29 09:49:27 +02:00
Zaiming (Stone) Shi	6891234390	chore: return simplified error reason for less logging	2023-09-29 09:48:15 +02:00
Zaiming (Stone) Shi	c2d750aa09	fix(resource): redact query args in exception log	2023-09-29 09:20:42 +02:00
Zaiming (Stone) Shi	02ef854f0f	fix(ldap): no crash when no query result is empty list	2023-09-29 08:54:41 +02:00
Zaiming (Stone) Shi	b59a7ff2dd	Merge pull request #11706 from zmstone/0928-fix-ldap-sso-logging-level 0928 fix ldap sso logging level and reject muti-match results	2023-09-29 02:40:37 +02:00
Zaiming (Stone) Shi	4a4730ad46	fix(ldap): handle invalidCredentials in ldap authn	2023-09-29 00:51:05 +02:00
Zaiming (Stone) Shi	9ee2cb9c79	fix(ldap): return unrecoverable_error if more than on match found	2023-09-28 23:58:34 +02:00
Zaiming (Stone) Shi	cc5dab1dc7	chore: fix code style	2023-09-28 21:29:59 +02:00
Zaiming (Stone) Shi	b267fc2588	chore: bump release version to 5.3.0	2023-09-28 21:22:33 +02:00
Zaiming (Stone) Shi	922d5a9a83	fix(ldap): do not allow multi-matches to proceed if ldap query returns more than on match we should reject the auth request instead of picking the first one	2023-09-28 21:20:50 +02:00
Zaiming (Stone) Shi	d858f8af39	test: fix openldap docker runs	2023-09-28 18:40:03 +02:00
Zaiming (Stone) Shi	b28e781c50	fix(ldap-sso): do not log error level when invalid user credentials	2023-09-28 18:37:11 +02:00
Zaiming (Stone) Shi	36f3052be1	Merge pull request #11698 from zmstone/0928-disable-audit-log-by-default fix(audit): disable audit log by default	2023-09-28 17:28:23 +02:00
Zaiming (Stone) Shi	39820be5ff	Merge pull request #11703 from lafirest/fix/ldap_bind fix(ldap): use the search result as bind target	2023-09-28 14:48:53 +02:00
Zaiming (Stone) Shi	1a13b2ac56	Merge remote-tracking branch 'origin/release-53' into 0928-sync-release-53	2023-09-28 13:53:03 +02:00
firest	43ea367df8	fix(ldap): use the search result as bind target	2023-09-28 18:49:00 +08:00
Zaiming (Stone) Shi	98409c9b1e	Merge pull request #11702 from zmstone/0928-minor-chore 0928 minor chore	2023-09-28 12:39:55 +02:00
Zaiming (Stone) Shi	26cadb2248	fix(audit): disable audit log by default	2023-09-28 12:36:14 +02:00
Zaiming (Stone) Shi	b14425d865	fix(sso/saml): ensure lower case http header name	2023-09-28 11:40:21 +02:00
Zaiming (Stone) Shi	7ddcd71412	docs(ssl_dist.conf): update doc link	2023-09-28 11:16:18 +02:00
firest	dca8fdb17f	fix(resource): respect the start_timeout	2023-09-28 16:36:41 +08:00
ieQu1	b77e5e880a	Merge pull request #11697 from ieQu1/dev/gen-rpc-3.1.1 chore(gen_rpc): Bump version to 3.1.1	2023-09-28 10:03:36 +02:00
JianBo He	6d2adfc259	chore(audit): emit the message field	2023-09-28 11:04:42 +08:00
JianBo He	859b122cdd	chore: format codes	2023-09-28 10:25:37 +08:00
JianBo He	b52e4ac99d	chore: update apps/emqx_machine/src/emqx_restricted_shell.erl Co-authored-by: Zaiming (Stone) Shi <zmstone@gmail.com>	2023-09-28 10:25:37 +08:00
JianBo He	bdf24d0ec8	chore: remove the `unauthorized` type for `from` field	2023-09-28 10:25:37 +08:00
JianBo He	71acf121ba	chore(audit): distinguish requests from rest_api or dashboard	2023-09-28 10:25:37 +08:00
JianBo He	dd9938114c	chore(audit): add from field	2023-09-28 10:25:37 +08:00
JianBo He	ece7d5b52a	Merge pull request #11690 from lafirest/fix/ldap_parse_cfg fix(ldap): improve the LDAP `parse_config` function	2023-09-28 10:24:52 +08:00
lafirest	b0d86eecd6	Merge pull request #11691 from lafirest/fix/sso_ssl fix(sso): support for SSL update && ensure update is atomic	2023-09-28 10:22:34 +08:00
firest	57781d0544	fix(ldap): remove the parse_config, it never work	2023-09-28 09:38:16 +08:00
firest	9dee2dc31e	fix(sso): clear last error first before update && fix the `running`	2023-09-28 08:56:16 +08:00
ieQu1	0aa3ccdd65	feat(gen_rpc): Add schema for the TLS versions and cipher suites	2023-09-28 00:36:59 +02:00
Zaiming (Stone) Shi	afdda107af	fix(logger): json format log encode binary list as string array	2023-09-27 23:40:01 +02:00
Zaiming (Stone) Shi	6f7a4344dc	fix: do not gc sso saml SP singing keys	2023-09-27 23:19:39 +02:00
Zaiming (Stone) Shi	34367fc4ec	fix(audit_log): pretty print shell args	2023-09-27 23:19:39 +02:00
Zaiming (Stone) Shi	bb49914fd6	fix(sso): add convet_certs callback for sso backends must convert certs in pre_config_update so the cert path refernces are stored in raw config, otherwise the files might get gc:ed	2023-09-27 22:41:39 +02:00
Zaiming (Stone) Shi	45caa3bf01	fix(sso): make sp_private_key sensitive so it will not be logged	2023-09-27 21:27:59 +02:00
Zaiming (Stone) Shi	c8cbbff044	fix(logger): no need for special handling of empty string when formating json logs, there is no need to handle empty strings special, already covered by unicode handling	2023-09-27 21:26:47 +02:00
ieQu1	3c37f19105	chore(gen_rpc): Bump version to 3.1.1	2023-09-27 21:09:00 +02:00
firest	66d2107007	fix(sso): refactor update logic	2023-09-28 00:09:09 +08:00
Zaiming (Stone) Shi	bd3277c51b	Merge pull request #11683 from zmstone/0925-test-refactor-emqx-rpc-test test: refactor emqx_rpc unit tests	2023-09-27 15:46:27 +02:00
firest	08ad09a68f	fix(sso): refactor backen update logic 1. valid config always can update successfully 2. the `running` endpoint only return successfully created backend 3. enhancement of the `/sso` endpoint, and will check is the resource online	2023-09-27 20:53:10 +08:00
Zaiming (Stone) Shi	ea8d54fd8b	test: ensure atom exists in test module	2023-09-27 12:58:06 +02:00
Zaiming (Stone) Shi	6e8c73258f	test: refactor emqx_rpc unit tests	2023-09-27 12:58:06 +02:00
JimMoen	c9194cd6b2	fix(saml_sso): donot load IDP metadata when disabling saml	2023-09-27 18:46:24 +08:00
JimMoen	af9e87c025	fix: saml callback should check saml state	2023-09-27 18:34:48 +08:00
firest	b2699c687b	fix(sso): support for SSL update && ensure update is atomic 1. support update SSL key and cert files 2. increase connection timeout 3. ensure the update is atomicity, everything will be consistent	2023-09-27 15:48:11 +08:00
Andrew Mayorov	1d0e789e4d	Merge pull request #11679 from keynslug/ft/EMQX-10942/custom-session-timers feat(session): add custom session timers mechanism	2023-09-26 19:09:53 +03:00
firest	0c33df3912	fix(ldap): improve the LDAP `parse_config` function	2023-09-26 23:28:37 +08:00
JimMoen	3fa18d6935	fix: lower sso saml redirect http header	2023-09-26 23:25:59 +08:00
JianBo He	6a9bb7c3ae	Merge pull request #11681 from zhongwencool/audit-log-fix-2 fix: don't need to change audit log's level	2023-09-26 23:12:28 +08:00
lafirest	ac5eb5bc29	Merge pull request #11687 from lafirest/fix/sso_timeout fix(sso): Handle backend update timeout and fix create errors	2023-09-26 22:43:38 +08:00
JianBo He	1a96a5990b	chore: Update apps/emqx_enterprise/src/emqx_enterprise_schema.erl Co-authored-by: Thales Macedo Garitezi <thalesmg@gmail.com>	2023-09-26 21:44:40 +08:00
firest	403714d44e	fix(sso): Handle backend update timeout and fix create errors 1. correctly handle the timeout when call update on a backend 2. fix that config update always returns success 3. do not ignore start failures and ensure start is atomic	2023-09-26 21:43:30 +08:00
Thales Macedo Garitezi	aae59f1efd	Merge pull request #11682 from thalesmg/fix-file-logger-type-r53-20230925 fix(file_logger): change file logger type depending on rotation size	2023-09-26 10:22:36 -03:00
Andrew Mayorov	bce2142df8	test(session): add custom session timers testcase	2023-09-26 16:22:06 +03:00
Zaiming (Stone) Shi	4e15edb5e4	Merge pull request #11661 from zmstone/0922-fix-json-log-formatter 0922 fix json log formatter	2023-09-26 14:13:41 +02:00
Thales Macedo Garitezi	fdcd73e20c	fix(file_logger): change file logger type depending on rotation size Fixes https://emqx.atlassian.net/browse/EMQX-11036 From `logger_disk_log_h:open_disk_log`: ```erlang open_disk_log(Name,File,Type,MaxNoBytes,MaxNoFiles) -> case filelib:ensure_dir(File) of ok -> Size = if Type==halt -> MaxNoBytes; Type==wrap -> {MaxNoBytes,MaxNoFiles} %% <------- end, Opts = [{name, Name}, {file, File}, {size, Size}, {type, Type}, {linkto, self()}, {repair, false}, {format, external}, {notify, true}, {quiet, true}, {mode, read_write}], case disk_log:open(Opts) of ``` Affects all file loggers (audit included): ``` % emqx_config_logger:update_log_handler/1 -> ok iex(emqx@127.0.0.1)14> Config override: log.file.emqx_audit is updated, but failed to add handler: {handler_not_added, {badarg, [{size, {infinity, 10}}, {type, wrap}, {linkto, <0.1952.0>}, {repair, false}, {format, external}, {notify, true}, {quiet, true}, {mode, read_write}]}} ```	2023-09-26 09:04:44 -03:00
Ilya Averyanov	14983ec14a	chore(hooks): validate hookpoints and document hook callbacks Co-authored-by: Thales Macedo Garitezi <thalesmg@gmail.com>	2023-09-26 14:27:42 +03:00
JianBo He	5e6397b843	chore: remove result field for CLI audit logs	2023-09-26 19:24:35 +08:00
JianBo He	a73c3b8e1e	Merge remote-tracking branch 'ce/release-53' into audit-log-fix-2	2023-09-26 19:05:47 +08:00
JianBo He	e9785a6863	Merge pull request #11680 from thalesmg/audit-not-on-ce-r53-20230925 fix(audit): only support audit log on enterprise edition	2023-09-26 18:57:22 +08:00
Zaiming (Stone) Shi	7d810c2107	test: fix test case match pattern	2023-09-26 11:40:30 +02:00
Zaiming (Stone) Shi	d31bfc70fb	Merge pull request #11659 from zhongwencool/fix-listener-ssl-create-500 fix: create ssl listener return 500 crash	2023-09-26 11:38:07 +02:00
lafirest	8cc626d33f	Merge pull request #11686 from lafirest/fix/sso_user_backend fix: fix update SSO user && improve SSO user deletion commnad	2023-09-26 16:04:51 +08:00
firest	56917fee5f	fix(sso): Improved SSO user deletion command	2023-09-26 14:15:41 +08:00
firest	d1af81c86e	fix(sso): fix the failure to update SSO users	2023-09-26 12:14:45 +08:00
firest	8135e27586	fix: redact sensitive data in SSO and LDAP	2023-09-26 11:06:47 +08:00
Thales Macedo Garitezi	17206f8c75	Merge pull request #11662 from thalesmg/port-scan-check-proto-dist-m-20230922 chore: check ekka proto dist module type when resolving node address	2023-09-25 17:01:43 -03:00
Thales Macedo Garitezi	5d212e1086	fix(audit): only support audit log on enterprise edition Fixes https://emqx.atlassian.net/browse/EMQX-11039	2023-09-25 15:59:35 -03:00
Thales Macedo Garitezi	0498e59c45	test: fix flaky test	2023-09-25 13:35:17 -03:00
zhongwencool	95060302fd	fix: don't need to change audit log's level	2023-09-26 00:28:47 +08:00
Thales Macedo Garitezi	ff7f37ccf5	test(cth): allow defining schema to load for app	2023-09-25 13:22:41 -03:00
Andrew Mayorov	b1f144ab8b	feat(session): add custom session timers mechanism That are managed exclusively by the session implementation, unlike common session timers that are managed by the channel itself.	2023-09-25 18:19:26 +03:00
lafirest	1df8326fb8	Merge pull request #11677 from lafirest/fix/sso_cfg adjust the config path for the SSO feature and improve the update logic	2023-09-25 23:00:46 +08:00
Zaiming (Stone) Shi	5e6996dc05	refactor: log formatter format mfa+line as m:f/a(line) also improve json formatter when a field is iolist	2023-09-25 16:55:22 +02:00
Zaiming (Stone) Shi	6a557980e4	refactor(logger): ensure JSON log field order Ensure that the log fileds in JSON format are ordered as time, level, msg, mfal, ...	2023-09-25 16:55:22 +02:00
Zaiming (Stone) Shi	5f45ba50ff	refactor: delete log formatter config for audit log handler It is using 'json' formatter, the template is useless	2023-09-25 16:55:22 +02:00
Zaiming (Stone) Shi	1fed38c248	fix(logger): write 'json' format logs as JSON	2023-09-25 16:55:22 +02:00
Zaiming (Stone) Shi	aea1e80290	feat: add 'format' as alias for log 'formatter'	2023-09-25 16:55:22 +02:00
William Yang	9106eb92d2	Merge pull request #11675 from qzhuyan/fix/william/quic-respect-param-verify	2023-09-25 15:48:01 +02:00
Thales Macedo Garitezi	806017ef90	chore: check ekka proto dist module type when resolving node address Follow up to https://github.com/emqx/emqx/pull/11637#discussion_r1334462917 Fixes https://emqx.atlassian.net/browse/EMQX-10944	2023-09-25 10:31:50 -03:00
firest	cfdb25b213	fix(sso): updates the SSO backend when the `[dashboard]` has updated	2023-09-25 20:30:47 +08:00
Ivan Dyachkov	f1bc3b68b6	Merge pull request #11674 from id/0925-e5.3.0-alpha.2 e5.3.0 alpha.2	2023-09-25 14:21:46 +02:00
JianBo He	6f29bbf997	Merge pull request #11673 from HJianBo/redact_audit_log_from_cli Redact audit log from CLI	2023-09-25 20:03:45 +08:00
Andrew Mayorov	81cf619f07	fix(ftconf): also mark `secret_access_key` key as sensitive	2023-09-25 14:52:57 +03:00
William Yang	36d3a3a524	fix: bump to quicer 0.0.201 do not load cacertfile if verify_none	2023-09-25 13:02:01 +02:00
William Yang	22193d273a	fix(quic): ignore undefined cacertfile	2023-09-25 12:57:55 +02:00
Ivan Dyachkov	8c93c79b44	chore: e5.3.0-alpha.2	2023-09-25 12:52:45 +02:00
JimMoen	7d58f6c61e	Merge pull request #11668 from JimMoen/saml-login-redirect fix: saml login acs redirect to dashboard overview	2023-09-25 18:11:03 +08:00
JianBo He	b970a34ee0	chore: redact some audit logs from CLI	2023-09-25 18:06:39 +08:00
JianBo He	89e15e9134	Merge pull request #11665 from HJianBo/typo-fixes Typo fixes	2023-09-25 17:23:40 +08:00
lafirest	1cd9df6461	Merge pull request #11669 from lafirest/fix/dashboard_cli fix(sso): refactor the `admins` CLI	2023-09-25 16:57:18 +08:00
firest	e63d484632	fix(sso): move the config path of the SSO feature to `dashboard.sso`	2023-09-25 15:23:52 +08:00
Ivan Dyachkov	e1f1c64ecd	Merge branch 'release-53' into 0925-sync-r53-to-master	2023-09-25 08:12:45 +02:00
firest	e94192d1fa	fix(sso): refactor the `admins` CLI 1. revert the opensource version 2. allow delete the SSO user via CLI	2023-09-25 13:53:01 +08:00
firest	4f4868a46c	fix(sso): Disable access to `logout` endpoint by the `API key`	2023-09-25 10:31:38 +08:00
JianBo He	30862a94c6	chore: typo fixes	2023-09-24 20:19:05 +08:00
JimMoen	ad4fadc2fa	fix: saml login acs redirect to dashboard overview	2023-09-23 17:29:02 +08:00
JianBo He	f8d06614c0	chore: fix dialyzer warnings	2023-09-23 07:34:04 +08:00
JimMoen	1dddccb448	fix(saml): cert files cleanup when destroy	2023-09-22 22:49:08 +08:00
JimMoen	80a6c1150d	fix(saml): saml login reply role `viewer` as default	2023-09-22 22:39:02 +08:00
JimMoen	cc3e4e4dc5	fix(saml): drop cert and key content and return path	2023-09-22 22:37:04 +08:00
JimMoen	6349cd3910	fix(saml): sp sign request	2023-09-22 21:57:50 +08:00
JimMoen	2a8f3f9eaa	fix: saml xml metedata format	2023-09-22 21:50:43 +08:00
JimMoen	a318ad486a	refactor: behavior login/2 use all http request	2023-09-22 21:50:43 +08:00
JianBo He	9181ec844f	chore: split out sso_saml_api module	2023-09-22 21:50:43 +08:00
JianBo He	df94426ee3	chore: make static_check happy	2023-09-22 21:50:42 +08:00
JianBo He	ec0894ca0b	chore: update esaml vsn	2023-09-22 21:50:42 +08:00
JianBo He	4a26f63bd6	chore: fix bugs	2023-09-22 21:50:41 +08:00
JianBo He	47badc3181	chore: make dialyzer happy	2023-09-22 21:49:12 +08:00
JianBo He	1c78c6bf6d	chore: fix 500 crashes when backend not existed	2023-09-22 21:49:12 +08:00
JimMoen	b4fb5196cb	fix(sso): SSO management API 500	2023-09-22 21:49:12 +08:00
JimMoen	bba5cc44a8	fix: keep same API path style	2023-09-22 21:49:12 +08:00
JimMoen	8300cd42d4	fix: acl url ignore auth check	2023-09-22 21:49:12 +08:00
JimMoen	44836ef5ee	chore: bump esaml vsn to v1.1.1	2023-09-22 21:49:12 +08:00
JimMoen	13666fa9f9	refactor: avoid dynamic call	2023-09-22 21:49:12 +08:00
JimMoen	c9e0d4fc30	feat: saml integration for dashboard sso	2023-09-22 21:49:10 +08:00
JimMoen	d9466eef63	chore: fix Dashboard RBAC license and rebar.config	2023-09-22 21:19:45 +08:00
Zaiming (Stone) Shi	fd932c9bf7	Merge pull request #11660 from zmstone/0922-fix-audit-eval-command fix(audit): make emqx eval command auditable	2023-09-22 14:02:47 +02:00
Zaiming (Stone) Shi	a34ab19d93	fix(audit): make emqx eval command auditable	2023-09-22 12:05:45 +02:00
zhongwencool	0eed01abee	fix: create ssl listener return 500 crash	2023-09-22 17:34:19 +08:00
lafirest	13b5e4dbc9	Merge pull request #11658 from lafirest/fix/sso_misc Fix/sso misc	2023-09-22 14:44:39 +08:00
firest	7286d15ca6	chore(sso): adjust the schema of the SSO LDAP backend	2023-09-22 13:48:20 +08:00
firest	9e55ae240a	feat(sso): add `role` into the result of login endpoints	2023-09-22 13:48:07 +08:00
firest	681e57dee6	fix(RBAC): allow read-only users to logout	2023-09-22 11:06:24 +08:00
Thales Macedo Garitezi	d6935b6a67	feat: add port scan diagnostics to mria waiting for tables checks Fixes https://emqx.atlassian.net/browse/EMQX-10944 Also updates ekka -> 0.15.15, mria -> 0.6.4 How to test =========== 1. Start 2 or more EMQX nodes and merge them in a cluster. 2. Stop them in order. 3. Start only the first node that was stopped in the previous step. 4. Wait until the log is printed. Or, more easily: 1. Start 2 or more EMQX nodes and merge them in a cluster. 2. Stop all but one. 3. Run `mria_mnesia:diagnosis([]).` on that node. Example output ============== ``` Check check_open_ports should get ok but got #{msg => "some ports are unreachable", results => #{'emqx@172.100.239.4' => #{open_ports => #{4370 => false, 5370 => false}, ports_to_check => [4370,5370], resolved_ips => [{172,100,239, 4}], status => bad_ports}, 'emqx@172.100.239.5' => #{open_ports => #{4370 => false, 5370 => false}, ports_to_check => [4370,5370], resolved_ips => [{172,100,239, 5}], status => bad_ports}}} ``` After one node is back: ``` Check check_open_ports should get ok but got #{msg => "some ports are unreachable", results => #{'emqx@172.100.239.4' => #{ports_to_check => [4370,5370], resolved_ips => [{172,100,239, 4}], status => ok}, 'emqx@172.100.239.5' => #{open_ports => #{4370 => false, 5370 => false}, ports_to_check => [4370,5370], resolved_ips => [{172,100,239, 5}], status => bad_ports}}} ```	2023-09-21 14:29:01 -03:00
Ivan Dyachkov	7cf60c5a91	chore: e5.3.0-alpha.1	2023-09-21 19:29:00 +02:00
Andrew Mayorov	acf4227fc6	test(session): fix quic testgroup in persistent session suite Which broker after quicer 0.0.200 upgrade.	2023-09-21 20:52:04 +04:00
Thales Macedo Garitezi	76f614e9c5	Merge pull request #11653 from thalesmg/fix-dash-rbac-dialyzer-error-m-20230921 chore: fix dialyzer errors on ce version	2023-09-21 13:06:09 -03:00
Thales Macedo Garitezi	85a8c174d9	chore: fix dialyzer errors on ce version ``` apps/emqx_dashboard/src/emqx_dashboard.erl Line 225 Column 17: The pattern {'error', 'unauthorized_role'} can never match the type {'error','not_found' \| 'token_timeout'} \| {'ok',binary()} ```	2023-09-21 11:07:31 -03:00
Andrew Mayorov	b563e30615	Merge pull request #11650 from keynslug/fix/simplify-takeover-suite test(session): make testsuite trigger takeover logic consistently	2023-09-21 18:02:38 +04:00
zhongwencool	beea1be9f0	Merge pull request #11599 from zhongwencool/audit-log	2023-09-21 18:39:23 +08:00
Ivan Dyachkov	0a61d08a0f	Merge pull request #11651 from id/0921-sync-r52-to-master sync r52 to master	2023-09-21 12:31:24 +02:00
William Yang	3a5227198e	Merge pull request #11642 from qzhuyan/dev/william/quicer-0.0.200 quicer 0.0.200	2023-09-21 12:20:14 +02:00
Ivan Dyachkov	dafd7c6085	chore: bump apps versions	2023-09-21 10:58:42 +02:00
zhongwencool	21bb209fb1	feat: added support for auditing API and CLI activity in logs	2023-09-21 16:35:46 +08:00
Ivan Dyachkov	105bebc250	chore: merge release-52 into master	2023-09-21 10:22:47 +02:00
Andrew Mayorov	a8f4b5bf86	test(session): make testsuite trigger takeover logic consistently	2023-09-21 11:53:40 +04:00
firest	9a128517d8	fix(sso): use the correct way to mark the API as authorization-free	2023-09-21 15:52:05 +08:00
zhongwencool	dfc14a39bc	test: add emqx_management to telemetry SUITE	2023-09-21 14:15:06 +08:00
firest	2283db62ec	fix(sso): add a API with authorization-free to list running backends	2023-09-21 11:52:30 +08:00
zhongwencool	123d31fa7d	Merge pull request #11640 from zhongwencool/ensure-destory-resource fix: always return ok when remove local resource	2023-09-21 09:21:45 +08:00
zhongwencool	9521e11d39	Merge pull request #11584 from zhongwencool/telemetry-error-on-windows fix: telemetry report error on windows	2023-09-21 09:08:55 +08:00
JianBo He	b924fb618a	Merge pull request #11639 from lafirest/test/sso test(sso): add test case for the integration of SSO with LDAP	2023-09-21 09:01:13 +08:00
zhongwencool	1b29e4b189	Merge pull request #11641 from zhongwencool/slog-msg-unify	2023-09-21 07:32:39 +08:00
Andrew Mayorov	a2ddd9d5f5	fix(session): respect existing session even if expiry interval = 0 If the original connection had Session-Expiry-Interval > 0, and the new connection set Session-Expiry-Interval = 0, the MQTTv5 spec says that (supposedly) we still have to continue with the existing session (if it hasn't expired yet). Co-Authored-By: Thales Macedo Garitezi <thalesmg@gmail.com>	2023-09-20 22:55:54 +04:00
Andrew Mayorov	3945f08f8f	fix(sessds): try to ensure iterators are closed on destroy	2023-09-20 22:55:54 +04:00
Andrew Mayorov	21e82b9534	test(sessmem): make retry delivery testcase more involved	2023-09-20 22:55:54 +04:00
Andrew Mayorov	69889d14a3	fix(sessds): fix use of undefined types	2023-09-20 22:55:54 +04:00
Andrew Mayorov	c1583f7f9d	fix(ds): refine `topic()` type to describe parsed topics And separate it from `topic_filter()` type, which describes parsed topic filters.	2023-09-20 22:55:52 +04:00
Andrew Mayorov	9362ef6f73	test(sessmem): drop unnecessary nesting in testcase Also get rid of sneaky binding assignment.	2023-09-20 22:55:25 +04:00
Andrew Mayorov	98706cd215	chore: ensure comments follow code style consistently	2023-09-20 22:55:25 +04:00
Andrew Mayorov	8670efbfa0	chore(chan): rename `Name` → `TimerName` for better readability	2023-09-20 22:55:25 +04:00
Andrew Mayorov	7a9916c84d	fix(sessds): convert ds iterator topics upon opening ds session	2023-09-20 22:55:25 +04:00
Andrew Mayorov	045d8b7f10	refactor(ds): reorder functions to improve readability	2023-09-20 22:55:24 +04:00
Andrew Mayorov	540ca6d60f	chore: drop few commented out and irrelevant pieces	2023-09-20 22:55:24 +04:00
Andrew Mayorov	9d145890cc	refactor(sessmem): pass log context as part of session event Co-Authored-By: Thales Macedo Garitezi <thalesmg@gmail.com>	2023-09-20 22:55:24 +04:00
Andrew Mayorov	adc29e15cc	refactor(session): make typespecsa and flow a bit more clear Co-Authored-By: Thales Macedo Garitezi <thalesmg@gmail.com>	2023-09-20 22:55:24 +04:00
Andrew Mayorov	e422f492ef	test(sessds): reuse and expand persistent session test suite	2023-09-20 22:55:24 +04:00
Andrew Mayorov	3383ae19a9	test(session): switch `emqx_persistent_session_SUITE` to cth tooling	2023-09-20 22:55:23 +04:00
Andrew Mayorov	7326ef550b	fix(sessds): make existing parts of persistent session impl work	2023-09-20 22:55:22 +04:00
Andrew Mayorov	e713fc38aa	feat(broker): reflect persisted messages in publish result In order for callers to distinguish between silently dropped and durably persisted message w/o matching subscribers.	2023-09-20 22:53:45 +04:00
Andrew Mayorov	f4953e719b	fix(cmproto): fix few typespecs	2023-09-20 22:53:45 +04:00
Andrew Mayorov	8af107e28d	test(ds): simplify cluster test setups	2023-09-20 22:53:45 +04:00
Andrew Mayorov	7c4f68dd3d	fix(session): make utility function names consistent Before this commit behavior of `is_banned_msg/1` / `should_discard/1` were actually the exact opposite of their names. Co-Authored-By: Thales Macedo Garitezi <thalesmg@gmail.com>	2023-09-20 22:53:44 +04:00
Andrew Mayorov	2dae8020ec	refactor(cm): avoid deep indirection in `emqx_session_mem`	2023-09-20 22:53:44 +04:00
Andrew Mayorov	abeff0bc4f	chore(session): try to describe what happens after session takeover	2023-09-20 22:53:44 +04:00
Andrew Mayorov	45d44df11d	refactor(session): update eviction channel session logic The changes partially reflect `emqx_channel` changes with respect to in-memory session specific logic. The difference is that eviction channel does not replay post-takeover, instead enqueues messages.	2023-09-20 22:53:44 +04:00
Andrew Mayorov	ab1c4c4222	refactor(session): drop `lookup/1` session API Due to the fact it's not used for anything right now.	2023-09-20 22:53:44 +04:00
Andrew Mayorov	97881ff3ca	refactor(session): bring back common session timers	2023-09-20 22:53:43 +04:00
Andrew Mayorov	bf16417513	feat(session): introduce session implementation concept	2023-09-20 22:53:42 +04:00
Andrew Mayorov	780ca15298	chore: bump application versions	2023-09-20 22:52:14 +04:00
Andrew Mayorov	04731b7ef7	test(takeover): randomize messages for random natural ordering	2023-09-20 22:52:14 +04:00
Andrew Mayorov	f022c9b1a4	feat(emqx): add `emqx_inflight:fold/3` generic function	2023-09-20 22:52:14 +04:00
Andrew Mayorov	596ce157fd	refactor(exproto): make timer names equal to messages they send Because keeping timer names different from the messages they send complicates understanding of the control flow, and spends few reductions per timer operation unnecessarily.	2023-09-20 22:52:13 +04:00
Andrew Mayorov	57ae5b14f1	refactor(mqttsn): make timer names equal to messages they send Because keeping timer names different from the messages they send complicates understanding of the control flow, and spends few reductions per timer operation unnecessarily.	2023-09-20 22:52:13 +04:00
Andrew Mayorov	e4866adc2f	refactor(chan): make timer names equal to messages they send Because keeping timer names different from the messages they send complicates understanding of the control flow, and spends few reductions per timer operation unnecessarily.	2023-09-20 22:52:13 +04:00
Andrew Mayorov	cfb1bf1fa4	chore(emqx): drop remnants of former session persistence impl 1. It is not functional anyway. 2. It blocks `emqx_session` refactoring in a few places.	2023-09-20 22:52:13 +04:00
William Yang	e43b87f18e	test(quic): update emqx_broker_SUITE	2023-09-20 20:20:18 +02:00
Thales Macedo Garitezi	2965fa6fcb	Merge pull request #11613 from thalesmg/ds-keyspace-m-20230914 feat(ds): introduce keyspace concept	2023-09-20 14:21:27 -03:00
William Yang	da626f6d29	feat(quic): bump to quicer 0.0.200 and emqtt 1.9.0	2023-09-20 16:43:15 +02:00
zhongwencool	dd687d9582	fix: dialyzer warning	2023-09-20 22:41:26 +08:00
zhongwencool	9e75ff88af	chore: apply suggestions from code review Co-authored-by: Thales Macedo Garitezi <thalesmg@gmail.com>	2023-09-20 22:15:39 +08:00
zhongwencool	f789a7504f	chore: update apps/emqx/src/emqx_quic_connection.erl Co-authored-by: Thales Macedo Garitezi <thalesmg@gmail.com>	2023-09-20 22:00:44 +08:00
Ivan Dyachkov	09aea47f40	chore: 5.2.1	2023-09-20 14:04:28 +02:00
firest	21c37a3f14	fix(sso): adjust the schema of LDAP API && add more logs	2023-09-20 18:15:42 +08:00
zhongwencool	2f1fa2e961	chore: unified slog message formatting to improve logging consistency	2023-09-20 18:13:00 +08:00
zhongwencool	c26a18e949	fix: always return ok when remove local resource	2023-09-20 18:02:42 +08:00
firest	b11c5d26ce	test(sso): add test case for the integration of SSO with LDAP	2023-09-20 16:25:19 +08:00
lafirest	bc6edac45f	Merge pull request #11631 from lafirest/feat/dashboard_ldap feat(dashboard): add SSO feature and integrate with LDAP	2023-09-20 11:40:42 +08:00
firest	61311081d8	fix(sso): fix RBAC test errors && spellcheck	2023-09-20 10:42:17 +08:00
Thales Macedo Garitezi	5ed5ac48ee	refactor: combine shard id and keyspace into a single value	2023-09-19 12:31:32 -03:00
firest	5b00998050	fix(sso): fix invalid_dynamic_call	2023-09-19 22:47:48 +08:00
firest	285e529766	fix(sso): fix sso errors found when manual test	2023-09-19 19:15:52 +08:00
Zaiming (Stone) Shi	65818740f3	Merge pull request #11622 from zmstone/0917-upgrade-gen_rpc-to-3.1.0 chore(gen_rpc): upgrade from 2.8.1 to 3.1.0	2023-09-19 10:22:53 +02:00
Ivan Dyachkov	a69c26b86d	chore: e5.2.1-alpha.3	2023-09-19 08:17:29 +02:00
firest	2cddce5479	feat(dashboard): add SSO feature and integrate with LDAP	2023-09-19 14:10:29 +08:00
JianBo He	de1bc04843	chore: bump ekka to 0.15.14, mria to 0.6.3 Inclued ekka's updates: - https://github.com/emqx/ekka/pull/214 - https://github.com/emqx/ekka/pull/215 - https://github.com/emqx/ekka/pull/216 - https://github.com/emqx/ekka/pull/217 mria's updates: - https://github.com/emqx/mria/pull/160 - https://github.com/emqx/mria/pull/161 - https://github.com/emqx/mria/pull/162	2023-09-19 09:43:19 +08:00
Thales Macedo Garitezi	a511088fd4	refactor: address review comments	2023-09-18 17:47:56 -03:00
Zaiming (Stone) Shi	9f8a7a96af	Merge pull request #11628 from zmstone/0918-upgrade-emqtt-to-1.8.7 0918 upgrade emqtt to 1.8.7	2023-09-18 21:56:04 +02:00
Zaiming (Stone) Shi	de93d71014	test: fix emqx_sahred_sub_SUITE:t_remote prior to this fix, the peer ct node is actually node itself	2023-09-18 21:54:43 +02:00
Zaiming (Stone) Shi	99b60849b4	test: fix flaky test emqx_falpping_SUITE:t_conf_update_timer	2023-09-18 20:44:38 +02:00
SergeTupchiy	0b0e322473	Merge pull request #11627 from SergeTupchiy/EMQX-10962-fix_hstreamdb-bridge-on-stop fix(emqx_bridge_hstreamdb): fix resources cleanup in on_stop/2 cb	2023-09-18 19:57:07 +03:00
Zaiming (Stone) Shi	d1e5b69eac	test: increase wait time	2023-09-18 17:33:09 +02:00
Zaiming (Stone) Shi	4f1ec795eb	test: delete special handling of emqtt race condition the race should have been fixed in emqtt 1.8.7	2023-09-18 17:27:34 +02:00
Zaiming (Stone) Shi	46557c3462	fix(emqtt): upgrade from 1.8.6 to 1.8.7	2023-09-18 17:04:23 +02:00
Serge Tupchii	80cf60e9be	fix(emqx_bridge_hstreamdb): fix resources cleanup in on_stop/2 cb fixes: EMQX-10962	2023-09-18 17:48:05 +03:00
Zaiming (Stone) Shi	45f0d0dfce	Merge pull request #11623 from zmstone/0917-upgrade-esockd-to-5.9.7 0917 upgrade esockd to 5.9.7	2023-09-18 16:30:54 +02:00
zhongwencool	c868264f65	Merge pull request #11617 from zhongwencool/rule-engine-console-args fix: keep builtin_console actions not complain args	2023-09-18 20:40:02 +08:00
zhongwencool	8b6d5d4ca9	test: add test for build_console's args	2023-09-18 16:48:38 +08:00
zhongwencool	5490807b20	chore: update apps/emqx_rule_engine/src/emqx_rule_engine_schema.erl Co-authored-by: Thales Macedo Garitezi <thalesmg@gmail.com>	2023-09-18 16:11:39 +08:00
Zaiming (Stone) Shi	f66d9e76fe	fix(emqx_channel): aovid logging frame errors as exceptions	2023-09-18 09:04:00 +02:00
lafirest	6fe846bf0e	Merge pull request #11610 from lafirest/feat/rbac feat(dashboard): add RBAC feature for Dashboard	2023-09-18 14:41:47 +08:00
firest	ca6547c05b	fix(rbac): change default role and update changes	2023-09-18 11:40:35 +08:00
Zaiming (Stone) Shi	abbee4bc47	fix(esockd): upgrade esockd from 5.9.6 to 5.9.7	2023-09-17 19:44:04 +02:00
Zaiming (Stone) Shi	985f0e6994	chore(gen_rpc): upgrade from 2.8.1 to 3.1.0	2023-09-17 19:10:13 +02:00
Zaiming (Stone) Shi	a9682c2989	Merge pull request #11605 from zmstone/0913-lower-severity-level-for-CMD-override-warnings 0913 lower severity level for cmd override warnings	2023-09-16 11:32:07 +02:00
Zaiming (Stone) Shi	ac41f497b4	feat: add bytesize rule sql function	2023-09-15 16:04:21 +02:00
Thales Macedo Garitezi	2aae3856a3	Merge pull request #11596 from thalesmg/fix-typespec-typos-m-20230912 fix: fix typespec typos	2023-09-15 09:24:42 -03:00
Ilya Averyanov	f0d2b2e6c3	chore: update emqx_eviction_agent version	2023-09-15 13:24:38 +03:00
firest	4b97d3f57d	test(rbac): add test cases for RBAC && update changes	2023-09-15 18:16:28 +08:00
Ilya Averyanov	1959e15703	chore: simplify session eviction for node rebalance	2023-09-15 11:46:51 +02:00
zhongwencool	32d838c85b	fix: format console action crash	2023-09-15 17:40:56 +08:00
zhongwencool	640dd130fa	fix: don't urldecode twice clientid	2023-09-15 17:36:48 +08:00
zhongwencool	d72348c8ed	fix: keep builtin_console actions not complain args	2023-09-15 16:38:04 +08:00
firest	45ccc66474	fix(dashbaord): fix test cases to support RBAC	2023-09-15 15:49:37 +08:00
lafirest	aace9215a4	Merge pull request #11608 from lafirest/feat/ldap_bind feat(ldap): integrate authentication with LDAP bind operation	2023-09-15 14:06:39 +08:00
firest	0846939760	fix(ldap): remove unused code and mark sensitive field	2023-09-15 10:13:07 +08:00
Thales Macedo Garitezi	b30bcf32bd	feat(ds): introduce keyspace concept Fixes https://emqx.atlassian.net/browse/EMQX-10579 This introduces the concept of "keyspaces" to our durable storage (DS) implementation, and also refactors some places where "shard" and "keyspace" would be mixed up. We might want to tune the storage options differently for distinct sets of topics, the keyspaces. The keyspace is composed by one or more shards. - Keyspaces are identified simply by binary strings. - DS configuration is scoped by keyspaces instead of shards. - Starting a new DS shard requires definining to which keyspace the shard belongs.	2023-09-14 16:39:00 -03:00
Ilya Averyanov	11c39c4b6a	chore: simplify session eviction for node rebalance	2023-09-14 18:28:25 +03:00
Thales Macedo Garitezi	6be0e14e8c	fix: fix typespec typos	2023-09-14 10:21:05 -03:00
Thales Macedo Garitezi	e41f7dd68c	Merge pull request #11598 from thalesmg/ds-fix-ps-router-m-20230912 fixes and improvements to persistent session router	2023-09-14 10:00:58 -03:00
firest	5c31c5ce76	feat(dashboard): add RBAC feature for Dashboard	2023-09-14 19:28:37 +08:00
firest	afbf13b8a2	feat(ldap): integrate authentication with LDAP bind operation	2023-09-14 14:10:43 +08:00
firest	3eb46be2ae	fix(banned): fix typos	2023-09-14 14:01:59 +08:00
Zaiming (Stone) Shi	95f1312df7	chore(emqx_ctl): lower command override log from warning to info prior to this change this warning message is always logged if a node joins cluster. the intention of this warning is to detect potential command name clash (provided by different plugins), so arguably it should be at debug level	2023-09-13 20:52:08 +02:00
Thales Macedo Garitezi	803b69d878	refactor: use more consistent return types Co-authored-by: Andrew Mayorov <encube.ul@gmail.com>	2023-09-13 10:49:45 -03:00
Thales Macedo Garitezi	f55f6dc779	docs(ps_session): add notes explaining rationale about operation order and consistency	2023-09-13 10:12:27 -03:00
Thales Macedo Garitezi	e081abb9e6	perf(ps_router): only check if there are any routes when deciding whether to persist message	2023-09-13 10:02:39 -03:00
Thales Macedo Garitezi	cae9ae1fab	fix(ps_router): use `disc_copies` for storing persistent session routes	2023-09-13 10:02:39 -03:00
William Yang	ea73d674b9	chore: bump version to e5.2.1-alpha.2	2023-09-13 14:55:17 +02:00
ieQu1	69d17f981d	Merge pull request #11595 from ieQu1/dev/dont-prevent-overlapping-partitions fix(distribution): Set prevent_overlapping_partitions to false	2023-09-13 14:22:34 +02:00
Serge Tupchii	e1456c1c04	feat(emqx_conf_schema): add node.default_bootstrap_batch_size config parameter	2023-09-13 10:11:14 +03:00
Serge Tupchii	af015bc2bb	chore(ekka): bump version to 0.15.13	2023-09-13 10:11:14 +03:00
ieQu1	b41310af9c	fix: Add prevent_overlappiing_partitions to vm_args Co-authored-by: Thales Macedo Garitezi <thalesmg@gmail.com>	2023-09-12 20:01:56 +02:00
ieQu1	1a86c21e20	fix(distribution): Set prevent_overlapping_partitions to false	2023-09-12 17:41:51 +02:00
William Yang	6ef296268e	chore: bump version to e5.2.1-alpha.1	2023-09-12 15:24:02 +02:00
Thales Macedo Garitezi	59b94788bf	refactor: address review comments	2023-09-11 16:25:34 -03:00
Thales Macedo Garitezi	64fcdb671d	test: fix a bunch of inter-suite interferences	2023-09-11 16:25:34 -03:00
Thales Macedo Garitezi	f1294736b7	feat(ds): add filter for message persistence Fixes https://emqx.atlassian.net/browse/EMQX-10520	2023-09-11 16:25:34 -03:00
Thales Macedo Garitezi	fe4640922d	feat(ds): add delete callback	2023-09-11 16:25:33 -03:00
Thales Macedo Garitezi	7805cc8c9b	fix(session): check if session is persistent	2023-09-11 16:25:33 -03:00
Thales Macedo Garitezi	f490da71cd	chore: prepare v5.2.0-build.1	2023-09-11 16:09:17 -03:00
Thales Macedo Garitezi	d0f1c75651	chore: bump apps vsns	2023-09-11 16:06:53 -03:00
Thales Macedo Garitezi	223d47a6ac	Merge branch 'master' into sync-m-r52-20230911	2023-09-11 16:04:28 -03:00
Thales Macedo Garitezi	063913f245	fix(session): remove recently added `iterators` field from `#session{}` record Fixes https://emqx.atlassian.net/browse/EMQX-10945 This could lead to `badrecord` errors being raised if a takeover were to happen during a rolling cluster upgrade, as the old nodes could receive a record with more fields than expected.	2023-09-11 14:46:12 -03:00
zhongwencool	887a74a6cb	fix: telemetry report error on windows	2023-09-11 16:48:30 +08:00
Zaiming (Stone) Shi	7010ac358c	chore: bump release version to v5.2.0	2023-09-08 16:31:52 +02:00
Andrew Mayorov	3d133801af	fix(router): use `ets:new/2` options compatible with OTP 24 While essentially keeping the same effect.	2023-09-08 18:04:29 +04:00
Thales Macedo Garitezi	e089fda260	Merge pull request #11568 from thalesmg/republish-props-m-20230905 feat(republish): allow templating mqtt properties	2023-09-07 16:43:00 -03:00
Zaiming (Stone) Shi	f3bebb0ba2	Merge remote-tracking branch 'origin/master' into 0907-sync-master-to-release-52	2023-09-07 18:51:30 +02:00
Thales Macedo Garitezi	68293231b8	test: add cases for more complex placeholders	2023-09-07 13:40:03 -03:00
Thales Macedo Garitezi	014bc64d3b	chore: ensure general prop is a binary	2023-09-07 13:40:03 -03:00
Thales Macedo Garitezi	02b8bbf76a	chore: drop templating support for `Subscription-Identifier` This is highly-dependent on the session state, as is `Topic-Alias`.	2023-09-07 13:40:03 -03:00
Thales Macedo Garitezi	47bd19dee4	chore: lower error log messages down to debug	2023-09-07 13:40:03 -03:00
Thales Macedo Garitezi	080cb73da1	fix: handle badmap inside `emqx_placeholder:proc_tmpl`	2023-09-07 13:40:03 -03:00
Zaiming (Stone) Shi	db2ec55aa0	chore: bump release version to official e5.2.0	2023-09-07 09:40:15 +02:00
Zaiming (Stone) Shi	7c2f87fabe	test: merge broker and router boot modules	2023-09-06 21:36:16 +02:00
Thales Macedo Garitezi	bb55b04d46	refactor: inline fn clauses, improve error logging	2023-09-06 13:54:40 -03:00
Thales Macedo Garitezi	c9100c7591	refactor: improve logging information and descriptions Co-authored-by: Zaiming (Stone) Shi <zmstone@gmail.com>	2023-09-06 13:33:59 -03:00
Thales Macedo Garitezi	78c5a779d7	feat(republish): allow templating mqtt properties Fixes https://emqx.atlassian.net/browse/EMQX-10912	2023-09-06 09:54:02 -03:00
Kjell Winblad	7fe704b6dd	Merge pull request #11563 from kjellwinblad/kjell/fix/release-52/EMQX-10775 fix: update gpb library to fix type error	2023-09-06 14:47:23 +02:00
Zaiming (Stone) Shi	18c6bfec97	chore: bump app vsns	2023-09-06 11:12:56 +02:00
Zaiming (Stone) Shi	e794143ae1	Merge remote-tracking branch 'origin/release-52' into 0906-sync-release-52-to-master	2023-09-06 09:08:22 +02:00
Thales Macedo Garitezi	954b73a9aa	Merge pull request #11533 from thalesmg/ds-unsubscribe-m-20230828 feat(ds): close iterators when handling `UNSUBSCRIBE` packets	2023-09-05 09:47:17 -03:00
ieQu1	01a128878f	chore(mria): Bump mria to 0.6.1	2023-09-05 11:08:32 +02:00
Andrew Mayorov	d26995a2aa	Merge pull request #11524 from keynslug/ft/EMQX-10713/unified-route-tab feat(router): add routing storage schema with 2 tables	2023-09-05 12:38:00 +04:00
Kjell Winblad	2b2e84b83c	fix: update gpb library to fix type error This fixes a bug in the protobuf schema registry functionality. Before this fix one would get a badarith error if one tried to assign a float value to an uint64 field. However, this commit fixes this by upgrading gpb so we instead will get a gpb_type_error which is what we want. Fixes: https://emqx.atlassian.net/browse/EMQX-10775	2023-09-05 09:52:17 +02:00
Thales Macedo Garitezi	23d63f5e01	refactor: fork clientid type for `emqx_ds:session_id/0`	2023-09-04 15:38:25 -03:00
Thales Macedo Garitezi	60ae3c15c8	refactor: disregard impossible case	2023-09-04 15:38:25 -03:00
Thales Macedo Garitezi	2cfe5ba057	fix(plugins_api): fix response types and test	2023-09-04 14:37:25 -03:00
Thales Macedo Garitezi	02c3d6a0a7	fix(data_import): rm duplicate import call and fix test	2023-09-04 14:19:59 -03:00
Thales Macedo Garitezi	73d4248334	test(cth_cluster): always allocate listener ports	2023-09-04 11:22:26 -03:00
Andrew Mayorov	9f0f218387	test(router): simplify cluster-related testcase in helper testsuite	2023-09-04 18:05:59 +04:00
Andrew Mayorov	7d26b7bc1a	fix(router): emit clearer error when conflicting schemas in use	2023-09-04 16:37:38 +04:00
Thales Macedo Garitezi	d33ad8a46f	feat: cluster purge (r5.2) Port of https://github.com/emqx/emqx/pull/11447 targeting `release-52` Fixes https://emqx.atlassian.net/browse/EMQX-10763	2023-09-04 09:15:28 -03:00
Andrew Mayorov	893f69617a	chore(test): drop obsolete TODOs	2023-09-04 14:40:49 +04:00
Andrew Mayorov	f0a0c7d4b1	fix(cthsuite): avoid duplicate application env entries Because `application:set_env/1` complains loudly if there are duplicates.	2023-09-04 14:40:49 +04:00
Andrew Mayorov	5024304bf9	fix(router): wait for tables replicate before choosing schema vsn	2023-09-04 14:40:48 +04:00
Ivan Dyachkov	24230a64df	chore: bump app versions	2023-09-04 11:39:21 +02:00
Ivan Dyachkov	b2f57636bd	Merge remote-tracking branch 'upstream/release-51' into 0904-sync-release-51	2023-09-04 11:34:22 +02:00
Kjell Winblad	52546ac50f	Merge pull request #11522 from kjellwinblad/kjell/fix/EMQX-10778 fix: bad error message when rule engine schema name is too long	2023-09-04 11:05:55 +02:00
Ilya Averyanov	240afecd69	Merge pull request #11487 from savonarola/0821-optimize-bcrypt feat: reduce bcrypt rounds to a usable value	2023-09-04 10:12:40 +03:00
zhongwencool	ce571d892e	chore: ping opentelemetry v1.3.0-emqx	2023-09-04 09:34:09 +08:00
Serge Tupchii	ed9afe3345	refactor(emqx_connector): use `hocon_schema:override/2` to make pgsql 'username' field required	2023-09-01 19:56:07 +03:00
Serge Tupchii	607705518b	test(emqx_bridge_cassandra): add connector test case for Cassandra configured without authentication	2023-09-01 19:56:07 +03:00
Serge Tupchii	f0c75d97e1	chore: upgrade emqx_http_lib to 0.5.3 0.5.3 release includes a fix to parse <host>:<port> URLs using the default http scheme.	2023-09-01 19:56:07 +03:00
Serge Tupchii	c3b3460173	fix(emqx_oracle): make username a required field in emqx_oracle_schema	2023-09-01 19:56:07 +03:00
Andrew Mayorov	4ab5f8374b	chore(schema): mark routing storage schema readOnly Co-authored-by: Thales Macedo Garitezi <thalesmg@gmail.com>	2023-09-01 19:58:31 +04:00
Andrew Mayorov	ebf13c90ea	test(router): make sort stable in e2e routing testcase	2023-09-01 19:48:56 +04:00
Ilya Averyanov	90156befb5	feat: improve bcrypt usability * limit salt rounds to usable values * update bcrypt library to enable concurrent bcrypt hash calculation	2023-09-01 17:36:11 +03:00
Serge Tupchii	c54527857a	fix(emqx_bridge_sqlserver): use empty password by default as it is not a required field	2023-09-01 16:57:35 +03:00
Serge Tupchii	1bf86250dd	fix(emqx_bridge_cassandra): allow cassandra bridge without username/password Cassandra can be used without credentials, if it is configured with AllowAllAuthenticator (default).	2023-09-01 16:57:35 +03:00
Andrew Mayorov	545f1c84a6	fix(cth): do not allocate ports for `emqx` app by default This causes tricky and impressively hard to track side effects down the line. Namely, loading `emqx_schema` _after_ `emqx_conf_schema` (as part of cluster node startup sequence) leads to a couple of schema root rewrites, because `emqx_schema` defines similar config roots yet slightly differently (e.g. `authorization`).	2023-09-01 17:23:34 +04:00
Andrew Mayorov	0a879bffd1	test(router): add e2e testcase for cluster-wide routing Which verifies that both router storage schemas work correctly.	2023-09-01 13:49:12 +04:00
Andrew Mayorov	eb0385a28f	chore(router): separate test-only function exports	2023-09-01 13:49:11 +04:00
zhongwencool	3d859453f4	Merge pull request #11554 from lafirest/chore/exhook_prop chore: shutdown reason will never be a UTF8 atom	2023-09-01 16:53:26 +08:00
Kjell Winblad	3bb65e6b05	Merge pull request #11542 from kjellwinblad/kjell/fix/EMQX-10775 fix: update gpb library to fix type error	2023-09-01 10:07:03 +02:00
firest	53940754b7	chore: shutdown reason will never be a UTF8 atom	2023-09-01 14:17:33 +08:00
Paulo Zulato	17fe406605	Merge pull request #11551 from paulozulato/refactor-connector-config-callback refactor: remove BridgeName from connector_config callback	2023-08-31 17:05:49 -03:00
Thales Macedo Garitezi	bf0f77b6dc	Merge pull request #11548 from thalesmg/fix-plugin-order-update-r52-20230830 fix(plugins): update plugin order on whole cluster	2023-08-31 16:18:28 -03:00
Paulo Zulato	7b607c3300	refactor: remove BridgeName from connector_config callback As `bridge_name` is already in the Config parameter, this callback doesn't need to have it on API anymore. Fixes https://github.com/emqx/emqx/pull/11546/files#r1310778734	2023-08-31 11:01:49 -03:00
Zaiming (Stone) Shi	c20ba0572a	chore: bump to 5.2.0-alpha.4	2023-08-31 15:47:39 +02:00
Zaiming (Stone) Shi	876d539336	Merge remote-tracking branch 'andrew/ft/EMQX-10713/unified-route-tab' into 0831-make-use-of-new-routing-table	2023-08-31 15:46:33 +02:00
Andrew Mayorov	fb094e1d47	test(router): avoid testsuite collisions	2023-08-31 13:36:01 +04:00
Paulo Zulato	727fd296ee	Merge pull request #11546 from paulozulato/fix-kafka-producer-unique-name fix(kafka): avoid producer name collision between Kafka and AEH bridges	2023-08-30 18:08:54 -03:00
Thales Macedo Garitezi	4dfbc859f9	fix(plugins): update plugin order on whole cluster Fixes https://emqx.atlassian.net/browse/EMQX-10879	2023-08-30 16:39:52 -03:00
Paulo Zulato	ee77976424	fix(kafka): avoid producer name collision between Kafka and AEH bridges Fixes https://emqx.atlassian.net/browse/EMQX-10860	2023-08-30 14:48:10 -03:00
Andrew Mayorov	2da604dfa4	test(mgmt): simplify flaky `t_verify_imported_mnesia_tab_on_cluster` And also rest of the test setup in the suite.	2023-08-30 20:24:18 +04:00
Andrew Mayorov	b1defa29d7	feat(ruleeng): avoid storing whole rules in topic index Because it doesn't really give any benefit, but wastes memory by duplication.	2023-08-30 20:07:56 +04:00
Andrew Mayorov	6b9cb06334	fix(router): add / refine some comments and log messages Co-authored-by: Zaiming (Stone) Shi <zmstone@gmail.com>	2023-08-30 19:51:31 +04:00
Thales Macedo Garitezi	922ca5e141	feat(ds): close iterators when handling `UNSUBSCRIBE` packets Fixes https://emqx.atlassian.net/browse/EMQX-9742	2023-08-30 11:14:28 -03:00
Thales Macedo Garitezi	9c6dd30f44	feat(session): store iterator ids in session record	2023-08-30 11:13:55 -03:00
Paulo Zulato	dfcede8794	fix: increment matched counter when bridge is unhealthy Fixes https://emqx.atlassian.net/browse/EMQX-10767	2023-08-30 10:52:53 -03:00
Andrew Mayorov	f8923ab419	Merge pull request #11539 from keynslug/ft/cth-desc-workdir feat(cthsuite): add function to determine workdir of testrun	2023-08-30 17:15:55 +04:00
Thales Macedo Garitezi	1cab687153	Merge pull request #11540 from thalesmg/fix-cert-path-utf8-r52-20230829 fix(bridge): validate bridge name before attempting to convert certificates	2023-08-30 09:45:55 -03:00
lafirest	8b3a9072f9	Merge pull request #11532 from lafirest/fix/frame_parse fix(frame): improve some error reasons when parsing invalid packet	2023-08-30 19:10:45 +08:00
Kjell Winblad	d911f7fbea	fix: update gpb library to fix type error This fixes a bug in the protobuf schema registry functionality. Before this fix one would get a badarith error if one tried to assign a float value to an uint64 field. However, this commit fixes this by upgrading gpb so we instead will get a gpb_type_error which is what we want. Fixes: https://emqx.atlassian.net/browse/EMQX-10775	2023-08-30 11:12:33 +02:00
JianBo He	9fe4382d98	Merge pull request #11530 from JimMoen/chore-bump-hstreamdb-driver chore: bump hstreamdb_erl driver to `0.4.5+v0.16.1`	2023-08-30 14:37:17 +08:00
firest	804443ba40	chore: fix typos	2023-08-30 11:22:09 +08:00
JianBo He	06fad14d07	Merge pull request #11536 from zhongwencool/comma_separated_binary chore: ciphers should allow empty space(comma_separated_binary)	2023-08-30 10:20:06 +08:00
Ilya Averyanov	2ef60db147	Merge pull request #11481 from savonarola/0817-simplify-async-responses chore(ft): refactor async reply mechanism	2023-08-30 01:20:09 +03:00
Ilya Averyanov	54ac4a8527	chore(ft): tidy up the code according to the review	2023-08-29 23:21:36 +03:00
Thales Macedo Garitezi	0f297ffef4	fix(bridge): validate bridge name before attempting to convert certificates Fixes https://emqx.atlassian.net/browse/EMQX-10865	2023-08-29 16:32:01 -03:00
Andrew Mayorov	0e770bdc95	test: switch `emqx_broker_SUITE` to use new cth tooling	2023-08-29 22:05:36 +04:00
Andrew Mayorov	3268093881	feat(cth): add module-level documenation	2023-08-29 22:05:36 +04:00
Andrew Mayorov	f57d16ba13	feat(cthsuite): add function to determine workdir of testrun In a deterministic fashion, to lift the burden of undestanding where the testrun's data should go from the test writer.	2023-08-29 21:34:01 +04:00
Andrew Mayorov	063d6200c8	feat(router): enable using 2 tables to store routes Instead of a single unified table, to reap the benefits of cheap `ets:lookup/2` per regular topic subscription route. Change configuration option naming to reflect the change: user now has an ability to choose _storage schema_.	2023-08-29 17:41:59 +04:00
Andrew Mayorov	270fd107b2	feat(triesearch): allow reusing filter tokenization result As a kind of micro-optimization.	2023-08-29 17:31:26 +04:00
zhongwencool	501456efec	chore: more safe with iolist_to_binary Co-authored-by: Zaiming (Stone) Shi <zmstone@gmail.com>	2023-08-29 17:10:43 +08:00
zhongwencool	4e7ba5d35f	chore: ciphers should allow empty space(comma_separated_binary)	2023-08-29 11:34:40 +08:00
firest	6722722522	fix(frame): improve some error reasons when parsing invalid packet	2023-08-29 10:53:20 +08:00
zhongwencool	4245a4d8c6	fix: authz clean-cache clientid always return not_found	2023-08-29 08:17:47 +08:00
Paulo Zulato	cc3ba18734	fix: increment dropped message counter when bridge is unhealthy Fixes https://emqx.atlassian.net/browse/EMQX-10767	2023-08-28 19:47:11 -03:00
Paulo Zulato	2c89be04d1	Merge pull request #11527 from paulozulato/fix-kafka-header-template-handling fix(kafka): fix template processing for header	2023-08-28 18:55:33 -03:00
Paulo Zulato	0b86f04bae	fix(kafka): fix template processing for header Fixes https://emqx.atlassian.net/browse/EMQX-10846	2023-08-28 17:28:05 -03:00
Ilya Averyanov	279895b8fd	chore(ft): add read/write concurrency to emqx_ft_async_reply tabs	2023-08-28 22:46:30 +03:00
SergeTupchiy	c04f770118	Merge pull request #11506 from SergeTupchiy/EMQX-10274-do-not-download-empty-trace-log fix(emqx_trace): don't download empty trace log file	2023-08-28 22:17:00 +03:00
Serge Tupchii	0072749143	fix(emqx_trace): don't download empty trace log file Closes: EMQX-10274	2023-08-28 19:25:55 +03:00
Thales Macedo Garitezi	5908b69353	chore: hide cluster purge from cli and api for now	2023-08-28 10:23:21 -03:00
Thales Macedo Garitezi	f988de4ff4	feat(purge): clear delayed messages	2023-08-28 10:23:21 -03:00
Thales Macedo Garitezi	9bded07834	feat: cluster purge Fixes https://emqx.atlassian.net/browse/EMQX-10763	2023-08-28 10:23:20 -03:00
Thales Macedo Garitezi	dec21ffc95	Merge pull request #11362 from thalesmg/ds-handle-sub-20230725 feat(ds): open iterators when handling `SUBSCRIBE` packets	2023-08-28 10:21:28 -03:00
Andrew Mayorov	2d931a0512	test(evict): do not disable router module in cluster nodes	2023-08-28 14:07:46 +04:00
Andrew Mayorov	8d2ebdea7e	fix(router): generalize config option and make effects visible	2023-08-28 14:07:46 +04:00
Andrew Mayorov	e85789306b	chore(router): drop test-only `has_routes/1` Seems that it's too much support work only for test purposes, where `lookup_routes/1` is nearly as usable.	2023-08-28 14:07:46 +04:00
Andrew Mayorov	5d51687dbf	feat(router): add unified routing table config option	2023-08-28 14:07:45 +04:00
Andrew Mayorov	33e5e1ba57	feat(router): add unified routing table	2023-08-28 14:07:44 +04:00
Andrew Mayorov	166375a000	fix(topicidx): make `get_record/2` simpler to use in concurrent env The mechanic of `emqx_topic_index` cannot really guarantee atomicity of reading records associated with index matches, so instead it's probably better to make the user aware of that lack of this guarantee.	2023-08-28 13:52:59 +04:00
Andrew Mayorov	84e40fb6fe	test(trie): add more involved route add + delete case That shows how current local trie implementation breaks because of lack of refcounting.	2023-08-28 13:52:59 +04:00
Andrew Mayorov	dcb63440bc	refactor(mgmt): avoid dealing with router tab directly Instead, contain all this behind `emqx_router` module interface.	2023-08-28 13:52:59 +04:00
Andrew Mayorov	9eccfa0909	refactor(router): isolate cleanup logic in router module	2023-08-28 13:52:59 +04:00
JimMoen	f3467f44b2	chore: bump hstreamdb_erl driver to `0.4.5+v0.16.1`	2023-08-28 17:28:50 +08:00
Ilya Averyanov	4488e9e591	chore(ft): stop hook chain when doing actual handling	2023-08-28 11:57:44 +03:00
Ilya Averyanov	39a48179ea	chore(emqx_channel): use macros for reply construction	2023-08-28 11:57:44 +03:00
Ilya Averyanov	b8cacd2833	chore(ft): add tests for async reply registry	2023-08-28 11:57:44 +03:00
Andrew Mayorov	b74ff10705	Merge pull request #11517 from keynslug/ft/topic-index-v3 feat(topicidx): iterate on trie search implementation	2023-08-28 12:24:16 +04:00
zhongwencool	053b7fb94a	test: add more test for conf_cli	2023-08-28 11:14:36 +08:00
zhongwencool	d8be248a3d	fix: improve the suggest msg for update conf failed	2023-08-28 08:53:23 +08:00
Ilya Averyanov	b0d4a22aa8	chore(ft): refactor async reply mechanism	2023-08-27 21:54:23 +03:00
zhongwencool	b874926de7	Merge pull request #11514 from zhongwencool/stop-load-application-before-reboot fix: stop otel deps appication before reboot	2023-08-27 20:46:31 +08:00
Paulo Zulato	2bb415f897	Merge pull request #11526 from paulozulato/fix-validator-return-msg fix: flatten error message on resource validator	2023-08-25 17:27:31 -03:00
Thales Macedo Garitezi	33a0048155	refactor: move logic to `ensure_iterator`	2023-08-25 15:24:53 -03:00
Paulo Zulato	84e68f8ed8	Merge pull request #11508 from paulozulato/fix-azure-msg-error-handling fix(kafka): fix result handling when sending message with invalid header	2023-08-25 14:57:09 -03:00
Paulo Zulato	42877e282d	fix: flatten error message on resource validator Fixes https://emqx.atlassian.net/browse/EMQX-10864	2023-08-25 13:53:52 -03:00
Thales Macedo Garitezi	f15f59650d	test: rm obselete workaround code	2023-08-25 13:49:33 -03:00
Paulo Zulato	cb1e105e19	Merge pull request #11516 from paulozulato/fix-kafka-aeh-client-unique-id Fix Kafka/AEH ClientId uniqueness	2023-08-25 10:14:44 -03:00
Andrew Mayorov	d5cff533e3	chore(topicidx): drop TODO comment	2023-08-25 16:44:03 +04:00
Andrew Mayorov	ca59a87d47	chore(topicidx): refine example of wildcard compare	2023-08-25 16:44:03 +04:00
Zaiming (Stone) Shi	558402a68e	chore(topic_index): add topic validation	2023-08-25 16:44:03 +04:00
Andrew Mayorov	33ed53bb6a	refactor(topicidx): simplify `compare/3` further It's possible to emit seek instruction just once, on the way back out of the `compare/3` stack.	2023-08-25 16:34:45 +04:00
Andrew Mayorov	fc37d235c7	refactor(topicidx): simplify seek instructions Which also avoids comparing filter tail repeatedly when evaluating it.	2023-08-25 15:24:06 +04:00
Kjell Winblad	c65db82b07	fix: bad error message when rule engine schema name is too long Fixes: https://emqx.atlassian.net/browse/EMQX-10778	2023-08-25 11:02:38 +02:00
zhongwencool	c8af5a702c	test: remove connection_closed from test	2023-08-25 15:53:35 +08:00
zhongwencool	fc1738188e	fix: packets_connack_sent is not incremented if the ack_flag field in the CONNACK packet is non-zero	2023-08-25 15:18:34 +08:00
lafirest	ba9cb0a1ed	Merge pull request #11512 from lafirest/fix/ldap_def_port fix(ldap): expose request_timeout to prevent infinite hang	2023-08-25 10:22:44 +08:00
zhongwencool	8ab6eb5638	test: start emqx_opentelemetry in emqx_machine SUITE	2023-08-25 10:09:00 +08:00
Andrew Mayorov	cf45e80c71	feat(topicidx): iterate on trie search implementation This improves matching performance and decreases GC pressure on synthetic workloads.	2023-08-25 01:47:11 +04:00
Paulo Zulato	535c7f8b43	fix(kafka): avoid ClientId collision between Kafka and Azure bridges Fixes https://emqx.atlassian.net/browse/EMQX-10860	2023-08-24 18:46:22 -03:00
Thales Macedo Garitezi	d9a5a9ea2b	Merge pull request #11513 from thalesmg/kafka-fix-ts-template-r52-20230824 fix: use correct timestamp template for kafka and remove such fields from azure event hub producer	2023-08-24 16:26:52 -03:00
Thales Macedo Garitezi	016ae0524f	fix(aeh_producer): remove timestamp template field Fixes https://emqx.atlassian.net/browse/EMQX-10847 Checking the whole Kafka message from AEH, it seems like the timestamp type is append, which means that it’s the broker who controls the timestamp, and the timestamp defined by the producer is ignored. Ref: https://kafka.apache.org/documentation/#brokerconfigs_log.message.timestamp.type Example message consumed from AEH: ``` %{ "headers" => %{}, "key" => "", "offset" => 4, "topic" => "test0", "ts" => 1692879703006, "ts_type" => "append", "value" => "{\"username\":\"undefined\",\"topic\":\"t/aeh/produ\",\"timestamp\":1692879692189,\"qos\":0,\"publish_received_at\":1692879692189,\"pub_props\":{\"User-Property\":{}},\"peerhost\":\"undefined\",\"payload\":\"aaaa\",\"node\":\"emqx@127.0.0.1\",\"metadata\":{\"rule_id\":\"rule_aehp\"},\"id\":\"000603AA44B34E08F4AF000006E30003\",\"flags\":{},\"event\":\"message.publish\",\"clientid\":\"undefined\"}" } ``` Note the ts_type above is append. Example message from a Kafka broker whose ts type is create: ``` %{ "headers" => %{}, "key" => "", "offset" => 4, "topic" => "test-topic-three-partitions", "ts" => 1692881883668, "ts_type" => "create", "value" => "{\"username\":\"undefined\",\"topic\":\"t/kafka/produ\",\"timestamp\":1692881883668,\"qos\":0,\"publish_received_at\":1692881883668,\"pub_props\":{\"User-Property\":{}},\"peerhost\":\"undefined\",\"payload\":\"aaaaaa\",\"node\":\"emqx@127.0.0.1\",\"id\":\"000603AAC7529FEEF4AC000007050000\",\"flags\":{},\"event\":\"message.publish\",\"clientid\":\"undefined\"}" } ``` Unfortunately, I couldn’t find anywhere in AEH where that configuration could be changed.	2023-08-24 14:20:42 -03:00
Thales Macedo Garitezi	0381ac0410	fix(kafka_producer): use correct timestamp template field Fixes https://emqx.atlassian.net/browse/EMQX-10847	2023-08-24 14:20:42 -03:00
Kjell Winblad	9fe5080705	build: bump versions before release	2023-08-24 16:46:27 +02:00
zhongwencool	c215fe3736	fix: stop otel deps appication before reboot	2023-08-24 22:14:14 +08:00
Paulo Zulato	60e6217496	fix(kafka): fix result handling when sending message with invalid header Fixes https://emqx.atlassian.net/browse/EMQX-10846	2023-08-24 10:41:42 -03:00
Thales Macedo Garitezi	e5041de9cc	fix(gcp_consumer): handle 401 errors Fixes https://emqx.atlassian.net/browse/EMQX-10852	2023-08-24 09:03:34 -03:00
Zaiming (Stone) Shi	62423b0b12	refactor(topic_index): less special handling for leading $ words	2023-08-24 13:30:10 +02:00
Zaiming (Stone) Shi	a30d87e14f	refactor(topic_index): remove more unnecessary next calls also avoid using records (setelement) for recursive return values	2023-08-24 12:25:04 +02:00
Zaiming (Stone) Shi	a1e6635614	refactor(topic_index): no forced ceiling entry in index table	2023-08-24 12:25:04 +02:00
Zaiming (Stone) Shi	f4c8c6be55	refactor(topic_index): optimize trie-search performance	2023-08-24 12:25:04 +02:00
Zaiming (Stone) Shi	6b152b3cb7	test: add more debug output	2023-08-24 12:25:04 +02:00
Zaiming (Stone) Shi	ae094e363c	chore: fix a typo in log message	2023-08-24 12:25:04 +02:00
firest	6085442958	fix(ldap): expose request_timeout to prevent infinite hang	2023-08-24 16:50:38 +08:00
zhongwencool	2322b27542	Merge pull request #11497 from zhongwencool/prometheus-metrics Prometheus metrics	2023-08-24 12:06:32 +08:00
zhongwencool	8d2be27ade	chore: add changlog for 11466	2023-08-24 06:46:50 +08:00
zhongwencool	84dd3b83bb	fix: hocon converter not working when make_serializable is true(check_plain)	2023-08-24 06:46:47 +08:00
zhongwencool	f72ba6819f	Merge pull request #11498 from zhongwencool/fix-otel-stop-error-log fix: stop otel deps application in terminate crashed	2023-08-24 06:40:24 +08:00
zhongwencool	d287b736ec	chore: add changelog for 11497	2023-08-23 17:02:30 +08:00
zhongwencool	58be7f709b	fix: stop otel deps application in terminate crashed	2023-08-23 16:45:41 +08:00
zhongwencool	6bb15541c7	feat: rename olp metrics to overload_protection metrics	2023-08-23 15:25:54 +08:00
zhongwencool	b9a97923c4	feat: add some authz/connection missing metrics	2023-08-23 14:47:53 +08:00
zhongwencool	141676185d	feat: add authentication metrics to prometheus	2023-08-23 14:15:16 +08:00
zhongwencool	4928c69758	feat: add authorization metrics to prometheus	2023-08-23 14:11:59 +08:00
zhongwencool	df9f8da178	feat: add overload_protection metrics to prometheus	2023-08-23 14:07:37 +08:00
zhongwencool	188a81913e	test: add prometheus api test	2023-08-23 11:23:43 +08:00
zhongwencool	ae10415fc3	feat: disabled the Erlang VM Prometheus exporter by default to improve performance and security	2023-08-23 09:03:22 +08:00
Paulo Zulato	61536b5362	Merge pull request #11494 from paulozulato/fix-kinesis-validators fix(kinesis): set validators for static constraints	2023-08-22 18:28:35 -03:00
Paulo Zulato	20b46091f9	fix(kinesis): set validators for static constraints Fixes https://emqx.atlassian.net/browse/EMQX-10833	2023-08-22 14:42:44 -03:00
Thales Macedo Garitezi	f007b44426	fix(data_import): rm duplicate import call and fix test	2023-08-22 13:29:15 -03:00
Thales Macedo Garitezi	ee2897e5de	test(refactor): move test to integration tests dir	2023-08-22 13:29:15 -03:00
Thales Macedo Garitezi	c1f49abad2	test: fix inter-suite flakiness	2023-08-22 13:29:15 -03:00
Thales Macedo Garitezi	dad27091be	test: rm custom option	2023-08-22 13:29:15 -03:00
Thales Macedo Garitezi	dbfacae283	fix: reinstate transactions	2023-08-22 13:29:15 -03:00
Thales Macedo Garitezi	65085d012b	refactor: rename fn	2023-08-22 13:29:15 -03:00
Thales Macedo Garitezi	3344bfb0bd	refactor: rm `emqx_ds_replay`	2023-08-22 13:29:15 -03:00
Thales Macedo Garitezi	c46b8de938	test: remove unused things, refactor some functions	2023-08-22 13:29:15 -03:00
Thales Macedo Garitezi	e8c73b06e1	docs: add comment about future test failure	2023-08-22 13:29:15 -03:00
Thales Macedo Garitezi	6de0bbe76a	test(refactor): always allocate listeners for emqx app	2023-08-22 13:29:15 -03:00
Thales Macedo Garitezi	a15405a800	test: fix assertions	2023-08-22 13:29:15 -03:00
Thales Macedo Garitezi	c74abe79d0	refactor: reduce arity	2023-08-22 13:29:15 -03:00
Thales Macedo Garitezi	021755b82b	refactor: rm iterators from DS `#session{}` record	2023-08-22 13:29:15 -03:00
Thales Macedo Garitezi	e4e88ebf36	test: add scenario for node stopping midway during subscribe	2023-08-22 13:29:15 -03:00
Thales Macedo Garitezi	3239f5ac5b	feat: rm unnecessary transactions, use separate table for iterator references	2023-08-22 13:29:15 -03:00
Thales Macedo Garitezi	8eab389ae1	perf: avoid unnecessary transaction	2023-08-22 13:29:15 -03:00
Thales Macedo Garitezi	c28c6d1b7e	fix: ensure iterator is opened	2023-08-22 13:29:15 -03:00
Thales Macedo Garitezi	33ddbe80ad	refactor: remove persistence leakeage from emqx_cm level	2023-08-22 13:29:15 -03:00
Thales Macedo Garitezi	e8d7bb9a67	refactor: rename module	2023-08-22 13:29:15 -03:00
Thales Macedo Garitezi	9463e271c0	feat(ds): open iterators when handling `SUBSCRIBE` packets Fixes https://emqx.atlassian.net/browse/EMQX-9741	2023-08-22 13:29:15 -03:00
Thales Macedo Garitezi	ca697a4e14	fix: rename `emqx_ds{,_replay}:replay_id()`	2023-08-22 13:29:15 -03:00
Thales Macedo Garitezi	45e2e687e5	fix(greptimedb_bridge): avoid double-parsing write syntax during probe and remove code duplication Fixes https://emqx.atlassian.net/browse/EMQX-10843	2023-08-22 12:42:48 -03:00
Kjell Winblad	3ffbb7decf	fix: HTTP API /api/v5/publish schema The schema for the /api/v5/publish HTTP API endpoint was incorrect. For 400 (Bad Request) error it cannot return a list but the incorrect schema declared that the response could include a list. Fixes: https://emqx.atlassian.net/browse/EMQX-10837 https://github.com/emqx/emqx/issues/11488	2023-08-22 15:21:20 +02:00
lafirest	7b8a599d17	Merge pull request #11486 from lafirest/fix/ldap_autn_wrong_pw fix(ldap): Return correct reason code when password is wrong	2023-08-22 18:53:17 +08:00
lafirest	f8f39bf223	Merge pull request #11490 from lafirest/fix/absent_pw fix(authn): quickly return when the password is absent in password-based authentication	2023-08-22 18:52:58 +08:00
firest	e20b804e6b	chore: update changes && test cases	2023-08-22 17:41:08 +08:00
firest	184e03387a	fix(ldap): fix status detection and auto reconnecting errors	2023-08-22 17:06:00 +08:00
Kinple	663d03112e	Merge pull request #11476 from Kinplemelon/kinple/for-upgrade-dashboard fix: set the `endpoint` in kinesis bridge as a required field	2023-08-22 14:28:40 +08:00
firest	b0c5b447a4	fix(authn): quickly return when the password is absent in password-based authentication	2023-08-22 11:49:32 +08:00
JimMoen	13ebcd6290	Merge pull request #11478 from JimMoen/hstreamdb-tls-support Hstreamdb tls support	2023-08-22 10:40:54 +08:00
firest	037b0a7599	fix(ldap): Return correct reason code when password is wrong	2023-08-22 09:42:04 +08:00
Paulo Zulato	4e4c93a758	Merge pull request #11469 from paulozulato/feat-redis-auth-username Add support for AUTH with username on Redis	2023-08-21 16:44:21 -03:00
Thales Macedo Garitezi	74d4a8325e	Merge pull request #11470 from thalesmg/gcp-consumer-rm-worker-pool-size-r52-20230817 fix(gcp_consumer): remove unused resource_opts fields	2023-08-21 14:49:59 -03:00
Thales Macedo Garitezi	bd5680db00	Merge pull request #11461 from thalesmg/bridge-dryrun-flex-timeout-r52-20230816 fix(bridge): make dryrun health check timeout more malleable	2023-08-21 14:49:46 -03:00
Ivan Dyachkov	999988cab4	Merge pull request #11401 from kjellwinblad/kjell/fix/mongo_date_format/EMQX-10727 fix: rule SQL mongo_date function should return a string in test mode	2023-08-21 16:20:59 +02:00
Thales Macedo Garitezi	4163f06611	Merge pull request #11480 from thalesmg/rule-funcs-func-clause-r52-20230818 fix(rule_engine): capture function_clause errors	2023-08-21 11:16:25 -03:00
Kinplemelon	443d44aaa3	fix: set the `endpoint` in kinesis bridge as a required field	2023-08-21 11:49:57 +08:00
JimMoen	f45b5fac6f	chore: unhidden hstreamdb bridge for e5.2.0	2023-08-21 10:40:51 +08:00
JimMoen	649647190e	test: new batch mechanism of hstreamdb_erl	2023-08-21 10:40:51 +08:00
JimMoen	5527edf442	chore: bump hstreamdb_erl to `0.4.3+v0.16.1`	2023-08-21 10:40:36 +08:00
Ilya Averyanov	ed67303281	Merge pull request #11382 from savonarola/0801-auth-refactor Auth refactor stage 1	2023-08-21 00:24:15 +03:00
Zaiming (Stone) Shi	01c9095982	Merge pull request #11394 from zmstone/0804-upgrade-wolff-to-1.7.7 chore: upgrade Kafka client wolff to 1.7.7	2023-08-20 10:14:13 +02:00
Paulo Zulato	05fdf52d8e	fix(redis): set bridge as unhealthy on authentication error	2023-08-18 14:51:03 -03:00
Paulo Zulato	fc35c74eab	fix(redis): use eredis_secret to avoid password leaking	2023-08-18 14:51:03 -03:00
Paulo Zulato	2c458b62f5	feat(redis): add support for `username` on AUTH command Fixes https://emqx.atlassian.net/browse/EMQX-9911	2023-08-18 14:50:06 -03:00
Thales Macedo Garitezi	66dec69d09	fix(rule_engine): capture function_clause errors Fixes https://emqx.atlassian.net/browse/EMQX-10798	2023-08-18 13:51:19 -03:00
Thales Macedo Garitezi	befc260555	fix(gcp_consumer): remove unused resource_opts fields Fixes https://emqx.atlassian.net/browse/EMQX-10789	2023-08-17 17:02:02 -03:00
Thales Macedo Garitezi	e48bfb52bb	Merge branch 'release-52' into sync-r52-master-20230817	2023-08-17 17:01:04 -03:00
Paulo Zulato	afffdbbaa1	fix(kinesis): replace default payload template Fixes https://emqx.atlassian.net/browse/EMQX-10766	2023-08-17 17:00:14 -03:00
Ivan Dyachkov	e2b9d905d7	Merge pull request #11465 from id/0718-e5.2.0-alpha.3	2023-08-17 20:59:13 +02:00
Andrew Mayorov	75ed6aa8e7	Merge pull request #11396 from keynslug/ft/EMQX-10712/ruleeng-topic-index-vol-2 perf(ruleeng): employ `emqx_topic_index` to speed up topic matching	2023-08-17 20:43:09 +04:00
Ivan Dyachkov	a0c2fe8cc1	chore: e5.2.0-alpha.3	2023-08-17 17:55:56 +02:00
Thales Macedo Garitezi	ebecbd1545	fix(bridge): make dryrun health check timeout more malleable Fixes https://emqx.atlassian.net/browse/EMQX-10773 - Makes the timeout for probing a bridge more malleable to account for differences between each database. - Increases GCP PubSub Consumer default health check timeout to account for GCP slowness/throttling.	2023-08-17 09:21:19 -03:00
Thales Macedo Garitezi	e3572eb758	Merge pull request #11459 from thalesmg/kafka-health-check-interval-r52-20230816 feat(kafka): add option to configure health check interval	2023-08-17 09:04:30 -03:00
Thales Macedo Garitezi	029b461a13	Merge pull request #11448 from thalesmg/gcp-consumer-403-20230815 fix(gcp_consumer): handle 403 responses	2023-08-17 09:04:00 -03:00
ieQu1	7466024bca	Merge pull request #11458 from ieQu1/fix-excluded-apps-230916 fix(emqx_machine_boot): Fix excluded_apps	2023-08-17 11:36:23 +02:00
Ivan Dyachkov	7469222a17	Merge remote-tracking branch 'upstream/master' into 0817-e5.2.0-code-freeze	2023-08-17 08:16:04 +02:00
lafirest	5e448f5a02	Merge pull request #11446 from lafirest/refactor/calendar refactor(calendar): refactor datetime-related code and remove redundant	2023-08-17 07:40:44 +08:00
Andrew Mayorov	5d79823891	perf(topicidx): preserve next key on the stack to reuse later This should further optimize the number of `ets:next/2` calls required for a single match query.	2023-08-17 01:13:19 +04:00
Paulo Zulato	740680d54b	Merge pull request #11444 from paulozulato/fix-kinesis-msg-access-denied fix(kinesis): return error message on access denied	2023-08-16 18:02:46 -03:00
Thales Macedo Garitezi	f03733ba6b	Merge pull request #11460 from thalesmg/integration-tests-dir-20230816 ci: add `integration_test` dir to `emqx` application	2023-08-16 17:47:14 -03:00
Ilya Averyanov	d17bcc94f6	chore(auth): update emqx_gcp_device tests	2023-08-16 22:37:42 +03:00
Paulo Zulato	a64386ef82	fix(kinesis): return error message on access denied Fixes https://emqx.atlassian.net/browse/EMQX-10764	2023-08-16 16:04:23 -03:00
Ilya Averyanov	3943830eae	chore(auth): remove unnecessary atom conversions	2023-08-16 20:50:35 +03:00
Ilya Averyanov	0dae040047	chore(auth): restore injected schema key position	2023-08-16 20:50:35 +03:00
Ilya Averyanov	db31e5f0d9	chore(auth): tidy up the code	2023-08-16 20:50:35 +03:00
Ilya Averyanov	67e06b3171	chore(auth): make schema injection be more universal	2023-08-16 20:41:05 +03:00
Ilya Averyanov	abcdf18ca4	chore(auth): update ldap authn test	2023-08-16 20:41:05 +03:00
Ilya Averyanov	f00f4568dc	chore(auth): simplify schema injection	2023-08-16 20:41:05 +03:00
Ilya Averyanov	8a3e8ee528	chore(auth): add config propagation tests for authn	2023-08-16 20:41:05 +03:00
Ilya Averyanov	cd88dfbbb8	chore(auth): update authn includes	2023-08-16 20:41:05 +03:00
Ilya Averyanov	ae3355880e	chore(auth): update emqx_authn tests	2023-08-16 20:41:05 +03:00
Ilya Averyanov	128aa19d47	chore(auth): improve emqx_config_handler to replace adhoc config updates	2023-08-16 20:41:05 +03:00
Ilya Averyanov	8213aa42c9	chore(auth): move authn leftovers to the authn app	2023-08-16 18:52:14 +03:00
Ilya Averyanov	ca8c1e3ef8	chore(auth): removed direct usages of authn from emqx core app	2023-08-16 18:52:14 +03:00
Ilya Averyanov	ce2b159022	chore(auth): make pre_hook_authenticate be part of emqx_access_control domain	2023-08-16 18:52:14 +03:00
zhongwencool	e6f0dead9e	Merge pull request #11445 from zhongwencool/remove-os-mon-from-windows fix: remove os_mon application in Windows release	2023-08-16 23:30:24 +08:00
Thales Macedo Garitezi	a6a023eff7	ci: add `integration_test` dir to `emqx` application This gives us a place where to put tests that exercise multiple umbrella application, which is more closely related to `emqx`, but in a way that doesn't affect the standalone app tests.	2023-08-16 11:48:47 -03:00
Thales Macedo Garitezi	ffca581229	feat(kafka): add option to configure health check interval Fixes https://emqx.atlassian.net/browse/EMQX-10781	2023-08-16 11:08:06 -03:00
ieQu1	7b44caeae4	fix(emqx_machine_boot): Fix excluded_apps	2023-08-16 16:04:35 +02:00
Andrew Mayorov	c84ee66d80	Merge pull request #11450 from keynslug/fix/dirty-testsuite-flapping fix(test): switch `emqx_flapping_SUITE` to cth tooling	2023-08-16 17:20:31 +04:00
zhongwencool	e406cd7868	Merge pull request #11456 from zhongwencool/allow-empty-cacertfile-pem fix: allow empty cacertfile pem	2023-08-16 21:10:52 +08:00
zhongwencool	78356d2625	chore: start os_mon in handle_continue/2	2023-08-16 20:54:53 +08:00
Thales Macedo Garitezi	82f27eaf78	Merge pull request #11429 from thalesmg/mongodb-legacy-opt-20230810 feat(mongodb): add configurable option to override legacy protocol usage	2023-08-16 09:54:53 -03:00
zhongwencool	8b23ee86b3	fix: hide cpu_status if os_check is not supported	2023-08-16 20:49:28 +08:00
zhongwencool	b817e03c08	fix: start os_mon application temporary	2023-08-16 20:49:27 +08:00
zhongwencool	848eb7e3c3	fix: remove os_mon application in Windows release	2023-08-16 20:49:27 +08:00
zhongwencool	b733adca06	fix: allow empty cacertfile pem	2023-08-16 20:15:21 +08:00
firest	040d28c35e	fix(cli): fix two typos in the time unit	2023-08-16 18:46:17 +08:00
zhongwencool	1af0407c48	fix: don't crash when debug huge payload	2023-08-16 15:35:09 +08:00
firest	8cd21da94b	chore: update apps version	2023-08-16 10:55:54 +08:00
firest	b08102269a	refactor(calendar): refactor datetime-related code and remove redundant	2023-08-16 10:55:46 +08:00
Thales Macedo Garitezi	4e80d669b0	fix(influxdb_bridge): avoid double-parsing write syntax during probe Fixes https://emqx.atlassian.net/browse/EMQX-10771	2023-08-15 17:05:57 -03:00
Andrew Mayorov	0b21b87296	fix(test): switch `emqx_flapping_SUITE` to cth tooling	2023-08-15 21:29:42 +04:00
Andrew Mayorov	5560e6ed4f	fix(cthsuite): also prevent `emqx` from loading default conf	2023-08-15 21:25:39 +04:00
Thales Macedo Garitezi	5d707c8b7d	Merge pull request #11403 from thalesmg/gcp-produ-attr-20230728 feat(gcp_producer): add support for defining message attributes and ordering key	2023-08-15 13:22:31 -03:00
Thales Macedo Garitezi	ba956ebe88	fix(gcp_consumer): handle 403 responses Fixes https://emqx.atlassian.net/browse/EMQX-10736	2023-08-15 13:20:20 -03:00
Zaiming (Stone) Shi	fa9e9f3348	Merge pull request #11442 from zmstone/0814-sync-release-52-to-master 0814 sync release 52 to master	2023-08-15 16:21:55 +02:00
Andrew Mayorov	e39bbf4c49	chore(topicidx): add more descriptive comments and specs To (hopefully) better illustrate what is happening there.	2023-08-15 16:55:48 +04:00
Thales Macedo Garitezi	23f5cea482	feat: handle strange key values when resolving placeholders	2023-08-14 13:39:38 -03:00
Thales Macedo Garitezi	d93e1bbf08	feat(mongodb): add configurable option to override legacy protocol usage Fixes https://emqx.atlassian.net/browse/EMQX-10750 Fixes https://github.com/emqx/emqx/discussions/11428 See https://github.com/emqx/mongodb-erlang/pull/39	2023-08-14 13:19:50 -03:00
Thales Macedo Garitezi	926eb4e3dd	test: rm unused var warning	2023-08-14 10:33:24 -03:00
Thales Macedo Garitezi	82b8538041	feat(gcp_producer): add support for defining message attributes and ordering key Fixes https://emqx.atlassian.net/browse/EMQX-10652	2023-08-14 10:33:17 -03:00
lafirest	1bda8020f5	Merge pull request #11436 from lafirest/feat/banned_clear feat(banned): add a new API used to clear all banned data	2023-08-14 20:48:43 +08:00
lafirest	6bea894205	Merge pull request #11440 from lafirest/fix/ldap_dep fix(ldap): fix dependency problem	2023-08-14 20:34:58 +08:00
Andrew Mayorov	fe9477f92e	chore: bump applications versions * emqx_rule_engine 5.0.23	2023-08-14 15:36:58 +04:00
Andrew Mayorov	47dfba4341	perf(ruleeng): employ `emqx_topic_index` to speed up topic matching	2023-08-14 15:36:58 +04:00
Andrew Mayorov	9a249e4b01	test(topicidx): increase test coverage	2023-08-14 15:36:58 +04:00
Andrew Mayorov	fd0986071c	perf(topicidx): implement fast-forwarding prefixes This should give less `ets:next/2` calls in general and much less when index has relatively small number of long non-wildcard topics.	2023-08-14 15:36:58 +04:00
Andrew Mayorov	0c7bdbdab4	test(topicidx): add property test Co-Authored-By: JianBo He <heeejianbo@gmail.com>	2023-08-14 15:36:57 +04:00
Andrew Mayorov	48a50c9137	fix(topicidx): fix missing matches when 'a/b' and 'a/b/#' both exist Thanks to @HJianBo for spotting this issue. The approach to fix it is different though: we try to keep the "recurrency branch factor" to a minimum, instead introducing new condition for the case when filter does not match, but iteration with `ets:next/2` is not yet finished for the prefix. Co-Authored-By: JianBo He <heeejianbo@gmail.com>	2023-08-14 15:36:57 +04:00
Andrew Mayorov	6a13406363	fix(topicidx): use custom topic words to keep required ordering Otherwise, topic with empty tokens (e.g. `a/b///c`) would have some of their tokens ordered before `#` / `+`, because empty token was represented as empty atom (`''`).	2023-08-14 15:36:57 +04:00
Andrew Mayorov	28bcb394d1	fix(topicidx): allow to return matches unique by record id	2023-08-14 15:36:57 +04:00
Andrew Mayorov	8feda315f6	feat(index): add topic index facility Somewhat similar to `emqx_trie` in design and logic, yet built on top of a single, potentially pre-existing table.	2023-08-14 15:36:54 +04:00
Zaiming (Stone) Shi	970ff28200	Merge remote-tracking branch 'origin/master' into release-52	2023-08-14 11:50:40 +02:00
firest	0b066fa20c	fix(ldap): fix dependency problem	2023-08-14 16:59:37 +08:00
zhongwencool	41180170f4	fix: update error msg	2023-08-14 15:45:57 +08:00
zhongwencool	e10f9e5e9b	feat: change mqtt.max_packet_size type from string to bytesize	2023-08-14 10:10:46 +08:00
lafirest	b8d3dcf59a	Merge pull request #11424 from lafirest/fix/epoch_maximum_val fix(datetime): make sure the epoch is not larger than the maximum supported value	2023-08-11 20:37:56 +08:00
firest	749c2d075f	chore: update changes && bump app version	2023-08-11 17:57:27 +08:00
firest	bc417a6764	fix(datetime): make sure the epoch is not larger than the maximum supported value	2023-08-11 17:57:21 +08:00
firest	2fc0468e0c	feat(banned): add a new API used to clear all banned data	2023-08-11 17:25:49 +08:00
Ivan Dyachkov	7852af896c	chore: e5.2.0-alpha.1	2023-08-11 11:16:30 +02:00
Ivan Dyachkov	bab05b6613	Merge pull request #11433 from id/0811-ci-upgrade-push-helm-action	2023-08-11 11:03:00 +02:00
Ivan Dyachkov	b6084b0001	chore: bump apps/emqx version	2023-08-11 09:19:51 +02:00
lafirest	4eaced241d	Merge pull request #11423 from lafirest/chore/limiter_utils fix(limiter): simplify the code of the limiter	2023-08-11 15:17:42 +08:00
JimMoen	060074e04a	fix: api total accumulate ignore `undefined` by down nodes result	2023-08-11 11:27:55 +08:00
Thales Macedo Garitezi	65aee8870b	Merge pull request #11427 from id/0810-cut-v5.1.5-build.3 v5.1.5-build.3	2023-08-10 09:52:58 -03:00
Paulo Zulato	9ca9c65af2	Merge pull request #11367 from paulozulato/feat-gcp-devices feat(gcp-iot): port GCP IoT Core compatibility layer from e4.4	2023-08-10 09:44:55 -03:00
Ivan Dyachkov	801c93dd46	chore: v5.1.5-build.3	2023-08-10 12:56:28 +02:00
Ivan Dyachkov	6ead09b28d	chore: merge 'upstream/master'	2023-08-10 12:56:00 +02:00
firest	6dbddfb089	fix(limiter): simplify the code of the limiter move runtime code out from the schema	2023-08-10 18:20:05 +08:00
zhongwencool	aa798e531e	Merge pull request #11409 from zhongwencool/opentelemetry-metrics feat: support opentelemetry metrics	2023-08-10 14:35:25 +08:00
zhongwencool	d1dc37af4c	Merge pull request #11279 from zhongwencool/trace-log fix: don't be kill when send large payload when log is debug	2023-08-10 11:58:31 +08:00
lafirest	b2394cf92d	Merge pull request #11399 from lafirest/fix/ph_utf8 fix(placeholder): porting fix to support utf8 key in placeholder	2023-08-10 09:41:39 +08:00
zhongwencool	5a4dd3a5e5	fix: truncate large payload	2023-08-10 09:35:12 +08:00
zhongwencool	d5fe891961	fix: don't be kill when send large payload when log is debug	2023-08-10 09:22:30 +08:00
Thales Macedo Garitezi	bb8ce68c2e	docs: Generate changelog for v5.1.5-patch.2	2023-08-09 16:38:28 -03:00
Thales Macedo Garitezi	95df958f10	docs: Generate changelog for v5.1.5-patch.1	2023-08-09 13:18:09 -03:00
Thales Macedo Garitezi	cce0d144f9	Merge branch 'master' into release-v515-patch1-20230809	2023-08-09 13:08:43 -03:00
Paulo Zulato	a85c948e23	feat(gcp-iot): port GCP IoT Core compatibility layer from e4.4 Fixes https://emqx.atlassian.net/browse/EMQX-10341	2023-08-09 10:48:25 -03:00
zhongwencool	3933227636	feat: support opentelemetry metrics	2023-08-09 20:23:40 +08:00
lafirest	bef8eddad3	Merge pull request #11405 from lafirest/fix/kal_kialo fix(calendar): make date parse error reason more sense	2023-08-09 14:42:08 +08:00
lafirest	524d33a1fa	Merge pull request #11407 from lafirest/fix/config_name_example fix(ldap): improve configuration name and docs	2023-08-09 14:41:53 +08:00
firest	3e9155fdb1	chore: bump emqx_utils version && changes	2023-08-09 10:54:56 +08:00
firest	7567d211da	fix(placeholder): porting fix to support utf8 key in placeholder	2023-08-09 10:54:41 +08:00
firest	177ec161a1	fix(ldap): improve configuration name and docs	2023-08-09 09:39:57 +08:00
Thales Macedo Garitezi	fdfdb105f0	docs: Generate changelog for v5.1.5	2023-08-08 10:33:34 -03:00
Thales Macedo Garitezi	a1ffd0263d	fix(cacerts): add `cacerts` back as deprecated to allow upgrading from older versions See https://github.com/emqx/emqx/issues/11380	2023-08-08 10:13:13 -03:00
Kjell Winblad	b38461e50a	fix: mongo_date/2 shall give user friendly value in the test environment	2023-08-08 14:47:07 +02:00
Ilya Averyanov	9245162394	chore(rebalance): fix flaky test	2023-08-08 13:06:25 +03:00
firest	9f38f5f26a	fix(calendar): make date parse error reason more sense	2023-08-08 14:28:38 +08:00
Thales Macedo Garitezi	b6decf9592	Merge pull request #11402 from thalesmg/dynamic-kconsu-mqtt-topics-20230807 feat(kafka_consumer): add mqtt topic placeholder support	2023-08-07 15:10:29 -03:00
Thales Macedo Garitezi	29e706c83d	refactor: move catch to dry run fn	2023-08-07 13:08:34 -03:00
Thales Macedo Garitezi	4b8cea4498	fix: make error handling more flexible	2023-08-07 13:08:34 -03:00
Thales Macedo Garitezi	963d63b899	refactor: rename temporary name Co-authored-by: Zaiming (Stone) Shi <zmstone@gmail.com>	2023-08-07 13:08:34 -03:00
Thales Macedo Garitezi	5c8dc092a1	fix(http_bridge): don't attempt to convert headers to atoms Fixes https://emqx.atlassian.net/browse/EMQX-10653	2023-08-07 13:08:34 -03:00
Thales Macedo Garitezi	d5847f33a8	test: attempt to stabilize flaky tests	2023-08-07 13:08:34 -03:00
Thales Macedo Garitezi	9900a32850	feat(kafka_consumer): add mqtt topic placeholder support Fixes https://emqx.atlassian.net/browse/EMQX-10678	2023-08-07 11:42:34 -03:00
Kjell Winblad	3ed031db70	fix: rule SQL mongo_date function should return a string in test mode The rule SQL mongo_date function should return a string with the format ISODate(), where is an ISO date string when running the rule in test mode. Fixes: https://emqx.atlassian.net/browse/EMQX-10727	2023-08-07 16:10:30 +02:00
lafirest	2b03436552	Merge pull request #11392 from lafirest/feat/ldap_authz feat(ldap-authz): integrate the LDAP authorization	2023-08-07 11:12:05 +08:00
zhongwencool	665695a977	Merge pull request #11388 from SergeTupchiy/EMQX-10703-fix-replicant-crash-when-core-terminates-abnormally fix: increase emqx_router_sup restart intensity	2023-08-06 14:40:32 +08:00
Serge Tupchii	2b7798608d	fix(emqx_router_helper): don't cleanup down node on a replicant The cleanup on a replicant node is redundant, as Mria would delegate this delete op to a core node (via RPC), and the core node is expected to receive the same `nodedown` message and process it.	2023-08-04 16:55:36 +03:00
SergeTupchiy	2044326734	Merge pull request #11390 from SergeTupchiy/EMQX-10661-improve-perf-high-latency-cluster-network EMQX-10661 improve performance on high latency cluster network	2023-08-04 16:41:08 +03:00
Zaiming (Stone) Shi	115ab85670	chore: upgrade Kafka client wolff to 1.7.7	2023-08-04 15:31:34 +02:00
firest	b24a9d5343	chore(ldap-authz): update apps version && changes	2023-08-04 18:14:09 +08:00
firest	0571fd8cac	feat(ldap-authz): integrate the LDAP authorization	2023-08-04 18:14:01 +08:00
Serge Tupchii	f276ea9e91	fix: increase emqx_router_sup restart intensity The goal is to tolerate occasional crashes that can happen under relatively normal conditions and don't seem critical to shutdown the whole app (emqx). For example, mria write/delete call delegated from a replicant to a core node may fail, if the core node is being stopped / restarted / not ready. Fixes: EMQX-10703, #11310	2023-08-04 10:49:59 +03:00
firest	7055eafb91	fix(ldap): fix license date and some minor problems	2023-08-04 11:01:13 +08:00
lafirest	1b0b15786c	Merge pull request #11386 from lafirest/feat/ldap_authn feat(authn): integrate the LDAP authentication	2023-08-04 09:37:37 +08:00
Andrew Mayorov	420653e5a2	Merge pull request #11389 from keynslug/perf/EMQX-10706/squash-retained-index perf(retainer): squash index updates into single dirty activity	2023-08-03 21:32:04 +04:00
Serge Tupchii	466fe7e009	perf: add broker_pool_size, generic_pool_size and channel_cleanup_batch_size config options Tuning these options can improve performance if cluster interconnect network latency is high. Fixes: EMQX-10661	2023-08-03 19:44:00 +03:00
Serge Tupchii	ed28c12a66	chore(emqx_conf): deprecate node.tlog_push_mode setting It is not used since mria 0.2.10	2023-08-03 17:46:14 +03:00
Andrew Mayorov	0e0c0d0e1e	chore: bump `emqx_retainer` to 5.0.16	2023-08-03 15:35:21 +04:00
Andrew Mayorov	534a741b0e	perf(retainer): do not GC on replicant nodes	2023-08-03 15:34:24 +04:00
firest	efff585b82	feat(ldap-authn): add test suite for the LDAP authenticator	2023-08-03 18:56:41 +08:00
Andrew Mayorov	42be694d40	perf(retainer): squash index updates into single dirty activity In order to minimize number of round trips to core nodes and between them, improving publishing latency. This shouldn't make consistency worse than it was before.	2023-08-03 12:51:36 +04:00
Andrew Mayorov	39bb9d5136	chore: bump ekka to 0.15.10 Which sports mria 0.6.0 with dirty activities support.	2023-08-03 11:38:53 +04:00
firest	18b3db336a	fix(ldap-authn): remove slat-related configs since they conflict with RFC 3123	2023-08-03 11:00:42 +08:00
Paulo Zulato	2c63fe3bcd	fix(greptimedb): add sync_start to avoid false negative healthy check Fixes https://emqx.atlassian.net/browse/EMQX-10709	2023-08-02 19:40:23 -03:00
Paulo Zulato	97fdc834de	Merge pull request #11381 from paulozulato/fix-oracle-doc-link doc(oracle): add link to online documentation into README	2023-08-02 12:10:59 -03:00
firest	c041216ec0	feat(authn): integrate the LDAP authentication	2023-08-02 19:19:17 +08:00
firest	9bb5c9de33	fix(ldap): make elvis happy	2023-08-02 11:02:02 +08:00
firest	b2f3ac9967	fix(ldap): fix newline error && correcting files header	2023-08-02 10:07:27 +08:00
Paulo Zulato	b8be080ffb	docs(oracle): add link to online documentation into README Fixes https://emqx.atlassian.net/browse/EMQX-10694	2023-08-01 16:20:31 -03:00
firest	f98f97f37e	feat(ldap): set test env and add test suites	2023-08-01 18:49:54 +08:00
firest	8c9b136d15	fix(ldap): integrate parser and fix lexer errors	2023-08-01 18:49:54 +08:00
firest	fa6343cc80	feat(ldap): add LDAP connector	2023-08-01 18:49:54 +08:00
Ivan Dyachkov	0f161a81c3	chore: v5.1.4	2023-08-01 09:20:46 +02:00
Thales Macedo Garitezi	41606aa840	Merge pull request #11373 from thalesmg/fix-spellcheck-master-20230731 fix(spellcheck): fix several spellcheck issues not caught in CI	2023-07-31 18:00:31 -03:00
Thales Macedo Garitezi	620b5fc048	fix(spellcheck): fix several spellcheck issues not caught in CI Fixes some issus later found by CI that somehow didn't block the originating PRs. Example failure: https://github.com/emqx/emqx/actions/runs/5715470851/job/15485284918?pr=11372	2023-07-31 14:32:12 -03:00
Thales Macedo Garitezi	7687770821	fix(tls): remove `cacerts` config for now Fixes https://github.com/emqx/emqx/issues/11370 Related: https://github.com/emqx/emqx/pull/11371	2023-07-31 10:44:05 -03:00
Thales Macedo Garitezi	a3be1529c6	fix(schema): ensure enterprise module is correctly loaded Fixes https://emqx.atlassian.net/browse/EMQX-10654 Despite loading the application in `nodetool`, we need to invoke `:module_info()` to force the module to be actually loaded, especially when it's called in `call_hocon` to generate the initial configurations. Otherwise, it'll fail to list all the bridge schemas.	2023-07-28 16:27:43 -03:00
Thales Macedo Garitezi	d6344ab709	Merge pull request #11363 from thalesmg/rabbit-tls-20230727 feat(rabbitmq_bridge): add TLS support	2023-07-28 13:23:30 -03:00
Thales Macedo Garitezi	2ee1aa6d60	Merge pull request #11347 from thalesmg/fix-ocsp-path-encoding-20230725 fix(ocsp): URL encode request path	2023-07-28 09:01:39 -03:00
Thales Macedo Garitezi	399f849f7b	feat(rabbitmq_bridge): add TLS support Fixes https://emqx.atlassian.net/browse/EMQX-10605	2023-07-27 15:52:46 -03:00
Ivan Dyachkov	d51b5b739b	chore: v5.1.3	2023-07-27 17:00:20 +02:00
Ivan Dyachkov	5ac01c9b85	Merge pull request #11360 from id/0727-sync-release-51-to-master	2023-07-27 16:58:09 +02:00
Thales Macedo Garitezi	ee3d002fca	Merge pull request #11329 from thalesmg/aeh-bridge-20230720 feat: add Azure Event Hub Producer bridge	2023-07-27 11:18:40 -03:00
Ivan Dyachkov	63adeabf72	chore: bump app versions	2023-07-27 15:29:03 +02:00
Ivan Dyachkov	cbfca8c043	chore: merge master into release-51	2023-07-27 15:19:57 +02:00
Thales Macedo Garitezi	5abe4bed88	feat: add Azure Event Hub Producer bridge Fixes https://emqx.atlassian.net/browse/EMQX-10338	2023-07-27 09:22:39 -03:00
Ivan Dyachkov	50a0900d92	chore: e5.1.1	2023-07-27 12:18:03 +02:00
JianBo He	951a96457b	Revert "feat(index): add topic index facility "	2023-07-27 13:42:43 +08:00
JianBo He	5e4855334e	Revert "Fix(topicidx): allow to return matches unique by record id"	2023-07-27 13:39:37 +08:00
firest	abf8d8b391	fix(ds): make dialyzer happy	2023-07-26 16:35:07 +08:00
firest	14b76916df	fix(ds): avoid crashes when starting on Windows	2023-07-26 15:37:58 +08:00
Thales Macedo Garitezi	2ac8ba2add	test: fix flaky test	2023-07-25 17:43:33 -03:00
Thales Macedo Garitezi	d3d52695d5	feat(tls): automatically add `cacerts` to client opts `public_key:cacerts_get/0` was introduced in OTP 25 and allows us to load the system trusted CA certificates. https://www.erlang.org/doc/man/public_key.html#cacerts_get-0	2023-07-25 17:43:33 -03:00
Thales Macedo Garitezi	d0deaca00d	fix(ocsp): URL encode request path Fixes https://emqx.atlassian.net/browse/EMQX-10624	2023-07-25 17:39:38 -03:00
Serge Tupchii	77184c00ff	chore(ekka): Bump version to 0.15.9	2023-07-25 19:29:18 +03:00
Ivan Dyachkov	f9d3d3325b	chore: e5.1.1-rc.1	2023-07-25 16:34:25 +02:00
Ilya Averyanov	2909b1de2d	Merge pull request #11339 from savonarola/0724-fix-subscribe-qos-authz fix(authz): correctly identify qos of subscribe actions	2023-07-25 17:07:57 +03:00
Thales Macedo Garitezi	c7bf3ece34	Merge pull request #11338 from thalesmg/fix-pgsql-error-r51-20230724 fix(postgres_bridge): fix table existence check and handle sync_required	2023-07-25 10:53:03 -03:00
Paulo Zulato	7ee17553d5	Merge pull request #11337 from paulozulato/fix-error-code-topic-wildcard fix(topic_rewrite): handle error when target contains wildcards	2023-07-25 10:37:20 -03:00
Paulo Zulato	8ec14bb07e	fix(topic_rewrite): handle error when target contains wildcards Fixes https://emqx.atlassian.net/browse/EMQX-10565	2023-07-25 09:43:14 -03:00
Ilya Averyanov	deaac9bd73	fix(authz): correctly identify qos of subscribe actions	2023-07-25 15:20:52 +03:00
Thales Macedo Garitezi	7a16ff4f04	fix(postgres_bridge): fix table existence check and handle sync_required Fixes https://emqx.atlassian.net/browse/EMQX-10629 During health checking, we check whether tables in the SQL statement exist. Such check was done by asking the backend to parse the statement using a named prepared statements. Concurrent health checks could then result in the error: ```erlang {error,{error,error,<<"42P05">>,duplicate_prepared_statement,<<"prepared statement \"get_status\" already exists">>,[{file,<<"prepare.c">>},{line,<<"451">>},{routine,<<"StorePreparedStatement">>},{severity,<<"ERROR">>}]}} ``` This could lead to an inconsistent state in the driver process, which would crash later when a message from the backend (`READY_FOR_QUERY`, "idle"): ``` 2023-07-24T13:05:58.892043+00:00 [error] Generic server <0.2134.0> terminating. Reason: {'module could not be loaded',[{undefined,handle_message,[90,<<"I">>,... ``` Added calls to `epgsql:sync/1` for functions that could return `{error, sync_required}`. Also, redundant calls to `parse2` were removed to reduce the number of requests.	2023-07-25 09:15:14 -03:00
zhongwencool	2c193f26e6	Merge pull request #11332 from HJianBo/fix-topic-index-unique-bugs	2023-07-25 19:07:07 +08:00
JianBo He	d05a5cfe0f	fix(rule): fix the `matches/2` for some edge cases	2023-07-25 14:35:18 +08:00
Paulo Zulato	69f4275871	fix(oracle): fix return error checking on table validation Fixes https://emqx.atlassian.net/browse/EMQX-10622	2023-07-24 14:50:38 -03:00
JianBo He	e630331de1	fix(rule): fix a quering problem when 'a/b' and 'a/b/#' exist at the same time. When using `ets:next` to query the next level of topic words, we should prioritize the next level of '#', '+'.	2023-07-24 23:04:53 +08:00
JianBo He	f848c0b87a	Merge pull request #11333 from JimMoen/chore-hide-hstreamdb chore: hidden hstreamdb bridge schema	2023-07-24 21:54:10 +08:00
JianBo He	511d1b6ca1	chore: hide the hstreamdb http api	2023-07-24 20:11:44 +08:00
JianBo He	dcf4819c04	test(rule): add tests to ensure the rules ordering	2023-07-24 19:30:34 +08:00
firest	8439ce0e84	chore: update app version && reboot_lists	2023-07-24 19:08:41 +08:00
Dennis Zhuang	9f200120c2	feat: use http port to detect server availability	2023-07-24 17:58:48 +08:00
Dennis Zhuang	cd9d5f287e	chore: adds auto_reconnect for ecpool	2023-07-24 17:58:48 +08:00
Dennis Zhuang	2ea903c5ac	fix: static checks failures	2023-07-24 17:58:48 +08:00
Dennis Zhuang	b34374c26f	chore: by CR comments	2023-07-24 17:58:48 +08:00
Dennis Zhuang	c9550cc2e5	refactor: rename bridge greptimedb_grpc_v1 to greptimedb	2023-07-24 17:58:48 +08:00
Dennis Zhuang	a1c7eb337b	fix: dependency name	2023-07-24 17:58:48 +08:00
Dennis Zhuang	50c10dd919	chore: update greptimedb-client-erl to v0.1.2	2023-07-24 17:58:48 +08:00
Dennis Zhuang	3b1363dbb7	chore: change license to BCL and adds emqx_bridge_greptimedb_connector_SUITE	2023-07-24 17:58:48 +08:00
Dennis Zhuang	6f7fbcf693	fix: compile error	2023-07-24 17:58:48 +08:00
Dennis Zhuang	4921856950	test: make all emqx_bridge_greptimedb_SUITE tests passing	2023-07-24 17:58:48 +08:00
Dennis Zhuang	c6a7f3e2ad	test: make test passed 21/29	2023-07-24 17:58:48 +08:00
Dennis Zhuang	975795a6e0	feat: add ci test	2023-07-24 17:58:48 +08:00
Dennis Zhuang	89bce99870	test: greptimedb data brige	2023-07-24 17:58:48 +08:00
Dennis Zhuang	91ebd90442	fix: batch write	2023-07-24 17:58:48 +08:00
Dennis Zhuang	6d9944a8e8	feat: update greptimedb dependencies	2023-07-24 17:58:48 +08:00
Dennis Zhuang	417e017498	feat: begin to impl connector	2023-07-24 17:58:48 +08:00
Dennis Zhuang	c5078980f3	feat: adds the greptimedb bridge to emqx modules	2023-07-24 17:58:48 +08:00
Dennis Zhuang	4d581d0b30	feat: init commit	2023-07-24 17:58:48 +08:00
Andrew Mayorov	0496038361	fix(ruleeng): ensure topic index matched rules evalauted once	2023-07-24 17:44:12 +08:00
Andrew Mayorov	6432c9c8fc	fix(topicidx): allow to return matches unique by record id	2023-07-24 17:43:11 +08:00
JimMoen	613dc1646c	chore: hidden hstreamdb bridge schema	2023-07-24 17:22:29 +08:00
firest	af6405fa25	fix(nested_put): fix a data loss bug introduced by #11172	2023-07-24 16:39:37 +08:00
Andrew Mayorov	81793c31fc	Merge pull request #11315 from keynslug/ft/EMQX-9593/peek-mqueue-info refactor(session): allow peeking at mqueue less intrusively	2023-07-24 09:57:05 +02:00
JimMoen	c393c2e091	test: ets table cleanup after cases	2023-07-24 09:33:28 +08:00
JimMoen	4e4b1ac115	refactor: module move to app emqx_rule_engine - Rename to emqx_rule_index.erl - Remove test funcs from src -> test dir	2023-07-24 09:33:28 +08:00
Andrew Mayorov	b821bdee00	perf(ruleeng): employ `emqx_topic_index` to speed up topic matching	2023-07-24 09:27:31 +08:00
Andrew Mayorov	28dad5d7a9	feat(index): add topic index facility Somewhat similar to `emqx_trie` in design and logic, yet built on top of a single, potentially pre-existing table.	2023-07-24 09:27:31 +08:00
Paulo Zulato	31cf05ec66	Merge pull request #11316 from paulozulato/fix-oracle-pool-size fix(oracle): fix Pool Size parameter retrieval	2023-07-21 17:51:21 -03:00
Thales Macedo Garitezi	2531c3e7d1	Merge pull request #11306 from thalesmg/rule-actions-reply-dropped-r51-20230719 fix(rule_metrics): notify rule metrics of late replies and expired requests	2023-07-21 16:51:14 -03:00
Ivan Dyachkov	29432009db	chore: 5.1.1-alpha.4	2023-07-21 18:42:14 +02:00
ieQu1	485e495b98	chore(ekka): Bump version to 0.15.8 (mria 0.5.10)	2023-07-21 18:31:02 +02:00
Paulo Zulato	85ab97970f	fix(oracle): fix Pool Size parameter retrieval Fixes https://emqx.atlassian.net/browse/EMQX-10599	2023-07-21 11:02:27 -03:00
Ivan Dyachkov	c2c3da073f	chore: v5.1.2	2023-07-21 13:26:29 +02:00
Ivan Dyachkov	243b8f5b67	chore: merge 'upstream/master' into v5.1.2	2023-07-21 13:25:46 +02:00
Ivan Dyachkov	3a3b843f4a	fix(machine): add emqx_bridge_kinesis to reboot_lists.eterm	2023-07-21 13:20:50 +02:00
SergeTupchiy	04bd7c7eed	Merge pull request #11322 from SergeTupchiy/EMQX-10590-data-import-fix-missing-config-rel51 EMQX-10590 data import fix missing config relealse 51	2023-07-21 12:36:21 +03:00
Serge Tupchii	ee97cf8e33	fix(emqx_modules): ignore already_existed/not_found errors for added/removed topic metrics	2023-07-21 12:17:47 +03:00
zhongwencool	520ae0e9d3	chore: remove zone desc from document	2023-07-21 15:51:21 +08:00
Serge Tupchii	b37920d2e5	feat: add `topic_metrics` and `slow_subs` configuration to data import/export Fixes: EMQX-10590	2023-07-21 10:41:22 +03:00
Serge Tupchii	a1a7c4fab6	fix(emqx_rule_engine): fix typo in `behaviour` module attribute The type resulted in missing `rule_engine` config after importing data from a backup file. Fixes: EMQX-10590	2023-07-21 10:33:56 +03:00
zhongwencool	d3e4fda21d	fix: hocon_pp quote string for special char	2023-07-21 12:31:22 +08:00
Paulo Zulato	0827a45c89	Merge pull request #11307 from paulozulato/fix-oracle-table-check fix(oracle): discard nested tokens when checking table	2023-07-20 19:19:50 -03:00
Andrew Mayorov	e1e4c64a30	refactor(session): allow peeking at mqueue less intrusively	2023-07-20 21:21:30 +02:00
Thales Macedo Garitezi	54efc04a6f	Merge pull request #11309 from thalesmg/fix-machine-boot-reboot-r51-20230719 fix(machine_boot): use shared list of reboot apps and add bridges to reboot list	2023-07-20 14:33:16 -03:00
Thales Macedo Garitezi	6cd503865b	fix(machine_boot): ensure `emqx_bridge` starts after its companion apps We need to reverse the dependency of `emqx_bridge` and `emqx_bridge_*`, because the former loads and starts bridges during its application startup. If the individual bridge application being loaded has not started with its dependencies, the supervision tree will not be ready for that.	2023-07-20 13:11:44 -03:00
Thales Macedo Garitezi	3b1e436d3f	refactor: use `emqx_pool:async_submit` to avoid excessive spawning	2023-07-20 10:17:43 -03:00
JianBo He	b9f0cd7ba4	chore: pretty the cli output style	2023-07-20 21:01:28 +08:00
Thales Macedo Garitezi	77e2d852e5	fix: add emqx_durable_storage to app list	2023-07-20 09:55:05 -03:00
Andrew Mayorov	f2a32e8ed2	Merge pull request #11304 from keynslug/ft/EMQX-9593/ds-session-connect refactor(session): minimize `emqx_session` interface surface	2023-07-20 14:33:21 +02:00
Thales Macedo Garitezi	89ea40a8b7	refactor: apply review remarks	2023-07-20 09:31:13 -03:00
zhongwencool	3cd223ff5b	chore: add more detail msg for merging failed	2023-07-20 17:48:26 +08:00
SergeTupchiy	8480a26b66	Merge pull request #11065 from SergeTupchiy/EMQX-9992-fix-async-cleanup-error-logs fix: avoid logging unnecessary errors in async cleanup functions	2023-07-20 12:20:57 +03:00
Thales Macedo Garitezi	b9b11d8f4d	fix(machine_boot): use shared list of reboot apps and add bridges to reboot list	2023-07-19 20:15:42 -03:00
Paulo Zulato	e76ba760c9	fix(oracle): discard nested tokens when checking table Fixes https://emqx.atlassian.net/browse/EMQX-10597	2023-07-19 15:03:49 -03:00
Thales Macedo Garitezi	eb41b77de4	fix(rule_metrics): notify rule metrics of late replies and expired requests Fixes https://emqx.atlassian.net/browse/EMQX-10600	2023-07-19 11:39:28 -03:00
Serge Tupchii	ff4119e8b3	chore(emqx_config): fix typo in the log message	2023-07-19 16:58:21 +03:00
Thales Macedo Garitezi	41b780f7f2	Merge pull request #11280 from thalesmg/unhide-gcp-consumer-master-20230717 chore(gcp_pubsub_consumer): unhide GCP PubSub Consumer bridge for e5.2.0	2023-07-19 10:26:42 -03:00
Thales Macedo Garitezi	6003c34ce5	Merge pull request #11283 from thalesmg/flaky-test-20230717 test(http): attempt to stabilize flaky tests	2023-07-19 10:24:07 -03:00
ieQu1	57e39f42c5	Merge pull request #11294 from ieQu1/mria-fixes Mria fixes	2023-07-19 15:10:42 +02:00
Andrew Mayorov	dd31487b4a	refactor(session): drop `is_session/1` helper as useless This is a part of effort to minimize `emqx_session` module interface to simplify adding alternative session implementations.	2023-07-19 14:55:26 +02:00
Andrew Mayorov	0cd2351134	refactor(session): hide `no_local` logic behind enqueue / deliver This is a part of effort to minimize `emqx_session` module interface to simplify adding alternative session implementations.	2023-07-19 14:55:26 +02:00
Ivan Dyachkov	f29a9ed9d5	Merge pull request #11301 from id/0719-sync-release-51-to-master	2023-07-19 14:21:26 +02:00
lafirest	d4550f911c	Merge pull request #11299 from lafirest/hs fix(hstream): handle the `unavailable` error code	2023-07-19 17:47:30 +08:00
Andrew Mayorov	92166f287a	Merge pull request #11293 from keynslug/fix/EMQX-9591/phase-out-persistence chore(ps): phase out existing session persistence mechanism	2023-07-19 10:36:46 +02:00
Ivan Dyachkov	b7f0f7b32d	chore: merge master into release-51	2023-07-19 09:28:05 +02:00
firest	7ac8715358	fix(hstream): handle the `unavailable` error code The "unavailable" error code just means that the HStream is warming up or busy, HStream guarantees that a retry will work well.	2023-07-19 14:43:50 +08:00
zhongwencool	0524c3b3b1	test: configs SUITE crash	2023-07-19 11:05:14 +08:00
JianBo He	439eb4d029	test: cover the node params for `get /configs` endpoint	2023-07-19 11:05:14 +08:00
JianBo He	74532a64e6	chore: update apps/emqx_management/src/emqx_mgmt_api_configs.erl	2023-07-19 11:05:14 +08:00
zhongwencool	402f75592e	chore: move rpc call from emqx_management_proto to emqx_conf_proto	2023-07-19 11:05:14 +08:00
zhongwencool	8a0f7bfd99	chore: update version bpapi.versions	2023-07-19 11:05:14 +08:00
zhongwencool	59ed65787f	fix: get_config return target node's node conf	2023-07-19 11:05:14 +08:00
Paulo Zulato	27630ca215	Merge pull request #11261 from paulozulato/feat-bridge-kinesis Implement Amazon Kinesis Producer bridge	2023-07-18 16:48:34 -03:00
ieQu1	3a5112829c	fix(mgmt_cli): Don't print cluster status on the replicant	2023-07-18 21:45:00 +02:00
ieQu1	ce76d4ab04	chore(ekka): Bump version to 0.15.7 (mria 0.5.9)	2023-07-18 21:45:00 +02:00
ieQu1	103b89f60c	fix(mgmt_cli): Don't crash when mria is not running	2023-07-18 21:45:00 +02:00
ieQu1	293700773f	refactor(mgmt_cli): Call mria directly	2023-07-18 21:45:00 +02:00
Serge Tupchii	2954ff7300	feat: add `topic_metrics` and `slow_subs` configuration to data import/export Fixes: EMQX-10590	2023-07-18 20:53:10 +03:00
Serge Tupchii	c9985758d9	fix(emqx_rule_engine): fix typo in `behaviour` module attribute The type resulted in missing `rule_engine` config after importing data from a backup file. Fixes: EMQX-10590	2023-07-18 20:35:21 +03:00
Ivan Dyachkov	de4cc492d4	chore: e5.1.1-alpha.2	2023-07-18 18:55:24 +02:00
Thales Macedo Garitezi	4ec4041f99	Merge pull request #11281 from thalesmg/restore-queue-shared-sub-r51-20230717 fix(shared_sub): restore support for `$queue/` shared subscription	2023-07-18 13:52:44 -03:00
Ivan Dyachkov	ca51732d8e	Merge pull request #11292 from emqx/update-rocksdb	2023-07-18 16:14:50 +02:00
Thales Macedo Garitezi	cb1e0cdc89	test(http): attempt to stabilize flaky tests	2023-07-18 10:51:04 -03:00
Andrew Mayorov	3ba6d34511	chore(eviction): phase out session persistence concerns	2023-07-18 15:47:12 +02:00
Andrew Mayorov	0a00c39282	chore(ps): phase out existing session persistence mechanism * It's not really working currently in a cluster setup. * It's not really working well. * It would be much easier to integrate `emqx_durable_storage` w/o the need to support existing solution.	2023-07-18 15:46:04 +02:00
Thales Macedo Garitezi	91cd88c136	fix(api_mgmt): use `emqx_topic:join` for correct construction of topics	2023-07-18 10:19:55 -03:00
Thales Macedo Garitezi	4a889c0994	chore: bump ekka -> 0.15.6 https://github.com/emqx/erlang-rocksdb/releases/tag/1.8.0-emqx-1	2023-07-18 09:00:29 -03:00
firest	4f4a813f04	fix(tdengine): update the default template and the changelog	2023-07-18 10:31:18 +00:00
Thales Macedo Garitezi	1fdcfba629	fix(shared_sub): restore support for `$queue/` shared subscription Partially addresses: https://emqx.atlassian.net/browse/EMQX-4589 There's still a problem with the handling of shared groups that is _not particular to the `$queue/` syntax_ and preexistent that the same client cannot subscribe to _different groups_ that have the same _topic filter_.	2023-07-17 16:41:24 -03:00
Paulo Zulato	484519dcf9	feat(kinesis): implement Amazon Kinesis Producer bridge Fixes https://emqx.atlassian.net/browse/EMQX-10474 Fixes https://emqx.atlassian.net/browse/EMQX-10475	2023-07-17 11:51:42 -03:00
Thales Macedo Garitezi	05c3e023a9	chore(gcp_pubsub_consumer): unhide GCP PubSub Consumer bridge for e5.2.0 Fixes https://emqx.atlassian.net/browse/EMQX-10506	2023-07-17 11:24:21 -03:00
Thales Macedo Garitezi	ab5fd1e5c3	Merge pull request #11260 from thalesmg/fix-rule-maps-nested-put-r51 fix(rule_maps): avoid losing data when using `emqx_rule_maps:nested_put`	2023-07-14 15:02:24 -03:00
zhongwencool	0a35b7875f	Merge pull request #11269 from zhongwencool/fix-process-limit-hidden fix: hide node.process_limit completely	2023-07-14 22:32:41 +08:00
lafirest	f6834b33a0	Merge pull request #11266 from lafirest/fix/influxdb-ph fix(tdengine): fix SQL template errors	2023-07-14 22:29:16 +08:00
zhongwencool	f853f3d3bd	Merge pull request #11271 from zhongwencool/fix-precent-check fix: keep percentage type's range is 0%~100%	2023-07-14 22:07:41 +08:00
Thales Macedo Garitezi	f9452241bd	test(rules): add a few more tests to assert our rule evaluation behavior	2023-07-14 10:23:20 -03:00
Serge Tupchii	950d5edc41	fix: avoid logging unnecessary errors in async cleanup functions Cleanup functions that access ETS tables may fail with `badarg` error during EMQX shutdown. They are called asynchronously by `emqx_pool` workers and accessed ETS tables may be already destroyed as their owners are shut down. This fix catches ETS `badarg` errors before they can be caught and logged by `emqx_pool`. Fixes: EMQX-9992	2023-07-14 14:22:43 +03:00
firest	fea73cf17d	fix(log): fix the `pubrel` typo in the log	2023-07-14 17:19:50 +08:00
zhongwencool	11ee6abf02	fix: keep precent range is 0%~100%	2023-07-14 16:48:50 +08:00
zhongwencool	131511b10e	fix: hide process_limit completely	2023-07-14 11:04:20 +08:00
Thales Macedo Garitezi	01b143c5ad	fix(resource): don't destruct error tuple Otherwise, `emqx_resource:query` won't correctly deem the resource to be unhealthy when there's an extra message.	2023-07-13 16:12:33 -03:00
Thales Macedo Garitezi	0dff428efb	Merge pull request #11262 from thalesmg/fix-gcp-consumer-hc-20230712-master fix(gcp_pubsub_consumer): fail health check when there are no workers	2023-07-13 15:09:02 -03:00
Thales Macedo Garitezi	4034bcbb26	fix(rule_runtime): avoid rewriting select clause sources (by @keynslug) Thanks to @keynslug for the insight and the patch. With this, we avoid rewriting the parsed select clause sources, and attempt to reuse the result context when reading values during evaluation.	2023-07-13 14:46:08 -03:00
Thales Macedo Garitezi	924ed06760	Merge pull request #11256 from thalesmg/bridge-api-ecpool-400-errors-20230712-r51 fix(bridge_api): return 400 for all ecpool start errors	2023-07-13 10:05:07 -03:00
firest	749b8cd2ed	test(tdengine): cover multi-table insert && subtable name generation	2023-07-13 07:39:01 +00:00
firest	fef5087c41	fix(tdengine): fix SQL template errors 1. supports multi-table insert 2. supports constructing subtable names by mixed prefixes and placeholders	2023-07-13 04:44:48 +00:00
JimMoen	c23c3a1f78	fix: hstreamdb connector use unified schema	2023-07-13 10:47:45 +08:00
Thales Macedo Garitezi	06010f7ca9	Merge remote-tracking branch 'origin/release-51' into sync-r51-20230712	2023-07-12 16:47:45 -03:00
Thales Macedo Garitezi	be7918aa41	fix(gcp_pubsub_consumer): fail health check when there are no workers `ecpool` already returns an error even if the worker process is dead, but we add the empty worker list clause here just for completeness.	2023-07-12 16:31:21 -03:00
Thales Macedo Garitezi	bbff1d6ae9	fix(bridge_api): return 400 for all ecpool start errors Fixes https://emqx.atlassian.net/browse/EMQX-10460 (https://emqx.atlassian.net/browse/EMQX-10460?focusedCommentId=30126)	2023-07-12 15:32:34 -03:00
Thales Macedo Garitezi	bffef386c1	fix(rule_maps): avoid losing data when using `emqx_rule_maps:nested_put` Fixes https://emqx.atlassian.net/browse/EMQX-10541	2023-07-12 14:28:18 -03:00
Ivan Dyachkov	8ebe099653	Merge pull request #11253 from id/kjell/refactor/http_bridge/EMQX-9568 refactor: HTTP bridge into the emqx_bridge_http application	2023-07-12 15:58:02 +02:00
Ivan Dyachkov	6180e775f4	test: fix mocking and application start	2023-07-12 14:47:52 +02:00
Ivan Dyachkov	8815e58149	chore: remove docker-ct from emqx_bridge_http since toxiproxy is not used in CT	2023-07-12 14:47:46 +02:00
Ivan Dyachkov	45f94df7b1	fix: add ehttpc as emqx_bridge_http dependency	2023-07-12 14:47:39 +02:00
Thales Macedo Garitezi	c94dc2e63f	fix: add emqx_dashboard as a dependency of emqx_machine ``` ===> Compiling emqx_machine ===> Compiling src/user_default.erl failed src/user_default.erl:{24,14}: can't find include lib "emqx_dashboard/include/emqx_dashboard.hrl"; Make sure emqx_dashboard is in your app file's 'applications' list ==> emqx_mix ** (Mix) Could not compile dependency :emqx_machine, "/github/home/.mix/elixir/1-14/rebar3 bare compile --paths /__w/emqx/emqx/_build/emqx/lib//ebin" command failed. Errors may have been logged above. You can recompile this dependency with "mix deps.compile emqx_machine", update it with "mix deps.update emqx_machine" or clean it with "mix deps.clean emqx_machine" make: ** [Makefile:276: emqx-elixir] Error 1 ```	2023-07-12 14:47:28 +02:00
Kjell Winblad	6ce47614d2	refactor: HTTP bridge into the emqx_bridge_http app Fixes: https://emqx.atlassian.net/browse/EMQX-9568	2023-07-12 14:47:02 +02:00
Kjell Winblad	f28510b3ad	refactor: HTTP connector into emqx_bridge_http app	2023-07-12 14:46:43 +02:00
Thales Macedo Garitezi	541d03a0ba	refactor(schema_registry): refactor schema registry app and modules Fixes https://emqx.atlassian.net/browse/EMQX-10361 - Moves `lib-ee/emqx_ee_schema_registry` to `apps/emqx_schema_registry`. - Removes the `_ee_` segment from module names. - Exceptions are the table names which are kept to avoid backwards incompatibilities.	2023-07-12 09:24:15 -03:00
Serge Tupchii	cacfb51280	fix(emqx_machine): add emqx_ee_schema_registry to the reboot apps list As emqx_ee_schema_registry uses Mria tables (schema_registry_shard), a node joining a cluster needs to restart this application in order to restart relevant Mria shard processes.	2023-07-12 09:23:28 -03:00
zhongwencool	5b0695ca19	Merge pull request #11249 from zhongwencool/license-setting-api feat: add license setting get/put api	2023-07-12 18:34:23 +08:00
zhongwencool	f40d8318b7	fix: license validations is not working	2023-07-12 14:40:38 +08:00
SergeTupchiy	fce3060634	Merge pull request #11251 from SergeTupchiy/EMQX-10392-cluster-topology-api Add cluster topology HTTP API endpoint	2023-07-11 17:45:00 +03:00
Serge Tupchii	19de10be7c	feat(emqx_management): add /cluster/topology HTTP API endpoint The endpoint shows Mria RLOG cluster topology info: connections between core and replicant nodes. Closes: EMQX-10392	2023-07-11 16:25:36 +03:00
lafirest	903d81b532	Merge pull request #11250 from lafirest/fix/ws_order fix(ws): fix MQTT packets may be reversed in the WS	2023-07-11 20:09:55 +08:00
firest	211486a946	fix(ws): fix MQTT packets may be reversed in the WS Fix when a WS packet contains many MQTT packets, the order of MQTT packets will be reversed	2023-07-11 18:40:06 +08:00
JianBo He	e51a4ae81e	chore: avoid dialyzer warnings	2023-07-11 10:41:10 +08:00
JianBo He	15c91373fe	perf(http): improve the speed of clients querying in default parameters In https://github.com//emqx/emqx/pull/9749 we fixed the problem of incorrect total calculation. In this PR we added an option to improve the query speed when the query condition is empty	2023-07-11 10:41:10 +08:00
Andrew Mayorov	21fbf79c29	Merge pull request #11191 from keynslug/ft/EMQX-9591/msg-persistence-minimal feat(ds): hardwire emqx_durable_storage message persistence	2023-07-10 21:05:04 +02:00
Thales Macedo Garitezi	beb5be4de2	Merge pull request #11244 from thalesmg/ci-sorted-reboot-apps-check-master ci(machine_boot): add ci check for missing reboot apps	2023-07-10 15:56:10 -03:00
Thales Macedo Garitezi	a53768c1d4	fix(machine_boot): add `emqx_durable_storage` to reboot apps list	2023-07-10 14:39:44 -03:00
SergeTupchiy	721dbad300	Merge pull request #11242 from SergeTupchiy/add-schema_registry-app-to-reboot-list fix(emqx_machine): add emqx_ee_schema_registry to the reboot apps list	2023-07-10 20:17:59 +03:00
Andrew Mayorov	d91ab7dec9	test(ds): make `emqx_persistent_messages_SUITE` setup cleaner Co-authored-by: Thales Macedo Garitezi <thalesmg@gmail.com>	2023-07-10 18:12:16 +02:00
Ivan Dyachkov	fb96c1e20d	chore: bump to e5.1.1-alpha.1	2023-07-10 17:25:07 +02:00
Serge Tupchii	7f04fff2a8	fix(emqx_machine): add emqx_ee_schema_registry to the reboot apps list As emqx_ee_schema_registry uses Mria tables (schema_registry_shard), a node joining a cluster needs to restart this application in order to restart relevant Mria shard processes.	2023-07-10 18:04:22 +03:00
JianBo He	ae59a26659	Merge pull request #11223 from JimMoen/fix-influxdb-float-value-trans fix: influxdb float serialization error	2023-07-10 23:04:01 +08:00
Stefan Strigler	93a9772743	Merge pull request #11211 from sstrigler/EMQX-9963-refactor-all-http-ap-is-to-respond-404-on-the-deletion-of-the-resource-is-non-exist consistently return 404 if resource not found	2023-07-10 16:25:31 +02:00
Ilya Averyanov	58a83739b8	Merge pull request #10986 from savonarola/ft/EMQX-9523/config-api feat(ft-api): provide configuration API	2023-07-10 15:32:30 +03:00
Ilya Averyanov	12e237c36d	Merge pull request #11132 from savonarola/0531-authz-qos-retain feat(authz): use extensible map format for actions in authz rules	2023-07-10 15:32:02 +03:00
JimMoen	e30bc6afa8	test(influxdb): write raw as float for all number value	2023-07-10 20:00:09 +08:00
zhongwencool	f9e54ed8b1	Merge pull request #11237 from zhongwencool/prometheus-api-schema fix: bad prometheus schema for headers	2023-07-10 18:13:42 +08:00
Andrew Mayorov	576eab9717	Merge pull request #11193 from keynslug/fix/emqx-ft-test-flaps fix(ft-test): use new cth tooling in emqx_ft_storage_fs_SUITE	2023-07-10 11:55:16 +02:00
JianBo He	f144bb0571	Merge pull request #11226 from zhongwencool/listener-conf-enabled-to-enable fix: alias listeners.Type.Name.enabled as listeners.Type.Name.enable	2023-07-10 17:15:24 +08:00
zhongwencool	1b5d55cdbb	fix: delete bad link in emqx_prometheus	2023-07-10 16:48:13 +08:00
zhongwencool	0632d629cb	fix: bad prometheus schema for headers	2023-07-10 16:48:13 +08:00
JimMoen	e9f1d7f2bf	fix: influxdb float serialization error	2023-07-10 13:53:11 +08:00
zhongwencool	802a50601a	chore: add comment for init_loader_done	2023-07-10 12:03:36 +08:00
zhongwencool	c4ba558ee3	fix: unset config_loader in emqx's env when stop emqx app	2023-07-10 11:06:08 +08:00
zhongwencool	d661b10355	fix: emqx CI failed	2023-07-10 10:34:36 +08:00
zhongwencool	86d3984025	fix: mgmt api SUITE failed	2023-07-10 10:34:36 +08:00
zhongwencool	c0ee47dc08	chore: add changelog for 11226 pr	2023-07-10 10:34:36 +08:00
zhongwencool	d781346efc	fix: alias listeners.Type.Name.enabled as listeners.Type.Name.enable	2023-07-10 10:34:36 +08:00
Stefan Strigler	1110b5d8f5	fix(emqx_retainer): return 404 in delete if topic not found	2023-07-08 14:43:43 +02:00
Stefan Strigler	80e4ffff75	fix(emqx_management): return 404 if plugin does not exist	2023-07-08 14:43:43 +02:00
Stefan Strigler	3fd28f9e18	fix(emqx_management): return 404 for unknown listener id	2023-07-08 14:43:43 +02:00
Stefan Strigler	d65d690c17	fix(emqx_gateway): return 404 for unknown client id	2023-07-08 14:43:43 +02:00
Stefan Strigler	3bc419ee64	fix(emqx_gateway): return 404 for unknown listener id	2023-07-08 14:10:23 +02:00
Andrew Mayorov	8c883feb54	chore: bump `emqx_durable_storage` to 0.1.1	2023-07-07 21:56:21 +02:00
Andrew Mayorov	030beb3e6a	fix(ds): drop debug printouts in test suite	2023-07-07 21:56:20 +02:00
Andrew Mayorov	daf4e86da1	feat(ds): add `ensure_shard/2` shortcut And use it in `emqx_persistent_session_ds:init()` backend initialization function.	2023-07-07 21:56:20 +02:00
Andrew Mayorov	ac56de9fc5	feat(ds): allow to redefine directory for shard's rocksdb	2023-07-07 21:56:20 +02:00
Ilya Averyanov	19f9fc5089	feat(authz): bump app versions	2023-07-07 19:41:34 +03:00
Ilya Averyanov	77895f2555	feat(authz): fix typos and style for Retain & QoS authz feature Co-authored-by: Thales Macedo Garitezi <thalesmg@gmail.com>	2023-07-07 19:40:34 +03:00
Ilya Averyanov	6db02d6b49	feat(authz): enable feature for both CE and EE	2023-07-07 19:40:34 +03:00
Ilya Averyanov	1ce6a225ae	feat(authz): add tests for authz extended actions	2023-07-07 19:40:34 +03:00
Ilya Averyanov	7de26a1776	feat(authz): use extensible map format for actions in authz rules * support authorization on retain, qos fields * refactored authz tests heavily	2023-07-07 19:40:34 +03:00
Ilya Averyanov	b568bda098	feat(ft-api): simplify config import test	2023-07-07 19:39:05 +03:00
Thales Macedo Garitezi	6337f52cf9	fix(plugins): start/stop plugins when loading config from CLI Fixes https://emqx.atlassian.net/browse/EMQX-10288	2023-07-07 13:37:51 -03:00
Ilya Averyanov	56c81c2c25	feat(ft-api): bump app versions	2023-07-07 19:17:22 +03:00
Ilya Averyanov	e0353ab750	fix(ft-api): update FT API tests to use emqx_cth_suite	2023-07-07 19:15:42 +03:00
Ilya Averyanov	fde506838a	fix(ft-api): implement import config behaviour	2023-07-07 19:15:42 +03:00
Ilya Averyanov	fe691e8330	fix(ft-api): fix swagger schema dump for ft schema	2023-07-07 19:15:42 +03:00
Ilya Averyanov	a2eb658cd9	feat(ft-api): do cleanup certs explicitly	2023-07-07 19:15:42 +03:00
Andrew Mayorov	a2b03716be	feat(ft-api): provide configuration API To configure `emqx_ft` during the runtime.	2023-07-07 19:15:42 +03:00
Andrew Mayorov	34793c5ed0	feat(ft-conf): preprocess TLS configuration on updates Specifically, reify keys and certificates into files in the file system and update the configuration to point to those files.	2023-07-07 19:15:42 +03:00
Andrew Mayorov	27ab9c62d8	fix(ft): unload conf hooks in `prep_stop` In order to avoid situations when the root supervisor is stopped already.	2023-07-07 19:15:42 +03:00
Ilya Averyanov	aba52c6a25	chore(rebalance test): fix API tests	2023-07-07 18:04:32 +03:00
Ilya Averyanov	9bb159cf1e	fix(rebalance): fix changelog and version	2023-07-07 18:04:11 +03:00
zhongwencool	5b1c265485	Merge pull request #11224 from zhongwencool/fix-psk-conf-load fix: psk_authentication is updated failed	2023-07-07 21:27:49 +08:00
Ilya Averyanov	a6019a2846	Merge pull request #11198 from savonarola/0705-fix-rebalance-swagger fix(rebalance): fix rebalance swagger examples	2023-07-07 15:55:16 +03:00
lafirest	70bd7a59e4	Merge pull request #11225 from lafirest/fix/pgsql_function_clause fix(bridge): ensure the username of pgsql must exists	2023-07-07 20:39:07 +08:00
zhongwencool	8b80a2f754	Merge pull request #11192 from zhongwencool/bump-hocon-to-0.39.13 chore: update hocon to 0.39.13	2023-07-07 20:02:46 +08:00
zhongwencool	0ef00d5919	fix: psk_authentication is updated failed	2023-07-07 20:02:06 +08:00
Andrew Mayorov	97b6c43062	fix(ft-test): use new cth tooling in `emqx_ft_storage_fs_SUITE` In attempt to battle test flakiness.	2023-07-07 14:00:33 +02:00
Andrew Mayorov	7e76914599	feat(ds): hardwire emqx_durable_storage message persistence Only message persistence is currently implemented, irrespectively of whether there are persistent sessions around or not.	2023-07-07 13:46:12 +02:00
firest	d01eee7fe4	chore: update changes && app version	2023-07-07 18:22:54 +08:00
firest	8cee75139d	fix(bridge): ensure the username of pgsql must exists	2023-07-07 18:06:28 +08:00
Stefan Strigler	055a1e8d75	Merge pull request #11210 from sstrigler/EMQX-9569-provide-the-ce-ee-version-info-and-the-current-version-number-in-the-info-field feat(emqx_dashboard): include edition and version in swagger.json info	2023-07-07 11:55:44 +02:00
zhongwencool	b5cc8fb3c3	fix: start_after_created's default value	2023-07-07 16:39:26 +08:00
zhongwencool	352d818e3b	chore: update hocon to 0.39.13	2023-07-07 16:39:26 +08:00
JimMoen	88fd8d0582	Merge pull request #11219 from JimMoen/fix-hstreamdb-deps-app chore: hstreamdb_erl as deps for hstreamdb bridge	2023-07-07 16:39:12 +08:00
JianBo He	2f33fd9bac	Merge pull request #11208 from HJianBo/update-lwm2m-stats fix(lwm2m): update the stats correctly and timely	2023-07-07 15:32:50 +08:00
JianBo He	daa6cf14fe	Merge pull request #11206 from HJianBo/coap-bugs Fix(coap): Make the username and password params to optional	2023-07-07 15:32:00 +08:00
zhongwencool	ab07fd0547	Merge pull request #11214 from zhongwencool/fix-cluster-rpc-call-tnx-id fix: bad tnx-id when rejoin cluster	2023-07-07 15:08:06 +08:00
JimMoen	63c6427037	chore: hstreamdb_erl as deps for hstreamdb bridge	2023-07-07 14:50:44 +08:00
JimMoen	30c931ae62	fix: pulsar flaky cluster tests	2023-07-07 12:25:37 +08:00
JimMoen	4ee44972b2	feat: refactor hstreamdb connector to to avoid resources leaking	2023-07-07 12:25:37 +08:00
JimMoen	b089fba100	refactor: rm ee_bridge and ee_connector application	2023-07-07 12:25:37 +08:00
JimMoen	583ccfaafd	test(hstreamdb): create stream and wirte data	2023-07-07 12:25:36 +08:00
JimMoen	1587f038a5	feat: hstreamdb bridge with batch query	2023-07-07 12:25:36 +08:00
JimMoen	b9bfdfd583	chore: compatibility with hstreamdb v0.15.0	2023-07-07 12:25:36 +08:00
JimMoen	d31a305bcb	refactor(hstreamdb): HStreamDB bridge to its own application	2023-07-07 12:25:36 +08:00
zhongwencool	f7513b900a	fix: set load config done after update tnx_id	2023-07-07 12:25:34 +08:00
zhongwencool	9f57ba510e	chore: add 11214 changelog	2023-07-07 12:25:34 +08:00
zhongwencool	221f6eba06	fix: bad tnx-id when rejoin cluster	2023-07-07 12:25:34 +08:00
JianBo He	d3d2c8a532	chore(lwm2m): bump version	2023-07-07 12:24:31 +08:00
JianBo He	31a240ba63	fix(lwm2m): update the stats correctly and timely	2023-07-07 12:24:31 +08:00
JianBo He	791b8ef671	chore: bump versions	2023-07-07 12:23:57 +08:00
JianBo He	6d2222318d	chore(coap): update the subscriptions_cnt stats in time	2023-07-07 12:23:57 +08:00
JianBo He	800b154582	test(coap): cover the params optional logic to create connection	2023-07-07 12:23:57 +08:00
JianBo He	5c901a52bd	fix(coap): make username/password optinal in connection	2023-07-07 12:23:57 +08:00
JianBo He	ab809c8b85	Merge pull request #11207 from lafirest/feat/keep_obfuscated feat: ensure data backends don't leak sensitive data	2023-07-07 12:22:11 +08:00
JianBo He	b11fa5f3bf	Merge pull request #11195 from HJianBo/stomp-topic-id-unique Fix(stomp): avoid to create duplicated subscription by HTTP or Client	2023-07-07 11:18:30 +08:00
firest	a1d2b2ca51	chore: bump app versions	2023-07-07 11:17:54 +08:00
firest	18dec53d8b	feat: ensure data backends don't leak sensitive data	2023-07-07 11:04:13 +08:00
JianBo He	05048dbf93	Merge pull request #11204 from HJianBo/avoid-case-clause Allow the `/` or multiple `Accept` values in header for the `/configs` API	2023-07-07 09:46:28 +08:00
Stefan Strigler	8faaa86c07	chore: bump vsn for emqx and emqx_bridge	2023-07-06 14:26:11 +02:00
Stefan Strigler	22b25fbbb3	feat(emqx_dashboard): include edition and version in swagger.json info	2023-07-06 14:14:21 +02:00
Thales Macedo Garitezi	353cc065db	Merge pull request #11175 from thalesmg/fix-mysql-start-error fix(mysql_bridge): make nxdomain a 400 API error	2023-07-06 08:26:12 -03:00
Stefan Strigler	9bcabe0a9e	Merge pull request #11184 from sstrigler/EMQX-10270-e-5-1-0-missing-value-range-validation-for-the-max-packet-size-of-mqtt-settings fix: limit mqtt max_packet_size to 256MB	2023-07-06 10:20:24 +02:00
JianBo He	71d1f80530	test(api): cover the accept logic for `/configs` API	2023-07-06 11:30:38 +08:00
JianBo He	966b2affc2	chore: allow handle / or multiple values in Accept headers	2023-07-06 10:53:07 +08:00
SergeTupchiy	1a79e34510	Merge pull request #11202 from SergeTupchiy/fix-rule-type-acl-conf chore(emqx_authz): fix `rule()` type example	2023-07-05 21:02:36 +03:00
Serge Tupchii	4dfd3421e7	chore(emqx_authz): fix `rule()` type example Use `action()` type which is a correct and defined type.	2023-07-05 20:24:26 +03:00
Ilya Averyanov	9af0030538	chore: bump to v5.1.1	2023-07-05 18:43:45 +03:00
Ilya Averyanov	f174cb656c	fix(rebalance): fix swagger examples in api-doc	2023-07-05 15:38:41 +03:00
Ilya Averyanov	dca6fe6200	fix(rebalance): fix global status evaluation on replicant nodes	2023-07-05 12:48:44 +03:00
JianBo He	aaf015c06f	test(stomp): cover subscription in use	2023-07-05 15:22:44 +08:00
lafirest	bf5167a8bf	Merge pull request #11172 from lafirest/fix/dup_payload fix(ruleengine): fix duplicate `payload` problems	2023-07-05 14:20:26 +08:00
JianBo He	0483c6afef	fix(stomp): not allow to create same subscriptions	2023-07-05 14:13:25 +08:00
Stefan Strigler	263890be47	fix: limit mqtt max_packet_size to 256MB	2023-07-04 16:03:11 +02:00
Andrew Mayorov	8cc7022760	Merge pull request #11120 from ft/EMQX-10329/tooling test: add tooling to make testruns more isolated and predictable	2023-07-04 14:36:39 +02:00
Ilya Averyanov	0bd0a16693	Merge pull request #11039 from savonarola/0613-fix-redis-db-schema fix(redis): validate database number	2023-07-04 15:32:02 +03:00
zhongwencool	f2c5f4932c	Merge pull request #11148 from lafirest/fix/mcall_error_report fix(emqx_conf): don't sync the MFA to a leaved node	2023-07-04 19:56:52 +08:00
Andrew Mayorov	9ed75085b7	chore: drop dead commented out code	2023-07-04 13:20:04 +02:00
Andrew Mayorov	c7ba300efc	fix(cthsuite): use correct type for "smth serializable as HOCON"	2023-07-04 13:20:04 +02:00
Andrew Mayorov	d568d43fe4	test(bridge): switch `emqx_bridge_api_SUITE` to use new tooling	2023-07-04 13:20:03 +02:00
Andrew Mayorov	fc709a14cc	test: switch `emqx_authz_file_SUITE` to use new tooling	2023-07-04 13:20:03 +02:00
Andrew Mayorov	2c50e61cee	fix(cth): reduce amount of logging + streamline logging Also make sure that code running on `emqx_cth_cluster` nodes don't crash when using `ct:pal` and friends.	2023-07-04 13:20:03 +02:00
Andrew Mayorov	9bda4192e5	fix(cthsuite): disable default `acl.conf` authz source So that users of `emqx_cth_suite` won't have to deal with providing correct filepath each time they start `emqx_conf` and/or `emqx_authz` up.	2023-07-04 13:20:03 +02:00
Andrew Mayorov	24a16ea247	fix(cthsuite): bump to hocon 0.39.11 with atom prettyprint fix	2023-07-04 13:20:03 +02:00
Andrew Mayorov	6a7254f55e	fix(cthcluster): match correct driver in `stop_node/2` Co-authored-by: Ilya Averyanov <av@rubybox.dev>	2023-07-04 13:20:02 +02:00
Andrew Mayorov	fe0b8cfbaf	test(conf): respect `init_config_load_done` in emqx_conf itself This should make task of configuring various applications (emqx_conf / emqx) during testsuites setup much simpler.	2023-07-04 13:20:02 +02:00
Andrew Mayorov	f76f3b77d7	test: add tooling to make testruns more isolated and predictable Also showcase their usage in some of the existing testsuites.	2023-07-04 12:53:39 +02:00
firest	afabdc3440	fix(emqx_conf): call clean callback before ekka stop	2023-07-04 18:04:33 +08:00
zhongwencool	d509c47344	feat: add conf load api	2023-07-04 14:17:11 +08:00
Kjell Winblad	33cb29efdb	Merge pull request #11169 from kjellwinblad/kjell/improved_sparkplugb/EMQX-10351 feat: add Sparkplug encode and decode functions to the rule engine	2023-07-04 07:24:06 +02:00
Ilya Averyanov	9701c3f7a1	fix(redis): validate database number	2023-07-03 22:44:54 +03:00
Andrew Mayorov	a127fd6571	Merge pull request #11183 from keynslug/perf/EMQX-9591/routing perf(broker): avoid usorting aggregated routes in a loop	2023-07-03 19:16:25 +02:00
Thales Macedo Garitezi	2cc0ba1217	Merge pull request #11174 from thalesmg/make-rule-server-a-binary fix(mqtt_bridge): ensure `server` key is a binary	2023-07-03 10:38:39 -03:00
Thales Macedo Garitezi	59d71a1147	Merge pull request #11173 from thalesmg/fix-flaky-gcp-consu-test test(gcp_consumer): attempts to reduce flakiness	2023-07-03 10:04:31 -03:00
Andrew Mayorov	0f25df3aa8	perf(router): employ `maps:foreach/2` instead	2023-07-03 15:01:47 +02:00
Andrew Mayorov	57da71eb1d	perf(broker): avoid usorting aggregated routes in a loop	2023-07-03 15:01:33 +02:00
firest	902603780b	test(ruleengine): add test for the fix of duplicate payload	2023-07-03 18:22:35 +08:00
firest	bd4f207365	fix(ruleengine): fix duplicate `payload` problems	2023-07-03 14:21:56 +08:00
Thales Macedo Garitezi	c216dfd96b	fix(mysql_bridge): make nxdomain a 400 API error Fixes https://emqx.atlassian.net/browse/EMQX-10460	2023-06-30 16:10:09 -03:00
Stefan Strigler	07cf250093	Merge pull request #11126 from sstrigler/EMQX-8842-fix-rule-metrics fix(emqx_rule_engine): set inc_action_metrics as async_reply_fun	2023-06-30 20:07:23 +02:00
Thales Macedo Garitezi	425eba8b13	fix(mqtt_bridge): ensure `server` key is a binary Fixes https://emqx.atlassian.net/browse/EMQX-10461 So that it can be JSON encoded correctly. ``` 2023-06-30T02:00:41.160110+00:00 [debug] msg: publish_to, mfa: emqx_trace:publish/1, line: 73, topic: b/$, payload: {"topic":"t/1","server":[49,48,46,52,50,46,51,46,49,56,48,58,49,56,56,51],"retain":false,"qos":1,"pub_props":{},"payload":"{\"msg\": \"hello\"}","message_received_at":1688090441159,"id":"0005FF4F2F181488103417000C2E0000","dup":false}, tag: PUBLISH ```	2023-06-30 13:46:24 -03:00
Thales Macedo Garitezi	6fe6aa7997	Merge pull request #11162 from thalesmg/treat-404-as-failure-master fix(webhook): treat 404 and other error replies as errors in async requests	2023-06-30 13:13:18 -03:00
Thales Macedo Garitezi	7cf1dd7e86	Merge pull request #11163 from thalesmg/fix-rm-mongo-topology-pool-size fix(mongodb): hide `topology.pool_size` and fix it at 1	2023-06-30 13:13:02 -03:00
Thales Macedo Garitezi	0201481c70	Merge pull request #11164 from thalesmg/fix-placeholder-sql-nested fix(placeholder): add back support for nested keys inside binary encoded json	2023-06-30 13:12:51 -03:00
Thales Macedo Garitezi	1a058f6890	test(gcp_consumer): attempts to reduce flakiness	2023-06-30 12:49:23 -03:00
Kjell Winblad	714363bd01	fix: decouple emqx_rule_engine application from emqx_ee_schema_registry This commit decouples the emqx_rule_engine application from the emqx_ee_schema_registry application by making it possible to register a callback module that defines extra rule engine SQL functions instead of calling a module in emqx_ee_schema_registry directly from the emqx_rule_engine application.	2023-06-30 16:56:16 +02:00
Ilya Averyanov	724efcb557	Merge pull request #11168 from savonarola/0630-fix-rebalance-schema Specify correct response schema for global rebalance status	2023-06-30 17:00:35 +03:00
Thales Macedo Garitezi	3c8f591cc4	fix(mongodb): hide `topology.pool_size` and fix it at 1 Fixes https://emqx.atlassian.net/browse/EMQX-10408 From an old conversation with @kjellwinblad: > There are 3 pool_sizes > - The buffer workers pool size, just exposed here: https://github.com/emqx/emqx/pull/9742 > - The topology.pool_size, which controls the pool size for the poolboy_pool in Kjell's diagram (on mongodb's side). > - The pool_size from emqx_connector_mongo:mongo_fields that controls the ecpool pool size (on EMQX's side). > So we actually want to set topology.pool_size = 1 and hide it from users.	2023-06-30 10:17:33 -03:00
Thales Macedo Garitezi	631f4ceac9	fix(placeholder): add back support for nested keys inside binary encoded json Fixes https://emqx.atlassian.net/browse/EMQX-10459	2023-06-30 10:05:49 -03:00
Thales Macedo Garitezi	ca435975de	fix(webhook): treat http status code 429 as recoverable	2023-06-30 09:46:03 -03:00
lafirest	1ea92d4009	Merge pull request #11166 from lafirest/feat/porti_uuid_el_v4 feat(ruleengine): port random && uuid_v4 functions from v4	2023-06-30 18:36:45 +08:00
zhongwencool	c8d1bd3bd5	Merge pull request #11138 from zhongwencool/cluster-conf-k8s-default fix: update cluster.conf's k8s default api_server value	2023-06-30 17:01:52 +08:00
Kjell Winblad	039e27a153	feat: add Sparkplug encode and decode functions to the rule engine Fixes: https://emqx.atlassian.net/browse/EMQX-10429	2023-06-30 10:06:56 +02:00
Ilya Averyanov	b5c0951584	fix(rebalance): specify correct response schema for global rebalance status	2023-06-30 10:53:08 +03:00
firest	872698d19e	feat(ruleengine): port random && uuid_v4 functions from v4	2023-06-30 14:38:27 +08:00
zhongwencool	bb1ae808b4	Merge pull request #11165 from zhongwencool/hide-global-limiter-from-swagger-api chore: hide /configs/limiter from swagger api doc	2023-06-30 11:54:01 +08:00
zhongwencool	3eefa1b2a3	chore: hide /configs/limiter from swagger api doc	2023-06-30 10:59:18 +08:00
zhongwencool	8b679cf358	Merge pull request #11137 from zhongwencool/dashboard-https-ssl-options feat: refactor dashboard https ssl_options	2023-06-30 09:57:07 +08:00
zhongwencool	bd83365d45	fix: update cluster.conf's k8s default api_server value	2023-06-30 09:55:36 +08:00
Thales Macedo Garitezi	59b109eb5c	fix(webhook): treat 404 and other error replies as errors in async requests Fixes https://emqx.atlassian.net/browse/EMQX-10405 The problem here was that, for async requests, ehttpc responses of the form `{ok, 4__, _, _}` and similar were being treated as successes.	2023-06-29 15:45:23 -03:00
Thales Macedo Garitezi	4506eff3ff	Merge pull request #11140 from thalesmg/gcp-consumer-tests test(gcp_pubsub_consumer): add more tests and improve bridge	2023-06-29 13:02:47 -03:00
Stefan Strigler	14da61194e	fix: handle resource errors	2023-06-29 16:09:45 +02:00
Stefan Strigler	321fd53132	fix: use ReplyTo in QUERY for async	2023-06-29 16:09:45 +02:00
Stefan Strigler	d71d70c889	fix: allow to pass in Opts rather than just a ReplyTo	2023-06-29 16:09:45 +02:00
Stefan Strigler	40dd34a704	fix: use reply_to instead of async_reply_fun	2023-06-29 16:09:45 +02:00
Stefan Strigler	1363108678	fix: fix simple_sync_query	2023-06-29 16:09:45 +02:00
Stefan Strigler	422c79583a	test(emqx_rule_engine): fix simple sync	2023-06-29 16:09:45 +02:00
Stefan Strigler	837acd4234	test(emqx_rule_engine): test rule metrics	2023-06-29 16:09:45 +02:00
Stefan Strigler	2274a192cc	fix(emqx_resource): call async reply fun in simple_aysnc_query	2023-06-29 16:09:45 +02:00
Stefan Strigler	ae636a52d7	fix(emqx_rule_engine): set inc_action_metrics as async_reply_fun	2023-06-29 16:09:45 +02:00
lafirest	9708a02680	Merge pull request #11134 from lafirest/fix/auth_header_sensitive fix: mask the value of the authorization header whatever its case	2023-06-29 21:43:16 +08:00
ieQu1	f2074e9c9b	Merge pull request #11143 from ieQu1/master docs(ds): Update IMPLEMENTATION.md	2023-06-29 11:14:55 +02:00
lafirest	be1a4c89a5	Merge pull request #11158 from lafirest/fix/wait_table_in_retainer fix(emqx_retainer): wait for Mria tables	2023-06-29 16:01:54 +08:00
firest	31e914f6a2	fix(emqx_utils): improve the checking for the `authorization` key	2023-06-29 15:57:48 +08:00
firest	6fedd0328f	fix(retainer): Fix missing changes in configuration	2023-06-29 14:06:17 +08:00
firest	1202bef6db	fix(emqx_retainer): wait for Mria tables	2023-06-29 03:16:05 +00:00
zhongwencool	9dae408b5a	Merge pull request #11142 from zhongwencool/list-listener-group-with-wrong-bind List listener group with wrong bind	2023-06-29 11:04:35 +08:00
zhongwencool	73487ecdd5	chore: add desc for ssl_options	2023-06-29 10:49:39 +08:00
zhongwencool	82ea9e5a04	test: dashbaord api ct failed	2023-06-29 10:49:39 +08:00
zhongwencool	e26c30ff0c	feat: refactor dashboard https ssl_options	2023-06-29 10:49:39 +08:00
firest	71d34504bf	fix(cluster_rpc): clean self-data by mria stop callback	2023-06-29 01:45:47 +00:00
firest	8e68af14ef	chore: bump ekka version	2023-06-29 01:45:47 +00:00

... 20 21 22 23 24 ...

10450 Commits