9406 Commits

Author	SHA1	Message	Date
Thales Macedo Garitezi	9463e271c0	feat(ds): open iterators when handling SUBSCRIBE packets ... Fixes https://emqx.atlassian.net/browse/EMQX-9741	2023-08-22 13:29:15 -03:00
Thales Macedo Garitezi	ca697a4e14	fix: rename emqx_ds{,_replay}:replay_id()	2023-08-22 13:29:15 -03:00
Thales Macedo Garitezi	45e2e687e5	fix(greptimedb_bridge): avoid double-parsing write syntax during probe and remove code duplication ... Fixes https://emqx.atlassian.net/browse/EMQX-10843	2023-08-22 12:42:48 -03:00
Kjell Winblad	3ffbb7decf	fix: HTTP API /api/v5/publish schema ... The schema for the /api/v5/publish HTTP API endpoint was incorrect. For 400 (Bad Request) error it cannot return a list but the incorrect schema declared that the response could include a list. Fixes: https://emqx.atlassian.net/browse/EMQX-10837 https://github.com/emqx/emqx/issues/11488	2023-08-22 15:21:20 +02:00
lafirest	7b8a599d17	Merge pull request #11486 from lafirest/fix/ldap_autn_wrong_pw ... fix(ldap): Return correct reason code when password is wrong	2023-08-22 18:53:17 +08:00
lafirest	f8f39bf223	Merge pull request #11490 from lafirest/fix/absent_pw ... fix(authn): quickly return when the password is absent in password-based authentication	2023-08-22 18:52:58 +08:00
firest	e20b804e6b	chore: update changes && test cases	2023-08-22 17:41:08 +08:00
firest	184e03387a	fix(ldap): fix status detection and auto reconnecting errors	2023-08-22 17:06:00 +08:00
Kinple	663d03112e	Merge pull request #11476 from Kinplemelon/kinple/for-upgrade-dashboard ... fix: set the `endpoint` in kinesis bridge as a required field	2023-08-22 14:28:40 +08:00
firest	b0c5b447a4	fix(authn): quickly return when the password is absent in password-based authentication	2023-08-22 11:49:32 +08:00
JimMoen	13ebcd6290	Merge pull request #11478 from JimMoen/hstreamdb-tls-support ... Hstreamdb tls support	2023-08-22 10:40:54 +08:00
firest	037b0a7599	fix(ldap): Return correct reason code when password is wrong	2023-08-22 09:42:04 +08:00
Paulo Zulato	4e4c93a758	Merge pull request #11469 from paulozulato/feat-redis-auth-username ... Add support for AUTH with username on Redis	2023-08-21 16:44:21 -03:00
Thales Macedo Garitezi	74d4a8325e	Merge pull request #11470 from thalesmg/gcp-consumer-rm-worker-pool-size-r52-20230817 ... fix(gcp_consumer): remove unused resource_opts fields	2023-08-21 14:49:59 -03:00
Thales Macedo Garitezi	bd5680db00	Merge pull request #11461 from thalesmg/bridge-dryrun-flex-timeout-r52-20230816 ... fix(bridge): make dryrun health check timeout more malleable	2023-08-21 14:49:46 -03:00
Ivan Dyachkov	999988cab4	Merge pull request #11401 from kjellwinblad/kjell/fix/mongo_date_format/EMQX-10727 ... fix: rule SQL mongo_date function should return a string in test mode	2023-08-21 16:20:59 +02:00
Thales Macedo Garitezi	4163f06611	Merge pull request #11480 from thalesmg/rule-funcs-func-clause-r52-20230818 ... fix(rule_engine): capture function_clause errors	2023-08-21 11:16:25 -03:00
Kinplemelon	443d44aaa3	fix: set the endpoint in kinesis bridge as a required field	2023-08-21 11:49:57 +08:00
JimMoen	f45b5fac6f	chore: unhidden hstreamdb bridge for e5.2.0	2023-08-21 10:40:51 +08:00
JimMoen	649647190e	test: new batch mechanism of hstreamdb_erl	2023-08-21 10:40:51 +08:00
JimMoen	5527edf442	chore: bump hstreamdb_erl to 0.4.3+v0.16.1	2023-08-21 10:40:36 +08:00
Ilya Averyanov	ed67303281	Merge pull request #11382 from savonarola/0801-auth-refactor ... Auth refactor stage 1	2023-08-21 00:24:15 +03:00
Zaiming (Stone) Shi	01c9095982	Merge pull request #11394 from zmstone/0804-upgrade-wolff-to-1.7.7 ... chore: upgrade Kafka client wolff to 1.7.7	2023-08-20 10:14:13 +02:00
Paulo Zulato	05fdf52d8e	fix(redis): set bridge as unhealthy on authentication error	2023-08-18 14:51:03 -03:00
Paulo Zulato	fc35c74eab	fix(redis): use eredis_secret to avoid password leaking	2023-08-18 14:51:03 -03:00
Paulo Zulato	2c458b62f5	feat(redis): add support for username on AUTH command ... Fixes https://emqx.atlassian.net/browse/EMQX-9911	2023-08-18 14:50:06 -03:00
Thales Macedo Garitezi	66dec69d09	fix(rule_engine): capture function_clause errors ... Fixes https://emqx.atlassian.net/browse/EMQX-10798	2023-08-18 13:51:19 -03:00
Thales Macedo Garitezi	befc260555	fix(gcp_consumer): remove unused resource_opts fields ... Fixes https://emqx.atlassian.net/browse/EMQX-10789	2023-08-17 17:02:02 -03:00
Thales Macedo Garitezi	e48bfb52bb	Merge branch 'release-52' into sync-r52-master-20230817	2023-08-17 17:01:04 -03:00
Paulo Zulato	afffdbbaa1	fix(kinesis): replace default payload template ... Fixes https://emqx.atlassian.net/browse/EMQX-10766	2023-08-17 17:00:14 -03:00
Ivan Dyachkov	e2b9d905d7	Merge pull request #11465 from id/0718-e5.2.0-alpha.3	2023-08-17 20:59:13 +02:00
Andrew Mayorov	75ed6aa8e7	Merge pull request #11396 from keynslug/ft/EMQX-10712/ruleeng-topic-index-vol-2 ... perf(ruleeng): employ `emqx_topic_index` to speed up topic matching	2023-08-17 20:43:09 +04:00
Ivan Dyachkov	a0c2fe8cc1	chore: e5.2.0-alpha.3	2023-08-17 17:55:56 +02:00
Thales Macedo Garitezi	ebecbd1545	fix(bridge): make dryrun health check timeout more malleable ... Fixes https://emqx.atlassian.net/browse/EMQX-10773 - Makes the timeout for probing a bridge more malleable to account for differences between each database. - Increases GCP PubSub Consumer default health check timeout to account for GCP slowness/throttling.	2023-08-17 09:21:19 -03:00
Thales Macedo Garitezi	e3572eb758	Merge pull request #11459 from thalesmg/kafka-health-check-interval-r52-20230816 ... feat(kafka): add option to configure health check interval	2023-08-17 09:04:30 -03:00
Thales Macedo Garitezi	029b461a13	Merge pull request #11448 from thalesmg/gcp-consumer-403-20230815 ... fix(gcp_consumer): handle 403 responses	2023-08-17 09:04:00 -03:00
ieQu1	7466024bca	Merge pull request #11458 from ieQu1/fix-excluded-apps-230916 ... fix(emqx_machine_boot): Fix excluded_apps	2023-08-17 11:36:23 +02:00
Ivan Dyachkov	7469222a17	Merge remote-tracking branch 'upstream/master' into 0817-e5.2.0-code-freeze	2023-08-17 08:16:04 +02:00
lafirest	5e448f5a02	Merge pull request #11446 from lafirest/refactor/calendar ... refactor(calendar): refactor datetime-related code and remove redundant	2023-08-17 07:40:44 +08:00
Andrew Mayorov	5d79823891	perf(topicidx): preserve next key on the stack to reuse later ... This should further optimize the number of `ets:next/2` calls required for a single match query.	2023-08-17 01:13:19 +04:00
Paulo Zulato	740680d54b	Merge pull request #11444 from paulozulato/fix-kinesis-msg-access-denied ... fix(kinesis): return error message on access denied	2023-08-16 18:02:46 -03:00
Thales Macedo Garitezi	f03733ba6b	Merge pull request #11460 from thalesmg/integration-tests-dir-20230816 ... ci: add `integration_test` dir to `emqx` application	2023-08-16 17:47:14 -03:00
Ilya Averyanov	d17bcc94f6	chore(auth): update emqx_gcp_device tests	2023-08-16 22:37:42 +03:00
Paulo Zulato	a64386ef82	fix(kinesis): return error message on access denied ... Fixes https://emqx.atlassian.net/browse/EMQX-10764	2023-08-16 16:04:23 -03:00
Ilya Averyanov	3943830eae	chore(auth): remove unnecessary atom conversions	2023-08-16 20:50:35 +03:00
Ilya Averyanov	0dae040047	chore(auth): restore injected schema key position	2023-08-16 20:50:35 +03:00
Ilya Averyanov	db31e5f0d9	chore(auth): tidy up the code	2023-08-16 20:50:35 +03:00
Ilya Averyanov	67e06b3171	chore(auth): make schema injection be more universal	2023-08-16 20:41:05 +03:00
Ilya Averyanov	abcdf18ca4	chore(auth): update ldap authn test	2023-08-16 20:41:05 +03:00
Ilya Averyanov	f00f4568dc	chore(auth): simplify schema injection	2023-08-16 20:41:05 +03:00
Ilya Averyanov	8a3e8ee528	chore(auth): add config propagation tests for authn	2023-08-16 20:41:05 +03:00
Ilya Averyanov	cd88dfbbb8	chore(auth): update authn includes	2023-08-16 20:41:05 +03:00
Ilya Averyanov	ae3355880e	chore(auth): update emqx_authn tests	2023-08-16 20:41:05 +03:00
Ilya Averyanov	128aa19d47	chore(auth): improve emqx_config_handler to replace adhoc config updates	2023-08-16 20:41:05 +03:00
Ilya Averyanov	8213aa42c9	chore(auth): move authn leftovers to the authn app	2023-08-16 18:52:14 +03:00
Ilya Averyanov	ca8c1e3ef8	chore(auth): removed direct usages of authn from emqx core app	2023-08-16 18:52:14 +03:00
Ilya Averyanov	ce2b159022	chore(auth): make pre_hook_authenticate be part of emqx_access_control domain	2023-08-16 18:52:14 +03:00
zhongwencool	e6f0dead9e	Merge pull request #11445 from zhongwencool/remove-os-mon-from-windows ... fix: remove os_mon application in Windows release	2023-08-16 23:30:24 +08:00
Thales Macedo Garitezi	a6a023eff7	ci: add integration_test dir to emqx application ... This gives us a place where to put tests that exercise multiple umbrella application, which is more closely related to `emqx`, but in a way that doesn't affect the standalone app tests.	2023-08-16 11:48:47 -03:00
Thales Macedo Garitezi	ffca581229	feat(kafka): add option to configure health check interval ... Fixes https://emqx.atlassian.net/browse/EMQX-10781	2023-08-16 11:08:06 -03:00
ieQu1	7b44caeae4	fix(emqx_machine_boot): Fix excluded_apps	2023-08-16 16:04:35 +02:00
Andrew Mayorov	c84ee66d80	Merge pull request #11450 from keynslug/fix/dirty-testsuite-flapping ... fix(test): switch `emqx_flapping_SUITE` to cth tooling	2023-08-16 17:20:31 +04:00
zhongwencool	e406cd7868	Merge pull request #11456 from zhongwencool/allow-empty-cacertfile-pem ... fix: allow empty cacertfile pem	2023-08-16 21:10:52 +08:00
zhongwencool	78356d2625	chore: start os_mon in handle_continue/2	2023-08-16 20:54:53 +08:00
Thales Macedo Garitezi	82f27eaf78	Merge pull request #11429 from thalesmg/mongodb-legacy-opt-20230810 ... feat(mongodb): add configurable option to override legacy protocol usage	2023-08-16 09:54:53 -03:00
zhongwencool	8b23ee86b3	fix: hide cpu_status if os_check is not supported	2023-08-16 20:49:28 +08:00
zhongwencool	b817e03c08	fix: start os_mon application temporary	2023-08-16 20:49:27 +08:00
zhongwencool	848eb7e3c3	fix: remove os_mon application in Windows release	2023-08-16 20:49:27 +08:00
zhongwencool	b733adca06	fix: allow empty cacertfile pem	2023-08-16 20:15:21 +08:00
firest	040d28c35e	fix(cli): fix two typos in the time unit	2023-08-16 18:46:17 +08:00
zhongwencool	1af0407c48	fix: don't crash when debug huge payload	2023-08-16 15:35:09 +08:00
firest	8cd21da94b	chore: update apps version	2023-08-16 10:55:54 +08:00
firest	b08102269a	refactor(calendar): refactor datetime-related code and remove redundant	2023-08-16 10:55:46 +08:00
Thales Macedo Garitezi	4e80d669b0	fix(influxdb_bridge): avoid double-parsing write syntax during probe ... Fixes https://emqx.atlassian.net/browse/EMQX-10771	2023-08-15 17:05:57 -03:00
Andrew Mayorov	0b21b87296	fix(test): switch emqx_flapping_SUITE to cth tooling	2023-08-15 21:29:42 +04:00
Andrew Mayorov	5560e6ed4f	fix(cthsuite): also prevent emqx from loading default conf	2023-08-15 21:25:39 +04:00
Thales Macedo Garitezi	5d707c8b7d	Merge pull request #11403 from thalesmg/gcp-produ-attr-20230728 ... feat(gcp_producer): add support for defining message attributes and ordering key	2023-08-15 13:22:31 -03:00
Thales Macedo Garitezi	ba956ebe88	fix(gcp_consumer): handle 403 responses ... Fixes https://emqx.atlassian.net/browse/EMQX-10736	2023-08-15 13:20:20 -03:00
Zaiming (Stone) Shi	fa9e9f3348	Merge pull request #11442 from zmstone/0814-sync-release-52-to-master ... 0814 sync release 52 to master	2023-08-15 16:21:55 +02:00
Andrew Mayorov	e39bbf4c49	chore(topicidx): add more descriptive comments and specs ... To (hopefully) better illustrate what is happening there.	2023-08-15 16:55:48 +04:00
Thales Macedo Garitezi	23f5cea482	feat: handle strange key values when resolving placeholders	2023-08-14 13:39:38 -03:00
Thales Macedo Garitezi	d93e1bbf08	feat(mongodb): add configurable option to override legacy protocol usage ... Fixes https://emqx.atlassian.net/browse/EMQX-10750 Fixes https://github.com/emqx/emqx/discussions/11428 See https://github.com/emqx/mongodb-erlang/pull/39	2023-08-14 13:19:50 -03:00
Thales Macedo Garitezi	926eb4e3dd	test: rm unused var warning	2023-08-14 10:33:24 -03:00
Thales Macedo Garitezi	82b8538041	feat(gcp_producer): add support for defining message attributes and ordering key ... Fixes https://emqx.atlassian.net/browse/EMQX-10652	2023-08-14 10:33:17 -03:00
lafirest	1bda8020f5	Merge pull request #11436 from lafirest/feat/banned_clear ... feat(banned): add a new API used to clear all banned data	2023-08-14 20:48:43 +08:00
lafirest	6bea894205	Merge pull request #11440 from lafirest/fix/ldap_dep ... fix(ldap): fix dependency problem	2023-08-14 20:34:58 +08:00
Andrew Mayorov	fe9477f92e	chore: bump applications versions ... * emqx_rule_engine 5.0.23	2023-08-14 15:36:58 +04:00
Andrew Mayorov	47dfba4341	perf(ruleeng): employ emqx_topic_index to speed up topic matching	2023-08-14 15:36:58 +04:00
Andrew Mayorov	9a249e4b01	test(topicidx): increase test coverage	2023-08-14 15:36:58 +04:00
Andrew Mayorov	fd0986071c	perf(topicidx): implement fast-forwarding prefixes ... This should give less `ets:next/2` calls in general and much less when index has relatively small number of long non-wildcard topics.	2023-08-14 15:36:58 +04:00
Andrew Mayorov	0c7bdbdab4	test(topicidx): add property test ... Co-Authored-By: JianBo He <heeejianbo@gmail.com>	2023-08-14 15:36:57 +04:00
Andrew Mayorov	48a50c9137	fix(topicidx): fix missing matches when 'a/b' and 'a/b/#' both exist ... Thanks to @HJianBo for spotting this issue. The approach to fix it is different though: we try to keep the "recurrency branch factor" to a minimum, instead introducing new condition for the case when filter does not match, but iteration with `ets:next/2` is not yet finished for the prefix. Co-Authored-By: JianBo He <heeejianbo@gmail.com>	2023-08-14 15:36:57 +04:00
Andrew Mayorov	6a13406363	fix(topicidx): use custom topic words to keep required ordering ... Otherwise, topic with empty tokens (e.g. `a/b///c`) would have some of their tokens ordered before `#` / `+`, because empty token was represented as empty atom (`''`).	2023-08-14 15:36:57 +04:00
Andrew Mayorov	28bcb394d1	fix(topicidx): allow to return matches unique by record id	2023-08-14 15:36:57 +04:00
Andrew Mayorov	8feda315f6	feat(index): add topic index facility ... Somewhat similar to `emqx_trie` in design and logic, yet built on top of a single, potentially pre-existing table.	2023-08-14 15:36:54 +04:00
Zaiming (Stone) Shi	970ff28200	Merge remote-tracking branch 'origin/master' into release-52	2023-08-14 11:50:40 +02:00
firest	0b066fa20c	fix(ldap): fix dependency problem	2023-08-14 16:59:37 +08:00
zhongwencool	41180170f4	fix: update error msg	2023-08-14 15:45:57 +08:00
zhongwencool	e10f9e5e9b	feat: change mqtt.max_packet_size type from string to bytesize	2023-08-14 10:10:46 +08:00
lafirest	b8d3dcf59a	Merge pull request #11424 from lafirest/fix/epoch_maximum_val ... fix(datetime): make sure the epoch is not larger than the maximum supported value	2023-08-11 20:37:56 +08:00
firest	749c2d075f	chore: update changes && bump app version	2023-08-11 17:57:27 +08:00
firest	bc417a6764	fix(datetime): make sure the epoch is not larger than the maximum supported value	2023-08-11 17:57:21 +08:00
firest	2fc0468e0c	feat(banned): add a new API used to clear all banned data	2023-08-11 17:25:49 +08:00
Ivan Dyachkov	7852af896c	chore: e5.2.0-alpha.1	2023-08-11 11:16:30 +02:00
Ivan Dyachkov	bab05b6613	Merge pull request #11433 from id/0811-ci-upgrade-push-helm-action	2023-08-11 11:03:00 +02:00
Ivan Dyachkov	b6084b0001	chore: bump apps/emqx version	2023-08-11 09:19:51 +02:00
lafirest	4eaced241d	Merge pull request #11423 from lafirest/chore/limiter_utils ... fix(limiter): simplify the code of the limiter	2023-08-11 15:17:42 +08:00
JimMoen	060074e04a	fix: api total accumulate ignore undefined by down nodes result	2023-08-11 11:27:55 +08:00
Thales Macedo Garitezi	65aee8870b	Merge pull request #11427 from id/0810-cut-v5.1.5-build.3 ... v5.1.5-build.3	2023-08-10 09:52:58 -03:00
Paulo Zulato	9ca9c65af2	Merge pull request #11367 from paulozulato/feat-gcp-devices ... feat(gcp-iot): port GCP IoT Core compatibility layer from e4.4	2023-08-10 09:44:55 -03:00
Ivan Dyachkov	801c93dd46	chore: v5.1.5-build.3	2023-08-10 12:56:28 +02:00
Ivan Dyachkov	6ead09b28d	chore: merge 'upstream/master'	2023-08-10 12:56:00 +02:00
firest	6dbddfb089	fix(limiter): simplify the code of the limiter ... move runtime code out from the schema	2023-08-10 18:20:05 +08:00
zhongwencool	aa798e531e	Merge pull request #11409 from zhongwencool/opentelemetry-metrics ... feat: support opentelemetry metrics	2023-08-10 14:35:25 +08:00
zhongwencool	d1dc37af4c	Merge pull request #11279 from zhongwencool/trace-log ... fix: don't be kill when send large payload when log is debug	2023-08-10 11:58:31 +08:00
lafirest	b2394cf92d	Merge pull request #11399 from lafirest/fix/ph_utf8 ... fix(placeholder): porting fix to support utf8 key in placeholder	2023-08-10 09:41:39 +08:00
zhongwencool	5a4dd3a5e5	fix: truncate large payload	2023-08-10 09:35:12 +08:00
zhongwencool	d5fe891961	fix: don't be kill when send large payload when log is debug	2023-08-10 09:22:30 +08:00
Thales Macedo Garitezi	bb8ce68c2e	docs: Generate changelog for v5.1.5-patch.2	2023-08-09 16:38:28 -03:00
Thales Macedo Garitezi	95df958f10	docs: Generate changelog for v5.1.5-patch.1	2023-08-09 13:18:09 -03:00
Thales Macedo Garitezi	cce0d144f9	Merge branch 'master' into release-v515-patch1-20230809	2023-08-09 13:08:43 -03:00
Paulo Zulato	a85c948e23	feat(gcp-iot): port GCP IoT Core compatibility layer from e4.4 ... Fixes https://emqx.atlassian.net/browse/EMQX-10341	2023-08-09 10:48:25 -03:00
zhongwencool	3933227636	feat: support opentelemetry metrics	2023-08-09 20:23:40 +08:00
lafirest	bef8eddad3	Merge pull request #11405 from lafirest/fix/kal_kialo ... fix(calendar): make date parse error reason more sense	2023-08-09 14:42:08 +08:00
lafirest	524d33a1fa	Merge pull request #11407 from lafirest/fix/config_name_example ... fix(ldap): improve configuration name and docs	2023-08-09 14:41:53 +08:00
firest	3e9155fdb1	chore: bump emqx_utils version && changes	2023-08-09 10:54:56 +08:00
firest	7567d211da	fix(placeholder): porting fix to support utf8 key in placeholder	2023-08-09 10:54:41 +08:00
firest	177ec161a1	fix(ldap): improve configuration name and docs	2023-08-09 09:39:57 +08:00
Thales Macedo Garitezi	fdfdb105f0	docs: Generate changelog for v5.1.5	2023-08-08 10:33:34 -03:00
Thales Macedo Garitezi	a1ffd0263d	fix(cacerts): add cacerts back as deprecated to allow upgrading from older versions ... See https://github.com/emqx/emqx/issues/11380	2023-08-08 10:13:13 -03:00
Kjell Winblad	b38461e50a	fix: mongo_date/2 shall give user friendly value in the test environment	2023-08-08 14:47:07 +02:00
Ilya Averyanov	9245162394	chore(rebalance): fix flaky test	2023-08-08 13:06:25 +03:00
firest	9f38f5f26a	fix(calendar): make date parse error reason more sense	2023-08-08 14:28:38 +08:00
Thales Macedo Garitezi	b6decf9592	Merge pull request #11402 from thalesmg/dynamic-kconsu-mqtt-topics-20230807 ... feat(kafka_consumer): add mqtt topic placeholder support	2023-08-07 15:10:29 -03:00
Thales Macedo Garitezi	29e706c83d	refactor: move catch to dry run fn	2023-08-07 13:08:34 -03:00
Thales Macedo Garitezi	4b8cea4498	fix: make error handling more flexible	2023-08-07 13:08:34 -03:00
Thales Macedo Garitezi	963d63b899	refactor: rename temporary name ... Co-authored-by: Zaiming (Stone) Shi <zmstone@gmail.com>	2023-08-07 13:08:34 -03:00
Thales Macedo Garitezi	5c8dc092a1	fix(http_bridge): don't attempt to convert headers to atoms ... Fixes https://emqx.atlassian.net/browse/EMQX-10653	2023-08-07 13:08:34 -03:00
Thales Macedo Garitezi	d5847f33a8	test: attempt to stabilize flaky tests	2023-08-07 13:08:34 -03:00
Thales Macedo Garitezi	9900a32850	feat(kafka_consumer): add mqtt topic placeholder support ... Fixes https://emqx.atlassian.net/browse/EMQX-10678	2023-08-07 11:42:34 -03:00
Kjell Winblad	3ed031db70	fix: rule SQL mongo_date function should return a string in test mode ... The rule SQL mongo_date function should return a string with the format ISODate(*), where * is an ISO date string when running the rule in test mode. Fixes: https://emqx.atlassian.net/browse/EMQX-10727	2023-08-07 16:10:30 +02:00
lafirest	2b03436552	Merge pull request #11392 from lafirest/feat/ldap_authz ... feat(ldap-authz): integrate the LDAP authorization	2023-08-07 11:12:05 +08:00
zhongwencool	665695a977	Merge pull request #11388 from SergeTupchiy/EMQX-10703-fix-replicant-crash-when-core-terminates-abnormally ... fix: increase emqx_router_sup restart intensity	2023-08-06 14:40:32 +08:00
Serge Tupchii	2b7798608d	fix(emqx_router_helper): don't cleanup down node on a replicant ... The cleanup on a replicant node is redundant, as Mria would delegate this delete op to a core node (via RPC), and the core node is expected to receive the same `nodedown` message and process it.	2023-08-04 16:55:36 +03:00
SergeTupchiy	2044326734	Merge pull request #11390 from SergeTupchiy/EMQX-10661-improve-perf-high-latency-cluster-network ... EMQX-10661 improve performance on high latency cluster network	2023-08-04 16:41:08 +03:00
Zaiming (Stone) Shi	115ab85670	chore: upgrade Kafka client wolff to 1.7.7	2023-08-04 15:31:34 +02:00
firest	b24a9d5343	chore(ldap-authz): update apps version && changes	2023-08-04 18:14:09 +08:00
firest	0571fd8cac	feat(ldap-authz): integrate the LDAP authorization	2023-08-04 18:14:01 +08:00
Serge Tupchii	f276ea9e91	fix: increase emqx_router_sup restart intensity ... The goal is to tolerate occasional crashes that can happen under relatively normal conditions and don't seem critical to shutdown the whole app (emqx). For example, mria write/delete call delegated from a replicant to a core node may fail, if the core node is being stopped / restarted / not ready. Fixes: EMQX-10703, #11310	2023-08-04 10:49:59 +03:00
firest	7055eafb91	fix(ldap): fix license date and some minor problems	2023-08-04 11:01:13 +08:00
lafirest	1b0b15786c	Merge pull request #11386 from lafirest/feat/ldap_authn ... feat(authn): integrate the LDAP authentication	2023-08-04 09:37:37 +08:00
Andrew Mayorov	420653e5a2	Merge pull request #11389 from keynslug/perf/EMQX-10706/squash-retained-index ... perf(retainer): squash index updates into single dirty activity	2023-08-03 21:32:04 +04:00
Serge Tupchii	466fe7e009	perf: add broker_pool_size, generic_pool_size and channel_cleanup_batch_size config options ... Tuning these options can improve performance if cluster interconnect network latency is high. Fixes: EMQX-10661	2023-08-03 19:44:00 +03:00
Serge Tupchii	ed28c12a66	chore(emqx_conf): deprecate node.tlog_push_mode setting ... It is not used since mria 0.2.10	2023-08-03 17:46:14 +03:00
Andrew Mayorov	0e0c0d0e1e	chore: bump emqx_retainer to 5.0.16	2023-08-03 15:35:21 +04:00
Andrew Mayorov	534a741b0e	perf(retainer): do not GC on replicant nodes	2023-08-03 15:34:24 +04:00
firest	efff585b82	feat(ldap-authn): add test suite for the LDAP authenticator	2023-08-03 18:56:41 +08:00
Andrew Mayorov	42be694d40	perf(retainer): squash index updates into single dirty activity ... In order to minimize number of round trips to core nodes and between them, improving publishing latency. This shouldn't make consistency worse than it was before.	2023-08-03 12:51:36 +04:00
Andrew Mayorov	39bb9d5136	chore: bump ekka to 0.15.10 ... Which sports mria 0.6.0 with dirty activities support.	2023-08-03 11:38:53 +04:00
firest	18b3db336a	fix(ldap-authn): remove slat-related configs since they conflict with RFC 3123	2023-08-03 11:00:42 +08:00
Paulo Zulato	2c63fe3bcd	fix(greptimedb): add sync_start to avoid false negative healthy check ... Fixes https://emqx.atlassian.net/browse/EMQX-10709	2023-08-02 19:40:23 -03:00
Paulo Zulato	97fdc834de	Merge pull request #11381 from paulozulato/fix-oracle-doc-link ... doc(oracle): add link to online documentation into README	2023-08-02 12:10:59 -03:00
firest	c041216ec0	feat(authn): integrate the LDAP authentication	2023-08-02 19:19:17 +08:00
firest	9bb5c9de33	fix(ldap): make elvis happy	2023-08-02 11:02:02 +08:00
firest	b2f3ac9967	fix(ldap): fix newline error && correcting files header	2023-08-02 10:07:27 +08:00
Paulo Zulato	b8be080ffb	docs(oracle): add link to online documentation into README ... Fixes https://emqx.atlassian.net/browse/EMQX-10694	2023-08-01 16:20:31 -03:00
firest	f98f97f37e	feat(ldap): set test env and add test suites	2023-08-01 18:49:54 +08:00
firest	8c9b136d15	fix(ldap): integrate parser and fix lexer errors	2023-08-01 18:49:54 +08:00
firest	fa6343cc80	feat(ldap): add LDAP connector	2023-08-01 18:49:54 +08:00
Ivan Dyachkov	0f161a81c3	chore: v5.1.4	2023-08-01 09:20:46 +02:00
Thales Macedo Garitezi	41606aa840	Merge pull request #11373 from thalesmg/fix-spellcheck-master-20230731 ... fix(spellcheck): fix several spellcheck issues not caught in CI	2023-07-31 18:00:31 -03:00
Thales Macedo Garitezi	620b5fc048	fix(spellcheck): fix several spellcheck issues not caught in CI ... Fixes some issus later found by CI that somehow didn't block the originating PRs. Example failure: https://github.com/emqx/emqx/actions/runs/5715470851/job/15485284918?pr=11372	2023-07-31 14:32:12 -03:00
Thales Macedo Garitezi	7687770821	fix(tls): remove cacerts config for now ... Fixes https://github.com/emqx/emqx/issues/11370 Related: https://github.com/emqx/emqx/pull/11371	2023-07-31 10:44:05 -03:00
Thales Macedo Garitezi	a3be1529c6	fix(schema): ensure enterprise module is correctly loaded ... Fixes https://emqx.atlassian.net/browse/EMQX-10654 Despite loading the application in `nodetool`, we need to invoke `:module_info()` to force the module to be actually loaded, especially when it's called in `call_hocon` to generate the initial configurations. Otherwise, it'll fail to list all the bridge schemas.	2023-07-28 16:27:43 -03:00
Thales Macedo Garitezi	d6344ab709	Merge pull request #11363 from thalesmg/rabbit-tls-20230727 ... feat(rabbitmq_bridge): add TLS support	2023-07-28 13:23:30 -03:00
Thales Macedo Garitezi	2ee1aa6d60	Merge pull request #11347 from thalesmg/fix-ocsp-path-encoding-20230725 ... fix(ocsp): URL encode request path	2023-07-28 09:01:39 -03:00
Thales Macedo Garitezi	399f849f7b	feat(rabbitmq_bridge): add TLS support ... Fixes https://emqx.atlassian.net/browse/EMQX-10605	2023-07-27 15:52:46 -03:00
Ivan Dyachkov	d51b5b739b	chore: v5.1.3	2023-07-27 17:00:20 +02:00
Ivan Dyachkov	5ac01c9b85	Merge pull request #11360 from id/0727-sync-release-51-to-master	2023-07-27 16:58:09 +02:00
Thales Macedo Garitezi	ee3d002fca	Merge pull request #11329 from thalesmg/aeh-bridge-20230720 ... feat: add Azure Event Hub Producer bridge	2023-07-27 11:18:40 -03:00
Ivan Dyachkov	63adeabf72	chore: bump app versions	2023-07-27 15:29:03 +02:00
Ivan Dyachkov	cbfca8c043	chore: merge master into release-51	2023-07-27 15:19:57 +02:00
Thales Macedo Garitezi	5abe4bed88	feat: add Azure Event Hub Producer bridge ... Fixes https://emqx.atlassian.net/browse/EMQX-10338	2023-07-27 09:22:39 -03:00
Ivan Dyachkov	50a0900d92	chore: e5.1.1	2023-07-27 12:18:03 +02:00
JianBo He	951a96457b	Revert "feat(index): add topic index facility "	2023-07-27 13:42:43 +08:00
JianBo He	5e4855334e	Revert "Fix(topicidx): allow to return matches unique by record id"	2023-07-27 13:39:37 +08:00
firest	abf8d8b391	fix(ds): make dialyzer happy	2023-07-26 16:35:07 +08:00
firest	14b76916df	fix(ds): avoid crashes when starting on Windows	2023-07-26 15:37:58 +08:00
Thales Macedo Garitezi	2ac8ba2add	test: fix flaky test	2023-07-25 17:43:33 -03:00
Thales Macedo Garitezi	d3d52695d5	feat(tls): automatically add cacerts to client opts ... `public_key:cacerts_get/0` was introduced in OTP 25 and allows us to load the system trusted CA certificates. https://www.erlang.org/doc/man/public_key.html#cacerts_get-0	2023-07-25 17:43:33 -03:00
Thales Macedo Garitezi	d0deaca00d	fix(ocsp): URL encode request path ... Fixes https://emqx.atlassian.net/browse/EMQX-10624	2023-07-25 17:39:38 -03:00
Serge Tupchii	77184c00ff	chore(ekka): Bump version to 0.15.9	2023-07-25 19:29:18 +03:00
Ivan Dyachkov	f9d3d3325b	chore: e5.1.1-rc.1	2023-07-25 16:34:25 +02:00
Ilya Averyanov	2909b1de2d	Merge pull request #11339 from savonarola/0724-fix-subscribe-qos-authz ... fix(authz): correctly identify qos of subscribe actions	2023-07-25 17:07:57 +03:00
Thales Macedo Garitezi	c7bf3ece34	Merge pull request #11338 from thalesmg/fix-pgsql-error-r51-20230724 ... fix(postgres_bridge): fix table existence check and handle sync_required	2023-07-25 10:53:03 -03:00
Paulo Zulato	7ee17553d5	Merge pull request #11337 from paulozulato/fix-error-code-topic-wildcard ... fix(topic_rewrite): handle error when target contains wildcards	2023-07-25 10:37:20 -03:00
Paulo Zulato	8ec14bb07e	fix(topic_rewrite): handle error when target contains wildcards ... Fixes https://emqx.atlassian.net/browse/EMQX-10565	2023-07-25 09:43:14 -03:00
Ilya Averyanov	deaac9bd73	fix(authz): correctly identify qos of subscribe actions	2023-07-25 15:20:52 +03:00
Thales Macedo Garitezi	7a16ff4f04	fix(postgres_bridge): fix table existence check and handle sync_required ... Fixes https://emqx.atlassian.net/browse/EMQX-10629 During health checking, we check whether tables in the SQL statement exist. Such check was done by asking the backend to parse the statement using a named prepared statements. Concurrent health checks could then result in the error: ```erlang {error,{error,error,<<"42P05">>,duplicate_prepared_statement,<<"prepared statement \"get_status\" already exists">>,[{file,<<"prepare.c">>},{line,<<"451">>},{routine,<<"StorePreparedStatement">>},{severity,<<"ERROR">>}]}} ``` This could lead to an inconsistent state in the driver process, which would crash later when a message from the backend (`READY_FOR_QUERY`, "idle"): ``` 2023-07-24T13:05:58.892043+00:00 [error] Generic server <0.2134.0> terminating. Reason: {'module could not be loaded',[{undefined,handle_message,[90,<<"I">>,... ``` Added calls to `epgsql:sync/1` for functions that could return `{error, sync_required}`. Also, redundant calls to `parse2` were removed to reduce the number of requests.	2023-07-25 09:15:14 -03:00
zhongwencool	2c193f26e6	Merge pull request #11332 from HJianBo/fix-topic-index-unique-bugs	2023-07-25 19:07:07 +08:00
JianBo He	d05a5cfe0f	fix(rule): fix the matches/2 for some edge cases	2023-07-25 14:35:18 +08:00
Paulo Zulato	69f4275871	fix(oracle): fix return error checking on table validation ... Fixes https://emqx.atlassian.net/browse/EMQX-10622	2023-07-24 14:50:38 -03:00
JianBo He	e630331de1	fix(rule): fix a quering problem when 'a/b' and 'a/b/#' exist at the same time. ... When using `ets:next` to query the next level of topic words, we should prioritize the next level of '#', '+'.	2023-07-24 23:04:53 +08:00
JianBo He	f848c0b87a	Merge pull request #11333 from JimMoen/chore-hide-hstreamdb ... chore: hidden hstreamdb bridge schema	2023-07-24 21:54:10 +08:00
JianBo He	511d1b6ca1	chore: hide the hstreamdb http api	2023-07-24 20:11:44 +08:00
JianBo He	dcf4819c04	test(rule): add tests to ensure the rules ordering	2023-07-24 19:30:34 +08:00
firest	8439ce0e84	chore: update app version && reboot_lists	2023-07-24 19:08:41 +08:00
Dennis Zhuang	9f200120c2	feat: use http port to detect server availability	2023-07-24 17:58:48 +08:00
Dennis Zhuang	cd9d5f287e	chore: adds auto_reconnect for ecpool	2023-07-24 17:58:48 +08:00
Dennis Zhuang	2ea903c5ac	fix: static checks failures	2023-07-24 17:58:48 +08:00
Dennis Zhuang	b34374c26f	chore: by CR comments	2023-07-24 17:58:48 +08:00
Dennis Zhuang	c9550cc2e5	refactor: rename bridge greptimedb_grpc_v1 to greptimedb	2023-07-24 17:58:48 +08:00
Dennis Zhuang	a1c7eb337b	fix: dependency name	2023-07-24 17:58:48 +08:00
Dennis Zhuang	50c10dd919	chore: update greptimedb-client-erl to v0.1.2	2023-07-24 17:58:48 +08:00
Dennis Zhuang	3b1363dbb7	chore: change license to BCL and adds emqx_bridge_greptimedb_connector_SUITE	2023-07-24 17:58:48 +08:00
Dennis Zhuang	6f7fbcf693	fix: compile error	2023-07-24 17:58:48 +08:00
Dennis Zhuang	4921856950	test: make all emqx_bridge_greptimedb_SUITE tests passing	2023-07-24 17:58:48 +08:00
Dennis Zhuang	c6a7f3e2ad	test: make test passed 21/29	2023-07-24 17:58:48 +08:00
Dennis Zhuang	975795a6e0	feat: add ci test	2023-07-24 17:58:48 +08:00
Dennis Zhuang	89bce99870	test: greptimedb data brige	2023-07-24 17:58:48 +08:00
Dennis Zhuang	91ebd90442	fix: batch write	2023-07-24 17:58:48 +08:00
Dennis Zhuang	6d9944a8e8	feat: update greptimedb dependencies	2023-07-24 17:58:48 +08:00
Dennis Zhuang	417e017498	feat: begin to impl connector	2023-07-24 17:58:48 +08:00
Dennis Zhuang	c5078980f3	feat: adds the greptimedb bridge to emqx modules	2023-07-24 17:58:48 +08:00
Dennis Zhuang	4d581d0b30	feat: init commit	2023-07-24 17:58:48 +08:00
Andrew Mayorov	0496038361	fix(ruleeng): ensure topic index matched rules evalauted once	2023-07-24 17:44:12 +08:00
Andrew Mayorov	6432c9c8fc	fix(topicidx): allow to return matches unique by record id	2023-07-24 17:43:11 +08:00
JimMoen	613dc1646c	chore: hidden hstreamdb bridge schema	2023-07-24 17:22:29 +08:00
firest	af6405fa25	fix(nested_put): fix a data loss bug introduced by #11172	2023-07-24 16:39:37 +08:00
Andrew Mayorov	81793c31fc	Merge pull request #11315 from keynslug/ft/EMQX-9593/peek-mqueue-info ... refactor(session): allow peeking at mqueue less intrusively	2023-07-24 09:57:05 +02:00
JimMoen	c393c2e091	test: ets table cleanup after cases	2023-07-24 09:33:28 +08:00
JimMoen	4e4b1ac115	refactor: module move to app emqx_rule_engine ... - Rename to emqx_rule_index.erl - Remove test funcs from src -> test dir	2023-07-24 09:33:28 +08:00
Andrew Mayorov	b821bdee00	perf(ruleeng): employ emqx_topic_index to speed up topic matching	2023-07-24 09:27:31 +08:00
Andrew Mayorov	28dad5d7a9	feat(index): add topic index facility ... Somewhat similar to `emqx_trie` in design and logic, yet built on top of a single, potentially pre-existing table.	2023-07-24 09:27:31 +08:00
Paulo Zulato	31cf05ec66	Merge pull request #11316 from paulozulato/fix-oracle-pool-size ... fix(oracle): fix Pool Size parameter retrieval	2023-07-21 17:51:21 -03:00
Thales Macedo Garitezi	2531c3e7d1	Merge pull request #11306 from thalesmg/rule-actions-reply-dropped-r51-20230719 ... fix(rule_metrics): notify rule metrics of late replies and expired requests	2023-07-21 16:51:14 -03:00
Ivan Dyachkov	29432009db	chore: 5.1.1-alpha.4	2023-07-21 18:42:14 +02:00
ieQu1	485e495b98	chore(ekka): Bump version to 0.15.8 (mria 0.5.10)	2023-07-21 18:31:02 +02:00
Paulo Zulato	85ab97970f	fix(oracle): fix Pool Size parameter retrieval ... Fixes https://emqx.atlassian.net/browse/EMQX-10599	2023-07-21 11:02:27 -03:00
Ivan Dyachkov	c2c3da073f	chore: v5.1.2	2023-07-21 13:26:29 +02:00
Ivan Dyachkov	243b8f5b67	chore: merge 'upstream/master' into v5.1.2	2023-07-21 13:25:46 +02:00
Ivan Dyachkov	3a3b843f4a	fix(machine): add emqx_bridge_kinesis to reboot_lists.eterm	2023-07-21 13:20:50 +02:00
SergeTupchiy	04bd7c7eed	Merge pull request #11322 from SergeTupchiy/EMQX-10590-data-import-fix-missing-config-rel51 ... EMQX-10590 data import fix missing config relealse 51	2023-07-21 12:36:21 +03:00
Serge Tupchii	ee97cf8e33	fix(emqx_modules): ignore already_existed/not_found errors for added/removed topic metrics	2023-07-21 12:17:47 +03:00
zhongwencool	520ae0e9d3	chore: remove zone desc from document	2023-07-21 15:51:21 +08:00
Serge Tupchii	b37920d2e5	feat: add topic_metrics and slow_subs configuration to data import/export ... Fixes: EMQX-10590	2023-07-21 10:41:22 +03:00
Serge Tupchii	a1a7c4fab6	fix(emqx_rule_engine): fix typo in behaviour module attribute ... The type resulted in missing `rule_engine` config after importing data from a backup file. Fixes: EMQX-10590	2023-07-21 10:33:56 +03:00
zhongwencool	d3e4fda21d	fix: hocon_pp quote string for special char	2023-07-21 12:31:22 +08:00
Paulo Zulato	0827a45c89	Merge pull request #11307 from paulozulato/fix-oracle-table-check ... fix(oracle): discard nested tokens when checking table	2023-07-20 19:19:50 -03:00
Andrew Mayorov	e1e4c64a30	refactor(session): allow peeking at mqueue less intrusively	2023-07-20 21:21:30 +02:00
Thales Macedo Garitezi	54efc04a6f	Merge pull request #11309 from thalesmg/fix-machine-boot-reboot-r51-20230719 ... fix(machine_boot): use shared list of reboot apps and add bridges to reboot list	2023-07-20 14:33:16 -03:00
Thales Macedo Garitezi	6cd503865b	fix(machine_boot): ensure emqx_bridge starts after its companion apps ... We need to reverse the dependency of `emqx_bridge` and `emqx_bridge_*`, because the former loads and starts bridges during its application startup. If the individual bridge application being loaded has not started with its dependencies, the supervision tree will not be ready for that.	2023-07-20 13:11:44 -03:00
Thales Macedo Garitezi	3b1e436d3f	refactor: use emqx_pool:async_submit to avoid excessive spawning	2023-07-20 10:17:43 -03:00
JianBo He	b9f0cd7ba4	chore: pretty the cli output style	2023-07-20 21:01:28 +08:00
Thales Macedo Garitezi	77e2d852e5	fix: add emqx_durable_storage to app list	2023-07-20 09:55:05 -03:00
Andrew Mayorov	f2a32e8ed2	Merge pull request #11304 from keynslug/ft/EMQX-9593/ds-session-connect ... refactor(session): minimize `emqx_session` interface surface	2023-07-20 14:33:21 +02:00
Thales Macedo Garitezi	89ea40a8b7	refactor: apply review remarks	2023-07-20 09:31:13 -03:00
zhongwencool	3cd223ff5b	chore: add more detail msg for merging failed	2023-07-20 17:48:26 +08:00
SergeTupchiy	8480a26b66	Merge pull request #11065 from SergeTupchiy/EMQX-9992-fix-async-cleanup-error-logs ... fix: avoid logging unnecessary errors in async cleanup functions	2023-07-20 12:20:57 +03:00
Thales Macedo Garitezi	b9b11d8f4d	fix(machine_boot): use shared list of reboot apps and add bridges to reboot list	2023-07-19 20:15:42 -03:00
Paulo Zulato	e76ba760c9	fix(oracle): discard nested tokens when checking table ... Fixes https://emqx.atlassian.net/browse/EMQX-10597	2023-07-19 15:03:49 -03:00
Thales Macedo Garitezi	eb41b77de4	fix(rule_metrics): notify rule metrics of late replies and expired requests ... Fixes https://emqx.atlassian.net/browse/EMQX-10600	2023-07-19 11:39:28 -03:00
Serge Tupchii	ff4119e8b3	chore(emqx_config): fix typo in the log message	2023-07-19 16:58:21 +03:00
Thales Macedo Garitezi	41b780f7f2	Merge pull request #11280 from thalesmg/unhide-gcp-consumer-master-20230717 ... chore(gcp_pubsub_consumer): unhide GCP PubSub Consumer bridge for e5.2.0	2023-07-19 10:26:42 -03:00
Thales Macedo Garitezi	6003c34ce5	Merge pull request #11283 from thalesmg/flaky-test-20230717 ... test(http): attempt to stabilize flaky tests	2023-07-19 10:24:07 -03:00
ieQu1	57e39f42c5	Merge pull request #11294 from ieQu1/mria-fixes ... Mria fixes	2023-07-19 15:10:42 +02:00
Andrew Mayorov	dd31487b4a	refactor(session): drop is_session/1 helper as useless ... This is a part of effort to minimize `emqx_session` module interface to simplify adding alternative session implementations.	2023-07-19 14:55:26 +02:00
Andrew Mayorov	0cd2351134	refactor(session): hide no_local logic behind enqueue / deliver ... This is a part of effort to minimize `emqx_session` module interface to simplify adding alternative session implementations.	2023-07-19 14:55:26 +02:00
Ivan Dyachkov	f29a9ed9d5	Merge pull request #11301 from id/0719-sync-release-51-to-master	2023-07-19 14:21:26 +02:00
lafirest	d4550f911c	Merge pull request #11299 from lafirest/hs ... fix(hstream): handle the `unavailable` error code	2023-07-19 17:47:30 +08:00
Andrew Mayorov	92166f287a	Merge pull request #11293 from keynslug/fix/EMQX-9591/phase-out-persistence ... chore(ps): phase out existing session persistence mechanism	2023-07-19 10:36:46 +02:00
Ivan Dyachkov	b7f0f7b32d	chore: merge master into release-51	2023-07-19 09:28:05 +02:00
firest	7ac8715358	fix(hstream): handle the unavailable error code ... The "unavailable" error code just means that the HStream is warming up or busy, HStream guarantees that a retry will work well.	2023-07-19 14:43:50 +08:00
zhongwencool	0524c3b3b1	test: configs SUITE crash	2023-07-19 11:05:14 +08:00
JianBo He	439eb4d029	test: cover the node params for get /configs endpoint	2023-07-19 11:05:14 +08:00
JianBo He	74532a64e6	chore: update apps/emqx_management/src/emqx_mgmt_api_configs.erl	2023-07-19 11:05:14 +08:00
zhongwencool	402f75592e	chore: move rpc call from emqx_management_proto to emqx_conf_proto	2023-07-19 11:05:14 +08:00
zhongwencool	8a0f7bfd99	chore: update version bpapi.versions	2023-07-19 11:05:14 +08:00
zhongwencool	59ed65787f	fix: get_config return target node's node conf	2023-07-19 11:05:14 +08:00
Paulo Zulato	27630ca215	Merge pull request #11261 from paulozulato/feat-bridge-kinesis ... Implement Amazon Kinesis Producer bridge	2023-07-18 16:48:34 -03:00
ieQu1	3a5112829c	fix(mgmt_cli): Don't print cluster status on the replicant	2023-07-18 21:45:00 +02:00
ieQu1	ce76d4ab04	chore(ekka): Bump version to 0.15.7 (mria 0.5.9)	2023-07-18 21:45:00 +02:00
ieQu1	103b89f60c	fix(mgmt_cli): Don't crash when mria is not running	2023-07-18 21:45:00 +02:00
ieQu1	293700773f	refactor(mgmt_cli): Call mria directly	2023-07-18 21:45:00 +02:00
Serge Tupchii	2954ff7300	feat: add topic_metrics and slow_subs configuration to data import/export ... Fixes: EMQX-10590	2023-07-18 20:53:10 +03:00
Serge Tupchii	c9985758d9	fix(emqx_rule_engine): fix typo in behaviour module attribute ... The type resulted in missing `rule_engine` config after importing data from a backup file. Fixes: EMQX-10590	2023-07-18 20:35:21 +03:00
Ivan Dyachkov	de4cc492d4	chore: e5.1.1-alpha.2	2023-07-18 18:55:24 +02:00
Thales Macedo Garitezi	4ec4041f99	Merge pull request #11281 from thalesmg/restore-queue-shared-sub-r51-20230717 ... fix(shared_sub): restore support for `$queue/` shared subscription	2023-07-18 13:52:44 -03:00
Ivan Dyachkov	ca51732d8e	Merge pull request #11292 from emqx/update-rocksdb	2023-07-18 16:14:50 +02:00
Thales Macedo Garitezi	cb1e0cdc89	test(http): attempt to stabilize flaky tests	2023-07-18 10:51:04 -03:00
Andrew Mayorov	3ba6d34511	chore(eviction): phase out session persistence concerns	2023-07-18 15:47:12 +02:00
Andrew Mayorov	0a00c39282	chore(ps): phase out existing session persistence mechanism ... * It's not really working currently in a cluster setup. * It's not really working well. * It would be much easier to integrate `emqx_durable_storage` w/o the need to support existing solution.	2023-07-18 15:46:04 +02:00
Thales Macedo Garitezi	91cd88c136	fix(api_mgmt): use emqx_topic:join for correct construction of topics	2023-07-18 10:19:55 -03:00
Thales Macedo Garitezi	4a889c0994	chore: bump ekka -> 0.15.6 ... https://github.com/emqx/erlang-rocksdb/releases/tag/1.8.0-emqx-1	2023-07-18 09:00:29 -03:00
firest	4f4a813f04	fix(tdengine): update the default template and the changelog	2023-07-18 10:31:18 +00:00
Thales Macedo Garitezi	1fdcfba629	fix(shared_sub): restore support for $queue/ shared subscription ... Partially addresses: https://emqx.atlassian.net/browse/EMQX-4589 There's still a problem with the handling of shared groups that is _not particular to the `$queue/` syntax_ and preexistent that the same client cannot subscribe to _different groups_ that have the same _topic filter_.	2023-07-17 16:41:24 -03:00
Paulo Zulato	484519dcf9	feat(kinesis): implement Amazon Kinesis Producer bridge ... Fixes https://emqx.atlassian.net/browse/EMQX-10474 Fixes https://emqx.atlassian.net/browse/EMQX-10475	2023-07-17 11:51:42 -03:00
Thales Macedo Garitezi	05c3e023a9	chore(gcp_pubsub_consumer): unhide GCP PubSub Consumer bridge for e5.2.0 ... Fixes https://emqx.atlassian.net/browse/EMQX-10506	2023-07-17 11:24:21 -03:00
Thales Macedo Garitezi	ab5fd1e5c3	Merge pull request #11260 from thalesmg/fix-rule-maps-nested-put-r51 ... fix(rule_maps): avoid losing data when using `emqx_rule_maps:nested_put`	2023-07-14 15:02:24 -03:00
zhongwencool	0a35b7875f	Merge pull request #11269 from zhongwencool/fix-process-limit-hidden ... fix: hide node.process_limit completely	2023-07-14 22:32:41 +08:00
lafirest	f6834b33a0	Merge pull request #11266 from lafirest/fix/influxdb-ph ... fix(tdengine): fix SQL template errors	2023-07-14 22:29:16 +08:00
zhongwencool	f853f3d3bd	Merge pull request #11271 from zhongwencool/fix-precent-check ... fix: keep percentage type's range is 0%~100%	2023-07-14 22:07:41 +08:00
Thales Macedo Garitezi	f9452241bd	test(rules): add a few more tests to assert our rule evaluation behavior	2023-07-14 10:23:20 -03:00
Serge Tupchii	950d5edc41	fix: avoid logging unnecessary errors in async cleanup functions ... Cleanup functions that access ETS tables may fail with `badarg` error during EMQX shutdown. They are called asynchronously by `emqx_pool` workers and accessed ETS tables may be already destroyed as their owners are shut down. This fix catches ETS `badarg` errors before they can be caught and logged by `emqx_pool`. Fixes: EMQX-9992	2023-07-14 14:22:43 +03:00
firest	fea73cf17d	fix(log): fix the pubrel typo in the log	2023-07-14 17:19:50 +08:00
zhongwencool	11ee6abf02	fix: keep precent range is 0%~100%	2023-07-14 16:48:50 +08:00
zhongwencool	131511b10e	fix: hide process_limit completely	2023-07-14 11:04:20 +08:00
Thales Macedo Garitezi	01b143c5ad	fix(resource): don't destruct error tuple ... Otherwise, `emqx_resource:query` won't correctly deem the resource to be unhealthy when there's an extra message.	2023-07-13 16:12:33 -03:00
Thales Macedo Garitezi	0dff428efb	Merge pull request #11262 from thalesmg/fix-gcp-consumer-hc-20230712-master ... fix(gcp_pubsub_consumer): fail health check when there are no workers	2023-07-13 15:09:02 -03:00
Thales Macedo Garitezi	4034bcbb26	fix(rule_runtime): avoid rewriting select clause sources (by @keynslug) ... Thanks to @keynslug for the insight and the patch. With this, we avoid rewriting the parsed select clause sources, and attempt to reuse the result context when reading values during evaluation.	2023-07-13 14:46:08 -03:00
Thales Macedo Garitezi	924ed06760	Merge pull request #11256 from thalesmg/bridge-api-ecpool-400-errors-20230712-r51 ... fix(bridge_api): return 400 for all ecpool start errors	2023-07-13 10:05:07 -03:00
firest	749b8cd2ed	test(tdengine): cover multi-table insert && subtable name generation	2023-07-13 07:39:01 +00:00
firest	fef5087c41	fix(tdengine): fix SQL template errors ... 1. supports multi-table insert 2. supports constructing subtable names by mixed prefixes and placeholders	2023-07-13 04:44:48 +00:00
JimMoen	c23c3a1f78	fix: hstreamdb connector use unified schema	2023-07-13 10:47:45 +08:00
Thales Macedo Garitezi	06010f7ca9	Merge remote-tracking branch 'origin/release-51' into sync-r51-20230712	2023-07-12 16:47:45 -03:00
Thales Macedo Garitezi	be7918aa41	fix(gcp_pubsub_consumer): fail health check when there are no workers ... `ecpool` already returns an error even if the worker process is dead, but we add the empty worker list clause here just for completeness.	2023-07-12 16:31:21 -03:00
Thales Macedo Garitezi	bbff1d6ae9	fix(bridge_api): return 400 for all ecpool start errors ... Fixes https://emqx.atlassian.net/browse/EMQX-10460 (https://emqx.atlassian.net/browse/EMQX-10460?focusedCommentId=30126)	2023-07-12 15:32:34 -03:00
Thales Macedo Garitezi	bffef386c1	fix(rule_maps): avoid losing data when using emqx_rule_maps:nested_put ... Fixes https://emqx.atlassian.net/browse/EMQX-10541	2023-07-12 14:28:18 -03:00
Ivan Dyachkov	8ebe099653	Merge pull request #11253 from id/kjell/refactor/http_bridge/EMQX-9568 ... refactor: HTTP bridge into the emqx_bridge_http application	2023-07-12 15:58:02 +02:00
Ivan Dyachkov	6180e775f4	test: fix mocking and application start	2023-07-12 14:47:52 +02:00
Ivan Dyachkov	8815e58149	chore: remove docker-ct from emqx_bridge_http since toxiproxy is not used in CT	2023-07-12 14:47:46 +02:00
Ivan Dyachkov	45f94df7b1	fix: add ehttpc as emqx_bridge_http dependency	2023-07-12 14:47:39 +02:00
Thales Macedo Garitezi	c94dc2e63f	fix: add emqx_dashboard as a dependency of emqx_machine ... ``` ===> Compiling emqx_machine ===> Compiling src/user_default.erl failed src/user_default.erl:{24,14}: can't find include lib "emqx_dashboard/include/emqx_dashboard.hrl"; Make sure emqx_dashboard is in your app file's 'applications' list ==> emqx_mix ** (Mix) Could not compile dependency :emqx_machine, "/github/home/.mix/elixir/1-14/rebar3 bare compile --paths /__w/emqx/emqx/_build/emqx/lib/*/ebin" command failed. Errors may have been logged above. You can recompile this dependency with "mix deps.compile emqx_machine", update it with "mix deps.update emqx_machine" or clean it with "mix deps.clean emqx_machine" make: *** [Makefile:276: emqx-elixir] Error 1 ```	2023-07-12 14:47:28 +02:00
Kjell Winblad	6ce47614d2	refactor: HTTP bridge into the emqx_bridge_http app ... Fixes: https://emqx.atlassian.net/browse/EMQX-9568	2023-07-12 14:47:02 +02:00
Kjell Winblad	f28510b3ad	refactor: HTTP connector into emqx_bridge_http app	2023-07-12 14:46:43 +02:00
Thales Macedo Garitezi	541d03a0ba	refactor(schema_registry): refactor schema registry app and modules ... Fixes https://emqx.atlassian.net/browse/EMQX-10361 - Moves `lib-ee/emqx_ee_schema_registry` to `apps/emqx_schema_registry`. - Removes the `_ee_` segment from module names. - Exceptions are the table names which are kept to avoid backwards incompatibilities.	2023-07-12 09:24:15 -03:00
Serge Tupchii	cacfb51280	fix(emqx_machine): add emqx_ee_schema_registry to the reboot apps list ... As emqx_ee_schema_registry uses Mria tables (schema_registry_shard), a node joining a cluster needs to restart this application in order to restart relevant Mria shard processes.	2023-07-12 09:23:28 -03:00
zhongwencool	5b0695ca19	Merge pull request #11249 from zhongwencool/license-setting-api ... feat: add license setting get/put api	2023-07-12 18:34:23 +08:00
zhongwencool	f40d8318b7	fix: license validations is not working	2023-07-12 14:40:38 +08:00
SergeTupchiy	fce3060634	Merge pull request #11251 from SergeTupchiy/EMQX-10392-cluster-topology-api ... Add cluster topology HTTP API endpoint	2023-07-11 17:45:00 +03:00
Serge Tupchii	19de10be7c	feat(emqx_management): add /cluster/topology HTTP API endpoint ... The endpoint shows Mria RLOG cluster topology info: connections between core and replicant nodes. Closes: EMQX-10392	2023-07-11 16:25:36 +03:00
lafirest	903d81b532	Merge pull request #11250 from lafirest/fix/ws_order ... fix(ws): fix MQTT packets may be reversed in the WS	2023-07-11 20:09:55 +08:00
firest	211486a946	fix(ws): fix MQTT packets may be reversed in the WS ... Fix when a WS packet contains many MQTT packets, the order of MQTT packets will be reversed	2023-07-11 18:40:06 +08:00
JianBo He	e51a4ae81e	chore: avoid dialyzer warnings	2023-07-11 10:41:10 +08:00
JianBo He	15c91373fe	perf(http): improve the speed of clients querying in default parameters ... In https://github.com//emqx/emqx/pull/9749 we fixed the problem of incorrect total calculation. In this PR we added an option to improve the query speed when the query condition is empty	2023-07-11 10:41:10 +08:00
Andrew Mayorov	21fbf79c29	Merge pull request #11191 from keynslug/ft/EMQX-9591/msg-persistence-minimal ... feat(ds): hardwire emqx_durable_storage message persistence	2023-07-10 21:05:04 +02:00
Thales Macedo Garitezi	beb5be4de2	Merge pull request #11244 from thalesmg/ci-sorted-reboot-apps-check-master ... ci(machine_boot): add ci check for missing reboot apps	2023-07-10 15:56:10 -03:00
Thales Macedo Garitezi	a53768c1d4	fix(machine_boot): add emqx_durable_storage to reboot apps list	2023-07-10 14:39:44 -03:00
SergeTupchiy	721dbad300	Merge pull request #11242 from SergeTupchiy/add-schema_registry-app-to-reboot-list ... fix(emqx_machine): add emqx_ee_schema_registry to the reboot apps list	2023-07-10 20:17:59 +03:00
Andrew Mayorov	d91ab7dec9	test(ds): make emqx_persistent_messages_SUITE setup cleaner ... Co-authored-by: Thales Macedo Garitezi <thalesmg@gmail.com>	2023-07-10 18:12:16 +02:00
Ivan Dyachkov	fb96c1e20d	chore: bump to e5.1.1-alpha.1	2023-07-10 17:25:07 +02:00
Serge Tupchii	7f04fff2a8	fix(emqx_machine): add emqx_ee_schema_registry to the reboot apps list ... As emqx_ee_schema_registry uses Mria tables (schema_registry_shard), a node joining a cluster needs to restart this application in order to restart relevant Mria shard processes.	2023-07-10 18:04:22 +03:00
JianBo He	ae59a26659	Merge pull request #11223 from JimMoen/fix-influxdb-float-value-trans ... fix: influxdb float serialization error	2023-07-10 23:04:01 +08:00
Stefan Strigler	93a9772743	Merge pull request #11211 from sstrigler/EMQX-9963-refactor-all-http-ap-is-to-respond-404-on-the-deletion-of-the-resource-is-non-exist ... consistently return 404 if resource not found	2023-07-10 16:25:31 +02:00
Ilya Averyanov	58a83739b8	Merge pull request #10986 from savonarola/ft/EMQX-9523/config-api ... feat(ft-api): provide configuration API	2023-07-10 15:32:30 +03:00
Ilya Averyanov	12e237c36d	Merge pull request #11132 from savonarola/0531-authz-qos-retain ... feat(authz): use extensible map format for actions in authz rules	2023-07-10 15:32:02 +03:00
JimMoen	e30bc6afa8	test(influxdb): write raw as float for all number value	2023-07-10 20:00:09 +08:00
zhongwencool	f9e54ed8b1	Merge pull request #11237 from zhongwencool/prometheus-api-schema ... fix: bad prometheus schema for headers	2023-07-10 18:13:42 +08:00
Andrew Mayorov	576eab9717	Merge pull request #11193 from keynslug/fix/emqx-ft-test-flaps ... fix(ft-test): use new cth tooling in emqx_ft_storage_fs_SUITE	2023-07-10 11:55:16 +02:00
JianBo He	f144bb0571	Merge pull request #11226 from zhongwencool/listener-conf-enabled-to-enable ... fix: alias listeners.Type.Name.enabled as listeners.Type.Name.enable	2023-07-10 17:15:24 +08:00
zhongwencool	1b5d55cdbb	fix: delete bad link in emqx_prometheus	2023-07-10 16:48:13 +08:00
zhongwencool	0632d629cb	fix: bad prometheus schema for headers	2023-07-10 16:48:13 +08:00
JimMoen	e9f1d7f2bf	fix: influxdb float serialization error	2023-07-10 13:53:11 +08:00
zhongwencool	802a50601a	chore: add comment for init_loader_done	2023-07-10 12:03:36 +08:00
zhongwencool	c4ba558ee3	fix: unset config_loader in emqx's env when stop emqx app	2023-07-10 11:06:08 +08:00
zhongwencool	d661b10355	fix: emqx CI failed	2023-07-10 10:34:36 +08:00
zhongwencool	86d3984025	fix: mgmt api SUITE failed	2023-07-10 10:34:36 +08:00
zhongwencool	c0ee47dc08	chore: add changelog for 11226 pr	2023-07-10 10:34:36 +08:00
zhongwencool	d781346efc	fix: alias listeners.Type.Name.enabled as listeners.Type.Name.enable	2023-07-10 10:34:36 +08:00
Stefan Strigler	1110b5d8f5	fix(emqx_retainer): return 404 in delete if topic not found	2023-07-08 14:43:43 +02:00
Stefan Strigler	80e4ffff75	fix(emqx_management): return 404 if plugin does not exist	2023-07-08 14:43:43 +02:00
Stefan Strigler	3fd28f9e18	fix(emqx_management): return 404 for unknown listener id	2023-07-08 14:43:43 +02:00
Stefan Strigler	d65d690c17	fix(emqx_gateway): return 404 for unknown client id	2023-07-08 14:43:43 +02:00
Stefan Strigler	3bc419ee64	fix(emqx_gateway): return 404 for unknown listener id	2023-07-08 14:10:23 +02:00
Andrew Mayorov	8c883feb54	chore: bump emqx_durable_storage to 0.1.1	2023-07-07 21:56:21 +02:00
Andrew Mayorov	030beb3e6a	fix(ds): drop debug printouts in test suite	2023-07-07 21:56:20 +02:00
Andrew Mayorov	daf4e86da1	feat(ds): add ensure_shard/2 shortcut ... And use it in `emqx_persistent_session_ds:init()` backend initialization function.	2023-07-07 21:56:20 +02:00
Andrew Mayorov	ac56de9fc5	feat(ds): allow to redefine directory for shard's rocksdb	2023-07-07 21:56:20 +02:00
Ilya Averyanov	19f9fc5089	feat(authz): bump app versions	2023-07-07 19:41:34 +03:00
Ilya Averyanov	77895f2555	feat(authz): fix typos and style for Retain & QoS authz feature ... Co-authored-by: Thales Macedo Garitezi <thalesmg@gmail.com>	2023-07-07 19:40:34 +03:00
Ilya Averyanov	6db02d6b49	feat(authz): enable feature for both CE and EE	2023-07-07 19:40:34 +03:00
Ilya Averyanov	1ce6a225ae	feat(authz): add tests for authz extended actions	2023-07-07 19:40:34 +03:00
Ilya Averyanov	7de26a1776	feat(authz): use extensible map format for actions in authz rules ... * support authorization on retain, qos fields * refactored authz tests heavily	2023-07-07 19:40:34 +03:00
Ilya Averyanov	b568bda098	feat(ft-api): simplify config import test	2023-07-07 19:39:05 +03:00
Thales Macedo Garitezi	6337f52cf9	fix(plugins): start/stop plugins when loading config from CLI ... Fixes https://emqx.atlassian.net/browse/EMQX-10288	2023-07-07 13:37:51 -03:00
Ilya Averyanov	56c81c2c25	feat(ft-api): bump app versions	2023-07-07 19:17:22 +03:00
Ilya Averyanov	e0353ab750	fix(ft-api): update FT API tests to use emqx_cth_suite	2023-07-07 19:15:42 +03:00
Ilya Averyanov	fde506838a	fix(ft-api): implement import config behaviour	2023-07-07 19:15:42 +03:00
Ilya Averyanov	fe691e8330	fix(ft-api): fix swagger schema dump for ft schema	2023-07-07 19:15:42 +03:00
Ilya Averyanov	a2eb658cd9	feat(ft-api): do cleanup certs explicitly	2023-07-07 19:15:42 +03:00
Andrew Mayorov	a2b03716be	feat(ft-api): provide configuration API ... To configure `emqx_ft` during the runtime.	2023-07-07 19:15:42 +03:00
Andrew Mayorov	34793c5ed0	feat(ft-conf): preprocess TLS configuration on updates ... Specifically, reify keys and certificates into files in the file system and update the configuration to point to those files.	2023-07-07 19:15:42 +03:00
Andrew Mayorov	27ab9c62d8	fix(ft): unload conf hooks in prep_stop ... In order to avoid situations when the root supervisor is stopped already.	2023-07-07 19:15:42 +03:00
Ilya Averyanov	aba52c6a25	chore(rebalance test): fix API tests	2023-07-07 18:04:32 +03:00
Ilya Averyanov	9bb159cf1e	fix(rebalance): fix changelog and version	2023-07-07 18:04:11 +03:00
zhongwencool	5b1c265485	Merge pull request #11224 from zhongwencool/fix-psk-conf-load ... fix: psk_authentication is updated failed	2023-07-07 21:27:49 +08:00
Ilya Averyanov	a6019a2846	Merge pull request #11198 from savonarola/0705-fix-rebalance-swagger ... fix(rebalance): fix rebalance swagger examples	2023-07-07 15:55:16 +03:00
lafirest	70bd7a59e4	Merge pull request #11225 from lafirest/fix/pgsql_function_clause ... fix(bridge): ensure the username of pgsql must exists	2023-07-07 20:39:07 +08:00
zhongwencool	8b80a2f754	Merge pull request #11192 from zhongwencool/bump-hocon-to-0.39.13 ... chore: update hocon to 0.39.13	2023-07-07 20:02:46 +08:00
zhongwencool	0ef00d5919	fix: psk_authentication is updated failed	2023-07-07 20:02:06 +08:00
Andrew Mayorov	97b6c43062	fix(ft-test): use new cth tooling in emqx_ft_storage_fs_SUITE ... In attempt to battle test flakiness.	2023-07-07 14:00:33 +02:00
Andrew Mayorov	7e76914599	feat(ds): hardwire emqx_durable_storage message persistence ... Only message persistence is currently implemented, irrespectively of whether there are persistent sessions around or not.	2023-07-07 13:46:12 +02:00
firest	d01eee7fe4	chore: update changes && app version	2023-07-07 18:22:54 +08:00
firest	8cee75139d	fix(bridge): ensure the username of pgsql must exists	2023-07-07 18:06:28 +08:00
Stefan Strigler	055a1e8d75	Merge pull request #11210 from sstrigler/EMQX-9569-provide-the-ce-ee-version-info-and-the-current-version-number-in-the-info-field ... feat(emqx_dashboard): include edition and version in swagger.json info	2023-07-07 11:55:44 +02:00
zhongwencool	b5cc8fb3c3	fix: start_after_created's default value	2023-07-07 16:39:26 +08:00
zhongwencool	352d818e3b	chore: update hocon to 0.39.13	2023-07-07 16:39:26 +08:00
JimMoen	88fd8d0582	Merge pull request #11219 from JimMoen/fix-hstreamdb-deps-app ... chore: hstreamdb_erl as deps for hstreamdb bridge	2023-07-07 16:39:12 +08:00
JianBo He	2f33fd9bac	Merge pull request #11208 from HJianBo/update-lwm2m-stats ... fix(lwm2m): update the stats correctly and timely	2023-07-07 15:32:50 +08:00
JianBo He	daa6cf14fe	Merge pull request #11206 from HJianBo/coap-bugs ... Fix(coap): Make the username and password params to optional	2023-07-07 15:32:00 +08:00
zhongwencool	ab07fd0547	Merge pull request #11214 from zhongwencool/fix-cluster-rpc-call-tnx-id ... fix: bad tnx-id when rejoin cluster	2023-07-07 15:08:06 +08:00
JimMoen	63c6427037	chore: hstreamdb_erl as deps for hstreamdb bridge	2023-07-07 14:50:44 +08:00
JimMoen	30c931ae62	fix: pulsar flaky cluster tests	2023-07-07 12:25:37 +08:00
JimMoen	4ee44972b2	feat: refactor hstreamdb connector to to avoid resources leaking	2023-07-07 12:25:37 +08:00
JimMoen	b089fba100	refactor: rm ee_bridge and ee_connector application	2023-07-07 12:25:37 +08:00
JimMoen	583ccfaafd	test(hstreamdb): create stream and wirte data	2023-07-07 12:25:36 +08:00
JimMoen	1587f038a5	feat: hstreamdb bridge with batch query	2023-07-07 12:25:36 +08:00
JimMoen	b9bfdfd583	chore: compatibility with hstreamdb v0.15.0	2023-07-07 12:25:36 +08:00
JimMoen	d31a305bcb	refactor(hstreamdb): HStreamDB bridge to its own application	2023-07-07 12:25:36 +08:00
zhongwencool	f7513b900a	fix: set load config done after update tnx_id	2023-07-07 12:25:34 +08:00
zhongwencool	9f57ba510e	chore: add 11214 changelog	2023-07-07 12:25:34 +08:00
zhongwencool	221f6eba06	fix: bad tnx-id when rejoin cluster	2023-07-07 12:25:34 +08:00
JianBo He	d3d2c8a532	chore(lwm2m): bump version	2023-07-07 12:24:31 +08:00
JianBo He	31a240ba63	fix(lwm2m): update the stats correctly and timely	2023-07-07 12:24:31 +08:00
JianBo He	791b8ef671	chore: bump versions	2023-07-07 12:23:57 +08:00
JianBo He	6d2222318d	chore(coap): update the subscriptions_cnt stats in time	2023-07-07 12:23:57 +08:00
JianBo He	800b154582	test(coap): cover the params optional logic to create connection	2023-07-07 12:23:57 +08:00
JianBo He	5c901a52bd	fix(coap): make username/password optinal in connection	2023-07-07 12:23:57 +08:00
JianBo He	ab809c8b85	Merge pull request #11207 from lafirest/feat/keep_obfuscated ... feat: ensure data backends don't leak sensitive data	2023-07-07 12:22:11 +08:00
JianBo He	b11fa5f3bf	Merge pull request #11195 from HJianBo/stomp-topic-id-unique ... Fix(stomp): avoid to create duplicated subscription by HTTP or Client	2023-07-07 11:18:30 +08:00
firest	a1d2b2ca51	chore: bump app versions	2023-07-07 11:17:54 +08:00
firest	18dec53d8b	feat: ensure data backends don't leak sensitive data	2023-07-07 11:04:13 +08:00
JianBo He	05048dbf93	Merge pull request #11204 from HJianBo/avoid-case-clause ... Allow the `*/*` or multiple `Accept` values in header for the `/configs` API	2023-07-07 09:46:28 +08:00
Stefan Strigler	8faaa86c07	chore: bump vsn for emqx and emqx_bridge	2023-07-06 14:26:11 +02:00
Stefan Strigler	22b25fbbb3	feat(emqx_dashboard): include edition and version in swagger.json info	2023-07-06 14:14:21 +02:00
Thales Macedo Garitezi	353cc065db	Merge pull request #11175 from thalesmg/fix-mysql-start-error ... fix(mysql_bridge): make nxdomain a 400 API error	2023-07-06 08:26:12 -03:00
Stefan Strigler	9bcabe0a9e	Merge pull request #11184 from sstrigler/EMQX-10270-e-5-1-0-missing-value-range-validation-for-the-max-packet-size-of-mqtt-settings ... fix: limit mqtt max_packet_size to 256MB	2023-07-06 10:20:24 +02:00
JianBo He	71d1f80530	test(api): cover the accept logic for /configs API	2023-07-06 11:30:38 +08:00
JianBo He	966b2affc2	chore: allow handle */* or multiple values in Accept headers	2023-07-06 10:53:07 +08:00
SergeTupchiy	1a79e34510	Merge pull request #11202 from SergeTupchiy/fix-rule-type-acl-conf ... chore(emqx_authz): fix `rule()` type example	2023-07-05 21:02:36 +03:00
Serge Tupchii	4dfd3421e7	chore(emqx_authz): fix rule() type example ... Use `action()` type which is a correct and defined type.	2023-07-05 20:24:26 +03:00
Ilya Averyanov	9af0030538	chore: bump to v5.1.1	2023-07-05 18:43:45 +03:00
Ilya Averyanov	f174cb656c	fix(rebalance): fix swagger examples in api-doc	2023-07-05 15:38:41 +03:00
Ilya Averyanov	dca6fe6200	fix(rebalance): fix global status evaluation on replicant nodes	2023-07-05 12:48:44 +03:00
JianBo He	aaf015c06f	test(stomp): cover subscription in use	2023-07-05 15:22:44 +08:00
lafirest	bf5167a8bf	Merge pull request #11172 from lafirest/fix/dup_payload ... fix(ruleengine): fix duplicate `payload` problems	2023-07-05 14:20:26 +08:00
JianBo He	0483c6afef	fix(stomp): not allow to create same subscriptions	2023-07-05 14:13:25 +08:00
Stefan Strigler	263890be47	fix: limit mqtt max_packet_size to 256MB	2023-07-04 16:03:11 +02:00
Andrew Mayorov	8cc7022760	Merge pull request #11120 from ft/EMQX-10329/tooling ... test: add tooling to make testruns more isolated and predictable	2023-07-04 14:36:39 +02:00
Ilya Averyanov	0bd0a16693	Merge pull request #11039 from savonarola/0613-fix-redis-db-schema ... fix(redis): validate database number	2023-07-04 15:32:02 +03:00
zhongwencool	f2c5f4932c	Merge pull request #11148 from lafirest/fix/mcall_error_report ... fix(emqx_conf): don't sync the MFA to a leaved node	2023-07-04 19:56:52 +08:00
Andrew Mayorov	9ed75085b7	chore: drop dead commented out code	2023-07-04 13:20:04 +02:00
Andrew Mayorov	c7ba300efc	fix(cthsuite): use correct type for "smth serializable as HOCON"	2023-07-04 13:20:04 +02:00
Andrew Mayorov	d568d43fe4	test(bridge): switch emqx_bridge_api_SUITE to use new tooling	2023-07-04 13:20:03 +02:00
Andrew Mayorov	fc709a14cc	test: switch emqx_authz_file_SUITE to use new tooling	2023-07-04 13:20:03 +02:00
Andrew Mayorov	2c50e61cee	fix(cth): reduce amount of logging + streamline logging ... Also make sure that code running on `emqx_cth_cluster` nodes don't crash when using `ct:pal` and friends.	2023-07-04 13:20:03 +02:00
Andrew Mayorov	9bda4192e5	fix(cthsuite): disable default acl.conf authz source ... So that users of `emqx_cth_suite` won't have to deal with providing correct filepath each time they start `emqx_conf` and/or `emqx_authz` up.	2023-07-04 13:20:03 +02:00
Andrew Mayorov	24a16ea247	fix(cthsuite): bump to hocon 0.39.11 with atom prettyprint fix	2023-07-04 13:20:03 +02:00
Andrew Mayorov	6a7254f55e	fix(cthcluster): match correct driver in stop_node/2 ... Co-authored-by: Ilya Averyanov <av@rubybox.dev>	2023-07-04 13:20:02 +02:00
Andrew Mayorov	fe0b8cfbaf	test(conf): respect init_config_load_done in emqx_conf itself ... This should make task of configuring various applications (emqx_conf / emqx) during testsuites setup much simpler.	2023-07-04 13:20:02 +02:00
Andrew Mayorov	f76f3b77d7	test: add tooling to make testruns more isolated and predictable ... Also showcase their usage in some of the existing testsuites.	2023-07-04 12:53:39 +02:00
firest	afabdc3440	fix(emqx_conf): call clean callback before ekka stop	2023-07-04 18:04:33 +08:00
zhongwencool	d509c47344	feat: add conf load api	2023-07-04 14:17:11 +08:00
Kjell Winblad	33cb29efdb	Merge pull request #11169 from kjellwinblad/kjell/improved_sparkplugb/EMQX-10351 ... feat: add Sparkplug encode and decode functions to the rule engine	2023-07-04 07:24:06 +02:00
Ilya Averyanov	9701c3f7a1	fix(redis): validate database number	2023-07-03 22:44:54 +03:00
Andrew Mayorov	a127fd6571	Merge pull request #11183 from keynslug/perf/EMQX-9591/routing ... perf(broker): avoid usorting aggregated routes in a loop	2023-07-03 19:16:25 +02:00
Thales Macedo Garitezi	2cc0ba1217	Merge pull request #11174 from thalesmg/make-rule-server-a-binary ... fix(mqtt_bridge): ensure `server` key is a binary	2023-07-03 10:38:39 -03:00
Thales Macedo Garitezi	59d71a1147	Merge pull request #11173 from thalesmg/fix-flaky-gcp-consu-test ... test(gcp_consumer): attempts to reduce flakiness	2023-07-03 10:04:31 -03:00
Andrew Mayorov	0f25df3aa8	perf(router): employ maps:foreach/2 instead	2023-07-03 15:01:47 +02:00
Andrew Mayorov	57da71eb1d	perf(broker): avoid usorting aggregated routes in a loop	2023-07-03 15:01:33 +02:00
firest	902603780b	test(ruleengine): add test for the fix of duplicate payload	2023-07-03 18:22:35 +08:00
firest	bd4f207365	fix(ruleengine): fix duplicate payload problems	2023-07-03 14:21:56 +08:00
Thales Macedo Garitezi	c216dfd96b	fix(mysql_bridge): make nxdomain a 400 API error ... Fixes https://emqx.atlassian.net/browse/EMQX-10460	2023-06-30 16:10:09 -03:00
Stefan Strigler	07cf250093	Merge pull request #11126 from sstrigler/EMQX-8842-fix-rule-metrics ... fix(emqx_rule_engine): set inc_action_metrics as async_reply_fun	2023-06-30 20:07:23 +02:00
Thales Macedo Garitezi	425eba8b13	fix(mqtt_bridge): ensure server key is a binary ... Fixes https://emqx.atlassian.net/browse/EMQX-10461 So that it can be JSON encoded correctly. ``` 2023-06-30T02:00:41.160110+00:00 [debug] msg: publish_to, mfa: emqx_trace:publish/1, line: 73, topic: b/$, payload: {"topic":"t/1","server":[49,48,46,52,50,46,51,46,49,56,48,58,49,56,56,51],"retain":false,"qos":1,"pub_props":{},"payload":"{\"msg\": \"hello\"}","message_received_at":1688090441159,"id":"0005FF4F2F181488103417000C2E0000","dup":false}, tag: PUBLISH ```	2023-06-30 13:46:24 -03:00
Thales Macedo Garitezi	6fe6aa7997	Merge pull request #11162 from thalesmg/treat-404-as-failure-master ... fix(webhook): treat 404 and other error replies as errors in async requests	2023-06-30 13:13:18 -03:00
Thales Macedo Garitezi	7cf1dd7e86	Merge pull request #11163 from thalesmg/fix-rm-mongo-topology-pool-size ... fix(mongodb): hide `topology.pool_size` and fix it at 1	2023-06-30 13:13:02 -03:00
Thales Macedo Garitezi	0201481c70	Merge pull request #11164 from thalesmg/fix-placeholder-sql-nested ... fix(placeholder): add back support for nested keys inside binary encoded json	2023-06-30 13:12:51 -03:00
Thales Macedo Garitezi	1a058f6890	test(gcp_consumer): attempts to reduce flakiness	2023-06-30 12:49:23 -03:00
Kjell Winblad	714363bd01	fix: decouple emqx_rule_engine application from emqx_ee_schema_registry ... This commit decouples the emqx_rule_engine application from the emqx_ee_schema_registry application by making it possible to register a callback module that defines extra rule engine SQL functions instead of calling a module in emqx_ee_schema_registry directly from the emqx_rule_engine application.	2023-06-30 16:56:16 +02:00
Ilya Averyanov	724efcb557	Merge pull request #11168 from savonarola/0630-fix-rebalance-schema ... Specify correct response schema for global rebalance status	2023-06-30 17:00:35 +03:00
Thales Macedo Garitezi	3c8f591cc4	fix(mongodb): hide topology.pool_size and fix it at 1 ... Fixes https://emqx.atlassian.net/browse/EMQX-10408 From an old conversation with @kjellwinblad: > There are 3 pool_sizes > - The buffer workers pool size, just exposed here: https://github.com/emqx/emqx/pull/9742 > - The topology.pool_size, which controls the pool size for the poolboy_pool in Kjell's diagram (on mongodb's side). > - The pool_size from emqx_connector_mongo:mongo_fields that controls the ecpool pool size (on EMQX's side). > So we actually want to set topology.pool_size = 1 and hide it from users.	2023-06-30 10:17:33 -03:00
Thales Macedo Garitezi	631f4ceac9	fix(placeholder): add back support for nested keys inside binary encoded json ... Fixes https://emqx.atlassian.net/browse/EMQX-10459	2023-06-30 10:05:49 -03:00
Thales Macedo Garitezi	ca435975de	fix(webhook): treat http status code 429 as recoverable	2023-06-30 09:46:03 -03:00
lafirest	1ea92d4009	Merge pull request #11166 from lafirest/feat/porti_uuid_el_v4 ... feat(ruleengine): port random && uuid_v4 functions from v4	2023-06-30 18:36:45 +08:00
zhongwencool	c8d1bd3bd5	Merge pull request #11138 from zhongwencool/cluster-conf-k8s-default ... fix: update cluster.conf's k8s default api_server value	2023-06-30 17:01:52 +08:00
Kjell Winblad	039e27a153	feat: add Sparkplug encode and decode functions to the rule engine ... Fixes: https://emqx.atlassian.net/browse/EMQX-10429	2023-06-30 10:06:56 +02:00
Ilya Averyanov	b5c0951584	fix(rebalance): specify correct response schema for global rebalance status	2023-06-30 10:53:08 +03:00
firest	872698d19e	feat(ruleengine): port random && uuid_v4 functions from v4	2023-06-30 14:38:27 +08:00
zhongwencool	bb1ae808b4	Merge pull request #11165 from zhongwencool/hide-global-limiter-from-swagger-api ... chore: hide /configs/limiter from swagger api doc	2023-06-30 11:54:01 +08:00
zhongwencool	3eefa1b2a3	chore: hide /configs/limiter from swagger api doc	2023-06-30 10:59:18 +08:00
zhongwencool	8b679cf358	Merge pull request #11137 from zhongwencool/dashboard-https-ssl-options ... feat: refactor dashboard https ssl_options	2023-06-30 09:57:07 +08:00
zhongwencool	bd83365d45	fix: update cluster.conf's k8s default api_server value	2023-06-30 09:55:36 +08:00
Thales Macedo Garitezi	59b109eb5c	fix(webhook): treat 404 and other error replies as errors in async requests ... Fixes https://emqx.atlassian.net/browse/EMQX-10405 The problem here was that, for async requests, ehttpc responses of the form `{ok, 4__, _, _}` and similar were being treated as successes.	2023-06-29 15:45:23 -03:00
Thales Macedo Garitezi	4506eff3ff	Merge pull request #11140 from thalesmg/gcp-consumer-tests ... test(gcp_pubsub_consumer): add more tests and improve bridge	2023-06-29 13:02:47 -03:00
Stefan Strigler	14da61194e	fix: handle resource errors	2023-06-29 16:09:45 +02:00
Stefan Strigler	321fd53132	fix: use ReplyTo in QUERY for async	2023-06-29 16:09:45 +02:00
Stefan Strigler	d71d70c889	fix: allow to pass in Opts rather than just a ReplyTo	2023-06-29 16:09:45 +02:00
Stefan Strigler	40dd34a704	fix: use reply_to instead of async_reply_fun	2023-06-29 16:09:45 +02:00
Stefan Strigler	1363108678	fix: fix simple_sync_query	2023-06-29 16:09:45 +02:00
Stefan Strigler	422c79583a	test(emqx_rule_engine): fix simple sync	2023-06-29 16:09:45 +02:00
Stefan Strigler	837acd4234	test(emqx_rule_engine): test rule metrics	2023-06-29 16:09:45 +02:00
Stefan Strigler	2274a192cc	fix(emqx_resource): call async reply fun in simple_aysnc_query	2023-06-29 16:09:45 +02:00
Stefan Strigler	ae636a52d7	fix(emqx_rule_engine): set inc_action_metrics as async_reply_fun	2023-06-29 16:09:45 +02:00
lafirest	9708a02680	Merge pull request #11134 from lafirest/fix/auth_header_sensitive ... fix: mask the value of the authorization header whatever its case	2023-06-29 21:43:16 +08:00
ieQu1	f2074e9c9b	Merge pull request #11143 from ieQu1/master ... docs(ds): Update IMPLEMENTATION.md	2023-06-29 11:14:55 +02:00
lafirest	be1a4c89a5	Merge pull request #11158 from lafirest/fix/wait_table_in_retainer ... fix(emqx_retainer): wait for Mria tables	2023-06-29 16:01:54 +08:00
firest	31e914f6a2	fix(emqx_utils): improve the checking for the authorization key	2023-06-29 15:57:48 +08:00
firest	6fedd0328f	fix(retainer): Fix missing changes in configuration	2023-06-29 14:06:17 +08:00
firest	1202bef6db	fix(emqx_retainer): wait for Mria tables	2023-06-29 03:16:05 +00:00
zhongwencool	9dae408b5a	Merge pull request #11142 from zhongwencool/list-listener-group-with-wrong-bind ... List listener group with wrong bind	2023-06-29 11:04:35 +08:00
zhongwencool	73487ecdd5	chore: add desc for ssl_options	2023-06-29 10:49:39 +08:00
zhongwencool	82ea9e5a04	test: dashbaord api ct failed	2023-06-29 10:49:39 +08:00
zhongwencool	e26c30ff0c	feat: refactor dashboard https ssl_options	2023-06-29 10:49:39 +08:00
firest	71d34504bf	fix(cluster_rpc): clean self-data by mria stop callback	2023-06-29 01:45:47 +00:00
firest	8e68af14ef	chore: bump ekka version	2023-06-29 01:45:47 +00:00
firest	51ec8cb8fa	fix(emqx_conf): don't sync the MFA to a leaved node	2023-06-29 01:45:47 +00:00
Thales Macedo Garitezi	30e0b4be54	test(gcp_pubsub_consumer): add more tests and improve bridge ... Fixes https://emqx.atlassian.net/browse/EMQX-10309	2023-06-28 14:08:40 -03:00
Kjell Winblad	f9ea924cd0	Merge pull request #11151 from kjellwinblad/kjell/refactor/mysql_bridge/EMQX-9533 ... refactor: MySQL bridge and connector to separate applications	2023-06-28 15:15:55 +02:00
ieQu1	940ad12108	docs(ds): Apply suggestions from code review ... Co-authored-by: Thales Macedo Garitezi <thalesmg@gmail.com>	2023-06-28 10:04:07 +02:00
Kjell Winblad	6d6287ef26	test: start emqx_mongodb when running the MongoDB tests	2023-06-28 08:03:41 +02:00
SergeTupchiy	9cf874e37e	Merge pull request #11150 from SergeTupchiy/wait-for-emqx_psk_tab ... fix(emqx_psk): wait for Mria table on app start	2023-06-28 08:57:32 +03:00
zhongwencool	30b67add05	chore: add more example for clients api	2023-06-28 10:55:55 +08:00
zhongwencool	93cbb5ebd8	fix: show the local listener's settings first	2023-06-28 10:55:55 +08:00
zhongwencool	d556adf86c	Merge pull request #11146 from zhongwencool/hide-node-process-limit ... feat: hide node.process_limit	2023-06-28 10:45:37 +08:00
Thales Macedo Garitezi	c4fc0e767e	feat: allow specifying more helpful messages for unhealthy targets	2023-06-27 17:13:43 -03:00
Serge Tupchii	8e877caf47	fix(emqx_psk): wait for Mria table on app start ... This ensures emqx_psk table is synced to a replicant even if it doesn't have init psk file.	2023-06-27 20:22:40 +03:00
Andrew Mayorov	30d78aaac2	Merge pull request #11152 from keynslug/test/ft-prop-aggressive ... test(ft): make proptests even less aggressive	2023-06-27 17:44:54 +02:00
Andrew Mayorov	7d171de02b	test(ft): make proptests even less aggressive	2023-06-27 17:17:56 +02:00
Kjell Winblad	3d1712c00c	refactor: MySQL bridge to its own application ... This commit refactor the MySQL bridge to its own application. Fixes: https://emqx.atlassian.net/browse/EMQX-9533	2023-06-27 17:13:26 +02:00
Andrew Mayorov	ff327609db	test(ft): generate segments manually in proptests ... In order to avoid spamming proptest logs with HUGE type instances, and make proptests themselves simpler. Proper now should refuse shrinking altogether, instances that cause prop function to timeout do not shrink well for some reason, making proptests stuck.	2023-06-27 17:13:23 +02:00
Kjell Winblad	85a130f68b	refactor: move MySQL open source connector to its own app	2023-06-27 16:15:18 +02:00
Zaiming (Stone) Shi	4ed422cb9a	Merge pull request #11127 from zmstone/0622-refine-examples ... 0622 refine examples	2023-06-27 15:30:30 +02:00
Andrew Mayorov	0e55aeada5	Merge pull request #11147 from keynslug/test/ft-timetrap ... test(ft): set safer suite-wide timetraps in cluster-related suites	2023-06-27 15:11:14 +02:00
Kjell Winblad	d3a0b3e183	Merge pull request #11139 from kjellwinblad/kjell/refactor/redis/EMQX-9534 ... refactor: redis bridge to its own application	2023-06-27 14:55:55 +02:00
Zaiming (Stone) Shi	90c35c3ff8	chore(prometheus): change default vaue enum the first symbol	2023-06-27 14:23:18 +02:00
Zaiming (Stone) Shi	9b6ed09513	refactor: call hocon_tconf:check_plain/4 directly for example conf check ... the attemp to re-use emqx_hocon:check failed because hocon_tconf:check_plain/3 and check_plain/4 behaves slightly different for unknown root fields. To keep the old logic unchanged, for example config checks, we call check_plain/4 directly	2023-06-27 14:23:18 +02:00
Zaiming (Stone) Shi	92ed7d7639	docs: move some prometheus docs from schema desc to code comments	2023-06-27 14:23:18 +02:00
Zaiming (Stone) Shi	41de679557	ci: run example config check in ci	2023-06-27 14:23:18 +02:00
Zaiming (Stone) Shi	a069b351fd	test: add test script to verify config example files	2023-06-27 14:23:18 +02:00
Zaiming (Stone) Shi	03d05825db	docs: hide core_nodes config doc ... core_nodes config is no longer required.	2023-06-27 14:23:18 +02:00
Zaiming (Stone) Shi	e0d05a02ff	refactor: refine examples ... Also turns off vm_dist_collector metrics collector by default	2023-06-27 14:23:18 +02:00
Andrew Mayorov	31e08a6046	test(ft): set safer suite-wide timetraps in cluster-related suites	2023-06-27 13:03:19 +02:00
Serge Tupchii	116675e86f	chore: bump ekka to 0.15.4	2023-06-27 13:24:49 +03:00
zhongwencool	b4ae4260c0	feat: hide node.process_limit	2023-06-27 18:09:26 +08:00
ieQu1	e0c11f54aa	docs(ds): Update IMPLEMENTATION.md	2023-06-27 10:53:38 +02:00
Kjell Winblad	a7db85c1e6	style: fix code style issue	2023-06-27 10:52:24 +02:00
Kjell Winblad	f99ccd4d76	fix: fix issues found in review by @paulozulato and @thalesmg	2023-06-27 10:49:19 +02:00
Kjell Winblad	e76daa0f3b	refactor: redis bridge to its own application ... This commit refactor the redis bridge to its own application. Fixes: https://emqx.atlassian.net/browse/EMQX-9534	2023-06-27 10:24:44 +02:00
Kjell Winblad	dd6aa96c99	refactor: move Redis open source connector to its own app	2023-06-27 10:24:40 +02:00
Kjell Winblad	36b7aef04c	chore: bump versions	2023-06-26 14:35:29 +02:00
Kjell Winblad	a91a478d42	build: fix order in mix.exs list due to CI script	2023-06-26 14:32:59 +02:00
Kjell Winblad	a65d768873	style: fix format issues	2023-06-26 14:32:59 +02:00
Kjell Winblad	fa2c2a300a	refactor: rename emqx_connector_mongo to emqx_mongodb ... This renaming is consistent with the naming in the only other connector only application emqx_oracle.	2023-06-26 14:32:59 +02:00
Kjell Winblad	b78a75bb5c	refactor: the MongoDB connector into its own application	2023-06-26 14:32:59 +02:00
Kjell Winblad	e3199ef813	refactor: MongoDB bridge to use the new app structure	2023-06-26 14:32:53 +02:00
lafirest	f2e3446e29	Merge pull request #11135 from lafirest/pref/calendar_timeoffset ... perf(rule_engine): improve the time offset parser	2023-06-26 18:54:00 +08:00
lafirest	850d642ec2	Merge pull request #11108 from ieQu1/emqx-ds ... Durable storage	2023-06-25 11:36:34 +08:00
firest	c8c2793944	perf(rule_engine): improve the time offset parser	2023-06-24 13:05:27 +00:00
firest	d485f8fe96	fix: mask the value of the authorization header whatever its case	2023-06-24 09:20:26 +00:00
firest	60a1f5a38d	chore: update app version && changes	2023-06-23 17:01:22 +00:00
firest	6bb8bf58ea	fix(retainer): rename deliver_rate to delivery_rate	2023-06-23 16:51:19 +00:00
Serge Tupchii	639fe276e1	chore(emqx_authz): fix ipaddrs type and style in etc/acl.conf	2023-06-23 14:53:26 +03:00
ieQu1	9a81f22105	fix(ds): Apply review remarks	2023-06-22 17:07:30 +02:00
Paulo Zulato	f4f068faaa	Merge pull request #11079 from paulozulato/feat-kafka-headers ... feat(kafka): add support for kafka headers and ext headers	2023-06-22 12:04:32 -03:00
Thales Macedo Garitezi	22356b7c25	chore: hide gcp pubsub consumer until e5.2.0	2023-06-22 10:05:52 -03:00
Thales Macedo Garitezi	f01de238b2	chore: bump app vsns	2023-06-22 10:01:12 -03:00
Thales Macedo Garitezi	2f00cf7f84	Merge pull request #11107 from thalesmg/fix-mongo-health-check-reason-master ... fix(mongo): return health check failure reason	2023-06-22 09:30:34 -03:00
Thales Macedo Garitezi	7ef03d9e1f	Merge pull request #11090 from thalesmg/gcp-pubsub-consumer ... feat(gcp_pubsub_consumer): implement GCP PubSub Consumer bridge	2023-06-22 09:17:45 -03:00
Zaiming (Stone) Shi	75eb18bc81	chore: bump app vsns	2023-06-22 11:09:09 +02:00
ieQu1	cfcd81e17b	fix(ds): Fix build	2023-06-22 11:07:52 +02:00
Zaiming (Stone) Shi	c58a98954b	Merge remote-tracking branch 'origin/master' into 0621-merge-release-51-to-master	2023-06-22 11:05:51 +02:00
ieQu1	b29c5ad23c	feat(emqx_ds): Add API draft for logic layer	2023-06-22 10:20:18 +02:00
ieQu1	a343cdb1d5	refactor(ds): message_storage -> message_storage_bitmask	2023-06-22 10:20:18 +02:00
ieQu1	a4219db163	refactor(ds): emqx_ds_local_store -> emqx_ds_storage_layer	2023-06-22 10:20:18 +02:00
ieQu1	1159f99432	refactor(ds): emqx_replay -> emqx_ds	2023-06-22 10:20:18 +02:00
ieQu1	8d6bcc1414	refactor(ds): emqx_replay -> emqx_durable_storage	2023-06-22 10:20:18 +02:00
ieQu1	c4f721f214	chore(ds): Add callback definitions to local_store	2023-06-22 10:20:18 +02:00
ieQu1	efed7cdc2f	chore(ds): behavior -> behaviour	2023-06-22 10:20:18 +02:00
ieQu1	0f6c81e42d	chore(ds): Change license to BSL	2023-06-22 10:20:18 +02:00
ieQu1	04adb65c09	refactor(ds): zone -> shard ... Also bump erlang-rocksdb version	2023-06-22 10:20:18 +02:00
Andrew Mayorov	8ac0bba958	test(ds): verify preserve / restore works with stored iterators	2023-06-22 10:20:18 +02:00
Andrew Mayorov	d2065e0c1b	feat(ds): allow to preserve / restore iterators in the db ... So that we could guarantee replay consistency / availability under the assumption that nodes may be restarted or even lost occasionally.	2023-06-22 10:20:18 +02:00
Andrew Mayorov	cbded9af39	feat(ds): Make create_generation safer against bad input	2023-06-22 10:20:18 +02:00
Andrew Mayorov	83d1606d00	feat(ds): Make iteration fully generation-aware	2023-06-22 10:20:18 +02:00
Andrew Mayorov	bf9d57f6a9	chore(ds): Simplify iteration-related typespecs	2023-06-22 10:20:18 +02:00
Andrew Mayorov	cf6a5e1643	feat(ds): Allow to create new storage generations	2023-06-22 10:20:18 +02:00
Andrew Mayorov	f80e906553	fix(ds): Correct typespec	2023-06-22 10:20:18 +02:00
Andrew Mayorov	f5a7b49f57	feat(ds): Wire iteration options up to the app config	2023-06-22 10:20:18 +02:00
Andrew Mayorov	2bf8a07b05	test(ds): Split unit tests off into a full-fledged suite	2023-06-22 10:20:18 +02:00
Andrew Mayorov	cf70184ebd	test(ds): Provide more general keymapper_info/1	2023-06-22 10:20:18 +02:00
Andrew Mayorov	2f385022cd	chore(ds): Rename testsuite to reflect test subject better	2023-06-22 10:20:18 +02:00
Andrew Mayorov	d875fa49d3	feat(ds): Enable periodic iterator refresh ... This might be helpful during replays taking multiple tens of seconds so that underlying iterators won't hold onto in-memory / on-disk data structures for too long, preventing rocksdb from recycling them.	2023-06-22 10:20:18 +02:00
Andrew Mayorov	7f408da251	refactor(ds): Use inline functions instead of macros	2023-06-22 10:20:07 +02:00
Andrew Mayorov	a11e75d189	fix(ds): clear bitmask of topic filter tail containing wildcards	2023-06-22 10:16:55 +02:00
Andrew Mayorov	ac0935ef91	test(ds): Proptest that iteration is exhaustive ... Compare iteration results against what an extremely simplified model produces.	2023-06-22 10:16:45 +02:00
Andrew Mayorov	60e3070328	test(ds): Scale up number of messages per topic in proptests	2023-06-22 10:16:41 +02:00
Andrew Mayorov	82a7292851	test(ds): Use _build/test/proper as a scratch dir for testruns	2023-06-22 10:16:32 +02:00
Andrew Mayorov	440fecd268	test(ds): Add a proptest on iterator preserve / restore ... Which verifies that preservation and restoration of iterators does not affect the outcome of an iteration (under the precondition that the state of database is constant during an iteration).	2023-06-22 10:16:23 +02:00
Andrew Mayorov	1f5425975f	feat(ds): add an ability to preserve and restore iterators ... This will allow to persist iteration state and to periodically recreate iterators during long replays.	2023-06-22 10:16:20 +02:00
Andrew Mayorov	94e8dbfe7f	test(ds): Move proptests into a separate module ... Following conventions. Also add few proptests on keyspace filters.	2023-06-22 10:16:16 +02:00
Andrew Mayorov	4c643aa7d5	refactor(ds): Introduce keyspace filter concept ... So we could conveniently test it separately.	2023-06-22 10:16:10 +02:00
Andrew Mayorov	c5826cee56	refactor(ds): rename compute_hash_* → compute_topic_*	2023-06-22 10:16:05 +02:00
Andrew Mayorov	85d3783ff1	chore(ds): Drop few unused macrodefinitions	2023-06-22 10:15:56 +02:00
Andrew Mayorov	a0bcdb5104	chore(ds): Attempt to make compute_next_seek's logic clearer	2023-06-22 10:15:49 +02:00
ieQu1	f1e39d977a	fix(ds): Fix dialyzer warnings	2023-06-22 10:15:47 +02:00
ieQu1	adcbf40d27	refactor(ds): tau -> epoch	2023-06-22 10:15:44 +02:00
ieQu1	120d4e66ae	refactor(ds): Factor out configuration to a separate module	2023-06-22 10:15:42 +02:00
ieQu1	0bbc5ecb32	refactor(ds): Introduce bitwise_concat function	2023-06-22 10:15:40 +02:00
ieQu1	b5bb77dd58	feat(ds): Add metadata storage and supervision tree	2023-06-22 10:15:37 +02:00
Andrew Mayorov	5e30a5d3dd	feat(ds): Implement keyspace partitioning across time	2023-06-22 10:15:32 +02:00
Andrew Mayorov	8c9c9cc669	feat(ds): Allow to specify message store options ... * Keymapper * Column family name + DB options * DB write / read options	2023-06-22 10:15:25 +02:00
Andrew Mayorov	5b6c4d766b	test(ds): Add basic property tests	2023-06-22 10:15:20 +02:00
Andrew Mayorov	a1e29e4e24	refactor(ds): Improve function naming	2023-06-22 10:15:03 +02:00
Andrew Mayorov	cd12338c3f	feat(ds): Smoke tests for wildcard iterator scans	2023-06-22 10:14:46 +02:00
Andrew Mayorov	9c1cd4911d	feat(ds): Implement iterator next	2023-06-22 10:14:43 +02:00
ieQu1	27b925405b	test(ds): Add testcase	2023-06-22 10:14:41 +02:00
Andrew Mayorov	691a27883d	feat(ds): Initial commit	2023-06-22 10:14:37 +02:00
Paulo Zulato	f47cc2a458	feat(kafka): add support for kafka headers and ext headers ... Fixes https://emqx.atlassian.net/browse/EMQX-9175	2023-06-21 18:27:39 -03:00
Paulo Zulato	62d3766726	Merge pull request #10645 from paulozulato/data-bridge-target-unavailable ... Data bridge target unavailable	2023-06-21 18:19:23 -03:00
Andrew Mayorov	62b832be45	Merge pull request #11118 from fix/EMQX-9964/bump-hocon ... chore: bump hocon to 0.39.10	2023-06-21 23:13:35 +02:00
Andrew Mayorov	86d787eced	chore: bump hocon to 0.39.10 ... Which comes with a fix for slightly more user-friendly validation error messages.	2023-06-21 21:25:43 +02:00
Thales Macedo Garitezi	18f0510353	fix(mongo): return health check failure reason ... Fixes https://emqx.atlassian.net/browse/EMQX-10335	2023-06-21 15:09:37 -03:00
Paulo Zulato	8430ec673c	feat(kafka): check whether target topic exists ... Fixes https://emqx.atlassian.net/browse/EMQX-9026	2023-06-21 15:00:35 -03:00
Thales Macedo Garitezi	decfd6df2b	feat(buffer_worker): log expired message count ... Fixes https://emqx.atlassian.net/browse/EMQX-10165 ``` iex(emqx@127.0.0.1)38> 2023-06-21T11:09:35.569404-03:00 [info] msg: buffer_worker_dropped_expired_messages, mfa: emqx_resource_buffer_worker:log_expired_messge_count/1, line: 982, expired_count: 900, resource_id: <<"bridge:webhook:webhook">>, worker_index: 3 ```	2023-06-21 14:38:51 -03:00
Zaiming (Stone) Shi	7cf8a6c892	chore: bump app vsns	2023-06-21 16:36:51 +02:00
Zaiming (Stone) Shi	5fa87091c4	Merge remote-tracking branch 'origin/master' into 0621-merge-release-51-to-master	2023-06-21 16:08:41 +02:00
Ilya Averyanov	7382c6e6e1	Merge pull request #11103 from savonarola/0620-update-erlcloud ... chore(deps): update erlcloud and remove unnecessary overrides	2023-06-21 15:07:45 +03:00
zhongwencool	f50d7334d6	Merge pull request #11077 from zhongwencool/fix-crash-ip-port-type	2023-06-21 17:36:59 +08:00
Zaiming (Stone) Shi	5f47649d4d	chore: downgrade log severity level of 'not_ready' nodes to info	2023-06-21 09:45:45 +02:00
Zaiming (Stone) Shi	045ed340dd	fix(emqx_conf_app): fix release version detect during cluster conf sync	2023-06-21 09:28:46 +02:00
Thales Macedo Garitezi	0463828e84	refactor(gcp_pubsub): transform connector into opaque client	2023-06-20 15:27:42 -03:00
Thales Macedo Garitezi	1d791d7a8c	fix(resource): validate maximum worker pool size ... Fixes https://emqx.atlassian.net/browse/EMQX-10297	2023-06-20 14:26:42 -03:00
Thales Macedo Garitezi	ffce6fefa8	docs: note that connector state must be immutable to avoid errors	2023-06-20 13:50:53 -03:00
Zaiming (Stone) Shi	dddccfdc5c	chore: bump to v5.1.0 official cut	2023-06-20 17:09:17 +02:00
Zaiming (Stone) Shi	728656d4f6	chore: bump to e5.1.0 official cut	2023-06-20 17:08:18 +02:00
Thales Macedo Garitezi	ba96c725e5	feat: add time-based pull for safety	2023-06-20 11:36:35 -03:00
Thales Macedo Garitezi	57460e83b9	test(fix): rm unused var warnings	2023-06-20 11:15:37 -03:00
Thales Macedo Garitezi	2ac2d4c037	refactor: addressing review comments	2023-06-20 11:15:13 -03:00
Ilya Averyanov	54d96488a0	chore(deps): update erlcloud and remove unnecessary overrides	2023-06-20 16:46:23 +03:00
Zaiming (Stone) Shi	b588b88a60	chore: change autoclean interval default value to 24h ... There is currently a bug in OTP causing external backends to fail when merge schema (mnesia_schema:change_storage_type/3). To avoid forcing users to clean up the DB after the node is stopped for a short while (5m before this change), we increase the default auto-clean interval to 24 hours. This PR also has the autoclean config removed from examples.	2023-06-20 15:43:37 +02:00
lafirest	8f595cbeca	Merge pull request #11098 from lafirest/feat/doc-example ... chore: add examples of how to configure	2023-06-20 20:09:44 +08:00
Zaiming (Stone) Shi	f95787d229	test: make possible to test core/replica locally	2023-06-20 12:42:00 +02:00
ieQu1	e5803a61f1	fix(management): Don't wait for an empty shard	2023-06-20 10:08:41 +02:00
firest	bb2bf059ac	chore: modify the build to copy examples into the release	2023-06-20 14:53:14 +08:00
zhongwencool	36ee872361	chore: hide plugins from conf load cli	2023-06-20 10:34:09 +08:00
zhongwencool	856de78698	chore: remove the is_list guard	2023-06-20 08:39:23 +08:00
zhongwencool	093cdab838	chore: to_integer to make sure integer is converted	2023-06-20 08:39:23 +08:00
zhongwencool	07172e42f0	test: integer CI check failed	2023-06-20 08:39:23 +08:00
zhongwencool	a4be9b8281	chore: bump hocon to 0.39.9	2023-06-20 08:39:23 +08:00
zhongwencool	45963b6a95	fix: ip_port schema type crash	2023-06-20 08:39:23 +08:00
Zaiming (Stone) Shi	ead511a128	chore: bump to 5.1.0-rc.1	2023-06-19 23:19:27 +02:00
ieQu1	86b78981c4	Merge pull request #11092 from ieQu1/mria-0.5.5 ... chore(mria): Bump version to 0.5.5	2023-06-19 23:13:36 +02:00
Thales Macedo Garitezi	13746c2cdf	fix(resource): check status when (re)starting a resource ... Fixes https://emqx.atlassian.net/browse/EMQX-10290	2023-06-19 18:01:02 -03:00
Thales Macedo Garitezi	01d758e4c0	fix(bpapi): fix query_mode type(spec) ... The previous spec was wrong due to a mismatch between type declaration and usage in specs: it would never be `dynamic`, and it was lacking the `simple_async`, `simple_sync` and `no_queries` constructors.	2023-06-19 16:04:12 -03:00
Thales Macedo Garitezi	b442910ff1	feat(gcp_pubsub_consumer): implement GCP PubSub Consumer bridge ... Fixes https://emqx.atlassian.net/browse/EMQX-10281	2023-06-19 16:04:12 -03:00
Thales Macedo Garitezi	bb49482529	refactor(gcp_pubsub): move logging from connector to bridge	2023-06-19 15:59:00 -03:00
Thales Macedo Garitezi	dabefdb01b	fix(gcp_pubsub): redact request when errors occur	2023-06-19 15:59:00 -03:00
Thales Macedo Garitezi	7f850f7499	fix(resource): fix query_mode/0 type and usage	2023-06-19 15:59:00 -03:00
Thales Macedo Garitezi	a1690b3684	chore(gcp_pubsub): add stricter compile/xref flags	2023-06-19 15:59:00 -03:00