9406 Commits

Author	SHA1	Message	Date
Andrew Mayorov	063d6200c8	feat(router): enable using 2 tables to store routes ... Instead of a single unified table, to reap the benefits of cheap `ets:lookup/2` per regular topic subscription route. Change configuration option naming to reflect the change: user now has an ability to choose _storage schema_.	2023-08-29 17:41:59 +04:00
Andrew Mayorov	270fd107b2	feat(triesearch): allow reusing filter tokenization result ... As a kind of micro-optimization.	2023-08-29 17:31:26 +04:00
zhongwencool	501456efec	chore: more safe with iolist_to_binary ... Co-authored-by: Zaiming (Stone) Shi <zmstone@gmail.com>	2023-08-29 17:10:43 +08:00
zhongwencool	4e7ba5d35f	chore: ciphers should allow empty space(comma_separated_binary)	2023-08-29 11:34:40 +08:00
firest	6722722522	fix(frame): improve some error reasons when parsing invalid packet	2023-08-29 10:53:20 +08:00
zhongwencool	4245a4d8c6	fix: authz clean-cache clientid always return not_found	2023-08-29 08:17:47 +08:00
Paulo Zulato	cc3ba18734	fix: increment dropped message counter when bridge is unhealthy ... Fixes https://emqx.atlassian.net/browse/EMQX-10767	2023-08-28 19:47:11 -03:00
Paulo Zulato	2c89be04d1	Merge pull request #11527 from paulozulato/fix-kafka-header-template-handling ... fix(kafka): fix template processing for header	2023-08-28 18:55:33 -03:00
Paulo Zulato	0b86f04bae	fix(kafka): fix template processing for header ... Fixes https://emqx.atlassian.net/browse/EMQX-10846	2023-08-28 17:28:05 -03:00
Ilya Averyanov	279895b8fd	chore(ft): add read/write concurrency to emqx_ft_async_reply tabs	2023-08-28 22:46:30 +03:00
SergeTupchiy	c04f770118	Merge pull request #11506 from SergeTupchiy/EMQX-10274-do-not-download-empty-trace-log ... fix(emqx_trace): don't download empty trace log file	2023-08-28 22:17:00 +03:00
Serge Tupchii	0072749143	fix(emqx_trace): don't download empty trace log file ... Closes: EMQX-10274	2023-08-28 19:25:55 +03:00
Thales Macedo Garitezi	5908b69353	chore: hide cluster purge from cli and api for now	2023-08-28 10:23:21 -03:00
Thales Macedo Garitezi	f988de4ff4	feat(purge): clear delayed messages	2023-08-28 10:23:21 -03:00
Thales Macedo Garitezi	9bded07834	feat: cluster purge ... Fixes https://emqx.atlassian.net/browse/EMQX-10763	2023-08-28 10:23:20 -03:00
Thales Macedo Garitezi	dec21ffc95	Merge pull request #11362 from thalesmg/ds-handle-sub-20230725 ... feat(ds): open iterators when handling `SUBSCRIBE` packets	2023-08-28 10:21:28 -03:00
Andrew Mayorov	2d931a0512	test(evict): do not disable router module in cluster nodes	2023-08-28 14:07:46 +04:00
Andrew Mayorov	8d2ebdea7e	fix(router): generalize config option and make effects visible	2023-08-28 14:07:46 +04:00
Andrew Mayorov	e85789306b	chore(router): drop test-only has_routes/1 ... Seems that it's too much support work only for test purposes, where `lookup_routes/1` is nearly as usable.	2023-08-28 14:07:46 +04:00
Andrew Mayorov	5d51687dbf	feat(router): add unified routing table config option	2023-08-28 14:07:45 +04:00
Andrew Mayorov	33e5e1ba57	feat(router): add unified routing table	2023-08-28 14:07:44 +04:00
Andrew Mayorov	166375a000	fix(topicidx): make get_record/2 simpler to use in concurrent env ... The mechanic of `emqx_topic_index` cannot really guarantee atomicity of reading records associated with index matches, so instead it's probably better to make the user aware of that lack of this guarantee.	2023-08-28 13:52:59 +04:00
Andrew Mayorov	84e40fb6fe	test(trie): add more involved route add + delete case ... That shows how current local trie implementation breaks because of lack of refcounting.	2023-08-28 13:52:59 +04:00
Andrew Mayorov	dcb63440bc	refactor(mgmt): avoid dealing with router tab directly ... Instead, contain all this behind `emqx_router` module interface.	2023-08-28 13:52:59 +04:00
Andrew Mayorov	9eccfa0909	refactor(router): isolate cleanup logic in router module	2023-08-28 13:52:59 +04:00
JimMoen	f3467f44b2	chore: bump hstreamdb_erl driver to 0.4.5+v0.16.1	2023-08-28 17:28:50 +08:00
Ilya Averyanov	4488e9e591	chore(ft): stop hook chain when doing actual handling	2023-08-28 11:57:44 +03:00
Ilya Averyanov	39a48179ea	chore(emqx_channel): use macros for reply construction	2023-08-28 11:57:44 +03:00
Ilya Averyanov	b8cacd2833	chore(ft): add tests for async reply registry	2023-08-28 11:57:44 +03:00
Andrew Mayorov	b74ff10705	Merge pull request #11517 from keynslug/ft/topic-index-v3 ... feat(topicidx): iterate on trie search implementation	2023-08-28 12:24:16 +04:00
zhongwencool	053b7fb94a	test: add more test for conf_cli	2023-08-28 11:14:36 +08:00
zhongwencool	d8be248a3d	fix: improve the suggest msg for update conf failed	2023-08-28 08:53:23 +08:00
Ilya Averyanov	b0d4a22aa8	chore(ft): refactor async reply mechanism	2023-08-27 21:54:23 +03:00
zhongwencool	b874926de7	Merge pull request #11514 from zhongwencool/stop-load-application-before-reboot ... fix: stop otel deps appication before reboot	2023-08-27 20:46:31 +08:00
Paulo Zulato	2bb415f897	Merge pull request #11526 from paulozulato/fix-validator-return-msg ... fix: flatten error message on resource validator	2023-08-25 17:27:31 -03:00
Thales Macedo Garitezi	33a0048155	refactor: move logic to ensure_iterator	2023-08-25 15:24:53 -03:00
Paulo Zulato	84e68f8ed8	Merge pull request #11508 from paulozulato/fix-azure-msg-error-handling ... fix(kafka): fix result handling when sending message with invalid header	2023-08-25 14:57:09 -03:00
Paulo Zulato	42877e282d	fix: flatten error message on resource validator ... Fixes https://emqx.atlassian.net/browse/EMQX-10864	2023-08-25 13:53:52 -03:00
Thales Macedo Garitezi	f15f59650d	test: rm obselete workaround code	2023-08-25 13:49:33 -03:00
Paulo Zulato	cb1e105e19	Merge pull request #11516 from paulozulato/fix-kafka-aeh-client-unique-id ... Fix Kafka/AEH ClientId uniqueness	2023-08-25 10:14:44 -03:00
Andrew Mayorov	d5cff533e3	chore(topicidx): drop TODO comment	2023-08-25 16:44:03 +04:00
Andrew Mayorov	ca59a87d47	chore(topicidx): refine example of wildcard compare	2023-08-25 16:44:03 +04:00
Zaiming (Stone) Shi	558402a68e	chore(topic_index): add topic validation	2023-08-25 16:44:03 +04:00
Andrew Mayorov	33ed53bb6a	refactor(topicidx): simplify compare/3 further ... It's possible to emit seek instruction just once, on the way back out of the `compare/3` stack.	2023-08-25 16:34:45 +04:00
Andrew Mayorov	fc37d235c7	refactor(topicidx): simplify seek instructions ... Which also avoids comparing filter tail repeatedly when evaluating it.	2023-08-25 15:24:06 +04:00
Kjell Winblad	c65db82b07	fix: bad error message when rule engine schema name is too long ... Fixes: https://emqx.atlassian.net/browse/EMQX-10778	2023-08-25 11:02:38 +02:00
zhongwencool	c8af5a702c	test: remove connection_closed from test	2023-08-25 15:53:35 +08:00
zhongwencool	fc1738188e	fix: packets_connack_sent is not incremented if the ack_flag field in the CONNACK packet is non-zero	2023-08-25 15:18:34 +08:00
lafirest	ba9cb0a1ed	Merge pull request #11512 from lafirest/fix/ldap_def_port ... fix(ldap): expose request_timeout to prevent infinite hang	2023-08-25 10:22:44 +08:00
zhongwencool	8ab6eb5638	test: start emqx_opentelemetry in emqx_machine SUITE	2023-08-25 10:09:00 +08:00
Andrew Mayorov	cf45e80c71	feat(topicidx): iterate on trie search implementation ... This improves matching performance and decreases GC pressure on synthetic workloads.	2023-08-25 01:47:11 +04:00
Paulo Zulato	535c7f8b43	fix(kafka): avoid ClientId collision between Kafka and Azure bridges ... Fixes https://emqx.atlassian.net/browse/EMQX-10860	2023-08-24 18:46:22 -03:00
Thales Macedo Garitezi	d9a5a9ea2b	Merge pull request #11513 from thalesmg/kafka-fix-ts-template-r52-20230824 ... fix: use correct timestamp template for kafka and remove such fields from azure event hub producer	2023-08-24 16:26:52 -03:00
Thales Macedo Garitezi	016ae0524f	fix(aeh_producer): remove timestamp template field ... Fixes https://emqx.atlassian.net/browse/EMQX-10847 Checking the whole Kafka message from AEH, it seems like the timestamp type is append, which means that it’s the broker who controls the timestamp, and the timestamp defined by the producer is ignored. Ref: https://kafka.apache.org/documentation/#brokerconfigs_log.message.timestamp.type Example message consumed from AEH: ``` %{ "headers" => %{}, "key" => "", "offset" => 4, "topic" => "test0", "ts" => 1692879703006, "ts_type" => "append", "value" => "{\"username\":\"undefined\",\"topic\":\"t/aeh/produ\",\"timestamp\":1692879692189,\"qos\":0,\"publish_received_at\":1692879692189,\"pub_props\":{\"User-Property\":{}},\"peerhost\":\"undefined\",\"payload\":\"aaaa\",\"node\":\"emqx@127.0.0.1\",\"metadata\":{\"rule_id\":\"rule_aehp\"},\"id\":\"000603AA44B34E08F4AF000006E30003\",\"flags\":{},\"event\":\"message.publish\",\"clientid\":\"undefined\"}" } ``` Note the ts_type above is append. Example message from a Kafka broker whose ts type is create: ``` %{ "headers" => %{}, "key" => "", "offset" => 4, "topic" => "test-topic-three-partitions", "ts" => 1692881883668, "ts_type" => "create", "value" => "{\"username\":\"undefined\",\"topic\":\"t/kafka/produ\",\"timestamp\":1692881883668,\"qos\":0,\"publish_received_at\":1692881883668,\"pub_props\":{\"User-Property\":{}},\"peerhost\":\"undefined\",\"payload\":\"aaaaaa\",\"node\":\"emqx@127.0.0.1\",\"id\":\"000603AAC7529FEEF4AC000007050000\",\"flags\":{},\"event\":\"message.publish\",\"clientid\":\"undefined\"}" } ``` Unfortunately, I couldn’t find anywhere in AEH where that configuration could be changed.	2023-08-24 14:20:42 -03:00
Thales Macedo Garitezi	0381ac0410	fix(kafka_producer): use correct timestamp template field ... Fixes https://emqx.atlassian.net/browse/EMQX-10847	2023-08-24 14:20:42 -03:00
Kjell Winblad	9fe5080705	build: bump versions before release	2023-08-24 16:46:27 +02:00
zhongwencool	c215fe3736	fix: stop otel deps appication before reboot	2023-08-24 22:14:14 +08:00
Paulo Zulato	60e6217496	fix(kafka): fix result handling when sending message with invalid header ... Fixes https://emqx.atlassian.net/browse/EMQX-10846	2023-08-24 10:41:42 -03:00
Thales Macedo Garitezi	e5041de9cc	fix(gcp_consumer): handle 401 errors ... Fixes https://emqx.atlassian.net/browse/EMQX-10852	2023-08-24 09:03:34 -03:00
Zaiming (Stone) Shi	62423b0b12	refactor(topic_index): less special handling for leading $ words	2023-08-24 13:30:10 +02:00
Zaiming (Stone) Shi	a30d87e14f	refactor(topic_index): remove more unnecessary next calls ... also avoid using records (setelement) for recursive return values	2023-08-24 12:25:04 +02:00
Zaiming (Stone) Shi	a1e6635614	refactor(topic_index): no forced ceiling entry in index table	2023-08-24 12:25:04 +02:00
Zaiming (Stone) Shi	f4c8c6be55	refactor(topic_index): optimize trie-search performance	2023-08-24 12:25:04 +02:00
Zaiming (Stone) Shi	6b152b3cb7	test: add more debug output	2023-08-24 12:25:04 +02:00
Zaiming (Stone) Shi	ae094e363c	chore: fix a typo in log message	2023-08-24 12:25:04 +02:00
firest	6085442958	fix(ldap): expose request_timeout to prevent infinite hang	2023-08-24 16:50:38 +08:00
zhongwencool	2322b27542	Merge pull request #11497 from zhongwencool/prometheus-metrics ... Prometheus metrics	2023-08-24 12:06:32 +08:00
zhongwencool	8d2be27ade	chore: add changlog for 11466	2023-08-24 06:46:50 +08:00
zhongwencool	84dd3b83bb	fix: hocon converter not working when make_serializable is true(check_plain)	2023-08-24 06:46:47 +08:00
zhongwencool	f72ba6819f	Merge pull request #11498 from zhongwencool/fix-otel-stop-error-log ... fix: stop otel deps application in terminate crashed	2023-08-24 06:40:24 +08:00
zhongwencool	d287b736ec	chore: add changelog for 11497	2023-08-23 17:02:30 +08:00
zhongwencool	58be7f709b	fix: stop otel deps application in terminate crashed	2023-08-23 16:45:41 +08:00
zhongwencool	6bb15541c7	feat: rename olp metrics to overload_protection metrics	2023-08-23 15:25:54 +08:00
zhongwencool	b9a97923c4	feat: add some authz/connection missing metrics	2023-08-23 14:47:53 +08:00
zhongwencool	141676185d	feat: add authentication metrics to prometheus	2023-08-23 14:15:16 +08:00
zhongwencool	4928c69758	feat: add authorization metrics to prometheus	2023-08-23 14:11:59 +08:00
zhongwencool	df9f8da178	feat: add overload_protection metrics to prometheus	2023-08-23 14:07:37 +08:00
zhongwencool	188a81913e	test: add prometheus api test	2023-08-23 11:23:43 +08:00
zhongwencool	ae10415fc3	feat: disabled the Erlang VM Prometheus exporter by default to improve performance and security	2023-08-23 09:03:22 +08:00
Paulo Zulato	61536b5362	Merge pull request #11494 from paulozulato/fix-kinesis-validators ... fix(kinesis): set validators for static constraints	2023-08-22 18:28:35 -03:00
Paulo Zulato	20b46091f9	fix(kinesis): set validators for static constraints ... Fixes https://emqx.atlassian.net/browse/EMQX-10833	2023-08-22 14:42:44 -03:00
Thales Macedo Garitezi	f007b44426	fix(data_import): rm duplicate import call and fix test	2023-08-22 13:29:15 -03:00
Thales Macedo Garitezi	ee2897e5de	test(refactor): move test to integration tests dir	2023-08-22 13:29:15 -03:00
Thales Macedo Garitezi	c1f49abad2	test: fix inter-suite flakiness	2023-08-22 13:29:15 -03:00
Thales Macedo Garitezi	dad27091be	test: rm custom option	2023-08-22 13:29:15 -03:00
Thales Macedo Garitezi	dbfacae283	fix: reinstate transactions	2023-08-22 13:29:15 -03:00
Thales Macedo Garitezi	65085d012b	refactor: rename fn	2023-08-22 13:29:15 -03:00
Thales Macedo Garitezi	3344bfb0bd	refactor: rm emqx_ds_replay	2023-08-22 13:29:15 -03:00
Thales Macedo Garitezi	c46b8de938	test: remove unused things, refactor some functions	2023-08-22 13:29:15 -03:00
Thales Macedo Garitezi	e8c73b06e1	docs: add comment about future test failure	2023-08-22 13:29:15 -03:00
Thales Macedo Garitezi	6de0bbe76a	test(refactor): always allocate listeners for emqx app	2023-08-22 13:29:15 -03:00
Thales Macedo Garitezi	a15405a800	test: fix assertions	2023-08-22 13:29:15 -03:00
Thales Macedo Garitezi	c74abe79d0	refactor: reduce arity	2023-08-22 13:29:15 -03:00
Thales Macedo Garitezi	021755b82b	refactor: rm iterators from DS #session{} record	2023-08-22 13:29:15 -03:00
Thales Macedo Garitezi	e4e88ebf36	test: add scenario for node stopping midway during subscribe	2023-08-22 13:29:15 -03:00
Thales Macedo Garitezi	3239f5ac5b	feat: rm unnecessary transactions, use separate table for iterator references	2023-08-22 13:29:15 -03:00
Thales Macedo Garitezi	8eab389ae1	perf: avoid unnecessary transaction	2023-08-22 13:29:15 -03:00
Thales Macedo Garitezi	c28c6d1b7e	fix: ensure iterator is opened	2023-08-22 13:29:15 -03:00
Thales Macedo Garitezi	33ddbe80ad	refactor: remove persistence leakeage from emqx_cm level	2023-08-22 13:29:15 -03:00
Thales Macedo Garitezi	e8d7bb9a67	refactor: rename module	2023-08-22 13:29:15 -03:00
Thales Macedo Garitezi	9463e271c0	feat(ds): open iterators when handling SUBSCRIBE packets ... Fixes https://emqx.atlassian.net/browse/EMQX-9741	2023-08-22 13:29:15 -03:00
Thales Macedo Garitezi	ca697a4e14	fix: rename emqx_ds{,_replay}:replay_id()	2023-08-22 13:29:15 -03:00
Thales Macedo Garitezi	45e2e687e5	fix(greptimedb_bridge): avoid double-parsing write syntax during probe and remove code duplication ... Fixes https://emqx.atlassian.net/browse/EMQX-10843	2023-08-22 12:42:48 -03:00
Kjell Winblad	3ffbb7decf	fix: HTTP API /api/v5/publish schema ... The schema for the /api/v5/publish HTTP API endpoint was incorrect. For 400 (Bad Request) error it cannot return a list but the incorrect schema declared that the response could include a list. Fixes: https://emqx.atlassian.net/browse/EMQX-10837 https://github.com/emqx/emqx/issues/11488	2023-08-22 15:21:20 +02:00
lafirest	7b8a599d17	Merge pull request #11486 from lafirest/fix/ldap_autn_wrong_pw ... fix(ldap): Return correct reason code when password is wrong	2023-08-22 18:53:17 +08:00
lafirest	f8f39bf223	Merge pull request #11490 from lafirest/fix/absent_pw ... fix(authn): quickly return when the password is absent in password-based authentication	2023-08-22 18:52:58 +08:00
firest	e20b804e6b	chore: update changes && test cases	2023-08-22 17:41:08 +08:00
firest	184e03387a	fix(ldap): fix status detection and auto reconnecting errors	2023-08-22 17:06:00 +08:00
Kinple	663d03112e	Merge pull request #11476 from Kinplemelon/kinple/for-upgrade-dashboard ... fix: set the `endpoint` in kinesis bridge as a required field	2023-08-22 14:28:40 +08:00
firest	b0c5b447a4	fix(authn): quickly return when the password is absent in password-based authentication	2023-08-22 11:49:32 +08:00
JimMoen	13ebcd6290	Merge pull request #11478 from JimMoen/hstreamdb-tls-support ... Hstreamdb tls support	2023-08-22 10:40:54 +08:00
firest	037b0a7599	fix(ldap): Return correct reason code when password is wrong	2023-08-22 09:42:04 +08:00
Paulo Zulato	4e4c93a758	Merge pull request #11469 from paulozulato/feat-redis-auth-username ... Add support for AUTH with username on Redis	2023-08-21 16:44:21 -03:00
Thales Macedo Garitezi	74d4a8325e	Merge pull request #11470 from thalesmg/gcp-consumer-rm-worker-pool-size-r52-20230817 ... fix(gcp_consumer): remove unused resource_opts fields	2023-08-21 14:49:59 -03:00
Thales Macedo Garitezi	bd5680db00	Merge pull request #11461 from thalesmg/bridge-dryrun-flex-timeout-r52-20230816 ... fix(bridge): make dryrun health check timeout more malleable	2023-08-21 14:49:46 -03:00
Ivan Dyachkov	999988cab4	Merge pull request #11401 from kjellwinblad/kjell/fix/mongo_date_format/EMQX-10727 ... fix: rule SQL mongo_date function should return a string in test mode	2023-08-21 16:20:59 +02:00
Thales Macedo Garitezi	4163f06611	Merge pull request #11480 from thalesmg/rule-funcs-func-clause-r52-20230818 ... fix(rule_engine): capture function_clause errors	2023-08-21 11:16:25 -03:00
Kinplemelon	443d44aaa3	fix: set the endpoint in kinesis bridge as a required field	2023-08-21 11:49:57 +08:00
JimMoen	f45b5fac6f	chore: unhidden hstreamdb bridge for e5.2.0	2023-08-21 10:40:51 +08:00
JimMoen	649647190e	test: new batch mechanism of hstreamdb_erl	2023-08-21 10:40:51 +08:00
JimMoen	5527edf442	chore: bump hstreamdb_erl to 0.4.3+v0.16.1	2023-08-21 10:40:36 +08:00
Ilya Averyanov	ed67303281	Merge pull request #11382 from savonarola/0801-auth-refactor ... Auth refactor stage 1	2023-08-21 00:24:15 +03:00
Zaiming (Stone) Shi	01c9095982	Merge pull request #11394 from zmstone/0804-upgrade-wolff-to-1.7.7 ... chore: upgrade Kafka client wolff to 1.7.7	2023-08-20 10:14:13 +02:00
Paulo Zulato	05fdf52d8e	fix(redis): set bridge as unhealthy on authentication error	2023-08-18 14:51:03 -03:00
Paulo Zulato	fc35c74eab	fix(redis): use eredis_secret to avoid password leaking	2023-08-18 14:51:03 -03:00
Paulo Zulato	2c458b62f5	feat(redis): add support for username on AUTH command ... Fixes https://emqx.atlassian.net/browse/EMQX-9911	2023-08-18 14:50:06 -03:00
Thales Macedo Garitezi	66dec69d09	fix(rule_engine): capture function_clause errors ... Fixes https://emqx.atlassian.net/browse/EMQX-10798	2023-08-18 13:51:19 -03:00
Thales Macedo Garitezi	befc260555	fix(gcp_consumer): remove unused resource_opts fields ... Fixes https://emqx.atlassian.net/browse/EMQX-10789	2023-08-17 17:02:02 -03:00
Thales Macedo Garitezi	e48bfb52bb	Merge branch 'release-52' into sync-r52-master-20230817	2023-08-17 17:01:04 -03:00
Paulo Zulato	afffdbbaa1	fix(kinesis): replace default payload template ... Fixes https://emqx.atlassian.net/browse/EMQX-10766	2023-08-17 17:00:14 -03:00
Ivan Dyachkov	e2b9d905d7	Merge pull request #11465 from id/0718-e5.2.0-alpha.3	2023-08-17 20:59:13 +02:00
Andrew Mayorov	75ed6aa8e7	Merge pull request #11396 from keynslug/ft/EMQX-10712/ruleeng-topic-index-vol-2 ... perf(ruleeng): employ `emqx_topic_index` to speed up topic matching	2023-08-17 20:43:09 +04:00
Ivan Dyachkov	a0c2fe8cc1	chore: e5.2.0-alpha.3	2023-08-17 17:55:56 +02:00
Thales Macedo Garitezi	ebecbd1545	fix(bridge): make dryrun health check timeout more malleable ... Fixes https://emqx.atlassian.net/browse/EMQX-10773 - Makes the timeout for probing a bridge more malleable to account for differences between each database. - Increases GCP PubSub Consumer default health check timeout to account for GCP slowness/throttling.	2023-08-17 09:21:19 -03:00
Thales Macedo Garitezi	e3572eb758	Merge pull request #11459 from thalesmg/kafka-health-check-interval-r52-20230816 ... feat(kafka): add option to configure health check interval	2023-08-17 09:04:30 -03:00
Thales Macedo Garitezi	029b461a13	Merge pull request #11448 from thalesmg/gcp-consumer-403-20230815 ... fix(gcp_consumer): handle 403 responses	2023-08-17 09:04:00 -03:00
ieQu1	7466024bca	Merge pull request #11458 from ieQu1/fix-excluded-apps-230916 ... fix(emqx_machine_boot): Fix excluded_apps	2023-08-17 11:36:23 +02:00
Ivan Dyachkov	7469222a17	Merge remote-tracking branch 'upstream/master' into 0817-e5.2.0-code-freeze	2023-08-17 08:16:04 +02:00
lafirest	5e448f5a02	Merge pull request #11446 from lafirest/refactor/calendar ... refactor(calendar): refactor datetime-related code and remove redundant	2023-08-17 07:40:44 +08:00
Andrew Mayorov	5d79823891	perf(topicidx): preserve next key on the stack to reuse later ... This should further optimize the number of `ets:next/2` calls required for a single match query.	2023-08-17 01:13:19 +04:00
Paulo Zulato	740680d54b	Merge pull request #11444 from paulozulato/fix-kinesis-msg-access-denied ... fix(kinesis): return error message on access denied	2023-08-16 18:02:46 -03:00
Thales Macedo Garitezi	f03733ba6b	Merge pull request #11460 from thalesmg/integration-tests-dir-20230816 ... ci: add `integration_test` dir to `emqx` application	2023-08-16 17:47:14 -03:00
Ilya Averyanov	d17bcc94f6	chore(auth): update emqx_gcp_device tests	2023-08-16 22:37:42 +03:00
Paulo Zulato	a64386ef82	fix(kinesis): return error message on access denied ... Fixes https://emqx.atlassian.net/browse/EMQX-10764	2023-08-16 16:04:23 -03:00
Ilya Averyanov	3943830eae	chore(auth): remove unnecessary atom conversions	2023-08-16 20:50:35 +03:00
Ilya Averyanov	0dae040047	chore(auth): restore injected schema key position	2023-08-16 20:50:35 +03:00
Ilya Averyanov	db31e5f0d9	chore(auth): tidy up the code	2023-08-16 20:50:35 +03:00
Ilya Averyanov	67e06b3171	chore(auth): make schema injection be more universal	2023-08-16 20:41:05 +03:00
Ilya Averyanov	abcdf18ca4	chore(auth): update ldap authn test	2023-08-16 20:41:05 +03:00
Ilya Averyanov	f00f4568dc	chore(auth): simplify schema injection	2023-08-16 20:41:05 +03:00
Ilya Averyanov	8a3e8ee528	chore(auth): add config propagation tests for authn	2023-08-16 20:41:05 +03:00
Ilya Averyanov	cd88dfbbb8	chore(auth): update authn includes	2023-08-16 20:41:05 +03:00
Ilya Averyanov	ae3355880e	chore(auth): update emqx_authn tests	2023-08-16 20:41:05 +03:00
Ilya Averyanov	128aa19d47	chore(auth): improve emqx_config_handler to replace adhoc config updates	2023-08-16 20:41:05 +03:00
Ilya Averyanov	8213aa42c9	chore(auth): move authn leftovers to the authn app	2023-08-16 18:52:14 +03:00
Ilya Averyanov	ca8c1e3ef8	chore(auth): removed direct usages of authn from emqx core app	2023-08-16 18:52:14 +03:00
Ilya Averyanov	ce2b159022	chore(auth): make pre_hook_authenticate be part of emqx_access_control domain	2023-08-16 18:52:14 +03:00
zhongwencool	e6f0dead9e	Merge pull request #11445 from zhongwencool/remove-os-mon-from-windows ... fix: remove os_mon application in Windows release	2023-08-16 23:30:24 +08:00
Thales Macedo Garitezi	a6a023eff7	ci: add integration_test dir to emqx application ... This gives us a place where to put tests that exercise multiple umbrella application, which is more closely related to `emqx`, but in a way that doesn't affect the standalone app tests.	2023-08-16 11:48:47 -03:00
Thales Macedo Garitezi	ffca581229	feat(kafka): add option to configure health check interval ... Fixes https://emqx.atlassian.net/browse/EMQX-10781	2023-08-16 11:08:06 -03:00
ieQu1	7b44caeae4	fix(emqx_machine_boot): Fix excluded_apps	2023-08-16 16:04:35 +02:00
Andrew Mayorov	c84ee66d80	Merge pull request #11450 from keynslug/fix/dirty-testsuite-flapping ... fix(test): switch `emqx_flapping_SUITE` to cth tooling	2023-08-16 17:20:31 +04:00
zhongwencool	e406cd7868	Merge pull request #11456 from zhongwencool/allow-empty-cacertfile-pem ... fix: allow empty cacertfile pem	2023-08-16 21:10:52 +08:00
zhongwencool	78356d2625	chore: start os_mon in handle_continue/2	2023-08-16 20:54:53 +08:00
Thales Macedo Garitezi	82f27eaf78	Merge pull request #11429 from thalesmg/mongodb-legacy-opt-20230810 ... feat(mongodb): add configurable option to override legacy protocol usage	2023-08-16 09:54:53 -03:00
zhongwencool	8b23ee86b3	fix: hide cpu_status if os_check is not supported	2023-08-16 20:49:28 +08:00
zhongwencool	b817e03c08	fix: start os_mon application temporary	2023-08-16 20:49:27 +08:00
zhongwencool	848eb7e3c3	fix: remove os_mon application in Windows release	2023-08-16 20:49:27 +08:00
zhongwencool	b733adca06	fix: allow empty cacertfile pem	2023-08-16 20:15:21 +08:00
firest	040d28c35e	fix(cli): fix two typos in the time unit	2023-08-16 18:46:17 +08:00
zhongwencool	1af0407c48	fix: don't crash when debug huge payload	2023-08-16 15:35:09 +08:00
firest	8cd21da94b	chore: update apps version	2023-08-16 10:55:54 +08:00
firest	b08102269a	refactor(calendar): refactor datetime-related code and remove redundant	2023-08-16 10:55:46 +08:00
Thales Macedo Garitezi	4e80d669b0	fix(influxdb_bridge): avoid double-parsing write syntax during probe ... Fixes https://emqx.atlassian.net/browse/EMQX-10771	2023-08-15 17:05:57 -03:00
Andrew Mayorov	0b21b87296	fix(test): switch emqx_flapping_SUITE to cth tooling	2023-08-15 21:29:42 +04:00
Andrew Mayorov	5560e6ed4f	fix(cthsuite): also prevent emqx from loading default conf	2023-08-15 21:25:39 +04:00
Thales Macedo Garitezi	5d707c8b7d	Merge pull request #11403 from thalesmg/gcp-produ-attr-20230728 ... feat(gcp_producer): add support for defining message attributes and ordering key	2023-08-15 13:22:31 -03:00
Thales Macedo Garitezi	ba956ebe88	fix(gcp_consumer): handle 403 responses ... Fixes https://emqx.atlassian.net/browse/EMQX-10736	2023-08-15 13:20:20 -03:00
Zaiming (Stone) Shi	fa9e9f3348	Merge pull request #11442 from zmstone/0814-sync-release-52-to-master ... 0814 sync release 52 to master	2023-08-15 16:21:55 +02:00
Andrew Mayorov	e39bbf4c49	chore(topicidx): add more descriptive comments and specs ... To (hopefully) better illustrate what is happening there.	2023-08-15 16:55:48 +04:00
Thales Macedo Garitezi	23f5cea482	feat: handle strange key values when resolving placeholders	2023-08-14 13:39:38 -03:00
Thales Macedo Garitezi	d93e1bbf08	feat(mongodb): add configurable option to override legacy protocol usage ... Fixes https://emqx.atlassian.net/browse/EMQX-10750 Fixes https://github.com/emqx/emqx/discussions/11428 See https://github.com/emqx/mongodb-erlang/pull/39	2023-08-14 13:19:50 -03:00
Thales Macedo Garitezi	926eb4e3dd	test: rm unused var warning	2023-08-14 10:33:24 -03:00
Thales Macedo Garitezi	82b8538041	feat(gcp_producer): add support for defining message attributes and ordering key ... Fixes https://emqx.atlassian.net/browse/EMQX-10652	2023-08-14 10:33:17 -03:00
lafirest	1bda8020f5	Merge pull request #11436 from lafirest/feat/banned_clear ... feat(banned): add a new API used to clear all banned data	2023-08-14 20:48:43 +08:00
lafirest	6bea894205	Merge pull request #11440 from lafirest/fix/ldap_dep ... fix(ldap): fix dependency problem	2023-08-14 20:34:58 +08:00
Andrew Mayorov	fe9477f92e	chore: bump applications versions ... * emqx_rule_engine 5.0.23	2023-08-14 15:36:58 +04:00
Andrew Mayorov	47dfba4341	perf(ruleeng): employ emqx_topic_index to speed up topic matching	2023-08-14 15:36:58 +04:00
Andrew Mayorov	9a249e4b01	test(topicidx): increase test coverage	2023-08-14 15:36:58 +04:00
Andrew Mayorov	fd0986071c	perf(topicidx): implement fast-forwarding prefixes ... This should give less `ets:next/2` calls in general and much less when index has relatively small number of long non-wildcard topics.	2023-08-14 15:36:58 +04:00
Andrew Mayorov	0c7bdbdab4	test(topicidx): add property test ... Co-Authored-By: JianBo He <heeejianbo@gmail.com>	2023-08-14 15:36:57 +04:00
Andrew Mayorov	48a50c9137	fix(topicidx): fix missing matches when 'a/b' and 'a/b/#' both exist ... Thanks to @HJianBo for spotting this issue. The approach to fix it is different though: we try to keep the "recurrency branch factor" to a minimum, instead introducing new condition for the case when filter does not match, but iteration with `ets:next/2` is not yet finished for the prefix. Co-Authored-By: JianBo He <heeejianbo@gmail.com>	2023-08-14 15:36:57 +04:00
Andrew Mayorov	6a13406363	fix(topicidx): use custom topic words to keep required ordering ... Otherwise, topic with empty tokens (e.g. `a/b///c`) would have some of their tokens ordered before `#` / `+`, because empty token was represented as empty atom (`''`).	2023-08-14 15:36:57 +04:00
Andrew Mayorov	28bcb394d1	fix(topicidx): allow to return matches unique by record id	2023-08-14 15:36:57 +04:00
Andrew Mayorov	8feda315f6	feat(index): add topic index facility ... Somewhat similar to `emqx_trie` in design and logic, yet built on top of a single, potentially pre-existing table.	2023-08-14 15:36:54 +04:00
Zaiming (Stone) Shi	970ff28200	Merge remote-tracking branch 'origin/master' into release-52	2023-08-14 11:50:40 +02:00
firest	0b066fa20c	fix(ldap): fix dependency problem	2023-08-14 16:59:37 +08:00
zhongwencool	41180170f4	fix: update error msg	2023-08-14 15:45:57 +08:00
zhongwencool	e10f9e5e9b	feat: change mqtt.max_packet_size type from string to bytesize	2023-08-14 10:10:46 +08:00
lafirest	b8d3dcf59a	Merge pull request #11424 from lafirest/fix/epoch_maximum_val ... fix(datetime): make sure the epoch is not larger than the maximum supported value	2023-08-11 20:37:56 +08:00
firest	749c2d075f	chore: update changes && bump app version	2023-08-11 17:57:27 +08:00
firest	bc417a6764	fix(datetime): make sure the epoch is not larger than the maximum supported value	2023-08-11 17:57:21 +08:00
firest	2fc0468e0c	feat(banned): add a new API used to clear all banned data	2023-08-11 17:25:49 +08:00
Ivan Dyachkov	7852af896c	chore: e5.2.0-alpha.1	2023-08-11 11:16:30 +02:00
Ivan Dyachkov	bab05b6613	Merge pull request #11433 from id/0811-ci-upgrade-push-helm-action	2023-08-11 11:03:00 +02:00
Ivan Dyachkov	b6084b0001	chore: bump apps/emqx version	2023-08-11 09:19:51 +02:00
lafirest	4eaced241d	Merge pull request #11423 from lafirest/chore/limiter_utils ... fix(limiter): simplify the code of the limiter	2023-08-11 15:17:42 +08:00
JimMoen	060074e04a	fix: api total accumulate ignore undefined by down nodes result	2023-08-11 11:27:55 +08:00
Thales Macedo Garitezi	65aee8870b	Merge pull request #11427 from id/0810-cut-v5.1.5-build.3 ... v5.1.5-build.3	2023-08-10 09:52:58 -03:00
Paulo Zulato	9ca9c65af2	Merge pull request #11367 from paulozulato/feat-gcp-devices ... feat(gcp-iot): port GCP IoT Core compatibility layer from e4.4	2023-08-10 09:44:55 -03:00
Ivan Dyachkov	801c93dd46	chore: v5.1.5-build.3	2023-08-10 12:56:28 +02:00
Ivan Dyachkov	6ead09b28d	chore: merge 'upstream/master'	2023-08-10 12:56:00 +02:00
firest	6dbddfb089	fix(limiter): simplify the code of the limiter ... move runtime code out from the schema	2023-08-10 18:20:05 +08:00
zhongwencool	aa798e531e	Merge pull request #11409 from zhongwencool/opentelemetry-metrics ... feat: support opentelemetry metrics	2023-08-10 14:35:25 +08:00
zhongwencool	d1dc37af4c	Merge pull request #11279 from zhongwencool/trace-log ... fix: don't be kill when send large payload when log is debug	2023-08-10 11:58:31 +08:00
lafirest	b2394cf92d	Merge pull request #11399 from lafirest/fix/ph_utf8 ... fix(placeholder): porting fix to support utf8 key in placeholder	2023-08-10 09:41:39 +08:00
zhongwencool	5a4dd3a5e5	fix: truncate large payload	2023-08-10 09:35:12 +08:00
zhongwencool	d5fe891961	fix: don't be kill when send large payload when log is debug	2023-08-10 09:22:30 +08:00
Thales Macedo Garitezi	bb8ce68c2e	docs: Generate changelog for v5.1.5-patch.2	2023-08-09 16:38:28 -03:00
Thales Macedo Garitezi	95df958f10	docs: Generate changelog for v5.1.5-patch.1	2023-08-09 13:18:09 -03:00
Thales Macedo Garitezi	cce0d144f9	Merge branch 'master' into release-v515-patch1-20230809	2023-08-09 13:08:43 -03:00
Paulo Zulato	a85c948e23	feat(gcp-iot): port GCP IoT Core compatibility layer from e4.4 ... Fixes https://emqx.atlassian.net/browse/EMQX-10341	2023-08-09 10:48:25 -03:00
zhongwencool	3933227636	feat: support opentelemetry metrics	2023-08-09 20:23:40 +08:00
lafirest	bef8eddad3	Merge pull request #11405 from lafirest/fix/kal_kialo ... fix(calendar): make date parse error reason more sense	2023-08-09 14:42:08 +08:00
lafirest	524d33a1fa	Merge pull request #11407 from lafirest/fix/config_name_example ... fix(ldap): improve configuration name and docs	2023-08-09 14:41:53 +08:00
firest	3e9155fdb1	chore: bump emqx_utils version && changes	2023-08-09 10:54:56 +08:00
firest	7567d211da	fix(placeholder): porting fix to support utf8 key in placeholder	2023-08-09 10:54:41 +08:00
firest	177ec161a1	fix(ldap): improve configuration name and docs	2023-08-09 09:39:57 +08:00
Thales Macedo Garitezi	fdfdb105f0	docs: Generate changelog for v5.1.5	2023-08-08 10:33:34 -03:00
Thales Macedo Garitezi	a1ffd0263d	fix(cacerts): add cacerts back as deprecated to allow upgrading from older versions ... See https://github.com/emqx/emqx/issues/11380	2023-08-08 10:13:13 -03:00
Kjell Winblad	b38461e50a	fix: mongo_date/2 shall give user friendly value in the test environment	2023-08-08 14:47:07 +02:00
Ilya Averyanov	9245162394	chore(rebalance): fix flaky test	2023-08-08 13:06:25 +03:00
firest	9f38f5f26a	fix(calendar): make date parse error reason more sense	2023-08-08 14:28:38 +08:00
Thales Macedo Garitezi	b6decf9592	Merge pull request #11402 from thalesmg/dynamic-kconsu-mqtt-topics-20230807 ... feat(kafka_consumer): add mqtt topic placeholder support	2023-08-07 15:10:29 -03:00
Thales Macedo Garitezi	29e706c83d	refactor: move catch to dry run fn	2023-08-07 13:08:34 -03:00
Thales Macedo Garitezi	4b8cea4498	fix: make error handling more flexible	2023-08-07 13:08:34 -03:00
Thales Macedo Garitezi	963d63b899	refactor: rename temporary name ... Co-authored-by: Zaiming (Stone) Shi <zmstone@gmail.com>	2023-08-07 13:08:34 -03:00
Thales Macedo Garitezi	5c8dc092a1	fix(http_bridge): don't attempt to convert headers to atoms ... Fixes https://emqx.atlassian.net/browse/EMQX-10653	2023-08-07 13:08:34 -03:00
Thales Macedo Garitezi	d5847f33a8	test: attempt to stabilize flaky tests	2023-08-07 13:08:34 -03:00
Thales Macedo Garitezi	9900a32850	feat(kafka_consumer): add mqtt topic placeholder support ... Fixes https://emqx.atlassian.net/browse/EMQX-10678	2023-08-07 11:42:34 -03:00
Kjell Winblad	3ed031db70	fix: rule SQL mongo_date function should return a string in test mode ... The rule SQL mongo_date function should return a string with the format ISODate(*), where * is an ISO date string when running the rule in test mode. Fixes: https://emqx.atlassian.net/browse/EMQX-10727	2023-08-07 16:10:30 +02:00
lafirest	2b03436552	Merge pull request #11392 from lafirest/feat/ldap_authz ... feat(ldap-authz): integrate the LDAP authorization	2023-08-07 11:12:05 +08:00
zhongwencool	665695a977	Merge pull request #11388 from SergeTupchiy/EMQX-10703-fix-replicant-crash-when-core-terminates-abnormally ... fix: increase emqx_router_sup restart intensity	2023-08-06 14:40:32 +08:00
Serge Tupchii	2b7798608d	fix(emqx_router_helper): don't cleanup down node on a replicant ... The cleanup on a replicant node is redundant, as Mria would delegate this delete op to a core node (via RPC), and the core node is expected to receive the same `nodedown` message and process it.	2023-08-04 16:55:36 +03:00
SergeTupchiy	2044326734	Merge pull request #11390 from SergeTupchiy/EMQX-10661-improve-perf-high-latency-cluster-network ... EMQX-10661 improve performance on high latency cluster network	2023-08-04 16:41:08 +03:00
Zaiming (Stone) Shi	115ab85670	chore: upgrade Kafka client wolff to 1.7.7	2023-08-04 15:31:34 +02:00
firest	b24a9d5343	chore(ldap-authz): update apps version && changes	2023-08-04 18:14:09 +08:00
firest	0571fd8cac	feat(ldap-authz): integrate the LDAP authorization	2023-08-04 18:14:01 +08:00
Serge Tupchii	f276ea9e91	fix: increase emqx_router_sup restart intensity ... The goal is to tolerate occasional crashes that can happen under relatively normal conditions and don't seem critical to shutdown the whole app (emqx). For example, mria write/delete call delegated from a replicant to a core node may fail, if the core node is being stopped / restarted / not ready. Fixes: EMQX-10703, #11310	2023-08-04 10:49:59 +03:00
firest	7055eafb91	fix(ldap): fix license date and some minor problems	2023-08-04 11:01:13 +08:00
lafirest	1b0b15786c	Merge pull request #11386 from lafirest/feat/ldap_authn ... feat(authn): integrate the LDAP authentication	2023-08-04 09:37:37 +08:00
Andrew Mayorov	420653e5a2	Merge pull request #11389 from keynslug/perf/EMQX-10706/squash-retained-index ... perf(retainer): squash index updates into single dirty activity	2023-08-03 21:32:04 +04:00
Serge Tupchii	466fe7e009	perf: add broker_pool_size, generic_pool_size and channel_cleanup_batch_size config options ... Tuning these options can improve performance if cluster interconnect network latency is high. Fixes: EMQX-10661	2023-08-03 19:44:00 +03:00
Serge Tupchii	ed28c12a66	chore(emqx_conf): deprecate node.tlog_push_mode setting ... It is not used since mria 0.2.10	2023-08-03 17:46:14 +03:00
Andrew Mayorov	0e0c0d0e1e	chore: bump emqx_retainer to 5.0.16	2023-08-03 15:35:21 +04:00
Andrew Mayorov	534a741b0e	perf(retainer): do not GC on replicant nodes	2023-08-03 15:34:24 +04:00
firest	efff585b82	feat(ldap-authn): add test suite for the LDAP authenticator	2023-08-03 18:56:41 +08:00
Andrew Mayorov	42be694d40	perf(retainer): squash index updates into single dirty activity ... In order to minimize number of round trips to core nodes and between them, improving publishing latency. This shouldn't make consistency worse than it was before.	2023-08-03 12:51:36 +04:00
Andrew Mayorov	39bb9d5136	chore: bump ekka to 0.15.10 ... Which sports mria 0.6.0 with dirty activities support.	2023-08-03 11:38:53 +04:00
firest	18b3db336a	fix(ldap-authn): remove slat-related configs since they conflict with RFC 3123	2023-08-03 11:00:42 +08:00
Paulo Zulato	2c63fe3bcd	fix(greptimedb): add sync_start to avoid false negative healthy check ... Fixes https://emqx.atlassian.net/browse/EMQX-10709	2023-08-02 19:40:23 -03:00
Paulo Zulato	97fdc834de	Merge pull request #11381 from paulozulato/fix-oracle-doc-link ... doc(oracle): add link to online documentation into README	2023-08-02 12:10:59 -03:00
firest	c041216ec0	feat(authn): integrate the LDAP authentication	2023-08-02 19:19:17 +08:00
firest	9bb5c9de33	fix(ldap): make elvis happy	2023-08-02 11:02:02 +08:00
firest	b2f3ac9967	fix(ldap): fix newline error && correcting files header	2023-08-02 10:07:27 +08:00
Paulo Zulato	b8be080ffb	docs(oracle): add link to online documentation into README ... Fixes https://emqx.atlassian.net/browse/EMQX-10694	2023-08-01 16:20:31 -03:00
firest	f98f97f37e	feat(ldap): set test env and add test suites	2023-08-01 18:49:54 +08:00
firest	8c9b136d15	fix(ldap): integrate parser and fix lexer errors	2023-08-01 18:49:54 +08:00
firest	fa6343cc80	feat(ldap): add LDAP connector	2023-08-01 18:49:54 +08:00
Ivan Dyachkov	0f161a81c3	chore: v5.1.4	2023-08-01 09:20:46 +02:00
Thales Macedo Garitezi	41606aa840	Merge pull request #11373 from thalesmg/fix-spellcheck-master-20230731 ... fix(spellcheck): fix several spellcheck issues not caught in CI	2023-07-31 18:00:31 -03:00
Thales Macedo Garitezi	620b5fc048	fix(spellcheck): fix several spellcheck issues not caught in CI ... Fixes some issus later found by CI that somehow didn't block the originating PRs. Example failure: https://github.com/emqx/emqx/actions/runs/5715470851/job/15485284918?pr=11372	2023-07-31 14:32:12 -03:00
Thales Macedo Garitezi	7687770821	fix(tls): remove cacerts config for now ... Fixes https://github.com/emqx/emqx/issues/11370 Related: https://github.com/emqx/emqx/pull/11371	2023-07-31 10:44:05 -03:00
Thales Macedo Garitezi	a3be1529c6	fix(schema): ensure enterprise module is correctly loaded ... Fixes https://emqx.atlassian.net/browse/EMQX-10654 Despite loading the application in `nodetool`, we need to invoke `:module_info()` to force the module to be actually loaded, especially when it's called in `call_hocon` to generate the initial configurations. Otherwise, it'll fail to list all the bridge schemas.	2023-07-28 16:27:43 -03:00
Thales Macedo Garitezi	d6344ab709	Merge pull request #11363 from thalesmg/rabbit-tls-20230727 ... feat(rabbitmq_bridge): add TLS support	2023-07-28 13:23:30 -03:00
Thales Macedo Garitezi	2ee1aa6d60	Merge pull request #11347 from thalesmg/fix-ocsp-path-encoding-20230725 ... fix(ocsp): URL encode request path	2023-07-28 09:01:39 -03:00
Thales Macedo Garitezi	399f849f7b	feat(rabbitmq_bridge): add TLS support ... Fixes https://emqx.atlassian.net/browse/EMQX-10605	2023-07-27 15:52:46 -03:00
Ivan Dyachkov	d51b5b739b	chore: v5.1.3	2023-07-27 17:00:20 +02:00
Ivan Dyachkov	5ac01c9b85	Merge pull request #11360 from id/0727-sync-release-51-to-master	2023-07-27 16:58:09 +02:00
Thales Macedo Garitezi	ee3d002fca	Merge pull request #11329 from thalesmg/aeh-bridge-20230720 ... feat: add Azure Event Hub Producer bridge	2023-07-27 11:18:40 -03:00
Ivan Dyachkov	63adeabf72	chore: bump app versions	2023-07-27 15:29:03 +02:00
Ivan Dyachkov	cbfca8c043	chore: merge master into release-51	2023-07-27 15:19:57 +02:00
Thales Macedo Garitezi	5abe4bed88	feat: add Azure Event Hub Producer bridge ... Fixes https://emqx.atlassian.net/browse/EMQX-10338	2023-07-27 09:22:39 -03:00
Ivan Dyachkov	50a0900d92	chore: e5.1.1	2023-07-27 12:18:03 +02:00
JianBo He	951a96457b	Revert "feat(index): add topic index facility "	2023-07-27 13:42:43 +08:00
JianBo He	5e4855334e	Revert "Fix(topicidx): allow to return matches unique by record id"	2023-07-27 13:39:37 +08:00
firest	abf8d8b391	fix(ds): make dialyzer happy	2023-07-26 16:35:07 +08:00
firest	14b76916df	fix(ds): avoid crashes when starting on Windows	2023-07-26 15:37:58 +08:00
Thales Macedo Garitezi	2ac8ba2add	test: fix flaky test	2023-07-25 17:43:33 -03:00
Thales Macedo Garitezi	d3d52695d5	feat(tls): automatically add cacerts to client opts ... `public_key:cacerts_get/0` was introduced in OTP 25 and allows us to load the system trusted CA certificates. https://www.erlang.org/doc/man/public_key.html#cacerts_get-0	2023-07-25 17:43:33 -03:00
Thales Macedo Garitezi	d0deaca00d	fix(ocsp): URL encode request path ... Fixes https://emqx.atlassian.net/browse/EMQX-10624	2023-07-25 17:39:38 -03:00
Serge Tupchii	77184c00ff	chore(ekka): Bump version to 0.15.9	2023-07-25 19:29:18 +03:00
Ivan Dyachkov	f9d3d3325b	chore: e5.1.1-rc.1	2023-07-25 16:34:25 +02:00
Ilya Averyanov	2909b1de2d	Merge pull request #11339 from savonarola/0724-fix-subscribe-qos-authz ... fix(authz): correctly identify qos of subscribe actions	2023-07-25 17:07:57 +03:00
Thales Macedo Garitezi	c7bf3ece34	Merge pull request #11338 from thalesmg/fix-pgsql-error-r51-20230724 ... fix(postgres_bridge): fix table existence check and handle sync_required	2023-07-25 10:53:03 -03:00
Paulo Zulato	7ee17553d5	Merge pull request #11337 from paulozulato/fix-error-code-topic-wildcard ... fix(topic_rewrite): handle error when target contains wildcards	2023-07-25 10:37:20 -03:00
Paulo Zulato	8ec14bb07e	fix(topic_rewrite): handle error when target contains wildcards ... Fixes https://emqx.atlassian.net/browse/EMQX-10565	2023-07-25 09:43:14 -03:00
Ilya Averyanov	deaac9bd73	fix(authz): correctly identify qos of subscribe actions	2023-07-25 15:20:52 +03:00
Thales Macedo Garitezi	7a16ff4f04	fix(postgres_bridge): fix table existence check and handle sync_required ... Fixes https://emqx.atlassian.net/browse/EMQX-10629 During health checking, we check whether tables in the SQL statement exist. Such check was done by asking the backend to parse the statement using a named prepared statements. Concurrent health checks could then result in the error: ```erlang {error,{error,error,<<"42P05">>,duplicate_prepared_statement,<<"prepared statement \"get_status\" already exists">>,[{file,<<"prepare.c">>},{line,<<"451">>},{routine,<<"StorePreparedStatement">>},{severity,<<"ERROR">>}]}} ``` This could lead to an inconsistent state in the driver process, which would crash later when a message from the backend (`READY_FOR_QUERY`, "idle"): ``` 2023-07-24T13:05:58.892043+00:00 [error] Generic server <0.2134.0> terminating. Reason: {'module could not be loaded',[{undefined,handle_message,[90,<<"I">>,... ``` Added calls to `epgsql:sync/1` for functions that could return `{error, sync_required}`. Also, redundant calls to `parse2` were removed to reduce the number of requests.	2023-07-25 09:15:14 -03:00
zhongwencool	2c193f26e6	Merge pull request #11332 from HJianBo/fix-topic-index-unique-bugs	2023-07-25 19:07:07 +08:00
JianBo He	d05a5cfe0f	fix(rule): fix the matches/2 for some edge cases	2023-07-25 14:35:18 +08:00
Paulo Zulato	69f4275871	fix(oracle): fix return error checking on table validation ... Fixes https://emqx.atlassian.net/browse/EMQX-10622	2023-07-24 14:50:38 -03:00
JianBo He	e630331de1	fix(rule): fix a quering problem when 'a/b' and 'a/b/#' exist at the same time. ... When using `ets:next` to query the next level of topic words, we should prioritize the next level of '#', '+'.	2023-07-24 23:04:53 +08:00
JianBo He	f848c0b87a	Merge pull request #11333 from JimMoen/chore-hide-hstreamdb ... chore: hidden hstreamdb bridge schema	2023-07-24 21:54:10 +08:00
JianBo He	511d1b6ca1	chore: hide the hstreamdb http api	2023-07-24 20:11:44 +08:00
JianBo He	dcf4819c04	test(rule): add tests to ensure the rules ordering	2023-07-24 19:30:34 +08:00
firest	8439ce0e84	chore: update app version && reboot_lists	2023-07-24 19:08:41 +08:00
Dennis Zhuang	9f200120c2	feat: use http port to detect server availability	2023-07-24 17:58:48 +08:00
Dennis Zhuang	cd9d5f287e	chore: adds auto_reconnect for ecpool	2023-07-24 17:58:48 +08:00
Dennis Zhuang	2ea903c5ac	fix: static checks failures	2023-07-24 17:58:48 +08:00
Dennis Zhuang	b34374c26f	chore: by CR comments	2023-07-24 17:58:48 +08:00
Dennis Zhuang	c9550cc2e5	refactor: rename bridge greptimedb_grpc_v1 to greptimedb	2023-07-24 17:58:48 +08:00
Dennis Zhuang	a1c7eb337b	fix: dependency name	2023-07-24 17:58:48 +08:00
Dennis Zhuang	50c10dd919	chore: update greptimedb-client-erl to v0.1.2	2023-07-24 17:58:48 +08:00
Dennis Zhuang	3b1363dbb7	chore: change license to BCL and adds emqx_bridge_greptimedb_connector_SUITE	2023-07-24 17:58:48 +08:00
Dennis Zhuang	6f7fbcf693	fix: compile error	2023-07-24 17:58:48 +08:00
Dennis Zhuang	4921856950	test: make all emqx_bridge_greptimedb_SUITE tests passing	2023-07-24 17:58:48 +08:00
Dennis Zhuang	c6a7f3e2ad	test: make test passed 21/29	2023-07-24 17:58:48 +08:00
Dennis Zhuang	975795a6e0	feat: add ci test	2023-07-24 17:58:48 +08:00
Dennis Zhuang	89bce99870	test: greptimedb data brige	2023-07-24 17:58:48 +08:00
Dennis Zhuang	91ebd90442	fix: batch write	2023-07-24 17:58:48 +08:00
Dennis Zhuang	6d9944a8e8	feat: update greptimedb dependencies	2023-07-24 17:58:48 +08:00
Dennis Zhuang	417e017498	feat: begin to impl connector	2023-07-24 17:58:48 +08:00
Dennis Zhuang	c5078980f3	feat: adds the greptimedb bridge to emqx modules	2023-07-24 17:58:48 +08:00
Dennis Zhuang	4d581d0b30	feat: init commit	2023-07-24 17:58:48 +08:00
Andrew Mayorov	0496038361	fix(ruleeng): ensure topic index matched rules evalauted once	2023-07-24 17:44:12 +08:00
Andrew Mayorov	6432c9c8fc	fix(topicidx): allow to return matches unique by record id	2023-07-24 17:43:11 +08:00
JimMoen	613dc1646c	chore: hidden hstreamdb bridge schema	2023-07-24 17:22:29 +08:00
firest	af6405fa25	fix(nested_put): fix a data loss bug introduced by #11172	2023-07-24 16:39:37 +08:00
Andrew Mayorov	81793c31fc	Merge pull request #11315 from keynslug/ft/EMQX-9593/peek-mqueue-info ... refactor(session): allow peeking at mqueue less intrusively	2023-07-24 09:57:05 +02:00
JimMoen	c393c2e091	test: ets table cleanup after cases	2023-07-24 09:33:28 +08:00
JimMoen	4e4b1ac115	refactor: module move to app emqx_rule_engine ... - Rename to emqx_rule_index.erl - Remove test funcs from src -> test dir	2023-07-24 09:33:28 +08:00
Andrew Mayorov	b821bdee00	perf(ruleeng): employ emqx_topic_index to speed up topic matching	2023-07-24 09:27:31 +08:00
Andrew Mayorov	28dad5d7a9	feat(index): add topic index facility ... Somewhat similar to `emqx_trie` in design and logic, yet built on top of a single, potentially pre-existing table.	2023-07-24 09:27:31 +08:00
Paulo Zulato	31cf05ec66	Merge pull request #11316 from paulozulato/fix-oracle-pool-size ... fix(oracle): fix Pool Size parameter retrieval	2023-07-21 17:51:21 -03:00
Thales Macedo Garitezi	2531c3e7d1	Merge pull request #11306 from thalesmg/rule-actions-reply-dropped-r51-20230719 ... fix(rule_metrics): notify rule metrics of late replies and expired requests	2023-07-21 16:51:14 -03:00
Ivan Dyachkov	29432009db	chore: 5.1.1-alpha.4	2023-07-21 18:42:14 +02:00
ieQu1	485e495b98	chore(ekka): Bump version to 0.15.8 (mria 0.5.10)	2023-07-21 18:31:02 +02:00
Paulo Zulato	85ab97970f	fix(oracle): fix Pool Size parameter retrieval ... Fixes https://emqx.atlassian.net/browse/EMQX-10599	2023-07-21 11:02:27 -03:00
Ivan Dyachkov	c2c3da073f	chore: v5.1.2	2023-07-21 13:26:29 +02:00
Ivan Dyachkov	243b8f5b67	chore: merge 'upstream/master' into v5.1.2	2023-07-21 13:25:46 +02:00
Ivan Dyachkov	3a3b843f4a	fix(machine): add emqx_bridge_kinesis to reboot_lists.eterm	2023-07-21 13:20:50 +02:00
SergeTupchiy	04bd7c7eed	Merge pull request #11322 from SergeTupchiy/EMQX-10590-data-import-fix-missing-config-rel51 ... EMQX-10590 data import fix missing config relealse 51	2023-07-21 12:36:21 +03:00
Serge Tupchii	ee97cf8e33	fix(emqx_modules): ignore already_existed/not_found errors for added/removed topic metrics	2023-07-21 12:17:47 +03:00
zhongwencool	520ae0e9d3	chore: remove zone desc from document	2023-07-21 15:51:21 +08:00
Serge Tupchii	b37920d2e5	feat: add topic_metrics and slow_subs configuration to data import/export ... Fixes: EMQX-10590	2023-07-21 10:41:22 +03:00
Serge Tupchii	a1a7c4fab6	fix(emqx_rule_engine): fix typo in behaviour module attribute ... The type resulted in missing `rule_engine` config after importing data from a backup file. Fixes: EMQX-10590	2023-07-21 10:33:56 +03:00
zhongwencool	d3e4fda21d	fix: hocon_pp quote string for special char	2023-07-21 12:31:22 +08:00
Paulo Zulato	0827a45c89	Merge pull request #11307 from paulozulato/fix-oracle-table-check ... fix(oracle): discard nested tokens when checking table	2023-07-20 19:19:50 -03:00
Andrew Mayorov	e1e4c64a30	refactor(session): allow peeking at mqueue less intrusively	2023-07-20 21:21:30 +02:00
Thales Macedo Garitezi	54efc04a6f	Merge pull request #11309 from thalesmg/fix-machine-boot-reboot-r51-20230719 ... fix(machine_boot): use shared list of reboot apps and add bridges to reboot list	2023-07-20 14:33:16 -03:00
Thales Macedo Garitezi	6cd503865b	fix(machine_boot): ensure emqx_bridge starts after its companion apps ... We need to reverse the dependency of `emqx_bridge` and `emqx_bridge_*`, because the former loads and starts bridges during its application startup. If the individual bridge application being loaded has not started with its dependencies, the supervision tree will not be ready for that.	2023-07-20 13:11:44 -03:00
Thales Macedo Garitezi	3b1e436d3f	refactor: use emqx_pool:async_submit to avoid excessive spawning	2023-07-20 10:17:43 -03:00
JianBo He	b9f0cd7ba4	chore: pretty the cli output style	2023-07-20 21:01:28 +08:00
Thales Macedo Garitezi	77e2d852e5	fix: add emqx_durable_storage to app list	2023-07-20 09:55:05 -03:00
Andrew Mayorov	f2a32e8ed2	Merge pull request #11304 from keynslug/ft/EMQX-9593/ds-session-connect ... refactor(session): minimize `emqx_session` interface surface	2023-07-20 14:33:21 +02:00
Thales Macedo Garitezi	89ea40a8b7	refactor: apply review remarks	2023-07-20 09:31:13 -03:00
zhongwencool	3cd223ff5b	chore: add more detail msg for merging failed	2023-07-20 17:48:26 +08:00
SergeTupchiy	8480a26b66	Merge pull request #11065 from SergeTupchiy/EMQX-9992-fix-async-cleanup-error-logs ... fix: avoid logging unnecessary errors in async cleanup functions	2023-07-20 12:20:57 +03:00
Thales Macedo Garitezi	b9b11d8f4d	fix(machine_boot): use shared list of reboot apps and add bridges to reboot list	2023-07-19 20:15:42 -03:00
Paulo Zulato	e76ba760c9	fix(oracle): discard nested tokens when checking table ... Fixes https://emqx.atlassian.net/browse/EMQX-10597	2023-07-19 15:03:49 -03:00
Thales Macedo Garitezi	eb41b77de4	fix(rule_metrics): notify rule metrics of late replies and expired requests ... Fixes https://emqx.atlassian.net/browse/EMQX-10600	2023-07-19 11:39:28 -03:00
Serge Tupchii	ff4119e8b3	chore(emqx_config): fix typo in the log message	2023-07-19 16:58:21 +03:00
Thales Macedo Garitezi	41b780f7f2	Merge pull request #11280 from thalesmg/unhide-gcp-consumer-master-20230717 ... chore(gcp_pubsub_consumer): unhide GCP PubSub Consumer bridge for e5.2.0	2023-07-19 10:26:42 -03:00
Thales Macedo Garitezi	6003c34ce5	Merge pull request #11283 from thalesmg/flaky-test-20230717 ... test(http): attempt to stabilize flaky tests	2023-07-19 10:24:07 -03:00
ieQu1	57e39f42c5	Merge pull request #11294 from ieQu1/mria-fixes ... Mria fixes	2023-07-19 15:10:42 +02:00
Andrew Mayorov	dd31487b4a	refactor(session): drop is_session/1 helper as useless ... This is a part of effort to minimize `emqx_session` module interface to simplify adding alternative session implementations.	2023-07-19 14:55:26 +02:00
Andrew Mayorov	0cd2351134	refactor(session): hide no_local logic behind enqueue / deliver ... This is a part of effort to minimize `emqx_session` module interface to simplify adding alternative session implementations.	2023-07-19 14:55:26 +02:00
Ivan Dyachkov	f29a9ed9d5	Merge pull request #11301 from id/0719-sync-release-51-to-master	2023-07-19 14:21:26 +02:00
lafirest	d4550f911c	Merge pull request #11299 from lafirest/hs ... fix(hstream): handle the `unavailable` error code	2023-07-19 17:47:30 +08:00
Andrew Mayorov	92166f287a	Merge pull request #11293 from keynslug/fix/EMQX-9591/phase-out-persistence ... chore(ps): phase out existing session persistence mechanism	2023-07-19 10:36:46 +02:00
Ivan Dyachkov	b7f0f7b32d	chore: merge master into release-51	2023-07-19 09:28:05 +02:00
firest	7ac8715358	fix(hstream): handle the unavailable error code ... The "unavailable" error code just means that the HStream is warming up or busy, HStream guarantees that a retry will work well.	2023-07-19 14:43:50 +08:00
zhongwencool	0524c3b3b1	test: configs SUITE crash	2023-07-19 11:05:14 +08:00
JianBo He	439eb4d029	test: cover the node params for get /configs endpoint	2023-07-19 11:05:14 +08:00
JianBo He	74532a64e6	chore: update apps/emqx_management/src/emqx_mgmt_api_configs.erl	2023-07-19 11:05:14 +08:00
zhongwencool	402f75592e	chore: move rpc call from emqx_management_proto to emqx_conf_proto	2023-07-19 11:05:14 +08:00
zhongwencool	8a0f7bfd99	chore: update version bpapi.versions	2023-07-19 11:05:14 +08:00
zhongwencool	59ed65787f	fix: get_config return target node's node conf	2023-07-19 11:05:14 +08:00
Paulo Zulato	27630ca215	Merge pull request #11261 from paulozulato/feat-bridge-kinesis ... Implement Amazon Kinesis Producer bridge	2023-07-18 16:48:34 -03:00
ieQu1	3a5112829c	fix(mgmt_cli): Don't print cluster status on the replicant	2023-07-18 21:45:00 +02:00
ieQu1	ce76d4ab04	chore(ekka): Bump version to 0.15.7 (mria 0.5.9)	2023-07-18 21:45:00 +02:00
ieQu1	103b89f60c	fix(mgmt_cli): Don't crash when mria is not running	2023-07-18 21:45:00 +02:00
ieQu1	293700773f	refactor(mgmt_cli): Call mria directly	2023-07-18 21:45:00 +02:00
Serge Tupchii	2954ff7300	feat: add topic_metrics and slow_subs configuration to data import/export ... Fixes: EMQX-10590	2023-07-18 20:53:10 +03:00
Serge Tupchii	c9985758d9	fix(emqx_rule_engine): fix typo in behaviour module attribute ... The type resulted in missing `rule_engine` config after importing data from a backup file. Fixes: EMQX-10590	2023-07-18 20:35:21 +03:00
Ivan Dyachkov	de4cc492d4	chore: e5.1.1-alpha.2	2023-07-18 18:55:24 +02:00
Thales Macedo Garitezi	4ec4041f99	Merge pull request #11281 from thalesmg/restore-queue-shared-sub-r51-20230717 ... fix(shared_sub): restore support for `$queue/` shared subscription	2023-07-18 13:52:44 -03:00
Ivan Dyachkov	ca51732d8e	Merge pull request #11292 from emqx/update-rocksdb	2023-07-18 16:14:50 +02:00
Thales Macedo Garitezi	cb1e0cdc89	test(http): attempt to stabilize flaky tests	2023-07-18 10:51:04 -03:00
Andrew Mayorov	3ba6d34511	chore(eviction): phase out session persistence concerns	2023-07-18 15:47:12 +02:00
Andrew Mayorov	0a00c39282	chore(ps): phase out existing session persistence mechanism ... * It's not really working currently in a cluster setup. * It's not really working well. * It would be much easier to integrate `emqx_durable_storage` w/o the need to support existing solution.	2023-07-18 15:46:04 +02:00
Thales Macedo Garitezi	91cd88c136	fix(api_mgmt): use emqx_topic:join for correct construction of topics	2023-07-18 10:19:55 -03:00
Thales Macedo Garitezi	4a889c0994	chore: bump ekka -> 0.15.6 ... https://github.com/emqx/erlang-rocksdb/releases/tag/1.8.0-emqx-1	2023-07-18 09:00:29 -03:00
firest	4f4a813f04	fix(tdengine): update the default template and the changelog	2023-07-18 10:31:18 +00:00
Thales Macedo Garitezi	1fdcfba629	fix(shared_sub): restore support for $queue/ shared subscription ... Partially addresses: https://emqx.atlassian.net/browse/EMQX-4589 There's still a problem with the handling of shared groups that is _not particular to the `$queue/` syntax_ and preexistent that the same client cannot subscribe to _different groups_ that have the same _topic filter_.	2023-07-17 16:41:24 -03:00
Paulo Zulato	484519dcf9	feat(kinesis): implement Amazon Kinesis Producer bridge ... Fixes https://emqx.atlassian.net/browse/EMQX-10474 Fixes https://emqx.atlassian.net/browse/EMQX-10475	2023-07-17 11:51:42 -03:00
Thales Macedo Garitezi	05c3e023a9	chore(gcp_pubsub_consumer): unhide GCP PubSub Consumer bridge for e5.2.0 ... Fixes https://emqx.atlassian.net/browse/EMQX-10506	2023-07-17 11:24:21 -03:00
Thales Macedo Garitezi	ab5fd1e5c3	Merge pull request #11260 from thalesmg/fix-rule-maps-nested-put-r51 ... fix(rule_maps): avoid losing data when using `emqx_rule_maps:nested_put`	2023-07-14 15:02:24 -03:00
zhongwencool	0a35b7875f	Merge pull request #11269 from zhongwencool/fix-process-limit-hidden ... fix: hide node.process_limit completely	2023-07-14 22:32:41 +08:00
lafirest	f6834b33a0	Merge pull request #11266 from lafirest/fix/influxdb-ph ... fix(tdengine): fix SQL template errors	2023-07-14 22:29:16 +08:00
zhongwencool	f853f3d3bd	Merge pull request #11271 from zhongwencool/fix-precent-check ... fix: keep percentage type's range is 0%~100%	2023-07-14 22:07:41 +08:00
Thales Macedo Garitezi	f9452241bd	test(rules): add a few more tests to assert our rule evaluation behavior	2023-07-14 10:23:20 -03:00
Serge Tupchii	950d5edc41	fix: avoid logging unnecessary errors in async cleanup functions ... Cleanup functions that access ETS tables may fail with `badarg` error during EMQX shutdown. They are called asynchronously by `emqx_pool` workers and accessed ETS tables may be already destroyed as their owners are shut down. This fix catches ETS `badarg` errors before they can be caught and logged by `emqx_pool`. Fixes: EMQX-9992	2023-07-14 14:22:43 +03:00
firest	fea73cf17d	fix(log): fix the pubrel typo in the log	2023-07-14 17:19:50 +08:00
zhongwencool	11ee6abf02	fix: keep precent range is 0%~100%	2023-07-14 16:48:50 +08:00
zhongwencool	131511b10e	fix: hide process_limit completely	2023-07-14 11:04:20 +08:00
Thales Macedo Garitezi	01b143c5ad	fix(resource): don't destruct error tuple ... Otherwise, `emqx_resource:query` won't correctly deem the resource to be unhealthy when there's an extra message.	2023-07-13 16:12:33 -03:00
Thales Macedo Garitezi	0dff428efb	Merge pull request #11262 from thalesmg/fix-gcp-consumer-hc-20230712-master ... fix(gcp_pubsub_consumer): fail health check when there are no workers	2023-07-13 15:09:02 -03:00
Thales Macedo Garitezi	4034bcbb26	fix(rule_runtime): avoid rewriting select clause sources (by @keynslug) ... Thanks to @keynslug for the insight and the patch. With this, we avoid rewriting the parsed select clause sources, and attempt to reuse the result context when reading values during evaluation.	2023-07-13 14:46:08 -03:00
Thales Macedo Garitezi	924ed06760	Merge pull request #11256 from thalesmg/bridge-api-ecpool-400-errors-20230712-r51 ... fix(bridge_api): return 400 for all ecpool start errors	2023-07-13 10:05:07 -03:00
firest	749b8cd2ed	test(tdengine): cover multi-table insert && subtable name generation	2023-07-13 07:39:01 +00:00
firest	fef5087c41	fix(tdengine): fix SQL template errors ... 1. supports multi-table insert 2. supports constructing subtable names by mixed prefixes and placeholders	2023-07-13 04:44:48 +00:00
JimMoen	c23c3a1f78	fix: hstreamdb connector use unified schema	2023-07-13 10:47:45 +08:00
Thales Macedo Garitezi	06010f7ca9	Merge remote-tracking branch 'origin/release-51' into sync-r51-20230712	2023-07-12 16:47:45 -03:00
Thales Macedo Garitezi	be7918aa41	fix(gcp_pubsub_consumer): fail health check when there are no workers ... `ecpool` already returns an error even if the worker process is dead, but we add the empty worker list clause here just for completeness.	2023-07-12 16:31:21 -03:00
Thales Macedo Garitezi	bbff1d6ae9	fix(bridge_api): return 400 for all ecpool start errors ... Fixes https://emqx.atlassian.net/browse/EMQX-10460 (https://emqx.atlassian.net/browse/EMQX-10460?focusedCommentId=30126)	2023-07-12 15:32:34 -03:00
Thales Macedo Garitezi	bffef386c1	fix(rule_maps): avoid losing data when using emqx_rule_maps:nested_put ... Fixes https://emqx.atlassian.net/browse/EMQX-10541	2023-07-12 14:28:18 -03:00
Ivan Dyachkov	8ebe099653	Merge pull request #11253 from id/kjell/refactor/http_bridge/EMQX-9568 ... refactor: HTTP bridge into the emqx_bridge_http application	2023-07-12 15:58:02 +02:00
Ivan Dyachkov	6180e775f4	test: fix mocking and application start	2023-07-12 14:47:52 +02:00
Ivan Dyachkov	8815e58149	chore: remove docker-ct from emqx_bridge_http since toxiproxy is not used in CT	2023-07-12 14:47:46 +02:00
Ivan Dyachkov	45f94df7b1	fix: add ehttpc as emqx_bridge_http dependency	2023-07-12 14:47:39 +02:00
Thales Macedo Garitezi	c94dc2e63f	fix: add emqx_dashboard as a dependency of emqx_machine ... ``` ===> Compiling emqx_machine ===> Compiling src/user_default.erl failed src/user_default.erl:{24,14}: can't find include lib "emqx_dashboard/include/emqx_dashboard.hrl"; Make sure emqx_dashboard is in your app file's 'applications' list ==> emqx_mix ** (Mix) Could not compile dependency :emqx_machine, "/github/home/.mix/elixir/1-14/rebar3 bare compile --paths /__w/emqx/emqx/_build/emqx/lib/*/ebin" command failed. Errors may have been logged above. You can recompile this dependency with "mix deps.compile emqx_machine", update it with "mix deps.update emqx_machine" or clean it with "mix deps.clean emqx_machine" make: *** [Makefile:276: emqx-elixir] Error 1 ```	2023-07-12 14:47:28 +02:00
Kjell Winblad	6ce47614d2	refactor: HTTP bridge into the emqx_bridge_http app ... Fixes: https://emqx.atlassian.net/browse/EMQX-9568	2023-07-12 14:47:02 +02:00
Kjell Winblad	f28510b3ad	refactor: HTTP connector into emqx_bridge_http app	2023-07-12 14:46:43 +02:00
Thales Macedo Garitezi	541d03a0ba	refactor(schema_registry): refactor schema registry app and modules ... Fixes https://emqx.atlassian.net/browse/EMQX-10361 - Moves `lib-ee/emqx_ee_schema_registry` to `apps/emqx_schema_registry`. - Removes the `_ee_` segment from module names. - Exceptions are the table names which are kept to avoid backwards incompatibilities.	2023-07-12 09:24:15 -03:00
Serge Tupchii	cacfb51280	fix(emqx_machine): add emqx_ee_schema_registry to the reboot apps list ... As emqx_ee_schema_registry uses Mria tables (schema_registry_shard), a node joining a cluster needs to restart this application in order to restart relevant Mria shard processes.	2023-07-12 09:23:28 -03:00
zhongwencool	5b0695ca19	Merge pull request #11249 from zhongwencool/license-setting-api ... feat: add license setting get/put api	2023-07-12 18:34:23 +08:00
zhongwencool	f40d8318b7	fix: license validations is not working	2023-07-12 14:40:38 +08:00
SergeTupchiy	fce3060634	Merge pull request #11251 from SergeTupchiy/EMQX-10392-cluster-topology-api ... Add cluster topology HTTP API endpoint	2023-07-11 17:45:00 +03:00
Serge Tupchii	19de10be7c	feat(emqx_management): add /cluster/topology HTTP API endpoint ... The endpoint shows Mria RLOG cluster topology info: connections between core and replicant nodes. Closes: EMQX-10392	2023-07-11 16:25:36 +03:00
lafirest	903d81b532	Merge pull request #11250 from lafirest/fix/ws_order ... fix(ws): fix MQTT packets may be reversed in the WS	2023-07-11 20:09:55 +08:00
firest	211486a946	fix(ws): fix MQTT packets may be reversed in the WS ... Fix when a WS packet contains many MQTT packets, the order of MQTT packets will be reversed	2023-07-11 18:40:06 +08:00
JianBo He	e51a4ae81e	chore: avoid dialyzer warnings	2023-07-11 10:41:10 +08:00
JianBo He	15c91373fe	perf(http): improve the speed of clients querying in default parameters ... In https://github.com//emqx/emqx/pull/9749 we fixed the problem of incorrect total calculation. In this PR we added an option to improve the query speed when the query condition is empty	2023-07-11 10:41:10 +08:00
Andrew Mayorov	21fbf79c29	Merge pull request #11191 from keynslug/ft/EMQX-9591/msg-persistence-minimal ... feat(ds): hardwire emqx_durable_storage message persistence	2023-07-10 21:05:04 +02:00
Thales Macedo Garitezi	beb5be4de2	Merge pull request #11244 from thalesmg/ci-sorted-reboot-apps-check-master ... ci(machine_boot): add ci check for missing reboot apps	2023-07-10 15:56:10 -03:00
Thales Macedo Garitezi	a53768c1d4	fix(machine_boot): add emqx_durable_storage to reboot apps list	2023-07-10 14:39:44 -03:00
SergeTupchiy	721dbad300	Merge pull request #11242 from SergeTupchiy/add-schema_registry-app-to-reboot-list ... fix(emqx_machine): add emqx_ee_schema_registry to the reboot apps list	2023-07-10 20:17:59 +03:00
Andrew Mayorov	d91ab7dec9	test(ds): make emqx_persistent_messages_SUITE setup cleaner ... Co-authored-by: Thales Macedo Garitezi <thalesmg@gmail.com>	2023-07-10 18:12:16 +02:00
Ivan Dyachkov	fb96c1e20d	chore: bump to e5.1.1-alpha.1	2023-07-10 17:25:07 +02:00
Serge Tupchii	7f04fff2a8	fix(emqx_machine): add emqx_ee_schema_registry to the reboot apps list ... As emqx_ee_schema_registry uses Mria tables (schema_registry_shard), a node joining a cluster needs to restart this application in order to restart relevant Mria shard processes.	2023-07-10 18:04:22 +03:00
JianBo He	ae59a26659	Merge pull request #11223 from JimMoen/fix-influxdb-float-value-trans ... fix: influxdb float serialization error	2023-07-10 23:04:01 +08:00
Stefan Strigler	93a9772743	Merge pull request #11211 from sstrigler/EMQX-9963-refactor-all-http-ap-is-to-respond-404-on-the-deletion-of-the-resource-is-non-exist ... consistently return 404 if resource not found	2023-07-10 16:25:31 +02:00
Ilya Averyanov	58a83739b8	Merge pull request #10986 from savonarola/ft/EMQX-9523/config-api ... feat(ft-api): provide configuration API	2023-07-10 15:32:30 +03:00
Ilya Averyanov	12e237c36d	Merge pull request #11132 from savonarola/0531-authz-qos-retain ... feat(authz): use extensible map format for actions in authz rules	2023-07-10 15:32:02 +03:00
JimMoen	e30bc6afa8	test(influxdb): write raw as float for all number value	2023-07-10 20:00:09 +08:00
zhongwencool	f9e54ed8b1	Merge pull request #11237 from zhongwencool/prometheus-api-schema ... fix: bad prometheus schema for headers	2023-07-10 18:13:42 +08:00
Andrew Mayorov	576eab9717	Merge pull request #11193 from keynslug/fix/emqx-ft-test-flaps ... fix(ft-test): use new cth tooling in emqx_ft_storage_fs_SUITE	2023-07-10 11:55:16 +02:00
JianBo He	f144bb0571	Merge pull request #11226 from zhongwencool/listener-conf-enabled-to-enable ... fix: alias listeners.Type.Name.enabled as listeners.Type.Name.enable	2023-07-10 17:15:24 +08:00
zhongwencool	1b5d55cdbb	fix: delete bad link in emqx_prometheus	2023-07-10 16:48:13 +08:00
zhongwencool	0632d629cb	fix: bad prometheus schema for headers	2023-07-10 16:48:13 +08:00
JimMoen	e9f1d7f2bf	fix: influxdb float serialization error	2023-07-10 13:53:11 +08:00
zhongwencool	802a50601a	chore: add comment for init_loader_done	2023-07-10 12:03:36 +08:00
zhongwencool	c4ba558ee3	fix: unset config_loader in emqx's env when stop emqx app	2023-07-10 11:06:08 +08:00
zhongwencool	d661b10355	fix: emqx CI failed	2023-07-10 10:34:36 +08:00
zhongwencool	86d3984025	fix: mgmt api SUITE failed	2023-07-10 10:34:36 +08:00
zhongwencool	c0ee47dc08	chore: add changelog for 11226 pr	2023-07-10 10:34:36 +08:00
zhongwencool	d781346efc	fix: alias listeners.Type.Name.enabled as listeners.Type.Name.enable	2023-07-10 10:34:36 +08:00
Stefan Strigler	1110b5d8f5	fix(emqx_retainer): return 404 in delete if topic not found	2023-07-08 14:43:43 +02:00
Stefan Strigler	80e4ffff75	fix(emqx_management): return 404 if plugin does not exist	2023-07-08 14:43:43 +02:00
Stefan Strigler	3fd28f9e18	fix(emqx_management): return 404 for unknown listener id	2023-07-08 14:43:43 +02:00
Stefan Strigler	d65d690c17	fix(emqx_gateway): return 404 for unknown client id	2023-07-08 14:43:43 +02:00
Stefan Strigler	3bc419ee64	fix(emqx_gateway): return 404 for unknown listener id	2023-07-08 14:10:23 +02:00
Andrew Mayorov	8c883feb54	chore: bump emqx_durable_storage to 0.1.1	2023-07-07 21:56:21 +02:00
Andrew Mayorov	030beb3e6a	fix(ds): drop debug printouts in test suite	2023-07-07 21:56:20 +02:00
Andrew Mayorov	daf4e86da1	feat(ds): add ensure_shard/2 shortcut ... And use it in `emqx_persistent_session_ds:init()` backend initialization function.	2023-07-07 21:56:20 +02:00
Andrew Mayorov	ac56de9fc5	feat(ds): allow to redefine directory for shard's rocksdb	2023-07-07 21:56:20 +02:00
Ilya Averyanov	19f9fc5089	feat(authz): bump app versions	2023-07-07 19:41:34 +03:00
Ilya Averyanov	77895f2555	feat(authz): fix typos and style for Retain & QoS authz feature ... Co-authored-by: Thales Macedo Garitezi <thalesmg@gmail.com>	2023-07-07 19:40:34 +03:00
Ilya Averyanov	6db02d6b49	feat(authz): enable feature for both CE and EE	2023-07-07 19:40:34 +03:00
Ilya Averyanov	1ce6a225ae	feat(authz): add tests for authz extended actions	2023-07-07 19:40:34 +03:00
Ilya Averyanov	7de26a1776	feat(authz): use extensible map format for actions in authz rules ... * support authorization on retain, qos fields * refactored authz tests heavily	2023-07-07 19:40:34 +03:00
Ilya Averyanov	b568bda098	feat(ft-api): simplify config import test	2023-07-07 19:39:05 +03:00
Thales Macedo Garitezi	6337f52cf9	fix(plugins): start/stop plugins when loading config from CLI ... Fixes https://emqx.atlassian.net/browse/EMQX-10288	2023-07-07 13:37:51 -03:00
Ilya Averyanov	56c81c2c25	feat(ft-api): bump app versions	2023-07-07 19:17:22 +03:00
Ilya Averyanov	e0353ab750	fix(ft-api): update FT API tests to use emqx_cth_suite	2023-07-07 19:15:42 +03:00
Ilya Averyanov	fde506838a	fix(ft-api): implement import config behaviour	2023-07-07 19:15:42 +03:00
Ilya Averyanov	fe691e8330	fix(ft-api): fix swagger schema dump for ft schema	2023-07-07 19:15:42 +03:00
Ilya Averyanov	a2eb658cd9	feat(ft-api): do cleanup certs explicitly	2023-07-07 19:15:42 +03:00
Andrew Mayorov	a2b03716be	feat(ft-api): provide configuration API ... To configure `emqx_ft` during the runtime.	2023-07-07 19:15:42 +03:00
Andrew Mayorov	34793c5ed0	feat(ft-conf): preprocess TLS configuration on updates ... Specifically, reify keys and certificates into files in the file system and update the configuration to point to those files.	2023-07-07 19:15:42 +03:00
Andrew Mayorov	27ab9c62d8	fix(ft): unload conf hooks in prep_stop ... In order to avoid situations when the root supervisor is stopped already.	2023-07-07 19:15:42 +03:00
Ilya Averyanov	aba52c6a25	chore(rebalance test): fix API tests	2023-07-07 18:04:32 +03:00
Ilya Averyanov	9bb159cf1e	fix(rebalance): fix changelog and version	2023-07-07 18:04:11 +03:00
zhongwencool	5b1c265485	Merge pull request #11224 from zhongwencool/fix-psk-conf-load ... fix: psk_authentication is updated failed	2023-07-07 21:27:49 +08:00
Ilya Averyanov	a6019a2846	Merge pull request #11198 from savonarola/0705-fix-rebalance-swagger ... fix(rebalance): fix rebalance swagger examples	2023-07-07 15:55:16 +03:00
lafirest	70bd7a59e4	Merge pull request #11225 from lafirest/fix/pgsql_function_clause ... fix(bridge): ensure the username of pgsql must exists	2023-07-07 20:39:07 +08:00
zhongwencool	8b80a2f754	Merge pull request #11192 from zhongwencool/bump-hocon-to-0.39.13 ... chore: update hocon to 0.39.13	2023-07-07 20:02:46 +08:00
zhongwencool	0ef00d5919	fix: psk_authentication is updated failed	2023-07-07 20:02:06 +08:00
Andrew Mayorov	97b6c43062	fix(ft-test): use new cth tooling in emqx_ft_storage_fs_SUITE ... In attempt to battle test flakiness.	2023-07-07 14:00:33 +02:00
Andrew Mayorov	7e76914599	feat(ds): hardwire emqx_durable_storage message persistence ... Only message persistence is currently implemented, irrespectively of whether there are persistent sessions around or not.	2023-07-07 13:46:12 +02:00
firest	d01eee7fe4	chore: update changes && app version	2023-07-07 18:22:54 +08:00
firest	8cee75139d	fix(bridge): ensure the username of pgsql must exists	2023-07-07 18:06:28 +08:00
Stefan Strigler	055a1e8d75	Merge pull request #11210 from sstrigler/EMQX-9569-provide-the-ce-ee-version-info-and-the-current-version-number-in-the-info-field ... feat(emqx_dashboard): include edition and version in swagger.json info	2023-07-07 11:55:44 +02:00
zhongwencool	b5cc8fb3c3	fix: start_after_created's default value	2023-07-07 16:39:26 +08:00
zhongwencool	352d818e3b	chore: update hocon to 0.39.13	2023-07-07 16:39:26 +08:00
JimMoen	88fd8d0582	Merge pull request #11219 from JimMoen/fix-hstreamdb-deps-app ... chore: hstreamdb_erl as deps for hstreamdb bridge	2023-07-07 16:39:12 +08:00
JianBo He	2f33fd9bac	Merge pull request #11208 from HJianBo/update-lwm2m-stats ... fix(lwm2m): update the stats correctly and timely	2023-07-07 15:32:50 +08:00
JianBo He	daa6cf14fe	Merge pull request #11206 from HJianBo/coap-bugs ... Fix(coap): Make the username and password params to optional	2023-07-07 15:32:00 +08:00
zhongwencool	ab07fd0547	Merge pull request #11214 from zhongwencool/fix-cluster-rpc-call-tnx-id ... fix: bad tnx-id when rejoin cluster	2023-07-07 15:08:06 +08:00
JimMoen	63c6427037	chore: hstreamdb_erl as deps for hstreamdb bridge	2023-07-07 14:50:44 +08:00
JimMoen	30c931ae62	fix: pulsar flaky cluster tests	2023-07-07 12:25:37 +08:00
JimMoen	4ee44972b2	feat: refactor hstreamdb connector to to avoid resources leaking	2023-07-07 12:25:37 +08:00
JimMoen	b089fba100	refactor: rm ee_bridge and ee_connector application	2023-07-07 12:25:37 +08:00
JimMoen	583ccfaafd	test(hstreamdb): create stream and wirte data	2023-07-07 12:25:36 +08:00
JimMoen	1587f038a5	feat: hstreamdb bridge with batch query	2023-07-07 12:25:36 +08:00
JimMoen	b9bfdfd583	chore: compatibility with hstreamdb v0.15.0	2023-07-07 12:25:36 +08:00
JimMoen	d31a305bcb	refactor(hstreamdb): HStreamDB bridge to its own application	2023-07-07 12:25:36 +08:00
zhongwencool	f7513b900a	fix: set load config done after update tnx_id	2023-07-07 12:25:34 +08:00
zhongwencool	9f57ba510e	chore: add 11214 changelog	2023-07-07 12:25:34 +08:00
zhongwencool	221f6eba06	fix: bad tnx-id when rejoin cluster	2023-07-07 12:25:34 +08:00
JianBo He	d3d2c8a532	chore(lwm2m): bump version	2023-07-07 12:24:31 +08:00
JianBo He	31a240ba63	fix(lwm2m): update the stats correctly and timely	2023-07-07 12:24:31 +08:00
JianBo He	791b8ef671	chore: bump versions	2023-07-07 12:23:57 +08:00
JianBo He	6d2222318d	chore(coap): update the subscriptions_cnt stats in time	2023-07-07 12:23:57 +08:00
JianBo He	800b154582	test(coap): cover the params optional logic to create connection	2023-07-07 12:23:57 +08:00
JianBo He	5c901a52bd	fix(coap): make username/password optinal in connection	2023-07-07 12:23:57 +08:00
JianBo He	ab809c8b85	Merge pull request #11207 from lafirest/feat/keep_obfuscated ... feat: ensure data backends don't leak sensitive data	2023-07-07 12:22:11 +08:00
JianBo He	b11fa5f3bf	Merge pull request #11195 from HJianBo/stomp-topic-id-unique ... Fix(stomp): avoid to create duplicated subscription by HTTP or Client	2023-07-07 11:18:30 +08:00
firest	a1d2b2ca51	chore: bump app versions	2023-07-07 11:17:54 +08:00
firest	18dec53d8b	feat: ensure data backends don't leak sensitive data	2023-07-07 11:04:13 +08:00
JianBo He	05048dbf93	Merge pull request #11204 from HJianBo/avoid-case-clause ... Allow the `*/*` or multiple `Accept` values in header for the `/configs` API	2023-07-07 09:46:28 +08:00
Stefan Strigler	8faaa86c07	chore: bump vsn for emqx and emqx_bridge	2023-07-06 14:26:11 +02:00
Stefan Strigler	22b25fbbb3	feat(emqx_dashboard): include edition and version in swagger.json info	2023-07-06 14:14:21 +02:00
Thales Macedo Garitezi	353cc065db	Merge pull request #11175 from thalesmg/fix-mysql-start-error ... fix(mysql_bridge): make nxdomain a 400 API error	2023-07-06 08:26:12 -03:00
Stefan Strigler	9bcabe0a9e	Merge pull request #11184 from sstrigler/EMQX-10270-e-5-1-0-missing-value-range-validation-for-the-max-packet-size-of-mqtt-settings ... fix: limit mqtt max_packet_size to 256MB	2023-07-06 10:20:24 +02:00
JianBo He	71d1f80530	test(api): cover the accept logic for /configs API	2023-07-06 11:30:38 +08:00
JianBo He	966b2affc2	chore: allow handle */* or multiple values in Accept headers	2023-07-06 10:53:07 +08:00
SergeTupchiy	1a79e34510	Merge pull request #11202 from SergeTupchiy/fix-rule-type-acl-conf ... chore(emqx_authz): fix `rule()` type example	2023-07-05 21:02:36 +03:00
Serge Tupchii	4dfd3421e7	chore(emqx_authz): fix rule() type example ... Use `action()` type which is a correct and defined type.	2023-07-05 20:24:26 +03:00
Ilya Averyanov	9af0030538	chore: bump to v5.1.1	2023-07-05 18:43:45 +03:00
Ilya Averyanov	f174cb656c	fix(rebalance): fix swagger examples in api-doc	2023-07-05 15:38:41 +03:00
Ilya Averyanov	dca6fe6200	fix(rebalance): fix global status evaluation on replicant nodes	2023-07-05 12:48:44 +03:00
JianBo He	aaf015c06f	test(stomp): cover subscription in use	2023-07-05 15:22:44 +08:00
lafirest	bf5167a8bf	Merge pull request #11172 from lafirest/fix/dup_payload ... fix(ruleengine): fix duplicate `payload` problems	2023-07-05 14:20:26 +08:00
JianBo He	0483c6afef	fix(stomp): not allow to create same subscriptions	2023-07-05 14:13:25 +08:00
Stefan Strigler	263890be47	fix: limit mqtt max_packet_size to 256MB	2023-07-04 16:03:11 +02:00
Andrew Mayorov	8cc7022760	Merge pull request #11120 from ft/EMQX-10329/tooling ... test: add tooling to make testruns more isolated and predictable	2023-07-04 14:36:39 +02:00
Ilya Averyanov	0bd0a16693	Merge pull request #11039 from savonarola/0613-fix-redis-db-schema ... fix(redis): validate database number	2023-07-04 15:32:02 +03:00
zhongwencool	f2c5f4932c	Merge pull request #11148 from lafirest/fix/mcall_error_report ... fix(emqx_conf): don't sync the MFA to a leaved node	2023-07-04 19:56:52 +08:00
Andrew Mayorov	9ed75085b7	chore: drop dead commented out code	2023-07-04 13:20:04 +02:00
Andrew Mayorov	c7ba300efc	fix(cthsuite): use correct type for "smth serializable as HOCON"	2023-07-04 13:20:04 +02:00
Andrew Mayorov	d568d43fe4	test(bridge): switch emqx_bridge_api_SUITE to use new tooling	2023-07-04 13:20:03 +02:00
Andrew Mayorov	fc709a14cc	test: switch emqx_authz_file_SUITE to use new tooling	2023-07-04 13:20:03 +02:00
Andrew Mayorov	2c50e61cee	fix(cth): reduce amount of logging + streamline logging ... Also make sure that code running on `emqx_cth_cluster` nodes don't crash when using `ct:pal` and friends.	2023-07-04 13:20:03 +02:00
Andrew Mayorov	9bda4192e5	fix(cthsuite): disable default acl.conf authz source ... So that users of `emqx_cth_suite` won't have to deal with providing correct filepath each time they start `emqx_conf` and/or `emqx_authz` up.	2023-07-04 13:20:03 +02:00
Andrew Mayorov	24a16ea247	fix(cthsuite): bump to hocon 0.39.11 with atom prettyprint fix	2023-07-04 13:20:03 +02:00
Andrew Mayorov	6a7254f55e	fix(cthcluster): match correct driver in stop_node/2 ... Co-authored-by: Ilya Averyanov <av@rubybox.dev>	2023-07-04 13:20:02 +02:00
Andrew Mayorov	fe0b8cfbaf	test(conf): respect init_config_load_done in emqx_conf itself ... This should make task of configuring various applications (emqx_conf / emqx) during testsuites setup much simpler.	2023-07-04 13:20:02 +02:00