30eb54e86b
fix(sessds): Delay unsubscribe until full ack of in-flight messages
2024-02-06 02:49:07 +01:00
a9c55f7568
feat(sessds): Consider #srs with only QoS0 messages fully acked
2024-02-06 02:49:07 +01:00
d3db53626b
Merge pull request #12483 from zmstone/0205-docs-fix-typos
...
Improve emqx ctl conf cluster_sync CLI and help text
2024-02-06 09:11:35 +08:00
3e599e5d8e
chore: add maybe feature enable on rabbitmq_bridge
2024-02-06 07:57:13 +08:00
e3cb49db8e
chore: add copyright header
2024-02-06 07:57:13 +08:00
688701eedb
chore: add desc for rabbitmq source
2024-02-06 07:57:13 +08:00
b444c82a42
feat: rabbitmq bridge v2 integration
2024-02-06 07:57:12 +08:00
280fcd8c52
Merge pull request #12437 from ieQu1/dev/optimize_make_filter
...
Optimize emqx_ds_bitmask_keymapper:make_filter function.
2024-02-05 17:32:28 +01:00
4665837cf0
fix(ds): Apply review remarks
2024-02-05 16:52:06 +01:00
d7b0456bb0
feat: rename emqx ctl cluster_sync 'tnxid' to 'inspect'
2024-02-05 16:50:55 +01:00
e5b14a38ed
Merge pull request #12472 from thalesmg/fix-bridgev2-api-multicall-m-20240202
...
fix(bridge_v2_api): avoid calling nodes that do not support minimum bpapi
2024-02-05 10:28:28 -03:00
c7888ad1f1
Merge pull request #12475 from ieQu1/dev/lean-stream
...
Use a more compact data structure to represent streams
2024-02-05 13:55:24 +01:00
e1ff276d76
Merge pull request #12471 from thalesmg/fix-config-upgrade-m-20240202
...
fix(config): apply config upgrade to deprecated configs
2024-02-05 09:05:12 -03:00
b4a6be0e7c
fix(tdengine): remove redundant codes
2024-02-05 18:50:31 +08:00
571786b6c5
Merge pull request #12480 from lafirest/fix/td_v1_schema
...
fix(tdengine): keep the bridge schema still compatible with v1
2024-02-05 18:17:55 +08:00
698ba3f271
fix(ds): Optimize emqx_ds_bitmask_keymapper:make_filter
...
This optimization makes idle polling faster
2024-02-05 10:54:19 +01:00
8edbec5929
refactor(ds): Clarify the language used in ds_bitmapper
2024-02-05 10:54:18 +01:00
75023f2ca3
Merge pull request #12442 from ieQu1/dev/ds-license-apache
...
Relicense apps/emqx_durable_storage under Apache 2.0
2024-02-05 10:16:52 +01:00
4a2c5a3161
fix(tdengine): keep the bridge schema still compatible with v1
2024-02-05 13:22:17 +08:00
f7b0d1bc9d
chore: add duplicated key assert in swagger.json
2024-02-04 11:53:37 +08:00
b1150a5f88
fix(schema): bridge oracle connector schema
2024-02-04 10:53:13 +08:00
2e2f3cb2aa
fix(sessds): Avoid stream hash collisions
2024-02-03 21:15:54 +01:00
2e56810ea2
refactor(ds): Use a simple improper list to represent the streams
2024-02-03 21:15:54 +01:00
76d242df9b
fix(bridge_v2_api): avoid calling nodes that do not support minimum bpapi
...
Fixes https://emqx.atlassian.net/browse/EMQX-11834
2024-02-02 17:36:08 -03:00
76401a302a
fix(config): apply config upgrade to deprecated configs
...
Fixes https://emqx.atlassian.net/browse/EMQX-11845
Fixes https://github.com/emqx/emqx/issues/12452
2024-02-02 15:12:08 -03:00
ed8660cb68
Merge pull request #12458 from id/0202-sync-release-55
...
sync release-55
2024-02-02 17:20:38 +01:00
81433282be
Merge pull request #12467 from SergeTupchiy/autocluster-dns-aaaaa-record-type
...
feat(emqx_conf): support AAAA cluster dns record type
2024-02-02 18:13:06 +02:00
b1a05c7b59
Merge pull request #12326 from zmstone/0111-unregister-session-with-timestamp
...
0111 unregister session with timestamp
2024-02-02 17:00:23 +01:00
e0b5d9fae7
Merge pull request #12464 from ieQu1/dev/feat-ds-cli
...
feat(ds): Add a CLI interface to inspect status of DS databases
2024-02-02 14:14:48 +01:00
5e0c3d4051
feat(emqx_conf): support AAAA cluster dns record type
...
Ekka autocluster DNS already supports AAAA records, so it's only needed to update enum in schema.
2024-02-02 12:13:29 +02:00
fa0baf2f38
Merge pull request #12439 from kjellwinblad/kjell/refactor/oracle_bridge/EMQX-11464
...
feat: refactor Oracle bridge to connector and action
2024-02-02 10:53:15 +01:00
84b6d7d720
fix: remove 5.5.bpapi2 file
2024-02-02 10:38:50 +01:00
3d2ac97c61
feat(ds): Add a CLI interface to inspect status of DS databases
2024-02-02 10:11:01 +01:00
f0569d8ae8
refactor: use mria:async_dirty to group dirty ops
2024-02-02 09:26:43 +01:00
24d8a9ab00
Merge pull request #12449 from lafirest/feat/td
...
feat(tdengine): improve the TDengine bridge to v2 style
2024-02-02 16:17:01 +08:00
dd490de2e1
chore: emqx 5.5.0
2024-02-02 08:48:56 +01:00
f1c7e716ce
chore: 5.5.0-rc.2
2024-02-02 08:48:56 +01:00
9aad7997ca
chore: compatible the contet-type sytanx
2024-02-02 08:48:56 +01:00
dae3a94670
chore: 5.5.0-rc.1
2024-02-02 08:48:56 +01:00
c724d2127e
Merge pull request #12457 from lafirest/fix/opentsdb
...
fix(opents): change the schema of tags to object style
2024-02-02 15:33:50 +08:00
17d79026cd
test: fix emqx_connector_schema eunit missing fields
2024-02-02 14:43:25 +08:00
5291adf2c0
fix(opents): change the schema of tags to object style
2024-02-02 13:07:49 +08:00
1a372ce39a
fix(swagger): no-need call common_fields when `emqx_connector_schema:api_fields/3` used
2024-02-02 10:54:49 +08:00
2241461acb
chore: update change & bump version
2024-02-02 07:48:44 +08:00
af3f43ffd5
fix: use emqx_resource macro for status
...
Thanks for the suggestion @thalesmg
Co-authored-by: Thales Macedo Garitezi <thalesmg@gmail.com>
2024-02-01 17:24:25 +01:00
98d1094d73
feat(sessds): Expose subscriptions in the REST API
2024-02-01 16:47:57 +01:00
016fbd2c5c
chore: remove commented out code
2024-02-01 16:18:37 +01:00
dfad020c49
feat(tdengine): improve the TDengine bridge to v2 style
2024-02-01 23:14:24 +08:00
a4272c71dc
feat: refactor Oracle bridge to connector and action
...
Fixes:
https://emqx.atlassian.net/browse/EMQX-11464
2024-02-01 16:03:05 +01:00
ae1ef9d1bb
Merge pull request #12428 from savonarola/0130-simplify-boot-machine-runtime-deps
...
chore(emqx_machine): refactor injecting runtime deps
2024-02-01 16:32:53 +02:00
80ff1b1657
Merge pull request #12434 from qzhuyan/fix/william/kafka-dont-stacktrace-when-no-partiion-count
...
kafka-bridge: dont stacktrace when no partition count
2024-02-01 15:09:45 +01:00
3e518c1876
Merge pull request #12427 from zmstone/0130-limit-kafka-partitions
...
0130 limit kafka partitions
2024-02-01 14:39:52 +01:00
6a092aeb69
chore(emqx_machine): refactor injecting runtime deps
...
Co-authored-by: Thales Macedo Garitezi <thalesmg@gmail.com>
2024-02-01 16:13:49 +03:00
16444b7da9
fix(bridge-kafka): no stacktrace when fetch topic partition count fail
2024-02-01 14:09:15 +01:00
3ad71f75e6
chore: emqx 5.5.0
2024-02-01 11:07:02 +01:00
42a4bc3382
Merge pull request #12435 from zhongwencool/dont-add-disable-resource-to-connector
...
fix: don't add disable bridge to connector's channel
2024-02-01 10:39:47 +08:00
0d5911d942
Merge pull request #12422 from zhongwencool/upgrade-erlfmt-to-v1.3.0
...
feat: upgrade erlfmt to support maybe syntax
2024-02-01 09:34:33 +08:00
f9d16340e0
fix: don't add disable bridge to connector's channel
2024-02-01 09:12:43 +08:00
139f5dc3bd
chore(ds): Remove an obsolete document; superceded by ./README.md
2024-02-01 00:14:08 +01:00
b50d6bf1fd
chore(ds): Change the license to Apache 2.0
...
Due to technicalities parts of the original code were licensed under
BSL.
In preparations for the public release of the feature, the license has
been changed to Apache 2.0
2024-02-01 00:10:48 +01:00
f7b12470dd
test(ds): fix inter-suite flakiness
...
Attempt to mitigate this frequent source of flakiness:
```
=CRASH REPORT==== 31-Jan-2024::17:30:15.025404 ===
crasher:
initial call: emqx_ds_replication_layer_egress:init/1
pid: <0.11312.0>
registered_name: []
exception error: no match of right hand side value {error,
no_leader_for_shard}
in function emqx_ds_replication_layer_egress:init/1 (/emqx/apps/emqx_durable_storage/src/emqx_ds_replication_layer_egress.erl, line 93)
in call from gen_server:init_it/2 (gen_server.erl, line 980)
in call from gen_server:init_it/6 (gen_server.erl, line 935)
ancestors: [<0.11310.0>,<0.11304.0>,emqx_ds_builtin_databases_sup,
emqx_ds_builtin_sup,emqx_ds_sup,<0.11236.0>]
message_queue_len: 0
messages: []
links: [<0.11310.0>]
dictionary: []
trap_exit: true
status: running
heap_size: 376
stack_size: 28
reductions: 231
neighbours:
```
2024-01-31 15:42:26 -03:00
d51deac222
fix(ds): use configured data dir for site storage
2024-01-31 15:42:26 -03:00
3b6fbff9a5
test: fix compile warnings
2024-01-31 19:32:57 +01:00
3b42a7425b
feat(kafka_producer): add partitions_limit
2024-01-31 19:26:01 +01:00
53c217c383
refactor: micro optimization
2024-01-31 19:25:57 +01:00
b3657f1892
Merge pull request #12436 from savonarola/0131-fix-stream-replay
...
fix(sessds): fix renew stream logic
2024-01-31 18:25:17 +02:00
3f71a98e5e
chore: 5.5.0-rc.2
2024-01-31 17:06:54 +01:00
a60aeed539
Merge pull request #12398 from lafirest/feat/api-docs
...
feat(dashboard): expose the `swagger_support` option
2024-01-31 23:31:56 +08:00
fe46434687
fix(sessds): fix renew stream logic
2024-01-31 18:02:29 +03:00
2680fae9b6
Merge pull request #12420 from kjellwinblad/kjell/fix/kinesis/refactoring/problems/thanks_HJianBo
...
fix: kinesis schema problems found by @HJianBo
2024-01-31 15:52:45 +01:00
e9c8446d57
feat: upgrade erlfmt to support maybe syntax
2024-01-31 20:06:49 +08:00
b787f28d27
chore: compatible the contet-type sytanx
2024-01-31 17:49:46 +08:00
38047108a4
test: add test coverage for emqx_cm_registry_keeper module
2024-01-31 09:50:12 +01:00
209331ad33
test: fix config test
2024-01-31 09:50:12 +01:00
87a2368e37
feat(metrics): add cluster_session guage
2024-01-31 09:50:12 +01:00
509ab6f35a
feat(api): add /sessions_count api to count sessions
2024-01-31 09:50:12 +01:00
562a2736ae
feat: add `broker` root to hot-config schema
2024-01-31 09:50:12 +01:00
e9318752e6
feat: store session unregistration timestamp in emqx_cm_registry table
2024-01-31 09:50:12 +01:00
5bc67cb288
Merge pull request #12432 from ieQu1/ds_ignore_fully_replayed_streams
...
fix(sessds): Stream scheduler must ignore fully replayed streams
2024-01-31 09:51:49 +02:00
13df7fa46e
fix(dashboard): add test case & update change
2024-01-31 14:14:56 +08:00
e843d9fd91
fix(sessds): Stream scheduler must ignore fully replayed streams
2024-01-31 00:20:54 +01:00
a2ba8fc645
chore: 5.5.0-rc.1
2024-01-30 18:58:00 +01:00
274f378c6e
fix: better delete of local_topic as suggested by @thalesmg
...
Co-authored-by: Thales Macedo Garitezi <thalesmg@gmail.com>
Co-authored-by: Thales Macedo Garitezi <thalesmg@gmail.com>
2024-01-30 17:53:32 +01:00
c7f1e44513
Merge pull request #12424 from lafirest/fix/opentsdb
...
feat(opentsdb): supports more flexible tags schema
2024-01-30 22:05:30 +08:00
55fdc83aa5
Merge remote-tracking branch 'origin/release-55' into 0130-syn-release-55-to-master
2024-01-30 12:06:43 +01:00
c0674913e2
Merge pull request #12421 from HJianBo/fix-import-users
...
fix(user_import): ensure the last record overwrites previous one
2024-01-30 18:49:35 +08:00
81f96f1a68
feat(opentsdb): supports more flexible tags schema
2024-01-30 18:43:39 +08:00
03ff6f2ddf
Merge pull request #12410 from SergeTupchiy/EMQX-11812-subscribe-performance-degraded
...
perf(emqx_broker): pick broker pool worker by topic/shard pair to dis…
2024-01-30 11:48:59 +02:00
db3f285054
Merge pull request #12417 from emqx/port-msg-expiry-interval-from44
...
feat: configurable server side message_expiry_interval
2024-01-30 17:10:32 +08:00
206af96a33
ci: update testcases for message-expiry-interval
2024-01-30 15:46:11 +08:00
4190682a16
chore: fix the data type and example value for cluster invitation result
2024-01-30 15:29:46 +08:00
aedfc8e8c0
fix(user_import): ensure the last record overwrites previous one
2024-01-30 14:14:20 +08:00
35c4ef2ee2
Merge pull request #12407 from zmstone/0126-script-to-update-bsl-license-convert-time
...
0126 script to update bsl license convert time
2024-01-30 09:54:34 +08:00
4688b36cdf
Merge pull request #12396 from HJianBo/import_user_2
...
feat(import_users): support user's password in plain text
2024-01-30 09:00:00 +08:00
5007650bd2
perf(emqx_broker): pick broker pool worker by topic/shard pair to distribute the load more evenly.
...
Fixes: EMQX-11812
2024-01-29 20:57:10 +02:00
cf0465dad4
Merge pull request #12411 from thalesmg/fix-cassandra-null-r55-20240126
...
fix(cassandra_bridge): correctly insert null values into columns
2024-01-29 14:09:12 -03:00
b849b08dbc
fix: kinesis schema problems found by @HJianBo
...
This commit fixes problems in schema found by @HJianBo here:
https://github.com/emqx/emqx/pull/12376#pullrequestreview-1848306286
2024-01-29 18:08:53 +01:00
7ee0a6aaa4
Merge pull request #12414 from ieQu1/dev/ds-readme
...
doc(ds): Update README
2024-01-29 18:01:03 +01:00
82403167c2
chore: update BSL license change date
2024-01-29 16:47:31 +01:00
47f61ba68a
fix(cassandra_bridge): correctly insert null values into columns
...
Fixes https://emqx.atlassian.net/browse/EMQX-11822
2024-01-29 11:32:00 -03:00
cb90d3c90c
Merge pull request #12415 from ieQu1/dev/remove-ds-conf-module
...
fix(ds): Remove unused module
2024-01-29 12:56:04 +01:00
9f22c2c455
ci: add some sleep and retry to emqx_persistent_session_ds_SUITE
2024-01-29 18:18:18 +08:00
d12335c4c6
chore: add tests
2024-01-29 18:10:42 +08:00
d286b7e28c
Merge pull request #12404 from thalesmg/fix-action-metric-handler-r55-20240126
...
fix(resource_metrics): avoid detaching handler on crashes
2024-01-29 17:51:04 +08:00
12da3c0986
feat: configurable server side message_expiry_interval
2024-01-29 17:29:52 +08:00
fa6d65887d
test(retainer): fix test cases
2024-01-29 08:42:36 +01:00
e4b8d79444
fix(retainer): add default delivery rate in the schema
2024-01-29 08:04:58 +01:00
ab99a17c99
chore(utils_stream): simplfy the csv reader implementation
2024-01-29 11:10:50 +08:00
2e35024df1
test: update eunit tests
2024-01-29 10:49:07 +08:00
9915c85b0b
chore(authn_mnesia): use emqx_utils_stream module to imporve reusability
2024-01-29 10:49:07 +08:00
8fc8106819
test: cover password_type and new data format
2024-01-29 10:49:07 +08:00
829887630d
test: refine existed test cases
2024-01-29 10:49:07 +08:00
fed512689a
chore: make elvis checking happy
2024-01-29 10:49:07 +08:00
e65cfb836c
feat(import_users): support user's password in plain text
2024-01-29 10:49:07 +08:00
2479e1189a
fix(ds): Remove unused module
2024-01-29 00:36:13 +01:00
96c527541b
docs(ds): Update README
2024-01-28 20:27:20 +01:00
dbe2baa405
Merge pull request #12408 from zmstone/sync-release-55
...
Sync release 55
2024-01-27 19:20:58 +00:00
2c6a776318
fix(sessds): Stricter checks for PacketIds
2024-01-26 17:49:33 +01:00
eec56b0d6b
fix(sessds): Improve comments
2024-01-26 17:49:33 +01:00
3c451c6ae6
test(sessds): Fix unstable tests
2024-01-26 17:49:33 +01:00
2d23212792
refactor(sessds): #ifs -> #srs
2024-01-26 17:49:33 +01:00
974760d331
test(sessds): Don't trap exits in the test
2024-01-26 17:49:33 +01:00
ebe2339810
fix(sessds): Use mria:async_dirty instead of transaction
2024-01-26 17:49:33 +01:00
f5b9bd30aa
fix(sessds): Apply review remarks
2024-01-26 17:49:33 +01:00
39857626ce
test(sessds): Fix failing tests
2024-01-26 17:49:33 +01:00
e7b03cdc59
test(sessds): Create a property-based test for the session state
2024-01-26 17:49:33 +01:00
893656f092
fix(sessds): Fix session garbage collection after the refactoring
2024-01-26 17:49:33 +01:00
963df8f941
fix(sessds): Delete the routes when the session expires
2024-01-26 17:49:33 +01:00
cff6c15e13
fix(sessds): Store the QoS as the MSB of the packet ID
2024-01-26 17:49:33 +01:00
978a3bfef3
refactor(sessds): Simplify representation of QoS tracks
2024-01-26 17:49:33 +01:00
1b4f69b44d
refactor(sessds): Simplify data structure of ds_state pmap datatype
2024-01-26 17:49:33 +01:00
4f4831fe7f
refactor(sessds): Factor out stream scheduler into its own module
2024-01-26 17:49:33 +01:00
82ef34998a
feat(sessds): Index streams by a unique subid
2024-01-26 17:49:33 +01:00
3fb2064ea4
test(sessds): Add property-based tests for seqno generator
2024-01-26 17:49:33 +01:00
8e8d3af096
fix(sessds): Refactor emqx_persistent_session_ds to use CRUD module
2024-01-26 17:49:33 +01:00
2d08aa88d8
refactor(ds): Create a CRUD module for the persistent session
2024-01-26 17:49:33 +01:00
6410f5a717
fix(resource_metrics): avoid detaching handler on crashes
...
Fixes https://emqx.atlassian.net/browse/EMQX-11821
2024-01-26 13:05:41 -03:00
2a40152721
Merge remote-tracking branch 'origin/release-55' into sync-release-55
2024-01-26 16:51:13 +01:00
933c00c7ad
Merge pull request #12392 from qzhuyan/perf/william/ws-no-utf8-validate
...
perf: new ws listener option to disable UTF-8 validation
2024-01-26 16:01:04 +01:00
0933dc818e
chore(ekka): Bump version to 0.18.4
...
Don't escalate the errors in etcd node discovery to the node level.
Fixes : #12255
2024-01-26 14:25:16 +01:00
a56a5e9c3c
chore: add copyright
2024-01-26 11:01:53 +02:00
2d693402c5
refactor: split greptimedb bridge to actions and connectors
2024-01-26 11:01:53 +02:00
726302ef6a
perf: new ws listener option to disable UTF-8 validation
2024-01-26 09:55:17 +01:00
2e37f7514a
fix(prom_stats): compatibility with previous api format in json mode
2024-01-26 16:01:32 +08:00
308cde53b9
fix(prom_stats): merge cl_consistented data into per nodes data
2024-01-26 11:39:20 +08:00
e29a80d568
Merge pull request #12388 from qzhuyan/dev/william/per-listn-conn-cnt
...
feat: quic per listener conn count
2024-01-26 09:01:39 +08:00
590746ddfa
Merge pull request #12400 from thalesmg/ds-fix-data-dir-schema-m-20240125
...
fix(ds): don't make data dir part of the schema
2024-01-25 15:52:11 -03:00
8e31afe6c2
fix(ds): don't make data dir part of the schema
...
The data directory was ending up being persisted in the database schema. This led to
issues when opening the DB on different nodes.
2024-01-25 14:44:06 -03:00
0b6aee0ae9
Merge pull request #12393 from lafirest/fix/iotdb
...
fix(iotdb): change the `data` field to optional
2024-01-25 23:00:36 +08:00
c37097a150
feat(dashboard): expose the `swagger_support` option
2024-01-25 22:58:16 +08:00
5bf37cbe0a
Merge pull request #12376 from kjellwinblad/kjell/kinesis
...
feat: refactor kinesis bridge to connector and action
2024-01-25 14:58:40 +01:00
b5567d9d9f
Merge pull request #12389 from thalesmg/ci-peer-cover-m-20240124
...
ci: start/flush cover when using peer
2024-01-25 10:00:50 -03:00
2887a05ba3
refactor: simplify emqx_bridge_kinesis (thanks to @thalesmg's tips)
2024-01-25 12:48:31 +01:00
4dca1ef848
fix(prom_di): compatibility with bridge_v1
2024-01-25 19:37:15 +08:00
7b041683bb
fix(prom_di): action enable and status
2024-01-25 19:36:40 +08:00
beeedd33d1
fix(prom_mria): mria_data in init_acc
2024-01-25 19:36:39 +08:00
58b60181d7
fix(prom_mria): move mria callback into `emqx_prometheus.erl`
...
- they will return in same api endpoint.
2024-01-25 19:36:38 +08:00
cfad0923cf
chore: use macros for connector and action status atoms
2024-01-25 11:50:01 +01:00
01f374d8e5
fix(iotdb): change the `data` field to optional
2024-01-25 18:29:41 +08:00
3b0736fc67
Merge pull request #12387 from thalesmg/sync-r55-m-20240124
...
sync release-55 to master
2024-01-25 17:35:41 +08:00
4f8accc31b
Merge branch 'master' into sync-r55-m-20240124
2024-01-25 16:09:05 +08:00
aeefbe9544
fix(ds): Cache database metadata in RAM
2024-01-25 16:01:44 +08:00
846ad42a65
fix(ds): don't use env var for data dir default value
...
Fixes https://github.com/emqx/emqx/pull/12380
2024-01-25 16:01:44 +08:00
024ffe2909
test(ds): reduce flakiness
2024-01-25 16:01:44 +08:00
9003bc5b72
perf(ds): inherit only LTS paths containing wildcards when adding a new generation
...
Fixes https://github.com/emqx/emqx/pull/12338#discussion_r1462139499
2024-01-25 16:01:44 +08:00
e4c683d6f8
chore: update ecql to 0.6.0
2024-01-25 16:01:44 +08:00
5cd9f49558
ci: update generated connector name
2024-01-25 16:01:44 +08:00
6a21766ce3
refactor: split cassandra bridges to actions and connectors
2024-01-25 16:01:44 +08:00
497e735bf4
ci: add env vars to run cassandra tests locally
2024-01-25 16:01:43 +08:00
186e1591df
chore: document api-key path api only support bearerAuth
2024-01-25 16:01:43 +08:00
b44420c14f
fix(opentsdb): Enhanced the type support for template data
2024-01-25 16:01:43 +08:00
83a8822798
chore(opents): bump version && update changes
2024-01-25 16:01:43 +08:00
dad8a32e0b
feat(opents): improve the OpentsDB bridge to v2 style
2024-01-25 16:01:43 +08:00
878c9ee8b1
fix(ds): do not count persistent session-only routed messages as dropped
...
Fixes https://emqx.atlassian.net/browse/EMQX-11539
2024-01-25 16:01:43 +08:00
d323fc7c27
feat(ps): add message gc
2024-01-25 16:01:43 +08:00
7c0d37fdb9
feat(lts): inherit previous generation's lts when possible
2024-01-25 16:01:43 +08:00
4a0fd756ae
feat(ds): add `list_generations` and `drop_generation` APIs
2024-01-25 16:01:43 +08:00
fb39e1eacc
feat(ds): allow customizing the data directory
...
The storage expectations for the RocksDB DB may be different from our usual data
directory. Also, it may consume a lot more storage than other data.
This allows customizing the data directory for the builtin DS storage backend.
Note: if the cluster was already initialized using a directory path, changing that config
will have no effect. This path is currently persisted in mnesia and used when reopening
the DB.
2024-01-25 16:01:42 +08:00
51d32bd620
chore: improve http connector logs format
2024-01-25 16:01:42 +08:00
adf22f1f10
fix(mqtt_bridge): render valid messages from incomplete rule data
2024-01-25 16:01:42 +08:00
a8c6280a5e
test(emqx_cm_SUITE): use one helper function: `emqx_pool:flush_async_tasks/1`
2024-01-25 16:01:42 +08:00
f52cc93d9d
perf(emqx_cm): use a dedicated pool for channel cleanup
...
This is to isolate channels cleanup from other async tasks (like routes cleanup),
as channels cleanup can be quite slow under high network latency conditions.
Fixes: EMQX-11743
2024-01-25 16:01:42 +08:00
52a7b45d97
fix: upgrade ekka to 0.18.3 to ensure the leader correct
2024-01-25 14:47:59 +08:00
3bc6e546e0
fix: reboot emqx_dashboard after emqx_licencse
2024-01-25 12:29:04 +08:00
4eb0260eaf
Merge pull request #12381 from emqx/port-sql-funcs-from-emqx4
...
feat: port emqx/emqx-enterprise#1892 , add some SQL functions
2024-01-25 11:12:58 +08:00
ff0fd65f9d
Merge pull request #12373 from JimMoen/fix-prom-data-aggre
...
Follow up #12299
2024-01-25 10:37:47 +08:00
a752119d05
fix(prom_di): use bridge_v2 metrics api
2024-01-25 09:22:22 +08:00
61dd362db0
fix(prom_di): api crash in `connecting`
...
- https://emqx.atlassian.net/browse/EMQX-11801
2024-01-25 09:22:21 +08:00
ae387d1812
ci: start/flush cover when using peer
...
`cover` is not automatically started by `peer`. Without starting/flushing it, we don't
get coverage data from peer nodes.
2024-01-24 18:02:47 -03:00
9fb6688801
fix(quic): Per listener conn count
2024-01-24 21:36:25 +01:00
a19cf253ae
Merge pull request #12359 from thalesmg/fix-connector-app-deps-r55-20240119
...
fix(machine_boot): inject connector/bridge apps as dependencies to `emqx_connector` app
2024-01-24 15:40:24 -03:00
7b5f2948fe
test(ds): Fix flaky testcase
2024-01-24 19:33:30 +01:00
305a54f646
chore(ds): Update BPAPI version
2024-01-24 19:33:30 +01:00
eee221f1d0
feat(ds): Make egress batching configurable
2024-01-24 19:33:30 +01:00
137535a821
feat(ds): Introduce egress process for the builtin backend
2024-01-24 19:33:30 +01:00
ec93d8cf18
Merge pull request #12385 from ieQu1/ds-meta-ram-cache
...
fix(ds): Cache database metadata in RAM
2024-01-24 19:32:38 +01:00
9b7df302e8
fix(ds): Cache database metadata in RAM
2024-01-24 18:43:48 +01:00
fa842736d2
feat: refactor kinesis bridge to connector and action
...
Fixes:
https://emqx.atlassian.net/browse/EMQX-11461
2024-01-24 18:31:03 +01:00
5547a40ceb
fix(ds): don't use env var for data dir default value
...
Fixes https://github.com/emqx/emqx/pull/12380
2024-01-24 11:39:14 -03:00
ace1303de2
fix(prom_auth): authz metric name: `allow` and `deny`
...
- https://emqx.atlassian.net/browse/EMQX-11799
2024-01-24 22:38:49 +08:00
5e02709de0
fix(prom_auth): authz_enable key from enable status
...
- https://emqx.atlassian.net/browse/EMQX-11800
2024-01-24 22:38:48 +08:00
4afba8eb94
feat: port emqx/emqx-enterprise#1892 , add some SQL functions
2024-01-24 18:50:57 +08:00
6e3ce4d644
fix(prom_stats): emqx_stats metric type should be gauge
2024-01-24 14:11:17 +08:00
4a1d1b6aeb
fix: topics and retained metrics are cluster consistented
2024-01-24 14:11:16 +08:00
731efd8b49
fix(prom): cluster aggre/unaggre labels
2024-01-24 14:11:15 +08:00
497ec04359
fix(prom): missing callback attribute
2024-01-24 14:11:14 +08:00
947a08d1d2
Merge pull request #12375 from thalesmg/fix-actions-reset-node-metrics-r55-20240123
...
fix(actions_api): reset metrics on all nodes
2024-01-24 09:17:09 +08:00
77329209a2
Merge pull request #12368 from thalesmg/ds-inherit-wildcards-only-lts-m-20240122
...
perf(ds): inherit only LTS paths containing wildcards when adding a new generation
2024-01-23 17:14:51 -03:00
67c9e9c8fc
fix(actions_api): reset metrics on all nodes
...
Fixes https://emqx.atlassian.net/browse/EMQX-11796
2024-01-23 10:40:02 -03:00
eecd7e084c
test(ds): reduce flakiness
2024-01-23 09:47:03 -03:00
1be5b6aaf3
fix(mqtt_action): use overridden `resource_opts`
...
Fixes https://emqx.atlassian.net/browse/EMQX-11790
2024-01-23 09:41:28 -03:00
1eb47d0c16
perf(ds): inherit only LTS paths containing wildcards when adding a new generation
...
Fixes https://github.com/emqx/emqx/pull/12338#discussion_r1462139499
2024-01-23 09:20:28 -03:00
a8eefe808f
Merge pull request #12371 from emqx/es-server-schema
...
chore: es's base_url to server
2024-01-23 17:17:19 +08:00
6a9cbb3d97
test: add es's update test
2024-01-23 15:51:09 +08:00
aafb683ec7
Merge pull request #12330 from emqx/bridge-v2-cassandra
...
refactor: split cassandra bridges to actions and connectors
2024-01-23 14:45:32 +08:00
94692162b5
Merge pull request #12370 from zhongwencool/api-key-auth
...
chore: document api-key path api only support bearerAuth
2024-01-23 14:22:35 +08:00
218af3fef4
chore: update ecql to 0.6.0
2024-01-23 14:14:23 +08:00
9d2a207184
Merge pull request #12353 from lafirest/feat/optsdb
...
feat(opents): improve the OpentsDB bridge to v2 style
2024-01-23 13:49:33 +08:00
dc458ff0db
Merge pull request #12366 from lafirest/fix/sys
...
fix(sysk): fix probe testing bugs for syskeeper
2024-01-23 13:49:28 +08:00
51e8c955ff
fix(connector): make the connector id unique when doing probe testing
2024-01-23 13:03:12 +08:00
ada2785b5d
chore: es's base_url to server
2024-01-23 12:20:34 +08:00
0dbaaa5d94
chore: document api-key path api only support bearerAuth
2024-01-23 10:31:43 +08:00
28867d07e6
fix(opentsdb): Enhanced the type support for template data
2024-01-23 10:00:56 +08:00
609ba7e332
fix(ds): do not count persistent session-only routed messages as dropped
...
Fixes https://emqx.atlassian.net/browse/EMQX-11539
2024-01-22 16:58:45 -03:00
d122340c13
Merge pull request #12338 from thalesmg/ds-message-gc-20240115
...
feat(ds): add message GC
2024-01-22 16:57:26 -03:00
7035b4c8b3
feat(ps): add message gc
2024-01-22 14:53:17 -03:00
db710c4be5
feat(lts): inherit previous generation's lts when possible
2024-01-22 14:53:17 -03:00
75b08b525b
feat(ds): add `list_generations` and `drop_generation` APIs
2024-01-22 14:53:17 -03:00
39090d3732
Merge pull request #12340 from thalesmg/ds-db-data-path-m-20240116
...
feat(ds): allow customizing the data directory
2024-01-22 13:30:59 -03:00
3207f0ea80
fix(machine_boot): inject connector/bridge apps as dependencies to `emqx_connector` app
...
Fixes https://emqx.atlassian.net/browse/EMQX-11771
For the same reasons as we inject `emqx_bridge_*` applications as dependencies to
`emqx_bridge` when starting the node. Already configured connectors are started when
`emqx_connector` application starts, and may lead to crashes and noise in the logs. One
example is to configure a mongodb bridge and restart the node.
2024-01-22 11:13:34 -03:00
3f7b913e88
chore(opents): bump version && update changes
2024-01-22 20:45:18 +08:00
e337e1dc40
feat(opents): improve the OpentsDB bridge to v2 style
2024-01-22 20:45:10 +08:00
cd90b93550
fix(sysk): fix probe testing bugs for syskeeper
2024-01-22 20:27:48 +08:00
2706e005ff
Merge pull request #12354 from SergeTupchiy/EMQX-11751-dashboard-import-timeout-rel55
...
Apply brdige post config changes in parallel
2024-01-22 17:24:55 +08:00
2061d75b50
docs: prometheus api `mode` field description
2024-01-22 10:39:56 +08:00
2263df0242
fix(prom_push_gw): use format mode `node` for prometheus push gateway
2024-01-22 10:39:55 +08:00
b424f8ac12
feat(prom_stats): aggregated/unaggregated prometheus data
2024-01-22 10:39:54 +08:00
6b064dd8eb
fix(prom_stats): missing metric key
...
- follow https://github.com/emqx/emqx/pull/11497
2024-01-22 10:39:53 +08:00
c6c1a7fc28
refactor(prom): prom_auth and prom_di as prom_cluster behaviour
2024-01-22 10:39:52 +08:00
b480c5b371
fix(prom): use name `mode` and macros to put/get format mode
2024-01-22 10:39:51 +08:00
0e1043f80c
ci: update generated connector name
2024-01-22 10:34:40 +08:00
f7ae9ab489
Merge pull request #12351 from HJianBo/improve-the-http-connector-logs
...
chore: improve http connector logs format
2024-01-22 10:27:35 +08:00
b32c0fb0d8
refactor: split cassandra bridges to actions and connectors
2024-01-22 10:16:46 +08:00
29d767bd62
ci: add env vars to run cassandra tests locally
2024-01-22 10:16:46 +08:00
8cb12c6a74
refactor: use utils func for prom_auth and prom_di
2024-01-21 00:14:54 +08:00
c3da792323
feat(prom_di): cluster aggregated/unaggregated metrics
2024-01-21 00:14:53 +08:00
9627124d67
fix(prom_di): metric `emqx_rule_enable`
2024-01-21 00:14:52 +08:00
5534d5e9de
fix(bpapi): make static_check happy
2024-01-21 00:14:51 +08:00
5914eb5ca5
fix(prom_cert): rm cacertfile expiry epoch
2024-01-21 00:14:50 +08:00
4fb1ff2f9d
fix(prom_api): format-mode example value
2024-01-21 00:14:49 +08:00
57f3efde63
feat(prom_auth): cluster metrics with different format-mode
2024-01-21 00:14:48 +08:00
fb330f77e6
feat(prometheus): api `format_mode` parameter support
...
- node(default):
The only supported format_mode for PushGateway.
Return the current node's metrics.
- Without label `node_name` with content-type: `text/plain`.
- Without key `node_name` with content-type: `application/json`
- nodes_aggregated:
Return all nodes metrics Arithmetic-Sum or Logical-Sum.
See details in callback modules.
- Logical-Sum for metrics named with `xxx_enable` or `xxx_status`.
- Arithmetic-Sum for other metrics.
`node_name` field:
- Without label `node_name` with content-type: `text/plain`.
- Without key `node_name` with content-type: `application/json`
- nodes_unaggregated:
Return all nodes metrics without aggregated.
`node_name` field:
- _With_ label `node_name` with content-type: `text/plain`.
- _With_ key `node_name` with content-type: `application/json`
2024-01-21 00:14:47 +08:00
94032aafb2
fix(prom_data_integration): fix metric type
2024-01-21 00:14:46 +08:00
c3e9533260
fix: prometheus auth metrics fields and type
...
- rm rate fields
- fix few fields type to counter
2024-01-21 00:14:45 +08:00
a18c4d193a
refactor: abstract function call
2024-01-21 00:14:44 +08:00
8f7964f435
feat(prom): data integration metrics in josn format
2024-01-21 00:14:42 +08:00
36f009b0c2
fix(prom): connectors specific data
2024-01-21 00:14:41 +08:00
76d9ace582
fix: connector_count contains bridge_v1 and bridge_v2
2024-01-21 00:14:40 +08:00
f457def201
fix: use `id` uniformly as the label key for rules and actions
2024-01-21 00:14:39 +08:00
4b23930fce
fix(prometheus): license expiry and schema_registry only for ee
2024-01-21 00:14:38 +08:00
38a90bd273
fix(prom_auth): authn && authz data response by josn
2024-01-21 00:14:37 +08:00
0dca9905dd
test(prometheus): `{Registry, Collector}` tuple
2024-01-21 00:14:36 +08:00
7832bbc0a4
fix(prom): schema registry not in ce edition
2024-01-21 00:14:35 +08:00
5158395bcf
feat(prometheus): data integration prom data
2024-01-21 00:14:34 +08:00
bf2e4d134a
refactor(prometheus): generic api response funcs
2024-01-21 00:14:33 +08:00
e0feb580b6
feat(prometheus): auth metrics with text/plain
2024-01-21 00:14:32 +08:00
092159b071
feat(prometheus): cert expiry epoch in endpoint `/prometheus/stats`
2024-01-21 00:14:31 +08:00
558c471392
feat(prometheus): license expiry at epoch as gauge
2024-01-21 00:14:30 +08:00
fae0cea17f
fix(license): make dialyzer happy
2024-01-21 00:14:29 +08:00
81ba166b49
feat(license): expiry epoch api
2024-01-21 00:14:28 +08:00
89128958ed
fix(dashboard): licence quota not provided to ce edition
2024-01-21 00:14:27 +08:00
ecd0da9fde
feat(dashboard): `/monitor_current/nodes/{node}` provide `node_uptime`
2024-01-21 00:14:26 +08:00
7bc3a5090d
fix(dashboard): meck `emqx_retainer` in SUITE
2024-01-21 00:14:25 +08:00
3d6b65aced
chore: emqx_dashboard_monitor:current_rate/0 not exported anymore
2024-01-21 00:14:24 +08:00
a35698009c
feat(dashboard): endpoint `/monitor_current` provides mor fields
...
- `retained_msg_count`
Current retained_msg_count on each node and should be same on all nodes.
- `license_quota`
Only for enterprise edition, provides the max limited connections num.
2024-01-21 00:14:23 +08:00
dc15d37dcc
perf(emqx_bridge/connector): load and unload bridges/connectors in parallel
...
This should reduce app start/stop time, when a large number of bridges/connectors are not healthy.
2024-01-19 21:44:31 +02:00
d3a6870097
feat(emqx_utils): add pforeach/2,3
2024-01-19 21:44:31 +02:00
a6568dec75
perf(emqx_bridge/connector): apply post config bridge/connector changes in parallel
...
This can greatly improve the performance when many bridges/connectors are being changed,
e.g. when a backup file is being imported.
Fixes: EMQX-11751
2024-01-19 21:44:31 +02:00
54457b7093
feat(emqx_utils): allow `infinity` timeout in `pmap/3`
2024-01-19 19:34:04 +02:00
a40a13b786
Merge pull request #12357 from thalesmg/fix-bridge-bpapi-interval-r55-20240119
...
fix(bridge_api): explicitly state bpapi version ranges
2024-01-19 13:08:44 -03:00
57074015c6
feat(ds): allow customizing the data directory
...
The storage expectations for the RocksDB DB may be different from our usual data
directory. Also, it may consume a lot more storage than other data.
This allows customizing the data directory for the builtin DS storage backend.
Note: if the cluster was already initialized using a directory path, changing that config
will have no effect. This path is currently persisted in mnesia and used when reopening
the DB.
2024-01-19 13:07:24 -03:00
d22092e3da
fix(mqtt_source): don't attempt local publish when legacy config is absent
...
Fixes https://emqx.atlassian.net/browse/EMQX-11765
2024-01-19 10:54:05 -03:00
e369c1b971
docs(mqtt_source): fix example qos
2024-01-19 10:54:05 -03:00
4068258c78
fix(bridge_api): explicitly state bpapi version ranges
...
Fixes https://emqx.atlassian.net/browse/EMQX-11767
The currently supported version for a node may not be available at the time it's probed.
2024-01-19 10:20:57 -03:00
7d14a13b7b
Merge remote-tracking branch 'origin/release-55'
2024-01-18 14:36:30 +01:00
e219c3eda1
Merge pull request #12166 from kjellwinblad/kjell/mqtt_conn_action_3/EMQX-11489
...
feat: refactor MQTT bridge to source, action, and connector
2024-01-18 09:28:14 -03:00
6b462a9100
Merge pull request #12349 from zmstone/0118-fix-authz-cache-excludes-type
...
0118 fix authz cache excludes type
2024-01-18 10:32:38 +00:00
1b432eadd8
Merge pull request #12348 from emqx/elasticsearch-e550
...
Elasticsearch e550
2024-01-18 18:06:48 +08:00
5b064e399f
chore: improve http connector logs format
2024-01-18 17:29:23 +08:00
dae835635c
fix: don't crash in http SUITE
2024-01-18 16:45:46 +08:00
59797cfea7
feat: es's update support doc_as_upsert
2024-01-18 16:44:56 +08:00
91368a57ff
test: add es docker CI test
2024-01-18 16:44:56 +08:00
7f5fe91905
fix: es's action is atom not binary
2024-01-18 16:44:56 +08:00
7802d6e018
chore: fix typos
2024-01-18 16:35:57 +08:00
556092b7d0
feat(authz/prometheus): add authz cache_miss counter
2024-01-18 09:01:17 +01:00
85b6a3454c
fix(authz): use binary() type instead of string() for cache.excludes
2024-01-18 09:01:17 +01:00
6d6242c27a
Merge pull request #12335 from lafirest/fix/type_clause
...
fix(iotdb): enhances type checking when converting value
2024-01-18 11:28:40 +08:00
74bf4042c5
fix(mqtt_bridge): render valid messages from incomplete rule data
2024-01-17 23:13:55 +03:00
b2af7fdd70
fix(sysk): fix a update issue for the Syskeeper forwarder
2024-01-17 12:51:10 +08:00
238ecc68cf
fix(iotdb): enhances type checking when converting value
2024-01-17 12:00:15 +08:00
4fa906731d
Merge pull request #12333 from zmstone/0116-add-tags-for-action-and-connectors
...
feat: add 'tags' field for action and connector
2024-01-16 18:56:57 +00:00
80e82db282
test(emqx_cm_SUITE): use one helper function: `emqx_pool:flush_async_tasks/1`
2024-01-16 19:42:37 +02:00
b472b56883
perf(emqx_cm): use a dedicated pool for channel cleanup
...
This is to isolate channels cleanup from other async tasks (like routes cleanup),
as channels cleanup can be quite slow under high network latency conditions.
Fixes: EMQX-11743
2024-01-16 19:08:02 +02:00
01d52e37c4
fix: resource tag type should be binary string
...
Co-authored-by: Thales Macedo Garitezi <thalesmg@gmail.com>
2024-01-16 17:35:22 +01:00
2a41cad54f
fix(sources): remote irrelevant `resource_opts` fields for sources
...
Since they don't use buffer workers, they shouldn't have buffer-related sub-fields.
2024-01-16 11:29:35 -03:00
a8f9e5676f
docs(mqtt_bridge): add API examples
2024-01-16 10:42:52 -03:00
60fab6ee45
refactor: attempt to improve function names
2024-01-16 10:42:52 -03:00
c6cd3adccb
refactor: fix type upgrade calls and move compatiblitly logic
...
Some bridge V1 to V2 calls were wrong but did not seem to cause issues
(perhaps due to locking test coverage). This commit also move
compatibility logic from the API module to the emqx_bridge_v2 module
where most of the compatibility logic exists.
2024-01-16 10:42:52 -03:00
440a543a85
docs: fix typo
2024-01-16 10:42:52 -03:00
938429f351
chore(mqtt_bridge): change schema to remote `remote` sub-fields and hide `local`
...
`local` is still needed for backwards compatibility
2024-01-16 10:42:52 -03:00
007af20a30
test(bridge_v2_api): adapt more tests to sources
2024-01-16 10:42:52 -03:00
fc88a1ed1e
test(sources_api): add some tests to cover `/sources` HTTP API
...
Also fixes a bug with `DELETE /sources/:id`
2024-01-16 10:42:52 -03:00
8f304d3456
test(bridge_v2_api): refactor suite to use CT matrix
2024-01-16 10:42:52 -03:00
cc24fe6e93
feat(mqtt_consumer): add support for rule engine `FROM`
2024-01-16 10:42:52 -03:00
28de7c89c7
feat: add `/sources*` HTTP APIs
2024-01-16 10:42:52 -03:00
e6ccfa5b39
fix(mqtt_bridge): fixes after rebasing onto current `master`
...
Rebased on top of 7f57ec47d5
2024-01-16 10:42:52 -03:00
6511693b2e
refactor(action_api): prepare for `/sources` HTTP API
2024-01-16 10:42:52 -03:00
12dc9fbeb9
test(mqtt_bridge): fix assertion
2024-01-16 10:42:52 -03:00
862283ff7c
test: fix expected connector name after name convention generation changed
2024-01-16 10:42:52 -03:00
7fc069da46
test: fix another broken test
2024-01-16 10:42:52 -03:00
1ad3100cad
chore: add i18n
2024-01-16 10:42:52 -03:00
3597ee7c93
fix(mqtt_action): fix resource_opts schema
2024-01-16 10:42:52 -03:00
ab1b0dda67
refactor: fix typo
2024-01-16 10:42:52 -03:00
697c8f5ee1
test: fix broken tests
2024-01-16 10:42:52 -03:00
cc34660ab9
fix(actions): use backward-compatible ids
2024-01-16 10:42:52 -03:00
14b99737e9
fix(mqtt_bridge): add missing fields to POST api spec; fix test
2024-01-16 10:42:52 -03:00
7befe898d0
fix(mqtt_bridge): fix schema
2024-01-16 10:42:52 -03:00
139da6d720
fix: don't double-write the transformed config; return a triplet in all cases
2024-01-16 10:42:52 -03:00
2ecc775fb7
style: remove commented out code and fix copyright headers
2024-01-16 10:42:52 -03:00
886ed55374
fix: don't call non-existing function
2024-01-16 10:42:52 -03:00
145ed2e632
fix: elvis style error
2024-01-16 10:42:52 -03:00
f199a0f24a
feat: refactor MQTT bridge to source, action, and connector
...
This commit:
* refactors the MQTT V1 bridge into connector, source and action
* Extends the compatibility layer so it works for sources
* Fixes the MQTT bridge test suite so that all test cases passes
We still need to add a HTTP API handling sources. Also, we still need to
add HTTP API example schemes and examples for the MQTT
connector/action/source.
We should also make sure that we handle the corner cases of the MQTT V1
bridge automatic upgrade downgrade in a sufficiently good way:
* An error is currently thrown when converting an MQTT V1 bridge without
egress or ingress config.
* If there is a source and action with the same name we will currently
throw an error in the compatibility layer.
* We will also throw an error when converting an MQTT V1 bridge with
both ingress and egress.
The above is probably the right thing to do but we have to make sure
that we return a reasonable error to the user when this happens.
(partly)
Fixes:
https://emqx.atlassian.net/browse/EMQX-11489
2024-01-16 10:42:52 -03:00
996a851cf6
chore: format username as string in log formatter
2024-01-16 14:42:10 +01:00
541525c50f
fix(authz): fix authz result logs
...
prior to this fix, it's always the default authz result logged at
warning level
2024-01-16 14:40:53 +01:00
1fe1a62fe2
test: fix already exported function warning
2024-01-16 14:00:34 +01:00
ab66986f16
feat: add 'tags' field for action and connector
2024-01-16 13:57:48 +01:00
b6d0365027
Merge pull request #12267 from HJianBo/new-timeout-param-for-invite
...
feat(cluster): supports inviting nodes to join the cluster in an asynchronous manner
2024-01-16 10:11:20 +08:00
58a54adbb4
Merge remote-tracking branch 'origin/master' into release-55
2024-01-15 17:58:48 +01:00
04d3e0335b
Merge pull request #12328 from lafirest/fix/iotdb
...
fix(iotdb): ensure the `data` field is `required`
2024-01-15 23:26:36 +08:00
50ce2384d9
fix(iotdb): ensure the `data` field is `required`
2024-01-15 20:29:58 +08:00
d2d3ddb72a
test(quic): listener port updates
2024-01-15 11:42:45 +01:00
c77837a9ea
feat(quic): support reload with new binding port
2024-01-15 11:33:25 +01:00
90c2a5445c
Merge pull request #12295 from zhongwencool/elasticsearch
...
feat: support elasticsearch bridge
2024-01-15 14:13:38 +08:00
ace443fc18
refactor: refactor es's action
2024-01-15 11:31:13 +08:00
4c40e754f4
chore: forward the async invite to leader node
2024-01-15 11:24:05 +08:00
e49d3ca50c
feat: support elasticsearch bridge
2024-01-15 09:33:44 +08:00
e3fee93d9f
fix: write quoted strings to influxdb failed
2024-01-15 09:29:09 +08:00
1668e9ac7d
fix: cannot write literal numbers to influxdb
2024-01-15 09:29:09 +08:00
93ef6766ef
chore: apply suggestions from code review
...
Co-authored-by: Zaiming (Stone) Shi <zmstone@gmail.com>
2024-01-13 15:29:58 +08:00
d2991dae03
chore: make dialyzer happy
2024-01-13 15:29:58 +08:00
81209e0ded
chore: update changes
2024-01-13 15:29:58 +08:00
944137ad45
chore: format error message
2024-01-13 15:29:58 +08:00
6ff4c560e4
feat: support invite node in async mananer
2024-01-13 15:29:58 +08:00
a08f56db42
feat(cluster): expose the timeout parameter to invite node
2024-01-13 15:29:58 +08:00
4736012d0a
Merge pull request #12317 from thalesmg/fix-mongo-batch-schema-m-20240112
...
fix(mongodb_action): make `batch_size` hidden and fixed in the API
2024-01-12 14:51:38 -03:00
eca2f972bc
Merge pull request #12237 from keynslug/fix/EMQX-11483/broker
...
feat(routing): add route sync process pool
2024-01-12 14:44:31 +01:00
a5e7db793b
fix(mongodb_action): make `batch_size` hidden and fixed in the API
...
Fixes https://emqx.atlassian.net/browse/ED-1171
The old bridge schema already had this override, but it had not been ported to actions.
2024-01-12 10:04:32 -03:00
1c0ca72877
Merge pull request #12316 from lafirest/fix/iotdb
...
fix(iotdb): move the iot_version into IoTDB connector
2024-01-12 20:56:10 +08:00
61417f26d4
chore: bump versions to 5.5.x
2024-01-12 13:54:35 +01:00
b4eac25678
chore(broker): fix code style issue
...
Co-Authored-By: Zaiming (Stone) Shi <zmstone@gmail.com>
2024-01-12 13:54:23 +01:00
d1ae6f5195
Merge pull request #12306 from thalesmg/fix-password-deobfuscate-m-20240111
...
fix(bridge_api): correctly deobfuscate secrets during dry run
2024-01-12 09:13:20 -03:00
b15106c753
fix(iotdb): robustify type verification
...
1. let the type is not case sensitive
2. return error if type is invalid
2024-01-12 19:22:06 +08:00
2f98f1faaf
fix(route-sync): ensure batch sync preserve idemopotency
2024-01-12 11:57:26 +01:00
e21a3497c7
chore(route-sync): turn TODO into comment
2024-01-12 11:57:26 +01:00
8f4758d9d4
feat(route-sync): use the smallest possible min sync delay
2024-01-12 11:57:26 +01:00
2ac6cddf19
fix(route-sync): handle batch sync errors gracefully
2024-01-12 11:57:25 +01:00
a28fc7bfa8
feat(route-sync): do not run empty batches
2024-01-12 11:57:25 +01:00
2dffd44985
feat(route-sync): allow to enable syncer pool only on cores/replicants
...
So we would able to roll it out and test more gradually.
2024-01-12 11:57:25 +01:00
884f784c1c
refactor(router): don't `emqx_broker_helper:monitor/1` in batches
...
As per out current understanding, this doesn't changes much in terms of
observability, since other nodes call `ekka:monitor(membership)` anyway,
so they will observe nodedowns without explicitly writing an entry into
the `?ROUTING_NODE` table.
2024-01-12 11:57:25 +01:00
d6f731c4fc
fix(route-sync): use public function as mria activity target
2024-01-12 11:57:25 +01:00
7d037cfe91
chore(route-sync): clarify why wait indefinitely for reply
2024-01-12 11:57:24 +01:00
498b7a922d
chore(syncer): fix code style issues
...
Co-Authored-By: Zaiming (Stone) Shi <zmstone@gmail.com>
2024-01-12 11:57:24 +01:00
0b3f5f7c37
feat(syncer): allow to turn syncer pool on/off through config
2024-01-12 11:57:24 +01:00
38e13f2337
fix(syncer): start syncer pool before broker pool
...
As the latter depends on the former.
2024-01-12 11:57:24 +01:00
a1ccf85c66
test(routesync): verify that syncer preserves consistency
...
Under a highly concurrent load. Be aware that this testcase is not
deterministic.
2024-01-12 11:57:24 +01:00
5aeff20f8b
fix(routesync): ensure causal relationships are preserved
...
At the cost of strict FIFO semantics though.
2024-01-12 11:57:23 +01:00
f92b5b3f32
feat(stream): add simple stream over process message queue
2024-01-12 11:57:23 +01:00
54f8b47455
feat(routing): add route sync process pool
...
Dedicated to synchronizing local state updates with the global view
of the routing state.
2024-01-12 11:57:18 +01:00
0f1aaa65bc
fix(iotdb): move the `iot_version` into IoTDB connector
2024-01-12 17:52:31 +08:00
9e85b53c39
Merge pull request #12296 from HJianBo/fix-delayed-message-http-api-500
...
fix(delayed): fix http 500 error
2024-01-12 09:37:41 +08:00
79a4a041e4
fix(bridge_api): correctly deobfuscate secrets during dry run
...
Fixes https://emqx.atlassian.net/browse/EMQX-11733
2024-01-11 15:42:14 -03:00
ef0850c71f
Merge pull request #12305 from savonarola/1101-fix-channel-info-update
...
fix(conn): avoid storing incomplete channel info
2024-01-11 18:48:53 +02:00
4c66a1135b
Merge pull request #12303 from savonarola/0111-fix-indexing
...
fix(retainer): fix topic search by index
2024-01-11 18:44:56 +02:00
7b0b2a0527
fix(conn): avoid storing incomplete channel info
2024-01-11 18:08:13 +03:00
09d524144b
fix(retainer): fix topic search by index
2024-01-11 16:00:58 +03:00
6ddbfd7b43
fix(gcp_pubsub_producer): mark connector resource opts fields as deprecated
...
Fixes https://emqx.atlassian.net/browse/EMQX-11703
2024-01-11 09:53:36 -03:00
c026d3f18a
Merge pull request #12300 from lafirest/fix/clients_api
...
fix(api): fix `api/v5/clients ` may crash when a client authenticate with JWT
2024-01-11 19:10:54 +08:00
f042462d53
Merge pull request #12290 from lafirest/fix/retain_match
...
fix(retain): add `hasnext` into the meta data for the `GET /retain/messages`
2024-01-11 18:09:29 +08:00
aca9942fd4
fix(api): fix `api/v5/clients ` may crash when a client authenticate with JWT
2024-01-11 16:53:02 +08:00
f896cf2f4f
fix(retain): add `hasnext` into the meta data for the `GET /retain/messages`
2024-01-11 16:14:40 +08:00
596607d549
chore: update bpapi.versions
2024-01-11 14:56:02 +08:00
c4dd083fd9
fix(delayed): delete delayed messge on all nodes
2024-01-11 14:12:30 +08:00
eea0ec135f
fix(delayed): fix http 500 error
2024-01-11 10:36:55 +08:00
b16920e796
Merge pull request #12285 from HJianBo/shorten-coap-params
...
feat(coap): support short param names
2024-01-11 09:09:09 +08:00
8bea0711ac
Merge pull request #12196 from SergeTupchiy/EMQX-10891-route-cleanup-optimization
...
EMQX-10891 route cleanup optimization
2024-01-10 17:26:24 +02:00
8532e0cf59
Merge pull request #12292 from thalesmg/fix-syskeeper-v2-only-m-20240110
...
fix(syskeeper_bridge): mark syskeeper forwarder as a v2-only action
2024-01-10 11:42:24 -03:00
965ce5d446
perf: use mria:match_delete/2 to cleanup routes
...
This must be much more network efficient since both Mria and Mnesia
need only to replicate one op, e.g.: `{MatchPattern, clear_table}`
instead of replicating one per each key to be deleted.
2024-01-10 16:23:58 +02:00
febaaefc38
chore: upgrade ekka to 0.18.1 (mria 0.8.1)
...
Mria 0.8.1 release implements `mria:match_delete/2` function
2024-01-10 16:23:58 +02:00
b395924569
Merge pull request #12283 from thalesmg/fix-gcp-pubsub-produ-resopts-m-20240109
...
fix(gcp_pubsub_producer): fix connector `resource_opts` schema
2024-01-10 11:08:39 -03:00
7c8a36fc06
Merge pull request #12289 from zmstone/0108-support-acl-cache-masks
...
0108 support acl cache excludes
2024-01-10 13:40:29 +00:00
ieQu1