e9c8446d57
feat: upgrade erlfmt to support maybe syntax
2024-01-31 20:06:49 +08:00
38047108a4
test: add test coverage for emqx_cm_registry_keeper module
2024-01-31 09:50:12 +01:00
209331ad33
test: fix config test
2024-01-31 09:50:12 +01:00
87a2368e37
feat(metrics): add cluster_session guage
2024-01-31 09:50:12 +01:00
509ab6f35a
feat(api): add /sessions_count api to count sessions
2024-01-31 09:50:12 +01:00
562a2736ae
feat: add `broker` root to hot-config schema
2024-01-31 09:50:12 +01:00
e9318752e6
feat: store session unregistration timestamp in emqx_cm_registry table
2024-01-31 09:50:12 +01:00
5bc67cb288
Merge pull request #12432 from ieQu1/ds_ignore_fully_replayed_streams
...
fix(sessds): Stream scheduler must ignore fully replayed streams
2024-01-31 09:51:49 +02:00
13df7fa46e
fix(dashboard): add test case & update change
2024-01-31 14:14:56 +08:00
e843d9fd91
fix(sessds): Stream scheduler must ignore fully replayed streams
2024-01-31 00:20:54 +01:00
274f378c6e
fix: better delete of local_topic as suggested by @thalesmg
...
Co-authored-by: Thales Macedo Garitezi <thalesmg@gmail.com>
Co-authored-by: Thales Macedo Garitezi <thalesmg@gmail.com>
2024-01-30 17:53:32 +01:00
c7f1e44513
Merge pull request #12424 from lafirest/fix/opentsdb
...
feat(opentsdb): supports more flexible tags schema
2024-01-30 22:05:30 +08:00
55fdc83aa5
Merge remote-tracking branch 'origin/release-55' into 0130-syn-release-55-to-master
2024-01-30 12:06:43 +01:00
c0674913e2
Merge pull request #12421 from HJianBo/fix-import-users
...
fix(user_import): ensure the last record overwrites previous one
2024-01-30 18:49:35 +08:00
81f96f1a68
feat(opentsdb): supports more flexible tags schema
2024-01-30 18:43:39 +08:00
03ff6f2ddf
Merge pull request #12410 from SergeTupchiy/EMQX-11812-subscribe-performance-degraded
...
perf(emqx_broker): pick broker pool worker by topic/shard pair to dis…
2024-01-30 11:48:59 +02:00
db3f285054
Merge pull request #12417 from emqx/port-msg-expiry-interval-from44
...
feat: configurable server side message_expiry_interval
2024-01-30 17:10:32 +08:00
206af96a33
ci: update testcases for message-expiry-interval
2024-01-30 15:46:11 +08:00
4190682a16
chore: fix the data type and example value for cluster invitation result
2024-01-30 15:29:46 +08:00
aedfc8e8c0
fix(user_import): ensure the last record overwrites previous one
2024-01-30 14:14:20 +08:00
35c4ef2ee2
Merge pull request #12407 from zmstone/0126-script-to-update-bsl-license-convert-time
...
0126 script to update bsl license convert time
2024-01-30 09:54:34 +08:00
4688b36cdf
Merge pull request #12396 from HJianBo/import_user_2
...
feat(import_users): support user's password in plain text
2024-01-30 09:00:00 +08:00
5007650bd2
perf(emqx_broker): pick broker pool worker by topic/shard pair to distribute the load more evenly.
...
Fixes: EMQX-11812
2024-01-29 20:57:10 +02:00
cf0465dad4
Merge pull request #12411 from thalesmg/fix-cassandra-null-r55-20240126
...
fix(cassandra_bridge): correctly insert null values into columns
2024-01-29 14:09:12 -03:00
b849b08dbc
fix: kinesis schema problems found by @HJianBo
...
This commit fixes problems in schema found by @HJianBo here:
https://github.com/emqx/emqx/pull/12376#pullrequestreview-1848306286
2024-01-29 18:08:53 +01:00
7ee0a6aaa4
Merge pull request #12414 from ieQu1/dev/ds-readme
...
doc(ds): Update README
2024-01-29 18:01:03 +01:00
82403167c2
chore: update BSL license change date
2024-01-29 16:47:31 +01:00
47f61ba68a
fix(cassandra_bridge): correctly insert null values into columns
...
Fixes https://emqx.atlassian.net/browse/EMQX-11822
2024-01-29 11:32:00 -03:00
cb90d3c90c
Merge pull request #12415 from ieQu1/dev/remove-ds-conf-module
...
fix(ds): Remove unused module
2024-01-29 12:56:04 +01:00
9f22c2c455
ci: add some sleep and retry to emqx_persistent_session_ds_SUITE
2024-01-29 18:18:18 +08:00
d12335c4c6
chore: add tests
2024-01-29 18:10:42 +08:00
d286b7e28c
Merge pull request #12404 from thalesmg/fix-action-metric-handler-r55-20240126
...
fix(resource_metrics): avoid detaching handler on crashes
2024-01-29 17:51:04 +08:00
12da3c0986
feat: configurable server side message_expiry_interval
2024-01-29 17:29:52 +08:00
fa6d65887d
test(retainer): fix test cases
2024-01-29 08:42:36 +01:00
e4b8d79444
fix(retainer): add default delivery rate in the schema
2024-01-29 08:04:58 +01:00
ab99a17c99
chore(utils_stream): simplfy the csv reader implementation
2024-01-29 11:10:50 +08:00
2e35024df1
test: update eunit tests
2024-01-29 10:49:07 +08:00
9915c85b0b
chore(authn_mnesia): use emqx_utils_stream module to imporve reusability
2024-01-29 10:49:07 +08:00
8fc8106819
test: cover password_type and new data format
2024-01-29 10:49:07 +08:00
829887630d
test: refine existed test cases
2024-01-29 10:49:07 +08:00
fed512689a
chore: make elvis checking happy
2024-01-29 10:49:07 +08:00
e65cfb836c
feat(import_users): support user's password in plain text
2024-01-29 10:49:07 +08:00
2479e1189a
fix(ds): Remove unused module
2024-01-29 00:36:13 +01:00
96c527541b
docs(ds): Update README
2024-01-28 20:27:20 +01:00
dbe2baa405
Merge pull request #12408 from zmstone/sync-release-55
...
Sync release 55
2024-01-27 19:20:58 +00:00
2c6a776318
fix(sessds): Stricter checks for PacketIds
2024-01-26 17:49:33 +01:00
eec56b0d6b
fix(sessds): Improve comments
2024-01-26 17:49:33 +01:00
3c451c6ae6
test(sessds): Fix unstable tests
2024-01-26 17:49:33 +01:00
2d23212792
refactor(sessds): #ifs -> #srs
2024-01-26 17:49:33 +01:00
974760d331
test(sessds): Don't trap exits in the test
2024-01-26 17:49:33 +01:00
ebe2339810
fix(sessds): Use mria:async_dirty instead of transaction
2024-01-26 17:49:33 +01:00
f5b9bd30aa
fix(sessds): Apply review remarks
2024-01-26 17:49:33 +01:00
39857626ce
test(sessds): Fix failing tests
2024-01-26 17:49:33 +01:00
e7b03cdc59
test(sessds): Create a property-based test for the session state
2024-01-26 17:49:33 +01:00
893656f092
fix(sessds): Fix session garbage collection after the refactoring
2024-01-26 17:49:33 +01:00
963df8f941
fix(sessds): Delete the routes when the session expires
2024-01-26 17:49:33 +01:00
cff6c15e13
fix(sessds): Store the QoS as the MSB of the packet ID
2024-01-26 17:49:33 +01:00
978a3bfef3
refactor(sessds): Simplify representation of QoS tracks
2024-01-26 17:49:33 +01:00
1b4f69b44d
refactor(sessds): Simplify data structure of ds_state pmap datatype
2024-01-26 17:49:33 +01:00
4f4831fe7f
refactor(sessds): Factor out stream scheduler into its own module
2024-01-26 17:49:33 +01:00
82ef34998a
feat(sessds): Index streams by a unique subid
2024-01-26 17:49:33 +01:00
3fb2064ea4
test(sessds): Add property-based tests for seqno generator
2024-01-26 17:49:33 +01:00
8e8d3af096
fix(sessds): Refactor emqx_persistent_session_ds to use CRUD module
2024-01-26 17:49:33 +01:00
2d08aa88d8
refactor(ds): Create a CRUD module for the persistent session
2024-01-26 17:49:33 +01:00
6410f5a717
fix(resource_metrics): avoid detaching handler on crashes
...
Fixes https://emqx.atlassian.net/browse/EMQX-11821
2024-01-26 13:05:41 -03:00
2a40152721
Merge remote-tracking branch 'origin/release-55' into sync-release-55
2024-01-26 16:51:13 +01:00
933c00c7ad
Merge pull request #12392 from qzhuyan/perf/william/ws-no-utf8-validate
...
perf: new ws listener option to disable UTF-8 validation
2024-01-26 16:01:04 +01:00
0933dc818e
chore(ekka): Bump version to 0.18.4
...
Don't escalate the errors in etcd node discovery to the node level.
Fixes : #12255
2024-01-26 14:25:16 +01:00
a56a5e9c3c
chore: add copyright
2024-01-26 11:01:53 +02:00
2d693402c5
refactor: split greptimedb bridge to actions and connectors
2024-01-26 11:01:53 +02:00
726302ef6a
perf: new ws listener option to disable UTF-8 validation
2024-01-26 09:55:17 +01:00
2e37f7514a
fix(prom_stats): compatibility with previous api format in json mode
2024-01-26 16:01:32 +08:00
308cde53b9
fix(prom_stats): merge cl_consistented data into per nodes data
2024-01-26 11:39:20 +08:00
e29a80d568
Merge pull request #12388 from qzhuyan/dev/william/per-listn-conn-cnt
...
feat: quic per listener conn count
2024-01-26 09:01:39 +08:00
590746ddfa
Merge pull request #12400 from thalesmg/ds-fix-data-dir-schema-m-20240125
...
fix(ds): don't make data dir part of the schema
2024-01-25 15:52:11 -03:00
8e31afe6c2
fix(ds): don't make data dir part of the schema
...
The data directory was ending up being persisted in the database schema. This led to
issues when opening the DB on different nodes.
2024-01-25 14:44:06 -03:00
0b6aee0ae9
Merge pull request #12393 from lafirest/fix/iotdb
...
fix(iotdb): change the `data` field to optional
2024-01-25 23:00:36 +08:00
c37097a150
feat(dashboard): expose the `swagger_support` option
2024-01-25 22:58:16 +08:00
5bf37cbe0a
Merge pull request #12376 from kjellwinblad/kjell/kinesis
...
feat: refactor kinesis bridge to connector and action
2024-01-25 14:58:40 +01:00
b5567d9d9f
Merge pull request #12389 from thalesmg/ci-peer-cover-m-20240124
...
ci: start/flush cover when using peer
2024-01-25 10:00:50 -03:00
2887a05ba3
refactor: simplify emqx_bridge_kinesis (thanks to @thalesmg's tips)
2024-01-25 12:48:31 +01:00
4dca1ef848
fix(prom_di): compatibility with bridge_v1
2024-01-25 19:37:15 +08:00
7b041683bb
fix(prom_di): action enable and status
2024-01-25 19:36:40 +08:00
beeedd33d1
fix(prom_mria): mria_data in init_acc
2024-01-25 19:36:39 +08:00
58b60181d7
fix(prom_mria): move mria callback into `emqx_prometheus.erl`
...
- they will return in same api endpoint.
2024-01-25 19:36:38 +08:00
cfad0923cf
chore: use macros for connector and action status atoms
2024-01-25 11:50:01 +01:00
01f374d8e5
fix(iotdb): change the `data` field to optional
2024-01-25 18:29:41 +08:00
3b0736fc67
Merge pull request #12387 from thalesmg/sync-r55-m-20240124
...
sync release-55 to master
2024-01-25 17:35:41 +08:00
4f8accc31b
Merge branch 'master' into sync-r55-m-20240124
2024-01-25 16:09:05 +08:00
aeefbe9544
fix(ds): Cache database metadata in RAM
2024-01-25 16:01:44 +08:00
846ad42a65
fix(ds): don't use env var for data dir default value
...
Fixes https://github.com/emqx/emqx/pull/12380
2024-01-25 16:01:44 +08:00
024ffe2909
test(ds): reduce flakiness
2024-01-25 16:01:44 +08:00
9003bc5b72
perf(ds): inherit only LTS paths containing wildcards when adding a new generation
...
Fixes https://github.com/emqx/emqx/pull/12338#discussion_r1462139499
2024-01-25 16:01:44 +08:00
e4c683d6f8
chore: update ecql to 0.6.0
2024-01-25 16:01:44 +08:00
5cd9f49558
ci: update generated connector name
2024-01-25 16:01:44 +08:00
6a21766ce3
refactor: split cassandra bridges to actions and connectors
2024-01-25 16:01:44 +08:00
497e735bf4
ci: add env vars to run cassandra tests locally
2024-01-25 16:01:43 +08:00
186e1591df
chore: document api-key path api only support bearerAuth
2024-01-25 16:01:43 +08:00
b44420c14f
fix(opentsdb): Enhanced the type support for template data
2024-01-25 16:01:43 +08:00
83a8822798
chore(opents): bump version && update changes
2024-01-25 16:01:43 +08:00
dad8a32e0b
feat(opents): improve the OpentsDB bridge to v2 style
2024-01-25 16:01:43 +08:00
878c9ee8b1
fix(ds): do not count persistent session-only routed messages as dropped
...
Fixes https://emqx.atlassian.net/browse/EMQX-11539
2024-01-25 16:01:43 +08:00
d323fc7c27
feat(ps): add message gc
2024-01-25 16:01:43 +08:00
7c0d37fdb9
feat(lts): inherit previous generation's lts when possible
2024-01-25 16:01:43 +08:00
4a0fd756ae
feat(ds): add `list_generations` and `drop_generation` APIs
2024-01-25 16:01:43 +08:00
fb39e1eacc
feat(ds): allow customizing the data directory
...
The storage expectations for the RocksDB DB may be different from our usual data
directory. Also, it may consume a lot more storage than other data.
This allows customizing the data directory for the builtin DS storage backend.
Note: if the cluster was already initialized using a directory path, changing that config
will have no effect. This path is currently persisted in mnesia and used when reopening
the DB.
2024-01-25 16:01:42 +08:00
51d32bd620
chore: improve http connector logs format
2024-01-25 16:01:42 +08:00
adf22f1f10
fix(mqtt_bridge): render valid messages from incomplete rule data
2024-01-25 16:01:42 +08:00
a8c6280a5e
test(emqx_cm_SUITE): use one helper function: `emqx_pool:flush_async_tasks/1`
2024-01-25 16:01:42 +08:00
f52cc93d9d
perf(emqx_cm): use a dedicated pool for channel cleanup
...
This is to isolate channels cleanup from other async tasks (like routes cleanup),
as channels cleanup can be quite slow under high network latency conditions.
Fixes: EMQX-11743
2024-01-25 16:01:42 +08:00
52a7b45d97
fix: upgrade ekka to 0.18.3 to ensure the leader correct
2024-01-25 14:47:59 +08:00
3bc6e546e0
fix: reboot emqx_dashboard after emqx_licencse
2024-01-25 12:29:04 +08:00
4eb0260eaf
Merge pull request #12381 from emqx/port-sql-funcs-from-emqx4
...
feat: port emqx/emqx-enterprise#1892 , add some SQL functions
2024-01-25 11:12:58 +08:00
ff0fd65f9d
Merge pull request #12373 from JimMoen/fix-prom-data-aggre
...
Follow up #12299
2024-01-25 10:37:47 +08:00
a752119d05
fix(prom_di): use bridge_v2 metrics api
2024-01-25 09:22:22 +08:00
61dd362db0
fix(prom_di): api crash in `connecting`
...
- https://emqx.atlassian.net/browse/EMQX-11801
2024-01-25 09:22:21 +08:00
ae387d1812
ci: start/flush cover when using peer
...
`cover` is not automatically started by `peer`. Without starting/flushing it, we don't
get coverage data from peer nodes.
2024-01-24 18:02:47 -03:00
9fb6688801
fix(quic): Per listener conn count
2024-01-24 21:36:25 +01:00
a19cf253ae
Merge pull request #12359 from thalesmg/fix-connector-app-deps-r55-20240119
...
fix(machine_boot): inject connector/bridge apps as dependencies to `emqx_connector` app
2024-01-24 15:40:24 -03:00
7b5f2948fe
test(ds): Fix flaky testcase
2024-01-24 19:33:30 +01:00
305a54f646
chore(ds): Update BPAPI version
2024-01-24 19:33:30 +01:00
eee221f1d0
feat(ds): Make egress batching configurable
2024-01-24 19:33:30 +01:00
137535a821
feat(ds): Introduce egress process for the builtin backend
2024-01-24 19:33:30 +01:00
ec93d8cf18
Merge pull request #12385 from ieQu1/ds-meta-ram-cache
...
fix(ds): Cache database metadata in RAM
2024-01-24 19:32:38 +01:00
9b7df302e8
fix(ds): Cache database metadata in RAM
2024-01-24 18:43:48 +01:00
fa842736d2
feat: refactor kinesis bridge to connector and action
...
Fixes:
https://emqx.atlassian.net/browse/EMQX-11461
2024-01-24 18:31:03 +01:00
5547a40ceb
fix(ds): don't use env var for data dir default value
...
Fixes https://github.com/emqx/emqx/pull/12380
2024-01-24 11:39:14 -03:00
ace1303de2
fix(prom_auth): authz metric name: `allow` and `deny`
...
- https://emqx.atlassian.net/browse/EMQX-11799
2024-01-24 22:38:49 +08:00
5e02709de0
fix(prom_auth): authz_enable key from enable status
...
- https://emqx.atlassian.net/browse/EMQX-11800
2024-01-24 22:38:48 +08:00
4afba8eb94
feat: port emqx/emqx-enterprise#1892 , add some SQL functions
2024-01-24 18:50:57 +08:00
6e3ce4d644
fix(prom_stats): emqx_stats metric type should be gauge
2024-01-24 14:11:17 +08:00
4a1d1b6aeb
fix: topics and retained metrics are cluster consistented
2024-01-24 14:11:16 +08:00
731efd8b49
fix(prom): cluster aggre/unaggre labels
2024-01-24 14:11:15 +08:00
497ec04359
fix(prom): missing callback attribute
2024-01-24 14:11:14 +08:00
947a08d1d2
Merge pull request #12375 from thalesmg/fix-actions-reset-node-metrics-r55-20240123
...
fix(actions_api): reset metrics on all nodes
2024-01-24 09:17:09 +08:00
77329209a2
Merge pull request #12368 from thalesmg/ds-inherit-wildcards-only-lts-m-20240122
...
perf(ds): inherit only LTS paths containing wildcards when adding a new generation
2024-01-23 17:14:51 -03:00
67c9e9c8fc
fix(actions_api): reset metrics on all nodes
...
Fixes https://emqx.atlassian.net/browse/EMQX-11796
2024-01-23 10:40:02 -03:00
eecd7e084c
test(ds): reduce flakiness
2024-01-23 09:47:03 -03:00
1be5b6aaf3
fix(mqtt_action): use overridden `resource_opts`
...
Fixes https://emqx.atlassian.net/browse/EMQX-11790
2024-01-23 09:41:28 -03:00
1eb47d0c16
perf(ds): inherit only LTS paths containing wildcards when adding a new generation
...
Fixes https://github.com/emqx/emqx/pull/12338#discussion_r1462139499
2024-01-23 09:20:28 -03:00
a8eefe808f
Merge pull request #12371 from emqx/es-server-schema
...
chore: es's base_url to server
2024-01-23 17:17:19 +08:00
6a9cbb3d97
test: add es's update test
2024-01-23 15:51:09 +08:00
aafb683ec7
Merge pull request #12330 from emqx/bridge-v2-cassandra
...
refactor: split cassandra bridges to actions and connectors
2024-01-23 14:45:32 +08:00
94692162b5
Merge pull request #12370 from zhongwencool/api-key-auth
...
chore: document api-key path api only support bearerAuth
2024-01-23 14:22:35 +08:00
218af3fef4
chore: update ecql to 0.6.0
2024-01-23 14:14:23 +08:00
9d2a207184
Merge pull request #12353 from lafirest/feat/optsdb
...
feat(opents): improve the OpentsDB bridge to v2 style
2024-01-23 13:49:33 +08:00
dc458ff0db
Merge pull request #12366 from lafirest/fix/sys
...
fix(sysk): fix probe testing bugs for syskeeper
2024-01-23 13:49:28 +08:00
51e8c955ff
fix(connector): make the connector id unique when doing probe testing
2024-01-23 13:03:12 +08:00
ada2785b5d
chore: es's base_url to server
2024-01-23 12:20:34 +08:00
0dbaaa5d94
chore: document api-key path api only support bearerAuth
2024-01-23 10:31:43 +08:00
zhongwencool