6a21766ce3
refactor: split cassandra bridges to actions and connectors
2024-01-25 16:01:44 +08:00
497e735bf4
ci: add env vars to run cassandra tests locally
2024-01-25 16:01:43 +08:00
186e1591df
chore: document api-key path api only support bearerAuth
2024-01-25 16:01:43 +08:00
b44420c14f
fix(opentsdb): Enhanced the type support for template data
2024-01-25 16:01:43 +08:00
83a8822798
chore(opents): bump version && update changes
2024-01-25 16:01:43 +08:00
dad8a32e0b
feat(opents): improve the OpentsDB bridge to v2 style
2024-01-25 16:01:43 +08:00
878c9ee8b1
fix(ds): do not count persistent session-only routed messages as dropped
...
Fixes https://emqx.atlassian.net/browse/EMQX-11539
2024-01-25 16:01:43 +08:00
d323fc7c27
feat(ps): add message gc
2024-01-25 16:01:43 +08:00
7c0d37fdb9
feat(lts): inherit previous generation's lts when possible
2024-01-25 16:01:43 +08:00
4a0fd756ae
feat(ds): add `list_generations` and `drop_generation` APIs
2024-01-25 16:01:43 +08:00
fb39e1eacc
feat(ds): allow customizing the data directory
...
The storage expectations for the RocksDB DB may be different from our usual data
directory. Also, it may consume a lot more storage than other data.
This allows customizing the data directory for the builtin DS storage backend.
Note: if the cluster was already initialized using a directory path, changing that config
will have no effect. This path is currently persisted in mnesia and used when reopening
the DB.
2024-01-25 16:01:42 +08:00
51d32bd620
chore: improve http connector logs format
2024-01-25 16:01:42 +08:00
adf22f1f10
fix(mqtt_bridge): render valid messages from incomplete rule data
2024-01-25 16:01:42 +08:00
a8c6280a5e
test(emqx_cm_SUITE): use one helper function: `emqx_pool:flush_async_tasks/1`
2024-01-25 16:01:42 +08:00
f52cc93d9d
perf(emqx_cm): use a dedicated pool for channel cleanup
...
This is to isolate channels cleanup from other async tasks (like routes cleanup),
as channels cleanup can be quite slow under high network latency conditions.
Fixes: EMQX-11743
2024-01-25 16:01:42 +08:00
52a7b45d97
fix: upgrade ekka to 0.18.3 to ensure the leader correct
2024-01-25 14:47:59 +08:00
3bc6e546e0
fix: reboot emqx_dashboard after emqx_licencse
2024-01-25 12:29:04 +08:00
4eb0260eaf
Merge pull request #12381 from emqx/port-sql-funcs-from-emqx4
...
feat: port emqx/emqx-enterprise#1892 , add some SQL functions
2024-01-25 11:12:58 +08:00
ff0fd65f9d
Merge pull request #12373 from JimMoen/fix-prom-data-aggre
...
Follow up #12299
2024-01-25 10:37:47 +08:00
a752119d05
fix(prom_di): use bridge_v2 metrics api
2024-01-25 09:22:22 +08:00
61dd362db0
fix(prom_di): api crash in `connecting`
...
- https://emqx.atlassian.net/browse/EMQX-11801
2024-01-25 09:22:21 +08:00
ae387d1812
ci: start/flush cover when using peer
...
`cover` is not automatically started by `peer`. Without starting/flushing it, we don't
get coverage data from peer nodes.
2024-01-24 18:02:47 -03:00
9fb6688801
fix(quic): Per listener conn count
2024-01-24 21:36:25 +01:00
a19cf253ae
Merge pull request #12359 from thalesmg/fix-connector-app-deps-r55-20240119
...
fix(machine_boot): inject connector/bridge apps as dependencies to `emqx_connector` app
2024-01-24 15:40:24 -03:00
7b5f2948fe
test(ds): Fix flaky testcase
2024-01-24 19:33:30 +01:00
305a54f646
chore(ds): Update BPAPI version
2024-01-24 19:33:30 +01:00
eee221f1d0
feat(ds): Make egress batching configurable
2024-01-24 19:33:30 +01:00
137535a821
feat(ds): Introduce egress process for the builtin backend
2024-01-24 19:33:30 +01:00
ec93d8cf18
Merge pull request #12385 from ieQu1/ds-meta-ram-cache
...
fix(ds): Cache database metadata in RAM
2024-01-24 19:32:38 +01:00
9b7df302e8
fix(ds): Cache database metadata in RAM
2024-01-24 18:43:48 +01:00
fa842736d2
feat: refactor kinesis bridge to connector and action
...
Fixes:
https://emqx.atlassian.net/browse/EMQX-11461
2024-01-24 18:31:03 +01:00
5547a40ceb
fix(ds): don't use env var for data dir default value
...
Fixes https://github.com/emqx/emqx/pull/12380
2024-01-24 11:39:14 -03:00
ace1303de2
fix(prom_auth): authz metric name: `allow` and `deny`
...
- https://emqx.atlassian.net/browse/EMQX-11799
2024-01-24 22:38:49 +08:00
5e02709de0
fix(prom_auth): authz_enable key from enable status
...
- https://emqx.atlassian.net/browse/EMQX-11800
2024-01-24 22:38:48 +08:00
4afba8eb94
feat: port emqx/emqx-enterprise#1892 , add some SQL functions
2024-01-24 18:50:57 +08:00
6e3ce4d644
fix(prom_stats): emqx_stats metric type should be gauge
2024-01-24 14:11:17 +08:00
4a1d1b6aeb
fix: topics and retained metrics are cluster consistented
2024-01-24 14:11:16 +08:00
731efd8b49
fix(prom): cluster aggre/unaggre labels
2024-01-24 14:11:15 +08:00
497ec04359
fix(prom): missing callback attribute
2024-01-24 14:11:14 +08:00
947a08d1d2
Merge pull request #12375 from thalesmg/fix-actions-reset-node-metrics-r55-20240123
...
fix(actions_api): reset metrics on all nodes
2024-01-24 09:17:09 +08:00
77329209a2
Merge pull request #12368 from thalesmg/ds-inherit-wildcards-only-lts-m-20240122
...
perf(ds): inherit only LTS paths containing wildcards when adding a new generation
2024-01-23 17:14:51 -03:00
67c9e9c8fc
fix(actions_api): reset metrics on all nodes
...
Fixes https://emqx.atlassian.net/browse/EMQX-11796
2024-01-23 10:40:02 -03:00
eecd7e084c
test(ds): reduce flakiness
2024-01-23 09:47:03 -03:00
1be5b6aaf3
fix(mqtt_action): use overridden `resource_opts`
...
Fixes https://emqx.atlassian.net/browse/EMQX-11790
2024-01-23 09:41:28 -03:00
1eb47d0c16
perf(ds): inherit only LTS paths containing wildcards when adding a new generation
...
Fixes https://github.com/emqx/emqx/pull/12338#discussion_r1462139499
2024-01-23 09:20:28 -03:00
a8eefe808f
Merge pull request #12371 from emqx/es-server-schema
...
chore: es's base_url to server
2024-01-23 17:17:19 +08:00
6a9cbb3d97
test: add es's update test
2024-01-23 15:51:09 +08:00
aafb683ec7
Merge pull request #12330 from emqx/bridge-v2-cassandra
...
refactor: split cassandra bridges to actions and connectors
2024-01-23 14:45:32 +08:00
94692162b5
Merge pull request #12370 from zhongwencool/api-key-auth
...
chore: document api-key path api only support bearerAuth
2024-01-23 14:22:35 +08:00
218af3fef4
chore: update ecql to 0.6.0
2024-01-23 14:14:23 +08:00
9d2a207184
Merge pull request #12353 from lafirest/feat/optsdb
...
feat(opents): improve the OpentsDB bridge to v2 style
2024-01-23 13:49:33 +08:00
dc458ff0db
Merge pull request #12366 from lafirest/fix/sys
...
fix(sysk): fix probe testing bugs for syskeeper
2024-01-23 13:49:28 +08:00
51e8c955ff
fix(connector): make the connector id unique when doing probe testing
2024-01-23 13:03:12 +08:00
ada2785b5d
chore: es's base_url to server
2024-01-23 12:20:34 +08:00
0dbaaa5d94
chore: document api-key path api only support bearerAuth
2024-01-23 10:31:43 +08:00
28867d07e6
fix(opentsdb): Enhanced the type support for template data
2024-01-23 10:00:56 +08:00
609ba7e332
fix(ds): do not count persistent session-only routed messages as dropped
...
Fixes https://emqx.atlassian.net/browse/EMQX-11539
2024-01-22 16:58:45 -03:00
d122340c13
Merge pull request #12338 from thalesmg/ds-message-gc-20240115
...
feat(ds): add message GC
2024-01-22 16:57:26 -03:00
7035b4c8b3
feat(ps): add message gc
2024-01-22 14:53:17 -03:00
db710c4be5
feat(lts): inherit previous generation's lts when possible
2024-01-22 14:53:17 -03:00
75b08b525b
feat(ds): add `list_generations` and `drop_generation` APIs
2024-01-22 14:53:17 -03:00
39090d3732
Merge pull request #12340 from thalesmg/ds-db-data-path-m-20240116
...
feat(ds): allow customizing the data directory
2024-01-22 13:30:59 -03:00
3207f0ea80
fix(machine_boot): inject connector/bridge apps as dependencies to `emqx_connector` app
...
Fixes https://emqx.atlassian.net/browse/EMQX-11771
For the same reasons as we inject `emqx_bridge_*` applications as dependencies to
`emqx_bridge` when starting the node. Already configured connectors are started when
`emqx_connector` application starts, and may lead to crashes and noise in the logs. One
example is to configure a mongodb bridge and restart the node.
2024-01-22 11:13:34 -03:00
3f7b913e88
chore(opents): bump version && update changes
2024-01-22 20:45:18 +08:00
e337e1dc40
feat(opents): improve the OpentsDB bridge to v2 style
2024-01-22 20:45:10 +08:00
cd90b93550
fix(sysk): fix probe testing bugs for syskeeper
2024-01-22 20:27:48 +08:00
2706e005ff
Merge pull request #12354 from SergeTupchiy/EMQX-11751-dashboard-import-timeout-rel55
...
Apply brdige post config changes in parallel
2024-01-22 17:24:55 +08:00
2061d75b50
docs: prometheus api `mode` field description
2024-01-22 10:39:56 +08:00
2263df0242
fix(prom_push_gw): use format mode `node` for prometheus push gateway
2024-01-22 10:39:55 +08:00
b424f8ac12
feat(prom_stats): aggregated/unaggregated prometheus data
2024-01-22 10:39:54 +08:00
6b064dd8eb
fix(prom_stats): missing metric key
...
- follow https://github.com/emqx/emqx/pull/11497
2024-01-22 10:39:53 +08:00
c6c1a7fc28
refactor(prom): prom_auth and prom_di as prom_cluster behaviour
2024-01-22 10:39:52 +08:00
b480c5b371
fix(prom): use name `mode` and macros to put/get format mode
2024-01-22 10:39:51 +08:00
0e1043f80c
ci: update generated connector name
2024-01-22 10:34:40 +08:00
f7ae9ab489
Merge pull request #12351 from HJianBo/improve-the-http-connector-logs
...
chore: improve http connector logs format
2024-01-22 10:27:35 +08:00
b32c0fb0d8
refactor: split cassandra bridges to actions and connectors
2024-01-22 10:16:46 +08:00
29d767bd62
ci: add env vars to run cassandra tests locally
2024-01-22 10:16:46 +08:00
8cb12c6a74
refactor: use utils func for prom_auth and prom_di
2024-01-21 00:14:54 +08:00
c3da792323
feat(prom_di): cluster aggregated/unaggregated metrics
2024-01-21 00:14:53 +08:00
9627124d67
fix(prom_di): metric `emqx_rule_enable`
2024-01-21 00:14:52 +08:00
5534d5e9de
fix(bpapi): make static_check happy
2024-01-21 00:14:51 +08:00
5914eb5ca5
fix(prom_cert): rm cacertfile expiry epoch
2024-01-21 00:14:50 +08:00
4fb1ff2f9d
fix(prom_api): format-mode example value
2024-01-21 00:14:49 +08:00
57f3efde63
feat(prom_auth): cluster metrics with different format-mode
2024-01-21 00:14:48 +08:00
fb330f77e6
feat(prometheus): api `format_mode` parameter support
...
- node(default):
The only supported format_mode for PushGateway.
Return the current node's metrics.
- Without label `node_name` with content-type: `text/plain`.
- Without key `node_name` with content-type: `application/json`
- nodes_aggregated:
Return all nodes metrics Arithmetic-Sum or Logical-Sum.
See details in callback modules.
- Logical-Sum for metrics named with `xxx_enable` or `xxx_status`.
- Arithmetic-Sum for other metrics.
`node_name` field:
- Without label `node_name` with content-type: `text/plain`.
- Without key `node_name` with content-type: `application/json`
- nodes_unaggregated:
Return all nodes metrics without aggregated.
`node_name` field:
- _With_ label `node_name` with content-type: `text/plain`.
- _With_ key `node_name` with content-type: `application/json`
2024-01-21 00:14:47 +08:00
94032aafb2
fix(prom_data_integration): fix metric type
2024-01-21 00:14:46 +08:00
c3e9533260
fix: prometheus auth metrics fields and type
...
- rm rate fields
- fix few fields type to counter
2024-01-21 00:14:45 +08:00
a18c4d193a
refactor: abstract function call
2024-01-21 00:14:44 +08:00
8f7964f435
feat(prom): data integration metrics in josn format
2024-01-21 00:14:42 +08:00
36f009b0c2
fix(prom): connectors specific data
2024-01-21 00:14:41 +08:00
76d9ace582
fix: connector_count contains bridge_v1 and bridge_v2
2024-01-21 00:14:40 +08:00
f457def201
fix: use `id` uniformly as the label key for rules and actions
2024-01-21 00:14:39 +08:00
4b23930fce
fix(prometheus): license expiry and schema_registry only for ee
2024-01-21 00:14:38 +08:00
38a90bd273
fix(prom_auth): authn && authz data response by josn
2024-01-21 00:14:37 +08:00
0dca9905dd
test(prometheus): `{Registry, Collector}` tuple
2024-01-21 00:14:36 +08:00
7832bbc0a4
fix(prom): schema registry not in ce edition
2024-01-21 00:14:35 +08:00
5158395bcf
feat(prometheus): data integration prom data
2024-01-21 00:14:34 +08:00
bf2e4d134a
refactor(prometheus): generic api response funcs
2024-01-21 00:14:33 +08:00
e0feb580b6
feat(prometheus): auth metrics with text/plain
2024-01-21 00:14:32 +08:00
092159b071
feat(prometheus): cert expiry epoch in endpoint `/prometheus/stats`
2024-01-21 00:14:31 +08:00
Shawn