yuanbiao/emqx
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
19,803 Commits 393 Branches 684 Tags 74 MiB
dependabot/github_actions/actions-2c2a3ba6e2
Commit Graph

10686 Commits

Author SHA1 Message Date
zhongwencool
186e1591df chore: document api-key path api only support bearerAuth 2024-01-25 16:01:43 +08:00
firest
b44420c14f fix(opentsdb): Enhanced the type support for template data 2024-01-25 16:01:43 +08:00
firest
83a8822798 chore(opents): bump version && update changes 2024-01-25 16:01:43 +08:00
firest
dad8a32e0b feat(opents): improve the OpentsDB bridge to v2 style 2024-01-25 16:01:43 +08:00
Thales Macedo Garitezi
878c9ee8b1 fix(ds): do not count persistent session-only routed messages as dropped 
Fixes https://emqx.atlassian.net/browse/EMQX-11539
 2024-01-25 16:01:43 +08:00
Thales Macedo Garitezi
d323fc7c27 feat(ps): add message gc 2024-01-25 16:01:43 +08:00
Thales Macedo Garitezi
7c0d37fdb9 feat(lts): inherit previous generation's lts when possible 2024-01-25 16:01:43 +08:00
Thales Macedo Garitezi
4a0fd756ae feat(ds): add list_generations and drop_generation APIs 2024-01-25 16:01:43 +08:00
Thales Macedo Garitezi
fb39e1eacc feat(ds): allow customizing the data directory 
The storage expectations for the RocksDB DB may be different from our usual data
directory.  Also, it may consume a lot more storage than other data.

This allows customizing the data directory for the builtin DS storage backend.

Note: if the cluster was already initialized using a directory path, changing that config
will have no effect.  This path is currently persisted in mnesia and used when reopening
the DB.
 2024-01-25 16:01:42 +08:00
JianBo He
51d32bd620 chore: improve http connector logs format 2024-01-25 16:01:42 +08:00
Ilya Averyanov
adf22f1f10 fix(mqtt_bridge): render valid messages from incomplete rule data 2024-01-25 16:01:42 +08:00
Serge Tupchii
a8c6280a5e test(emqx_cm_SUITE): use one helper function: emqx_pool:flush_async_tasks/1 2024-01-25 16:01:42 +08:00
Serge Tupchii
f52cc93d9d perf(emqx_cm): use a dedicated pool for channel cleanup 
This is to isolate channels cleanup from other async tasks (like routes cleanup),
as channels cleanup can be quite slow under high network latency conditions.

Fixes: EMQX-11743
 2024-01-25 16:01:42 +08:00
JianBo He
52a7b45d97 fix: upgrade ekka to 0.18.3 to ensure the leader correct 2024-01-25 14:47:59 +08:00
zhongwencool
3bc6e546e0 fix: reboot emqx_dashboard after emqx_licencse 2024-01-25 12:29:04 +08:00
Xinyu Liu
4eb0260eaf
Merge pull request #12381 from emqx/port-sql-funcs-from-emqx4 
feat: port emqx/emqx-enterprise#1892, add some SQL functions
 2024-01-25 11:12:58 +08:00
JianBo He
ff0fd65f9d
Merge pull request #12373 from JimMoen/fix-prom-data-aggre 
Follow up #12299
 2024-01-25 10:37:47 +08:00
JimMoen
a752119d05
fix(prom_di): use bridge_v2 metrics api 2024-01-25 09:22:22 +08:00
JimMoen
61dd362db0
fix(prom_di): api crash in connecting 
- https://emqx.atlassian.net/browse/EMQX-11801
 2024-01-25 09:22:21 +08:00
Thales Macedo Garitezi
ae387d1812 ci: start/flush cover when using peer 
`cover` is not automatically started by `peer`.  Without starting/flushing it, we don't
get coverage data from peer nodes.
 2024-01-24 18:02:47 -03:00
William Yang
9fb6688801 fix(quic): Per listener conn count 2024-01-24 21:36:25 +01:00
Thales Macedo Garitezi
a19cf253ae
Merge pull request #12359 from thalesmg/fix-connector-app-deps-r55-20240119 
fix(machine_boot): inject connector/bridge apps as dependencies to `emqx_connector` app
 2024-01-24 15:40:24 -03:00
ieQu1
7b5f2948fe test(ds): Fix flaky testcase 2024-01-24 19:33:30 +01:00
ieQu1
305a54f646 chore(ds): Update BPAPI version 2024-01-24 19:33:30 +01:00
ieQu1
eee221f1d0 feat(ds): Make egress batching configurable 2024-01-24 19:33:30 +01:00
ieQu1
137535a821 feat(ds): Introduce egress process for the builtin backend 2024-01-24 19:33:30 +01:00
ieQu1
ec93d8cf18
Merge pull request #12385 from ieQu1/ds-meta-ram-cache 
fix(ds): Cache database metadata in RAM
 2024-01-24 19:32:38 +01:00
ieQu1
9b7df302e8 fix(ds): Cache database metadata in RAM 2024-01-24 18:43:48 +01:00
Kjell Winblad
fa842736d2 feat: refactor kinesis bridge to connector and action 
Fixes:
https://emqx.atlassian.net/browse/EMQX-11461
 2024-01-24 18:31:03 +01:00
Thales Macedo Garitezi
5547a40ceb fix(ds): don't use env var for data dir default value 
Fixes https://github.com/emqx/emqx/pull/12380
 2024-01-24 11:39:14 -03:00
JimMoen
ace1303de2
fix(prom_auth): authz metric name: allow and deny 
- https://emqx.atlassian.net/browse/EMQX-11799
 2024-01-24 22:38:49 +08:00
JimMoen
5e02709de0
fix(prom_auth): authz_enable key from enable status 
- https://emqx.atlassian.net/browse/EMQX-11800
 2024-01-24 22:38:48 +08:00
Shawn
4afba8eb94 feat: port emqx/emqx-enterprise#1892, add some SQL functions 2024-01-24 18:50:57 +08:00
JimMoen
6e3ce4d644
fix(prom_stats): emqx_stats metric type should be gauge 2024-01-24 14:11:17 +08:00
JimMoen
4a1d1b6aeb
fix: topics and retained metrics are cluster consistented 2024-01-24 14:11:16 +08:00
JimMoen
731efd8b49
fix(prom): cluster aggre/unaggre labels 2024-01-24 14:11:15 +08:00
JimMoen
497ec04359
fix(prom): missing callback attribute 2024-01-24 14:11:14 +08:00
JianBo He
947a08d1d2
Merge pull request #12375 from thalesmg/fix-actions-reset-node-metrics-r55-20240123 
fix(actions_api): reset metrics on all nodes
 2024-01-24 09:17:09 +08:00
Thales Macedo Garitezi
77329209a2
Merge pull request #12368 from thalesmg/ds-inherit-wildcards-only-lts-m-20240122 
perf(ds): inherit only LTS paths containing wildcards when adding a new generation
 2024-01-23 17:14:51 -03:00
Thales Macedo Garitezi
67c9e9c8fc fix(actions_api): reset metrics on all nodes 
Fixes https://emqx.atlassian.net/browse/EMQX-11796
 2024-01-23 10:40:02 -03:00
Thales Macedo Garitezi
eecd7e084c test(ds): reduce flakiness 2024-01-23 09:47:03 -03:00
Thales Macedo Garitezi
1be5b6aaf3 fix(mqtt_action): use overridden resource_opts 
Fixes https://emqx.atlassian.net/browse/EMQX-11790
 2024-01-23 09:41:28 -03:00
Thales Macedo Garitezi
1eb47d0c16 perf(ds): inherit only LTS paths containing wildcards when adding a new generation 
Fixes https://github.com/emqx/emqx/pull/12338#discussion_r1462139499
 2024-01-23 09:20:28 -03:00
zhongwencool
a8eefe808f
Merge pull request #12371 from emqx/es-server-schema 
chore: es's base_url to server
 2024-01-23 17:17:19 +08:00
zhongwencool
6a9cbb3d97 test: add es's update test 2024-01-23 15:51:09 +08:00
Xinyu Liu
aafb683ec7
Merge pull request #12330 from emqx/bridge-v2-cassandra 
refactor: split cassandra bridges to actions and connectors
 2024-01-23 14:45:32 +08:00
zhongwencool
94692162b5
Merge pull request #12370 from zhongwencool/api-key-auth 
chore: document api-key path api only support bearerAuth
 2024-01-23 14:22:35 +08:00
Shawn
218af3fef4 chore: update ecql to 0.6.0 2024-01-23 14:14:23 +08:00
lafirest
9d2a207184
Merge pull request #12353 from lafirest/feat/optsdb 
feat(opents): improve the OpentsDB bridge to v2 style
 2024-01-23 13:49:33 +08:00
lafirest
dc458ff0db
Merge pull request #12366 from lafirest/fix/sys 
fix(sysk): fix probe testing bugs for syskeeper
 2024-01-23 13:49:28 +08:00
firest
51e8c955ff fix(connector): make the connector id unique when doing probe testing 2024-01-23 13:03:12 +08:00
zhongwencool
ada2785b5d chore: es's base_url to server 2024-01-23 12:20:34 +08:00
zhongwencool
0dbaaa5d94 chore: document api-key path api only support bearerAuth 2024-01-23 10:31:43 +08:00
firest
28867d07e6 fix(opentsdb): Enhanced the type support for template data 2024-01-23 10:00:56 +08:00
Thales Macedo Garitezi
609ba7e332 fix(ds): do not count persistent session-only routed messages as dropped 
Fixes https://emqx.atlassian.net/browse/EMQX-11539
 2024-01-22 16:58:45 -03:00
Thales Macedo Garitezi
d122340c13
Merge pull request #12338 from thalesmg/ds-message-gc-20240115 
feat(ds): add message GC
 2024-01-22 16:57:26 -03:00
Thales Macedo Garitezi
7035b4c8b3 feat(ps): add message gc 2024-01-22 14:53:17 -03:00
Thales Macedo Garitezi
db710c4be5 feat(lts): inherit previous generation's lts when possible 2024-01-22 14:53:17 -03:00
Thales Macedo Garitezi
75b08b525b feat(ds): add list_generations and drop_generation APIs 2024-01-22 14:53:17 -03:00
Thales Macedo Garitezi
39090d3732
Merge pull request #12340 from thalesmg/ds-db-data-path-m-20240116 
feat(ds): allow customizing the data directory
 2024-01-22 13:30:59 -03:00
Thales Macedo Garitezi
3207f0ea80 fix(machine_boot): inject connector/bridge apps as dependencies to emqx_connector app 
Fixes https://emqx.atlassian.net/browse/EMQX-11771

For the same reasons as we inject `emqx_bridge_*` applications as dependencies to
`emqx_bridge` when starting the node.  Already configured connectors are started when
`emqx_connector` application starts, and may lead to crashes and noise in the logs.  One
example is to configure a mongodb bridge and restart the node.
 2024-01-22 11:13:34 -03:00
firest
3f7b913e88 chore(opents): bump version && update changes 2024-01-22 20:45:18 +08:00
firest
e337e1dc40 feat(opents): improve the OpentsDB bridge to v2 style 2024-01-22 20:45:10 +08:00
firest
cd90b93550 fix(sysk): fix probe testing bugs for syskeeper 2024-01-22 20:27:48 +08:00
JianBo He
2706e005ff
Merge pull request #12354 from SergeTupchiy/EMQX-11751-dashboard-import-timeout-rel55 
Apply brdige post config changes in parallel
 2024-01-22 17:24:55 +08:00
JimMoen
2061d75b50
docs: prometheus api mode field description 2024-01-22 10:39:56 +08:00
JimMoen
2263df0242
fix(prom_push_gw): use format mode node for prometheus push gateway 2024-01-22 10:39:55 +08:00
JimMoen
b424f8ac12
feat(prom_stats): aggregated/unaggregated prometheus data 2024-01-22 10:39:54 +08:00
JimMoen
6b064dd8eb
fix(prom_stats): missing metric key 
- follow https://github.com/emqx/emqx/pull/11497
 2024-01-22 10:39:53 +08:00
JimMoen
c6c1a7fc28
refactor(prom): prom_auth and prom_di as prom_cluster behaviour 2024-01-22 10:39:52 +08:00
JimMoen
b480c5b371
fix(prom): use name mode and macros to put/get format mode 2024-01-22 10:39:51 +08:00
Shawn
0e1043f80c ci: update generated connector name 2024-01-22 10:34:40 +08:00
JianBo He
f7ae9ab489
Merge pull request #12351 from HJianBo/improve-the-http-connector-logs 
chore: improve http connector logs format
 2024-01-22 10:27:35 +08:00
Shawn
b32c0fb0d8 refactor: split cassandra bridges to actions and connectors 2024-01-22 10:16:46 +08:00
Shawn
29d767bd62 ci: add env vars to run cassandra tests locally 2024-01-22 10:16:46 +08:00
JimMoen
8cb12c6a74
refactor: use utils func for prom_auth and prom_di 2024-01-21 00:14:54 +08:00
JimMoen
c3da792323
feat(prom_di): cluster aggregated/unaggregated metrics 2024-01-21 00:14:53 +08:00
JimMoen
9627124d67
fix(prom_di): metric emqx_rule_enable 2024-01-21 00:14:52 +08:00
JimMoen
5534d5e9de
fix(bpapi): make static_check happy 2024-01-21 00:14:51 +08:00
JimMoen
5914eb5ca5
fix(prom_cert): rm cacertfile expiry epoch 2024-01-21 00:14:50 +08:00
JimMoen
4fb1ff2f9d
fix(prom_api): format-mode example value 2024-01-21 00:14:49 +08:00
JimMoen
57f3efde63
feat(prom_auth): cluster metrics with different format-mode 2024-01-21 00:14:48 +08:00
JimMoen
fb330f77e6
feat(prometheus): api format_mode parameter support 
- node(default):
  The only supported format_mode for PushGateway.
  Return the current node's metrics.
  -  Without label `node_name` with content-type: `text/plain`.
  -  Without key `node_name` with content-type: `application/json`

- nodes_aggregated:
  Return all nodes metrics Arithmetic-Sum or Logical-Sum.
  See details in callback modules.
    - Logical-Sum for metrics named with `xxx_enable` or `xxx_status`.
    - Arithmetic-Sum for other metrics.
  `node_name` field:
    -  Without label `node_name` with content-type: `text/plain`.
    -  Without key `node_name` with content-type: `application/json`

- nodes_unaggregated:
  Return all nodes metrics without aggregated.
  `node_name` field:
    -  _With_ label `node_name` with content-type: `text/plain`.
    -  _With_ key `node_name` with content-type: `application/json`
 2024-01-21 00:14:47 +08:00
JimMoen
94032aafb2
fix(prom_data_integration): fix metric type 2024-01-21 00:14:46 +08:00
JimMoen
c3e9533260
fix: prometheus auth metrics fields and type 
- rm rate fields
- fix few fields type to counter
 2024-01-21 00:14:45 +08:00
JimMoen
a18c4d193a
refactor: abstract function call 2024-01-21 00:14:44 +08:00
JimMoen
8f7964f435
feat(prom): data integration metrics in josn format 2024-01-21 00:14:42 +08:00
JimMoen
36f009b0c2
fix(prom): connectors specific data 2024-01-21 00:14:41 +08:00
JimMoen
76d9ace582
fix: connector_count contains bridge_v1 and bridge_v2 2024-01-21 00:14:40 +08:00
JimMoen
f457def201
fix: use id uniformly as the label key for rules and actions 2024-01-21 00:14:39 +08:00
JimMoen
4b23930fce
fix(prometheus): license expiry and schema_registry only for ee 2024-01-21 00:14:38 +08:00
JimMoen
38a90bd273
fix(prom_auth): authn && authz data response by josn 2024-01-21 00:14:37 +08:00
JimMoen
0dca9905dd
test(prometheus): {Registry, Collector} tuple 2024-01-21 00:14:36 +08:00
JimMoen
7832bbc0a4
fix(prom): schema registry not in ce edition 2024-01-21 00:14:35 +08:00
JimMoen
5158395bcf
feat(prometheus): data integration prom data 2024-01-21 00:14:34 +08:00
JimMoen
bf2e4d134a
refactor(prometheus): generic api response funcs 2024-01-21 00:14:33 +08:00
JimMoen
e0feb580b6
feat(prometheus): auth metrics with text/plain 2024-01-21 00:14:32 +08:00
JimMoen
092159b071
feat(prometheus): cert expiry epoch in endpoint /prometheus/stats 2024-01-21 00:14:31 +08:00
JimMoen
558c471392
feat(prometheus): license expiry at epoch as gauge 2024-01-21 00:14:30 +08:00
JimMoen
fae0cea17f
fix(license): make dialyzer happy 2024-01-21 00:14:29 +08:00