59ed65787f
fix: get_config return target node's node conf
2023-07-19 11:05:14 +08:00
27630ca215
Merge pull request #11261 from paulozulato/feat-bridge-kinesis
...
Implement Amazon Kinesis Producer bridge
2023-07-18 16:48:34 -03:00
3a5112829c
fix(mgmt_cli): Don't print cluster status on the replicant
2023-07-18 21:45:00 +02:00
ce76d4ab04
chore(ekka): Bump version to 0.15.7 (mria 0.5.9)
2023-07-18 21:45:00 +02:00
103b89f60c
fix(mgmt_cli): Don't crash when mria is not running
2023-07-18 21:45:00 +02:00
293700773f
refactor(mgmt_cli): Call mria directly
2023-07-18 21:45:00 +02:00
2954ff7300
feat: add `topic_metrics` and `slow_subs` configuration to data import/export
...
Fixes: EMQX-10590
2023-07-18 20:53:10 +03:00
c9985758d9
fix(emqx_rule_engine): fix typo in `behaviour` module attribute
...
The type resulted in missing `rule_engine` config after importing data from a backup file.
Fixes: EMQX-10590
2023-07-18 20:35:21 +03:00
de4cc492d4
chore: e5.1.1-alpha.2
2023-07-18 18:55:24 +02:00
4ec4041f99
Merge pull request #11281 from thalesmg/restore-queue-shared-sub-r51-20230717
...
fix(shared_sub): restore support for `$queue/` shared subscription
2023-07-18 13:52:44 -03:00
ca51732d8e
Merge pull request #11292 from emqx/update-rocksdb
2023-07-18 16:14:50 +02:00
cb1e0cdc89
test(http): attempt to stabilize flaky tests
2023-07-18 10:51:04 -03:00
3ba6d34511
chore(eviction): phase out session persistence concerns
2023-07-18 15:47:12 +02:00
0a00c39282
chore(ps): phase out existing session persistence mechanism
...
* It's not really working currently in a cluster setup.
* It's not really working well.
* It would be much easier to integrate `emqx_durable_storage` w/o
the need to support existing solution.
2023-07-18 15:46:04 +02:00
91cd88c136
fix(api_mgmt): use `emqx_topic:join` for correct construction of topics
2023-07-18 10:19:55 -03:00
4a889c0994
chore: bump ekka -> 0.15.6
...
https://github.com/emqx/erlang-rocksdb/releases/tag/1.8.0-emqx-1
2023-07-18 09:00:29 -03:00
4f4a813f04
fix(tdengine): update the default template and the changelog
2023-07-18 10:31:18 +00:00
1fdcfba629
fix(shared_sub): restore support for `$queue/` shared subscription
...
Partially addresses: https://emqx.atlassian.net/browse/EMQX-4589
There's still a problem with the handling of shared groups that is
_not particular to the `$queue/` syntax_ and preexistent that the same
client cannot subscribe to _different groups_ that have the same
_topic filter_.
2023-07-17 16:41:24 -03:00
484519dcf9
feat(kinesis): implement Amazon Kinesis Producer bridge
...
Fixes https://emqx.atlassian.net/browse/EMQX-10474
Fixes https://emqx.atlassian.net/browse/EMQX-10475
2023-07-17 11:51:42 -03:00
05c3e023a9
chore(gcp_pubsub_consumer): unhide GCP PubSub Consumer bridge for e5.2.0
...
Fixes https://emqx.atlassian.net/browse/EMQX-10506
2023-07-17 11:24:21 -03:00
ab5fd1e5c3
Merge pull request #11260 from thalesmg/fix-rule-maps-nested-put-r51
...
fix(rule_maps): avoid losing data when using `emqx_rule_maps:nested_put`
2023-07-14 15:02:24 -03:00
0a35b7875f
Merge pull request #11269 from zhongwencool/fix-process-limit-hidden
...
fix: hide node.process_limit completely
2023-07-14 22:32:41 +08:00
f6834b33a0
Merge pull request #11266 from lafirest/fix/influxdb-ph
...
fix(tdengine): fix SQL template errors
2023-07-14 22:29:16 +08:00
f853f3d3bd
Merge pull request #11271 from zhongwencool/fix-precent-check
...
fix: keep percentage type's range is 0%~100%
2023-07-14 22:07:41 +08:00
f9452241bd
test(rules): add a few more tests to assert our rule evaluation behavior
2023-07-14 10:23:20 -03:00
950d5edc41
fix: avoid logging unnecessary errors in async cleanup functions
...
Cleanup functions that access ETS tables may fail with `badarg` error during EMQX shutdown.
They are called asynchronously by `emqx_pool` workers and accessed ETS tables
may be already destroyed as their owners are shut down.
This fix catches ETS `badarg` errors before they can be caught and logged by `emqx_pool`.
Fixes: EMQX-9992
2023-07-14 14:22:43 +03:00
fea73cf17d
fix(log): fix the `pubrel` typo in the log
2023-07-14 17:19:50 +08:00
11ee6abf02
fix: keep precent range is 0%~100%
2023-07-14 16:48:50 +08:00
131511b10e
fix: hide process_limit completely
2023-07-14 11:04:20 +08:00
01b143c5ad
fix(resource): don't destruct error tuple
...
Otherwise, `emqx_resource:query` won't correctly deem the resource to
be unhealthy when there's an extra message.
2023-07-13 16:12:33 -03:00
0dff428efb
Merge pull request #11262 from thalesmg/fix-gcp-consumer-hc-20230712-master
...
fix(gcp_pubsub_consumer): fail health check when there are no workers
2023-07-13 15:09:02 -03:00
4034bcbb26
fix(rule_runtime): avoid rewriting select clause sources (by @keynslug)
...
Thanks to @keynslug for the insight and the patch.
With this, we avoid rewriting the parsed select clause sources, and
attempt to reuse the result context when reading values during
evaluation.
2023-07-13 14:46:08 -03:00
924ed06760
Merge pull request #11256 from thalesmg/bridge-api-ecpool-400-errors-20230712-r51
...
fix(bridge_api): return 400 for all ecpool start errors
2023-07-13 10:05:07 -03:00
749b8cd2ed
test(tdengine): cover multi-table insert && subtable name generation
2023-07-13 07:39:01 +00:00
fef5087c41
fix(tdengine): fix SQL template errors
...
1. supports multi-table insert
2. supports constructing subtable names by mixed prefixes and placeholders
2023-07-13 04:44:48 +00:00
c23c3a1f78
fix: hstreamdb connector use unified schema
2023-07-13 10:47:45 +08:00
06010f7ca9
Merge remote-tracking branch 'origin/release-51' into sync-r51-20230712
2023-07-12 16:47:45 -03:00
be7918aa41
fix(gcp_pubsub_consumer): fail health check when there are no workers
...
`ecpool` already returns an error even if the worker process is dead,
but we add the empty worker list clause here just for completeness.
2023-07-12 16:31:21 -03:00
bbff1d6ae9
fix(bridge_api): return 400 for all ecpool start errors
...
Fixes https://emqx.atlassian.net/browse/EMQX-10460
(https://emqx.atlassian.net/browse/EMQX-10460?focusedCommentId=30126 )
2023-07-12 15:32:34 -03:00
bffef386c1
fix(rule_maps): avoid losing data when using `emqx_rule_maps:nested_put`
...
Fixes https://emqx.atlassian.net/browse/EMQX-10541
2023-07-12 14:28:18 -03:00
8ebe099653
Merge pull request #11253 from id/kjell/refactor/http_bridge/EMQX-9568
...
refactor: HTTP bridge into the emqx_bridge_http application
2023-07-12 15:58:02 +02:00
6180e775f4
test: fix mocking and application start
2023-07-12 14:47:52 +02:00
8815e58149
chore: remove docker-ct from emqx_bridge_http since toxiproxy is not used in CT
2023-07-12 14:47:46 +02:00
45f94df7b1
fix: add ehttpc as emqx_bridge_http dependency
2023-07-12 14:47:39 +02:00
c94dc2e63f
fix: add emqx_dashboard as a dependency of emqx_machine
...
```
===> Compiling emqx_machine
===> Compiling src/user_default.erl failed
src/user_default.erl:{24,14}: can't find include lib "emqx_dashboard/include/emqx_dashboard.hrl"; Make sure emqx_dashboard is in your app file's 'applications' list
==> emqx_mix
** (Mix) Could not compile dependency :emqx_machine, "/github/home/.mix/elixir/1-14/rebar3 bare compile --paths /__w/emqx/emqx/_build/emqx/lib/*/ebin" command failed. Errors may have been logged above. You can recompile this dependency with "mix deps.compile emqx_machine", update it with "mix deps.update emqx_machine" or clean it with "mix deps.clean emqx_machine"
make: *** [Makefile:276: emqx-elixir] Error 1
```
2023-07-12 14:47:28 +02:00
6ce47614d2
refactor: HTTP bridge into the emqx_bridge_http app
...
Fixes:
https://emqx.atlassian.net/browse/EMQX-9568
2023-07-12 14:47:02 +02:00
f28510b3ad
refactor: HTTP connector into emqx_bridge_http app
2023-07-12 14:46:43 +02:00
541d03a0ba
refactor(schema_registry): refactor schema registry app and modules
...
Fixes https://emqx.atlassian.net/browse/EMQX-10361
- Moves `lib-ee/emqx_ee_schema_registry` to `apps/emqx_schema_registry`.
- Removes the `_ee_` segment from module names.
- Exceptions are the table names which are kept to avoid backwards incompatibilities.
2023-07-12 09:24:15 -03:00
cacfb51280
fix(emqx_machine): add emqx_ee_schema_registry to the reboot apps list
...
As emqx_ee_schema_registry uses Mria tables (schema_registry_shard),
a node joining a cluster needs to restart this application in order to
restart relevant Mria shard processes.
2023-07-12 09:23:28 -03:00
5b0695ca19
Merge pull request #11249 from zhongwencool/license-setting-api
...
feat: add license setting get/put api
2023-07-12 18:34:23 +08:00
f40d8318b7
fix: license validations is not working
2023-07-12 14:40:38 +08:00
fce3060634
Merge pull request #11251 from SergeTupchiy/EMQX-10392-cluster-topology-api
...
Add cluster topology HTTP API endpoint
2023-07-11 17:45:00 +03:00
19de10be7c
feat(emqx_management): add /cluster/topology HTTP API endpoint
...
The endpoint shows Mria RLOG cluster topology info:
connections between core and replicant nodes.
Closes: EMQX-10392
2023-07-11 16:25:36 +03:00
903d81b532
Merge pull request #11250 from lafirest/fix/ws_order
...
fix(ws): fix MQTT packets may be reversed in the WS
2023-07-11 20:09:55 +08:00
211486a946
fix(ws): fix MQTT packets may be reversed in the WS
...
Fix when a WS packet contains many MQTT packets, the order of MQTT packets will be reversed
2023-07-11 18:40:06 +08:00
e51a4ae81e
chore: avoid dialyzer warnings
2023-07-11 10:41:10 +08:00
15c91373fe
perf(http): improve the speed of clients querying in default parameters
...
In https://github.com//emqx/emqx/pull/9749 we fixed the problem of
incorrect total calculation. In this PR we added an option to improve
the query speed when the query condition is empty
2023-07-11 10:41:10 +08:00
21fbf79c29
Merge pull request #11191 from keynslug/ft/EMQX-9591/msg-persistence-minimal
...
feat(ds): hardwire emqx_durable_storage message persistence
2023-07-10 21:05:04 +02:00
beb5be4de2
Merge pull request #11244 from thalesmg/ci-sorted-reboot-apps-check-master
...
ci(machine_boot): add ci check for missing reboot apps
2023-07-10 15:56:10 -03:00
a53768c1d4
fix(machine_boot): add `emqx_durable_storage` to reboot apps list
2023-07-10 14:39:44 -03:00
721dbad300
Merge pull request #11242 from SergeTupchiy/add-schema_registry-app-to-reboot-list
...
fix(emqx_machine): add emqx_ee_schema_registry to the reboot apps list
2023-07-10 20:17:59 +03:00
d91ab7dec9
test(ds): make `emqx_persistent_messages_SUITE` setup cleaner
...
Co-authored-by: Thales Macedo Garitezi <thalesmg@gmail.com>
2023-07-10 18:12:16 +02:00
fb96c1e20d
chore: bump to e5.1.1-alpha.1
2023-07-10 17:25:07 +02:00
7f04fff2a8
fix(emqx_machine): add emqx_ee_schema_registry to the reboot apps list
...
As emqx_ee_schema_registry uses Mria tables (schema_registry_shard),
a node joining a cluster needs to restart this application in order to
restart relevant Mria shard processes.
2023-07-10 18:04:22 +03:00
ae59a26659
Merge pull request #11223 from JimMoen/fix-influxdb-float-value-trans
...
fix: influxdb float serialization error
2023-07-10 23:04:01 +08:00
93a9772743
Merge pull request #11211 from sstrigler/EMQX-9963-refactor-all-http-ap-is-to-respond-404-on-the-deletion-of-the-resource-is-non-exist
...
consistently return 404 if resource not found
2023-07-10 16:25:31 +02:00
58a83739b8
Merge pull request #10986 from savonarola/ft/EMQX-9523/config-api
...
feat(ft-api): provide configuration API
2023-07-10 15:32:30 +03:00
12e237c36d
Merge pull request #11132 from savonarola/0531-authz-qos-retain
...
feat(authz): use extensible map format for actions in authz rules
2023-07-10 15:32:02 +03:00
e30bc6afa8
test(influxdb): write raw as float for all number value
2023-07-10 20:00:09 +08:00
f9e54ed8b1
Merge pull request #11237 from zhongwencool/prometheus-api-schema
...
fix: bad prometheus schema for headers
2023-07-10 18:13:42 +08:00
576eab9717
Merge pull request #11193 from keynslug/fix/emqx-ft-test-flaps
...
fix(ft-test): use new cth tooling in emqx_ft_storage_fs_SUITE
2023-07-10 11:55:16 +02:00
f144bb0571
Merge pull request #11226 from zhongwencool/listener-conf-enabled-to-enable
...
fix: alias listeners.Type.Name.enabled as listeners.Type.Name.enable
2023-07-10 17:15:24 +08:00
1b5d55cdbb
fix: delete bad link in emqx_prometheus
2023-07-10 16:48:13 +08:00
0632d629cb
fix: bad prometheus schema for headers
2023-07-10 16:48:13 +08:00
e9f1d7f2bf
fix: influxdb float serialization error
2023-07-10 13:53:11 +08:00
802a50601a
chore: add comment for init_loader_done
2023-07-10 12:03:36 +08:00
c4ba558ee3
fix: unset config_loader in emqx's env when stop emqx app
2023-07-10 11:06:08 +08:00
d661b10355
fix: emqx CI failed
2023-07-10 10:34:36 +08:00
86d3984025
fix: mgmt api SUITE failed
2023-07-10 10:34:36 +08:00
c0ee47dc08
chore: add changelog for 11226 pr
2023-07-10 10:34:36 +08:00
d781346efc
fix: alias listeners.Type.Name.enabled as listeners.Type.Name.enable
2023-07-10 10:34:36 +08:00
1110b5d8f5
fix(emqx_retainer): return 404 in delete if topic not found
2023-07-08 14:43:43 +02:00
80e4ffff75
fix(emqx_management): return 404 if plugin does not exist
2023-07-08 14:43:43 +02:00
3fd28f9e18
fix(emqx_management): return 404 for unknown listener id
2023-07-08 14:43:43 +02:00
d65d690c17
fix(emqx_gateway): return 404 for unknown client id
2023-07-08 14:43:43 +02:00
3bc419ee64
fix(emqx_gateway): return 404 for unknown listener id
2023-07-08 14:10:23 +02:00
8c883feb54
chore: bump `emqx_durable_storage` to 0.1.1
2023-07-07 21:56:21 +02:00
030beb3e6a
fix(ds): drop debug printouts in test suite
2023-07-07 21:56:20 +02:00
daf4e86da1
feat(ds): add `ensure_shard/2` shortcut
...
And use it in `emqx_persistent_session_ds:init()` backend initialization
function.
2023-07-07 21:56:20 +02:00
ac56de9fc5
feat(ds): allow to redefine directory for shard's rocksdb
2023-07-07 21:56:20 +02:00
19f9fc5089
feat(authz): bump app versions
2023-07-07 19:41:34 +03:00
77895f2555
feat(authz): fix typos and style for Retain & QoS authz feature
...
Co-authored-by: Thales Macedo Garitezi <thalesmg@gmail.com>
2023-07-07 19:40:34 +03:00
6db02d6b49
feat(authz): enable feature for both CE and EE
2023-07-07 19:40:34 +03:00
1ce6a225ae
feat(authz): add tests for authz extended actions
2023-07-07 19:40:34 +03:00
7de26a1776
feat(authz): use extensible map format for actions in authz rules
...
* support authorization on retain, qos fields
* refactored authz tests heavily
2023-07-07 19:40:34 +03:00
b568bda098
feat(ft-api): simplify config import test
2023-07-07 19:39:05 +03:00
6337f52cf9
fix(plugins): start/stop plugins when loading config from CLI
...
Fixes https://emqx.atlassian.net/browse/EMQX-10288
2023-07-07 13:37:51 -03:00
56c81c2c25
feat(ft-api): bump app versions
2023-07-07 19:17:22 +03:00
e0353ab750
fix(ft-api): update FT API tests to use emqx_cth_suite
2023-07-07 19:15:42 +03:00
fde506838a
fix(ft-api): implement import config behaviour
2023-07-07 19:15:42 +03:00
fe691e8330
fix(ft-api): fix swagger schema dump for ft schema
2023-07-07 19:15:42 +03:00
a2eb658cd9
feat(ft-api): do cleanup certs explicitly
2023-07-07 19:15:42 +03:00
a2b03716be
feat(ft-api): provide configuration API
...
To configure `emqx_ft` during the runtime.
2023-07-07 19:15:42 +03:00
34793c5ed0
feat(ft-conf): preprocess TLS configuration on updates
...
Specifically, reify keys and certificates into files in the file system
and update the configuration to point to those files.
2023-07-07 19:15:42 +03:00
27ab9c62d8
fix(ft): unload conf hooks in `prep_stop`
...
In order to avoid situations when the root supervisor is stopped
already.
2023-07-07 19:15:42 +03:00
aba52c6a25
chore(rebalance test): fix API tests
2023-07-07 18:04:32 +03:00
9bb159cf1e
fix(rebalance): fix changelog and version
2023-07-07 18:04:11 +03:00
5b1c265485
Merge pull request #11224 from zhongwencool/fix-psk-conf-load
...
fix: psk_authentication is updated failed
2023-07-07 21:27:49 +08:00
a6019a2846
Merge pull request #11198 from savonarola/0705-fix-rebalance-swagger
...
fix(rebalance): fix rebalance swagger examples
2023-07-07 15:55:16 +03:00
70bd7a59e4
Merge pull request #11225 from lafirest/fix/pgsql_function_clause
...
fix(bridge): ensure the username of pgsql must exists
2023-07-07 20:39:07 +08:00
8b80a2f754
Merge pull request #11192 from zhongwencool/bump-hocon-to-0.39.13
...
chore: update hocon to 0.39.13
2023-07-07 20:02:46 +08:00
0ef00d5919
fix: psk_authentication is updated failed
2023-07-07 20:02:06 +08:00
97b6c43062
fix(ft-test): use new cth tooling in `emqx_ft_storage_fs_SUITE`
...
In attempt to battle test flakiness.
2023-07-07 14:00:33 +02:00
7e76914599
feat(ds): hardwire emqx_durable_storage message persistence
...
Only message persistence is currently implemented, irrespectively of
whether there are persistent sessions around or not.
2023-07-07 13:46:12 +02:00
d01eee7fe4
chore: update changes && app version
2023-07-07 18:22:54 +08:00
8cee75139d
fix(bridge): ensure the username of pgsql must exists
2023-07-07 18:06:28 +08:00
055a1e8d75
Merge pull request #11210 from sstrigler/EMQX-9569-provide-the-ce-ee-version-info-and-the-current-version-number-in-the-info-field
...
feat(emqx_dashboard): include edition and version in swagger.json info
2023-07-07 11:55:44 +02:00
b5cc8fb3c3
fix: start_after_created's default value
2023-07-07 16:39:26 +08:00
352d818e3b
chore: update hocon to 0.39.13
2023-07-07 16:39:26 +08:00
88fd8d0582
Merge pull request #11219 from JimMoen/fix-hstreamdb-deps-app
...
chore: hstreamdb_erl as deps for hstreamdb bridge
2023-07-07 16:39:12 +08:00
2f33fd9bac
Merge pull request #11208 from HJianBo/update-lwm2m-stats
...
fix(lwm2m): update the stats correctly and timely
2023-07-07 15:32:50 +08:00
daa6cf14fe
Merge pull request #11206 from HJianBo/coap-bugs
...
Fix(coap): Make the username and password params to optional
2023-07-07 15:32:00 +08:00
ab07fd0547
Merge pull request #11214 from zhongwencool/fix-cluster-rpc-call-tnx-id
...
fix: bad tnx-id when rejoin cluster
2023-07-07 15:08:06 +08:00
63c6427037
chore: hstreamdb_erl as deps for hstreamdb bridge
2023-07-07 14:50:44 +08:00
30c931ae62
fix: pulsar flaky cluster tests
2023-07-07 12:25:37 +08:00
4ee44972b2
feat: refactor hstreamdb connector to to avoid resources leaking
2023-07-07 12:25:37 +08:00
b089fba100
refactor: rm ee_bridge and ee_connector application
2023-07-07 12:25:37 +08:00
583ccfaafd
test(hstreamdb): create stream and wirte data
2023-07-07 12:25:36 +08:00
1587f038a5
feat: hstreamdb bridge with batch query
2023-07-07 12:25:36 +08:00
b9bfdfd583
chore: compatibility with hstreamdb v0.15.0
2023-07-07 12:25:36 +08:00
d31a305bcb
refactor(hstreamdb): HStreamDB bridge to its own application
2023-07-07 12:25:36 +08:00
f7513b900a
fix: set load config done after update tnx_id
2023-07-07 12:25:34 +08:00
9f57ba510e
chore: add 11214 changelog
2023-07-07 12:25:34 +08:00
221f6eba06
fix: bad tnx-id when rejoin cluster
2023-07-07 12:25:34 +08:00
d3d2c8a532
chore(lwm2m): bump version
2023-07-07 12:24:31 +08:00
31a240ba63
fix(lwm2m): update the stats correctly and timely
2023-07-07 12:24:31 +08:00
791b8ef671
chore: bump versions
2023-07-07 12:23:57 +08:00
6d2222318d
chore(coap): update the subscriptions_cnt stats in time
2023-07-07 12:23:57 +08:00
800b154582
test(coap): cover the params optional logic to create connection
2023-07-07 12:23:57 +08:00
5c901a52bd
fix(coap): make username/password optinal in connection
2023-07-07 12:23:57 +08:00
ab809c8b85
Merge pull request #11207 from lafirest/feat/keep_obfuscated
...
feat: ensure data backends don't leak sensitive data
2023-07-07 12:22:11 +08:00
b11fa5f3bf
Merge pull request #11195 from HJianBo/stomp-topic-id-unique
...
Fix(stomp): avoid to create duplicated subscription by HTTP or Client
2023-07-07 11:18:30 +08:00
a1d2b2ca51
chore: bump app versions
2023-07-07 11:17:54 +08:00
18dec53d8b
feat: ensure data backends don't leak sensitive data
2023-07-07 11:04:13 +08:00
05048dbf93
Merge pull request #11204 from HJianBo/avoid-case-clause
...
Allow the `*/*` or multiple `Accept` values in header for the `/configs` API
2023-07-07 09:46:28 +08:00
8faaa86c07
chore: bump vsn for emqx and emqx_bridge
2023-07-06 14:26:11 +02:00
22b25fbbb3
feat(emqx_dashboard): include edition and version in swagger.json info
2023-07-06 14:14:21 +02:00
353cc065db
Merge pull request #11175 from thalesmg/fix-mysql-start-error
...
fix(mysql_bridge): make nxdomain a 400 API error
2023-07-06 08:26:12 -03:00
9bcabe0a9e
Merge pull request #11184 from sstrigler/EMQX-10270-e-5-1-0-missing-value-range-validation-for-the-max-packet-size-of-mqtt-settings
...
fix: limit mqtt max_packet_size to 256MB
2023-07-06 10:20:24 +02:00
71d1f80530
test(api): cover the accept logic for `/configs` API
2023-07-06 11:30:38 +08:00
zhongwencool