yuanbiao/emqx
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
16,253 Commits 393 Branches 684 Tags 74 MiB
41004e86da
Commit Graph

913 Commits

Author SHA1 Message Date
某文
77cf19c96c chore: update 10340's changelog 2023-05-16 22:59:08 +08:00
Thales Macedo Garitezi
657df05ad9 fix(buffer_worker): avoid setting flush timer when inflight is full 
Fixes https://emqx.atlassian.net/browse/EMQX-9902

When the buffer worker inflight window is full, we don’t need to set a
timer to flush the messages again because there’s no more room, and
one of the inflight windows will flush the buffer worker by calling
`flush_worker`.

Currently, we do set the timer on such situation, and this fact
combined with the default batch time of 0 yields a busy loop situation
where the CPU spins a lot while inflight messages do not return.
 2023-05-16 11:28:58 -03:00
某文
17ab30d8bb chore: update 10607's log config changelog 2023-05-16 22:04:14 +08:00
Ilya Averyanov
c113a8ac6a
Merge pull request #10677 from savonarola/0511-fix-rule-api 
fix(api): respond 404 on the deletion of nonexistent rule
 2023-05-16 16:50:30 +03:00
某文
a2aa6b4666 chore: make ci happy again 2023-05-16 21:29:52 +08:00
Kjell Winblad
b1a4f6ea05 docs: add changelog entry 2023-05-15 16:37:54 +02:00
Ivan Dyachkov
bde086f549
Merge pull request #10701 from id/0510-bump-builder-version 
ci: emqx-builder 5.0-35
 2023-05-15 14:48:56 +02:00
firest
34b09e071f fix(limiter): fix a format error in the changelog 2023-05-15 18:08:33 +08:00
Ivan Dyachkov
8d8cf23fad chore: add changelog 2023-05-15 08:17:30 +02:00
lafirest
67ada52808
Merge pull request #10682 from lafirest/fix/will_msg_timestamp 
fix: update the will message timestamp when it is ready to publish
 2023-05-12 22:25:32 +08:00
zhongwencool
a953b951fe
Merge branch 'master' into sync-release-50-to-master 2023-05-12 18:01:58 +08:00
Zhongwen Deng
1141499b1b chore: add changelog for 10659 2023-05-12 14:42:33 +08:00
firest
2404d167c8 chore: update changes 2023-05-12 14:39:18 +08:00
lafirest
33d1872e8f
Merge pull request #10679 from lafirest/refactor/influxdb_dir 
refactor(influxdb): move influxdb bridge into its own app
 2023-05-12 14:31:29 +08:00
firest
7d46fe8390 chore: bump influxdb version && update changes 2023-05-12 11:48:56 +08:00
Zhongwen Deng
44212f6e06 chore: add listener default changelog 2023-05-12 11:18:15 +08:00
Thales Macedo Garitezi
64dc9ed46a perf(metrics): avoid increasing counters by 0 
Some performance tests indicate that calling `telemetry` is costly in
hot paths.  Since increasing a counter by 0 is a no-op, we should
avoid calling `telemetry` if the amount to increase is 0.
 2023-05-11 15:13:37 -03:00
Ilya Averyanov
49e9ace1c1 fix(api): respond 404 on the deletion of nonexistent rule 2023-05-11 23:12:59 +05:00
Ilya Averyanov
5b5d7ceac5 Merge branch 'release-50' into file-transfer 
* release-50:
  fix(limiter): fix an error when setting `max_conn_rate` in a listener
  chore: bump erlcloud dependencies vsns
  chore: rename dynamo template files
  refactor(dynamo): move dynamo bridge into its own app
  chore: update changes && bump app versions
  fix: issues with the RabbitMQ config
  refactor(pgsql): move pgsql && matrix && timescale bridges into their own app
  fix: the iotdb password field so it has the password format
  chore: update changes
  refactor(tdengine): move tdengine bridge into its own app
  feat: deprecate listeners's authn http api
 2023-05-11 16:15:38 +05:00
SergeTupchiy
0617a9b11c
Merge pull request #10653 from SergeTupchiy/convert-gateway-authn-certs 
fix(emqx_gateway): convert and clear authentication certificates
 2023-05-11 11:35:55 +03:00
Zaiming (Stone) Shi
b3e35dac1c
Merge pull request #10584 from paulozulato/debug-ssl-handshake 
feat: add log level configuration to ssl communication
 2023-05-11 08:59:13 +02:00
firest
f6a2f752ff chore: update changes && bump app versions 2023-05-10 17:23:26 +08:00
lafirest
594ceaf9e6
Merge pull request #10650 from lafirest/refactor/tdengine_dir 
refactor(tdengine): move tdengine bridge into its own app
 2023-05-10 16:42:35 +08:00
Andrew Mayorov
04a5ab4498
chore: add changelog entry 2023-05-10 11:40:05 +03:00
Zhongwen Deng
898826f15f chore: add changelog for 10659 2023-05-10 14:56:56 +08:00
firest
cabbf0f768 chore: update changes 2023-05-10 14:14:15 +08:00
Zaiming (Stone) Shi
48b53b9ca4 docs: delete zh changelog 2023-05-09 20:51:24 +05:00
Ilya Averyanov
609f7bd8fd feat(rebalance): port apps from 4.x 2023-05-09 20:51:22 +05:00
Serge Tupchii
b98a7168c4 fix(emqx_gateway): convert and clear authentication certificates 2023-05-09 17:32:44 +03:00
William Yang
328add3a02
Merge pull request #10563 from qzhuyan/fix/william/no_local_filter_all 
fix(mqtt): drop all local messages in session deliver
 2023-05-09 15:29:12 +02:00
Kjell Winblad
70cf1533db feat: add RabbitMQ bridge 2023-05-09 14:32:26 +02:00
firest
12491e08db chore: bump version && update changes 2023-05-09 15:58:02 +08:00
lafirest
b94290db58
Merge pull request #10625 from lafirest/refactor/limiter_cfg 
refactor(limiter): simplify limiter configuration
 2023-05-09 11:40:05 +08:00
Stefan Strigler
1ade7ce9a3
Merge pull request #10560 from sstrigler/EMQX-8390-5-0-x-io-tdb-bridge-port-conf-and-api-to-5-0 
IoTDB Bridge
 2023-05-08 20:27:01 +02:00
Paulo Zulato
77176787ca feat: add log level configuration to ssl communication 
Fixes https://emqx.atlassian.net/browse/EMQX-9781
 2023-05-08 15:11:49 -03:00
Paulo Zulato
83c4b2f2d4
Merge pull request #10568 from paulozulato/feat-shutdown-count 
feat: add shutdown count
 2023-05-08 15:07:51 -03:00
zhongwencool
f6c5644448
Merge pull request #10623 from zhongwencool/rename-max-message-queue-len 
feat: rename max_message_queue_len to max_mailbox_size
 2023-05-08 23:08:06 +08:00
Stefan Strigler
d231e708cb feat: add IotDB bridge 2023-05-08 16:19:01 +02:00
zhongwencool
74d0436fbf
Merge pull request #10636 from kjellwinblad/kjell/fix/mongo/max_overflow/EMQX-9714 
fix: non_neg_integer() translated to minimum = 1 in bridge-api-en.json
 2023-05-08 20:45:57 +08:00
William Yang
fc46b81fb1 docs: change log for #10563 2023-05-08 14:40:40 +02:00
Zhongwen Deng
eaa129d0d7 feat: rename max_message_queue_len to max_mailbox_size 2023-05-08 20:27:52 +08:00
Zaiming (Stone) Shi
83257617cd
Merge pull request #10630 from zhongwencool/sync-release-50-to-master 
Sync release 50 to master
 2023-05-08 14:02:27 +02:00
Kjell Winblad
62570d076b docs: add change log entry 2023-05-08 12:50:31 +02:00
Stefan Strigler
b639353cf4 fix(emqx_connector_http): wrap and unwrap auth headers 
This so we don't have sensitive information in a process' state
 2023-05-08 09:56:43 +02:00
William Yang
b6c7e55348
Merge pull request #10528 from qzhuyan/perf/william/force-config-atom-path 
perf(config): ensure root keys of 'conf' config is atom
 2023-05-08 09:37:18 +02:00
Zhongwen Deng
4f396a36a9 Merge remote-tracking branch 'upstream/master' into release-50 2023-05-08 14:58:03 +08:00
firest
197ebccf95 chore: update changes 2023-05-08 11:45:55 +08:00
JianBo He
2fb4b5bcbc chore: fix bad indent 2023-05-06 13:54:34 +08:00
JianBo He
e7800f5a71
chore: apply suggestions from code review 
Co-authored-by: yanzhiemq <125347458+yanzhiemq@users.noreply.github.com>
 2023-05-06 13:49:26 +08:00
Ivan Dyachkov
8ecd6364d1 chore: update e5.0.3.zh.md changelog and minor changes in e5.0.3.en.md 2023-05-05 16:42:44 +02:00
Ivan Dyachkov
644a39520a chore: update e5.0.3.en.md changelog 2023-05-05 16:10:10 +02:00
Ivan Dyachkov
cd5a375aad chore: e5.0.3 changelog 2023-05-05 16:05:00 +02:00
lafirest
335d948bce
Merge pull request #10591 from lafirest/fix/simplify_limiter_client_cfg 
perf(limiter): simplify the memory represent of limiter configuration
 2023-05-05 16:59:04 +08:00
firest
7a96a9772d fix(limiter): update change && fix deprecated version 2023-05-05 16:26:06 +08:00
William Yang
e4f501417b
Merge pull request #10525 from qzhuyan/perf/william/avoid-new-map-when-get-mqtt-caps 
perf(config): avoid build new map in emqx_mgmt_caps:get_caps
 2023-05-05 10:22:08 +02:00
firest
1b066fc0b6 chore: update changes 2023-05-05 16:21:21 +08:00
Zhongwen Deng
e42e73e104 chore: add changelog for trace timestrap 2023-05-04 14:44:56 +08:00
Paulo Zulato
f965fa7b9a feat: add shutdown count 
Fixes https://emqx.atlassian.net/browse/EMQX-9008
Fixes https://emqx.atlassian.net/browse/EMQX-9219
 2023-05-03 20:00:38 -03:00
William Yang
c38cec77a7
Merge pull request #10417 from qzhuyan/perf/william/no-make-ref-in-get-config 
perf(config): eliminate make_ref() calls in config get calls
 2023-05-03 16:56:44 +02:00
William Yang
421efd561a
docs: Update changes/ce/perf-10417.en.md 
Co-authored-by: Zaiming (Stone) Shi <zmstone@gmail.com>
 2023-05-03 13:50:48 +02:00
William Yang
0428766a6e docs: changelog for forcing atom conf path 2023-05-03 09:59:18 +02:00
Zaiming (Stone) Shi
66112fceed
Merge pull request #10572 from zmstone/0502-merge-release-50-back-to-master 
0502 merge release 50 back to master
 2023-05-03 09:01:35 +02:00
Thales Macedo Garitezi
8aa7c014e7 perf(buffer_worker): avoid calling ets:info/2 
(Almost?) fixes https://emqx.atlassian.net/browse/EMQX-9637

During the course of performance tests comparing the performance of
e5.0.3 and e4.4.16 regarding the webhook bridge in sync mode, we
observed that the throughput in e5.0.3 (sync) was much lower than in
e4.4.16: ~ 9 k msgs / s vs. ~ 50 k msgs / s, respectively.

Analyzing `observer_cli` output, we noticed that a lot of the time
both buffer workers and ehttpc processes was spent in `ets:info/2`.
That function was called to check the size of the inflight table when
updating metrics and checking if the inflight table was full.  Other
uses of `ets:info/2` were contained inside the arguments to some
`?tp/2` macro usages (https://github.com/kafka4beam/snabbkaffe/pull/60).

By using a specific record to track the size of the table, we managed
to improve the bridge performance to ~ 45 k msgs / s in sync mode.
 2023-05-02 17:05:32 -03:00
William Yang
3d7201502b perf(config): avoid build new map in emqx_mqtt_caps:get_caps 2023-05-02 21:50:36 +02:00
Zaiming (Stone) Shi
d5f5f35787 Merge remote-tracking branch 'origin/release-50' into 0502-merge-release-50-back-to-master 2023-05-02 18:08:04 +02:00
Ilya Averyanov
791010a65c chore(topic_metrics): do not complain on nonexisting ets while topic metrics stop 2023-05-02 15:59:50 +03:00
Thales Macedo Garitezi
77f5e461a3 chore: bump ehttpc -> 0.4.8 
Fixes https://emqx.atlassian.net/browse/EMQX-9656

See also https://github.com/emqx/ehttpc/pull/45

This fixes a race condition where the remote server would close the
connection before or during requests, and, depending on timing, an
`{error, normal}` response would be returned.  In those cases, we
should just retry the request without using up "retry credits".
 2023-04-27 14:10:37 -03:00
Paulo Zulato
dd90b2f498 feat(oracle): Oracle Database integration 2023-04-27 13:07:20 -03:00
Thales Macedo Garitezi
c53741a08c fix(buffer_worker): avoid sending late reply messages to callers 
Fixes https://emqx.atlassian.net/browse/EMQX-9635

During a sync call from process `A` to a buffer worker `B`, its call
to the underlying resource `C` can be very slow.  In those cases, `A`
will receive a timeout response and expect no more messages from `B`
nor `C`.  However, prior to this fix, if `B` is stuck in a long sync
call to `C` and then gets its response after `A` timed out, `B` would
still send the late response to `A`, polluting its mailbox.
 2023-04-26 13:18:28 -03:00
Ivan Dyachkov
50504a4cbf docs: Generate changelog for v5.0.24 2023-04-26 18:03:00 +02:00
William Yang
5ed3c3a92c perf(config): eliminate make_ref() calls in config get calls 2023-04-26 10:58:08 +02:00
SergeTupchiy
d398276852
Merge pull request #10518 from SergeTupchiy/upgrade-ekka-to-0.15.1-mria-0.5.2 
chore: bump ekka to 0.15.1
 2023-04-26 11:03:23 +03:00
zhongwencool
341024f0bc
Merge pull request #10497 from HJianBo/improve-chages-sentence 
chore: improve changes
 2023-04-26 14:56:29 +08:00
zhongwencool
713e050a79
Merge pull request #10512 from zhongwencool/hocon-0.39.3 
feat: improved the storage format of Unicode characters in data files
 2023-04-26 13:59:51 +08:00
Thales Macedo Garitezi
79cf5cad19
Merge pull request #10378 from thalesmg/pulsar-producer-e50 
feat: implement Pulsar Producer bridge (e5.0)
 2023-04-25 18:01:43 -03:00
Serge Tupchii
19b5ebff81 chore: bump ekka to 0.15.1 
ekka 0.15.1 uses mria 0.5.2, which includes the following changes:
  - fix(mria_membership): call `mria_rlog:role/1` safely
  - feat: add extra field to ?rlog_sync table (for future use)
 2023-04-25 23:21:07 +03:00
Zhongwen Deng
308056f0fc feat: improved the storage format of Unicode characters in data files 2023-04-25 18:08:34 +08:00
zhongwencool
79a235f8b5
Merge pull request #10491 from zhongwencool/rename-etcd-ssl-to-ssl_options 
feat: rename etcd.ssl to etcd.ssl_options
 2023-04-25 10:49:09 +08:00
JianBo He
09b17000c8
chore: update changes/ce/feat-10457.en.md 
Co-authored-by: Zaiming (Stone) Shi <zmstone@gmail.com>
 2023-04-25 09:56:40 +08:00
lafirest
29d3afd692
Merge pull request #10487 from lafirest/fix/limiter_instance 
fix(limiter): optimize the instance of limiter
 2023-04-25 09:43:04 +08:00
Serge Tupchii
99e892b5c4 chore: bump ekka to 0.15.0 
ekka 0.15.0 uses mria 0.5.0, which adds several fixes, enhancements and features:
  - protect `mria:join/1,2` with a global lock
  - implement new function `mria:sync_transaction/4,3,2`, which waits for
    a transaction replication to be ready on the local node
    (if the local node is a replicant)
  - optimize `mria:running_nodes/0`
  - optimize `mria:ro_transaction/2` when called on a replicant node.

Fixes: EMQX-9588 (#10380), EMQX-9102, EMQX-9152, EMQX-9213
 2023-04-24 20:52:20 +03:00
lafirest
2845469c48
Merge pull request #10490 from lafirest/fix/rmv_def_conn_limit 
fix(limiter): remove the default limit of connect rate
 2023-04-24 22:04:29 +08:00
JianBo He
4aad5c7454 chore: improve changes 2023-04-24 21:44:21 +08:00
Thales Macedo Garitezi
ad4be08bb2 feat: implement Pulsar Producer bridge (e5.0) 
Fixes https://emqx.atlassian.net/browse/EMQX-8398
 2023-04-24 10:28:26 -03:00
firest
6110aad23f chore: bump version && update changes 2023-04-24 18:17:23 +08:00
zhongwencool
22d6a2eaee
Merge pull request #10484 from zhongwencool/fix-copy-conf 
fix: copy cluster-override.conf from old version
 2023-04-24 17:06:07 +08:00
Zaiming (Stone) Shi
366aa53c80
Merge pull request #10462 from zmstone/0430-EMQX-8434-shared-dispatch-ack-deprecated 
chore: Hide config shared_dispatch_ack_enabled
 2023-04-24 09:42:09 +02:00
Zhongwen Deng
dacf92c4ab chore: rename etcd.ssl changelog 2023-04-24 14:46:06 +08:00
firest
24cecae1f8 chore: update changes 2023-04-24 14:15:45 +08:00
firest
2f2f32ac7b chore: update changes 2023-04-24 10:52:30 +08:00
某文
38cebf2fdc chore: add changelog for 10484 2023-04-23 15:53:17 +08:00
firest
6631fb7457 chore: update changes 2023-04-23 11:22:56 +08:00
Zaiming (Stone) Shi
81340edbca docs: add changelog 2023-04-22 09:08:07 +02:00
zhongwencool
f831a0b827 chore: update changes/ce/fix-10449.en.md 
Co-authored-by: JianBo He <heeejianbo@163.com>
 2023-04-21 15:30:27 +08:00
Zhongwen Deng
397e28f5a4 chore: add changlog for authn_http validation 2023-04-21 15:30:05 +08:00
zhongwencool
ad6090a778 chore: update changes/ce/fix-10449.en.md 
Co-authored-by: JianBo He <heeejianbo@163.com>
 2023-04-21 11:54:45 +08:00
Zhongwen Deng
2aef9ca215 chore: add changlog for authn_http validation 2023-04-21 11:54:45 +08:00
SergeTupchiy
0b105dcb8d
Merge pull request #10463 from SergeTupchiy/EMQX-9310-webhook-port-validation 
fix(emqx_bridge): validate Webhook bad URL
 2023-04-20 20:48:12 +03:00
Ilya Averyanov
8c4b32580e
Merge pull request #10420 from savonarola/0417-authn-authz-fix-path-quoting 
Fix path joining and quoting in authn/authz
 2023-04-20 18:03:04 +03:00
SergeTupchiy
b38ae7f78f
Merge pull request #10407 from SergeTupchiy/EMQX-9529-resource-manager-crash-on-alarm-timeout 
fix(emqx_resource): call emqx_alarm safely and don't reactivate alarm on reoccurring errors
 2023-04-20 17:53:56 +03:00
Zaiming (Stone) Shi
82e6ce53be
Merge pull request #10460 from zmstone/0420-sync-release-50-to-masteer 
0420 sync release 50 to masteer
 2023-04-20 16:41:50 +02:00
Serge Tupchii
45254d7d85 fix(emqx_bridge): validate Webhook bad URL and return 'BAD_REQUEST' if it's invalid 
Fixes: EMQX-9310
 2023-04-20 17:21:43 +03:00
Serge Tupchii
423a30fbb3 fix(emqx_alarm): add safe call API to activate/deactivate alarms and use it in resource_manager 
Don't let 'emqx_resource_manager' crash because of emqx_alarm timeouts.

Fixes: EMQX-9529/#10357
 2023-04-20 17:15:13 +03:00
Thales Macedo Garitezi
3f18c5e2e3
Merge pull request #10455 from thalesmg/fix-late-gen-server-replies-buf-worker-v50 
fix(buffer_worker): avoid sending late reply messages to callers
 2023-04-20 10:19:06 -03:00
Zhongwen Deng
bcc8f4313b chore: make plugins config to low level 2023-04-20 18:00:19 +08:00
zhongwencool
72685beb72
Merge pull request #10457 from HJianBo/hide-statsd 
chore: deprecate statsd
 2023-04-20 17:19:33 +08:00
Zaiming (Stone) Shi
415830a0a2 Merge remote-tracking branch 'origin/release-50' into 0420-sync-release-50-to-masteer 2023-04-20 11:03:39 +02:00
Zaiming (Stone) Shi
c2385f85d6
Merge pull request #10444 from zmstone/0418-cherry-pick-fixes-for-e503 
0418 cherry pick fixes for e503
 2023-04-20 10:58:57 +02:00
Kjell Winblad
7d3367467a
Merge pull request #10408 from kjellwinblad/kjell/rule_engine/add_missing_mongo_date_functions/EMQX-9244 
feat: add mongo_date functions to the rule engine
 2023-04-20 09:46:45 +02:00
JianBo He
794ddd8d73 chore: update changes 2023-04-20 14:23:55 +08:00
Thales Macedo Garitezi
cb995e2033 fix(buffer_worker): avoid sending late reply messages to callers 
Fixes https://emqx.atlassian.net/browse/EMQX-9635

During a sync call from process `A` to a buffer worker `B`, its call
to the underlying resource `C` can be very slow.  In those cases, `A`
will receive a timeout response and expect no more messages from `B`
nor `C`.  However, prior to this fix, if `B` is stuck in a long sync
call to `C` and then gets its response after `A` timed out, `B` would
still send the late response to `A`, polluting its mailbox.
 2023-04-19 18:27:10 -03:00
firest
8219af2fd4 chore: improve changelog 2023-04-19 16:45:53 +08:00
firest
e89f4d4565 fix(dynamo): fix terminology erros 
- Changed `username` to `aws_access_key_id`
- Changed `password` to `aws_secret_access_key`
 2023-04-19 16:26:42 +08:00
firest
b112f544a9 chore: update changes 2023-04-19 15:56:35 +08:00
firest
4f0c891aa6 chore: bump version && update changes 2023-04-19 15:45:31 +08:00
Thales Macedo Garitezi
6a1ef5e68a
Merge pull request #10422 from thalesmg/fix-plugin-sync-single-node-v50 
fix(plugins): attempt to extract plugin from current node on startup
 2023-04-18 14:39:02 -03:00
Zaiming (Stone) Shi
3e72d6c4a3 docs: sync changelogs 2023-04-18 19:17:03 +02:00
Ivan Dyachkov
f8ff2d6bc9 docs: Generate changelog for v5.0.23 2023-04-18 18:09:24 +02:00
Ivan Dyachkov
dc78ecb41c chore: merge upstream/master 2023-04-18 17:33:32 +02:00
Thales Macedo Garitezi
89cd6cfede fix(plugins): attempt to extract plugin from current node on startup 
Fixes https://emqx.atlassian.net/browse/EMQX-9605

Fixes https://github.com/emqx/emqx-elixir-plugin/issues/25

If an user happens to configure a plugin in a lone-node cluster via
environment variables, it would fail to start up as there are no other
nodes to copy the plugin from.  Here, we attempt to check if the
package is present in the current node but not yet extracted.
 2023-04-18 11:10:23 -03:00
某文
fbadfc06e4 feat: change exhook, rule_engine, bridge to low importance level instead of hidden 2023-04-18 20:15:19 +08:00
JianBo He
e3a84e0010 chore: improve the changes for configuration 2023-04-18 20:13:44 +08:00
Zhongwen Deng
22a1d05d7b feat: hide ssl_options.user_lookup_fun 2023-04-18 20:13:44 +08:00
Zhongwen Deng
e3d6fa1f21 chore: update config's changelog and emqx_conf.template 2023-04-18 20:13:44 +08:00
ieQu1
c0d8e9c402
Merge pull request #10369 from ieQu1/fix-stats-api 
fix(emqx_management): Ignore results from the nodes that are down
 2023-04-18 12:36:55 +02:00
Kjell Winblad
8836011310 docs: better changelog entry for mongo_date functions 
Co-authored-by: Thales Macedo Garitezi <thalesmg@gmail.com>
 2023-04-18 10:01:35 +02:00
Kjell Winblad
29584ca721 feat: add mongo_date functions to the rule engine 
This commit adds mong_date built-in functions to the rule engine
SQL-like language. Corresponding functions already existed in EMQX 4.4
and this commit makes sure that EMQX 5.X also has these functions.

Fixes:
https://emqx.atlassian.net/browse/EMQX-9244
 2023-04-18 10:01:35 +02:00
firest
61f3e62ba8 chore: update changes 2023-04-18 15:49:34 +08:00
ieQu1
282bfee8ff feat(emqx): Add an API that returns the list of running nodes 2023-04-18 09:22:58 +02:00
ieQu1
a947df1ea3 fix(emqx_management): Ignore results from the nodes that are down 2023-04-18 09:22:56 +02:00
JianBo He
77d300482c
chore: update changes/ce/feat-10389.en.md 2023-04-18 10:49:51 +08:00
zhongwencool
acb30c7957
chore: update changes/ce/feat-10389.en.md 
Co-authored-by: JianBo He <heeejianbo@163.com>
 2023-04-18 10:47:07 +08:00
zhongwencool
ad3e529994 chore: update changes/ce/feat-10389.en.md 
Co-authored-by: Thales Macedo Garitezi <thalesmg@gmail.com>
 2023-04-18 09:34:01 +08:00
某文
1ef74f1ada chore: upgrade hocon to 0.39.1 2023-04-18 09:28:36 +08:00
Ilya Averyanov
88ca94b417 fix(auth): fix uri path handling 
Fix uri path handling `emqx_connector_http`,
 HTTP authentication and authorization backends.
 2023-04-17 23:57:56 +03:00
Thales Macedo Garitezi
586cd54aa2
Merge pull request #10409 from thalesmg/protobuf-schema-v50 
feat(schema_registry): add support for protobuf schemas
 2023-04-17 14:51:51 -03:00
Kjell Winblad
0c727fc9b2
Merge pull request #10392 from kjellwinblad/kjell/rule_engine/add_missing_datetime_function/EMQX-9245 
freat: add date_to_unix_ts/3 function to the rule engine
 2023-04-17 18:09:44 +02:00
Thales Macedo Garitezi
9d15247dd5 feat(schema_registry): add support for protobuf schemas 
Fixes https://emqx.atlassian.net/browse/EMQX-9470
 2023-04-17 13:04:54 -03:00
JianBo He
3bf642cdff chore: update changes/ce/fix-10410.en.md 
Co-authored-by: Zaiming (Stone) Shi <zmstone@gmail.com>
 2023-04-17 13:57:02 +02:00
JianBo He
069afd042a chore: update changes 2023-04-17 13:56:50 +02:00
Ivan Dyachkov
9712aad7a8
Merge pull request #10413 from id/0416-e5.0.3-code-freeze 
0416 e5.0.3 code freeze
 2023-04-17 13:51:58 +02:00
JianBo He
19eda3bc5f
Merge pull request #10410 from HJianBo/fix-load-gw-from-confs 
fix(gw): load emqx applications before hocon configs checking
 2023-04-17 18:01:31 +08:00
JianBo He
549283ae75
chore: update changes/ce/fix-10410.en.md 
Co-authored-by: Zaiming (Stone) Shi <zmstone@gmail.com>
 2023-04-17 17:35:50 +08:00
firest
2a54d93c7e chore: update changes 2023-04-17 10:06:43 +08:00
zhongwencool
69d1a35c90
Merge pull request #10156 from zhongwencool/conf-refactor 
feat: configuration priority ENV > emqx.conf > API
 2023-04-16 13:45:35 +08:00
Zhongwen Deng
ad65fefac2 fix: rename emqx_misc to emqx_utils 2023-04-16 10:27:23 +08:00
zhongwencool
454d244535
chore: update changes/ce/feat-10156.en.md 
Co-authored-by: JianBo He <heeejianbo@163.com>
 2023-04-16 09:58:22 +08:00
JianBo He
73c15d9668 chore: update changes 2023-04-15 21:47:38 +08:00
zhongwencool
e1faae451a
chore: Update changes/ce/feat-10156.en.md 
Co-authored-by: JianBo He <heeejianbo@163.com>
 2023-04-15 18:17:28 +08:00
zhongwencool
494ffe86ad
Merge branch 'master' into conf-refactor 2023-04-15 06:40:38 +08:00
Zhongwen Deng
8facd130f6 chore: update cluster_hocon_file/0 function 2023-04-14 23:19:38 +08:00
Thales Macedo Garitezi
14ed4a7ada feat(buffer_worker): set default queue mode to memory_only 
Fixes https://emqx.atlassian.net/browse/EMQX-9367

For better user experience and performance for the average bridge, we
should change the default queue mode to `memory_only`, as was the
behavior of most bridges in e4.x.  This leads to better performance
when message rate is high enough and the remote resource is not
keeping up with EMQX.

Also, we set the default segment size to equal max queue bytes.
 2023-04-14 11:37:19 -03:00
JimMoen
790d841697
Merge pull request #10363 from JimMoen/feat-mssqlserver-birdge 
feat: implement Microsoft SQL Server bridge (e5.0)
 2023-04-14 17:55:48 +08:00
Andrew Mayorov
5e92ba6fa9
Merge pull request #10359 from ft/EMQX-9136/no-ask-metrics 
feat(resource): ask for metrics only when needed
 2023-04-14 12:28:52 +03:00
zhongwencool
1e07f37ab0
Merge pull request #10354 from zhongwencool/straightforward-log-info 
feat: more straightforward log for force_shutdown reason
 2023-04-14 10:15:32 +08:00
JimMoen
35ab1c0190
style: make hocon style check and spellcheck happy 
- with more human readable i18n style check format
 2023-04-14 10:02:47 +08:00
JimMoen
5841969877
feat: implement Microsoft SQL Server bridge (e5.0) 2023-04-14 10:02:45 +08:00
zhongwencool
0553facfca
Merge pull request #10391 from zhongwencool/04-13-hide-conf 
feat: hide ex_hook/rewrite/topic_metric/persistent_session_store
 2023-04-14 09:39:29 +08:00
zhongwencool
626e814e9a
Merge pull request #10385 from zhongwencool/hide-conf 
feat: hide data items from configuration files and documentation.
 2023-04-14 09:38:34 +08:00
zhongwencool
835f66a8d2
Merge pull request #10375 from zhongwencool/trace-conf 
feat: deprecated trace config
 2023-04-14 09:22:12 +08:00
Kjell Winblad
601564fa0a
Merge pull request #10324 from kjellwinblad/kjell/fix/EMQX-9374 
fix: check Clickhouse connection after creation
 2023-04-13 16:31:35 +02:00
Kjell Winblad
d3ccd8a65d feat: add date_to_unix_ts/3 function to the rule engine 
Fixes:
https://emqx.atlassian.net/browse/EMQX-9245
 2023-04-13 16:14:03 +02:00
某文
3431a1b123 chore: add changelog 2023-04-13 21:55:01 +08:00
某文
dc71a97d26 chore: add changelog for max_heap_size 2023-04-13 20:35:22 +08:00
某文
cbd2d90bb3 chore: add changelog for hide data items 2023-04-13 19:45:49 +08:00
ieQu1
d1089fa460 docs: Generate changelog for v5.0.22 2023-04-13 13:29:32 +02:00
Kjell Winblad
0cec52d5e4 fix: check Clickhouse connection after creation 
When pressing reconnect on a badly configured Clickhouse bridge in the
dashboard, no error message was shown. This commit fixes this issue by
testing the connection after creation and returning an error tuple if
the connection is not working.

Fixes:
https://emqx.atlassian.net/browse/EMQX-9374
 2023-04-13 10:09:35 +02:00
zhongwencool
cf2f00c937
Merge pull request #10381 from zhongwencool/hiden-auto-subscribe-conf 
feat: hiden auto_subscribe conf
 2023-04-13 14:42:59 +08:00
zhongwencool
17b2a62246
chore: update changes/ce/feat-10381.en.md 
Co-authored-by: JianBo He <heeejianbo@163.com>
 2023-04-13 11:02:10 +08:00
Zhongwen Deng
48600cbc8e chore: add auto_subscribe changelog 2023-04-13 09:50:11 +08:00
Ivan Dyachkov
f01e2f358b
Merge pull request #10367 from id/0411-sync-release-50-back-to-master 
0411 sync release 50 back to master
 2023-04-12 17:23:17 +02:00
Ivan Dyachkov
bdffa925db chore: merge upstream/master release-50 2023-04-12 15:30:20 +02:00
Andrew Mayorov
9c9f39d0f7
feat(resman): also move out metrics collection for debugging 
Now `emqx_resource:list_instances_verbose/0` will populate the metrics
for each instance, for the sake of simplicity.
 2023-04-12 16:14:42 +03:00
JianBo He
d16b5c40d6
Merge pull request #10356 from HJianBo/async-batch-cassa 
feat: support async and batch callback for cassandra connector
 2023-04-12 20:59:36 +08:00
Zhongwen Deng
45254c5936 chore: add changelog for create trace 2023-04-12 17:59:14 +08:00
Stefan Strigler
f668ad7b9e
Merge pull request #10336 from sstrigler/EMQX-8507-rule-engine-need-a-new-api-to-crud-rule-engines-setting-configs 
feat: add `/rule_engine` API endpoint
 2023-04-12 11:44:42 +02:00
Ivan Dyachkov
8bf65c507e chore: update changelog 2023-04-12 07:57:52 +02:00
Thales Macedo Garitezi
914184697e
Merge pull request #10337 from thalesmg/schema-registry-v50 
feat: implement schema registry for 5.0 (avro)
 2023-04-11 16:46:27 -03:00
Andrew Mayorov
d5ae5ebfd8
chore: add changelog entry 
Co-Authored-By: ieQu1 <99872536+ieQu1@users.noreply.github.com>
 2023-04-11 16:26:56 +03:00
Ivan Dyachkov
33811ebf59 docs: Generate changelog for e5.0.2 2023-04-11 13:21:57 +02:00
Ivan Dyachkov
00301935bb chore: update changelog entries 2023-04-11 11:42:07 +02:00
JianBo He
d501c1ee9c chore: update changes 2023-04-11 14:04:41 +08:00
JianBo He
e186477531
Merge pull request #10278 from HJianBo/refactor-gw-dir 
Refactor gateway application dirs
 2023-04-08 09:42:14 +08:00
Thales Macedo Garitezi
33100ecca6 feat: implement schema registry for 5.0 (avro) 
Part of https://emqx.atlassian.net/browse/EMQX-9251

This ports part of the Schema Registry app from 4.x to 5.0.  Here,
only support for Avro is added.  Subsequent PRs will follow to add
support for other formats.
 2023-04-06 16:28:45 -03:00
Kjell Winblad
1938882f16
Merge pull request #10318 from kjellwinblad/kjell/feat/rule_engine_from_clause_support_both_string_types 
feat(rule engine sql): enable both ' and " strings in FROM clause
 2023-04-06 09:19:44 +02:00
JimMoen
ab807fba51
Merge pull request #10329 from kjellwinblad/kjell/EMQX-9138-e-5-0-2-ensure-that-the-error-messages-returned-are-consistent 
fix: create consistent interface 'with_node' for API access
 2023-04-06 14:47:42 +08:00
JianBo He
702ecbcb6e Merge remote-tracking branch 'upstream/master' into refactor-gw-dir 2023-04-06 10:44:59 +08:00
Stefan Strigler
aea870f319 feat: add /rule_engine API endpoint 2023-04-05 15:19:31 +02:00
Stefan Strigler
f3446c48f7
Merge pull request #10315 from sstrigler/EMQX-8945-crash-for-bad-param-value-to-mqtt-delayed-messages-api-call 
EMQX 8945 crash for bad param value to mqtt delayed messages api call
 2023-04-05 13:44:22 +02:00
Zaiming (Stone) Shi
a9bf633e03
Merge pull request #10320 from zmstone/0403-sync-release-50-back-to-master 
0403 sync release 50 back to master
 2023-04-04 23:31:24 +02:00
Thales Macedo Garitezi
5d5b7ea215
Merge pull request #10306 from thalesmg/enable-async-buffer-workers-all-bridges-v50 
feat(bridges): enable async query mode for all bridges with buffer workers
 2023-04-04 17:10:46 -03:00
Ivan Dyachkov
2571da368c chore: add changelog 2023-04-04 19:58:43 +02:00
Stefan Strigler
04626ce9cc fix: create consistent interface 'with_node' for API access 2023-04-04 16:54:14 +02:00
Zaiming (Stone) Shi
68c15ffd48 Merge remote-tracking branch 'origin/release-50' into 0403-sync-release-50-back-to-master 2023-04-04 16:42:58 +02:00
SergeTupchiy
877b828d4a
Merge pull request #10327 from SergeTupchiy/EMQX-8786-fix-unknown-counter-inc-on-unrecoverable-err 
fix(rule_engine): don't increment unknown counter on unrecoverable er…
 2023-04-04 16:51:34 +03:00
Zaiming (Stone) Shi
eeb7b32bc8
Merge pull request #10317 from zmstone/0403-refactor-hide-listener-level-authentication 
0403 refactor hide listener level authentication
 2023-04-04 15:04:35 +02:00
Serge Tupchii
aca65ca2d4 fix(rule_engine): don't increment unknown counter on unrecoverable errors 
Closes: EMQX-8786
 2023-04-04 15:59:53 +03:00
Thales Macedo Garitezi
0b6fd7fe14 fix(buffer_worker): check request timeout and health check interval 
Port of https://github.com/emqx/emqx/pull/10154 for `release-50`

Fixes https://emqx.atlassian.net/browse/EMQX-9099

Originally, the `resume_interval`, which is what defines how often a
buffer worker will attempt to retry its inflight window, was set to
the same as the `health_check_interval`.  This had the problem that,
with default values, `health_check_interval = request_timeout`.  This
meant that, if a buffer worker with those configs were ever blocked,
all requests would have timed out by the time it retried them.

Here we change the default `resume_interval` to a reasonable value
dependent on `health_check_interval` and `request_timeout`, and also
expose that as a hidden parameter for fine tuning if necessary.
 2023-04-04 08:58:36 -03:00
Kjell Winblad
0e66eb5f3f feat(rule engine sql): enable both ' and " strings in FROM clause 
This commit upgrades the rulesql dependency to version 1.5 instead of
1.4. The difference between these two versions is that strings surrounded
by ' and " are supported in FROM clauses in version 1.5, but in version
1.4, only strings surrounded by " are supported.

Fixes:
https://emqx.atlassian.net/browse/EMQX-9243
 2023-04-04 10:36:48 +02:00
firest
a7e5709f86 chore: update changes 2023-04-04 16:31:54 +08:00
Zaiming (Stone) Shi
429b3d9efd Merge remote-tracking branch 'origin/master' into 0403-sync-release-50-back-to-master 2023-04-03 20:32:33 +02:00
Zaiming (Stone) Shi
e1d5894209 docs: delete clickhous bridge doc fix change log 
because the feature is not released yet (new to e5.0.2)
 2023-04-03 20:28:29 +02:00
Thales Macedo Garitezi
f3ffc02bff feat(bridges): enable async query mode for all bridges with buffer workers 
Fixes https://emqx.atlassian.net/browse/EMQX-9130

Since buffer workers always support async calls ("outer calls"), we
should decouple those two call modes (inner and outer), and avoid
exposing the inner call configuration to user to avoid complexity.

For bridges that currently only allow sync query modes, we should
allow them to be configured with async.  That means basically all
bridge types except Kafka Producer.
 2023-04-03 14:49:51 -03:00
Zaiming (Stone) Shi
a4e27e56a8 docs: add change logs 2023-04-03 16:52:49 +02:00
Stefan Strigler
5d722f8d46 style: add changelog 2023-04-03 15:55:25 +02:00
JimMoen
53712e6146
fix: running nodes should not include replica nodes 2023-04-03 20:01:37 +08:00
lafirest
9c7c49e9bf
Merge pull request #10201 from lafirest/fix/tdengine 
fix(tdengine): remove the redundant table name in SQL template
 2023-04-03 18:13:41 +08:00
JianBo He
5138e6371c chore: update changes 2023-04-03 09:47:05 +08:00
Thales Macedo Garitezi
53d760ec69
Merge pull request #10300 from thalesmg/fix-plugin-upload-v50 
fix(plugins): create directory before uploading
 2023-03-31 16:28:18 -03:00
Kjell Winblad
58898ea11d
Merge pull request #10294 from kjellwinblad/kjell/feat/collection_var_syntax_mongodb/EMQX-9246 
feat: (MongoDB bridge) use ${var} syntax in MongoDB collection field
 2023-03-31 17:18:27 +02:00
Paulo Zulato
3765f5f120
Merge pull request #10297 from paulozulato/fix-eval 
fix: keep eval command backward compatible with v4
 2023-03-31 11:29:57 -03:00
Zaiming (Stone) Shi
9bbca07943
Merge pull request #10298 from emqx/release-50 
Merge release-50 back to master
 2023-03-31 15:35:51 +02:00
Kjell Winblad
91df540287 docs: add changelog entry for MongoDB ${var} syntax for collection 2023-03-31 06:36:21 +02:00
firest
fec0e7ab0f chore: update changes 2023-03-31 10:37:30 +08:00
Thales Macedo Garitezi
a2b82dae69 fix(plugins): create directory before uploading 
Fixes https://emqx.atlassian.net/browse/EMQX-9434

Fixes https://github.com/emqx/emqx-elixir-plugin/issues/23
 2023-03-30 17:51:16 -03:00
Paulo Zulato
161435d29d fix: keep eval command backward compatible with v4 
Keeps "eval" command evaluating only Erlang expressions, even on Elixir
node.

Fixes: https://emqx.atlassian.net/browse/EMQX-8947
 2023-03-30 14:20:49 -03:00
Zaiming (Stone) Shi
36043dd651
Merge pull request #10286 from zmstone/0330-exit-with-non-zero-code-if-conf-init-failed 
0330 exit with non zero code if conf init failed
 2023-03-30 17:41:14 +02:00
Zaiming (Stone) Shi
14039e393a
docs: Update changes/ce/fix-10286.en.md 
Co-authored-by: Thales Macedo Garitezi <thalesmg@gmail.com>
 2023-03-30 17:11:10 +02:00
Kjell Winblad
2755829ebf docs: add changelog entry for clickhouse fix 2023-03-30 15:17:16 +02:00
Zaiming (Stone) Shi
da8794ede0 docs: Add change logs 2023-03-30 14:17:29 +02:00
William Yang
65ef9c9086
Merge pull request #10077 from qzhuyan/dev/william/quic-cert-password 
feat(quic): support TLS password protected keyfile
 2023-03-30 12:59:50 +02:00
Kjell Winblad
808bf1d232
Merge pull request #10270 from kjellwinblad/kjell/clickhouse/on_get_status 
fix: on_get_status clickhouse just reporting connecting
 2023-03-30 10:57:48 +02:00
Paulo Zulato
03a70bb527
Merge pull request #10263 from paulozulato/feat-eval-ex 
feat: add new command for Elixir expression evaluation
 2023-03-29 12:04:46 -03:00
Thales Macedo Garitezi
6e596ec322
Merge pull request #10224 from thalesmg/helm-cluster-ip 
feat(helm): add option to customize `clusterIP`
 2023-03-29 09:44:42 -03:00
Kjell Winblad
0a4a976e23 docs: add changelog entry for clickhouse fix 2023-03-29 14:43:13 +02:00
Zaiming (Stone) Shi
80eb9d7542
Merge pull request #10252 from emqx/release-50 
0327 merge release-50 to master
 2023-03-29 12:33:17 +02:00
JianBo He
fee4ff6a07
Merge pull request #10257 from HJianBo/gw-lwm2m-fixes 
Fixed the issue where `auto_observe` was not working in LwM2M Gateway
 2023-03-29 15:20:46 +08:00
Paulo Zulato
d9fc8fbc87 feat: add new command for Elixir expression evaluation 
Currently, Elixir expressions are evaluated on an EMQX node using the
'eval' command, which works for both Erlang and Elixir expressions.
This commit adds the new command 'eval-ex' exclusively for evaluating
Elixir expressions on Elixir nodes, similar to 'eval-erl' for Erlang.
 2023-03-28 18:45:48 -03:00
Thales Macedo Garitezi
1824e7efcc fix(rule_engine): count referenced bridges in from clauses as dependencies (rv5.0) 
Fixes https://emqx.atlassian.net/browse/EMQX-9325

Currently, ingress bridges referenced in the `FROM` clause of rules
are not being accounted as dependencies.

When we try to delete an ingress bridge that's referenced in a rule
like `select * from "$bridges/mqtt:ingress"`, that bridge does not
trigger an UI warning about dependent actions.
 2023-03-28 10:31:10 -03:00
Zaiming (Stone) Shi
d35c5e0516 docs: add changelogs 2023-03-28 14:29:24 +02:00
JianBo He
447f5bf9c5 chore: add changes 2023-03-28 19:05:51 +08:00
Stefan Strigler
193905c7b9
Merge pull request #10237 from sstrigler/EMQX-9138-e-5-0-2-ensure-that-the-error-messages-returned-are-consistent 
fix: create consistent interface 'with_node' for API access
 2023-03-28 10:41:10 +02:00
Zaiming (Stone) Shi
7a6494cda6
Merge pull request #10242 from zmstone/0326-fix-logging-avoid-using-pid-as-log-data-field 
fix: avoid uisng 'pid' as log data field
 2023-03-27 16:13:50 +02:00
Thales Macedo Garitezi
2f344ec9d3
docs: improve formatting 
Co-authored-by: Zaiming (Stone) Shi <zmstone@gmail.com>
 2023-03-27 11:02:59 -03:00
Stefan Strigler
64a1d84a44 fix: create consistent interface 'with_node' for API access 2023-03-27 12:14:48 +02:00
William Yang
70a1c25d0f docs: add changelogs feat-10077 
Co-authored-by: Thales Macedo Garitezi <thalesmg@gmail.com>
 2023-03-27 11:54:03 +02:00
JianBo He
bfa5922209
Merge pull request #10140 from HJianBo/cassa 
feat: support cassandra data bridge
 2023-03-27 10:23:02 +08:00
JianBo He
b77aeb69cb
Merge pull request #10172 from HJianBo/fix-typos-acl-file 
fix(acl): fix wrong default ACL rules
 2023-03-27 09:51:02 +08:00
Zaiming (Stone) Shi
19e136bb66 fix: avoid uisng 'pid' as log data field 
Since it clashes with log metad data field
 2023-03-26 10:33:18 +02:00
Zaiming (Stone) Shi
b37f186142 Merge remote-tracking branch 'origin/master' into 0324-merge-release-50-back-to-master 2023-03-24 21:47:15 +01:00
Zaiming (Stone) Shi
e59362a332 docs: fix both original and merged change logs 2023-03-24 21:39:04 +01:00
Zaiming (Stone) Shi
3490a7dc1d docs: fix a few zh version change log wording 2023-03-24 18:10:31 +01:00
Thales Macedo Garitezi
ff272a2071
Merge pull request #10206 from thalesmg/decouple-buffer-worker-query-call-mode-v50 
feat(buffer_worker): decouple query mode from underlying connector call mode
 2023-03-24 13:49:00 -03:00
Zaiming (Stone) Shi
bdc9ed849a docs: Generate changelog for v5.0.21 2023-03-24 16:46:51 +01:00
SergeTupchiy
f4472f66de
Merge pull request #10225 from SergeTupchiy/EMQX-9290-fix-plugin-name-clash 
fix(emqx_management): resolve plugin name clashes
 2023-03-24 16:17:20 +02:00
Serge Tupchii
b02d0088ea fix(emqx_management): resolve plugin name clashes 
Allow installing a plugin if its name matches the beginning of another (already installed) plugin name.
For example: if plugin "emqx_plugin_template_a" is installed, it must not block installing plugin "emqx_plugin_template".

Closes: #10213, EMQX-9290
 2023-03-24 16:11:31 +02:00
Stefan Strigler
8d084ed13b
Merge pull request #10226 from sstrigler/EMQX-9273-e-5-0-2-creating-a-data-bridge-the-name-verification-returned-an-incorrect-error-code-of-500 
fix(emqx_bridge): don't crash on validation error
 2023-03-24 14:48:03 +01:00
Thales Macedo Garitezi
9031c398fb feat(helm): add option to customize clusterIP 
Fixes https://github.com/emqx/emqx/issues/10223

Adds an option to set `clusterIP` to a fixed IP if the user wants
that.
 2023-03-24 09:50:05 -03:00
Stefan Strigler
fbfdaf44e0 fix(emqx_bridge): don't crash on validation error 2023-03-24 11:46:41 +01:00
JimMoen
1574b54666
chore: refine change for merged PRs 2023-03-24 11:17:34 +08:00