Commit Graph

15772 Commits

Author SHA1 Message Date
William Yang e4f501417b
Merge pull request #10525 from qzhuyan/perf/william/avoid-new-map-when-get-mqtt-caps
perf(config): avoid build new map in emqx_mgmt_caps:get_caps
2023-05-05 10:22:08 +02:00
Kinplemelon 7a55f2ae31 chore: upgrade dashboard to e1.0.6 for ee 2023-05-05 16:21:48 +08:00
firest 1b066fc0b6 chore: update changes 2023-05-05 16:21:21 +08:00
firest 4f47e65b7b perf(limiter): simplify the memory represent of limiter configuration 2023-05-05 16:21:21 +08:00
Ivan Dyachkov afb613ffd1
Merge pull request #10608 from id/0505-ci-fix-artifact-name
ci: fix artifact name in scheduled packages workflow
2023-05-05 08:38:32 +02:00
Ivan Dyachkov b94b33f722 ci(perf test): update tf variable name and set job timeout 2023-05-05 08:04:20 +02:00
firest 518b6e1211 fix(tdengine): redact the password for the TDEngine example API 2023-05-05 13:51:38 +08:00
Ivan Dyachkov 2406c4a896 ci: fix artifact name in scheduled packages workflow 2023-05-05 07:50:45 +02:00
Ivan Dyachkov a8f2ef30e6
Merge pull request #10604 from id/ci-fix-build_packages_cron
fix: build_packages_cron.yaml workflow
2023-05-04 22:46:04 +02:00
Ivan Dyachkov 3cb69463b4 fix: build_packages_cron.yaml workflow 2023-05-04 22:37:55 +02:00
Ivan Dyachkov ee8aa4feae
Merge pull request #10603 from id/ci-enable-scheduled-builds-on-release-50
ci: move scheduled builds to a separate workflow
2023-05-04 22:24:41 +02:00
Ivan Dyachkov 69d1a34461 ci: move scheduled builds to a separate workflow
so that we trigger the scheduled builds on both master and release-50
2023-05-04 19:15:27 +02:00
Zaiming (Stone) Shi 14e055f18b
Merge pull request #10578 from zmstone/0502-refactor-delete-stale-config-check-opt
0502 refactor delete stale config check opt
2023-05-04 16:32:49 +02:00
Zaiming (Stone) Shi 4283fb6620
Merge pull request #10592 from zmstone/0504-add-dev-ctl-command
feat(./dev): use command style and added 'ctl' command
2023-05-04 16:27:42 +02:00
Zaiming (Stone) Shi ed0d0b9787 build: check mnesia compatibility when generating mria config 2023-05-04 15:22:49 +02:00
Ivan Dyachkov 6e64d0bde5
Merge pull request #10599 from id/ci-enterprise-packages-in-scheduled-builds
ci: build both ce and ee packages in scheduled builds
2023-05-04 14:42:48 +02:00
Ivan Dyachkov 12a227f27d ci(packages): use unique job name 2023-05-04 13:13:38 +02:00
Ivan Dyachkov cd6e285674 ci(packages): remove unnecessary processing of git safe dir and pwd 2023-05-04 13:09:26 +02:00
Ivan Dyachkov f657d908ae ci: build both ce and ee packages in scheduled builds 2023-05-04 12:58:42 +02:00
Andrew Mayorov 4100c31d4a
Merge pull request #10296 from ft/EMQX-9416/fs-iterators
feat(ft-api): add paging support through cursors
2023-05-04 13:20:39 +03:00
zhongwencool 9cb8d1b0b0
Merge pull request #10596 from zhongwencool/add-validate-for-ee-conf
feat: add validations for emqx_ee_conf_schema
2023-05-04 18:13:11 +08:00
Zhongwen Deng a4bb865e6a feat: add validations for emqx_ee_conf_schema 2023-05-04 16:53:03 +08:00
Zaiming (Stone) Shi 232c5926f2 docs: fix a typo in api doc description 2023-05-04 10:50:14 +02:00
lafirest e82623d0fb
Merge pull request #10595 from lafirest/fix/password_redact
fix: add new sensitive keywords to redact checklist
2023-05-04 16:46:57 +08:00
firest 277deee616 fix: add new sensitive keywords to redact checklist 2023-05-04 16:32:32 +08:00
Zaiming (Stone) Shi c4da84f0be feat(./dev): use command style and added 'ctl' command 2023-05-04 10:24:17 +02:00
JianBo He 85fda1490c chore: update ehttpc to 0.4.8
for https://github.com/emqx/ehttpc/pull/45
2023-05-04 16:09:46 +08:00
zhongwencool 2bc1ddbd19
Merge pull request #10588 from zhongwencool/fix-array-default
chore: make sure topic_metrics/rewrite's default is []
2023-05-04 16:03:21 +08:00
zhongwencool 5bd4c56183
Merge pull request #10589 from zhongwencool/trace-timestrap-microsecond
Change trace timestrap to microsecond
2023-05-04 15:55:51 +08:00
Zaiming (Stone) Shi 06e25f5c72 test: fix delayed-pubish test case flakyness 2023-05-04 09:48:28 +02:00
Zaiming (Stone) Shi 856129984b refactor: remove raw_with_default config load option
This option was previously only in tests to avoid
emqx_conf app overwriting previously set configs with default values.

After a03f2dd64b, the issue for
test cases had been resolved.
This commit is to get rid of the option all together
2023-05-04 09:48:28 +02:00
Zhongwen Deng e42e73e104 chore: add changelog for trace timestrap 2023-05-04 14:44:56 +08:00
Zhongwen Deng 06960853e0 feat: increase the time precision of trace logs to microseconds 2023-05-04 14:41:02 +08:00
Zhongwen Deng b09ee540d0 chore: make sure topic_metrics/rewrite's default is [] 2023-05-04 14:29:54 +08:00
Paulo Zulato f965fa7b9a feat: add shutdown count
Fixes https://emqx.atlassian.net/browse/EMQX-9008
Fixes https://emqx.atlassian.net/browse/EMQX-9219
2023-05-03 20:00:38 -03:00
Kjell Winblad b7c7d400e2 docs: better max_overflow field label and description for MongoDB bridge
The new label and description for the max_overflow field clarifies the
purpose of the field, which is to manage the maximum number of
additional workers created when all workers in the pool are busy,
allowing more concurrent connections to the MongoDB server during
workload spikes.

Fixes part of:
https://emqx.atlassian.net/browse/EMQX-9714
2023-05-03 17:49:08 +02:00
William Yang c38cec77a7
Merge pull request #10417 from qzhuyan/perf/william/no-make-ref-in-get-config
perf(config): eliminate make_ref() calls in config get calls
2023-05-03 16:56:44 +02:00
Thales Macedo Garitezi a21dee441b
Merge pull request #10573 from thalesmg/fix-buffer-worker-ets-info2-r50
perf(buffer_worker): avoid calling `ets:info/2`
2023-05-03 08:59:39 -03:00
William Yang 421efd561a
docs: Update changes/ce/perf-10417.en.md
Co-authored-by: Zaiming (Stone) Shi <zmstone@gmail.com>
2023-05-03 13:50:48 +02:00
William Yang 2ded8e3836
Merge pull request #10577 from qzhuyan/dev/william/importance-mark-quic-listener
chore(schema): mark deprecated quic listener fields ?IMPORTANCE_HIDDEN
2023-05-03 13:23:32 +02:00
Andrew Mayorov ac1cf30a94
Merge pull request #10574 from ci/separate-job-static-checks
ci: run static checks in separate jobs
2023-05-03 11:43:36 +03:00
Andrew Mayorov 754045173e
chore: bump `snabbkaffe` to 1.0.8 2023-05-03 11:16:51 +03:00
Andrew Mayorov 827cd79eca
ci: run static checks in separate jobs
So that prepare jobs would finish earlier and CI would give
faster feedback. Also point cache action at the correct location
of the PLT file.
2023-05-03 11:16:14 +03:00
William Yang 0428766a6e docs: changelog for forcing atom conf path 2023-05-03 09:59:18 +02:00
Zaiming (Stone) Shi 66112fceed
Merge pull request #10572 from zmstone/0502-merge-release-50-back-to-master
0502 merge release 50 back to master
2023-05-03 09:01:35 +02:00
Ilya Averyanov 0272cf4473
Merge pull request #10571 from savonarola/0502-do-not-pullute-logs-on-metrics-stop
Do not complain on nonexisting ets while `emqx_topic_metrics` stops
2023-05-03 09:44:25 +03:00
William Yang b418cc766d test: update emqx_gateway_conf_SUITE
for error return messages
2023-05-02 22:59:24 +02:00
William Yang a4a5599636 chore(schema): mark deprecated quic listener fields ?IMPORTANCE_HIDDEN 2023-05-02 22:20:39 +02:00
Thales Macedo Garitezi 8aa7c014e7 perf(buffer_worker): avoid calling `ets:info/2`
(Almost?) fixes https://emqx.atlassian.net/browse/EMQX-9637

During the course of performance tests comparing the performance of
e5.0.3 and e4.4.16 regarding the webhook bridge in sync mode, we
observed that the throughput in e5.0.3 (sync) was much lower than in
e4.4.16: ~ 9 k msgs / s vs. ~ 50 k msgs / s, respectively.

Analyzing `observer_cli` output, we noticed that a lot of the time
both buffer workers and ehttpc processes was spent in `ets:info/2`.
That function was called to check the size of the inflight table when
updating metrics and checking if the inflight table was full.  Other
uses of `ets:info/2` were contained inside the arguments to some
`?tp/2` macro usages (https://github.com/kafka4beam/snabbkaffe/pull/60).

By using a specific record to track the size of the table, we managed
to improve the bridge performance to ~ 45 k msgs / s in sync mode.
2023-05-02 17:05:32 -03:00
William Yang c7af43bd72 chore: bump app vsn emqx 5.0.25 2023-05-02 21:51:43 +02:00