Commit Graph

14674 Commits

Author SHA1 Message Date
Zaiming (Stone) Shi d3c1c12916
Merge pull request #10583 from thalesmg/fix-bw-dec-batch-count-r50
fix(buffer_worker): fix inflight count when updating inflight item
2023-05-08 15:06:20 +02:00
Zaiming (Stone) Shi a1467250ca
Merge pull request #10639 from zmstone/0508-ci-fix-git-safe-dir
ci: ensure git safe dir
2023-05-08 14:41:29 +02:00
Zaiming (Stone) Shi cc518c81b2 ci: ensure git safe dir 2023-05-08 14:34:19 +02:00
Thales Macedo Garitezi eba627b365 fix(buffer_worker): fix inflight count when updating inflight item 2023-05-08 09:27:51 -03:00
Zaiming (Stone) Shi 56d8541fae
Merge pull request #10634 from zmstone/0508-prepare-e5.0.3-release
0508 prepare e5.0.3 release
2023-05-08 13:42:01 +02:00
Zaiming (Stone) Shi 8803c9b326 chore: make sure brod_gssapi app is included in relese package 2023-05-08 10:59:38 +02:00
Zaiming (Stone) Shi f2a223c1e9 chore: prepare for e5.0.3 release 2023-05-08 10:59:04 +02:00
Zaiming (Stone) Shi bfd4bb325e
Merge pull request #10624 from zmstone/0506-fix-release-50-ci
ci: port 10619 to release-50
2023-05-06 10:10:20 +02:00
Zaiming (Stone) Shi 1269a25006 ci: port 10619 to release-50 2023-05-06 10:07:21 +02:00
JianBo He 06f4fcaad9
Merge pull request #10614 from zmstone/0505-prepare-to-cut-e5.0.3-rc.1
0505 prepare to cut e5.0.3 rc.1
2023-05-06 14:27:38 +08:00
zhongwencool 0412d1e871
Merge pull request #10611 from Kinplemelon/kinple/for-upgrade-dashboard
chore: upgrade dashboard to e1.0.6 for ee
2023-05-06 14:22:23 +08:00
JianBo He 2fb4b5bcbc chore: fix bad indent 2023-05-06 13:54:34 +08:00
JianBo He e7800f5a71
chore: apply suggestions from code review
Co-authored-by: yanzhiemq <125347458+yanzhiemq@users.noreply.github.com>
2023-05-06 13:49:26 +08:00
Ivan Dyachkov 8ecd6364d1 chore: update e5.0.3.zh.md changelog and minor changes in e5.0.3.en.md 2023-05-05 16:42:44 +02:00
Ivan Dyachkov 644a39520a chore: update e5.0.3.en.md changelog 2023-05-05 16:10:10 +02:00
Ivan Dyachkov cd5a375aad chore: e5.0.3 changelog 2023-05-05 16:05:00 +02:00
Zaiming (Stone) Shi 8ce2122516 chore: prepare to cut e5.0.3-rc.1 2023-05-05 12:56:34 +02:00
Kinplemelon 7a55f2ae31 chore: upgrade dashboard to e1.0.6 for ee 2023-05-05 16:21:48 +08:00
Ivan Dyachkov 6e64d0bde5
Merge pull request #10599 from id/ci-enterprise-packages-in-scheduled-builds
ci: build both ce and ee packages in scheduled builds
2023-05-04 14:42:48 +02:00
Ivan Dyachkov 12a227f27d ci(packages): use unique job name 2023-05-04 13:13:38 +02:00
Ivan Dyachkov cd6e285674 ci(packages): remove unnecessary processing of git safe dir and pwd 2023-05-04 13:09:26 +02:00
Ivan Dyachkov f657d908ae ci: build both ce and ee packages in scheduled builds 2023-05-04 12:58:42 +02:00
zhongwencool 9cb8d1b0b0
Merge pull request #10596 from zhongwencool/add-validate-for-ee-conf
feat: add validations for emqx_ee_conf_schema
2023-05-04 18:13:11 +08:00
Zhongwen Deng a4bb865e6a feat: add validations for emqx_ee_conf_schema 2023-05-04 16:53:03 +08:00
lafirest e82623d0fb
Merge pull request #10595 from lafirest/fix/password_redact
fix: add new sensitive keywords to redact checklist
2023-05-04 16:46:57 +08:00
firest 277deee616 fix: add new sensitive keywords to redact checklist 2023-05-04 16:32:32 +08:00
Thales Macedo Garitezi a21dee441b
Merge pull request #10573 from thalesmg/fix-buffer-worker-ets-info2-r50
perf(buffer_worker): avoid calling `ets:info/2`
2023-05-03 08:59:39 -03:00
Thales Macedo Garitezi 8aa7c014e7 perf(buffer_worker): avoid calling `ets:info/2`
(Almost?) fixes https://emqx.atlassian.net/browse/EMQX-9637

During the course of performance tests comparing the performance of
e5.0.3 and e4.4.16 regarding the webhook bridge in sync mode, we
observed that the throughput in e5.0.3 (sync) was much lower than in
e4.4.16: ~ 9 k msgs / s vs. ~ 50 k msgs / s, respectively.

Analyzing `observer_cli` output, we noticed that a lot of the time
both buffer workers and ehttpc processes was spent in `ets:info/2`.
That function was called to check the size of the inflight table when
updating metrics and checking if the inflight table was full.  Other
uses of `ets:info/2` were contained inside the arguments to some
`?tp/2` macro usages (https://github.com/kafka4beam/snabbkaffe/pull/60).

By using a specific record to track the size of the table, we managed
to improve the bridge performance to ~ 45 k msgs / s in sync mode.
2023-05-02 17:05:32 -03:00
Thales Macedo Garitezi f6da18dc1b fix(webhook): consider `{shutdown, closed}` return as recoverable 2023-05-02 13:12:03 -03:00
Thales Macedo Garitezi 654d274039
Merge pull request #10562 from thalesmg/fix-webhook-async-shutdown-normal-reply-r50
fix(webhook): treat `{shutdown, normal}` and `{closed, _}` async replies as retriable
2023-05-02 10:08:18 -03:00
Zaiming (Stone) Shi 0fd5fee4ca
Merge pull request #10547 from zmstone/0427-default-listeners-in-schema
0427 default configs in schema
2023-05-02 15:03:49 +02:00
Zaiming (Stone) Shi 2dd9191718 refactor: use different terms for config tombstone
there are 3 different kind of Erlang terms for tombstone related configs
1. the schema type (must be an atom)
2. the config value (must be a binary)
3. the config change comamnd (request) which is only used
   in the code, but never persisted
2023-05-02 13:24:59 +02:00
Zaiming (Stone) Shi b1dfbf7984 refactor: move shared macros to header file 2023-05-02 13:24:59 +02:00
Zaiming (Stone) Shi 674f837f36 refactor(emqx_listeners): better variable names 2023-05-02 13:24:59 +02:00
Zaiming (Stone) Shi 29c9edeb4c test(emqx_delayed_SUITE): fix flaky test 2023-05-02 13:24:59 +02:00
Zaiming (Stone) Shi 37bf12c29e test(emqx_telemetry_SUITE): fix flakyness 2023-05-02 13:24:59 +02:00
Zaiming (Stone) Shi c825102bed fix(authz): ensure acl.conf path template rendered 2023-05-02 09:10:04 +02:00
Zaiming (Stone) Shi a3b1664c06 test: allow inter-test case config dependency for emqx_exhook_SUITE 2023-05-01 20:15:47 +02:00
Zaiming (Stone) Shi b65a71b498 test: allow emqx_ws_connection_SUITE to run without erasing configs 2023-05-01 19:37:12 +02:00
Zaiming (Stone) Shi 95cb262067 test: fix authn test cases 2023-05-01 18:42:45 +02:00
Zaiming (Stone) Shi a03f2dd64b test: allow pre-load configs before emqx_conf app 2023-05-01 15:35:33 +02:00
Zaiming (Stone) Shi 43c80ba635 chore: always init_load config wiht defaults populated
this effectively eliminates the need for raw_with_default
because it's now always set to true everywhere.
will remove it in a followup.
2023-04-30 21:24:46 +02:00
Zaiming (Stone) Shi 475dee32ee test(emqx_dashboard): refine spec error 2023-04-30 17:28:41 +02:00
Zaiming (Stone) Shi 57cc854a4a test(bridge): fix bridge map type filed converters
now the converters on map type fields only work at the wrapping map
level but not the values
2023-04-30 10:45:11 +02:00
Zaiming (Stone) Shi 03ae61569f test(authn): fix test case after authentication default value added 2023-04-30 10:18:18 +02:00
Zaiming (Stone) Shi 2e9dca280c refactor(listener-schema): use a tombstone for deleted listeners 2023-04-29 22:10:19 +02:00
Zaiming (Stone) Shi c13a972bf0 test(emqx_management): add test group for listener API 2023-04-29 22:10:19 +02:00
Zaiming (Stone) Shi b3c0abf494 test(emqx_management): fix listeners api test cases 2023-04-29 22:10:19 +02:00
Zaiming (Stone) Shi dbf9bae7dc test(statsd): fix raw config default value 2023-04-29 22:10:19 +02:00
Zaiming (Stone) Shi 4d705817d8 refactor(log): move default values to schema 2023-04-29 22:10:19 +02:00