Commit Graph

1131 Commits

Author SHA1 Message Date
Kjell Winblad
87ede1b1f7
Merge pull request #10124 from kjellwinblad/kjell/mongodb/default_heartbeat
fix: increase heartbeat time to avoid extreme MongoDB logging
2023-03-13 18:56:49 +01:00
Stefan Strigler
62aec87c56
Merge pull request #10107 from sstrigler/EMQX-9147-bridges-api-fix-handling-unknown-bridge-id
Bridges API: fix handling unknown bridge-id
2023-03-13 16:40:46 +01:00
Kjell Winblad
1cf01197bb fix: increase heartbeat time to avoid extreme MongoDB logging
Our MongoDB driver creates a new temporary connection, for every active
connection, to just do a single heartbeat test. There is configurable
delay between every heartbeat test. When the user has an EMQX cluster
with a MongoDB bridge (to a MongoDB replica set), there will be a lot of
connections. Furthermore, as MongoDB creates a log entry every time a
new connection is created, the log will be flooded with info about new
connection. One user have reported more than 1MB of log data in a 10
minute period.

This commit tries to fix this by increasing the default delay between
heartbeats. A better fix would be to change the MongoDB driver so that
it does not create a new connection just to do a heartbeat check, but
this is more complicated so we leave this to the future. We might also
swap out the current MongoDB driver to something better.

Fixes:
https://github.com/emqx/emqx/issues/9851
2023-03-13 14:58:53 +01:00
Stefan Strigler
18c3b9bb1c style: fix wording 2023-03-13 11:14:59 +01:00
Kjell Winblad
baf39fe080
Merge pull request #10098 from kjellwinblad/kjell/fix/mongo_authz_crash
fix: mongodb authz crash
2023-03-13 10:46:49 +01:00
Stefan Strigler
cf73aacd7b chore: add changelog 2023-03-13 10:38:51 +01:00
ieQu1
e3595f2e79 chore(mria): Bump version to 0.4.0 2023-03-11 00:37:25 +01:00
Ilya Averyanov
5650ad20f8
Merge pull request #10100 from savonarola/0308-fix-scram-auth
Fix channel crash for slow clients with enhanced authentication
2023-03-10 12:58:43 +02:00
Ivan Dyachkov
951e89134c Merge remote-tracking branch 'upstream/release-50' into 0310-merge-release-50-to-master 2023-03-10 08:48:32 +01:00
Zaiming (Stone) Shi
f231042e76 chore: Generate changelog for e5.0.1 and v5.0.20 2023-03-09 18:47:02 +01:00
Ilya Averyanov
cba0287439 fix(mqtt): fix channel crash for slow clients with enhanced authn 2023-03-09 17:27:24 +02:00
Kjell Winblad
aa57ea9ee1 fix: mongodb authz crash
This fixes a crash with an error in the log file (see below) that
happened when the MongoDB authorization module queried the database. The
reason is that the collection name that was sent to the mongodb
connection was an atom. This is fixed by making sure it is not an atom.

2023-03-08T17:16:34.215523+01:00 [error] msg: query_mongo_error, mfa:
emqx_authz_mongodb:authorize/4, line: 95, peername: 127.0.0.1:53212,
clientid: client123, collection: mqtt_acl, filter: #{username =>
<<"emqx_u">>}, reason: {resource_error,#{msg => #{error =>
{error,{error_cannot_parse_response,{op_msg_response,#{<<"code">> =>
73,<<"codeName">> => <<"InvalidNamespace">>,<<"errmsg">> => <<"Failed to
parse namespace element">>,<<"ok">> => 0.0}}}},id =>
<<"emqx_authz_mongodb:3">>,name => call_query,request =>
{find,mqtt_acl,#{username => <<"emqx_u">>},#{}},stacktrace =>
[{mc_connection_man,reply,1,[{file,"mc_connection_man.erl"},{line,123}],
...]}, reason => exception}}, resource_id: <<"emqx_authz_mongodb:3">>

Fixes: https://github.com/emqx/emqx/issues/9783
2023-03-09 16:01:23 +01:00
JimMoen
0c5e95e2d0
chore: refine change log for few PRs
PR#10032, PR#10044, PR#10054, PR#10056
2023-03-09 10:30:11 +08:00
Zaiming (Stone) Shi
fe27604010 Merge remote-tracking branch 'origin/release-50' into 0308-merge-release-50-back-to-master 2023-03-08 16:46:45 +01:00
Zaiming (Stone) Shi
ac6325c823 docs: add change log for PR 10086 2023-03-08 12:56:12 +01:00
Zaiming (Stone) Shi
116137a447
docs: fix typos in change log
Co-authored-by: Ivan Dyachkov <dev@dyachkov.org>
2023-03-07 21:58:05 +01:00
Zaiming (Stone) Shi
158b4a95df
Merge pull request #10079 from qzhuyan/fix/william/i18n-broker_shared_subscription_strategy
fix: i18n desc of broker_shared_subscription_strategy
2023-03-07 21:57:07 +01:00
Zaiming (Stone) Shi
93ebd59fb2 docs: add changelogs for PR 10076 2023-03-07 20:57:38 +01:00
Stefan Strigler
609cd01a35
Merge pull request #10085 from sstrigler/EMQX-8552-authorization-sources-type-status-move-shouldnt-exist-when-authorization-sources-type-doesnt-exist
emqx_authz API: return 404 for all requests on non existent source
2023-03-07 16:19:28 +01:00
Stefan Strigler
71cb3be1d0 chore: fix translation 2023-03-07 15:12:51 +01:00
Stefan Strigler
e1054be319 chore: add changelog 2023-03-07 13:56:22 +01:00
ieQu1
0e9665fd99
fix(changelog): Apply suggestions from code review
Co-authored-by: William Yang <mscame@gmail.com>
2023-03-07 12:22:57 +01:00
ieQu1
6f88cb7d9e chore(ekka): Bump version to 0.14.3 2023-03-07 12:07:07 +01:00
zhongwencool
0a5b221984
Merge pull request #10055 from zhongwencool/fix-max-awaiting-rel
fix: update max_awaiting_rel in session
2023-03-07 18:37:20 +08:00
William Yang
2b1cf2fa52
Merge pull request #10058 from qzhuyan/dev/william/deprecated-unsupp-quic-TLS-options
fix: deprecate unsupp quic TLS options
2023-03-07 09:29:52 +01:00
William Yang
422f8e3be3
Merge pull request #10078 from qzhuyan/fix/william/inval-listener-options-segfault
fix: inval listener option cause segfault
2023-03-07 09:26:27 +01:00
Zhongwen Deng
00bfc66e91 chore: add changelog for mqtt.max_awaiting_rel 2023-03-07 10:53:16 +08:00
William Yang
c283902a62 docs(quic): changelogs. 2023-03-06 16:29:35 +01:00
William Yang
1912027eb5 docs: changelogs 2023-03-06 16:28:28 +01:00
Stefan Strigler
a81d1a4618
Merge pull request #10066 from sstrigler/EMQX-8932-bridge-api-reports-500-for-most-errors-when-starting-a-resource
fix: return human readable error message for most common cases
2023-03-06 14:13:34 +01:00
Stefan Strigler
d0ea7f4647 fix(emqx_authz): check if type param matches type in body 2023-03-06 11:10:31 +01:00
Zaiming (Stone) Shi
a4aece396a
Merge pull request #10052 from zmstone/0301-optimize-boot-error-log
0301 optimize boot failure logs
2023-03-06 08:32:15 +01:00
Stefan Strigler
570bf165af fix: return human readable error message for most common cases 2023-03-03 16:49:09 +01:00
Stefan Strigler
072d310507 style: fix zn translation 2023-03-03 09:32:28 +01:00
Stefan Strigler
64b5e9585e feat(emqx_rule_engine): API format errors in a human readable way 2023-03-02 16:49:11 +01:00
William Yang
6649a4f7d1 docs: add change logs 2023-03-02 15:57:01 +01:00
Zaiming (Stone) Shi
4eb9a69df0 feat(bin/emqx): diagnose boot failure
Prior to this change, when EMQX daemon mode failed to start
it's not quite easy for users to understand what went wrong.
All the know is the node did not start in time
and then instructed to boot the node in 'console' mode wishing
for some logs.
However, the node might actuay be running, causing 'console' mode
to fail with a different reason.

With this change, after a filure of daemon mode boot,
we issue a diagnosis.
1. if node can not be found from ps -ef, instruct the user
   to find information in erlang.log.N
2. if the node is found running, but not responding to pings
   instruct the user to check if the node name is
   resolvable and reachable
3. if the node is responding to pings but emqx app is not
   running, then it's likely a bug. so the user is advised
   to report a github issue.
2023-03-02 14:46:09 +01:00
Stefan Strigler
8bdef1300b
style: fix punctuation changes/ce/fix-10056.en.md
Co-authored-by: ieQu1 <99872536+ieQu1@users.noreply.github.com>
2023-03-02 12:16:17 +01:00
Stefan Strigler
57ea098d90 chore: add changelog 2023-03-02 11:30:38 +01:00
Stefan Strigler
9fb74bfc87
Merge pull request #10050 from sstrigler/EMQX-9063-bridges-api-consistently-return-404-if-resource-does-not-exist
fix: consistently return 404 in case bridge is not found or invalid
2023-03-02 11:20:56 +01:00
Stefan Strigler
3f324f85bc fix: consistently return 404 in case bridge is not found or invalid
Also: fix some typos and be more verbose
2023-03-01 18:03:49 +01:00
Zaiming (Stone) Shi
a5f31d0bf4 Merge remote-tracking branch 'origin/master' into 0301-merge-release-50-to-master 2023-03-01 14:04:29 +01:00
Stefan Strigler
bc1750703a chore: add changelog for PR 10013 2023-03-01 12:54:36 +01:00
Stefan Strigler
c9f8e3ca03 chore: add changelog for PR 10014 2023-03-01 12:49:21 +01:00
Zaiming (Stone) Shi
fdc0ad6669
Merge pull request #10044 from zmstone/0228-fix-node-info-format
fix(emqx_mgmt): format stoped nodes correctly
2023-03-01 11:39:09 +01:00
Zaiming (Stone) Shi
c616192578
docs: Update changes/ce/fix-10044.zh.md
Co-authored-by: William Yang <mscame@gmail.com>
2023-03-01 09:39:16 +01:00
Zaiming (Stone) Shi
083330ad80 Merge remote-tracking branch 'origin/master' into 0301-merge-release-50-to-master 2023-03-01 08:53:03 +01:00
Zaiming (Stone) Shi
8d63c6c08d
Merge pull request #10041 from zmstone/0228-add-influx-line-protocol-desc
0228 add influx line protocol desc
2023-03-01 08:44:26 +01:00
Zaiming (Stone) Shi
ceec7e9707
Merge pull request #10027 from zmstone/0224-fix-docker-entrypoint-env-overrides
0224 fix docker entrypoint env overrides
2023-03-01 08:10:55 +01:00
Zaiming (Stone) Shi
a64f712353
Merge pull request #10043 from zmstone/0228-fix-ssl-dist-optfile
0228 fix ssl dist optfile
2023-03-01 00:33:23 +01:00
Zaiming (Stone) Shi
23fb924e54 docs: add changelogs 2023-02-28 21:53:32 +01:00
Zaiming (Stone) Shi
a8d48bf571
docs: Update changes/ce/fix-10043.en.md
Co-authored-by: Thales Macedo Garitezi <thalesmg@gmail.com>
2023-02-28 21:42:06 +01:00
Zaiming (Stone) Shi
8331c8fff0 docs: add changelogs 2023-02-28 21:40:48 +01:00
Zaiming (Stone) Shi
4bc63a6103 docs: add changelogs 2023-02-28 21:17:07 +01:00
ieQu1
1554305236
fix(changelog): Apply suggestions from code review
Co-authored-by: Zaiming (Stone) Shi <zmstone@gmail.com>
2023-02-28 20:29:34 +01:00
ieQu1
f80c4e4084 chore(ekka): Bump version to 0.14.2 (mria 0.3.3) 2023-02-28 20:14:13 +01:00
William Yang
3a58a77bcd docs: add change logs 2023-02-28 14:55:45 +01:00
William Yang
d775e6aaa7 chore: changelog translation fix. 2023-02-28 14:55:45 +01:00
Ivan Dyachkov
ead29593df chore: update changelog 2023-02-27 23:16:30 +01:00
Ivan Dyachkov
78540fd0df chore: add changelog 2023-02-27 23:16:30 +01:00
Zaiming (Stone) Shi
f749e1654a
Merge pull request #10018 from id/0222-chore-add-changelog-for-9986
chore: add changelog for #9986
2023-02-27 14:55:12 +01:00
Andrew Mayorov
3157a64eae
chore: add a changelog entry 2023-02-27 14:55:42 +03:00
Ivan Dyachkov
ea5116740b chore: fix translation for #9213 2023-02-27 10:04:45 +01:00
Ivan Dyachkov
6ad31f7ada chore: add changelog for #9986 2023-02-27 10:03:41 +01:00
firest
2ea589648e chore: update changes 2023-02-27 11:41:40 +08:00
Zaiming (Stone) Shi
df7e9db057
Merge pull request #10019 from qzhuyan/dev/william/quic-hidden-low-level-tunings
230222 feat(quic): add hidden low level settings for listeners.
2023-02-24 20:03:31 +01:00
Zaiming (Stone) Shi
80afb69bb2
Merge pull request #10015 from zmstone/0220-faile-fast-if-cookie-is-obviously-wrong
0220 fail fast if cookie is obviously wrong
2023-02-24 19:54:35 +01:00
Zaiming (Stone) Shi
79bf77c2f1
Merge pull request #10020 from zmstone/0222-fix-bridge-async-mode-counters
fix(bridge): fix dropped counter and inflight gauge
2023-02-24 19:51:24 +01:00
Zaiming (Stone) Shi
9bb5abf44a fix(docker-entrypoint.sh): allow setting EMQX_NODE__NAME for docker
Prior to this change EMQX_NODE__NAME is ignored by docker entrypoint
script which will in turn set EQMX_NODE_NAME by resolving
the node name and domain name respectively.
2023-02-24 16:01:38 +01:00
William Yang
ea65ec10bf feat(quic): add hidden low level settings for listeners. 2023-02-24 10:20:28 +01:00
Zaiming (Stone) Shi
a638cc1d74 docs: add change logs 2023-02-24 09:11:45 +01:00
Ilya Averyanov
5bfd690df6 fix(dashboard): fix swagger spec generation 2023-02-23 22:09:36 +02:00
Zaiming (Stone) Shi
d298d603ac
Merge pull request #9999 from zmstone/0220-add-change-logs
docs: add missing changelogs for 9939
2023-02-23 16:02:06 +01:00
Zaiming (Stone) Shi
2811c371ad docs: add changelogs 2023-02-22 22:18:44 +01:00
ieQu1
b0777ca73b chore(ekka): Bump version 2023-02-22 20:55:04 +01:00
Ivan Dyachkov
6fd11904ee chore: add changelog for #9213 2023-02-22 10:10:56 +01:00
Stefan Strigler
7502e57066 chore: add changelog 2023-02-21 10:41:59 +01:00
Zaiming (Stone) Shi
88f099cc6f docs: add missing changelogs for 9939 2023-02-20 14:32:00 +01:00
William Yang
34869434d7 chore(quic): move changelog dir 2023-02-20 10:53:51 +01:00
firest
2e6aa6388f chore: update changelogs 2023-02-17 20:50:57 +08:00
firest
6599c44213 chore: refactor the format-changelog script 2023-02-16 15:25:31 +08:00