yuanbiao/emqx
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
17,212 Commits 393 Branches 684 Tags 74 MiB
ea3c2d95f3
Commit Graph

8715 Commits

Author SHA1 Message Date
Thales Macedo Garitezi
9900a32850 feat(kafka_consumer): add mqtt topic placeholder support 
Fixes https://emqx.atlassian.net/browse/EMQX-10678
 2023-08-07 11:42:34 -03:00
lafirest
2b03436552
Merge pull request #11392 from lafirest/feat/ldap_authz 
feat(ldap-authz): integrate the LDAP authorization
 2023-08-07 11:12:05 +08:00
zhongwencool
665695a977
Merge pull request #11388 from SergeTupchiy/EMQX-10703-fix-replicant-crash-when-core-terminates-abnormally 
fix: increase emqx_router_sup restart intensity
 2023-08-06 14:40:32 +08:00
Serge Tupchii
2b7798608d fix(emqx_router_helper): don't cleanup down node on a replicant 
The cleanup on a replicant node is redundant, as Mria would delegate this delete op
to a core node (via RPC), and the core node is expected to receive the same
`nodedown` message and process it.
 2023-08-04 16:55:36 +03:00
SergeTupchiy
2044326734
Merge pull request #11390 from SergeTupchiy/EMQX-10661-improve-perf-high-latency-cluster-network 
EMQX-10661 improve performance on high latency cluster network
 2023-08-04 16:41:08 +03:00
firest
b24a9d5343 chore(ldap-authz): update apps version && changes 2023-08-04 18:14:09 +08:00
firest
0571fd8cac feat(ldap-authz): integrate the LDAP authorization 2023-08-04 18:14:01 +08:00
Serge Tupchii
f276ea9e91 fix: increase emqx_router_sup restart intensity 
The goal is to tolerate occasional crashes that can happen under relatively normal conditions
and don't seem critical to shutdown the whole app (emqx).
For example, mria write/delete call delegated from a replicant to a core node may fail,
if the core node is being stopped / restarted / not ready.

Fixes: EMQX-10703, #11310
 2023-08-04 10:49:59 +03:00
firest
7055eafb91 fix(ldap): fix license date and some minor problems 2023-08-04 11:01:13 +08:00
lafirest
1b0b15786c
Merge pull request #11386 from lafirest/feat/ldap_authn 
feat(authn): integrate the LDAP authentication
 2023-08-04 09:37:37 +08:00
Andrew Mayorov
420653e5a2
Merge pull request #11389 from keynslug/perf/EMQX-10706/squash-retained-index 
perf(retainer): squash index updates into single dirty activity
 2023-08-03 21:32:04 +04:00
Serge Tupchii
466fe7e009 perf: add broker_pool_size, generic_pool_size and channel_cleanup_batch_size config options 
Tuning these options can improve performance if cluster interconnect network latency is high.

Fixes: EMQX-10661
 2023-08-03 19:44:00 +03:00
Serge Tupchii
ed28c12a66 chore(emqx_conf): deprecate node.tlog_push_mode setting 
It is not used since mria 0.2.10
 2023-08-03 17:46:14 +03:00
Andrew Mayorov
0e0c0d0e1e
chore: bump emqx_retainer to 5.0.16 2023-08-03 15:35:21 +04:00
Andrew Mayorov
534a741b0e
perf(retainer): do not GC on replicant nodes 2023-08-03 15:34:24 +04:00
firest
efff585b82 feat(ldap-authn): add test suite for the LDAP authenticator 2023-08-03 18:56:41 +08:00
Andrew Mayorov
42be694d40
perf(retainer): squash index updates into single dirty activity 
In order to minimize number of round trips to core nodes and between
them, improving publishing latency. This shouldn't make consistency
worse than it was before.
 2023-08-03 12:51:36 +04:00
Andrew Mayorov
39bb9d5136
chore: bump ekka to 0.15.10 
Which sports mria 0.6.0 with dirty activities support.
 2023-08-03 11:38:53 +04:00
firest
18b3db336a fix(ldap-authn): remove slat-related configs since they conflict with RFC 3123 2023-08-03 11:00:42 +08:00
Paulo Zulato
2c63fe3bcd fix(greptimedb): add sync_start to avoid false negative healthy check 
Fixes https://emqx.atlassian.net/browse/EMQX-10709
 2023-08-02 19:40:23 -03:00
Paulo Zulato
97fdc834de
Merge pull request #11381 from paulozulato/fix-oracle-doc-link 
doc(oracle): add link to online documentation into README
 2023-08-02 12:10:59 -03:00
firest
c041216ec0 feat(authn): integrate the LDAP authentication 2023-08-02 19:19:17 +08:00
firest
9bb5c9de33 fix(ldap): make elvis happy 2023-08-02 11:02:02 +08:00
firest
b2f3ac9967 fix(ldap): fix newline error && correcting files header 2023-08-02 10:07:27 +08:00
Paulo Zulato
b8be080ffb docs(oracle): add link to online documentation into README 
Fixes https://emqx.atlassian.net/browse/EMQX-10694
 2023-08-01 16:20:31 -03:00
firest
f98f97f37e feat(ldap): set test env and add test suites 2023-08-01 18:49:54 +08:00
firest
8c9b136d15 fix(ldap): integrate parser and fix lexer errors 2023-08-01 18:49:54 +08:00
firest
fa6343cc80 feat(ldap): add LDAP connector 2023-08-01 18:49:54 +08:00
Ivan Dyachkov
0f161a81c3 chore: v5.1.4 2023-08-01 09:20:46 +02:00
Thales Macedo Garitezi
41606aa840
Merge pull request #11373 from thalesmg/fix-spellcheck-master-20230731 
fix(spellcheck): fix several spellcheck issues not caught in CI
 2023-07-31 18:00:31 -03:00
Thales Macedo Garitezi
620b5fc048 fix(spellcheck): fix several spellcheck issues not caught in CI 
Fixes some issus later found by CI that somehow didn't block the originating PRs.

Example failure:

https://github.com/emqx/emqx/actions/runs/5715470851/job/15485284918?pr=11372
 2023-07-31 14:32:12 -03:00
Thales Macedo Garitezi
7687770821 fix(tls): remove cacerts config for now 
Fixes https://github.com/emqx/emqx/issues/11370

Related: https://github.com/emqx/emqx/pull/11371
 2023-07-31 10:44:05 -03:00
Thales Macedo Garitezi
a3be1529c6 fix(schema): ensure enterprise module is correctly loaded 
Fixes https://emqx.atlassian.net/browse/EMQX-10654

Despite loading the application in `nodetool`, we need to invoke `:module_info()` to force
the module to be actually loaded, especially when it's called in `call_hocon` to generate
the initial configurations.  Otherwise, it'll fail to list all the bridge schemas.
 2023-07-28 16:27:43 -03:00
Thales Macedo Garitezi
d6344ab709
Merge pull request #11363 from thalesmg/rabbit-tls-20230727 
feat(rabbitmq_bridge): add TLS support
 2023-07-28 13:23:30 -03:00
Thales Macedo Garitezi
2ee1aa6d60
Merge pull request #11347 from thalesmg/fix-ocsp-path-encoding-20230725 
fix(ocsp): URL encode request path
 2023-07-28 09:01:39 -03:00
Thales Macedo Garitezi
399f849f7b feat(rabbitmq_bridge): add TLS support 
Fixes https://emqx.atlassian.net/browse/EMQX-10605
 2023-07-27 15:52:46 -03:00
Ivan Dyachkov
d51b5b739b chore: v5.1.3 2023-07-27 17:00:20 +02:00
Ivan Dyachkov
5ac01c9b85
Merge pull request #11360 from id/0727-sync-release-51-to-master 2023-07-27 16:58:09 +02:00
Thales Macedo Garitezi
ee3d002fca
Merge pull request #11329 from thalesmg/aeh-bridge-20230720 
feat: add Azure Event Hub Producer bridge
 2023-07-27 11:18:40 -03:00
Ivan Dyachkov
63adeabf72 chore: bump app versions 2023-07-27 15:29:03 +02:00
Ivan Dyachkov
cbfca8c043 chore: merge master into release-51 2023-07-27 15:19:57 +02:00
Thales Macedo Garitezi
5abe4bed88 feat: add Azure Event Hub Producer bridge 
Fixes https://emqx.atlassian.net/browse/EMQX-10338
 2023-07-27 09:22:39 -03:00
Ivan Dyachkov
50a0900d92 chore: e5.1.1 2023-07-27 12:18:03 +02:00
JianBo He
951a96457b
Revert "feat(index): add topic index facility " 2023-07-27 13:42:43 +08:00
JianBo He
5e4855334e
Revert "Fix(topicidx): allow to return matches unique by record id" 2023-07-27 13:39:37 +08:00
firest
abf8d8b391 fix(ds): make dialyzer happy 2023-07-26 16:35:07 +08:00
firest
14b76916df fix(ds): avoid crashes when starting on Windows 2023-07-26 15:37:58 +08:00
Thales Macedo Garitezi
2ac8ba2add test: fix flaky test 2023-07-25 17:43:33 -03:00
Thales Macedo Garitezi
d3d52695d5 feat(tls): automatically add cacerts to client opts 
`public_key:cacerts_get/0` was introduced in OTP 25 and allows us to
load the system trusted CA certificates.

https://www.erlang.org/doc/man/public_key.html#cacerts_get-0
 2023-07-25 17:43:33 -03:00
Thales Macedo Garitezi
d0deaca00d fix(ocsp): URL encode request path 
Fixes https://emqx.atlassian.net/browse/EMQX-10624
 2023-07-25 17:39:38 -03:00
Serge Tupchii
77184c00ff chore(ekka): Bump version to 0.15.9 2023-07-25 19:29:18 +03:00
Ivan Dyachkov
f9d3d3325b chore: e5.1.1-rc.1 2023-07-25 16:34:25 +02:00
Ilya Averyanov
2909b1de2d
Merge pull request #11339 from savonarola/0724-fix-subscribe-qos-authz 
fix(authz): correctly identify qos of subscribe actions
 2023-07-25 17:07:57 +03:00
Thales Macedo Garitezi
c7bf3ece34
Merge pull request #11338 from thalesmg/fix-pgsql-error-r51-20230724 
fix(postgres_bridge): fix table existence check and handle sync_required
 2023-07-25 10:53:03 -03:00
Paulo Zulato
7ee17553d5
Merge pull request #11337 from paulozulato/fix-error-code-topic-wildcard 
fix(topic_rewrite): handle error when target contains wildcards
 2023-07-25 10:37:20 -03:00
Paulo Zulato
8ec14bb07e fix(topic_rewrite): handle error when target contains wildcards 
Fixes https://emqx.atlassian.net/browse/EMQX-10565
 2023-07-25 09:43:14 -03:00
Ilya Averyanov
deaac9bd73 fix(authz): correctly identify qos of subscribe actions 2023-07-25 15:20:52 +03:00
Thales Macedo Garitezi
7a16ff4f04 fix(postgres_bridge): fix table existence check and handle sync_required 
Fixes https://emqx.atlassian.net/browse/EMQX-10629

During health checking, we check whether tables in the SQL statement
exist.  Such check was done by asking the backend to parse the
statement using a named prepared statements.  Concurrent health checks
could then result in the error:

```erlang
{error,{error,error,<<"42P05">>,duplicate_prepared_statement,<<"prepared statement \"get_status\" already exists">>,[{file,<<"prepare.c">>},{line,<<"451">>},{routine,<<"StorePreparedStatement">>},{severity,<<"ERROR">>}]}}
```

This could lead to an inconsistent state in the driver process, which
would crash later when a message from the backend (`READY_FOR_QUERY`, "idle"):

```
  2023-07-24T13:05:58.892043+00:00 [error] Generic server <0.2134.0> terminating. Reason: {'module could not be loaded',[{undefined,handle_message,[90,<<"I">>,...
```

Added calls to `epgsql:sync/1` for functions that could return
`{error, sync_required}`.

Also, redundant calls to `parse2` were removed to reduce the number of requests.
 2023-07-25 09:15:14 -03:00
zhongwencool
2c193f26e6
Merge pull request #11332 from HJianBo/fix-topic-index-unique-bugs 2023-07-25 19:07:07 +08:00
JianBo He
d05a5cfe0f fix(rule): fix the matches/2 for some edge cases 2023-07-25 14:35:18 +08:00
Paulo Zulato
69f4275871 fix(oracle): fix return error checking on table validation 
Fixes https://emqx.atlassian.net/browse/EMQX-10622
 2023-07-24 14:50:38 -03:00
JianBo He
e630331de1 fix(rule): fix a quering problem when 'a/b' and 'a/b/#' exist at the same time. 
When using `ets:next` to query the next level of topic words, we should prioritize the next level
of '#', '+'.
 2023-07-24 23:04:53 +08:00
JianBo He
f848c0b87a
Merge pull request #11333 from JimMoen/chore-hide-hstreamdb 
chore: hidden hstreamdb bridge schema
 2023-07-24 21:54:10 +08:00
JianBo He
511d1b6ca1 chore: hide the hstreamdb http api 2023-07-24 20:11:44 +08:00
JianBo He
dcf4819c04 test(rule): add tests to ensure the rules ordering 2023-07-24 19:30:34 +08:00
firest
8439ce0e84 chore: update app version && reboot_lists 2023-07-24 19:08:41 +08:00
Dennis Zhuang
9f200120c2 feat: use http port to detect server availability 2023-07-24 17:58:48 +08:00
Dennis Zhuang
cd9d5f287e chore: adds auto_reconnect for ecpool 2023-07-24 17:58:48 +08:00
Dennis Zhuang
2ea903c5ac fix: static checks failures 2023-07-24 17:58:48 +08:00
Dennis Zhuang
b34374c26f chore: by CR comments 2023-07-24 17:58:48 +08:00
Dennis Zhuang
c9550cc2e5 refactor: rename bridge greptimedb_grpc_v1 to greptimedb 2023-07-24 17:58:48 +08:00
Dennis Zhuang
a1c7eb337b fix: dependency name 2023-07-24 17:58:48 +08:00
Dennis Zhuang
50c10dd919 chore: update greptimedb-client-erl to v0.1.2 2023-07-24 17:58:48 +08:00
Dennis Zhuang
3b1363dbb7 chore: change license to BCL and adds emqx_bridge_greptimedb_connector_SUITE 2023-07-24 17:58:48 +08:00
Dennis Zhuang
6f7fbcf693 fix: compile error 2023-07-24 17:58:48 +08:00
Dennis Zhuang
4921856950 test: make all emqx_bridge_greptimedb_SUITE tests passing 2023-07-24 17:58:48 +08:00
Dennis Zhuang
c6a7f3e2ad test: make test passed 21/29 2023-07-24 17:58:48 +08:00
Dennis Zhuang
975795a6e0 feat: add ci test 2023-07-24 17:58:48 +08:00
Dennis Zhuang
89bce99870 test: greptimedb data brige 2023-07-24 17:58:48 +08:00
Dennis Zhuang
91ebd90442 fix: batch write 2023-07-24 17:58:48 +08:00
Dennis Zhuang
6d9944a8e8 feat: update greptimedb dependencies 2023-07-24 17:58:48 +08:00
Dennis Zhuang
417e017498 feat: begin to impl connector 2023-07-24 17:58:48 +08:00
Dennis Zhuang
c5078980f3 feat: adds the greptimedb bridge to emqx modules 2023-07-24 17:58:48 +08:00
Dennis Zhuang
4d581d0b30 feat: init commit 2023-07-24 17:58:48 +08:00
Andrew Mayorov
0496038361 fix(ruleeng): ensure topic index matched rules evalauted once 2023-07-24 17:44:12 +08:00
Andrew Mayorov
6432c9c8fc fix(topicidx): allow to return matches unique by record id 2023-07-24 17:43:11 +08:00
JimMoen
613dc1646c
chore: hidden hstreamdb bridge schema 2023-07-24 17:22:29 +08:00
firest
af6405fa25 fix(nested_put): fix a data loss bug introduced by #11172 2023-07-24 16:39:37 +08:00
Andrew Mayorov
81793c31fc
Merge pull request #11315 from keynslug/ft/EMQX-9593/peek-mqueue-info 
refactor(session): allow peeking at mqueue less intrusively
 2023-07-24 09:57:05 +02:00
JimMoen
c393c2e091
test: ets table cleanup after cases 2023-07-24 09:33:28 +08:00
JimMoen
4e4b1ac115
refactor: module move to app emqx_rule_engine 
- Rename to emqx_rule_index.erl
- Remove test funcs from src -> test dir
 2023-07-24 09:33:28 +08:00
Andrew Mayorov
b821bdee00
perf(ruleeng): employ emqx_topic_index to speed up topic matching 2023-07-24 09:27:31 +08:00
Andrew Mayorov
28dad5d7a9
feat(index): add topic index facility 
Somewhat similar to `emqx_trie` in design and logic, yet built on
top of a single, potentially pre-existing table.
 2023-07-24 09:27:31 +08:00
Paulo Zulato
31cf05ec66
Merge pull request #11316 from paulozulato/fix-oracle-pool-size 
fix(oracle): fix Pool Size parameter retrieval
 2023-07-21 17:51:21 -03:00
Thales Macedo Garitezi
2531c3e7d1
Merge pull request #11306 from thalesmg/rule-actions-reply-dropped-r51-20230719 
fix(rule_metrics): notify rule metrics of late replies and expired requests
 2023-07-21 16:51:14 -03:00
Ivan Dyachkov
29432009db chore: 5.1.1-alpha.4 2023-07-21 18:42:14 +02:00
ieQu1
485e495b98 chore(ekka): Bump version to 0.15.8 (mria 0.5.10) 2023-07-21 18:31:02 +02:00
Paulo Zulato
85ab97970f fix(oracle): fix Pool Size parameter retrieval 
Fixes https://emqx.atlassian.net/browse/EMQX-10599
 2023-07-21 11:02:27 -03:00
Ivan Dyachkov
c2c3da073f chore: v5.1.2 2023-07-21 13:26:29 +02:00
Ivan Dyachkov
243b8f5b67 chore: merge 'upstream/master' into v5.1.2 2023-07-21 13:25:46 +02:00