yuanbiao/emqx
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
22,836 Commits 393 Branches 684 Tags 74 MiB
master
Commit Graph

420 Commits

Author SHA1 Message Date
Thales Macedo Garitezi
b69fc9af15 fix(gcp_pubsub_producer): fix connector resource_opts schema 
Fixes https://emqx.atlassian.net/browse/EMQX-11703
 2024-01-10 10:13:11 -03:00
Thales Macedo Garitezi
787f952ad8 fix(syskeeper_bridge): mark syskeeeper as a v2-only action 
Fixes https://emqx.atlassian.net/browse/EMQX-11706
 2024-01-10 10:09:51 -03:00
Andrew Mayorov
e14e923f8a
chore: add changelog entry 2024-01-10 13:41:43 +01:00
Thales Macedo Garitezi
abd4873091 fix(mysql_bridge): allow deleting bridge when sql contains undefined fields 
Fixes https://emqx.atlassian.net/browse/EMQX-11655
 2024-01-09 17:25:34 -03:00
Thales Macedo Garitezi
d0588b86b5 fix(mysql_bridge): check prepare statement error messages 
Fixes https://emqx.atlassian.net/browse/EMQX-11648
 2024-01-09 17:25:34 -03:00
Ivan Dyachkov
06117c3a33 Merge remote-tracking branch 'upstream/release-54' into 0105-sync-r54 2024-01-05 14:20:38 +01:00
Andrew Mayorov
ace6081792
chore: add changelog entry 2024-01-04 15:16:27 +01:00
zhongwencool
338e14ad54
Merge pull request #12250 from zhongwencool/deobfuscate-config 
fix: incorrectly attempt to update the field value when the previous …
 2024-01-04 13:59:01 +08:00
zhongwencool
90404b62a4 fix: incorrectly attempt to update the field value when the previous field don't have value 2024-01-04 10:12:34 +08:00
JianBo He
b4c4103eab
Merge pull request #12246 from id/0102-docker-do-not-expose-11883 
chore: do not expose 11883 by default in docker as we do not listen on it
 2024-01-04 09:14:03 +08:00
zhongwencool
00e8a36dbe fix: the API prompt garbled characters for updating the configuration 2024-01-03 15:34:45 +08:00
Ivan Dyachkov
4c761b0ff9 docs: add changelog entry 2024-01-02 10:50:15 +01:00
Andrew Mayorov
72677f69d4
chore: add changelog entry 2023-12-28 14:49:05 +01:00
Zaiming (Stone) Shi
7338e394c8 perf: upgrade to wolff 1.9.1 for better performance 
Upgrade from 1.8.0:
- wollf-1.9.0 has the global stats disabled by default
- wolff-1.9.1 improved client pid lookup performance
 2023-12-18 18:54:21 +01:00
Zaiming (Stone) Shi
c1f2287b86 Merge remote-tracking branch 'origin/release-54' 2023-12-14 15:26:49 +01:00
Zaiming (Stone) Shi
ddc984becd docs: add changelog for license renewal 2023-12-08 08:29:29 +01:00
Dennis Zhuang
c128f7b2d9 docs: update changelog 2023-12-04 20:30:33 +08:00
Dennis Zhuang
547acef01d feat: upgrade greptimedb client to v0.1.5 2023-12-04 20:30:33 +08:00
Zaiming (Stone) Shi
d933d0b9e0
Merge pull request #12016 from zmstone/1122-load-license-file 
1122 load license file
 2023-11-27 16:43:51 +01:00
Kjell Winblad
f79d38983d docs: add changelog entry 2023-11-24 18:56:57 +01:00
Zaiming (Stone) Shi
d84d77d23b docs: add changelog for PR 12016 (license key enhancement) 2023-11-23 18:44:38 +01:00
Ilya Averyanov
e93e9ed108 feat(rebalance): improve rebalance usability 
* make availability API endpoint public
* allow connections during wait_health_check interval
* make availability status calculation more consistent and lightweight
* refactor test to get rid of some mocks and to use cth
 2023-11-18 21:29:16 +03:00
JimMoen
5fcedba4cd
chore: change log for gw_jt808 and gw_ocpp 2023-11-12 21:44:24 +08:00
firest
e93216fa62 chore(sysk): fix spellchecks & update change & more logs 2023-11-10 09:52:32 +08:00
Ivan Dyachkov
0bf5deaed9 chore: merge master into release-54 2023-11-09 08:32:26 +01:00
Ivan Dyachkov
0c91bec98d chore: merge 'upstream/release-53' 2023-11-08 09:24:38 +01:00
Thales Macedo Garitezi
2b8cf50a1d chore: rename bridges_v2 -> actions in the public facing APIs 
Fixes https://emqx.atlassian.net/browse/EMQX-11330

After feedback from Product team, we should rename `bridges_v2` to `actions` everywhere.
We'll start with the public facing APIs.

- HTTP API
- Hocon schema root key
 2023-11-06 15:37:07 -03:00
firest
6b50fdcf9e chore(gbt32960): update changes 2023-11-01 19:35:44 +08:00
Zaiming (Stone) Shi
d8d1783c0a docs: add changelog for bridge_v2 2023-10-31 14:33:29 +01:00
firest
4ba34f8f3e chore(rbac): fix CI errors & update change 2023-10-27 17:17:04 +08:00
JimMoen
8ae69874ee
chore: add missing change log for saml SSO Entra Id support 2023-10-24 09:34:26 +08:00
zhongwencool
befc484544 chore: add changelog entry and fix xref warning 2023-10-20 14:47:24 +08:00
lafirest
74442b0d31
Merge pull request #11766 from lafirest/feat/rbac 
feat(api_key): add RBAC feature for the API key
 2023-10-20 09:24:41 +08:00
Ilya Averyanov
c0ebaf9b6f
Merge pull request #11541 from savonarola/0829-duplicate-ft-responses 
Support asynchronous mode of receiving responses to FT operations
 2023-10-17 17:08:00 +03:00
Zaiming (Stone) Shi
55618dd28a
Merge pull request #11731 from zmstone/1008-expose-file-transfer-host-conf 
fix(api-docs): add file-transfer config to hot-config scope
 2023-10-17 11:23:16 +02:00
firest
db3915d472 fix(rbac): update changes && fix CI errors 2023-10-17 13:44:37 +08:00
Zaiming (Stone) Shi
6eb3bb7cff Merge remote-tracking branch 'origin/release-53' into 1114-sync-release-53 2023-10-14 10:16:38 +02:00
Ilya Averyanov
90a0c093bf
Merge pull request #11750 from savonarola/1011-redact-auth-http-request 
Do not trace authn http request bodies
 2023-10-13 17:25:28 +03:00
Andrew Mayorov
dcdfcdb24f
chore: add changelog entry 2023-10-13 19:58:59 +07:00
Ilya Averyanov
68f31a9da2 fix(authn): do not trace authn requests 2023-10-12 16:32:16 +03:00
Thales Macedo Garitezi
b07dddd49e fix(postgres): format unicode error messages from driver 
Fixes https://emqx.atlassian.net/browse/EMQX-11024

Sample error:

```
{error, error, <<"42501">>, insufficient_privilege,
<<229,175,185,232,161,168,32,109,113,116,116,95,117,115,101,114,32,230,157,131,233,153,144,228,184,141,229,164,159>>,
[]}
```
 2023-10-11 17:56:12 -03:00
Ilya Averyanov
534c9bdc13 feat(ft): add additional operation status report channel 2023-10-11 19:51:36 +03:00
Zaiming (Stone) Shi
a2e86c67db
Merge pull request #11733 from keynslug/fix/EMQX-10827/sesson-takeover 
fix(cm): bring back pre-v5.3.0 compat in `takeover_session_begin/1`
 2023-10-10 19:03:29 +02:00
Zaiming (Stone) Shi
2b44349b21 docs: add changelog for pull request 11731 2023-10-10 10:24:10 +02:00
Andrew Mayorov
6301294677
chore: add changelog entry 2023-10-10 01:34:10 +07:00
Thales Macedo Garitezi
79cf0a2ced fix(kafka_producer): correctly handle metrics for connector that have internal buffers 
Fixes https://emqx.atlassian.net/browse/EMQX-11086

There’s currently a metric inconsistency due to the internal buffering nature of Kafka
Producer (wolff).

We use simple_sync_query to call the Kafka Producer bridge.  If that times out, the call
is accounted as failed, even though the message is buffered in wolff and later sent
successfully.
 2023-10-09 15:02:25 -03:00
firest
bff048d183 chore: update changes 2023-10-08 18:45:39 +08:00
Thales Macedo Garitezi
34186fcc74 fix(kafka_producer): send messages to wolff producer to buffer even when connector is in connecting state 
Fixes https://emqx.atlassian.net/browse/EMQX-11085

Messages would not be sent to wolff if the connection was down, so they were effectively lost.
 2023-10-06 11:43:29 -03:00
JimMoen
a11b728239
chore: add missing changelog 2023-09-28 17:38:25 +08:00
Ivan Dyachkov
105bebc250 chore: merge release-52 into master 2023-09-21 10:22:47 +02:00
Serge Tupchii
80cf60e9be fix(emqx_bridge_hstreamdb): fix resources cleanup in on_stop/2 cb 
fixes: EMQX-10962
 2023-09-18 17:48:05 +03:00
lafirest
6fe846bf0e
Merge pull request #11610 from lafirest/feat/rbac 
feat(dashboard): add RBAC feature for Dashboard
 2023-09-18 14:41:47 +08:00
firest
ca6547c05b fix(rbac): change default role and update changes 2023-09-18 11:40:35 +08:00
firest
4b97d3f57d test(rbac): add test cases for RBAC && update changes 2023-09-15 18:16:28 +08:00
Ilya Averyanov
1959e15703 chore: simplify session eviction for node rebalance 2023-09-15 11:46:51 +02:00
lafirest
aace9215a4
Merge pull request #11608 from lafirest/feat/ldap_bind 
feat(ldap): integrate authentication with LDAP bind operation
 2023-09-15 14:06:39 +08:00
Ilya Averyanov
11c39c4b6a chore: simplify session eviction for node rebalance 2023-09-14 18:28:25 +03:00
firest
d0636dee7a chore: update change 2023-09-14 16:52:36 +08:00
Zaiming (Stone) Shi
abda3b130a chore: delete releaed change logs 2023-09-08 16:39:17 +02:00
Zaiming (Stone) Shi
f3bebb0ba2 Merge remote-tracking branch 'origin/master' into 0907-sync-master-to-release-52 2023-09-07 18:51:30 +02:00
Zaiming (Stone) Shi
916306b6ba chore: delete beta release feature changelog 2023-09-06 09:56:36 +02:00
Zaiming (Stone) Shi
e794143ae1 Merge remote-tracking branch 'origin/release-52' into 0906-sync-release-52-to-master 2023-09-06 09:08:22 +02:00
Kjell Winblad
fa9326f8ca docs: add changelog entry for gpb upgrade 2023-09-05 09:57:13 +02:00
Serge Tupchii
bc9b270308 chore: add changelog for bridges function_clause fixes 2023-09-01 19:56:07 +03:00
Kjell Winblad
3bb65e6b05
Merge pull request #11542 from kjellwinblad/kjell/fix/EMQX-10775 
fix: update gpb library to fix type error
 2023-09-01 10:07:03 +02:00
Kjell Winblad
36d44ca5b7 docs: add changelog entry for gpb upgrade 2023-08-30 11:29:29 +02:00
JianBo He
9fe4382d98
Merge pull request #11530 from JimMoen/chore-bump-hstreamdb-driver 
chore: bump hstreamdb_erl driver to `0.4.5+v0.16.1`
 2023-08-30 14:37:17 +08:00
Paulo Zulato
0b86f04bae fix(kafka): fix template processing for header 
Fixes https://emqx.atlassian.net/browse/EMQX-10846
 2023-08-28 17:28:05 -03:00
Thales Macedo Garitezi
9bded07834 feat: cluster purge 
Fixes https://emqx.atlassian.net/browse/EMQX-10763
 2023-08-28 10:23:20 -03:00
JimMoen
f3467f44b2
chore: bump hstreamdb_erl driver to 0.4.5+v0.16.1 2023-08-28 17:28:50 +08:00
Paulo Zulato
84e68f8ed8
Merge pull request #11508 from paulozulato/fix-azure-msg-error-handling 
fix(kafka): fix result handling when sending message with invalid header
 2023-08-25 14:57:09 -03:00
Thales Macedo Garitezi
0381ac0410 fix(kafka_producer): use correct timestamp template field 
Fixes https://emqx.atlassian.net/browse/EMQX-10847
 2023-08-24 14:20:42 -03:00
Paulo Zulato
60e6217496 fix(kafka): fix result handling when sending message with invalid header 
Fixes https://emqx.atlassian.net/browse/EMQX-10846
 2023-08-24 10:41:42 -03:00
Paulo Zulato
61536b5362
Merge pull request #11494 from paulozulato/fix-kinesis-validators 
fix(kinesis): set validators for static constraints
 2023-08-22 18:28:35 -03:00
Paulo Zulato
20b46091f9 fix(kinesis): set validators for static constraints 
Fixes https://emqx.atlassian.net/browse/EMQX-10833
 2023-08-22 14:42:44 -03:00
Thales Macedo Garitezi
45e2e687e5 fix(greptimedb_bridge): avoid double-parsing write syntax during probe and remove code duplication 
Fixes https://emqx.atlassian.net/browse/EMQX-10843
 2023-08-22 12:42:48 -03:00
JimMoen
13ebcd6290
Merge pull request #11478 from JimMoen/hstreamdb-tls-support 
Hstreamdb tls support
 2023-08-22 10:40:54 +08:00
Thales Macedo Garitezi
bd5680db00
Merge pull request #11461 from thalesmg/bridge-dryrun-flex-timeout-r52-20230816 
fix(bridge): make dryrun health check timeout more malleable
 2023-08-21 14:49:46 -03:00
Ivan Dyachkov
999988cab4
Merge pull request #11401 from kjellwinblad/kjell/fix/mongo_date_format/EMQX-10727 
fix: rule SQL mongo_date function should return a string in test mode
 2023-08-21 16:20:59 +02:00
JimMoen
f45b5fac6f
chore: unhidden hstreamdb bridge for e5.2.0 2023-08-21 10:40:51 +08:00
Zaiming (Stone) Shi
01c9095982
Merge pull request #11394 from zmstone/0804-upgrade-wolff-to-1.7.7 
chore: upgrade Kafka client wolff to 1.7.7
 2023-08-20 10:14:13 +02:00
Paulo Zulato
afffdbbaa1 fix(kinesis): replace default payload template 
Fixes https://emqx.atlassian.net/browse/EMQX-10766
 2023-08-17 17:00:14 -03:00
Thales Macedo Garitezi
ebecbd1545 fix(bridge): make dryrun health check timeout more malleable 
Fixes https://emqx.atlassian.net/browse/EMQX-10773

- Makes the timeout for probing a bridge more malleable to account for differences between
  each database.
- Increases GCP PubSub Consumer default health check timeout to account for GCP
  slowness/throttling.
 2023-08-17 09:21:19 -03:00
Thales Macedo Garitezi
e3572eb758
Merge pull request #11459 from thalesmg/kafka-health-check-interval-r52-20230816 
feat(kafka): add option to configure health check interval
 2023-08-17 09:04:30 -03:00
Ivan Dyachkov
7469222a17 Merge remote-tracking branch 'upstream/master' into 0817-e5.2.0-code-freeze 2023-08-17 08:16:04 +02:00
Paulo Zulato
740680d54b
Merge pull request #11444 from paulozulato/fix-kinesis-msg-access-denied 
fix(kinesis): return error message on access denied
 2023-08-16 18:02:46 -03:00
Paulo Zulato
a64386ef82 fix(kinesis): return error message on access denied 
Fixes https://emqx.atlassian.net/browse/EMQX-10764
 2023-08-16 16:04:23 -03:00
Thales Macedo Garitezi
ffca581229 feat(kafka): add option to configure health check interval 
Fixes https://emqx.atlassian.net/browse/EMQX-10781
 2023-08-16 11:08:06 -03:00
Thales Macedo Garitezi
4e80d669b0 fix(influxdb_bridge): avoid double-parsing write syntax during probe 
Fixes https://emqx.atlassian.net/browse/EMQX-10771
 2023-08-15 17:05:57 -03:00
Thales Macedo Garitezi
82b8538041 feat(gcp_producer): add support for defining message attributes and ordering key 
Fixes https://emqx.atlassian.net/browse/EMQX-10652
 2023-08-14 10:33:17 -03:00
Paulo Zulato
9ca9c65af2
Merge pull request #11367 from paulozulato/feat-gcp-devices 
feat(gcp-iot): port GCP IoT Core compatibility layer from e4.4
 2023-08-10 09:44:55 -03:00
Paulo Zulato
a85c948e23 feat(gcp-iot): port GCP IoT Core compatibility layer from e4.4 
Fixes https://emqx.atlassian.net/browse/EMQX-10341
 2023-08-09 10:48:25 -03:00
Thales Macedo Garitezi
9900a32850 feat(kafka_consumer): add mqtt topic placeholder support 
Fixes https://emqx.atlassian.net/browse/EMQX-10678
 2023-08-07 11:42:34 -03:00
Kjell Winblad
19d091eef1 docs: add changelog entry 2023-08-07 16:28:39 +02:00
Zaiming (Stone) Shi
ff88e508a6 docs: add changelog 2023-08-07 10:39:04 +02:00
firest
b24a9d5343 chore(ldap-authz): update apps version && changes 2023-08-04 18:14:09 +08:00
firest
7055eafb91 fix(ldap): fix license date and some minor problems 2023-08-04 11:01:13 +08:00
firest
b4a21b6afb feat(ldap): update changes 2023-08-03 18:56:46 +08:00
Thales Macedo Garitezi
a3be1529c6 fix(schema): ensure enterprise module is correctly loaded 
Fixes https://emqx.atlassian.net/browse/EMQX-10654

Despite loading the application in `nodetool`, we need to invoke `:module_info()` to force
the module to be actually loaded, especially when it's called in `call_hocon` to generate
the initial configurations.  Otherwise, it'll fail to list all the bridge schemas.
 2023-07-28 16:27:43 -03:00
Thales Macedo Garitezi
399f849f7b feat(rabbitmq_bridge): add TLS support 
Fixes https://emqx.atlassian.net/browse/EMQX-10605
 2023-07-27 15:52:46 -03:00
Ivan Dyachkov
5ac01c9b85
Merge pull request #11360 from id/0727-sync-release-51-to-master 2023-07-27 16:58:09 +02:00
Ivan Dyachkov
cbfca8c043 chore: merge master into release-51 2023-07-27 15:19:57 +02:00
Thales Macedo Garitezi
5abe4bed88 feat: add Azure Event Hub Producer bridge 
Fixes https://emqx.atlassian.net/browse/EMQX-10338
 2023-07-27 09:22:39 -03:00
Thales Macedo Garitezi
c7bf3ece34
Merge pull request #11338 from thalesmg/fix-pgsql-error-r51-20230724 
fix(postgres_bridge): fix table existence check and handle sync_required
 2023-07-25 10:53:03 -03:00
Thales Macedo Garitezi
7a16ff4f04 fix(postgres_bridge): fix table existence check and handle sync_required 
Fixes https://emqx.atlassian.net/browse/EMQX-10629

During health checking, we check whether tables in the SQL statement
exist.  Such check was done by asking the backend to parse the
statement using a named prepared statements.  Concurrent health checks
could then result in the error:

```erlang
{error,{error,error,<<"42P05">>,duplicate_prepared_statement,<<"prepared statement \"get_status\" already exists">>,[{file,<<"prepare.c">>},{line,<<"451">>},{routine,<<"StorePreparedStatement">>},{severity,<<"ERROR">>}]}}
```

This could lead to an inconsistent state in the driver process, which
would crash later when a message from the backend (`READY_FOR_QUERY`, "idle"):

```
  2023-07-24T13:05:58.892043+00:00 [error] Generic server <0.2134.0> terminating. Reason: {'module could not be loaded',[{undefined,handle_message,[90,<<"I">>,...
```

Added calls to `epgsql:sync/1` for functions that could return
`{error, sync_required}`.

Also, redundant calls to `parse2` were removed to reduce the number of requests.
 2023-07-25 09:15:14 -03:00
Paulo Zulato
69f4275871 fix(oracle): fix return error checking on table validation 
Fixes https://emqx.atlassian.net/browse/EMQX-10622
 2023-07-24 14:50:38 -03:00
JianBo He
5ffd7f2a73 chore: remove the hstreamdb changes due to we hide it in e5.1.1 2023-07-24 20:14:47 +08:00
Dennis Zhuang
ba9dcbcff0 chore: style 2023-07-24 17:58:48 +08:00
Dennis Zhuang
ffcd04bc9f docs: add change log 2023-07-24 17:58:48 +08:00
Paulo Zulato
31cf05ec66
Merge pull request #11316 from paulozulato/fix-oracle-pool-size 
fix(oracle): fix Pool Size parameter retrieval
 2023-07-21 17:51:21 -03:00
Paulo Zulato
85ab97970f fix(oracle): fix Pool Size parameter retrieval 
Fixes https://emqx.atlassian.net/browse/EMQX-10599
 2023-07-21 11:02:27 -03:00
Ivan Dyachkov
243b8f5b67 chore: merge 'upstream/master' into v5.1.2 2023-07-21 13:25:46 +02:00
Paulo Zulato
e76ba760c9 fix(oracle): discard nested tokens when checking table 
Fixes https://emqx.atlassian.net/browse/EMQX-10597
 2023-07-19 15:03:49 -03:00
Ivan Dyachkov
b7f0f7b32d chore: merge master into release-51 2023-07-19 09:28:05 +02:00
firest
4f4a813f04 fix(tdengine): update the default template and the changelog 2023-07-18 10:31:18 +00:00
Paulo Zulato
484519dcf9 feat(kinesis): implement Amazon Kinesis Producer bridge 
Fixes https://emqx.atlassian.net/browse/EMQX-10474
Fixes https://emqx.atlassian.net/browse/EMQX-10475
 2023-07-17 11:51:42 -03:00
JianBo He
c746c85739
chore: update changes/ee/fix-11266.en.md 
Co-authored-by: Thales Macedo Garitezi <thalesmg@gmail.com>
 2023-07-14 09:18:30 +08:00
firest
66baea2ba0 chore: update changes 2023-07-13 08:02:36 +00:00
Thales Macedo Garitezi
541d03a0ba refactor(schema_registry): refactor schema registry app and modules 
Fixes https://emqx.atlassian.net/browse/EMQX-10361

- Moves `lib-ee/emqx_ee_schema_registry` to `apps/emqx_schema_registry`.
- Removes the `_ee_` segment from module names.
  - Exceptions are the table names which are kept to avoid backwards incompatibilities.
 2023-07-12 09:24:15 -03:00
Serge Tupchii
cacfb51280 fix(emqx_machine): add emqx_ee_schema_registry to the reboot apps list 
As emqx_ee_schema_registry uses Mria tables (schema_registry_shard),
a node joining a cluster needs to restart this application in order to
restart relevant Mria shard processes.
 2023-07-12 09:23:28 -03:00
JianBo He
ae59a26659
Merge pull request #11223 from JimMoen/fix-influxdb-float-value-trans 
fix: influxdb float serialization error
 2023-07-10 23:04:01 +08:00
JimMoen
e9f1d7f2bf
fix: influxdb float serialization error 2023-07-10 13:53:11 +08:00
Ilya Averyanov
7de26a1776 feat(authz): use extensible map format for actions in authz rules 
* support authorization on retain, qos fields
* refactored authz tests heavily
 2023-07-07 19:40:34 +03:00
Ilya Averyanov
9bb159cf1e fix(rebalance): fix changelog and version 2023-07-07 18:04:11 +03:00
firest
d01eee7fe4 chore: update changes && app version 2023-07-07 18:22:54 +08:00
JimMoen
1587f038a5
feat: hstreamdb bridge with batch query 2023-07-07 12:25:36 +08:00
firest
afe6989625 chore: update changes 2023-07-07 11:04:18 +08:00
Thales Macedo Garitezi
353cc065db
Merge pull request #11175 from thalesmg/fix-mysql-start-error 
fix(mysql_bridge): make nxdomain a 400 API error
 2023-07-06 08:26:12 -03:00
Kjell Winblad
33cb29efdb
Merge pull request #11169 from kjellwinblad/kjell/improved_sparkplugb/EMQX-10351 
feat: add Sparkplug encode and decode functions to the rule engine
 2023-07-04 07:24:06 +02:00
Kjell Winblad
b5e91422de fix: changelog file ending 2023-07-03 18:21:39 +02:00
Thales Macedo Garitezi
c216dfd96b fix(mysql_bridge): make nxdomain a 400 API error 
Fixes https://emqx.atlassian.net/browse/EMQX-10460
 2023-06-30 16:10:09 -03:00
Thales Macedo Garitezi
3c8f591cc4 fix(mongodb): hide topology.pool_size and fix it at 1 
Fixes https://emqx.atlassian.net/browse/EMQX-10408

From an old conversation with @kjellwinblad:

> There are 3 pool_sizes
> - The buffer workers pool size, just exposed here: https://github.com/emqx/emqx/pull/9742
> - The topology.pool_size, which controls the pool size for the poolboy_pool in Kjell's
  diagram (on mongodb's side).
> - The pool_size from emqx_connector_mongo:mongo_fields that controls the ecpool pool
  size (on EMQX's side).
> So we actually want to set topology.pool_size = 1 and hide it from users.
 2023-06-30 10:17:33 -03:00
Kjell Winblad
4d45de2939 docs: changelog entry for new sparkplug decode and encode functions 2023-06-30 10:28:23 +02:00
Kjell Winblad
515a7d0c80 docs: add changelog entries for MySQL refactoring 2023-06-27 17:23:04 +02:00
Kjell Winblad
0a95749f86 docs: add changelog entries for Redis refactoring 2023-06-27 10:24:44 +02:00
Paulo Zulato
f4f068faaa
Merge pull request #11079 from paulozulato/feat-kafka-headers 
feat(kafka): add support for kafka headers and ext headers
 2023-06-22 12:04:32 -03:00
Thales Macedo Garitezi
2f00cf7f84
Merge pull request #11107 from thalesmg/fix-mongo-health-check-reason-master 
fix(mongo): return health check failure reason
 2023-06-22 09:30:34 -03:00
Thales Macedo Garitezi
7ef03d9e1f
Merge pull request #11090 from thalesmg/gcp-pubsub-consumer 
feat(gcp_pubsub_consumer): implement GCP PubSub Consumer bridge
 2023-06-22 09:17:45 -03:00
Paulo Zulato
f47cc2a458 feat(kafka): add support for kafka headers and ext headers 
Fixes https://emqx.atlassian.net/browse/EMQX-9175
 2023-06-21 18:27:39 -03:00
Thales Macedo Garitezi
18f0510353 fix(mongo): return health check failure reason 
Fixes https://emqx.atlassian.net/browse/EMQX-10335
 2023-06-21 15:09:37 -03:00
Paulo Zulato
8430ec673c feat(kafka): check whether target topic exists 
Fixes https://emqx.atlassian.net/browse/EMQX-9026
 2023-06-21 15:00:35 -03:00
Thales Macedo Garitezi
b442910ff1 feat(gcp_pubsub_consumer): implement GCP PubSub Consumer bridge 
Fixes https://emqx.atlassian.net/browse/EMQX-10281
 2023-06-19 16:04:12 -03:00
zhongwencool
e42cc58694
Merge pull request #11050 from emqx/release-51 
chore: sync release-51 back to master
 2023-06-15 09:45:31 +08:00
Paulo Zulato
36d6350880
Merge pull request #11031 from paulozulato/fix-influx-wrong-username 
fix(influxdb): check authentication
 2023-06-14 14:41:50 -03:00
Paulo Zulato
a573b9b38c fix(influxdb): check authentication 
Checks authentication on bridge start and get status. Also, handle
authentication error when sending message.

Fixes https://emqx.atlassian.net/browse/EMQX-10213
 2023-06-14 11:27:39 -03:00
zhongwencool
f57ff802e4
Merge pull request #11038 from thalesmg/fix-pulsar-get-status-r51 
fix(pulsar_producer): do not return `disconnected` when checking status (r5.1)
 2023-06-14 08:32:25 +08:00
Thales Macedo Garitezi
25b0e31035 fix(kafka_producer): do not return disconnected when checking status (r5.1) 
Fixes https://emqx.atlassian.net/browse/EMQX-10279

Related: https://github.com/emqx/emqx/pull/11038

Since wolff client has its own replayq that lives outside the management of the buffer
workers, we must not return disconnected status for such bridge: otherwise, the resource
manager will eventually kill the producers and data may be lost.
 2023-06-13 13:54:57 -03:00
Thales Macedo Garitezi
b609792a90 fix(pulsar_producer): do not return disconnected when checking status (r5.1) 
Fixes https://emqx.atlassian.net/browse/EMQX-10278

Since Pulsar client has its own replayq that lives outside the management of the buffer
workers, we must not return disconnected status for such bridge: otherwise, the resource
manager will eventually kill the producers and data may be lost.
 2023-06-13 11:44:45 -03:00
firest
415424654b chore: update changes 2023-06-13 16:13:40 +08:00
Thales Macedo Garitezi
c11011d857
Merge pull request #11024 from thalesmg/pulsar-cosmetic-connecting-check-r51 
feat(pulsar): retry health check a bit before returning (r5.1)
 2023-06-12 13:00:54 -03:00
Thales Macedo Garitezi
741c1f091e fix(pulsar): update pulsar -> 0.8.3 
Fixes https://emqx.atlassian.net/browse/EMQX-10229

See https://github.com/emqx/pulsar-client-erl/pull/59

Fixes a case_clause error that could arise from race conditions.
 2023-06-12 10:29:40 -03:00
Thales Macedo Garitezi
db5d14d5bf feat(pulsar): retry health check a bit before returning (r5.1) 
Fixes https://emqx.atlassian.net/browse/EMQX-10228

This is a cosmetic fix for the Pulsar Producer bridge health check status.

Pulsar connection process is asynchronous, therefore, when a bridge of this type is
created or updated (which is the same as stopping and re-creating it), the immediate
status will be connecting because it’s indeed still connecting.  The bridge will connect
very soon afterwards (assuming there are no true network/config issue), but having to
refresh the UI to see the new status and/or seeing the resource alarm might annoy users.

This workaround adds a few retries to account for that effect to reduce the probability of
seeing the `connecting` state on such happy-paths.
 2023-06-12 10:26:07 -03:00
Zaiming (Stone) Shi
12b73ba1c0 Merge remote-tracking branch 'origin/master' into release-51 2023-06-12 10:35:47 +02:00
Zaiming (Stone) Shi
e8ccdb8d0f
Merge pull request #10998 from zmstone/0609-no-batch-for-mongodb 
fix(mongodb): hide batch_size for mongodb resource
 2023-06-11 21:26:12 +02:00
Zaiming (Stone) Shi
654a9dcab5
Merge pull request #11006 from zmstone/0610-fix-quic-default-certs-path 
fix(quic): environment variables as cert file prefix for quic listener
 2023-06-11 11:52:56 +02:00
Zaiming (Stone) Shi
ddef751527 fix(mongodb): hide batch_size for mongodb resource 
MongoDB connector currently does not support batching
so the batch_size option has no effect.
However we cannot remove the field, so we choose to hide it from
schema
 2023-06-11 11:08:58 +02:00
Zaiming (Stone) Shi
97850de524 Merge remote-tracking branch 'origin/release-51' into 0610-merge-release-51-to-master 2023-06-10 12:23:55 +02:00
Zaiming (Stone) Shi
9f135d1f2b fix(quic): environment variables as cert file prefix for quic listener 2023-06-10 12:23:20 +02:00
Serge Tupchii
48ac942807 feat(emqx_bridge_kafka): add tcp keepalive option 
Closes: EMQX-8725
 2023-06-09 22:10:17 +03:00
Paulo Zulato
720a84d48b fix(kafka): fix timeout field for some kafka fields 
Change type of fields 'Partition Count Refresh Interval' and 'Offset
Commit Interval' to avoid accepting values larger than allowed.

Fixes https://emqx.atlassian.net/browse/EMQX-10196
Fixes https://emqx.atlassian.net/browse/EMQX-10199
 2023-06-09 13:38:04 -03:00
Kjell Winblad
c6eb1af82c docs: add changelog entry 2023-06-09 16:17:13 +02:00
Kjell Winblad
b60dbbc792 docs: add change log entry for Kafka query mode parameter 2023-06-08 16:27:04 +02:00
Zaiming (Stone) Shi
c1cf2365c2 Merge remote-tracking branch 'origin/master' into release-51 2023-06-08 12:30:02 +02:00
JianBo He
0b95bc1c1b
Merge pull request #10907 from HJianBo/refactor-on-stop-simple 
feat: refactored some bridges to avoid leaking resources part.2
 2023-06-08 09:37:31 +08:00
Ilya Averyanov
54f7941329 fix(rebalancing): add changelog 
Co-authored-by: Thales Macedo Garitezi <thalesmg@gmail.com>
 2023-06-07 21:37:08 +03:00
Thales Macedo Garitezi
260fae296b feat(gcp_pubsub): generate jwt tokens on demand without workers (5.1) 
Fixes https://emqx.atlassian.net/browse/EMQX-9603

Rather than relying on a JWT worker to produce and refresh tokens, we
could just produce then on demand when pushing the messages to GCP
PubSub.  That can generate a bit of extra work (as multiple processes
might realize it’s time to refresh the JWT and do so), but that
shouldn’t be much.  In return, we avoid any possibility of not having
a fresh JWT when pushing messages.
 2023-06-06 13:19:24 -03:00
JimMoen
0f808345e6
Merge pull request #10924 from JimMoen/refactor_influxdb_on_stop 
feat: refactor influxdb connector to to avoid resources leaking
 2023-06-05 18:02:15 +08:00
lafirest
d51c658a30
Merge pull request #10908 from lafirest/feat/rocketmq_on_stop 
feat(rocketmq): refactored bridge to avoid leaking resources during crashes at creation
 2023-06-05 15:00:32 +08:00
JianBo He
dbc0cdce67 chore: dont allocate resource for simple connectiors 2023-06-05 10:59:00 +08:00
JimMoen
a174d5741b
feat: refactor influxdb connector to to avoid resources leaking 2023-06-04 02:21:49 +08:00
Thales Macedo Garitezi
2d7c1da901
Merge pull request #10913 from thalesmg/fix-plugin-proto-multicall-v50 
fix(plugins): use `emqx:running_nodes` for multicall operations
 2023-06-02 09:03:42 -03:00
Thales Macedo Garitezi
64258120d7 fix(plugins): use emqx:running_nodes for multicall operations 
Fixes https://emqx.atlassian.net/browse/EMQX-10079
 2023-06-01 14:00:43 -03:00
firest
62d7b55092 chore: update changes 2023-06-01 18:49:50 +08:00
Paulo Zulato
3a6ad3b049 fix(oracle): require either sid or service name 
Fixes https://emqx.atlassian.net/browse/EMQX-9980
 2023-05-31 17:18:45 -03:00
Kjell Winblad
036f180c27
Merge pull request #10878 from kjellwinblad/kjell/bridge/rabbitmq_password_log_leak/EMQX-9976 
fix: password log leak in RabbitMQ bridge
 2023-05-31 16:17:19 +02:00
firest
a725ff0440 chore: bump version && update changes 2023-05-31 10:18:00 +08:00
Thales Macedo Garitezi
9c3f838e14
Merge pull request #10841 from thalesmg/kafka-validate-key-v50 
feat({kafka,pulsar}_producer): add validation for empty message key when strategy = key_dispatch
 2023-05-30 09:37:15 -03:00
Kjell Winblad
b6c4bb311f docs: add change log entry for RabbitMQ password log leak fix 2023-05-30 14:36:16 +02:00
Thales Macedo Garitezi
67e182e0c9
Merge pull request #10813 from thalesmg/refactor-kafka-on-stop-v50 
feat(kafka): ensure allocated resources are removed on failures
 2023-05-29 16:49:29 -03:00
Thales Macedo Garitezi
3edbad9f56 feat(pulsar_producer): add validation for empty message key when strategy = key_dispatch 2023-05-29 10:04:19 -03:00
Thales Macedo Garitezi
9b7e473cf6 feat(kafka_producer): add validation for empty message key when strategy = key_dispatch 
Fixes https://emqx.atlassian.net/browse/EMQX-9979
 2023-05-26 12:02:58 -03:00
Zaiming (Stone) Shi
cc5b4d3748 Merge remote-tracking branch 'origin/release-50' into 0526-ci-delete-otp-24-from-standalone-app-test 2023-05-26 15:58:16 +02:00
Thales Macedo Garitezi
5df7314255 feat(kafka): ensure allocated resources are removed on failures 2023-05-25 16:38:09 -03:00
Thales Macedo Garitezi
297b8b380d docs: improve changelog 2023-05-24 16:25:22 -03:00
Zaiming (Stone) Shi
a0d4120f8c
Merge pull request #10807 from zmstone/0524-delete-license-installer 
0524 delete license installer
 2023-05-24 21:01:51 +02:00
Paulo Zulato
50ff6c4aa4
Merge pull request #10741 from paulozulato/fix-oracle-passwd-leaking 
fix(oracle): hide password on stacktrace
 2023-05-24 15:31:00 -03:00
Thales Macedo Garitezi
fd2940cd77 feat(pulsar): ensure allocated resources are removed on failures (v5.0) 
Fixes https://emqx.atlassian.net/browse/EMQX-9937
 2023-05-24 12:29:00 -03:00
Zaiming (Stone) Shi
ae2398defe docs: add changelogs 2023-05-24 15:00:53 +02:00
Zaiming (Stone) Shi
732a7be187 Merge remote-tracking branch 'origin/release-50' 2023-05-22 17:46:54 +02:00
Andrew Mayorov
9aaa0b6fe1
Merge pull request #9927 from emqx/file-transfer 
feat: implement file transfer over mqtt
 2023-05-19 18:35:13 +03:00
firest
5a08a7b9de fix(tdengine): minor improvement of code and changes 2023-05-19 11:14:31 +08:00
Paulo Zulato
f9a75cb2a9 fix(oracle): hide password on stacktrace 2023-05-18 16:00:02 -03:00
firest
f1a3e5965e chore: update apps version && changes 2023-05-18 17:34:28 +08:00
Kjell Winblad
bce43978a2 refactor: the clickhouse bridge to use the new bridge app structure 
Fixes:
https://emqx.atlassian.net/browse/EMQX-9538
 2023-05-17 10:12:43 +02:00
Ilya Averyanov
1a8cf0e392 Merge branch 'release-50' into file-transfer 
* release-50:
  fix(pulsar): use a binary duration as default `health_check_interval`
  docs: add changelog entry
  docs: clarify description of bridge username and password
  chore: bump to v5.0.25
  fix(limiter): adjust type for compatibility
  fix(limiter): fix that update node-level limiter config will not working
  chore: upgrade dashboard to v1.2.4-1 for ce
  chore: upgarde rulesql to 0.1.6 to fix invaid utf8 input
  chore: add changelog for 10659
  fix: crash when sysmon.os.mem_check_interval = disabled
  chore: bump influxdb version && update changes
  refactor(influxdb): move influxdb bridge into its own app
  chore: add listener default changelog
  fix: ocsp cache SUITE failed
  fix: ensure atom key for emqx_config:get
  fix: only fill cerf_file default in server side
  fix: authn init is empty
  fix: bad listeners default ssl_options
 2023-05-17 00:27:55 +03:00
lafirest
33d1872e8f
Merge pull request #10679 from lafirest/refactor/influxdb_dir 
refactor(influxdb): move influxdb bridge into its own app
 2023-05-12 14:31:29 +08:00
firest
7d46fe8390 chore: bump influxdb version && update changes 2023-05-12 11:48:56 +08:00
Zhongwen Deng
44212f6e06 chore: add listener default changelog 2023-05-12 11:18:15 +08:00
Ilya Averyanov
5b5d7ceac5 Merge branch 'release-50' into file-transfer 
* release-50:
  fix(limiter): fix an error when setting `max_conn_rate` in a listener
  chore: bump erlcloud dependencies vsns
  chore: rename dynamo template files
  refactor(dynamo): move dynamo bridge into its own app
  chore: update changes && bump app versions
  fix: issues with the RabbitMQ config
  refactor(pgsql): move pgsql && matrix && timescale bridges into their own app
  fix: the iotdb password field so it has the password format
  chore: update changes
  refactor(tdengine): move tdengine bridge into its own app
  feat: deprecate listeners's authn http api
 2023-05-11 16:15:38 +05:00
firest
f6a2f752ff chore: update changes && bump app versions 2023-05-10 17:23:26 +08:00