5d1608f34b
chore: minimize oss/platform diff
2024-06-24 15:30:03 +02:00
3ac4ddcbe3
fix(kafka): handle message_too_large
...
bump 'failed' counter
2024-06-17 17:27:25 +02:00
00dfdc22cf
chore: pin Kafka client wolff 0.10.5
2024-06-17 17:27:25 +02:00
9637b14543
fix: upgrade to brod 3.18.0 to fix unnecessary rebalance
2024-06-01 10:57:24 +02:00
a00d9f17b1
chore: upgrade kafka producer lib wolff to 1.10.4
...
wolff-1.10.4 handles message_too_large error code from Kafka.
It tries to split the too-large batch into single-call batches
(for EMQX, one call batch is always one message), and retry.
In case a single-call batch is too large, EMQX should increment
a failure counter.
2024-05-30 15:40:10 +02:00
9fe29bf5f7
chore: bump kafka bridge app vsn
2024-05-29 21:57:14 +02:00
331d44a78a
chore: improve Kafka producer health-check error logs
...
The Kafka producer lib wolff returns detailed error logs
about which host:port had issue, EMQX should log them to help
troubleshooting
2024-05-18 19:12:51 +02:00
72b0c63ed2
Merge pull request #13043 from kjellwinblad/kjell/kafka_incorrect_query_type/EMQX-12363
...
fix(kafka trace): do not include query type in trace entry
2024-05-16 10:08:16 +02:00
437a0c0d55
fix(rocketmq): fix a typo and a RocketMQ encoding error
2024-05-14 23:01:31 +08:00
121084b2ff
fix(kafka trace): do not include query type in trace entry
...
For Kafka that has its internal buffering the on_query_async callback is
used both for sync and async queries (for sync queries the caller waits
for a response directly after calling on_query_async). Therefore, before
this commit, the trace included incorrect query type information. This
has been fixed by removing the query type information from the trace.
This should be okay since the query type is not essential information
and can be derived from the configuration.
Fixes:
https://emqx.atlassian.net/browse/EMQX-12363
2024-05-14 12:24:30 +02:00
32c27f1711
feat: add stop after render and after render trace to kafka action
2024-04-25 11:51:46 +02:00
ca56e7e8d7
fix(kafka): headers are template fields
2024-04-18 13:04:36 +02:00
5c014f4c29
test: fix test cases
2024-04-17 20:34:33 +02:00
51c8173174
feat(bridge): add is_template flag to bridge config fields
2024-04-17 13:10:55 +02:00
dfd13b4ab5
test: fix dashboard schema json test cases
2024-04-11 15:12:01 +02:00
db9efb9317
chore: bump apps versions
2024-03-28 10:19:09 +01:00
f4446ec680
Merge remote-tracking branch 'upstream/release-56' into 0328-sync-release-56
2024-03-28 09:59:54 +01:00
94c6e5bb38
Merge pull request #12727 from kjellwinblad/kjell/emqx_connector_info/EMQX-11427
...
refactor: add emqx_connector_info behavior
2024-03-25 14:31:40 +01:00
bc5775a988
fix(kafka_producer): handle ancient v1 config when migrating to actions
...
Fixes https://emqx.atlassian.net/browse/EMQX-12064
2024-03-22 09:45:27 -03:00
2b684c7bcc
fix(emqx_connector_info): refactoring based on thalesmg's comments
2024-03-22 09:29:26 +01:00
4bfc51c052
refactor(emqx_connector_info): improve documentation and type specs
2024-03-21 16:08:31 +01:00
e837791f94
fix(kafka-based bridges): avoid trying to get raw config for replayq dir
...
Fixes https://emqx.atlassian.net/browse/EMQX-12049
2024-03-21 11:49:00 -03:00
a3e631cda2
refactor(kafka connectors): to use emqx_connector_info
...
This commit refactors the `emqx_bridge_kafka` to use the
`emqx_connector_info` behavior. The `emqx_bridge_kafka` related
information can thus be removed from `emqx_connector_chema` and
`emqx_connector_resource`.
2024-03-19 14:41:23 +01:00
a852695950
fix(kafka_consumer): validate topic mapping in v2 schema
...
Fixes https://emqx.atlassian.net/browse/EMQX-12008
2024-03-13 09:57:46 -03:00
963e0de0c3
fix(kafka_consumer): check client connectivity
...
Fixes https://emqx.atlassian.net/browse/EMQX-11945
2024-03-07 14:22:03 -03:00
5d94a910b9
test: reduce flakiness
2024-02-29 13:59:43 -03:00
16b3dc1166
refactor: use individual keys for subscriber id resources
2024-02-29 10:39:37 -03:00
0aa9a872a3
feat: check `brod_sup` for client id
2024-02-29 09:53:23 -03:00
6b9844ae82
feat: migrate kafka consumer bridge to source + connector
...
Fixes https://emqx.atlassian.net/browse/EMQX-11848
2024-02-27 17:52:33 -03:00
f2619ce17a
Merge pull request #12571 from zhongwencool/delete-repeat-ci-test
...
test(bridge_v1): delete repeat probe_bridge_api code
2024-02-23 17:17:39 +08:00
46877e979b
chore: update copyright-year
2024-02-23 08:21:06 +01:00
d7faab4195
test(bridge_v1): delete repeat probe_bridge_api code
2024-02-23 14:43:42 +08:00
333eb34300
test: call emqx_resource:remove_local
2024-02-21 10:53:22 +01:00
d469f4158e
chore: bump app vsns
2024-02-20 16:53:57 -03:00
242df0ffe9
chore: upgrade kafka_protocol from 4.1.3 to 4.1.5
2024-02-16 10:33:53 +01:00
d4fb3e83f6
chore: upgrade to wolff 1.10.2
...
Wolff 1.10.2 added an enhancement which makes Kafka resource health
checks more lightweight and lowers the chance of false resource alerts.
2024-02-12 09:05:44 +01:00
80ff1b1657
Merge pull request #12434 from qzhuyan/fix/william/kafka-dont-stacktrace-when-no-partiion-count
...
kafka-bridge: dont stacktrace when no partition count
2024-02-01 15:09:45 +01:00
16444b7da9
fix(bridge-kafka): no stacktrace when fetch topic partition count fail
2024-02-01 14:09:15 +01:00
3b42a7425b
feat(kafka_producer): add partitions_limit
2024-01-31 19:26:01 +01:00
82403167c2
chore: update BSL license change date
2024-01-29 16:47:31 +01:00
e219c3eda1
Merge pull request #12166 from kjellwinblad/kjell/mqtt_conn_action_3/EMQX-11489
...
feat: refactor MQTT bridge to source, action, and connector
2024-01-18 09:28:14 -03:00
2a41cad54f
fix(sources): remote irrelevant `resource_opts` fields for sources
...
Since they don't use buffer workers, they shouldn't have buffer-related sub-fields.
2024-01-16 11:29:35 -03:00
cc24fe6e93
feat(mqtt_consumer): add support for rule engine `FROM`
2024-01-16 10:42:52 -03:00
ab66986f16
feat: add 'tags' field for action and connector
2024-01-16 13:57:48 +01:00
5e100f52b8
style: erlfmt all `rebar.config` files and `bin/nodetool`
2023-12-29 09:08:03 +08:00
23ded313ec
chore: update app versions
2023-12-22 15:29:22 +01:00
322b7bb7d2
chore: bump app vsn
2023-12-22 13:00:37 +01:00
cf9331a95f
Merge branch 'release-54' into sync-r54-m-20231218
2023-12-18 17:21:08 -03:00
7338e394c8
perf: upgrade to wolff 1.9.1 for better performance
...
Upgrade from 1.8.0:
- wollf-1.9.0 has the global stats disabled by default
- wolff-1.9.1 improved client pid lookup performance
2023-12-18 18:54:21 +01:00
432ddc5a3b
fix(bridge_v1_schema): undo changing v1 schema to avoid confusion
2023-12-15 12:55:34 -03:00
zmstone