Commit Graph

11890 Commits

Author SHA1 Message Date
Kjell Winblad
57270fb8fc feat: add support for counters and gauges to the Kafka Bridge
This commit adds support for counters and gauges to the Kafka Brige.
The Kafka bridge uses [Wolff](https://github.com/kafka4beam/wolff) for
the  Kafka connection. Wolff does its own batching and does not use the
batching functionality in `emqx_resource_worker` that is used by other
bridge types. Therefore, the counter events have to be generated by
Wolff. We have added
[telemetry](https://github.com/beam-telemetry/telemetry) events to Wolff
that we hook into to change counters and gauges for the Kafka bridge. The
counter called `matched` does not depend on specific functionality of
any bridge type so the updates of this counter is moved higher up in the
call chain then previously so that it also gets updated for Kafka
bridges.
2022-10-10 14:40:57 -03:00
Xinyu Liu
97da96823b
Merge pull request #9048 from emqx/release-e5.0-beta.4
chore: release e5.0.0-beta.4
2022-09-26 20:03:17 +08:00
Shawn
19e3f5919e chore: release e5.0.0-beta.4 2022-09-26 19:54:01 +08:00
Xinyu Liu
a6fb75d54c
Merge pull request #9041 from terry-xiaoyu/copy-of-dev/ee5.0
merge master into dev/ee.50
2022-09-26 19:43:48 +08:00
Shawn
dfe14be8b2 chore: bump app vsns 2022-09-26 18:23:28 +08:00
JimMoen
a522e957e4
Merge pull request #9034 from JimMoen/chore-bump-vsn-influxdb-cilent-erl
chroe: bump `influxdb-client-erl` version
2022-09-26 15:40:48 +08:00
Shawn
4135910b42 chore: merge master into dev/ee5.0 2022-09-26 09:52:33 +08:00
JimMoen
9fbd7b6e17 chore: bump influxdb-client-erl version 2022-09-26 09:42:32 +08:00
Zaiming (Stone) Shi
f6ac4c3a76
Merge pull request #8798 from zmstone/0815-feat-add-kafka-connector
feat: Add Kafka connector
2022-09-24 22:57:50 +02:00
Kjell Winblad
5ec4b0a6ca fix: fix entrypoint in docker compose for Kafka bridge test 2022-09-23 15:58:22 +02:00
Kjell Winblad
ac37c5d58a test: github actions debug printouts 2022-09-23 15:02:01 +02:00
Kjell Winblad
a3c88b40a0 test: changes to make Kafka container run in GitHub action 2022-09-23 14:33:41 +02:00
Kjell Winblad
8e514680d8 test: fix bad binary pattern 2022-09-23 13:54:11 +02:00
Xinyu Liu
83a3d836b0
Merge pull request #9035 from terry-xiaoyu/review_changes
fix(bridges): some issues found in code review
2022-09-23 18:49:58 +08:00
Shawn
d24441b204 fix(bridges): some issues found in code review 2022-09-23 18:32:39 +08:00
Zaiming (Stone) Shi
7b601bf970 chore: delete bad parse_bridge function clause 2022-09-23 11:53:02 +02:00
Kjell Winblad
c4f7d385b5 test: fix true not allowed as docker compose env var value 2022-09-23 11:47:12 +02:00
Xinyu Liu
b2d69b85dc
Merge pull request #9032 from JimMoen/merge-release-v5.0.8-into-master
Merge release v5.0.8 into master
2022-09-23 17:42:19 +08:00
JimMoen
2984397e73 chore: apps vsn bump 2022-09-23 17:09:15 +08:00
JimMoen
fc3fdfb994 fix(build): apply PR#8956 changes 2022-09-23 17:09:10 +08:00
Kjell Winblad
9f3e38aeb0 test: fix error in script detected by spellcheck script 2022-09-23 10:37:30 +02:00
Kjell Winblad
adc67b165b test: test cases for Kafka bridge REST API 2022-09-23 10:09:07 +02:00
JimMoen
85835256f1 Merge tag 'v5.0.8' into merge-release-v5.0.8-into-master 2022-09-23 16:06:44 +08:00
Zaiming (Stone) Shi
516d60c7da build: fix deps consistency check 2022-09-23 09:00:17 +02:00
Zaiming (Stone) Shi
ba34326010 ci(kafka): fix shellcheck errors 2022-09-23 08:58:51 +02:00
zhouzb
f424c411ff
Merge pull request #9030 from tigercl/chore/bump-dashboard-vsn
chore: update dashboard vsn
2022-09-23 14:07:40 +08:00
JimMoen
d914f465da
Merge pull request #9029 from JimMoen/chore-githook-and-ignore-files
chore: add git commit hook for git-blame-ignore-revs
and ignore redis log files
2022-09-23 13:58:26 +08:00
zhouzb
48bb116905 chore: update dashboard vsn 2022-09-23 13:50:12 +08:00
JimMoen
7aa99b26b9 chore: add git commit hook for git-blame-ignore-revs
ignore redis log files
2022-09-23 12:37:07 +08:00
lafirest
100b53d17c
Merge pull request #8986 from lafirest/fix/slow_subs_unit
fix(slow_subs): fix timestamp unit error and update config not work
2022-09-23 10:55:29 +08:00
firest
5ef1a978bd chore: bump slow subs version && update CHANGES 2022-09-22 17:59:11 +08:00
firest
89af9c4a5f fix(slow_subs): fix timestamp unit error and update config not work
1. The unit of `deliver_begin_at` is incorrectly used the `seconds`, the resulting is incorrect when `stats_type` is `internal` or `response`
2. The config update doesn't actually take effect, the `load` function always used the old config
2022-09-22 17:57:51 +08:00
Kjell Winblad
a71aa4ca9c
Merge pull request #8917 from kjellwinblad/kjell/rule_engine_jq_func_implementation_module_config
Add rule engine configuration option for changing the implementation of the jq function
2022-09-22 10:41:32 +02:00
Kjell Winblad
9ea0147a8c feat(rule engine jq function): config for changing implementation
This commit adds a rule engine configuration option for changing the
implementation module used for the rule engine function jq. The two
options are `jq_port` (uses Erlang port programs to interact with jq)
and `jq_nif` (uses an Erlang NIF library to interact with jq).

Thanks to @terry-xiaoyu (Xinyu Liu <506895667@qq.com>) for Chinese
translations
2022-09-22 09:02:30 +02:00
JimMoen
6d37fc8dcb
Merge pull request #9012 from JimMoen/rm-influxdb-udp
Hide influxdb udp bridge.
2022-09-22 10:33:05 +08:00
Xinyu Liu
4c0a04f8d5
Merge pull request #9021 from terry-xiaoyu/async_batch_resume_from_queue
refactor(resource): resume from queue/inflight-window with async-sending and batching
2022-09-22 09:34:10 +08:00
Shawn
b325633390 refactor(resource): resume from queue/inflight-window with async-sending and batching 2022-09-21 22:58:47 +08:00
JianBo He
c0850be71e
Merge pull request #9013 from HJianBo/fix-mqtt-bridge
chore: update emqtt to 1.7.0-rc.2
2022-09-21 17:31:43 +08:00
Ilya Averyanov
f54e3c1695
Merge pull request #8963 from savonarola/improve-interpolation
fix(auth): use empty strings for absent placeholder values
2022-09-20 17:34:36 +03:00
Ilya Averyanov
c11afc357e fix(auth): use empty strings for absent placeholder values 2022-09-20 15:20:55 +03:00
zhongwencool
8c718d891f
Merge pull request #9002 from zhongwencool/fix-listener-crash
fix: /listeners API crash when there are nodes still in initial conf
2022-09-20 15:25:03 +08:00
JianBo He
89711881f5 chore: update emqtt to 1.7.0-rc.2
To avoid the MQTT bridge blocked once the inflight window fulled
see: https://github.com/emqx/emqtt/pull/171
2022-09-20 15:02:27 +08:00
JimMoen
6788881642 fix: hide influxdb udp config 2022-09-20 14:46:59 +08:00
JimMoen
03495d8d36 fix: influxdb server string support scheme prefix 2022-09-20 14:46:59 +08:00
Zhongwen Deng
2551c51a8c fix: ct failed 2022-09-20 11:37:49 +08:00
ieQu1
ed23107561
Merge pull request #9006 from ieQu1/master
chore(ekka): Bump version to 0.13.5
2022-09-19 22:48:07 +02:00
Ivan Dyachkov
ff2a9897c8
Merge pull request #8999 from emqx/build-fix-cross-build-packages-workflow
build: extract macos packaging into reusable action
2022-09-19 21:45:07 +02:00
Ivan Dyachkov
fe80dccf9b build: extract macos packaging into reusable action 2022-09-19 19:25:27 +02:00
ieQu1
62957b298b chore(ekka): Bump version to 0.13.5 2022-09-19 18:21:32 +02:00
Thales Macedo Garitezi
0ca18af96d
Merge pull request #8990 from thalesmg/gpb-rebar3-mix
chore: use `:rebar3` as `:gpb`'s manager
2022-09-19 09:30:10 -03:00