2b66018d3b
fix: enable param is atom
2023-10-27 11:53:41 +02:00
abcae6b509
fix: refactor handling of operation(s) [ie 'start']
2023-10-27 11:53:41 +02:00
676572c65a
fix: use check_schema to simplify API implementation
2023-10-27 11:53:41 +02:00
2a1e135304
test: fix tests after emqx_authn changes
2023-10-27 11:53:41 +02:00
d46f8efe60
test: add emqx_bridge_v2_api_SUITE
2023-10-27 11:53:41 +02:00
cb3892038a
fix: typo
2023-10-27 11:53:41 +02:00
f49011ece4
fix: unused variable warning
2023-10-27 11:53:41 +02:00
2cd1c88f7f
fix: fixup after rebasing on release-23
2023-10-27 11:53:41 +02:00
d8a9778d7c
feat: add compatibilty layer function for checking if valid bridge_v1
2023-10-27 11:53:41 +02:00
e2b4fb3bda
fix: support 'start' operation
2023-10-27 11:53:41 +02:00
6568759a7e
fix: add bridge_v2_probe
2023-10-27 11:53:41 +02:00
7ad709560d
fix: bridge_not_found renamed
2023-10-27 11:53:41 +02:00
2249a2cb50
fix: remove unused function
2023-10-27 11:53:41 +02:00
38f5c7dcf4
feat: HTTP API for bridge_v2
2023-10-27 11:53:41 +02:00
a5a060473c
feat: restructure emqx_bridge_v2 for better readability
2023-10-27 11:53:41 +02:00
e13196c1ca
feat(bridge_v2): dry_run and specific test suite
2023-10-27 11:53:41 +02:00
04943ccbf0
refactor: better name of funtion
2023-10-27 11:53:41 +02:00
b0b518067a
fix: remove connector as well on Bridge V1 remove
...
For backwards compatibility we remove the connector for the Bridge V2
bridge when performing the remove operation but only if no other
channels depend on the connector.
2023-10-27 11:53:41 +02:00
828bbc57ac
feat: test case fixes and compatibility layer probe etc
...
* test case fixes for Bridge V1 suite
* Bug fixes
* local_topic
* Bridge V1 probe compatibility functionality
2023-10-27 11:53:41 +02:00
1c62b5bcf3
fix: use correct body_schema
2023-10-27 11:53:41 +02:00
291d54eef0
test: use no_link in init for mecks
2023-10-27 11:53:41 +02:00
671b5306cd
fix: cleanup start/stop/restart operations
2023-10-27 11:53:41 +02:00
1816b450f0
test: (re-)add inconsistent connector test
2023-10-27 11:53:41 +02:00
0ad156bfa9
test: make sure mocks are ready before init_mocks terminates
2023-10-27 11:53:41 +02:00
ee8e469086
test: port all remaining tests
2023-10-27 11:53:40 +02:00
58db34ac62
fix: apply suggestions from code review
...
Co-authored-by: Zaiming (Stone) Shi <zmstone@gmail.com>
2023-10-27 11:53:40 +02:00
a9a7f4ae3a
fix: set bpapi version to 1
2023-10-27 11:53:40 +02:00
cb8691438a
test: use mock instead of actual kafka service
2023-10-27 11:53:40 +02:00
7f3e23eed9
test: initial add of /connectors api suite
2023-10-27 11:53:40 +02:00
f3648c5232
fix: allow Type in resource-id and pass it on
2023-10-27 11:53:40 +02:00
8567ccafc1
fix: don't assume resource-id starts with "connector:"
2023-10-27 11:53:40 +02:00
4b4eb19b0b
fix: add schema desc for connector
2023-10-27 11:53:40 +02:00
c9b683fd78
fix: add missing function for non enterprise
2023-10-27 11:53:40 +02:00
229bc0ee34
fix: schema fixes for connector and kafka as connector
2023-10-27 11:53:40 +02:00
64faf32842
style: cleanup examples
2023-10-27 11:53:40 +02:00
7641c22455
fix: add missing parts
2023-10-27 11:53:40 +02:00
ed8aa46602
refactor: copy bridge api code over to emqx_connector
2023-10-27 11:53:40 +02:00
d05f2010b3
fix: fail remove connector with active channels
2023-10-27 11:53:40 +02:00
cc864f4821
feat: add update/3
2023-10-27 11:53:40 +02:00
9195838c17
test: add disable_enable tests
2023-10-27 11:53:40 +02:00
009b9c3d39
style: remove unused commented fn
2023-10-27 11:53:40 +02:00
c0df85ac09
feat: Bridge V2 compatiblilty layer progress and local topic
...
* Most Bridge V1 HTTP API calls are now compatible with Bridge V2
* Local topics works for Bridge V2 now
* A lot of work on trying to get the old Kafka producer test suite
to work after the refactorings
2023-10-27 11:53:40 +02:00
16d7f4d3e6
style: cleanup emqx_connector_resource
2023-10-27 11:53:40 +02:00
99904cab27
fix: don't break root for non enterprise
2023-10-27 11:53:40 +02:00
5374d35be3
feat: started to make bridge_v2 compatible with old style bridges
2023-10-27 11:53:40 +02:00
bc6e1da2fb
test: add suite for emqx_connector
2023-10-27 11:53:40 +02:00
8f109da62b
style: cleanup emqx_connector
2023-10-27 11:53:40 +02:00
f7984be946
feat: add connector schema scaffold and break out Kafka conector
...
This commit is the beginning of an effort to split bridges into a
connector part and a bridge part.
Several bridges should be able to share a connector pool defined by a
single connector. The connectors should be possible to enable and
disable similar to how one can disable and enable bridges. There should
also be an API for checking the status of a connector and for
add/edit/delete connectors similar to the current bridge API.
Issues:
https://emqx.atlassian.net/browse/EMQX-10805
2023-10-27 11:53:40 +02:00
97601171a5
Merge pull request #11818 from zmstone/1025-fix-flaky-test
...
test: fix a flaky test case emqx_crl_cache_SUITE:t_revoked
2023-10-25 20:46:31 +02:00
76a8b0efd4
test: fix a flaky test case emqx_crl_cache_SUITE:t_revoked
2023-10-25 16:08:31 +02:00
f52b4a9e32
fix: gen_rpc tcp client port align with server port
2023-10-25 12:11:35 +02:00
37dd44c3d7
Merge pull request #11813 from qzhuyan/fix/william/genrpc-ssl-port-align
...
Fix/william/genrpc ssl port align
2023-10-25 09:04:19 +02:00
6346e0d28a
fix(gen_rpc): ssl client port align with server port
2023-10-24 22:33:52 +02:00
abcb3166f6
fix: use binary string for raw default values
2023-10-24 14:46:01 +02:00
99fab8dc5d
chore: missing change log for duplicated apikey fixing
2023-10-24 09:44:39 +08:00
a9b42af8b3
Merge pull request #11796 from qzhuyan/fix/william/gen_rpc-driver
...
fix(gen_rpc): ensure client/server use same driver
2023-10-23 08:24:17 +02:00
e6576951ef
test: cleanup duplicated apikey with different name
2023-10-20 22:33:26 +08:00
d467289bb2
fix: avoid duplicated apikey from data import
2023-10-20 21:13:04 +08:00
dd5807b797
fix(gen_rpc): ensure client/server use same driver
...
Also bump to gen_rpc 3.2.1
2023-10-20 12:17:49 +02:00
90a0c093bf
Merge pull request #11750 from savonarola/1011-redact-auth-http-request
...
Do not trace authn http request bodies
2023-10-13 17:25:28 +03:00
51c57a5f0a
fix(cass): avoid using aggregates in healthcheck query
...
Otherwise, this query will produce warning message per each
healthcheck, telling the user:
```
WARN <...> - Aggregation query used without partition key
```
2023-10-13 16:50:19 +07:00
68f31a9da2
fix(authn): do not trace authn requests
2023-10-12 16:32:16 +03:00
6413afd0bc
fix(gcpdev): restore original shard in mnesia tab definition
...
Changing the shard is not backward compatible, and leads to a crash
when upgrading from 5.2.x.
2023-10-12 17:30:07 +07:00
d9859b6b49
Merge pull request #11749 from thalesmg/test-fix-flaky-http-suite-r53-20231011
...
test: attempt to fix flaky http bridge suite
2023-10-11 16:07:17 +02:00
e6358ca18c
Merge pull request #11747 from qzhuyan/dev/william/quicer-0.0.202
...
bump to quicer 0.0.202
2023-10-11 15:43:47 +02:00
ab662f506d
test: attempt to fix flaky http bridge suite
...
```
=CRASH REPORT==== 10-Oct-2023::05:35:30.911371 ===
crasher:
initial call: ehttpc:init/1
pid: <0.23358.2>
registered_name: []
exception error: bad argument
in function persistent_term:get/1
called as persistent_term:get({emqx_bridge_http_SUITE,
do_t_async_retries,attempts})
*** argument 1: no persistent term stored with this key
in call from emqx_bridge_http_SUITE:'-do_t_async_retries/3-fun-2-'/0 (/__w/emqx/emqx/apps/emqx_bridge_http/test/emqx_bridge_http_SUITE.erl, line 697)
in call from emqx_bridge_http_SUITE:'-do_t_async_retries/3-fun-4-'/6 (/__w/emqx/emqx/apps/emqx_bridge_http/test/emqx_bridge_http_SUITE.erl, line 705)
```
2023-10-11 09:13:25 -03:00
57655854d1
Merge pull request #11743 from savonarola/1010-auth-leftovers
...
chore(auth): cleanup code
2023-10-11 15:09:07 +03:00
a69c53455f
fix: bump to quicer 0.0.202
...
bring in urgent fixs from msquic 2.2.3
2023-10-11 13:12:32 +02:00
03ae5bf3c8
chore(auth): cleanup code
2023-10-11 13:13:50 +03:00
a2e86c67db
Merge pull request #11733 from keynslug/fix/EMQX-10827/sesson-takeover
...
fix(cm): bring back pre-v5.3.0 compat in `takeover_session_begin/1`
2023-10-10 19:03:29 +02:00
ee45145fb5
Merge pull request #11724 from thalesmg/fix-kprodu-sync-metrics-m-20231006
...
fix({kafka,pulsar}_producer): correctly handle metrics for connectors that have internal buffers
2023-10-10 12:13:33 -03:00
bfb2218392
chore: fix release version
2023-10-10 14:50:49 +02:00
cf2075d7d8
chore: remove mention of `is_buffer_supported` from typespec
2023-10-10 09:49:18 -03:00
143673b703
chore: bump release version to 5.3.1-alpha.1
2023-10-10 14:35:46 +02:00
0a9e1dfa88
Merge pull request #11734 from zmstone/1002-support-ipv6-only-clustering
...
Make IPv6 clustering options configurable
2023-10-10 14:29:52 +02:00
9b573834f9
Merge pull request #11736 from keynslug/fix/eval-erl-audit
...
fix(audit): handle abstract forms when logging `eval_erl`
2023-10-10 15:49:19 +07:00
e7e696cd66
feat(rpc): add ipv6_only config
2023-10-10 10:05:14 +02:00
e07937a3ef
fix(ldap): escape the escape character (\)
2023-10-10 13:49:36 +08:00
2a291dfd27
fix(audit): handle abstract forms when logging `eval_erl`
2023-10-10 12:31:19 +07:00
522302fee1
fix(cm): bring back pre-v5.3.0 compat in `takeover_session_begin/1`
...
Which was accidentally broken in bf164175
2023-10-10 01:34:10 +07:00
1e93d2f1fc
chore: upgrade to ekka 0.15.16 gen_rpc 3.2.0
...
* ekka 0.15.16 supports 'inet6_tls' as ekka.proto_dist
* gen_rpc 3.2.0 supports true | false as gen_rpc.ipv6_only
2023-10-09 20:03:21 +02:00
497e08448d
feat(cluster): support ipv6 and tls on ipv6 for clustering
...
Made possible to configure inet6_tls for Erlang distribution
Also, added support to configure ipv6 listener for gen_rpc
2023-10-09 20:03:21 +02:00
03d8e06ff7
chore(emqx_rule_funcs): regroup export functions
2023-10-09 20:03:21 +02:00
d6781efee2
fix(resource): change how buffer workers are started
2023-10-09 15:02:25 -03:00
902b1d6ec5
fix(pulsar_producer): use `simple_async_internal_buffer` query mode for Pulsar
...
Since it has internal buffering, it necessitates the same fix as Kafka producer.
2023-10-09 15:02:25 -03:00
eebfb44f72
fix(resource): create `simple_async_internal_buffer` query mode for bridges with internal buffering
...
Since authn/authz backends also use simple async/sync queries, we may want to avoid them
calling the connector when it's not connected.
2023-10-09 15:02:25 -03:00
79cf0a2ced
fix(kafka_producer): correctly handle metrics for connector that have internal buffers
...
Fixes https://emqx.atlassian.net/browse/EMQX-11086
There’s currently a metric inconsistency due to the internal buffering nature of Kafka
Producer (wolff).
We use simple_sync_query to call the Kafka Producer bridge. If that times out, the call
is accounted as failed, even though the message is buffered in wolff and later sent
successfully.
2023-10-09 15:02:25 -03:00
c60915293a
Merge pull request #11634 from savonarola/0919-auth-refactor
...
Auth refactor
2023-10-09 19:51:26 +02:00
8f4cdc3fcf
Merge pull request #11732 from lafirest/test/sso_cli
...
test(ldap): add test suite for SSO CLI
2023-10-09 20:35:23 +08:00
9ab49a7ae3
Merge remote-tracking branch 'origin/master' into 0919-auth-refactor
2023-10-09 14:18:10 +02:00
2c7e5eb1cb
Merge pull request #11728 from lafirest/fix/ldap_filter
...
fix(ldap): improve the filter lex && parse
2023-10-09 18:24:57 +08:00
e3550fc07b
test(ldap): add test suite for SSO CLI
2023-10-09 16:05:56 +08:00
0c89b6b213
docs: swagger api tags should camel case
2023-10-09 15:21:51 +08:00
b2a6724dc2
fix(ldap): improve the filter lex && parse
...
1. auto escape special chars in the filter
2. fix a bug that the value can't be `dn`
2023-10-08 18:39:20 +08:00
482e82f914
fix: cli's args in audit log should be array
2023-10-07 17:38:02 +08:00
34186fcc74
fix(kafka_producer): send messages to wolff producer to buffer even when connector is in `connecting` state
...
Fixes https://emqx.atlassian.net/browse/EMQX-11085
Messages would not be sent to wolff if the connection was down, so they were effectively lost.
2023-10-06 11:43:29 -03:00
398a62031e
chore: update app versions
2023-10-05 13:41:50 +03:00
5dff36474d
chore(auth): get rid of hardcoded schema modules in auth
2023-10-05 13:41:50 +03:00
c2c56ba481
chore(auth): update tests
2023-10-05 13:41:50 +03:00
1eb75b43c4
chore(auth): split emqx_authn and emqx_authz apps
2023-10-05 13:41:50 +03:00
Stefan Strigler