Commit Graph

375 Commits

Author SHA1 Message Date
Shawn
3ce969fd79 refactor: always recreate resources no matter it is connected or not 2022-04-20 11:43:05 +08:00
EMQ-YangM
255e7dd210 fix: improve documentation description 2022-04-20 10:44:43 +08:00
Shawn
1b79b3f3c9 fix: improve the error logs if update bridge failed 2022-04-19 19:45:46 +08:00
JimMoen
88c98bb310 fix(authn): api required fields 2022-04-19 18:57:01 +08:00
EMQ-YangM
24aa2e5575 fix: remove extra quotes 2022-04-19 15:58:05 +08:00
EMQ-YangM
7fbabf5577 fix: connector docs 2022-04-19 10:43:53 +08:00
DDDHuang
92eaf403f1 fix: mongo connector bad schema 2022-04-16 16:37:10 +08:00
DDDHuang
e22d01d25f fix: page & limit & pool_size pos_integer; some bad spelling 2022-04-16 16:37:10 +08:00
DDDHuang
2a0d7a2c13 fix: update MongoDB version 2022-04-07 09:52:22 +08:00
Zaiming (Stone) Shi
356fbf6ce1
Merge pull request #7519 from zmstone/0405-5.0-sync-ssl-lib-from-4.3
5.0 refactor: delete deprecated emqx_plugin_libs_ssl module
2022-04-05 22:57:56 +01:00
Zaiming (Stone) Shi
ba51f03cb7 refactor: remove the deprecated save_files_return_opts 2022-04-05 17:38:33 +02:00
ieQu1
99b3f2f83e docs(schema): Document missing records and fields 2022-04-04 23:58:43 +02:00
Zaiming (Stone) Shi
6fd902ebc8 chore: update dependency app versions
lc: 0.2.1
emqtt: 1.5.0
2022-04-04 21:07:02 +02:00
Ilya Averyanov
a6031d6695
Merge pull request #7464 from savonarola/emqx_topic_metrics_api-cov
chore(emqx_modules): add emqx_topic_metrics_api tests
2022-03-31 11:27:58 +03:00
Ilya Averyanov
0728b1e3f4 chore(emqx_modules): add emqx_topic_metrics_api tests 2022-03-30 21:18:27 +03:00
ieQu1
d23a88d0a9 docs(schema): Minor improvements to spelling and formatting. 2022-03-30 13:05:56 +02:00
ieQu1
edb91e2e4a docs(schema): Add descriptions for authZ and connector 2022-03-30 13:01:01 +02:00
ieQu1
80cd1350a5 docs(schema): Add documentation for connector records 2022-03-30 11:53:53 +02:00
JimMoen
e0fbf08d7e chore: update eredis_cluster version to 0.7.1 2022-03-28 14:37:38 +08:00
Xinyu Liu
1fc2124ff9
Merge pull request #7414 from terry-xiaoyu/list_connectors_with_default_values
fix: list connectors with default values
2022-03-25 16:52:25 +08:00
Shawn
79222e694e fix: list connectors with default values 2022-03-25 15:15:27 +08:00
Chris Hicks
e659748153
Merge pull request #7306 from mononym/EMQX-3917-add-test-cases-for-connectors-mongo-db
refactor: refactor mongo connector test suite
2022-03-23 14:01:26 +01:00
DDDHuang
e517b41a4d fix(api): desc & remove useless api 2022-03-21 15:03:37 +08:00
DDDHuang
4d4348759d fix: generate connector & exhook & retainer api response code 2022-03-21 14:12:19 +08:00
DDDHuang
74e6fa5a94 fix: generate bridge api response code
fix: generate connector api response code SUITE

fix: generate exhook api response code
2022-03-21 14:12:19 +08:00
JimMoen
ed021d125f fix(mongo): servers for mongo_sharded and mongo_rs 2022-03-18 17:58:27 +08:00
Zaiming (Stone) Shi
420ad32aa7 chore: update emqtt to 1.4.8 2022-03-15 12:11:44 +01:00
Chris
e35796abb0 refactor: refactor mongo connector test suite 2022-03-14 16:21:16 +01:00
Shawn
92a9fe46ea fix(bridges): validate empty topics for mqtt bridge 2022-03-11 20:16:03 +08:00
Shawn
f924b9389d fix(rule): add swagger schema for events from bridge sources 2022-03-11 14:13:14 +08:00
Shawn
3ca3470844 fix(rule_events): add descs for test columns 2022-03-10 22:49:29 +08:00
Shawn
247b14c95f fix(mqtt_bridge): refine the message format from a mqtt bridge source 2022-03-10 15:57:33 +08:00
Xinyu Liu
67e39150d0
Merge pull request #7251 from terry-xiaoyu/add_restart_bridge_api
feat(bridge): add APIs for restart/stop bridges on one node
2022-03-10 13:34:44 +08:00
Shawn
1d023b541f refactor(connnector): rename waiting_connect_complete -> wait_for_resource_ready
Rename the option to wait_for_resource_ready and defaults to 5s.
2022-03-10 10:46:57 +08:00
Shawn
a38cac0233 refactor(connector): rename list/0 -> list_raw/0 2022-03-10 10:02:06 +08:00
Chris Hicks
7f31cd08a7
Merge pull request #7252 from mononym/mongodb-deadloop-fix
fix: update mongodb client to latest version with deadloop fix
2022-03-09 14:08:24 +01:00
Chris
b383e68c94 fix: update mongodb client to latest version with deadloop fix 2022-03-09 11:59:37 +01:00
EMQ-YangM
583624fb8d fix(emqx_authn): fix test suite 2022-03-09 13:53:05 +08:00
EMQ-YangM
ca7a43986a fix(emqx_connector): restart with default wait_connected 2022-03-08 14:09:39 +08:00
EMQ-YangM
62d3aecc09 fix(emqx_connector): add default Opts: '#{wait_connected => 1000}' 2022-03-08 14:09:39 +08:00
Xinyu Liu
c5f92ef856
Merge branch 'master' into improve_rule_bridge_apis 2022-03-08 11:12:30 +08:00
Shawn
8a0565a53b chore(elvis): please the elvis 2022-03-08 11:11:29 +08:00
zhongwencool
2d9a086bbb
Merge pull request #7198 from zhongwencool/emqx-conf-ct-coverage
chore: add more test for emqx_config_handler
2022-03-08 10:04:02 +08:00
Shawn
b20902ebfe fix: remove the Id field from response of GET, POST /connectors 2022-03-07 19:33:32 +08:00
Shawn
2897af9650 fix: update testcases for emqx_connector 2022-03-07 18:39:23 +08:00
Zhongwen Deng
6ff2db6180 fix: elvis warning 2022-03-04 15:10:10 +08:00
Zhongwen Deng
71d20d153b fix: replace deep_merge with merge. 2022-03-03 22:52:46 +08:00
Ilya Averyanov
a0cd877669 chore(mongodb): do not use mongodb internal pool 2022-03-02 16:26:39 +03:00
Xinyu Liu
47a4fa5732
Merge pull request #7140 from EMQ-YangM/tmp_change_status
refactor(emqx_resource): change the status of emqx_resource to 'conne…
2022-02-28 11:13:47 +08:00
zhongwencool
13a0eff678
Merge pull request #7125 from zhongwencool/schema-json
feat: generate hot config's schema.json and remove nullable option.
2022-02-25 17:18:20 +08:00
EMQ-YangM
e54f4b75da fix(emqx_connector): fix resource status 2022-02-25 16:47:32 +08:00
Zhongwen Deng
114db2d14e chore: fix ct failed 2022-02-25 00:01:39 +08:00
Zhongwen Deng
db584f79d6 feat: upgrade hocon to 0.25.0 to replace nullable with required. 2022-02-24 22:39:03 +08:00
Chris Hicks
2b8bcfac5e
Merge pull request #7127 from mononym/EMQX3142-my-sql
refactor(emqx_connector): refactor mysql tests to use resource api
2022-02-24 14:08:21 +01:00
Chris Hicks
f7d78d0600
Merge pull request #7003 from mononym/EMQX-3145-redis
feat: add basic redis tests and bring redis connector module in line …
2022-02-24 10:38:41 +01:00
Chris
7e20369253 refactor(emqx_connector): refactor mysql tests to use resource api 2022-02-24 09:56:53 +01:00
Chris
d306baf92f feat: add basic redis tests 2022-02-23 15:25:11 +01:00
Chris
5c6e3fce6a refactor: update postgres connector tests to use resource apis 2022-02-23 14:37:51 +01:00
DDDHuang
98a11f3c15 fix(api): emqx_connector_api error code format 2022-02-22 17:14:35 +08:00
JimMoen
ff68e2a20f fix(http): connector and authn/authz http keep-alive default 30s , max 1000 2022-02-21 16:35:15 +08:00
k32
5638bcb92b docs: Fix typos 2022-02-17 23:22:31 +01:00
JimMoen
0c108035a8 test(connector): connector require ecpool start 2022-02-15 12:45:50 +08:00
JimMoen
23c6a404b9 test(connector): avoid define macro duplicate 2022-02-15 10:42:08 +08:00
JimMoen
28735dc6d7 refactor(connector): parse servers for rs and sharded mongo_type 2022-02-15 10:41:26 +08:00
JimMoen
ab7c2b72e3 refactor(connector): db connector provide default port 2022-02-15 00:51:48 +08:00
Chris Hicks
15d3e86089
Merge pull request #7002 from mononym/EMQX-3144-mongo-db
feat: add basic mongodb test suite
2022-02-14 14:57:22 +01:00
Chris Hicks
b1fbc08e3e
Merge pull request #6976 from mononym/EMQX3142-my-sql
feat: Add mysql tests for connector
2022-02-14 14:22:15 +01:00
Chris
7962583ac8 feat: add basic mongodb test suite 2022-02-14 13:11:15 +01:00
Chris
c635e7306d feat: Add mysql tests for connector 2022-02-14 10:31:04 +01:00
Ilya Averyanov
5f32d4cbd8 chore(mongo): reduce test flackyness 2022-02-11 15:52:35 +03:00
zhongwencool
f5415589e9 chore(schema): use emqx_schema:qos() instead of union integer. 2022-02-11 10:09:59 +08:00
Chris Hicks
ddbb78557a
Merge pull request #6958 from mononym/EMQX-3143-postgre-sql
feat: create tests for connector pgsql module and refactoring
2022-02-10 14:41:10 +01:00
Chris
14630568d6 feat: create tests for connector pgsql module and refactoring 2022-02-10 10:40:46 +01:00
Chris
c2772fdd09 refactor: remove unused/old functions 2022-02-09 10:14:13 +01:00
Chris
d0b0b05aa4 fix: decouple suite tests 2022-02-08 14:53:01 +01:00
zhongwencool
928555546d
Merge pull request #6869 from EMQ-YangM/fix_start_pool
fix(emqx_connector): when start_pool fails, return error and reason
2022-01-29 10:45:45 +08:00
k32
052bd9081d docs(schema): Fix typos in the schema files 2022-01-27 22:39:19 +01:00
Zaiming (Stone) Shi
d6f7ffec3c
Merge pull request #6881 from zmstone/refactor-upgrade-hocon-0.23.0
refactor: upgrade to hocon 0.23.0
2022-01-27 15:48:23 +01:00
Kian-Meng Ang
fc92e4c8bf docs: fix typos 2022-01-27 12:29:38 +01:00
Zaiming (Stone) Shi
252d7e85d9 refactor: call new hocon apis 2022-01-27 00:23:08 +01:00
EMQ-YangM
e9f3fa7b6b fix(emqx_connector): when start_pool fails, return error and reason 2022-01-26 16:07:46 +08:00
Zaiming (Stone) Shi
2105d1f22b test: call ct helpers to load config 2022-01-25 11:50:18 +01:00
JianBo He
e1933261c8 chore: remove the pool_size maximum limit 2022-01-18 14:22:23 +08:00
Shawn
6572785907
Merge pull request #6712 from tigercl/fix/pgsql
fix: fix errors caused by concurrent parsing of sql
2022-01-14 13:37:47 +08:00
JimMoen
82e3565344 chore: major mode file variable for Emacs 2022-01-13 15:53:47 +08:00
zhouzb
e2676bcbd8 fix: fix dep of epgsql 2022-01-13 11:39:48 +08:00
zhouzb
452f6e766a fix: return error when parse failed 2022-01-13 11:15:08 +08:00
zhouzb
a4f2a9c51d fix: fix dependency of epgsql 2022-01-13 10:40:22 +08:00
zhouzb
559a23c50f chore: update tag of epgsql 2022-01-13 10:15:12 +08:00
Shawn
552ea7d2fc
Merge pull request #6696 from terry-xiaoyu/rule_metrics2
Improve rule metrics
2022-01-12 14:53:09 +08:00
zhouzb
2eb7346229 chore: update tag of epgsql 2022-01-12 13:49:26 +08:00
zhouzb
2791052135 fix: fix errors caused by concurrent parsing of sql 2022-01-11 09:39:56 +08:00
zhouzb
76695c9652 test: update epgsql branch to test 2022-01-10 15:00:08 +08:00
zhongwencool
6ea51692c3
Merge pull request #6672 from zhongwencool/return-ok-when-trace-not-found
fix: delete error log when file enoent.
2022-01-07 15:36:03 +08:00
zhongwencool
0ec111d4e0 fix(test): flaky emqx_connector_api_SUITE test case. 2022-01-07 14:45:47 +08:00
zhouzb
c33eb84cb6 fix(mongo): add r_mode and w_mode options 2022-01-07 09:52:15 +08:00
Shawn
72d55c8c0d fix(rules): improve the names of the metrics 2022-01-07 09:35:00 +08:00
Shawn
67a60e1153 refactor(rule): add more metrics for rule and bridges 2022-01-07 09:34:54 +08:00
zhongwencool
3bdfa183f3
Merge pull request #6666 from JimMoen/merge-5.0-beta.3-to-master
Merge 5.0 beta.3 to master
2022-01-06 18:20:30 +08:00
JimMoen
9a115b99a4 Merge remote-tracking branch 'emqx/release-5.0-beta.3' into merge-5.0-beta.3-to-master 2022-01-06 14:08:45 +08:00
Zaiming (Stone) Shi
63167cea70 chore: update copyright 2022-01-05 20:55:00 +01:00
zhongwencool
adca9e6f22
Merge pull request #6645 from zhongwencool/fix-authz-reboot-headers-atom
fix: make sure authz headers is binary.
2022-01-05 16:49:25 +08:00
tigercl
a7325fe4d0
Merge pull request #6613 from JimMoen/update-dashobard
update dashboard version, fix connector api
2022-01-05 15:30:30 +08:00
zhongwencool
303707d69d fix: make sure authz headers is binary. 2022-01-05 15:11:16 +08:00
Shawn
21bf07a01c fix(test): race conditions in connector_api_SUITE 2022-01-05 11:41:17 +08:00
DDDHuang
eabede04f3 fix(test): emqx_connector_api_SUITE add sleep 2022-01-05 09:28:49 +08:00
Zaiming (Stone) Shi
6c99b64e4c refactor(emqx_plugin_libs_pool): structured logging 2022-01-04 00:54:09 +01:00
Zaiming (Stone) Shi
2898fa76e1 Merge remote-tracking branch 'origin/release-5.0-beta.3' into merge-5.0-beta.3-to-master 2022-01-03 11:39:06 +01:00
Shawn
e95445728c fix(test): wait until the bridge ready 2022-01-02 23:59:56 +08:00
Shawn
808646c2a1 fix(bridge): prohibit deleting connectors that are in use 2022-01-01 22:10:13 +08:00
Ilya Averyanov
852033a955
Merge pull request #6525 from savonarola/authn-ssl-tests
chore(authn): test authn ssl settings
2022-01-01 13:41:37 +03:00
Shawn
925d46fe86 fix(connector): add testcase for binding egress mqtt bridge to rules 2022-01-01 04:12:20 +08:00
Shawn
9a7452e1c5 fix(connector): add testcase for binding ingress mqtt bridge to rules 2022-01-01 03:07:31 +08:00
Shawn
b74a9bfda1 fix(swagger): duplicate keys in swagger doc 2021-12-31 22:20:22 +08:00
Shawn
9ba454a63d fix(bridge): filter the topic of received msgs got from remote MQTT broker 2021-12-31 12:00:43 +08:00
Shawn
e2d899ad6e fix(bridge): HTTP reqeust crash if using GET an DELETE method 2021-12-31 00:03:03 +08:00
Shawn
9d733c2ec5 fix(resource): typos on restart a resource 2021-12-30 23:48:41 +08:00
Shawn
d11cf6ad64 fix(bridges): store connector name and bridge name to config files 2021-12-30 23:48:41 +08:00
Shawn
110ae62b24 fix(bridge): don't concat names into ids 2021-12-30 23:48:41 +08:00
Shawn
14089a572e fix(bridge): changes timeouts from 30s to 15s 2021-12-30 23:48:41 +08:00
Shawn
aefcd6275b fix(bridges): ingress MQTT bridges didn't increase counters on msg received 2021-12-30 23:48:41 +08:00
Shawn
c23436166b fix(bridge): HTTP connector should failed on non-200 status codes 2021-12-30 23:48:41 +08:00
Shawn
ea1aaa9806 fix(bridge): remove clientid config from MQTT bridges
Don't allow the user provide the clientid for connecting the remote broker.
We generate the clientid using the bridge id and node name.
2021-12-30 23:48:41 +08:00
zhongwencool
d16362af96
Merge pull request #6547 from zhongwencool/trace-formatter
feat(trace): replace logger_formatter by emqx_trace_formatter
2021-12-30 23:40:59 +08:00
zhongwencool
489fb7f806 fix(trace): copy binary:encode_hex/2 from binary.erl 2021-12-30 21:38:23 +08:00
Ilya Averyanov
c98e0efdad chore(mongodb): update client 2021-12-30 13:57:48 +03:00
JimMoen
39c29b2396 fix(connector): redis cluster servers field 2021-12-30 15:37:53 +08:00
zhongwencool
43141dffee
Merge branch 'release-5.0-beta.3' into trace-formatter 2021-12-29 22:37:59 +08:00
Ilya Averyanov
f230c20521 chore(authn): test HTTPS authn 2021-12-29 16:24:57 +03:00
Ilya Averyanov
a7ca6cb39f chore(authn): test MongoDB authn via ssl connection 2021-12-29 16:24:52 +03:00
zhongwencool
121d906992 chore(log): add SLOG/3 to add meta info 2021-12-29 14:48:48 +08:00
tigercl
d769401869
Merge pull request #6555 from tigercl/chore/new-epgsql
chore: support prepared query in postgresql connector
2021-12-29 13:37:29 +08:00
zhongwencool
4b6bba11eb feat(trace): struct log for trace 2021-12-29 00:26:54 +08:00
Shawn
07997ab865 fix(bridge): Bridges should send a JSON message if payload template not set 2021-12-28 14:18:14 +08:00
Shawn
4406589980 fix(bridge): time unit error for MQTT keepalive 2021-12-28 14:12:28 +08:00
zhouzb
1a22d5ca46 fix: fix undef function call 2021-12-28 11:21:41 +08:00
zhouzb
d26042703e chore: provide prepared_query and equery 2021-12-28 09:52:31 +08:00
zhouzb
fc89fb0f8a chore: using prepared query in postgresql connector 2021-12-28 09:16:00 +08:00
Ilya Averyanov
e2e2c98679 chore(authn): test Mysql authn via ssl connection 2021-12-27 11:16:31 +03:00
Ilya Averyanov
6de89d1207 chore(authn): test PostgreSQL authn via ssl connection 2021-12-27 11:16:31 +03:00
zhongwencool
668180388c feat(trace): replace logger_formatter by emqx_trace_formatter 2021-12-27 14:40:40 +08:00
Thales Macedo Garitezi
34d6dbca61
chore(mix): simplify build by using rebar3 for umbrella apps
By treating the apps in the umbrella as dependencies to be managed and
built by rebar3, we can simplify the maintenance of the release, at
the cost of increased build times: using Mix as before, it could track
changed files better than using rebar.  But the complexity and
possibility of discrepancies make it using rebar much more compelling.
2021-12-22 09:40:01 -03:00
Thales Macedo Garitezi
917575de5a
chore(mix): minimal elixir mix release build
This commit enables a minimal working build of EMQX release using
Mix.  However, to properly start the release, several configuration
steps are still missing.  A `mix_release.sh` script does a few hacks
to get the release built with Mix to start properly, by first assuming
that `make emqx` has been run prior to the release, ran once to
generate the `app.*.config` files, and then it copies that and some
other files to the expected places.

Also, `emqx_telemetry` hangs the start procedure because it thinks
it's in an official release and tries to make a request.  We disable
it temporarily via config just to get a working build for now.
2021-12-21 13:51:22 -03:00
Shawn
27de3139a4 fix(http_connect): don't check status on_start 2021-12-20 11:36:52 +08:00
Shawn
cfaad15364 fix(connector): update the connector config failed 2021-12-18 20:19:34 +08:00
Shawn
a44e18e869 fix(bridge): filter out some extra fields from the request body 2021-12-18 19:19:58 +08:00
Shawn
11e8e0db69 fix(bridge): stop http failed due to econnrefused 2021-12-18 15:33:25 +08:00
Shawn
20091f8d2a fix(connector): some desc for connector APIs 2021-12-18 09:52:15 +08:00
Shawn
673a545aa2 fix(dialyzer): bad type specs 2021-12-17 22:15:56 +08:00
Shawn
0699682f38 refactor(bridges): rename some config entries for MQTT bridge 2021-12-17 21:22:04 +08:00