Commit Graph

445 Commits

Author SHA1 Message Date
Shawn 88ca25c60c fix(resource): fast return when starting a unavailable resource 2022-06-01 08:24:53 +08:00
JianBo He efc0ca2b62
Merge branch 'master' into changes-enable_pipelining-type 2022-05-31 20:49:10 +08:00
Zhongwen Deng 9ec804ae03 feat: generate example.conf from schemas 2022-05-31 19:20:27 +08:00
Zhongwen Deng 8aa60cc0a5 feat: generate a minimized emqx.conf 2022-05-31 19:20:27 +08:00
JianBo He ebf4ed0270 feat(connector-http): using pos_integer() instead of boolean() for enable_pipelining 2022-05-31 17:14:59 +08:00
Shawn d37a66e9b8 fix(test): update test cases for emqx_resource:health_check/1 2022-05-31 10:14:37 +08:00
Shawn 1054c364ad refactor(resource): improve health check and alarm it if resource down 2022-05-31 01:40:40 +08:00
Shawn a157539710 refactor(rule): rename http_bridge -> webhook 2022-05-25 18:56:12 +08:00
Shawn 71de9616d3 refactor(rule): rename outputs -> actions 2022-05-25 17:02:37 +08:00
Xinyu Liu 54a6505984
Merge pull request #7982 from terry-xiaoyu/bridge_mode_in_mqtt_connector
fix: add bridge_mode field to the mqtt connector
2022-05-19 08:56:42 +08:00
Shawn a9da88d73b fix(spell): please the spell checker 2022-05-19 08:55:47 +08:00
Shawn 7e21ef6435 fix: add bridge_mode field to the mqtt connector 2022-05-18 18:28:43 +08:00
Shawn d89d692d3e refactor: move some APIs to new module emqx_bridge_resource 2022-05-18 15:12:34 +08:00
Shawn c98fd04f8f fix: rename the rule metrics 2022-05-17 17:17:07 +08:00
Xinyu Liu 5e35e6bcb9
Merge pull request #7967 from emqx/fix_flaky_connector_tests
fix: change connector name to prevent race condition in tests
2022-05-16 21:04:46 +08:00
Chris 0c6a66e554 fix: change connector name to prevent race condition in tests 2022-05-16 12:22:57 +02:00
EMQ-YangM 561d8c3912 fix: load connector schema 2022-05-16 16:38:33 +08:00
Xinyu Liu 74bef22299
Merge pull request #7947 from emqx/fix_flaky_tests
fix: fix tests for connector so they do not fail
2022-05-16 09:35:00 +08:00
Zaiming (Stone) Shi 4013dd2f14 refactor: refine pmap implementation 2022-05-13 15:22:42 +02:00
Chris dbc361959c fix: fix tests for connector so they do not fail 2022-05-13 11:08:11 +02:00
DDDHuang 448f9b5c9f
Merge pull request #7940 from DDDHuang/mqtt_bridge_cs
fix: clean session when destroy mqtt bridge
2022-05-13 16:04:09 +08:00
DDDHuang 9744040795 fix: clean session when destroy mqtt bridge 2022-05-13 14:02:40 +08:00
EMQ-YangM 798a6dcfb9 fix: update comment 2022-05-13 13:55:17 +08:00
EMQ-YangM 637b81ec18 fix: mqtt connector disable bridge_mode 2022-05-13 13:08:04 +08:00
DDDHuang 8516b457f3 fix(SUTIE): connector api, bad rule name in SUITE 2022-05-12 17:33:19 +08:00
DDDHuang 2de69c97ba fix: ruleengine & connector & bridge api, better error message 2022-05-12 16:51:36 +08:00
Zhongwen Deng 703a8d3eff fix: clear cert crash when config is undefined 2022-05-10 15:47:16 +08:00
Chris Hicks 841acb7828
Merge pull request #7783 from emqx/EMQX-4199-introduce-a-new-emqx-resource-manager-module
feat: isolate resource manager processes
2022-05-09 18:33:01 +02:00
Chris ffd4e83ed7 test: add emqx_connector_SUITE to increase coverage 2022-05-09 14:12:21 +02:00
Chris 0b3e30e813 feat: isolate resource manager processes 2022-05-09 13:24:34 +02:00
Ilya Averyanov 4cff19985e
Merge pull request #7872 from savonarola/fix-mongo-conn-healthcheck
fix(mongodb): fix mongodb connection healthcheck
2022-05-06 11:47:26 +03:00
Ilya Averyanov 0dae3f43a9 fix(mongodb): fix mongodb connection healthcheck 2022-05-05 15:36:38 +03:00
Chris 6971a3109f fix: remove case clause where the error clause can never be reached 2022-05-05 14:26:04 +02:00
Shawn 5b5878f4a9 fix: don't drop input ssl options even if invalid 2022-05-05 14:53:42 +08:00
zhouzb afe526ba67
Merge pull request #7789 from tigercl/chore/authn-fields
chore: rename certificate in jwt and selector in mongodb, remove pool_size in jwks
2022-04-29 10:14:06 +08:00
DDDHuang 778973b2de
Merge pull request #7791 from DDDHuang/auto_failed_connector
fix: disconnected status in auto_reconnect = false
2022-04-29 09:30:16 +08:00
Xinyu Liu 8528d76371
Merge pull request #7815 from terry-xiaoyu/fix_bridge_ssl_dry_run_fail
fix: convert ssl certfiles for dry-run creating bridges
2022-04-28 22:41:50 +08:00
Shawn 4b7d9b7239 chore(erlfmt): make the erlfmt happy 2022-04-28 22:39:30 +08:00
Zaiming (Stone) Shi 33e9823317 style: reformat emqx_connector_mqtt_mod.erl 2022-04-28 15:07:07 +02:00
zhouzb 95e63fcadf fix: fix bad code 2022-04-28 16:51:36 +08:00
Shawn e18c2a6de2 fix: convert ssl certfiles for dry-run creating bridges 2022-04-28 16:17:55 +08:00
zhouzb bd0d0d9797
Merge branch 'master' into chore/authn-fields 2022-04-28 16:09:26 +08:00
DDDHuang 05cf8af14b fix: connector, remove bad include 2022-04-28 15:32:54 +08:00
DDDHuang 132b37813c refactor: code format emqx_connector emqx_resource 2022-04-28 15:32:47 +08:00
DDDHuang 2a2308bbf8 refactor: resource check & connector status 2022-04-28 15:32:35 +08:00
DDDHuang e3e7acbcde fix: remove match topic in mqtt bridge 2022-04-28 15:23:30 +08:00
Zaiming (Stone) Shi 02c3f87b31 style: reformat all remaining apps 2022-04-27 15:51:18 +02:00
Shawn 0635918d16 fix: define ssl SNI field as a non-empty-string 2022-04-27 14:17:22 +08:00
Shawn 318d0df419 fix: return value of post_config_update 2022-04-27 11:59:16 +08:00
Shawn 94e24c2621 refactor: move ssl file handling from resources to bridges 2022-04-27 11:59:15 +08:00
zhouzb fa9bd74595 chore: rename selector to filter and fix spellcheck 2022-04-27 11:29:18 +08:00
zhongwencool 4b763a3a12
Merge pull request #7742 from zhongwencool/schema-namespace
fix: add namespace to schema
2022-04-26 09:26:04 +08:00
JimMoen e9843aa225 fix(doc): html line break use `</br>` 2022-04-24 18:56:21 +08:00
Yang Miao 742e9eed43
Merge pull request #7743 from EMQ-YangM/work1
fix: avoid '/connectors' function pattern matching failures
2022-04-24 18:50:56 +08:00
EMQ-YangM 9311080f0b fix: avoid '/connectors' function pattern matching failures 2022-04-24 16:07:15 +08:00
Zhongwen Deng 7d9403d056 fix: add namespace to schema 2022-04-24 15:47:23 +08:00
Shawn 984a26945c docs: add i18n ids 2022-04-23 03:51:38 +08:00
Yang Miao 4a43a10296
Merge pull request #7701 from EMQ-YangM/improve_docs
fix: improve document quality
2022-04-22 16:52:09 +08:00
EMQ-YangM 28c8f661ab fix(emqx_connector_http): request field reply to previous value 2022-04-22 09:31:14 +08:00
DDDHuang 9088752afa fix: bad return in retry prepare 2022-04-22 00:20:13 +08:00
DDDHuang 4b7a5bbf53 fix: bad empty map 2022-04-21 21:26:35 +08:00
DDDHuang 7417e5070d fix: perpare sql when connector doing init; add prepare statement field; bad log path 2022-04-21 16:00:15 +08:00
DDDHuang 365ca67078 fix: auth mysql prepare query 2022-04-21 16:00:15 +08:00
DDDHuang 94795098c9 fix: bad function name & dialyzer 2022-04-21 16:00:15 +08:00
DDDHuang 039619ee23 feat: authz & authn mysql resource support prepare sql query 2022-04-21 16:00:15 +08:00
DDDHuang d2c4b862b6 fix: bad code & xref 2022-04-21 16:00:14 +08:00
DDDHuang 0faf1240f3 fix: mysql support prepare sql 2022-04-21 16:00:14 +08:00
EMQ-YangM cef16ac382 fix: improve document quality 2022-04-21 15:05:56 +08:00
Xinyu Liu f8d046b259
Merge pull request #7673 from terry-xiaoyu/mqtt_bridge_issues
fix: improve the error logs if update bridge failed
2022-04-20 18:37:48 +08:00
EMQ-YangM 216ebade6d feat(emqx_conf_schema): log config add i18n support 2022-04-20 17:04:30 +08:00
Shawn 3ce969fd79 refactor: always recreate resources no matter it is connected or not 2022-04-20 11:43:05 +08:00
EMQ-YangM 255e7dd210 fix: improve documentation description 2022-04-20 10:44:43 +08:00
Shawn 1b79b3f3c9 fix: improve the error logs if update bridge failed 2022-04-19 19:45:46 +08:00
JimMoen 88c98bb310 fix(authn): api required fields 2022-04-19 18:57:01 +08:00
EMQ-YangM 24aa2e5575 fix: remove extra quotes 2022-04-19 15:58:05 +08:00
EMQ-YangM 7fbabf5577 fix: connector docs 2022-04-19 10:43:53 +08:00
DDDHuang 92eaf403f1 fix: mongo connector bad schema 2022-04-16 16:37:10 +08:00
DDDHuang e22d01d25f fix: page & limit & pool_size pos_integer; some bad spelling 2022-04-16 16:37:10 +08:00
DDDHuang 2a0d7a2c13 fix: update MongoDB version 2022-04-07 09:52:22 +08:00
Zaiming (Stone) Shi 356fbf6ce1
Merge pull request #7519 from zmstone/0405-5.0-sync-ssl-lib-from-4.3
5.0 refactor: delete deprecated emqx_plugin_libs_ssl module
2022-04-05 22:57:56 +01:00
Zaiming (Stone) Shi ba51f03cb7 refactor: remove the deprecated save_files_return_opts 2022-04-05 17:38:33 +02:00
ieQu1 99b3f2f83e docs(schema): Document missing records and fields 2022-04-04 23:58:43 +02:00
Zaiming (Stone) Shi 6fd902ebc8 chore: update dependency app versions
lc: 0.2.1
emqtt: 1.5.0
2022-04-04 21:07:02 +02:00
Ilya Averyanov a6031d6695
Merge pull request #7464 from savonarola/emqx_topic_metrics_api-cov
chore(emqx_modules): add emqx_topic_metrics_api tests
2022-03-31 11:27:58 +03:00
Ilya Averyanov 0728b1e3f4 chore(emqx_modules): add emqx_topic_metrics_api tests 2022-03-30 21:18:27 +03:00
ieQu1 d23a88d0a9 docs(schema): Minor improvements to spelling and formatting. 2022-03-30 13:05:56 +02:00
ieQu1 edb91e2e4a docs(schema): Add descriptions for authZ and connector 2022-03-30 13:01:01 +02:00
ieQu1 80cd1350a5 docs(schema): Add documentation for connector records 2022-03-30 11:53:53 +02:00
JimMoen e0fbf08d7e chore: update eredis_cluster version to 0.7.1 2022-03-28 14:37:38 +08:00
Xinyu Liu 1fc2124ff9
Merge pull request #7414 from terry-xiaoyu/list_connectors_with_default_values
fix: list connectors with default values
2022-03-25 16:52:25 +08:00
Shawn 79222e694e fix: list connectors with default values 2022-03-25 15:15:27 +08:00
Chris Hicks e659748153
Merge pull request #7306 from mononym/EMQX-3917-add-test-cases-for-connectors-mongo-db
refactor: refactor mongo connector test suite
2022-03-23 14:01:26 +01:00
DDDHuang e517b41a4d fix(api): desc & remove useless api 2022-03-21 15:03:37 +08:00
DDDHuang 4d4348759d fix: generate connector & exhook & retainer api response code 2022-03-21 14:12:19 +08:00
DDDHuang 74e6fa5a94 fix: generate bridge api response code
fix: generate connector api response code SUITE

fix: generate exhook api response code
2022-03-21 14:12:19 +08:00
JimMoen ed021d125f fix(mongo): servers for mongo_sharded and mongo_rs 2022-03-18 17:58:27 +08:00
Zaiming (Stone) Shi 420ad32aa7 chore: update emqtt to 1.4.8 2022-03-15 12:11:44 +01:00
Chris e35796abb0 refactor: refactor mongo connector test suite 2022-03-14 16:21:16 +01:00
Shawn 92a9fe46ea fix(bridges): validate empty topics for mqtt bridge 2022-03-11 20:16:03 +08:00
Shawn f924b9389d fix(rule): add swagger schema for events from bridge sources 2022-03-11 14:13:14 +08:00
Shawn 3ca3470844 fix(rule_events): add descs for test columns 2022-03-10 22:49:29 +08:00
Shawn 247b14c95f fix(mqtt_bridge): refine the message format from a mqtt bridge source 2022-03-10 15:57:33 +08:00
Xinyu Liu 67e39150d0
Merge pull request #7251 from terry-xiaoyu/add_restart_bridge_api
feat(bridge): add APIs for restart/stop bridges on one node
2022-03-10 13:34:44 +08:00
Shawn 1d023b541f refactor(connnector): rename waiting_connect_complete -> wait_for_resource_ready
Rename the option to wait_for_resource_ready and defaults to 5s.
2022-03-10 10:46:57 +08:00
Shawn a38cac0233 refactor(connector): rename list/0 -> list_raw/0 2022-03-10 10:02:06 +08:00
Chris Hicks 7f31cd08a7
Merge pull request #7252 from mononym/mongodb-deadloop-fix
fix: update mongodb client to latest version with deadloop fix
2022-03-09 14:08:24 +01:00
Chris b383e68c94 fix: update mongodb client to latest version with deadloop fix 2022-03-09 11:59:37 +01:00
EMQ-YangM 583624fb8d fix(emqx_authn): fix test suite 2022-03-09 13:53:05 +08:00
EMQ-YangM ca7a43986a fix(emqx_connector): restart with default wait_connected 2022-03-08 14:09:39 +08:00
EMQ-YangM 62d3aecc09 fix(emqx_connector): add default Opts: '#{wait_connected => 1000}' 2022-03-08 14:09:39 +08:00
Xinyu Liu c5f92ef856
Merge branch 'master' into improve_rule_bridge_apis 2022-03-08 11:12:30 +08:00
Shawn 8a0565a53b chore(elvis): please the elvis 2022-03-08 11:11:29 +08:00
zhongwencool 2d9a086bbb
Merge pull request #7198 from zhongwencool/emqx-conf-ct-coverage
chore: add more test for emqx_config_handler
2022-03-08 10:04:02 +08:00
Shawn b20902ebfe fix: remove the Id field from response of GET, POST /connectors 2022-03-07 19:33:32 +08:00
Shawn 2897af9650 fix: update testcases for emqx_connector 2022-03-07 18:39:23 +08:00
Zhongwen Deng 6ff2db6180 fix: elvis warning 2022-03-04 15:10:10 +08:00
Zhongwen Deng 71d20d153b fix: replace deep_merge with merge. 2022-03-03 22:52:46 +08:00
Ilya Averyanov a0cd877669 chore(mongodb): do not use mongodb internal pool 2022-03-02 16:26:39 +03:00
Xinyu Liu 47a4fa5732
Merge pull request #7140 from EMQ-YangM/tmp_change_status
refactor(emqx_resource): change the status of emqx_resource to 'conne…
2022-02-28 11:13:47 +08:00
zhongwencool 13a0eff678
Merge pull request #7125 from zhongwencool/schema-json
feat: generate hot config's schema.json and remove nullable option.
2022-02-25 17:18:20 +08:00
EMQ-YangM e54f4b75da fix(emqx_connector): fix resource status 2022-02-25 16:47:32 +08:00
Zhongwen Deng 114db2d14e chore: fix ct failed 2022-02-25 00:01:39 +08:00
Zhongwen Deng db584f79d6 feat: upgrade hocon to 0.25.0 to replace nullable with required. 2022-02-24 22:39:03 +08:00
Chris Hicks 2b8bcfac5e
Merge pull request #7127 from mononym/EMQX3142-my-sql
refactor(emqx_connector): refactor mysql tests to use resource api
2022-02-24 14:08:21 +01:00
Chris Hicks f7d78d0600
Merge pull request #7003 from mononym/EMQX-3145-redis
feat: add basic redis tests and bring redis connector module in line …
2022-02-24 10:38:41 +01:00
Chris 7e20369253 refactor(emqx_connector): refactor mysql tests to use resource api 2022-02-24 09:56:53 +01:00
Chris d306baf92f feat: add basic redis tests 2022-02-23 15:25:11 +01:00
Chris 5c6e3fce6a refactor: update postgres connector tests to use resource apis 2022-02-23 14:37:51 +01:00
DDDHuang 98a11f3c15 fix(api): emqx_connector_api error code format 2022-02-22 17:14:35 +08:00
JimMoen ff68e2a20f fix(http): connector and authn/authz http `keep-alive` default 30s , max 1000 2022-02-21 16:35:15 +08:00
k32 5638bcb92b docs: Fix typos 2022-02-17 23:22:31 +01:00
JimMoen 0c108035a8 test(connector): connector require `ecpool` start 2022-02-15 12:45:50 +08:00
JimMoen 23c6a404b9 test(connector): avoid define macro duplicate 2022-02-15 10:42:08 +08:00
JimMoen 28735dc6d7 refactor(connector): parse servers for `rs` and `sharded` mongo_type 2022-02-15 10:41:26 +08:00
JimMoen ab7c2b72e3 refactor(connector): db connector provide default port 2022-02-15 00:51:48 +08:00
Chris Hicks 15d3e86089
Merge pull request #7002 from mononym/EMQX-3144-mongo-db
feat: add basic mongodb test suite
2022-02-14 14:57:22 +01:00
Chris Hicks b1fbc08e3e
Merge pull request #6976 from mononym/EMQX3142-my-sql
feat: Add mysql tests for connector
2022-02-14 14:22:15 +01:00
Chris 7962583ac8 feat: add basic mongodb test suite 2022-02-14 13:11:15 +01:00
Chris c635e7306d feat: Add mysql tests for connector 2022-02-14 10:31:04 +01:00
Ilya Averyanov 5f32d4cbd8 chore(mongo): reduce test flackyness 2022-02-11 15:52:35 +03:00
zhongwencool f5415589e9 chore(schema): use emqx_schema:qos() instead of union integer. 2022-02-11 10:09:59 +08:00
Chris Hicks ddbb78557a
Merge pull request #6958 from mononym/EMQX-3143-postgre-sql
feat: create tests for connector pgsql module and refactoring
2022-02-10 14:41:10 +01:00
Chris 14630568d6 feat: create tests for connector pgsql module and refactoring 2022-02-10 10:40:46 +01:00
Chris c2772fdd09 refactor: remove unused/old functions 2022-02-09 10:14:13 +01:00
Chris d0b0b05aa4 fix: decouple suite tests 2022-02-08 14:53:01 +01:00
zhongwencool 928555546d
Merge pull request #6869 from EMQ-YangM/fix_start_pool
fix(emqx_connector): when start_pool fails, return error and reason
2022-01-29 10:45:45 +08:00
k32 052bd9081d docs(schema): Fix typos in the schema files 2022-01-27 22:39:19 +01:00
Zaiming (Stone) Shi d6f7ffec3c
Merge pull request #6881 from zmstone/refactor-upgrade-hocon-0.23.0
refactor: upgrade to hocon 0.23.0
2022-01-27 15:48:23 +01:00
Kian-Meng Ang fc92e4c8bf docs: fix typos 2022-01-27 12:29:38 +01:00
Zaiming (Stone) Shi 252d7e85d9 refactor: call new hocon apis 2022-01-27 00:23:08 +01:00