8fde169abb
Merge pull request #9821 from thalesmg/buffer-worker-expiry-v50
...
feat(buffer_worker): add expiration time to requests
2023-01-24 13:54:04 +01:00
ca4a262b75
refactor: re-organize dealing with unrecoverable errors
2023-01-20 12:00:17 -03:00
16f45a60fd
chore: i18n typo fix
2023-01-20 11:50:01 +08:00
d755b43c77
fix(jwt_worker): handle exceptions when decoding jwk from pem
...
Returns a more controlled error if users attempt to use the Service
Account JSON from the GCP PubSub example from swagger, which is
redacted.
2023-01-19 09:24:45 -03:00
7abba17b25
Merge pull request #9765 from zmstone/0115-add-password-converter
...
fix(schema): add password converter to ensure its binary() type
2023-01-18 15:09:05 +01:00
087b667263
fix(buffer_worker): allow signalling unrecoverable errors
2023-01-17 19:50:30 -03:00
006b4bda97
feat(buffer_worker): monitor async workers and cancel their inflight requests upon death
2023-01-17 16:48:48 -03:00
4a7e74f5d6
fix(schema): add password converter to ensure its binary() type
2023-01-17 11:12:17 +01:00
44f635300d
chore: update mysql-otp to 1.7.2
2023-01-17 13:36:26 +08:00
54cea3b3f2
chore: update epgsql to 4.7.0.1 with full OTP-25 compat
2023-01-16 15:35:51 +03:00
9a53410efb
fix: don't add empty list element to options proplist
2023-01-16 12:00:03 +01:00
edfcea7f43
fix: add log for timeout
2023-01-16 12:00:03 +01:00
376dab7cd8
Merge pull request #9743 from zmstone/0112-docs-fix-some-descriptions
...
0112 docs fix some descriptions
2023-01-16 09:56:56 +01:00
54ebc27d24
Merge pull request #9672 from JimMoen/0103-fix-mqtt-bridge
...
Fix the problem that the bridge is not available when the Payload template is empty in the MQTT bridge.
2023-01-16 09:57:20 +08:00
1690a6dcfc
Merge branch 'master' into dev/api-refactor
2023-01-13 15:34:13 +01:00
f15b29b1ef
chore: upgrade app version
2023-01-13 18:22:29 +08:00
59ac0b1424
fix(mqtt-bridge): transmit raw msg payload with empty template
2023-01-13 17:23:04 +08:00
c7ac55520d
docs: update pool_size doc
2023-01-13 07:46:23 +01:00
2a81fa1522
fix: remove redundant log message
2023-01-12 14:29:11 +01:00
04f46f5227
feat: make http connector report errors
2023-01-12 14:26:36 +01:00
77f043dedf
fix: don't require username and password
...
not enforced by schema so we shouldn't either
2023-01-12 14:26:36 +01:00
82e80e5610
fix: remove password from info logs
...
Information log messages for several connectors contained sensitive
password information. This commit fixes this by hiding the sensitive
information from the log messages.
Fixes: https://emqx.atlassian.net/browse/EMQX-8718
2023-01-12 09:28:01 +01:00
bae811e8b4
Merge pull request #9725 from terry-xiaoyu/remove_the_auto_reconnect_field
...
refactor: remove the auto_reconnect field
2023-01-12 11:11:00 +08:00
3e9c4f444f
refactor: remove the auto_reconnect field
2023-01-11 21:47:06 +08:00
fde8752452
Merge pull request #9710 from kjellwinblad/kjell/mongodb_upgrade_in_emqx_5_master_fix
...
chore: upgrade mongodb-erlang to v3.0.19
2023-01-11 12:41:11 +01:00
0f70786d13
Merge pull request #9705 from terry-xiaoyu/remove-default-value-of-webhook-body
...
fix: remove the default value of webhook body field
2023-01-10 18:23:50 +08:00
724015af47
fix: remove the default value of webhook body field
2023-01-10 09:45:25 +08:00
67f2159a27
Merge pull request #9653 from zmstone/0101-authz-schema-union-member-selection
...
0101 authz schema union member selection
2023-01-09 22:17:51 +01:00
0bd5bec982
chore: upgrade mongodb-erlang to v3.0.19
...
This upgrades mongodb-erlang from v3.0.18 to v3.0.19. This fixes a bug
that occurred when one issued a command specified as a map*. This fix
should not affect present EMQX as this functionality is currently not
used by EMQX. However, I think it is good to do the upgrade anyway in
case we will use the fixed functionality in the future. There is no need
to update the changelog.
* https://github.com/emqx/mongodb-erlang/pull/36
2023-01-09 18:14:11 +01:00
f1ebfe40a5
Merge pull request #9697 from lafirest/fix/ldap_i18n
...
chore: add i18n file for ldap connector
2023-01-09 22:54:09 +08:00
c3635f537a
ci: wait for redis in emqx_ee_bridge_redis_SUITE
2023-01-09 14:39:56 +01:00
0697c692ed
refactor: mongo_type and redis_type are not mandatory
...
the connector schemas are shared between authn, auth and bridges,
the difference is that authn and authz configs are unions like:
[
{mongo_type = rs,
...
}
{another backend config}
]
however the brdige types are maps like, for example:
mongodb_rs.$name {
mongo_type = rs
...
}
in which case, the mongo_type is not required.
in order to keep the schema static as much as possible,
this field is chanegd to 'required => false' with a default value.
However, for authn and authz, the union selector will still raise
exception if the there is no type provided.
2023-01-09 14:26:16 +01:00
e52f9d5920
refactor: use union member type selector for authz sources
2023-01-09 14:26:16 +01:00
ba8c304723
Merge pull request #9691 from kjellwinblad/kjell/mongodb_upgrade_in_emqx_5_master
...
feat: upgrade MongoDB library to support MongoDB 5.1+
2023-01-09 14:15:48 +01:00
0db31f30a1
Merge pull request #9675 from keynslug/chore/otp-25-compat-deps
...
chore: bump deps versions with full OTP-25 compat
2023-01-09 14:54:14 +04:00
3859878985
Merge pull request #9684 from zmstone/0105-do-not-use-testcase-skip
...
test: do not use tc_user_skip for test cases
2023-01-09 09:02:06 +01:00
1336a57b3b
chore: bump to emqx/eredis_cluster 0.7.5
...
* Full OTP-25 compat.
* Password censoring in status and crash reports.
* No more crashes on query timeout.
2023-01-08 13:13:31 +03:00
d2456f9fbe
chore: add i18n file for ldap connector
2023-01-06 17:28:06 +08:00
f7b50c56da
feat(bridges): integrate PostgreSQL into bridges
...
support both simple and batch query
2023-01-06 11:47:22 +08:00
7a4e7a6de9
test: wait for redis
2023-01-05 22:47:08 +01:00
5f12cdff6c
ci: should not skip tests in github actions
2023-01-05 22:47:08 +01:00
5266722e51
feat: upgrade MongoDB library to support MongoDB 5.1+
2023-01-05 16:40:45 +01:00
cf6996cbea
test(flaky): fix flaky jwt worker test
2023-01-05 11:19:43 -03:00
00b91d8a60
Merge pull request #9664 from thalesmg/fix-mongo-duration-field-descs-v50
...
docs(mongodb_connector): fix duration field descriptions
2023-01-04 10:03:38 -03:00
f767db4d8f
Merge pull request #9660 from olcai/refactor-ingress-bridge-counter
...
refactor(emqx_resource): ingress bridge counter
2023-01-04 10:43:07 +01:00
c3cfbae3c2
docs: improve descriptions
...
Thanks to @qzhuyan for the corrections
2023-01-03 11:38:09 -03:00
7bbdc20993
docs(mongodb_connector): fix duration field descriptions
...
https://emqx.atlassian.net/browse/EMQX-8642
Adds different descriptions for the different fields of type duration
for MongoDB.
Based off: https://www.mongodb.com/docs/manual/reference/connection-string/
2023-01-03 10:01:56 -03:00
b9d012e072
refactor(emqx_resource): ingress bridge counter
...
Unify code paths for resource metrics by removing
emqx_resource:inc_received/1 and adding
emqx_resource_metrics:received_inc/1 & friends.
2023-01-02 15:11:52 +01:00
bc37556963
fix(mysql): fix the problem of data loss and bad match when mysql is disconnected
2023-01-02 21:46:24 +08:00
dbc10c2eed
chore: update copyright year 2023
2023-01-02 09:22:27 +01:00
231d6da4dc
Merge pull request #9644 from id/fix-kafka-bridge-connectivity-detection
...
fix(kafka): detect connectivity in on_get_status
2022-12-30 21:54:56 +01:00
0ce1ca89b7
refactor: use string type for server and servers
2022-12-30 14:20:23 +01:00
f410201dc3
chore: fix flaky test case in emqx_connector_jwt_worker_SUITE
2022-12-30 11:45:13 +01:00
446a4c74d0
fix(gcp_pubsub): fix potential jwt accumulation and lack of refresh (v5.0)
...
https://emqx.atlassian.net/browse/EMQX-8653
Related:
- https://emqx.atlassian.net/browse/EEC-737
- https://emqx.atlassian.net/browse/EMQX-8652
Since the rule resource testing mechanism creates a new resource to
test the configuration, a new JWT associated with an unique temporary
resource was being created and left in the JWT table, leaking it.
Also, a wrong case clause when setting the new refresh timer for the
JWT worker was preventing it from refreshing from the 2nd refresh
onward.
2022-12-29 16:30:36 -03:00
81b226a801
Merge pull request #9608 from zmstone/1123-pin-hocon-0.33.0
...
1123 pin hocon 0.33.0
2022-12-26 19:22:21 +08:00
35dc75b7ed
feat(mqtt): add option to customize clientid prefix for egress bridges
...
https://emqx.atlassian.net/browse/EMQX-8445
Currently the bridge client’s client ID is prefixed with the resource
ID.
Sometimes it’s useful for users to have control of this prefix,
e.g. prefix based ACL rules in the target broker.
2022-12-23 09:50:26 -03:00
fa7433628c
fix(logs): set password field sensitive for connectors
2022-12-23 12:46:03 +01:00
6292d7ec68
refactor: remove dead code
2022-12-23 12:07:36 +01:00
13942f5c49
refactor: rename error return in mysql connector
2022-12-22 10:29:12 +01:00
7df24000a0
test: add more EE mysql bridge test cases
2022-12-22 10:27:38 +01:00
23ac426608
fix(emqx_connector): check for key among prepared statements on query
...
An infinite loop was triggered in the mysql connector when a query
used a prepared statement key that was not among the defined prepared
statements on start. We now check that the key is defined among the
prepared statements before recursing. It seems that this bug was never
triggered in any production code flow and simply found while writing
tests.
An error return spell fix is also included as well as a FIXME comment
regarding running mysql:prepare and not distinguishing between
transient failures and syntax errors. Syntax errors should not be
retried.
2022-12-22 10:27:38 +01:00
516147ad00
Merge pull request #9581 from zmstone/1219-fix-mqtt-bridge-config
...
1219 fix mqtt bridge config
2022-12-20 14:47:02 +01:00
da51433dc3
refactor: add default value for eggress remote 'qos' and 'retain'
...
otherwise when updating from dashboard, there is no way to set
'false' for 'retain' because it's a checkbox,
it's either 'true' or 'undefined'
2022-12-20 00:00:31 +01:00
29f394aa70
fix(shared): handle unsubscribe for sticky strategy
...
prior to this change, the message is dispatched to a shared subscriber
even after unsubscribed
2022-12-19 19:12:38 +01:00
ed2d5aa48a
fix: handle status in `format_status/1` callback
...
Which is expected argument type for this callback. Also try to
make sure that random maps won't pass through this callback unnoticed.
2022-12-16 13:45:06 +03:00
9e3da5b661
chore: bump app versions
2022-12-14 20:07:41 +01:00
42c58e2a91
Merge remote-tracking branch 'origin/release-50' into 1214-sync-master-upstreams
2022-12-14 15:29:13 +01:00
1cd91a24e9
feat(gcp_pubsub): implement GCP PubSub bridge (ee5.0)
2022-12-12 17:18:19 -03:00
34e9056779
refactor: fix typo in variable name
...
Might confuse people to think it's related to `replayq`.
2022-12-12 17:17:51 -03:00
40809b2ad0
Merge remote-tracking branch 'origin/dev/ee5.0' into release-50
2022-12-09 11:45:52 +01:00
6692b0c895
feat(bridge): add Redis bridge
2022-12-06 23:15:42 +03:00
1c2fc4b6c3
Merge remote-tracking branch 'origin/release-50' into 1206-chore-merge-ee50-to-release-50
2022-12-06 16:35:56 +01:00
485c4ddcab
Merge pull request #9393 from olcai/add-mysql-bridge-test
...
test: add basic mysql bridge test (ee5.0)
2022-12-02 09:43:22 +01:00
eb017ab034
test: add test case to cover mqtt bridge config upgrade
2022-12-01 16:50:10 +01:00
5461311edc
test: more EE mysql bridge tests
2022-12-01 10:27:51 +01:00
96bff1d32e
test: improve basic tests for EE mysql bridge
2022-12-01 10:27:51 +01:00
9a6901987f
feat: add mqtt bridge config upgrade converter
2022-11-30 21:01:59 +01:00
983e904858
fix(connector): fix ssl clear
2022-11-30 17:03:41 +01:00
81586a4c8d
chore: bump connector version
2022-11-30 23:14:54 +08:00
51ace31f30
fix(connector): fix previous incorrectly fixes
...
There was an error in the try_clear_certs2/3 clause that the argument isn't the ssl field but including it.
2022-11-30 22:14:44 +08:00
b398617614
chore: bump app versions
2022-11-28 21:12:43 +01:00
7ee53e5319
Merge tag 'v5.0.11' into dev/ee5.0
2022-11-28 21:02:21 +01:00
fc2793c300
fix: fix upside down function clause
2022-11-24 10:37:52 +08:00
67cef65fdb
refactor(emqx_connector_ssl): simplify implementation
2022-11-23 23:49:43 +01:00
6dc5078a96
fix: fix obsolete SSL files aren't deleted after the bridge configuration update
2022-11-23 23:49:43 +01:00
00c57de4c3
feat: do not drop MQTTv5 properties in rule/bridge
2022-11-22 20:09:59 +01:00
09455edae8
Merge tag 'v5.0.10' into dev/ee5.0
2022-11-16 16:20:30 +01:00
d0687c7aaa
fix(connector): keep connector name type as binary don't convert it to atom
...
After investigation, it was confirmed that there was no need to convert the connector name to atom
2022-11-01 15:36:31 +08:00
c157392452
docs: fix self-closing html tag, change </br> to <br/>
2022-10-27 13:57:18 +02:00
a314950be9
docs: fix zh punctuations
2022-10-26 16:19:38 +02:00
834910b6f6
chore: update app.src
2022-09-27 17:24:44 +08:00
39ad172377
chore: replace ip_port() wuth host_port() for all connectors
2022-09-27 15:19:42 +08:00
00e4b4da5a
fix(schema): support hostname.domain:port for mqtt bridge
2022-09-27 09:02:49 +02:00
dfe14be8b2
chore: bump app vsns
2022-09-26 18:23:28 +08:00
4135910b42
chore: merge master into dev/ee5.0
2022-09-26 09:52:33 +08:00
a660004fa4
fix(bridge): mqtt bridge client info `username` & `password`
...
for non configured `username` and `password`, default values `<<>>` should be
used. emqtt needs the values.
2022-09-16 15:09:51 +08:00
d5d3972ff5
chore: add test cases for MQTT Bridge reconnecting
2022-09-15 10:19:33 +08:00
4e211c12d3
fix(mqtt_bridge): return value of sending messages was discarded
2022-09-15 08:57:01 +08:00
1c03c236f5
fix(mqtt_bridge): handle send_to_remote in idle state
2022-09-14 15:19:30 +08:00
f018b8ab49
fix(bridge/authz/exhook): no need to drop invalid certs
2022-09-14 14:08:55 +08:00
b5bf5d3adb
fix: mqtt bridge payload default value
2022-09-13 18:58:01 +08:00
81ec4c4403
Merge pull request #8906 from zmstone/merge-master-to-ee50-a
...
Merge master to ee50
2022-09-07 11:19:41 +02:00
2b33ca6d49
fix: no error log print if insert bool values into mysql
2022-09-07 16:00:09 +08:00
befc4acced
Merge remote-tracking branch 'origin/master' into merge-master-to-ee50-a
2022-09-06 20:31:38 +02:00
f785da075b
ci: only start required docker for integration tests
2022-09-06 19:25:53 +02:00
23b6ff399d
Merge pull request #8844 from thalesmg/mongodb-bridge
...
feat: add mongodb bridge (e5.0)
2022-09-03 12:27:01 +08:00
7fed4faac3
Merge pull request #8859 from terry-xiaoyu/refactor_counters_for_resources
...
Some improvements and bug fixes to emqx_resources
2022-09-03 12:16:49 +08:00
d533e35df0
chore: update app vsn
2022-09-02 22:26:21 +08:00
26234d38b9
fix: mark the async msg 'queuing' not 'sent.inflight' on recoverable_error
2022-09-02 18:41:43 +08:00
16618131ad
fix(bridge): mqtt source/sink bridge use empty payload template
2022-09-02 14:44:38 +08:00
2693fc263d
fix(bridge): show file paths for SSL certs in dashboard for bridge
2022-09-02 14:12:03 +08:00
b45f3de8db
refactor(resource): rename metrics batched,queued -> batching,queuing
2022-09-02 12:41:14 +08:00
74659bb864
fix(bridge): rm mqtt bridge default `username` and `password`
2022-09-02 10:43:32 +08:00
275171d217
feat: handle lists of servers in mongo servers config
2022-09-01 14:47:14 -03:00
3d4afd65df
feat: add mongodb bridge (e5.0)
2022-09-01 14:47:14 -03:00
8a5a9ca2bf
Merge pull request #8854 from zmstone/0831-chore-merge-main-to-dev-ee50
...
0831 chore merge main to dev ee50
2022-09-01 11:35:23 +01:00
a5ac5b6f3a
Merge branch 'dev/ee5.0' into refactor-mqtt-bridge
2022-09-01 09:30:37 +08:00
5a3fb4a011
Merge remote-tracking branch 'origin/master' into dev/ee5.0
2022-08-31 17:11:15 +02:00
0ef0b68de4
refactor: change '{recoverable_error,Reason}' to '{error,{recoverable_error,Reason}}'
2022-08-31 18:25:00 +08:00
ca52b8eb29
fix: start connector-mqtt failed when username/password not provided
2022-08-31 09:18:10 +08:00
73e19d84ee
feat: use the new metrics to bridge APIs
2022-08-30 23:47:58 +08:00
65dfa63324
fix: update the counters for data bridges
2022-08-30 12:28:01 +08:00
262e68f7d2
fix: return error when receive HTTP code other than 2xx
2022-08-30 10:16:02 +08:00
b5ad5233a1
fix(mqtt-bridge): username and password defaults to undefined
2022-08-30 10:14:56 +08:00
a6eff81163
chore: update emqtt to 1.7.0-rc.1
2022-08-30 09:50:36 +08:00
0aa10702db
feat(bridge): support async mode resource options
2022-08-30 09:34:56 +08:00
ca7ad9cc15
chore: refactor mqtt connector
2022-08-30 09:34:56 +08:00
2eb078ff3b
chore: bump changed app versions
2022-08-26 14:32:28 +02:00
1625b8eaeb
fix(mysql_bridge): export the query_mode option to the APIs
2022-08-26 17:11:24 +08:00
4ac6f12252
refactor: configs and APIs for mysql bridge
2022-08-24 10:08:03 +08:00
45352206a3
fix(auth): remove emqx_connector from testcases of authz/authn
2022-08-22 20:20:45 +08:00
55c18c0b5f
fix(bridges): update the test cases for new config structure
2022-08-22 18:24:59 +08:00
aea8c77b49
refactor: new config structure for mqtt bridge
2022-08-22 18:24:59 +08:00
4ad04b646f
Merge pull request #8759 from lafirest/feat/mysql_batch_query
...
feat(bridge): add `on_batch_query` on emqx_connector_mysql
2022-08-22 17:22:39 +08:00
f0c2b53868
fix(bpapi): make bpapi static_checks happy
2022-08-22 10:51:44 +08:00
2648362c62
fix(bridge): password for bridge/db format as `password` for dashboard
2022-08-19 15:54:19 +08:00
06363e63d9
fix(influxdb): connector use a fallbacke `pool_size` for influxdb client
2022-08-19 15:54:19 +08:00
8d8afd1688
feat(bridge): add `on_batch_query` on emqx_connector_mysql
2022-08-19 13:16:22 +08:00
b8a7ab9ad3
fix(connector_psql): Wrap password in a fun
2022-08-17 14:31:12 +02:00
de3a325953
fix: revert the changes in connector mysql
2022-08-16 09:06:13 +08:00
2898966439
Merge branch 'dev/ee5.0' into resource_opts
2022-08-15 21:43:22 +08:00
19d85d485b
refactor(resource): add resource_opts level into config structure
2022-08-15 21:40:10 +08:00
b3162fe5ff
fix: conflicts between master and ee5.0
2022-08-14 22:24:09 +08:00
dc7953c3e1
chore: refine async query variable name
2022-08-12 17:28:56 +08:00
404e79b7d7
Merge pull request #8687 from lafirest/fix/bridge_mysql
...
fix(bridge): replace prepare_statement by sql_template
2022-08-12 10:12:34 +08:00
449239d0f4
fix: count all msg size of `event_message` for mqtt bridge
2022-08-12 01:29:56 +08:00
88388b0c54
feat: http connector support async sending
2022-08-11 21:44:22 +08:00
7581082fcb
fix(bridge): replace prepare_statement by sql_template
2022-08-11 13:22:16 +08:00
4994731d3e
chore: update emqx_connector app vsn
2022-08-10 09:50:12 +02:00
18614ad291
fix(connector): add back deleted fields as deprecated
...
max_retries and retry_interval were removed from 5.0.4 wihtout
backward compatibliity.
This commit adds the fields back as deprecated
2022-08-10 09:50:12 +02:00
35fe70b887
feat: support aysnc callback to connector modules
2022-08-10 00:34:35 +08:00
8f0954837b
fix: update test cases for emqx_connector
2022-08-10 00:34:35 +08:00
75adba0781
fix: increase resource metrics using the resource id
2022-08-10 00:34:35 +08:00
d3950b9534
fix(resource): make option 'queue_enabled' disabled by default
2022-08-10 00:34:35 +08:00
0377d3cf61
fix: update existing testcases for new emqx_resource
2022-08-10 00:34:35 +08:00
2fb42e4d37
refactor: create emqx_resource_worker_sup for resource workers
2022-08-10 00:34:35 +08:00
aa6077bdea
fix(bridge): remove emqx_ee_connector_mysql
2022-08-04 14:52:16 +08:00
01e9e8a0eb
feat: add ee influxdb connector & bridge
2022-08-01 10:27:35 +08:00
3fe76446bc
Merge branch 'master' into dev/ee5.0
2022-08-01 10:14:21 +08:00
a4992ef1b5
fix: hstreamdb connector conf & api
2022-07-28 16:47:30 +08:00
23eeb21b13
fix(webhook): the 'max_retries' opt means request retry times
2022-07-27 17:06:14 +08:00
53f9b59805
Merge pull request #8408 from zmstone/0704-docs-fix-enable_pipelining-docs
...
fix: enable_pipelining should not be allowed to be zero
2022-07-19 21:13:29 +01:00
f42c8ffcfa
test(connector): redis sentinel include name
2022-07-13 10:37:16 +08:00
59c301243c
fix(connector): redis sentinel field required
2022-07-13 10:37:16 +08:00
b55048f705
chore: update app versions
2022-07-08 16:29:07 +08:00
841f816e39
refactor: improve the health_check for webhook bridges
2022-07-08 09:17:23 +08:00
bb854a9667
fix: enable_pipelining should not be allowed to be zero
2022-07-04 12:18:01 +02:00
b18097375c
docs(emqx_connector): Remove mentions of cluster_singleton
...
Fixes: 8339
2022-07-04 11:33:01 +02:00
6685a3c5a8
fix: remove the 'headers' field from the rule events
2022-06-17 15:57:10 +08:00
c47d28cdc3
Merge pull request #8247 from terry-xiaoyu/mongo_auth_timeout
...
feat: add start_after_created option to resource:create/4
2022-06-17 07:51:52 +08:00
cc25f92273
feat: add start_after_created option to resource:create/4
2022-06-16 23:34:52 +08:00
3c7dd5d6c4
Merge pull request #8092 from qzhuyan/dev/william/bump-quicer
...
feat: new quicer 0.0.11
2022-06-16 11:48:31 +02:00
a911c27962
feat(quic): bump emqtt to 1.6.0 with quic 0.0.11
2022-06-16 10:38:46 +02:00
70c63779df
Merge pull request #8232 from HJianBo/mapping-ssl-true-to-required
...
chore(pgsql): mapping ssl option from 'true' to 'required'
2022-06-16 16:11:34 +08:00
8194427cb3
chore(pgsql): mapping ssl option from 'true' to 'required'
...
Once the pgsql client is configured with ssl, we should force ssl to be used to
avoid fallback to tcp connection.
2022-06-16 10:04:07 +08:00
fbfed35371
Merge pull request #8214 from zmstone/0613-best-effort-json-for-hocon-type-check-errors
...
refactor: best-effort json for hocon type check errors
2022-06-15 22:45:05 +08:00
738a551550
refactor: best-effort json for hocon validation errors
2022-06-15 15:01:15 +02:00
45e2605485
build: workaround for windows build
2022-06-15 14:39:29 +02:00
57e57205a0
Merge pull request #8207 from HJianBo/gw-fixes
...
Gateway restart won't make built-in-database data lost
2022-06-15 17:41:13 +08:00
78dd9fe247
fix(gw): compatible with the max_connection is string type
2022-06-15 13:48:15 +08:00
14a26fc876
fix(redis): make sentinel required
2022-06-15 13:48:15 +08:00
aea4180aa0
chore(connector): schema validator throw error messages directly
2022-06-14 16:20:10 +02:00
5b79fd55a2
Merge pull request #8176 from qzhuyan/dev/william/kill-quic
...
chore: don't build quic on MacOS
2022-06-13 14:34:39 +02:00
d49a75ae28
chore: don't build quic on MacOS
2022-06-13 13:09:20 +02:00
2065be569e
fix(emqx_cluster_rpc): fail fast on stale state
...
Due to:
* Cluster RPC MFA is not idempotent!
* There is a lack of rollback for callback's side-effects
For instance, when two nodes try to add a cluster-singleton
concurrently, one of them will have to wait for the table lock
then try to catch-up, then try to apply MFA.
The catch-up will have the singleton created, but the initiated
initiated multicall apply will fail causing the commit to rollback,
but not to 'undo' the singleton creation.
Later, the retries will fail indefinitely.
2022-06-12 20:18:48 +02:00
c7cc2e85b2
fix: add default&example for schema
2022-06-06 09:52:10 +08:00
88ca25c60c
fix(resource): fast return when starting a unavailable resource
2022-06-01 08:24:53 +08:00
efc0ca2b62
Merge branch 'master' into changes-enable_pipelining-type
2022-05-31 20:49:10 +08:00
9ec804ae03
feat: generate example.conf from schemas
2022-05-31 19:20:27 +08:00
8aa60cc0a5
feat: generate a minimized emqx.conf
2022-05-31 19:20:27 +08:00
ebf4ed0270
feat(connector-http): using pos_integer() instead of boolean() for enable_pipelining
2022-05-31 17:14:59 +08:00
d37a66e9b8
fix(test): update test cases for emqx_resource:health_check/1
2022-05-31 10:14:37 +08:00
1054c364ad
refactor(resource): improve health check and alarm it if resource down
2022-05-31 01:40:40 +08:00
a157539710
refactor(rule): rename http_bridge -> webhook
2022-05-25 18:56:12 +08:00
71de9616d3
refactor(rule): rename outputs -> actions
2022-05-25 17:02:37 +08:00
54a6505984
Merge pull request #7982 from terry-xiaoyu/bridge_mode_in_mqtt_connector
...
fix: add bridge_mode field to the mqtt connector
2022-05-19 08:56:42 +08:00
a9da88d73b
fix(spell): please the spell checker
2022-05-19 08:55:47 +08:00
7e21ef6435
fix: add bridge_mode field to the mqtt connector
2022-05-18 18:28:43 +08:00
d89d692d3e
refactor: move some APIs to new module emqx_bridge_resource
2022-05-18 15:12:34 +08:00
c98fd04f8f
fix: rename the rule metrics
2022-05-17 17:17:07 +08:00
5e35e6bcb9
Merge pull request #7967 from emqx/fix_flaky_connector_tests
...
fix: change connector name to prevent race condition in tests
2022-05-16 21:04:46 +08:00
0c6a66e554
fix: change connector name to prevent race condition in tests
2022-05-16 12:22:57 +02:00
561d8c3912
fix: load connector schema
2022-05-16 16:38:33 +08:00
74bef22299
Merge pull request #7947 from emqx/fix_flaky_tests
...
fix: fix tests for connector so they do not fail
2022-05-16 09:35:00 +08:00
4013dd2f14
refactor: refine pmap implementation
2022-05-13 15:22:42 +02:00
dbc361959c
fix: fix tests for connector so they do not fail
2022-05-13 11:08:11 +02:00
448f9b5c9f
Merge pull request #7940 from DDDHuang/mqtt_bridge_cs
...
fix: clean session when destroy mqtt bridge
2022-05-13 16:04:09 +08:00
9744040795
fix: clean session when destroy mqtt bridge
2022-05-13 14:02:40 +08:00
798a6dcfb9
fix: update comment
2022-05-13 13:55:17 +08:00
637b81ec18
fix: mqtt connector disable bridge_mode
2022-05-13 13:08:04 +08:00
8516b457f3
fix(SUTIE): connector api, bad rule name in SUITE
2022-05-12 17:33:19 +08:00
2de69c97ba
fix: ruleengine & connector & bridge api, better error message
2022-05-12 16:51:36 +08:00
703a8d3eff
fix: clear cert crash when config is undefined
2022-05-10 15:47:16 +08:00
841acb7828
Merge pull request #7783 from emqx/EMQX-4199-introduce-a-new-emqx-resource-manager-module
...
feat: isolate resource manager processes
2022-05-09 18:33:01 +02:00
ffd4e83ed7
test: add emqx_connector_SUITE to increase coverage
2022-05-09 14:12:21 +02:00
0b3e30e813
feat: isolate resource manager processes
2022-05-09 13:24:34 +02:00
4cff19985e
Merge pull request #7872 from savonarola/fix-mongo-conn-healthcheck
...
fix(mongodb): fix mongodb connection healthcheck
2022-05-06 11:47:26 +03:00
0dae3f43a9
fix(mongodb): fix mongodb connection healthcheck
2022-05-05 15:36:38 +03:00
6971a3109f
fix: remove case clause where the error clause can never be reached
2022-05-05 14:26:04 +02:00
5b5878f4a9
fix: don't drop input ssl options even if invalid
2022-05-05 14:53:42 +08:00
afe526ba67
Merge pull request #7789 from tigercl/chore/authn-fields
...
chore: rename certificate in jwt and selector in mongodb, remove pool_size in jwks
2022-04-29 10:14:06 +08:00
778973b2de
Merge pull request #7791 from DDDHuang/auto_failed_connector
...
fix: disconnected status in auto_reconnect = false
2022-04-29 09:30:16 +08:00
8528d76371
Merge pull request #7815 from terry-xiaoyu/fix_bridge_ssl_dry_run_fail
...
fix: convert ssl certfiles for dry-run creating bridges
2022-04-28 22:41:50 +08:00
4b7d9b7239
chore(erlfmt): make the erlfmt happy
2022-04-28 22:39:30 +08:00
33e9823317
style: reformat emqx_connector_mqtt_mod.erl
2022-04-28 15:07:07 +02:00
95e63fcadf
fix: fix bad code
2022-04-28 16:51:36 +08:00
e18c2a6de2
fix: convert ssl certfiles for dry-run creating bridges
2022-04-28 16:17:55 +08:00
bd0d0d9797
Merge branch 'master' into chore/authn-fields
2022-04-28 16:09:26 +08:00
05cf8af14b
fix: connector, remove bad include
2022-04-28 15:32:54 +08:00
132b37813c
refactor: code format emqx_connector emqx_resource
2022-04-28 15:32:47 +08:00
2a2308bbf8
refactor: resource check & connector status
2022-04-28 15:32:35 +08:00
e3e7acbcde
fix: remove match topic in mqtt bridge
2022-04-28 15:23:30 +08:00
02c3f87b31
style: reformat all remaining apps
2022-04-27 15:51:18 +02:00
0635918d16
fix: define ssl SNI field as a non-empty-string
2022-04-27 14:17:22 +08:00
318d0df419
fix: return value of post_config_update
2022-04-27 11:59:16 +08:00
94e24c2621
refactor: move ssl file handling from resources to bridges
2022-04-27 11:59:15 +08:00
fa9bd74595
chore: rename selector to filter and fix spellcheck
2022-04-27 11:29:18 +08:00
4b763a3a12
Merge pull request #7742 from zhongwencool/schema-namespace
...
fix: add namespace to schema
2022-04-26 09:26:04 +08:00
e9843aa225
fix(doc): html line break use `</br>`
2022-04-24 18:56:21 +08:00
742e9eed43
Merge pull request #7743 from EMQ-YangM/work1
...
fix: avoid '/connectors' function pattern matching failures
2022-04-24 18:50:56 +08:00
9311080f0b
fix: avoid '/connectors' function pattern matching failures
2022-04-24 16:07:15 +08:00
7d9403d056
fix: add namespace to schema
2022-04-24 15:47:23 +08:00
984a26945c
docs: add i18n ids
2022-04-23 03:51:38 +08:00
4a43a10296
Merge pull request #7701 from EMQ-YangM/improve_docs
...
fix: improve document quality
2022-04-22 16:52:09 +08:00
28c8f661ab
fix(emqx_connector_http): request field reply to previous value
2022-04-22 09:31:14 +08:00
9088752afa
fix: bad return in retry prepare
2022-04-22 00:20:13 +08:00
4b7a5bbf53
fix: bad empty map
2022-04-21 21:26:35 +08:00
7417e5070d
fix: perpare sql when connector doing init; add prepare statement field; bad log path
2022-04-21 16:00:15 +08:00
365ca67078
fix: auth mysql prepare query
2022-04-21 16:00:15 +08:00
94795098c9
fix: bad function name & dialyzer
2022-04-21 16:00:15 +08:00
039619ee23
feat: authz & authn mysql resource support prepare sql query
2022-04-21 16:00:15 +08:00
d2c4b862b6
fix: bad code & xref
2022-04-21 16:00:14 +08:00
0faf1240f3
fix: mysql support prepare sql
2022-04-21 16:00:14 +08:00
cef16ac382
fix: improve document quality
2022-04-21 15:05:56 +08:00
f8d046b259
Merge pull request #7673 from terry-xiaoyu/mqtt_bridge_issues
...
fix: improve the error logs if update bridge failed
2022-04-20 18:37:48 +08:00
216ebade6d
feat(emqx_conf_schema): log config add i18n support
2022-04-20 17:04:30 +08:00
3ce969fd79
refactor: always recreate resources no matter it is connected or not
2022-04-20 11:43:05 +08:00
255e7dd210
fix: improve documentation description
2022-04-20 10:44:43 +08:00
1b79b3f3c9
fix: improve the error logs if update bridge failed
2022-04-19 19:45:46 +08:00
88c98bb310
fix(authn): api required fields
2022-04-19 18:57:01 +08:00
24aa2e5575
fix: remove extra quotes
2022-04-19 15:58:05 +08:00
7fbabf5577
fix: connector docs
2022-04-19 10:43:53 +08:00
92eaf403f1
fix: mongo connector bad schema
2022-04-16 16:37:10 +08:00
e22d01d25f
fix: page & limit & pool_size pos_integer; some bad spelling
2022-04-16 16:37:10 +08:00
2a0d7a2c13
fix: update MongoDB version
2022-04-07 09:52:22 +08:00
356fbf6ce1
Merge pull request #7519 from zmstone/0405-5.0-sync-ssl-lib-from-4.3
...
5.0 refactor: delete deprecated emqx_plugin_libs_ssl module
2022-04-05 22:57:56 +01:00
ba51f03cb7
refactor: remove the deprecated save_files_return_opts
2022-04-05 17:38:33 +02:00
99b3f2f83e
docs(schema): Document missing records and fields
2022-04-04 23:58:43 +02:00
6fd902ebc8
chore: update dependency app versions
...
lc: 0.2.1
emqtt: 1.5.0
2022-04-04 21:07:02 +02:00
a6031d6695
Merge pull request #7464 from savonarola/emqx_topic_metrics_api-cov
...
chore(emqx_modules): add emqx_topic_metrics_api tests
2022-03-31 11:27:58 +03:00
0728b1e3f4
chore(emqx_modules): add emqx_topic_metrics_api tests
2022-03-30 21:18:27 +03:00
d23a88d0a9
docs(schema): Minor improvements to spelling and formatting.
2022-03-30 13:05:56 +02:00
edb91e2e4a
docs(schema): Add descriptions for authZ and connector
2022-03-30 13:01:01 +02:00
80cd1350a5
docs(schema): Add documentation for connector records
2022-03-30 11:53:53 +02:00
e0fbf08d7e
chore: update eredis_cluster version to 0.7.1
2022-03-28 14:37:38 +08:00
1fc2124ff9
Merge pull request #7414 from terry-xiaoyu/list_connectors_with_default_values
...
fix: list connectors with default values
2022-03-25 16:52:25 +08:00
79222e694e
fix: list connectors with default values
2022-03-25 15:15:27 +08:00
e659748153
Merge pull request #7306 from mononym/EMQX-3917-add-test-cases-for-connectors-mongo-db
...
refactor: refactor mongo connector test suite
2022-03-23 14:01:26 +01:00
e517b41a4d
fix(api): desc & remove useless api
2022-03-21 15:03:37 +08:00
4d4348759d
fix: generate connector & exhook & retainer api response code
2022-03-21 14:12:19 +08:00
74e6fa5a94
fix: generate bridge api response code
...
fix: generate connector api response code SUITE
fix: generate exhook api response code
2022-03-21 14:12:19 +08:00
ed021d125f
fix(mongo): servers for mongo_sharded and mongo_rs
2022-03-18 17:58:27 +08:00
420ad32aa7
chore: update emqtt to 1.4.8
2022-03-15 12:11:44 +01:00
e35796abb0
refactor: refactor mongo connector test suite
2022-03-14 16:21:16 +01:00
92a9fe46ea
fix(bridges): validate empty topics for mqtt bridge
2022-03-11 20:16:03 +08:00
f924b9389d
fix(rule): add swagger schema for events from bridge sources
2022-03-11 14:13:14 +08:00
3ca3470844
fix(rule_events): add descs for test columns
2022-03-10 22:49:29 +08:00
247b14c95f
fix(mqtt_bridge): refine the message format from a mqtt bridge source
2022-03-10 15:57:33 +08:00
67e39150d0
Merge pull request #7251 from terry-xiaoyu/add_restart_bridge_api
...
feat(bridge): add APIs for restart/stop bridges on one node
2022-03-10 13:34:44 +08:00
1d023b541f
refactor(connnector): rename waiting_connect_complete -> wait_for_resource_ready
...
Rename the option to wait_for_resource_ready and defaults to 5s.
2022-03-10 10:46:57 +08:00
a38cac0233
refactor(connector): rename list/0 -> list_raw/0
2022-03-10 10:02:06 +08:00
7f31cd08a7
Merge pull request #7252 from mononym/mongodb-deadloop-fix
...
fix: update mongodb client to latest version with deadloop fix
2022-03-09 14:08:24 +01:00
b383e68c94
fix: update mongodb client to latest version with deadloop fix
2022-03-09 11:59:37 +01:00
583624fb8d
fix(emqx_authn): fix test suite
2022-03-09 13:53:05 +08:00
ca7a43986a
fix(emqx_connector): restart with default wait_connected
2022-03-08 14:09:39 +08:00
62d3aecc09
fix(emqx_connector): add default Opts: '#{wait_connected => 1000}'
2022-03-08 14:09:39 +08:00
c5f92ef856
Merge branch 'master' into improve_rule_bridge_apis
2022-03-08 11:12:30 +08:00
8a0565a53b
chore(elvis): please the elvis
2022-03-08 11:11:29 +08:00
2d9a086bbb
Merge pull request #7198 from zhongwencool/emqx-conf-ct-coverage
...
chore: add more test for emqx_config_handler
2022-03-08 10:04:02 +08:00
b20902ebfe
fix: remove the Id field from response of GET, POST /connectors
2022-03-07 19:33:32 +08:00
2897af9650
fix: update testcases for emqx_connector
2022-03-07 18:39:23 +08:00
6ff2db6180
fix: elvis warning
2022-03-04 15:10:10 +08:00
71d20d153b
fix: replace deep_merge with merge.
2022-03-03 22:52:46 +08:00
a0cd877669
chore(mongodb): do not use mongodb internal pool
2022-03-02 16:26:39 +03:00
47a4fa5732
Merge pull request #7140 from EMQ-YangM/tmp_change_status
...
refactor(emqx_resource): change the status of emqx_resource to 'conne…
2022-02-28 11:13:47 +08:00
13a0eff678
Merge pull request #7125 from zhongwencool/schema-json
...
feat: generate hot config's schema.json and remove nullable option.
2022-02-25 17:18:20 +08:00
e54f4b75da
fix(emqx_connector): fix resource status
2022-02-25 16:47:32 +08:00
114db2d14e
chore: fix ct failed
2022-02-25 00:01:39 +08:00
db584f79d6
feat: upgrade hocon to 0.25.0 to replace nullable with required.
2022-02-24 22:39:03 +08:00
2b8bcfac5e
Merge pull request #7127 from mononym/EMQX3142-my-sql
...
refactor(emqx_connector): refactor mysql tests to use resource api
2022-02-24 14:08:21 +01:00
f7d78d0600
Merge pull request #7003 from mononym/EMQX-3145-redis
...
feat: add basic redis tests and bring redis connector module in line …
2022-02-24 10:38:41 +01:00
7e20369253
refactor(emqx_connector): refactor mysql tests to use resource api
2022-02-24 09:56:53 +01:00
d306baf92f
feat: add basic redis tests
2022-02-23 15:25:11 +01:00
5c6e3fce6a
refactor: update postgres connector tests to use resource apis
2022-02-23 14:37:51 +01:00
98a11f3c15
fix(api): emqx_connector_api error code format
2022-02-22 17:14:35 +08:00
ff68e2a20f
fix(http): connector and authn/authz http `keep-alive` default 30s , max 1000
2022-02-21 16:35:15 +08:00
5638bcb92b
docs: Fix typos
2022-02-17 23:22:31 +01:00
0c108035a8
test(connector): connector require `ecpool` start
2022-02-15 12:45:50 +08:00
23c6a404b9
test(connector): avoid define macro duplicate
2022-02-15 10:42:08 +08:00
28735dc6d7
refactor(connector): parse servers for `rs` and `sharded` mongo_type
2022-02-15 10:41:26 +08:00
ab7c2b72e3
refactor(connector): db connector provide default port
2022-02-15 00:51:48 +08:00
15d3e86089
Merge pull request #7002 from mononym/EMQX-3144-mongo-db
...
feat: add basic mongodb test suite
2022-02-14 14:57:22 +01:00
b1fbc08e3e
Merge pull request #6976 from mononym/EMQX3142-my-sql
...
feat: Add mysql tests for connector
2022-02-14 14:22:15 +01:00
7962583ac8
feat: add basic mongodb test suite
2022-02-14 13:11:15 +01:00
c635e7306d
feat: Add mysql tests for connector
2022-02-14 10:31:04 +01:00
5f32d4cbd8
chore(mongo): reduce test flackyness
2022-02-11 15:52:35 +03:00
f5415589e9
chore(schema): use emqx_schema:qos() instead of union integer.
2022-02-11 10:09:59 +08:00
ddbb78557a
Merge pull request #6958 from mononym/EMQX-3143-postgre-sql
...
feat: create tests for connector pgsql module and refactoring
2022-02-10 14:41:10 +01:00
14630568d6
feat: create tests for connector pgsql module and refactoring
2022-02-10 10:40:46 +01:00
c2772fdd09
refactor: remove unused/old functions
2022-02-09 10:14:13 +01:00
d0b0b05aa4
fix: decouple suite tests
2022-02-08 14:53:01 +01:00
928555546d
Merge pull request #6869 from EMQ-YangM/fix_start_pool
...
fix(emqx_connector): when start_pool fails, return error and reason
2022-01-29 10:45:45 +08:00
052bd9081d
docs(schema): Fix typos in the schema files
2022-01-27 22:39:19 +01:00
d6f7ffec3c
Merge pull request #6881 from zmstone/refactor-upgrade-hocon-0.23.0
...
refactor: upgrade to hocon 0.23.0
2022-01-27 15:48:23 +01:00
fc92e4c8bf
docs: fix typos
2022-01-27 12:29:38 +01:00
252d7e85d9
refactor: call new hocon apis
2022-01-27 00:23:08 +01:00
e9f3fa7b6b
fix(emqx_connector): when start_pool fails, return error and reason
2022-01-26 16:07:46 +08:00
2105d1f22b
test: call ct helpers to load config
2022-01-25 11:50:18 +01:00
e1933261c8
chore: remove the pool_size maximum limit
2022-01-18 14:22:23 +08:00
6572785907
Merge pull request #6712 from tigercl/fix/pgsql
...
fix: fix errors caused by concurrent parsing of sql
2022-01-14 13:37:47 +08:00
82e3565344
chore: major mode file variable for Emacs
2022-01-13 15:53:47 +08:00
e2676bcbd8
fix: fix dep of epgsql
2022-01-13 11:39:48 +08:00
452f6e766a
fix: return error when parse failed
2022-01-13 11:15:08 +08:00
a4f2a9c51d
fix: fix dependency of epgsql
2022-01-13 10:40:22 +08:00
559a23c50f
chore: update tag of epgsql
2022-01-13 10:15:12 +08:00
552ea7d2fc
Merge pull request #6696 from terry-xiaoyu/rule_metrics2
...
Improve rule metrics
2022-01-12 14:53:09 +08:00
2eb7346229
chore: update tag of epgsql
2022-01-12 13:49:26 +08:00
2791052135
fix: fix errors caused by concurrent parsing of sql
2022-01-11 09:39:56 +08:00
76695c9652
test: update epgsql branch to test
2022-01-10 15:00:08 +08:00
6ea51692c3
Merge pull request #6672 from zhongwencool/return-ok-when-trace-not-found
...
fix: delete error log when file enoent.
2022-01-07 15:36:03 +08:00
Zaiming (Stone) Shi