a4bb865e6a
feat: add validations for emqx_ee_conf_schema
2023-05-04 16:53:03 +08:00
277deee616
fix: add new sensitive keywords to redact checklist
2023-05-04 16:32:32 +08:00
8aa7c014e7
perf(buffer_worker): avoid calling `ets:info/2`
...
(Almost?) fixes https://emqx.atlassian.net/browse/EMQX-9637
During the course of performance tests comparing the performance of
e5.0.3 and e4.4.16 regarding the webhook bridge in sync mode, we
observed that the throughput in e5.0.3 (sync) was much lower than in
e4.4.16: ~ 9 k msgs / s vs. ~ 50 k msgs / s, respectively.
Analyzing `observer_cli` output, we noticed that a lot of the time
both buffer workers and ehttpc processes was spent in `ets:info/2`.
That function was called to check the size of the inflight table when
updating metrics and checking if the inflight table was full. Other
uses of `ets:info/2` were contained inside the arguments to some
`?tp/2` macro usages (https://github.com/kafka4beam/snabbkaffe/pull/60 ).
By using a specific record to track the size of the table, we managed
to improve the bridge performance to ~ 45 k msgs / s in sync mode.
2023-05-02 17:05:32 -03:00
57cc854a4a
test(bridge): fix bridge map type filed converters
...
now the converters on map type fields only work at the wrapping map
level but not the values
2023-04-30 10:45:11 +02:00
b58d3e8f94
Merge pull request #10529 from zmstone/0426-ensure-buffer-worker-monitors-cassandra-conn-pid
...
0426 ensure buffer worker monitors cassandra conn pid
2023-04-27 22:54:30 +02:00
1f0148a819
Merge pull request #10524 from lafirest/fix/rocketmq_sensitive
...
fix(rocketmq): keep sensitive data safe in rocketmq logs and state
2023-04-27 10:16:05 +08:00
a8b000f062
refactor(sqlserver): support only sync mode at connector level
2023-04-26 20:44:56 +02:00
c83d630c97
fix(cassandra): ensure async calls return connection pid
...
so the buffer worker can monitor it and perform retries
if the connection restarted
2023-04-26 14:33:37 +02:00
9eccfa5cdf
fix(dynamo): fix test case errors
2023-04-26 17:03:01 +08:00
6706fd90e1
fix(rocketmq): keep sensitive data safe in rocketmq logs and state
2023-04-26 16:10:35 +08:00
e467e082f0
fix(dynamo): remove all async callbacks of the Dynamo connector
2023-04-26 14:47:22 +08:00
dc452deaf0
Merge pull request #10506 from lafirest/fix/dynamo_default_port
...
fix(dynamo): use correct default port for different schemas
2023-04-25 18:26:44 +08:00
3bb50a5751
fix(rocketmq): fix that the update of ACL info not working
2023-04-25 16:55:03 +08:00
33c27ac2ac
fix(dynamo): use correct default port for different schemas
2023-04-25 10:50:44 +08:00
7ce04358c4
fix(Dynamo): fix DynamoDB bridge status check error
2023-04-24 17:28:33 +08:00
2b0106e047
Merge pull request #10485 from JimMoen/fix-mssql-bridge-default
...
fix: use default health check timeout for sqlserver
2023-04-23 18:20:10 +08:00
d505b65ba8
fix: use default health check timeout for sqlserver
2023-04-23 15:47:19 +08:00
4e7472090b
fix: refine default sql and driver name for mssql bridge
2023-04-23 15:47:18 +08:00
6ef032026f
Merge pull request #10471 from lafirest/fix/dynamo_bridge
...
fix(dynamo): separate the implementation of connector and client of Dynamo bridge
2023-04-23 14:25:23 +08:00
d826b0921d
fix(dynamo): separate the implementation of connector and client of Dynamo bridge
2023-04-23 10:57:36 +08:00
7704995279
fix(rocketmq): expose the driver parameter `sync_timeout` into the RocketMQ bridge configuration
2023-04-21 15:10:25 +08:00
48402d0476
Merge pull request #10461 from lafirest/fix/dynamo_db_svrs
...
fix(rocketmq): allow setting multiple addresses in RocketMQ bridge
2023-04-21 14:37:37 +08:00
f602900a53
fix(rocketmq): fix that the status check of RocketMQ bridge may not accurate
2023-04-21 13:35:29 +08:00
d865998a63
fix(rocketmq): fix test cases
2023-04-21 11:02:14 +08:00
6e12abff39
fix(rocketmq): allow setting multiple addresses in RocketMQ bridge
2023-04-20 17:58:12 +08:00
e89f4d4565
fix(dynamo): fix terminology erros
...
- Changed `username` to `aws_access_key_id`
- Changed `password` to `aws_secret_access_key`
2023-04-19 16:26:42 +08:00
bc353b0a06
fix(dynamo): change `database` to `table` in the schema of the DynamoDB bridge
...
there is no term like `database` in DynamoDB, the correct concept should be `table`
2023-04-19 15:56:29 +08:00
9fc8a498f8
chore: bump apps versions
2023-04-17 09:09:08 +02:00
7df0493312
Merge pull request #10390 from sstrigler/EMQX-9549-new-emqx-utils-app-to-collect-utility-modules
...
New emqx_utils app to collect utility modules
2023-04-14 20:33:11 +02:00
f0c13e0134
fix: stale ref to emqx_map_lib
2023-04-14 18:43:53 +02:00
e073bc90bc
refactor(buffer_worker): rename `s/queue/buffer/g`
2023-04-14 11:37:19 -03:00
edd1bc579f
fix: stale ref to emqx_json after rebase
2023-04-14 16:32:42 +02:00
4f2f0ebb6a
fix: bad ref to emqx_misc after rebase
2023-04-14 14:58:19 +02:00
062ce5f819
refactor: rename emqx_map_lib to emqx_utils_maps
2023-04-14 13:41:34 +02:00
6e8665365b
refactor: rename emqx_tables to emqx_utils_ets
2023-04-14 13:41:33 +02:00
d0df086c80
refactor: rename emqx_api_lib to emqx_utils_api
2023-04-14 13:41:33 +02:00
9c11bfce80
refactor: rename emqx_misc to emqx_utils
2023-04-14 13:41:27 +02:00
f8e9e54393
refactor: move emqx_json to emqx_utils_json
2023-04-14 13:31:27 +02:00
9ce0dbae7b
test: fix batch_size parameter
2023-04-14 13:11:45 +08:00
2484a79c7a
test: create bridge with invalid password
2023-04-14 12:52:08 +08:00
8cec62bd87
fix: async reply arg list
2023-04-14 12:43:36 +08:00
65c4234829
refactor: rename instance_id, which is also PoolName
2023-04-14 10:02:48 +08:00
2d1b94f7f7
fix: file mode 755 magic number
2023-04-14 10:02:48 +08:00
675f9894ab
fix: fix single quotes not applied for single query
...
- alwasy use `emqx_plugin_libs_rule:proc_batch_sql/3` to add single quotes for string
2023-04-14 10:02:47 +08:00
f8c0aa49a2
style: make elvis and shellcheck happy
2023-04-14 10:02:47 +08:00
437096985b
test: fix SUITE case `t_create_disconnected/1`
2023-04-14 10:02:47 +08:00
27fdf644aa
fix(sqlserver): let a single query be a length 1 batch
...
Need to be fixed:
`emqx_plugin_libs_rule:proc_tmpl/2` won't add single quotes for string
2023-04-14 10:02:46 +08:00
a379d909bf
test: use type VARCHAR to use utf8 encoding in sqlserver
2023-04-14 10:02:46 +08:00
c366267b0f
test: MS SQL Server data bridge
2023-04-14 10:02:46 +08:00
5841969877
feat: implement Microsoft SQL Server bridge (e5.0)
2023-04-14 10:02:45 +08:00
Zhongwen Deng