c8e42cf6b1
test(emqx_broker_SUITE): fix flaky test case
2024-03-05 10:14:07 +01:00
cb0066d639
chore: add tag for logs from MQTT connection modules
2024-03-05 08:39:53 +01:00
00b21cf9c5
Merge pull request #12634 from zmstone/0304-breaking-no-escape-for-triple-quote-string-characters
...
chore: upgrade to hocon 0.42.0
2024-03-05 08:32:50 +01:00
c2dcb507cf
Merge pull request #12637 from lafirest/merge-55
...
sync release-55 to master
2024-03-05 08:47:30 +08:00
e725064a2a
fix(emqx_conf_schema): use `timeout_duration_s()` type for `log.throttling.time_window` field
2024-03-04 22:41:28 +02:00
9929025820
fix(rule_func): time zone shift at wrong precision
2024-03-04 21:25:49 +01:00
61328eb91a
chore: prepare e5.6.0-alpha.2
2024-03-04 15:37:58 -03:00
3e3194fd21
chore: upgrade to hocon 0.42.0
2024-03-04 19:12:42 +01:00
06334798a5
fix(ds): fix `drop_generation` typespec
...
This typespec fix will be used downstream by other backends.
2024-03-04 14:15:59 -03:00
6c9eb16a95
refactor(logger): reorder log fields
...
tag > clientid > msg > peername > username > topic > [other fields]
2024-03-04 18:10:19 +01:00
577ef41e45
Merge remote-tracking branch 'origin/release-55' into sync-r55-r56-20240304
2024-03-04 12:48:06 -03:00
cdcab23c54
Merge pull request #12615 from id/0229-prepare-5.5.1-release
...
chore: prepare 5.5.1 release
2024-03-04 16:34:13 +01:00
79f0720d14
Merge pull request #12635 from lafirest/fix/r551
...
fix(http): fix that sensitive headers may be printed in log when querying
2024-03-04 22:32:14 +08:00
7780b4f1d7
chore: prepare 5.5.1 release
2024-03-04 15:15:10 +01:00
6d9b2a95c3
Merge remote-tracking branch 'origin/release-55'
2024-03-04 20:47:20 +08:00
0dd9990f24
Merge remote-tracking branch 'origin/release-55' into sync-r55-r56-20240304
2024-03-04 09:44:30 -03:00
8b66ea7852
Merge pull request #12625 from thalesmg/test-retainer-extensions-m-20240301
...
test(retainer): extend test suite for usage by other backends
2024-03-04 09:40:32 -03:00
c5eb09a72f
fix(http): fix that sensitive headers may be printed in log when querying
2024-03-04 20:36:01 +08:00
3e7311ee31
Merge pull request #12619 from JimMoen/EMQX-11468/refactor/sqlserver
...
feat: refactor MS SQL Server bridge to connector and action
2024-03-04 18:05:14 +08:00
2e792da934
Merge pull request #12562 from ieQu1/dev/new-ds-schema
...
Refactor schema for the durable storage
2024-03-04 10:33:27 +01:00
4623b73f47
fix: sqlserver connector auto reconnect
2024-03-04 17:13:25 +08:00
2e3003e0f1
test: sqlserver bridge v2
2024-03-04 17:13:24 +08:00
1d58092176
fix: bridge v2 `on_query` matched ChannelId
2024-03-04 17:13:23 +08:00
00d50479f5
fix: compatible with bridge v1
2024-03-04 17:13:22 +08:00
9143d5994d
feat: refactor MS SQL Server bridge to connector and action
2024-03-04 17:13:21 +08:00
0a33f9d027
fix(calendar): leap year time to unix timestamp
2024-03-04 15:37:49 +08:00
9f61239704
Merge remote-tracking branch 'upstream/release-56' into 0304-sync-release-56
2024-03-04 08:00:39 +01:00
e9a5670cce
Merge pull request #12581 from zmstone/0223-add-json-schema
...
feat: schema registry supports json schema
2024-03-02 10:09:31 +01:00
08ef2c7b8b
test(retainer): extend test suite for usage by other backends
...
Part of https://emqx.atlassian.net/browse/EMQX-11922
2024-03-01 17:27:15 -03:00
a20478fff0
chore: update scripts and workflows for 5.6.x
2024-03-01 09:01:34 +01:00
fa275bf0a2
refactor(schema_registry): use one func for both encode and decode check
2024-03-01 07:20:59 +01:00
1c1c4e497d
chore: bump version && update change
2024-03-01 12:42:19 +08:00
5a3a34cce7
fix(redact): enhanced the redact for sensitive headers
2024-03-01 12:30:26 +08:00
0670272188
fix: Revert "fix: redact all headers from logs"
...
This reverts commit d8032f47ca
2024-03-01 10:32:57 +08:00
d56fb22208
Merge pull request #12595 from thalesmg/kafka-consumer-source-m-20240223
...
feat: migrate kafka consumer bridge to source + connector
2024-03-01 10:11:16 +08:00
b7e5ea2941
feat(schema_registry): add JSON schema
2024-02-29 21:03:52 +01:00
5d94a910b9
test: reduce flakiness
2024-02-29 13:59:43 -03:00
21cf600242
chore: address previous review comments
2024-02-29 16:13:52 +01:00
66fbcdcefa
test: fix a compile warning
2024-02-29 16:13:52 +01:00
5afe000ada
Merge pull request #12612 from zmstone/0226-fix-schema-registry-replication
...
refactor: change schema registry SERD_TAB to ets
2024-02-29 14:58:41 +01:00
5bb769e659
Merge pull request #12616 from savonarola/0229-ds-interface
...
feat(ds): export types
2024-02-29 15:42:42 +02:00
16b3dc1166
refactor: use individual keys for subscriber id resources
2024-02-29 10:39:37 -03:00
bc9de20024
Merge pull request #12540 from zhongwencool/bridge-pulsar-v2
...
feat: pulsar bridge v2
2024-02-29 21:25:11 +08:00
0aa9a872a3
feat: check `brod_sup` for client id
2024-02-29 09:53:23 -03:00
b82973b36b
Merge pull request #11868 from qzhuyan/fix/william/takeover-pub-willmsg
...
fix: willmsg not published in takeover
2024-02-29 13:14:18 +01:00
b706caf294
feat(ds): export types
2024-02-29 14:27:18 +03:00
f87c17b540
Merge pull request #12611 from savonarola/0228-ds-interface
...
feat(ds): update delete/count interface
2024-02-29 10:31:51 +02:00
d4519bda82
Merge pull request #12589 from savonarola/0222-retainer-interface
...
Make retainer pluggable
2024-02-29 10:31:15 +02:00
3814203fa2
test(pulsar): add pulsar action v2 testcase
2024-02-29 16:23:37 +08:00
e9e1daf962
chore: update some pulsar's desc
2024-02-29 16:23:37 +08:00
650f9659a4
fix: create pulsar producer when on_add_channel
2024-02-29 16:23:37 +08:00
7f1b4cef27
feat: pulsar bridge v2
2024-02-29 16:23:37 +08:00
21e0ecfcce
Merge pull request #12583 from zhongwencool/wait-for-listener-stop
...
chore: wait_for cowboy listener release sock when stop_listener
2024-02-29 15:03:22 +08:00
d2dda2535b
Merge pull request #12602 from lafirest/fix/iotdb_ping
...
fix(iotdb): use the `ping` API to check the status of the IOTDB connections
2024-02-29 12:26:10 +08:00
0bebd66f05
fix(iotdb): make dialyzer happy
2024-02-29 10:51:12 +08:00
49b508544e
chore: port not released msg
...
Co-authored-by: Zaiming (Stone) Shi <zmstone@gmail.com>
2024-02-29 10:49:29 +08:00
10c1245125
refactor: change schema registry SERD_TAB to ets
...
Prior to this change, it's a mria/mnesia table
which may cause nodes to overwrite each other.
2024-02-28 23:13:07 +01:00
d5ae0e5c53
feat(ds): update delete/count interface
2024-02-28 22:51:24 +03:00
704eceb7c7
Merge pull request #12599 from zmstone/0227-refactor-log-config-template
...
docs: add log docs
2024-02-28 17:58:14 +01:00
ef4ae92da4
Merge pull request #12523 from keynslug/ft/bump-ekka-0.19.0
...
refactor: bump ekka to 0.19.0 w/o mnesia boot phase
2024-02-28 17:46:29 +01:00
dfdf7455d3
feat(retainer): make additional implementations pluggable
...
Co-authored-by: Thales Macedo Garitezi <thalesmg@gmail.com>
2024-02-28 18:43:17 +03:00
d94066a10a
chore(retainer): refactor types; remove hotwiring to builtin config
2024-02-28 18:43:16 +03:00
aa2ee9c409
chore(retainer): add backend creation to the behaviour
2024-02-28 18:43:16 +03:00
d3fb72733e
Merge pull request #12610 from lafirest/fix/ldap_bind_health
...
fix(ldap): fixed that the connection to the LDAP connector could be disconnected after a period of time
2024-02-28 23:03:10 +08:00
eaef753c36
Merge pull request #12608 from lafirest/fix/iotdb
...
fix(iotdb): fix function clause error when there is no `payload` field
2024-02-28 22:00:54 +08:00
20c4029b33
test(cluster-rpc): unload any mocks in `end_per_suite/1`
...
Co-authored-by: Thales Macedo Garitezi <thalesmg@gmail.com>
2024-02-28 14:52:37 +01:00
b9f644c355
fix(ldap): fixed that the connection to the LDAP connector could be disconnected after a period of time
2024-02-28 21:46:03 +08:00
ce2552712f
chore: bump version && update change
2024-02-28 18:32:08 +08:00
c3b044a37b
fix(api-topics): respond with `count` when it's cheap to compute
2024-02-28 11:28:33 +01:00
bd578a799e
fix(api-topics): avoid doing full scans over router tables
2024-02-28 10:52:44 +01:00
9bb0868628
test(api-topics): add testcase verifying paged queries work
2024-02-28 10:52:41 +01:00
01207ef97b
fix(iotdb): fix function clause error when there is no `payload` field
2024-02-28 16:54:01 +08:00
660a1ce99d
chore: use gen_tcp:recv timeout to wait socket closed
2024-02-28 16:18:32 +08:00
6fd04e33f5
fix(prom): skip cert info for disabled ssl/wss/quic listeners
2024-02-28 15:39:33 +08:00
5f125047f5
refactor: remove unnecessary lists fold for `cerfile`
2024-02-28 14:53:20 +08:00
812e8ef314
fix: try-catch for unknow reason to inhibit api crash
2024-02-28 14:53:19 +08:00
4307aecefd
chore: wait_for cowboy listener release sock when stop_listener
2024-02-28 14:24:15 +08:00
c3a2cf6220
chore: update change && bump version
2024-02-28 13:18:48 +08:00
042a84c30f
fix(prom): api crash when tls cert file non existed
2024-02-28 11:35:55 +08:00
aa7def425d
fix: get grpc_timeout from hstreamdb connector config failed
2024-02-28 08:45:06 +08:00
28d664bae2
test(pulsar): simplify the test suite
2024-02-27 23:51:54 +01:00
367ffa8e80
feat(utils-fs): add function to compute relpaths naively
2024-02-27 23:41:50 +01:00
6b9844ae82
feat: migrate kafka consumer bridge to source + connector
...
Fixes https://emqx.atlassian.net/browse/EMQX-11848
2024-02-27 17:52:33 -03:00
787dcd0e86
Merge pull request #12577 from thalesmg/gcp-service-json-binary-m-20240223
...
feat(gcp_pubsub_bridges): make service account json a binary
2024-02-27 15:42:42 -03:00
ef99037335
docs: add log docs
2024-02-27 19:24:56 +01:00
6ea9d2a6d9
test(conf): simplify confsync test suite
2024-02-27 16:41:54 +01:00
ae79516fd2
test(cluster-rpc): ensure testsuite is side-effects-free
2024-02-27 16:41:54 +01:00
56eefe34d5
feat(cth-cluster): use workdir as cwd on each node
2024-02-27 16:41:53 +01:00
d60ff1e616
test(plugins): avoid using same workdir for different nodes
2024-02-27 16:41:53 +01:00
3a008c8b4c
refactor: bump ekka to 0.19.0 w/o mnesia boot phase
2024-02-27 16:41:50 +01:00
8a204f2ac1
Merge pull request #12596 from thalesmg/fix-header-logging-r55-20240226
...
fix: redact all headers from logs
2024-02-27 11:19:51 -03:00
77239da7ed
fix(iotdb): use the `ping` API to check the status of the IOTDB connections
2024-02-27 22:07:41 +08:00
02de92a53d
Merge pull request #12601 from lafirest/fix/eldap_log
...
fix(ldap): fix that logs of eldap will never be logged
2024-02-27 21:50:05 +08:00
2ded751237
test: `nl` not allowed for shared-sub
2024-02-27 18:24:30 +08:00
54c542c795
chore: rename _probe_ to t_probe_
2024-02-27 17:57:15 +08:00
c67f2130f2
fix: check connector and bridge_v2 with the right schema
2024-02-27 17:57:10 +08:00
c6b1102b2b
fix(mgmt_client): `nl` not allowed for shared-sub
2024-02-27 17:51:39 +08:00
f3237a1bf7
chore: bump emqx_ldap version
2024-02-27 17:48:34 +08:00
5c69500c52
fix(ldap): fix that logs of eldap will never be logged
2024-02-27 17:48:22 +08:00
9ae7ac04a2
Merge pull request #12597 from lafirest/fix/ldap_log
...
fix(ldap): fix that logs of eldap will never be logged
2024-02-27 17:40:44 +08:00
1567c5beb0
Merge pull request #12580 from zmstone/0224-delete-stale-macro
...
chore: delete stale macro
2024-02-27 09:58:06 +01:00
9c9a2b8494
Merge pull request #12592 from zmstone/0226-duration_s-min-value
...
chore: for dashboad add a 'minimum' attribute for duration_s type
2024-02-27 09:57:33 +01:00
da13ec736c
chore: bump emqx_ldap version
2024-02-27 16:08:47 +08:00
c1da7449fe
test(mgmt_api): bulk/unbulk sub/unsub shared topic filter
2024-02-27 16:01:12 +08:00
a76415c4f6
fix(mgmt): sub/unsub a share subscription to the client via http api
...
- `/clients/:clientid/subscribe`
- `/clients/:clientid/subscribe/bulk`
- `/clients/:clientid/unsubscribe`
- `/clients/:clientid/unsubscribe/bulk`
2024-02-27 16:00:45 +08:00
6e73cfa2cf
fix(ldap): fix that logs of eldap will never be logged
2024-02-27 15:47:46 +08:00
6c7b7741d5
feat(quic): mqtt 5.0 graceful shutdown in takeover
2024-02-26 23:05:49 +01:00
c8f9ffdc1f
chore: update some comments
2024-02-26 22:24:16 +01:00
88fc67b369
chore(willmsg): remove unreachable code
2024-02-26 22:24:16 +01:00
d5247cb567
refactor: update notes for willmsg
2024-02-26 22:24:16 +01:00
975c7429e5
chore: clean in tests
2024-02-26 22:24:13 +01:00
d8032f47ca
fix: redact all headers from logs
...
Fixes https://emqx.atlassian.net/browse/EMQX-11904
Since headers are usually used for authentication and the headers used for that are very
flexible, we redact all headers from logs to avoid leaking anything.
2024-02-26 18:04:12 -03:00
bb6a95bae8
Merge pull request #12590 from zmstone/0226-remove-mfa-from-logs
...
refactor: delete mfa from log metadata
2024-02-26 21:37:57 +01:00
5326cc80ed
Merge pull request #12594 from savonarola/0226-add-ds-delete-interface
...
chore(ds): add delete callbacks
2024-02-26 20:07:21 +02:00
9ca5684b34
Merge pull request #12591 from thalesmg/dev-cls-m-20240226
...
test: make `clear_screen` safer
2024-02-26 13:40:16 -03:00
b010d34640
chore(ds): add delete callbacks
2024-02-26 17:35:13 +03:00
5d4c85cd84
chore: list throttled log events in the change-log
2024-02-26 15:09:38 +02:00
5b48b06d4a
fix: trace throttled log events
2024-02-26 15:09:38 +02:00
652e977b3c
chore: for dashboad add a 'minimum' attribute for duration_s type
2024-02-26 13:51:07 +01:00
c6195fcf50
test: make `clear_screen` safer
...
Useful when iterating on the tests in a loop, to get rid of all the garbaged printed
before the test itself beings.
Only actually does anything if the environment variable `CLEAR_SCREEN` is set to `true`
and only clears the screen the screen the first time it's encountered, so it's harmless
otherwise.
2024-02-26 09:31:06 -03:00
f2c372d9ff
feat(gcp_pubsub_bridges): make service account json a binary
...
Fixes https://emqx.atlassian.net/browse/EMQX-11384
Today, service_account_json config field is an embedded object (map()).
This requires user to embed a JSON object into the config file instead of embedding it as
a string.
We should support binary() type as input, but keep supporting map() for backward
compatibility.
2024-02-26 09:21:07 -03:00
00c2aeb1ab
refactor: delete mfa from log metadata
2024-02-26 12:15:00 +01:00
de5e4491f7
Merge pull request #12576 from zmstone/0223-hide-bridges-root-from-docs
...
docs: stop generating schema doc for 'bridges' root
2024-02-24 09:08:05 +01:00
94a01d23c1
chore: delete stale macro
...
EMQX_API_VERSION is no longer in use since 5.2.0
2024-02-24 09:06:25 +01:00
a3e81c5039
chore: prepare for release 5.5.1-rc.2
2024-02-24 08:59:51 +01:00
fe4c7cd2dc
fix(ds): Apply review remarks, and hide certain fields
2024-02-23 18:07:56 +01:00
e126393cbf
fix(ds): Fix schema checker warnings for DS schema
2024-02-23 15:39:52 +01:00
c18fc6a4bb
fix(sessds): Remove deprecated configuration parameters
2024-02-23 15:08:13 +01:00
91ddbbcc3f
fix(sessds): Replace min- and max- batch size with batch_size
2024-02-23 15:08:13 +01:00
94b0ab983d
docs(ds): Add descriptions for the builtin's egress config
2024-02-23 15:08:13 +01:00
17ab3c6362
chore(ds_schema): Use atoms for record and field names
2024-02-23 15:08:13 +01:00
24337ecec7
feat(sessds): Move config schema to a separate root
2024-02-23 15:08:13 +01:00
8907e5afb3
chore(sessds): Remove deprecated schema
2024-02-23 15:08:11 +01:00
2adfefe297
docs: stop generating schema doc for 'bridges' root
2024-02-23 14:51:57 +01:00
5af01c041b
Merge pull request #12559 from zmstone/0221-refactor-use-atom-fileds
...
refactor: use atoms for root config fields
2024-02-23 14:38:19 +01:00
b60b19a29a
fix(connectors): redact authorization headers when creating/updating connectors
...
Fixes https://emqx.atlassian.net/browse/EMQX-11895
2024-02-23 10:17:24 -03:00
15f919e60f
Merge pull request #12564 from thalesmg/bw-support-batch-list-resp-m-20240221
...
feat(resource): allow `on_batch_query{,_async}` to return a list of individual results
2024-02-23 09:37:42 -03:00
cd091b4f75
Merge pull request #12572 from zhongwencool/api-config-error-log
...
fix(api): more detail error when don't allow update readonly key
2024-02-23 17:29:00 +08:00
f2619ce17a
Merge pull request #12571 from zhongwencool/delete-repeat-ci-test
...
test(bridge_v1): delete repeat probe_bridge_api code
2024-02-23 17:17:39 +08:00
fbf4afc3c5
fix(api): more detail error when don't allow update readonly key
2024-02-23 16:43:15 +08:00
46877e979b
chore: update copyright-year
2024-02-23 08:21:06 +01:00
d7faab4195
test(bridge_v1): delete repeat probe_bridge_api code
2024-02-23 14:43:42 +08:00
9f52b4fba8
Merge pull request #12566 from lafirest/fix/same_api
...
fix(api_key): enhanced bootstrap files for REST API keys
2024-02-23 10:57:37 +08:00
11d3df2775
Merge pull request #12569 from zhongwencool/fix-rabbitmq-action-crash-dropped-metrics
...
fix: rabbitmq action failed to increase dropped metrics
2024-02-23 09:53:55 +08:00
c08522bc1e
Merge pull request #12539 from zhongwencool/rocketmq-channel-status
...
fix: Rocketmq channel status
2024-02-23 09:50:10 +08:00
51a6ada015
fix: rabbitmq action failed to increase dropped metrics
2024-02-23 08:35:00 +08:00
eba74c1ca8
Merge pull request #12567 from thalesmg/fix-gcp-consumer-v1-api-m-20240222
...
fix(gcp_pubsub_consumer,mongodb_bridge): fix v1 config transformation for gcp pubsub consumer and mongodb bridges
2024-02-22 17:33:02 -03:00
d003f77021
feat(resource): allow `on_batch_query{,_async}` to return a list of individual results
...
Fixes https://emqx.atlassian.net/browse/EMQX-11892
This allows callers of batching resources to receive results specific to their requests,
rather than a broad success or failure for the whole batch.
2024-02-22 16:26:02 -03:00
54499175d5
Merge pull request #12568 from keynslug/ft/EMQX-11888/s3-redact
...
fix(s3): try to obtain credentials with default lhttpc
2024-02-22 18:07:04 +01:00
2ff33f98ef
chore(willmsg): add come comments
2024-02-22 17:12:19 +01:00
Kjell Winblad