e148d903e8
feat: log resource_id
2024-07-23 15:14:42 +08:00
0a04b1ad6e
feat: add group/type to resource slog
2024-07-23 15:14:41 +08:00
cba3f532f8
feat: don't record dry_run log
2024-07-23 15:14:41 +08:00
7bb7b10a31
Merge pull request #13114 from emqx/emqx-relup-gen
...
feat: generate relup tarball, add relup APIs
2024-07-23 15:00:52 +08:00
439abe430b
refactor: remove relup revert callback functions
2024-07-23 11:45:55 +08:00
99e6613713
test(rule events): add test cases for `schema.validation_failed` and `message.transformation_failed` events
2024-07-22 16:31:48 -03:00
d9832252d8
refactor: add namespace to avoid clashes with operations or other resources
2024-07-22 16:04:19 -03:00
6a5849488c
feat(cluster link): add metrics
...
Fixes https://emqx.atlassian.net/browse/EMQX-12627
2024-07-22 16:04:19 -03:00
07cb147d38
fix(cluster link schema): username is not required
2024-07-22 16:04:19 -03:00
ba3cbe02e3
feat(cluster link api): add status to responses
...
Fixes https://emqx.atlassian.net/browse/EMQX-12627
2024-07-22 16:04:19 -03:00
0b1f0db73c
chore(cluster link): refactor HTTP API for CRUD operations
...
Fixes https://emqx.atlassian.net/browse/EMQX-12627
2024-07-22 16:04:19 -03:00
7ca5205f3f
feat: add `peername` to rule events that already have `peerhost`
...
Fixes https://emqx.atlassian.net/browse/EMQX-12342
2024-07-22 16:01:30 -03:00
69f5b6fa6c
chore: hide `enable` fields from docgen
...
Fixes https://emqx.atlassian.net/browse/EMQX-12730
2024-07-22 13:26:53 -03:00
8ae54ac325
fix(connector resource): use configuration `resource_opts` for health check interval when starting up
...
Fixes https://emqx.atlassian.net/browse/EMQX-12738
2024-07-22 11:34:10 -03:00
220fbe8a0a
test: fix flaky test
2024-07-22 09:44:51 -03:00
a2bed1efb8
Merge pull request #13480 from zhongwencool/rule-engine-log-tag
...
feat: Rule engine log tag
2024-07-22 16:47:13 +08:00
57b67ebb37
Merge pull request #13481 from zhongwencool/match_rule_error
...
chore: add authz tag to match_rule_error log
2024-07-22 16:46:49 +08:00
862336a2cb
feat: hide relup plugins from APIs and CLIs
2024-07-22 16:07:50 +08:00
ed2fab51e9
Merge remote-tracking branch 'origin/release-57' into sync-release-57-20240722-022026
2024-07-22 02:20:27 +00:00
65544f34ec
chore: bump hocon -> 0.43.2
2024-07-19 17:25:18 -03:00
8d535bbd24
Merge pull request #13464 from thalesmg/20240712-m-res-manager-shutdown-logs
...
chore: attempt to reduce race condition supervisor noproc shutdown error logs
2024-07-19 14:57:56 -03:00
4d174b8678
feat(sources & actions api): add dependent rules to response
...
Fixes https://emqx.atlassian.net/browse/EMQX-12654
2024-07-19 14:43:55 -03:00
eb2d3a3b7e
chore: attempt to reduce race condition supervisor shutdown errors
...
Fixes https://emqx.atlassian.net/browse/EMQX-12442
e.g.:
```
2024-05-23T08:52:39.811845+00:00 [error] Supervisor: {local,emqx_resource_manager_sup}. Context: shutdown_error. Reason: noproc. Offender: id=<<99, 101, 110, 115, 111, 114, 101, 100>>,pid=<0.7752.1030>.
```
It could be just a race condition, as it seems to be the case for resource manager: i) a call is made to the process to stop it; ii) the call times out; iii) the after clause ends up calling supervisor:terminate_child; iv) while the supervisor is finding the child to terminate, the process actually finishes terminating, and the supervisor receives a noproc reason back.
2024-07-19 10:57:00 -03:00
ae828e8cfb
feat(connectors api): add dependent actions and sources to response
...
Fixes https://emqx.atlassian.net/browse/EMQX-12654
2024-07-19 10:33:48 -03:00
464e202742
Merge pull request #13488 from thalesmg/20240718-m-mix-fix-machine-dep
...
chore(new mix build): fix app dependency for release
2024-07-19 09:21:02 -03:00
b7200656a5
Merge pull request #13486 from keynslug/fix/ci/ds-raft-flaky-next
...
test(dsraft): attempt to stabilize flaky testcases
2024-07-19 12:15:36 +02:00
fc3405fe4c
fix: bp_api for relup
2024-07-19 17:35:36 +08:00
f11dfce292
ci: suppress dialyzer checks for quicer and odbc types
2024-07-19 17:11:49 +08:00
c61828460a
chore: emqx_utils_api:with_node/2 support simple http-code
2024-07-19 15:02:14 +08:00
4d25f28bb2
fix: dialyzer checks
2024-07-19 14:19:50 +08:00
3ad7dc262b
fix: some sanity-checks
2024-07-19 11:38:44 +08:00
3c8ef35b18
fix: show relup status even if no packages installed
2024-07-19 11:20:37 +08:00
01883e9759
chore(new mix build): fix app dependency for release
2024-07-18 11:33:02 -03:00
ca47e4768d
Merge pull request #13485 from thalesmg/20240717-r57-rm-dead-code-purge-proto
...
chore: remove dead code
2024-07-18 09:22:27 -03:00
3a893626b8
Merge pull request #13474 from keynslug/ft/EMQX-12309/ds-cas-api
...
feat(ds): allow isolated batches with preconditions
2024-07-18 12:52:13 +02:00
2008130071
feat: add HTTP APIs for relup
2024-07-18 18:48:38 +08:00
4a04ffdca1
Merge pull request #13483 from id/20240717-sync-release-57
...
sync release-57
2024-07-18 10:41:49 +02:00
c2d49ff34f
chore(rmq_tests): fix rabbitmq tests
...
Co-authored-by: Ilya Averyanov <av@rubybox.dev>
2024-07-18 08:34:00 +02:00
ac52bf39ce
Merge pull request #13443 from zhongwencool/cluster-link-cli-load
...
fix: update cluster.links via cli
2024-07-18 09:13:59 +08:00
0e545ffcec
feat(ds): add dedicated `#message_matcher{}` for preconditions
2024-07-17 21:27:17 +02:00
2e89656a90
test(dsraft): start `t_replication_transfers_snapshots` from stable state
2024-07-17 20:01:55 +02:00
466fa41ec3
fix(dsraft): rely on last resort timeout with unresponsive replicas
...
This simplifies the shard transition scheduling logic and makes it less
prone to races.
2024-07-17 19:24:38 +02:00
93c725732c
chore: remove dead code
2024-07-17 12:56:45 -03:00
4edbcc55e7
Merge pull request #13463 from thalesmg/20240712-m-gprodu-backoff-retry
...
feat(gcp pubsub producer): retry on 502 and 503 http status code responses
2024-07-17 12:49:27 -03:00
cd8bf2725a
Merge pull request #13453 from thalesmg/20240711-r57-mt-fixes
...
batch of message transformation fixes
2024-07-17 12:45:19 -03:00
0c05b3f019
fix(ds): make conditionals less confusing
2024-07-17 16:23:41 +02:00
78fe9304be
Merge pull request #13462 from keynslug/fix/ci/flaky-ds-raft
...
fix(dsraft): preserve pending replica set transitions
2024-07-17 16:11:59 +02:00
14022aded1
feat(ds): allow isolated batches with preconditions
...
Namely, single message deletions and preconditions that can be used to
build complex "compare-and-swap"-style operations. Also allow user to
declare that atomic batches support is needed for a DB.
2024-07-17 15:57:17 +02:00
02e1007a16
feat(dslocal): implement `force_monotonic_timestamps => false`
2024-07-17 15:49:50 +02:00
3381eecd6f
chore: apply code review
2024-07-17 21:27:07 +08:00
3c832db13d
test: test cluster.links reloaded
2024-07-17 21:06:48 +08:00
937fb153c2
fix: fill_default/3 should populate default values for all parameters except the 'ds'
2024-07-17 21:06:48 +08:00
7b6b9580c8
test: add test for updating cluster.links
2024-07-17 21:06:48 +08:00
2783192f77
fix: update cluster.links via cli
2024-07-17 21:06:48 +08:00
083537daa3
fix: retry not_found if conf file not exist
2024-07-17 21:06:48 +08:00
ae3812da85
feat(ds): allow to turn monotonic timestamps off for DB
...
That tells implementation how to assign timestamps to messages. Current
implicit default is now `force_monotonic_timestamps => true`.
2024-07-17 14:40:23 +02:00
6b130c6422
fix(dsraft): preserve pending replica set transitions
...
Otherwise, information about pending replica set transitions taking a
long time to complete could be lost on subsequent target set changes and
node crashes.
2024-07-17 12:17:07 +02:00
292b331064
Merge remote-tracking branch 'upstream/release-57' into 20240717-sync-release-57
2024-07-17 11:29:25 +02:00
52031441cf
chore: add authz tag to match_rule_error log
2024-07-17 12:21:32 +08:00
604cff4887
feat: add rule tag to rule_engine log
2024-07-17 12:15:57 +08:00
6697035812
Merge pull request #13441 from lafirest/feat/coap
...
feat(coap): use content-sensitive udp proxy for coap
2024-07-17 10:01:51 +08:00
1ad02a11e2
Merge pull request #13455 from thalesmg/20240711-m-mix-umbrella-part-III-no-ci
...
sync new mix build work to master
2024-07-16 14:41:10 -03:00
d04915d6a6
test(dsraft): increase `ra_server` logging level for debugging
2024-07-16 15:54:49 +02:00
78bb102311
test(dsraft): attempt to start select testcases from stable state
2024-07-16 15:54:49 +02:00
4a08bfc93f
feat(mix ct): improve failure logging
2024-07-15 09:26:04 -03:00
02a0ccfdd1
ci: preparations for new mix build
2024-07-15 09:26:04 -03:00
70786d6aca
test: fix suite apps
2024-07-15 09:26:04 -03:00
066fd0481b
feat(mix): compile asn1 files
2024-07-15 09:26:04 -03:00
9e4a84cf76
Merge pull request #13442 from thalesmg/20240709-r57-decouple-connector-action-hc
...
fix(resource manager): disentangle connector and channel health check frequencies
2024-07-15 09:12:07 -03:00
ec183f1d4c
test(coap): fix ci errors
2024-07-15 10:52:37 +08:00
46c2c75b7b
fix(connection): Make process_msg function tail-recursive
2024-07-14 06:00:00 +02:00
0e57b39cf2
feat(gcp pubsub producer): retry on 502 and 503 http status code responses
...
Fixes https://emqx.atlassian.net/browse/EMQX-12625
2024-07-12 15:29:59 -03:00
2401a2fb80
test(dsraft): run `t_join_leave_errors` case in tracing context
2024-07-12 18:28:24 +02:00
96c9020727
chore: improve protobuf decoding error messages
...
Fixes https://emqx.atlassian.net/browse/EMQX-12677
2024-07-12 13:27:30 -03:00
af81800aec
chore(dsraft): log a bit more informative messages in shard allocator
2024-07-12 18:24:58 +02:00
8e8b382ec0
chore(dsraft): provide more details when replica is unready
2024-07-12 18:23:23 +02:00
70a760850f
chore(dsraft): correct comment spelling errors
2024-07-12 15:27:29 +02:00
205ad507ea
test(dsraft): attempt to ensure testcases start from stable state
...
Where "stable state" is currently defined as "everyone knows and agrees
on the current leader".
2024-07-12 15:26:00 +02:00
9ca8aeb155
chore(mgmt): reduce test flakyness
2024-07-12 12:10:49 +03:00
854754eb60
feat(coap): use content-sensitive udp proxy for coap
2024-07-12 16:23:46 +08:00
83cc3ffeb0
fix(banned): let the bootfile of banned be optional
2024-07-12 13:58:14 +08:00
1b7d23cef4
Merge pull request #13451 from lafirest/fix/def_banned_file
...
fix: do not convert a empty file name to a empty list
2024-07-12 13:50:32 +08:00
2816170e9d
chore: add `$events.message_transformation_failed` to rule engine tester
...
Fixes https://emqx.atlassian.net/browse/EMQX-12679
2024-07-11 17:52:08 -03:00
5f595966d8
chore(message transformation): allow empty operation list
...
Fixes https://emqx.atlassian.net/browse/EMQX-12682
2024-07-11 17:52:08 -03:00
04b547d6f5
fix(schema registry): handle large names during lookup
...
Fixes https://emqx.atlassian.net/browse/EMQX-12692
2024-07-11 14:35:31 -03:00
f3c6d10f76
fix(mix): fix compile paths and deps
2024-07-11 14:19:23 -03:00
01d89be743
feat(message transformation): add timestamp and pub_props fields to read context
...
Fixes https://emqx.atlassian.net/browse/EMQX-12684
Fixes https://emqx.atlassian.net/browse/EMQX-12678
2024-07-11 12:15:31 -03:00
44e4b3616d
feat(variform): allow hyphens in identifiers
...
Fixes https://emqx.atlassian.net/browse/EMQX-12683
2024-07-11 12:15:23 -03:00
a4cc3ba9e8
Merge pull request #13375 from kjellwinblad/kjell/fix_connector_lister_speed_limit_clearing/EMQX-12514
...
fix: default value for max_conn_rate etc should be set to infinity
2024-07-11 16:36:01 +02:00
d9b5c5863b
fix: do not convert a empty file name to a empty list
2024-07-11 18:12:38 +08:00
c9e12f30cd
Merge pull request #13444 from lafirest/fix/oidc
...
fix(oidc): Avoid crashes and avoid deleting jwks on update
2024-07-11 17:55:50 +08:00
7664b06e98
Merge pull request #13434 from zmstone/0704-refine-rpc-config
...
0704 refine rpc config
2024-07-11 10:25:45 +02:00
4825079964
chore(ds): Support platform profile
2024-07-10 12:03:23 +02:00
b0e3e405cf
fix(oidc): Avoid crashes and avoid deleting jwks on update
2024-07-10 15:22:43 +08:00
44d533fe6d
Merge pull request #13432 from JimMoen/0705-fix-jwt-pem-check
...
fix: create authn jwt with bad public key
2024-07-10 10:33:54 +08:00
7a23ae7b4d
refactor: expose only server_port for rpc
...
previously, there were 4 port configs:
- tcp_server_port
- ssl_server_port
- tcp_client_port
- ssl_client_port
2024-07-09 22:26:29 +02:00
ee13773496
refactor: rename rpc.tcp_client_num to rpc.client_num
...
tcp_client_num is kept as an alias
2024-07-09 22:26:29 +02:00
48e604bda8
fix(mix grpc): include default erlc options
2024-07-09 15:56:30 -03:00
818070ad44
test(mix): add integration test path
2024-07-09 15:56:30 -03:00
5279ad76be
fix(grpc compiler): unload apps to avoid side effects
2024-07-09 15:56:30 -03:00
b91515b131
fix(schema registry mix): gpb is a runtime dep
2024-07-09 15:56:30 -03:00
6d94809950
Merge pull request #13415 from thalesmg/20240703-m-couchbase-action
...
feat: implement couchbase connector and action
2024-07-09 15:53:11 -03:00
3c370a90aa
Merge pull request #13436 from thalesmg/20240708-r57-custom-headers-jwks
...
feat(jwks): allow specifying custom request headers
2024-07-09 15:52:44 -03:00
9f8a1885a7
fix(resource manager): disentangle connector and channel health check frequencies
...
Fixes https://emqx.atlassian.net/browse/EMQX-12674
2024-07-09 14:53:39 -03:00
d25c4ba06f
Merge pull request #13421 from thalesmg/20240705-r57-docs-mt-api-examples
...
docs(message transformation): add api examples
2024-07-09 10:16:53 -03:00
3721be65ee
fix(ds): Improve comments
2024-07-09 13:15:15 +02:00
d7732a6aac
test(ds): Attempt to stabilize a flaky test
2024-07-09 13:15:15 +02:00
e70c1cfea3
test(ds): Improve stability of replication test suite
2024-07-09 13:15:15 +02:00
dc4ae82798
test(ds): Add message ID
2024-07-09 13:15:14 +02:00
d1b574a67e
perf(dslocal): Run heavy-duty operations in a temporary process
2024-07-09 13:15:14 +02:00
661f79544b
fix(ds): Optimize hot loop of skipstream storage layout
2024-07-09 13:15:14 +02:00
23dafbb03b
feat(ds): Add a benchmarking tool for storage efficiency analysis
2024-07-09 13:15:14 +02:00
afeb2ab8aa
feat(ds): Add metrics for skipstream layout
2024-07-09 13:15:14 +02:00
b68ebb9a73
test(dsrepl): Generalize tests to use different storage layouts
2024-07-09 13:15:14 +02:00
8c5e4a2376
test(ds): Generalize storage layout test suite for different layouts
2024-07-09 13:15:14 +02:00
086e7256f5
feat(ds): Add configuration schema for skipstream LTS layout
2024-07-09 13:15:14 +02:00
a4642d4d06
feat(ds): Add a new storage layout engine: "skipstream"
...
This layout is based on LTS as well, but it uses separate index
streams for constrained replay of streams with learned wildcards
2024-07-09 13:15:14 +02:00
de48077ac4
test(ds): Add new helper functions
...
- Improve message comparison
- Add set operations
2024-07-09 13:15:14 +02:00
210556e545
feat(ds): Generalize value serialization
...
- Add a new utility module for message serialization
- Add experimental serializer based on ASN.1
2024-07-09 13:15:14 +02:00
843973ef32
fix(ds): bitfield_lts: static_key_size -> static_key_bits
2024-07-09 13:15:14 +02:00
f84fb34692
feat(ds_lts): New APIs: info, reverse lookups and topic compression
2024-07-09 13:15:14 +02:00
eb80402ccb
fix(ds): Improve typespecs and descriptions in storage_layer
2024-07-09 13:15:14 +02:00
71dad0242e
docs(ds): Move Raft-related parts to emqx_ds_builtin_raft README
2024-07-09 13:15:14 +02:00
afe1c5617d
refactor(ds): Rename macros for bitfield_lts metrics
2024-07-09 13:15:14 +02:00
0f2c19b656
refactor(ds): Move end_of_stream detection logic for delete_next
2024-07-09 13:15:14 +02:00
b565976794
fix(ds): Fix hashing of empty wildcard topic levels in bitfield_lts
2024-07-09 13:15:13 +02:00
f00bb383d4
fix(ds builtin local): use `-include_lib` instead of relative path
2024-07-08 16:57:55 -03:00
811184ddad
feat(jwks): allow specifying custom request headers
...
Fixes https://emqx.atlassian.net/browse/EMQX-12655
2024-07-08 15:40:52 -03:00
d34fc7a03a
Merge pull request #13420 from thalesmg/20240705-r57-fix-mt-empty-topics
...
fix(schema validation & message transformation): forbid empty topic filter list
2024-07-08 10:15:08 -03:00
166f5e5f12
Merge pull request #13426 from thalesmg/20240705-r57-test-flaky-plugin-start-enabled
...
test(plugins): fix flaky test
2024-07-08 09:19:53 -03:00
820789a09f
fix: redact status when mark_fix_log begin
2024-07-08 17:32:45 +08:00
457ea93570
test: add cluster_sync cli test
2024-07-08 17:04:41 +08:00
f490a0cba2
feat: don't reset tnx_id when cluster_fix
2024-07-08 17:04:41 +08:00
298211d101
chore: apply suggestions from code review
...
Co-authored-by: zmstone <zmstone@gmail.com>
2024-07-08 17:04:41 +08:00
bdf3fc63a6
chore: add config leader to suggestion
2024-07-08 17:04:41 +08:00
22fc3c49cc
chore: combine some common code into one function
2024-07-08 17:04:41 +08:00
5b105fcdbb
chore: move emqx_conf_proto_v3 to emqx_conf_proto_v4
2024-07-08 17:04:41 +08:00
3ed4340145
test: fix cluster_rpc test failed
2024-07-08 17:04:41 +08:00
2069910ad1
feat: add cluster fix command
2024-07-08 17:04:41 +08:00
ae3b8fe146
test: create jwt authenticator with bad public key
2024-07-08 16:52:18 +08:00
f76444fbf8
fix: create authn jwt with bad public key
2024-07-08 16:52:18 +08:00
5fca0a16f9
feat: rename emqx_relup to emqx_post_upgrade
2024-07-08 10:33:09 +08:00
29d7a511f1
Merge pull request #13419 from zhongwencool/port-pr
...
Port: some minor bug fixes from master
2024-07-06 14:42:51 +08:00
f1b4467fe1
test(plugins): fix flaky test
...
Hypothesis is that both peer nodes were using the same directory and stepping on each
other's toes.
2024-07-05 14:17:42 -03:00
70fab51354
fix: handle `max_heap_size` = 0
...
Fixes https://github.com/emqx/emqx/issues/13417
Fixes https://emqx.atlassian.net/browse/EMQX-12659
2024-07-05 13:10:37 -03:00
c8258cebe8
Merge pull request #13414 from kjellwinblad/kjell/review_connector_error_logs_rabbitmq_etc/EMQX-12462
...
fix: make RabbitMQ error log messages easier to understand
2024-07-05 15:01:15 +02:00
36ee7bed77
docs(message transformation): add api examples
...
Fixes https://emqx.atlassian.net/browse/EMQX-12645
2024-07-05 09:59:27 -03:00
e7351d949d
fix(schema validation): forbid empty topic filter list
2024-07-05 09:51:43 -03:00
e99fee68c0
fix(message transformation): forbid empty topic filter list
...
Fixes https://emqx.atlassian.net/browse/EMQX-12646
2024-07-05 09:49:03 -03:00
7d851872ec
chore: update emqx_module's app version
2024-07-05 19:21:28 +08:00
d94fcb9cfd
test: fix api_config SUITE failed
2024-07-05 17:34:39 +08:00
ba3097dc56
fix: observer command crash when can't find object code
2024-07-05 17:34:33 +08:00
f0a1d785ca
fix: don't allow set active_n to negative int
2024-07-05 17:34:25 +08:00
8aab919f74
fix: load bad configs return unknown msg
2024-07-05 17:34:17 +08:00
b4cffc581b
fix: ws/wss's max_frame_size should > 0
2024-07-05 17:34:09 +08:00
094259f444
Merge pull request #13408 from zhongwencool/password-crash
...
chore: improve auth error for invalid salt/password type
2024-07-05 11:44:21 +08:00
9d0b5a9bc6
Merge pull request #13412 from JimMoen/fix-cert-notafter-badmatch
...
fix: obtain cert expiry epoch failed due to formated `generalTime`
2024-07-05 10:13:22 +08:00
d3d3303dcb
chore: improve auth error for invalid salt/password type
2024-07-05 10:12:24 +08:00
aa84ca5a88
Merge pull request #13386 from lafirest/feat/banned_boot_57
...
feat(banned): add a bootstrap file for banned
2024-07-05 08:47:40 +08:00
c4dd167cb9
feat: implement couchbase connector and action
...
Fixes https://emqx.atlassian.net/browse/EMQX-12545
2024-07-04 17:51:59 -03:00
b333babb4c
Merge pull request #13401 from thalesmg/20240703-r57-authz-ignore-api-metrics
...
fix(authz api): add new `ignore` metric to status response
2024-07-04 17:07:08 -03:00
d84d31cbc5
test: cert expiry epoch with `generalTime` formatted
2024-07-05 01:47:13 +08:00
b994e0f1c0
fix: make RabbitMQ error log messages easier to understand
...
Fixes:
https://emqx.atlassian.net/browse/EMQX-12462
2024-07-04 16:43:53 +02:00
420493deb4
chore: add missing mix files to new apps
2024-07-04 10:27:59 -03:00
d206d24975
fix: only set default for max_conn_rate and update test case
...
This revert the change in commit e291dcd
2024-07-04 14:32:10 +02:00
f758fd9279
Merge pull request #13405 from thalesmg/20240703-r57-test-flaky-table-removed-postgres
...
test(postgres bridge): attempt to stabilize flaky test
2024-07-04 09:25:15 -03:00
8c6cd69caa
fix: obtain cert expiry epoch failed due to formated `generalTime`
2024-07-04 18:23:56 +08:00
913e0ce18b
feat(banned): add a bootstrap file for banned
2024-07-04 09:12:12 +08:00
947cddb2eb
test: invalid map key is caught by hocon
...
now that hocon has a built-in map key validation,
some of the resource name validations are cought by hocon
2024-07-03 23:00:18 +02:00
eaaee725c2
fix: upgrade to hocon 0.43.1
...
included 3 changes since 0.42.2
- allow validation of map keys
- improve crash stacktrace report
- avoid dumping array environment variable values
2024-07-03 23:00:14 +02:00
7ee5b90084
Merge pull request #13400 from zmstone/0605-ACL-rules-in-http-authentication-response
...
feat(auth): support HTTP authn return ACL rules
2024-07-03 21:51:07 +02:00
32ace85e1c
Merge branch 'release-57' into 20240703-m-sync-r57
2024-07-03 16:03:15 -03:00
ae24b7a37b
Merge pull request #13404 from thalesmg/20240703-r57-refactor-mix-common-deps
...
ci(mix): refactor to avoid conflicts
2024-07-03 15:57:05 -03:00
72579f9014
test(postgres bridge): attempt to stabilize flaky test
...
```
%%% emqx_bridge_pgsql_SUITE ==> tcp.sync.with_batch.t_table_removed: FAILED
%%% emqx_bridge_pgsql_SUITE ==> {{panic,
#{msg => "Unexpected result",
result =>
{run_stage_failed,exit,
{test_case_failed,
"unexpected result: {error,{recoverable_error,sync_required}}"},
[{emqx_bridge_pgsql_SUITE,'-t_table_removed/1-fun-3-',3,
[{file,
"/emqx/apps/emqx_bridge_pgsql/test/emqx_bridge_pgsql_SUITE.erl"},
{line,822}]},
```
```
Error: -03T17:52:54.046809+00:00 [error] Generic server <0.352770.0> terminating. Reason: {'module could not be loaded',[{undefined,handle_message,[90,<<"I">>,{state,ssl,{sslsocket,{gen_tcp,#Port<0.1671>,tls_connection,undefined},[<0.352774.0>,<0.352773.0>]},<<>>,{336,-2093820527},on_message,{codec,#{},[null,undefined],{oid_db,#{16 =>
...
2024-07-03T17:52:54.075446+00:00 [critical] Run stage failed: exit:{test_case_failed,"unexpected result: {error,\n {resource_error,\n #{reason => exception,\n msg =>\n #{error =>\n {exit,\n {{undef,\n [{undefined,handle_message,\n [90,<<\"I\">>,\n {state,ssl,\n {sslsocket,\n {gen_tcp,#Port<0.1671>,tls_connection,\n
```
2024-07-03 15:05:00 -03:00
afb65817c4
ci(mix): refactor to avoid conflicts
...
This introduces a refactoring that will hopefully help avoid conflicts with ongoing work
to migrate our build / CI tooling to Mix.
2024-07-03 14:37:25 -03:00
187f5e5936
Merge pull request #13391 from keynslug/perf/EMQX-12611/avoid-stream-shuffle
...
perf(sessds): rotate through streams with iterators when fetching
2024-07-03 17:46:29 +02:00
d7d5eb2c52
test(bridge-s3): correct assertions to get rid of flakiness
2024-07-03 16:40:34 +02:00
532c7831b2
Merge pull request #13384 from thalesmg/20240701-r57-mt-new-fields
...
feat(message transformation): add more read-only fields to context
2024-07-03 11:27:27 -03:00
35f1ddc0eb
Merge pull request #13393 from thalesmg/20240702-r57-test-plugin-start-enabled
...
fix(plugins): ensure plugin apps are restarted when restarting `emqx_plugins`
2024-07-03 11:27:14 -03:00
9194756963
feat(auth): support HTTP authn return ACL rules
2024-07-03 15:37:11 +02:00
950f4d9483
fix(sessds): defend restartable stream iterator from infinite loop
2024-07-03 15:21:16 +02:00
947af1faaf
chore(sessds): rename `iterate` -> `iter_next` for consistency
2024-07-03 15:21:16 +02:00
c3579f338b
fix(authz api): add new `ignore` metric to status response
...
Fixes https://emqx.atlassian.net/browse/EMQX-12411
2024-07-03 10:16:18 -03:00
e1420a27bb
fix(plugins): ensure plugin apps are restarted when restarting `emqx_plugins`
...
Fixes https://emqx.atlassian.net/browse/EMQX-12628
Fixes https://github.com/emqx/emqx/issues/13378
2024-07-03 09:51:42 -03:00
2c3209e258
Merge pull request #13395 from thalesmg/20240702-r57-test-flaky-cluster-invite-timeout
...
test: attempt to fix flaky tests
2024-07-03 09:32:58 -03:00
fe256363ad
Merge pull request #13331 from lafirest/fix/error-msg
...
fix(api_keys): improved the error message when bootstrapping api_key
2024-07-03 15:38:44 +08:00
cfa29eaa6f
Merge remote-tracking branch 'upstream/release-57' into 20240702-m-sync-r57-mix-umbrella
2024-07-03 15:30:11 +08:00
5f321702e7
Merge pull request #13398 from zhongwencool/authz-db-clear-table
...
fix: don't destory when authz'source unchanged
2024-07-03 15:29:39 +08:00
9f44c50025
Merge pull request #13350 from HJianBo/add-peersni-to-client-attr
...
feat: support to extract the client peersni field to clientinfo
2024-07-03 15:29:21 +08:00
cfa7c3bf04
Merge remote-tracking branch 'upstream/release-57' into 20240702-m-sync-r57-mix-umbrella
2024-07-03 15:15:58 +08:00
112433da87
fix: don't destory when authz'source unchanged
2024-07-03 13:13:23 +08:00
ac6bbd2977
fix(api_keys): improved the error message when bootstrapping api_key
2024-07-03 11:08:47 +08:00
0dfa3e8c86
chore: ensure the module is loaded
2024-07-03 10:11:33 +08:00
920e039487
chore: fix failed tests
2024-07-03 09:55:45 +08:00
7c02e1979e
chore: add cluster_rpc_opts() type in emqx_config
2024-07-03 09:49:14 +08:00
059baf9ea5
test: add authz test case
2024-07-03 09:49:13 +08:00
e1c3b7587d
feat: do not fail on other nodes when the RPC succeeds on the first node
2024-07-03 09:49:13 +08:00
9ef3eff4c6
Merge pull request #13394 from thalesmg/20240702-r57-atom-leak-schema-registry
...
fix(schema registry): avoid atom leak
2024-07-02 17:40:26 -03:00
fdf43455d9
Merge pull request #13383 from thalesmg/20240701-r57-test-flaky-gconsu-multiple-pull-workers
...
test: attempts to stabilize flaky tests
2024-07-02 17:40:10 -03:00
b0c0c02df9
test: attempt to fix flaky tests
...
```
%%% emqx_mgmt_api_cluster_SUITE ==> t_cluster_invite_api_timeout: FAILED
%%% emqx_mgmt_api_cluster_SUITE ==>
Failure/Error: ?assertMatch([ # { core_node := Core1 , replicant_nodes := [ # { node := Replicant , streams := _ } ] } , # { core_node := Core2 , replicant_nodes := [ # { node := Replicant , streams := _ } ] } ], lists : sort ( Core1Resp ))
expected: = [ # { core_node := Core1 , replicant_nodes := [ # { node := Replicant , streams := _ } ] } , # { core_node := Core2 , replicant_nodes := [ # { node := Replicant , streams := _ } ] } ]
got: [#{core_node => 'data_backup_core1@127.0.0.1',
replicant_nodes => []},
#{core_node => 'data_backup_core2@127.0.0.1',
replicant_nodes =>
[#{node => 'data_backup_replicant@127.0.0.1',
streams => 7}]}]
line: 111
```
2024-07-02 15:15:03 -03:00
ea30d50125
fix(schema registry): avoid atom leak
...
Fixes https://emqx.atlassian.net/browse/EMQX-12603
2024-07-02 14:01:21 -03:00
1d5669d008
fix(sessds): tolerate removal of nonexistent gbt entries
2024-07-02 17:15:41 +02:00
5532f40d83
Merge branch 'release-57' into 20240702-m-sync-r57-mix-umbrella
2024-07-02 11:52:36 -03:00
f64bd313aa
Merge pull request #13263 from thalesmg/mix-umbrella-m-20240612
...
perf: "mixify" project to improve release speed (part 1)
2024-07-02 11:36:09 -03:00
55298ab6f3
Merge pull request #13387 from zhongwencool/dont-override-authn-users
...
fix: don't override authn users when import_user from authn.boostrap_file
2024-07-02 22:33:16 +08:00
3f0d59300b
Merge pull request #13348 from lafirest/fix/drop_payload
...
feat(log): allows custom the encoding of payload in the log
2024-07-02 21:47:48 +08:00
a57917b66b
perf(sessds): rotate through streams with iterators when fetching
...
This avoids expensive shuffling of the whole list of fetchable streams,
which can be quite long.
2024-07-02 15:42:33 +02:00
9a4f3f88e3
feat(sessds): allow stream iteration starting from a specific key
2024-07-02 15:40:40 +02:00
dc73b957b3
feat(sessds): use trees to hold streams in session state
2024-07-02 15:39:02 +02:00
4df2e0be85
fix: bad rebase conflict resolution
2024-07-02 10:21:52 -03:00
08596f886a
feat: add default csv file in authn-built-in-db
2024-07-02 21:18:38 +08:00
8e904099c7
fix: add boostrap_file/type to post authn_api
2024-07-02 21:18:37 +08:00
4d912516c8
fix: don't override authn users when import_user from authn.boostrap_file
2024-07-02 21:18:37 +08:00
bd0c8f0204
fix: bad conflict resolution
2024-07-02 09:47:49 -03:00
89bd69eb50
fix(bridge v1 api): return correct http response code when incompatible
2024-07-02 09:46:06 -03:00
8843fcbbf4
perf: use manifest to track proto file compilation
2024-07-02 09:45:47 -03:00
19f3b030f9
chore: preparing to run common tests / eunit with mix
2024-07-02 09:45:45 -03:00
b74828d7ea
perf: "mixify" project to improve release speed
...
Fixes https://emqx.atlassian.net/browse/EMQX-12527
2024-07-02 09:39:48 -03:00
dea2bf19b1
Merge pull request #13389 from lafirest/fix/builtin_acl
...
fix: fix two minor issues of bulti-in authn/authz
2024-07-02 20:19:53 +08:00
5a0bae2318
Merge pull request #13367 from thalesmg/20240628-r57-test-flaky-authz-cache
...
test(authz cache): attempt to fix flaky test
2024-07-02 09:14:06 -03:00
24ac241727
Merge pull request #13380 from thalesmg/20240701-r57-fix-http-bridge-hc-return-value
...
fix(http action): use correct return value for channel health check
2024-07-02 09:13:53 -03:00
db07a1ebea
feat(message transformation): add more read-only fields to context
...
Fixes https://emqx.atlassian.net/browse/EMQX-12583
2024-07-02 09:13:19 -03:00
686f79c036
fix: fix two minor issues of bulti-in authn/authz
...
1. the `Derived Key Length` for `pbkdf2` should be a positive integer.
2. fix topics in the authorization rules might be parsed incorrectly
2024-07-02 19:35:48 +08:00
a46440d00a
feat(log): allows custom the encoding of payload in the log
2024-07-02 19:33:31 +08:00
7e0bcd4eda
chore: tests in otp26
2024-07-02 15:26:07 +08:00
317b29451f
test(gcp consumer): attempt to stabilize flaky test
...
```
%%% emqx_bridge_kafka_impl_consumer_SUITE ==> ssl.t_start_and_consume_ok: FAILED
%%% emqx_bridge_kafka_impl_consumer_SUITE ==> {{panic,
#{msg => "Unexpected result",
result =>
{run_stage_failed,error,
{badmatch,{{1,0},timeout}},
[{emqx_bridge_kafka_impl_consumer_SUITE,
'-t_start_and_consume_ok/1-fun-12-',4,
[{file,
"/emqx/apps/emqx_bridge_kafka/test/emqx_bridge_kafka_impl_consumer_SUITE.erl"},
{line,1184}]},
{emqx_bridge_kafka_impl_consumer_SUITE,
t_start_and_consume_ok,1,
[{file,
"/emqx/apps/emqx_bridge_kafka/test/emqx_bridge_kafka_impl_consumer_SUITE.erl"},
{line,1171}]}]}}},
[{emqx_bridge_kafka_impl_consumer_SUITE,t_start_and_consume_ok,1,
[{file,
"/emqx/apps/emqx_bridge_kafka/test/emqx_bridge_kafka_impl_consumer_SUITE.erl"},
{line,1240}]},
```
2024-07-01 17:57:17 -03:00
c04e93838f
test(eviction agent): attempt to stabilize flaky test
...
```
%%% emqx_eviction_agent_SUITE ==> t_session_serialization: FAILED
%%% emqx_eviction_agent_SUITE ==>
Failure/Error: ?assertEqual(1, emqx_eviction_agent : session_count ( ))
expected: 1
got: 2
line: 348
```
2024-07-01 16:10:32 -03:00
59084dbfbe
fix(message transformation): correctly read from user properties in context
...
Port of https://github.com/emqx/emqx/pull/13316 to release-57
Fixes https://emqx.atlassian.net/browse/EMQX-12582
2024-07-01 14:53:42 -03:00
6dbb561944
Merge pull request #13355 from thalesmg/20240627-r57-fix-connector-api-bad-ssl-config
...
fix(connector api): handle bad tls config file conversion errors
2024-07-01 14:26:09 -03:00
b14856cf1a
refactor: improve error messages
2024-07-01 13:21:17 -03:00
72664780df
fix(http action): use correct return value for channel health check
...
Fixes https://emqx.atlassian.net/browse/EMQX-12622
2024-07-01 11:17:57 -03:00
532f04da9d
Merge pull request #13373 from id/0701-sync-release-57
...
sync release-57
2024-07-01 16:02:29 +02:00
d1e9b097d1
Merge pull request #13365 from thalesmg/20240628-r57-fix-dashboard-add-default-user-concurrently
...
fix(dashboard): handle add default user race condition
2024-07-01 10:22:32 -03:00
505f568c32
chore: bump apps versions
2024-07-01 13:52:27 +02:00
e28750b522
Merge remote-tracking branch 'upstream/release-57' into 0701-sync-release-57
2024-07-01 13:52:14 +02:00
e291dcdd18
fix: default value for max_conn_rate etc should be set to infinity
...
Before this commit the default value for the fields max_conn_rate,
messages_rate and bytes_rate were not set. This is fixed by setting the
default value to infinity. This breaks the corresponding dashboard
fields (they can not be edited) so the dashboard also needs to be
updated.
Fixes:
https://emqx.atlassian.net/browse/EMQX-12514
2024-07-01 13:16:26 +02:00
bd075caf56
Merge pull request #13358 from lafirest/fix/authn_reason
...
fix(events): fixed the reason format of the `authn_complete_event`
2024-07-01 18:46:18 +08:00
6c665037de
Merge pull request #13372 from lafirest/fix/gateway_license
...
fix: limit gateway connections with license
2024-07-01 18:46:05 +08:00
a0644d4612
chore: update app version
2024-07-01 16:32:08 +08:00
b5d507bad8
fix: limit gateway connections with license
2024-06-30 20:06:04 +08:00
ec6e862539
test(authz cache): attempt to fix flaky test
...
Hypothesis: some race condition involving the previous test case, which uses the same
clientid.
```
Testing apps.emqx.emqx_authz_cache_SUITE: *** FAILED test case 3 of 3 ***
%%% emqx_authz_cache_SUITE ==> t_drain_authz_cache: FAILED
%%% emqx_authz_cache_SUITE ==>
Failure/Error: ?assertEqual([], list_cache ( ClientPid ))
expected: []
got: [{{#{qos => 0,action_type => publish,retain => false},<<"t1">>},
{allow,1719599365019}}]
line: 72
```
2024-06-28 15:40:55 -03:00
9215b3710f
Merge pull request #13327 from thalesmg/fix-kprodu-delete-wolff-r57-20240624
...
fix(kafka and derivatives): add `alias` config to avoid clashes with same topic
2024-06-28 15:22:11 -03:00
b69f298058
fix(dashboard): handle add default user race condition
...
This can happen at least in tests, when nodes boot concurrently.
2024-06-28 15:18:23 -03:00
795d280861
fix(connector api): handle bad tls config file conversion errors
...
Fixes https://emqx.atlassian.net/browse/EMQX-12581
2024-06-28 14:31:31 -03:00
9ede62c9b1
Merge pull request #13356 from thalesmg/20240626-m-test-sparkplug-empty-roundtrip
...
test(schema registry): add test asserting the behavior of empty message roundtrip
2024-06-28 12:08:38 -03:00
2a9c27d206
Merge pull request #13345 from thalesmg/20240626-r572-fix-validate-schema-reg-name
...
fix(schema registry api): validate schema name when creating
2024-06-28 12:08:27 -03:00
063e7657b5
Merge pull request #13344 from thalesmg/20240626-r572-multi-node-bulk-subscribe
...
fix(client mgmt api): make bulk subscribe work again in clusters
2024-06-28 12:08:16 -03:00
067beece75
chore: add count to thrown error
2024-06-28 12:06:47 -03:00
7cf0e69fdf
chore: fix failed tests
2024-06-28 14:07:59 +08:00
e8176b80a6
fix(events): fixed the reason format of the `authn_complete_event`
2024-06-28 11:09:28 +08:00
zhongwencool