zhongwencool
57b67ebb37
Merge pull request #13481 from zhongwencool/match_rule_error
...
chore: add authz tag to match_rule_error log
2024-07-22 16:46:49 +08:00
Shawn
862336a2cb
feat: hide relup plugins from APIs and CLIs
2024-07-22 16:07:50 +08:00
id
ed2fab51e9
Merge remote-tracking branch 'origin/release-57' into sync-release-57-20240722-022026
2024-07-22 02:20:27 +00:00
Thales Macedo Garitezi
65544f34ec
chore: bump hocon -> 0.43.2
2024-07-19 17:25:18 -03:00
Thales Macedo Garitezi
8d535bbd24
Merge pull request #13464 from thalesmg/20240712-m-res-manager-shutdown-logs
...
chore: attempt to reduce race condition supervisor noproc shutdown error logs
2024-07-19 14:57:56 -03:00
Thales Macedo Garitezi
4d174b8678
feat(sources & actions api): add dependent rules to response
...
Fixes https://emqx.atlassian.net/browse/EMQX-12654
2024-07-19 14:43:55 -03:00
Thales Macedo Garitezi
eb2d3a3b7e
chore: attempt to reduce race condition supervisor shutdown errors
...
Fixes https://emqx.atlassian.net/browse/EMQX-12442
e.g.:
```
2024-05-23T08:52:39.811845+00:00 [error] Supervisor: {local,emqx_resource_manager_sup}. Context: shutdown_error. Reason: noproc. Offender: id=<<99, 101, 110, 115, 111, 114, 101, 100>>,pid=<0.7752.1030>.
```
It could be just a race condition, as it seems to be the case for resource manager: i) a call is made to the process to stop it; ii) the call times out; iii) the after clause ends up calling supervisor:terminate_child; iv) while the supervisor is finding the child to terminate, the process actually finishes terminating, and the supervisor receives a noproc reason back.
2024-07-19 10:57:00 -03:00
Thales Macedo Garitezi
ae828e8cfb
feat(connectors api): add dependent actions and sources to response
...
Fixes https://emqx.atlassian.net/browse/EMQX-12654
2024-07-19 10:33:48 -03:00
Thales Macedo Garitezi
464e202742
Merge pull request #13488 from thalesmg/20240718-m-mix-fix-machine-dep
...
chore(new mix build): fix app dependency for release
2024-07-19 09:21:02 -03:00
Andrew Mayorov
b7200656a5
Merge pull request #13486 from keynslug/fix/ci/ds-raft-flaky-next
...
test(dsraft): attempt to stabilize flaky testcases
2024-07-19 12:15:36 +02:00
Shawn
fc3405fe4c
fix: bp_api for relup
2024-07-19 17:35:36 +08:00
Shawn
f11dfce292
ci: suppress dialyzer checks for quicer and odbc types
2024-07-19 17:11:49 +08:00
Shawn
c61828460a
chore: emqx_utils_api:with_node/2 support simple http-code
2024-07-19 15:02:14 +08:00
Shawn
4d25f28bb2
fix: dialyzer checks
2024-07-19 14:19:50 +08:00
Shawn
3ad7dc262b
fix: some sanity-checks
2024-07-19 11:38:44 +08:00
Shawn
3c8ef35b18
fix: show relup status even if no packages installed
2024-07-19 11:20:37 +08:00
Thales Macedo Garitezi
01883e9759
chore(new mix build): fix app dependency for release
2024-07-18 11:33:02 -03:00
Thales Macedo Garitezi
ca47e4768d
Merge pull request #13485 from thalesmg/20240717-r57-rm-dead-code-purge-proto
...
chore: remove dead code
2024-07-18 09:22:27 -03:00
Andrew Mayorov
3a893626b8
Merge pull request #13474 from keynslug/ft/EMQX-12309/ds-cas-api
...
feat(ds): allow isolated batches with preconditions
2024-07-18 12:52:13 +02:00
Shawn
2008130071
feat: add HTTP APIs for relup
2024-07-18 18:48:38 +08:00
Ivan Dyachkov
4a04ffdca1
Merge pull request #13483 from id/20240717-sync-release-57
...
sync release-57
2024-07-18 10:41:49 +02:00
Ivan Dyachkov
c2d49ff34f
chore(rmq_tests): fix rabbitmq tests
...
Co-authored-by: Ilya Averyanov <av@rubybox.dev>
2024-07-18 08:34:00 +02:00
zhongwencool
ac52bf39ce
Merge pull request #13443 from zhongwencool/cluster-link-cli-load
...
fix: update cluster.links via cli
2024-07-18 09:13:59 +08:00
Andrew Mayorov
0e545ffcec
feat(ds): add dedicated `#message_matcher{}` for preconditions
2024-07-17 21:27:17 +02:00
Andrew Mayorov
2e89656a90
test(dsraft): start `t_replication_transfers_snapshots` from stable state
2024-07-17 20:01:55 +02:00
Andrew Mayorov
466fa41ec3
fix(dsraft): rely on last resort timeout with unresponsive replicas
...
This simplifies the shard transition scheduling logic and makes it less
prone to races.
2024-07-17 19:24:38 +02:00
Thales Macedo Garitezi
93c725732c
chore: remove dead code
2024-07-17 12:56:45 -03:00
Thales Macedo Garitezi
4edbcc55e7
Merge pull request #13463 from thalesmg/20240712-m-gprodu-backoff-retry
...
feat(gcp pubsub producer): retry on 502 and 503 http status code responses
2024-07-17 12:49:27 -03:00
Thales Macedo Garitezi
cd8bf2725a
Merge pull request #13453 from thalesmg/20240711-r57-mt-fixes
...
batch of message transformation fixes
2024-07-17 12:45:19 -03:00
Andrew Mayorov
0c05b3f019
fix(ds): make conditionals less confusing
2024-07-17 16:23:41 +02:00
Andrew Mayorov
78fe9304be
Merge pull request #13462 from keynslug/fix/ci/flaky-ds-raft
...
fix(dsraft): preserve pending replica set transitions
2024-07-17 16:11:59 +02:00
Andrew Mayorov
14022aded1
feat(ds): allow isolated batches with preconditions
...
Namely, single message deletions and preconditions that can be used to
build complex "compare-and-swap"-style operations. Also allow user to
declare that atomic batches support is needed for a DB.
2024-07-17 15:57:17 +02:00
Andrew Mayorov
02e1007a16
feat(dslocal): implement `force_monotonic_timestamps => false`
2024-07-17 15:49:50 +02:00
zhongwencool
3381eecd6f
chore: apply code review
2024-07-17 21:27:07 +08:00
zhongwencool
3c832db13d
test: test cluster.links reloaded
2024-07-17 21:06:48 +08:00
zhongwencool
937fb153c2
fix: fill_default/3 should populate default values for all parameters except the 'ds'
2024-07-17 21:06:48 +08:00
zhongwencool
7b6b9580c8
test: add test for updating cluster.links
2024-07-17 21:06:48 +08:00
zhongwencool
2783192f77
fix: update cluster.links via cli
2024-07-17 21:06:48 +08:00
zhongwencool
083537daa3
fix: retry not_found if conf file not exist
2024-07-17 21:06:48 +08:00
Andrew Mayorov
ae3812da85
feat(ds): allow to turn monotonic timestamps off for DB
...
That tells implementation how to assign timestamps to messages. Current
implicit default is now `force_monotonic_timestamps => true`.
2024-07-17 14:40:23 +02:00
Andrew Mayorov
6b130c6422
fix(dsraft): preserve pending replica set transitions
...
Otherwise, information about pending replica set transitions taking a
long time to complete could be lost on subsequent target set changes and
node crashes.
2024-07-17 12:17:07 +02:00
Ivan Dyachkov
292b331064
Merge remote-tracking branch 'upstream/release-57' into 20240717-sync-release-57
2024-07-17 11:29:25 +02:00
zhongwencool
52031441cf
chore: add authz tag to match_rule_error log
2024-07-17 12:21:32 +08:00
zhongwencool
604cff4887
feat: add rule tag to rule_engine log
2024-07-17 12:15:57 +08:00
lafirest
6697035812
Merge pull request #13441 from lafirest/feat/coap
...
feat(coap): use content-sensitive udp proxy for coap
2024-07-17 10:01:51 +08:00
Thales Macedo Garitezi
1ad02a11e2
Merge pull request #13455 from thalesmg/20240711-m-mix-umbrella-part-III-no-ci
...
sync new mix build work to master
2024-07-16 14:41:10 -03:00
Andrew Mayorov
d04915d6a6
test(dsraft): increase `ra_server` logging level for debugging
2024-07-16 15:54:49 +02:00
Andrew Mayorov
78bb102311
test(dsraft): attempt to start select testcases from stable state
2024-07-16 15:54:49 +02:00
Thales Macedo Garitezi
4a08bfc93f
feat(mix ct): improve failure logging
2024-07-15 09:26:04 -03:00
Thales Macedo Garitezi
02a0ccfdd1
ci: preparations for new mix build
2024-07-15 09:26:04 -03:00
Thales Macedo Garitezi
70786d6aca
test: fix suite apps
2024-07-15 09:26:04 -03:00
Thales Macedo Garitezi
066fd0481b
feat(mix): compile asn1 files
2024-07-15 09:26:04 -03:00
Thales Macedo Garitezi
9e4a84cf76
Merge pull request #13442 from thalesmg/20240709-r57-decouple-connector-action-hc
...
fix(resource manager): disentangle connector and channel health check frequencies
2024-07-15 09:12:07 -03:00
firest
ec183f1d4c
test(coap): fix ci errors
2024-07-15 10:52:37 +08:00
ieQu1
46c2c75b7b
fix(connection): Make process_msg function tail-recursive
2024-07-14 06:00:00 +02:00
Thales Macedo Garitezi
0e57b39cf2
feat(gcp pubsub producer): retry on 502 and 503 http status code responses
...
Fixes https://emqx.atlassian.net/browse/EMQX-12625
2024-07-12 15:29:59 -03:00
Andrew Mayorov
2401a2fb80
test(dsraft): run `t_join_leave_errors` case in tracing context
2024-07-12 18:28:24 +02:00
Thales Macedo Garitezi
96c9020727
chore: improve protobuf decoding error messages
...
Fixes https://emqx.atlassian.net/browse/EMQX-12677
2024-07-12 13:27:30 -03:00
Andrew Mayorov
af81800aec
chore(dsraft): log a bit more informative messages in shard allocator
2024-07-12 18:24:58 +02:00
Andrew Mayorov
8e8b382ec0
chore(dsraft): provide more details when replica is unready
2024-07-12 18:23:23 +02:00
Andrew Mayorov
70a760850f
chore(dsraft): correct comment spelling errors
2024-07-12 15:27:29 +02:00
Andrew Mayorov
205ad507ea
test(dsraft): attempt to ensure testcases start from stable state
...
Where "stable state" is currently defined as "everyone knows and agrees
on the current leader".
2024-07-12 15:26:00 +02:00
Ilya Averyanov
9ca8aeb155
chore(mgmt): reduce test flakyness
2024-07-12 12:10:49 +03:00
firest
854754eb60
feat(coap): use content-sensitive udp proxy for coap
2024-07-12 16:23:46 +08:00
firest
83cc3ffeb0
fix(banned): let the bootfile of banned be optional
2024-07-12 13:58:14 +08:00
lafirest
1b7d23cef4
Merge pull request #13451 from lafirest/fix/def_banned_file
...
fix: do not convert a empty file name to a empty list
2024-07-12 13:50:32 +08:00
Thales Macedo Garitezi
2816170e9d
chore: add `$events.message_transformation_failed` to rule engine tester
...
Fixes https://emqx.atlassian.net/browse/EMQX-12679
2024-07-11 17:52:08 -03:00
Thales Macedo Garitezi
5f595966d8
chore(message transformation): allow empty operation list
...
Fixes https://emqx.atlassian.net/browse/EMQX-12682
2024-07-11 17:52:08 -03:00
Thales Macedo Garitezi
04b547d6f5
fix(schema registry): handle large names during lookup
...
Fixes https://emqx.atlassian.net/browse/EMQX-12692
2024-07-11 14:35:31 -03:00
Thales Macedo Garitezi
f3c6d10f76
fix(mix): fix compile paths and deps
2024-07-11 14:19:23 -03:00
Thales Macedo Garitezi
01d89be743
feat(message transformation): add timestamp and pub_props fields to read context
...
Fixes https://emqx.atlassian.net/browse/EMQX-12684
Fixes https://emqx.atlassian.net/browse/EMQX-12678
2024-07-11 12:15:31 -03:00
Thales Macedo Garitezi
44e4b3616d
feat(variform): allow hyphens in identifiers
...
Fixes https://emqx.atlassian.net/browse/EMQX-12683
2024-07-11 12:15:23 -03:00
Kjell Winblad
a4cc3ba9e8
Merge pull request #13375 from kjellwinblad/kjell/fix_connector_lister_speed_limit_clearing/EMQX-12514
...
fix: default value for max_conn_rate etc should be set to infinity
2024-07-11 16:36:01 +02:00
firest
d9b5c5863b
fix: do not convert a empty file name to a empty list
2024-07-11 18:12:38 +08:00
lafirest
c9e12f30cd
Merge pull request #13444 from lafirest/fix/oidc
...
fix(oidc): Avoid crashes and avoid deleting jwks on update
2024-07-11 17:55:50 +08:00
zmstone
7664b06e98
Merge pull request #13434 from zmstone/0704-refine-rpc-config
...
0704 refine rpc config
2024-07-11 10:25:45 +02:00
ieQu1
4825079964
chore(ds): Support platform profile
2024-07-10 12:03:23 +02:00
firest
b0e3e405cf
fix(oidc): Avoid crashes and avoid deleting jwks on update
2024-07-10 15:22:43 +08:00
JimMoen
44d533fe6d
Merge pull request #13432 from JimMoen/0705-fix-jwt-pem-check
...
fix: create authn jwt with bad public key
2024-07-10 10:33:54 +08:00
zmstone
7a23ae7b4d
refactor: expose only server_port for rpc
...
previously, there were 4 port configs:
- tcp_server_port
- ssl_server_port
- tcp_client_port
- ssl_client_port
2024-07-09 22:26:29 +02:00
zmstone
ee13773496
refactor: rename rpc.tcp_client_num to rpc.client_num
...
tcp_client_num is kept as an alias
2024-07-09 22:26:29 +02:00
Thales Macedo Garitezi
48e604bda8
fix(mix grpc): include default erlc options
2024-07-09 15:56:30 -03:00
Thales Macedo Garitezi
818070ad44
test(mix): add integration test path
2024-07-09 15:56:30 -03:00
Thales Macedo Garitezi
5279ad76be
fix(grpc compiler): unload apps to avoid side effects
2024-07-09 15:56:30 -03:00
Thales Macedo Garitezi
b91515b131
fix(schema registry mix): gpb is a runtime dep
2024-07-09 15:56:30 -03:00
Thales Macedo Garitezi
6d94809950
Merge pull request #13415 from thalesmg/20240703-m-couchbase-action
...
feat: implement couchbase connector and action
2024-07-09 15:53:11 -03:00
Thales Macedo Garitezi
3c370a90aa
Merge pull request #13436 from thalesmg/20240708-r57-custom-headers-jwks
...
feat(jwks): allow specifying custom request headers
2024-07-09 15:52:44 -03:00
Thales Macedo Garitezi
9f8a1885a7
fix(resource manager): disentangle connector and channel health check frequencies
...
Fixes https://emqx.atlassian.net/browse/EMQX-12674
2024-07-09 14:53:39 -03:00
Thales Macedo Garitezi
d25c4ba06f
Merge pull request #13421 from thalesmg/20240705-r57-docs-mt-api-examples
...
docs(message transformation): add api examples
2024-07-09 10:16:53 -03:00
ieQu1
3721be65ee
fix(ds): Improve comments
2024-07-09 13:15:15 +02:00
ieQu1
d7732a6aac
test(ds): Attempt to stabilize a flaky test
2024-07-09 13:15:15 +02:00
ieQu1
e70c1cfea3
test(ds): Improve stability of replication test suite
2024-07-09 13:15:15 +02:00
ieQu1
dc4ae82798
test(ds): Add message ID
2024-07-09 13:15:14 +02:00
ieQu1
d1b574a67e
perf(dslocal): Run heavy-duty operations in a temporary process
2024-07-09 13:15:14 +02:00
ieQu1
661f79544b
fix(ds): Optimize hot loop of skipstream storage layout
2024-07-09 13:15:14 +02:00
ieQu1
23dafbb03b
feat(ds): Add a benchmarking tool for storage efficiency analysis
2024-07-09 13:15:14 +02:00
ieQu1
afeb2ab8aa
feat(ds): Add metrics for skipstream layout
2024-07-09 13:15:14 +02:00
ieQu1
b68ebb9a73
test(dsrepl): Generalize tests to use different storage layouts
2024-07-09 13:15:14 +02:00
ieQu1
8c5e4a2376
test(ds): Generalize storage layout test suite for different layouts
2024-07-09 13:15:14 +02:00
ieQu1
086e7256f5
feat(ds): Add configuration schema for skipstream LTS layout
2024-07-09 13:15:14 +02:00
ieQu1
a4642d4d06
feat(ds): Add a new storage layout engine: "skipstream"
...
This layout is based on LTS as well, but it uses separate index
streams for constrained replay of streams with learned wildcards
2024-07-09 13:15:14 +02:00
ieQu1
de48077ac4
test(ds): Add new helper functions
...
- Improve message comparison
- Add set operations
2024-07-09 13:15:14 +02:00
ieQu1
210556e545
feat(ds): Generalize value serialization
...
- Add a new utility module for message serialization
- Add experimental serializer based on ASN.1
2024-07-09 13:15:14 +02:00
ieQu1
843973ef32
fix(ds): bitfield_lts: static_key_size -> static_key_bits
2024-07-09 13:15:14 +02:00
ieQu1
f84fb34692
feat(ds_lts): New APIs: info, reverse lookups and topic compression
2024-07-09 13:15:14 +02:00
ieQu1
eb80402ccb
fix(ds): Improve typespecs and descriptions in storage_layer
2024-07-09 13:15:14 +02:00
ieQu1
71dad0242e
docs(ds): Move Raft-related parts to emqx_ds_builtin_raft README
2024-07-09 13:15:14 +02:00
ieQu1
afe1c5617d
refactor(ds): Rename macros for bitfield_lts metrics
2024-07-09 13:15:14 +02:00
ieQu1
0f2c19b656
refactor(ds): Move end_of_stream detection logic for delete_next
2024-07-09 13:15:14 +02:00
ieQu1
b565976794
fix(ds): Fix hashing of empty wildcard topic levels in bitfield_lts
2024-07-09 13:15:13 +02:00
Thales Macedo Garitezi
f00bb383d4
fix(ds builtin local): use `-include_lib` instead of relative path
2024-07-08 16:57:55 -03:00
Thales Macedo Garitezi
811184ddad
feat(jwks): allow specifying custom request headers
...
Fixes https://emqx.atlassian.net/browse/EMQX-12655
2024-07-08 15:40:52 -03:00
Thales Macedo Garitezi
d34fc7a03a
Merge pull request #13420 from thalesmg/20240705-r57-fix-mt-empty-topics
...
fix(schema validation & message transformation): forbid empty topic filter list
2024-07-08 10:15:08 -03:00
Thales Macedo Garitezi
166f5e5f12
Merge pull request #13426 from thalesmg/20240705-r57-test-flaky-plugin-start-enabled
...
test(plugins): fix flaky test
2024-07-08 09:19:53 -03:00
zhongwencool
820789a09f
fix: redact status when mark_fix_log begin
2024-07-08 17:32:45 +08:00
zhongwencool
457ea93570
test: add cluster_sync cli test
2024-07-08 17:04:41 +08:00
zhongwencool
f490a0cba2
feat: don't reset tnx_id when cluster_fix
2024-07-08 17:04:41 +08:00
zhongwencool
298211d101
chore: apply suggestions from code review
...
Co-authored-by: zmstone <zmstone@gmail.com>
2024-07-08 17:04:41 +08:00
zhongwencool
bdf3fc63a6
chore: add config leader to suggestion
2024-07-08 17:04:41 +08:00
zhongwencool
22fc3c49cc
chore: combine some common code into one function
2024-07-08 17:04:41 +08:00
zhongwencool
5b105fcdbb
chore: move emqx_conf_proto_v3 to emqx_conf_proto_v4
2024-07-08 17:04:41 +08:00
zhongwencool
3ed4340145
test: fix cluster_rpc test failed
2024-07-08 17:04:41 +08:00
zhongwencool
2069910ad1
feat: add cluster fix command
2024-07-08 17:04:41 +08:00
JimMoen
ae3b8fe146
test: create jwt authenticator with bad public key
2024-07-08 16:52:18 +08:00
JimMoen
f76444fbf8
fix: create authn jwt with bad public key
2024-07-08 16:52:18 +08:00
Shawn
5fca0a16f9
feat: rename emqx_relup to emqx_post_upgrade
2024-07-08 10:33:09 +08:00
zhongwencool
29d7a511f1
Merge pull request #13419 from zhongwencool/port-pr
...
Port: some minor bug fixes from master
2024-07-06 14:42:51 +08:00
Thales Macedo Garitezi
f1b4467fe1
test(plugins): fix flaky test
...
Hypothesis is that both peer nodes were using the same directory and stepping on each
other's toes.
2024-07-05 14:17:42 -03:00
Thales Macedo Garitezi
70fab51354
fix: handle `max_heap_size` = 0
...
Fixes https://github.com/emqx/emqx/issues/13417
Fixes https://emqx.atlassian.net/browse/EMQX-12659
2024-07-05 13:10:37 -03:00
Kjell Winblad
c8258cebe8
Merge pull request #13414 from kjellwinblad/kjell/review_connector_error_logs_rabbitmq_etc/EMQX-12462
...
fix: make RabbitMQ error log messages easier to understand
2024-07-05 15:01:15 +02:00
Thales Macedo Garitezi
36ee7bed77
docs(message transformation): add api examples
...
Fixes https://emqx.atlassian.net/browse/EMQX-12645
2024-07-05 09:59:27 -03:00
Thales Macedo Garitezi
e7351d949d
fix(schema validation): forbid empty topic filter list
2024-07-05 09:51:43 -03:00
Thales Macedo Garitezi
e99fee68c0
fix(message transformation): forbid empty topic filter list
...
Fixes https://emqx.atlassian.net/browse/EMQX-12646
2024-07-05 09:49:03 -03:00
zhongwencool
7d851872ec
chore: update emqx_module's app version
2024-07-05 19:21:28 +08:00
zhongwencool
d94fcb9cfd
test: fix api_config SUITE failed
2024-07-05 17:34:39 +08:00
zhongwencool
ba3097dc56
fix: observer command crash when can't find object code
2024-07-05 17:34:33 +08:00
zhongwencool
f0a1d785ca
fix: don't allow set active_n to negative int
2024-07-05 17:34:25 +08:00
zhongwencool
8aab919f74
fix: load bad configs return unknown msg
2024-07-05 17:34:17 +08:00
zhongwencool
b4cffc581b
fix: ws/wss's max_frame_size should > 0
2024-07-05 17:34:09 +08:00
zhongwencool
094259f444
Merge pull request #13408 from zhongwencool/password-crash
...
chore: improve auth error for invalid salt/password type
2024-07-05 11:44:21 +08:00
JimMoen
9d0b5a9bc6
Merge pull request #13412 from JimMoen/fix-cert-notafter-badmatch
...
fix: obtain cert expiry epoch failed due to formated `generalTime`
2024-07-05 10:13:22 +08:00
zhongwencool
d3d3303dcb
chore: improve auth error for invalid salt/password type
2024-07-05 10:12:24 +08:00
lafirest
aa84ca5a88
Merge pull request #13386 from lafirest/feat/banned_boot_57
...
feat(banned): add a bootstrap file for banned
2024-07-05 08:47:40 +08:00
Thales Macedo Garitezi
c4dd167cb9
feat: implement couchbase connector and action
...
Fixes https://emqx.atlassian.net/browse/EMQX-12545
2024-07-04 17:51:59 -03:00
Thales Macedo Garitezi
b333babb4c
Merge pull request #13401 from thalesmg/20240703-r57-authz-ignore-api-metrics
...
fix(authz api): add new `ignore` metric to status response
2024-07-04 17:07:08 -03:00
JimMoen
d84d31cbc5
test: cert expiry epoch with `generalTime` formatted
2024-07-05 01:47:13 +08:00
Kjell Winblad
b994e0f1c0
fix: make RabbitMQ error log messages easier to understand
...
Fixes:
https://emqx.atlassian.net/browse/EMQX-12462
2024-07-04 16:43:53 +02:00
Thales Macedo Garitezi
420493deb4
chore: add missing mix files to new apps
2024-07-04 10:27:59 -03:00
Kjell Winblad
d206d24975
fix: only set default for max_conn_rate and update test case
...
This revert the change in commit e291dcd
for all listener "short
path fields" except the field max_conn_rate so they no longer have a
default value. It also updates a test case that assume that no listener
config is created by default but this is no longer the case when there
is a default value for the max_conn_rate field.
2024-07-04 14:32:10 +02:00
Thales Macedo Garitezi
f758fd9279
Merge pull request #13405 from thalesmg/20240703-r57-test-flaky-table-removed-postgres
...
test(postgres bridge): attempt to stabilize flaky test
2024-07-04 09:25:15 -03:00
JimMoen
8c6cd69caa
fix: obtain cert expiry epoch failed due to formated `generalTime`
2024-07-04 18:23:56 +08:00
firest
913e0ce18b
feat(banned): add a bootstrap file for banned
2024-07-04 09:12:12 +08:00
zmstone
947cddb2eb
test: invalid map key is caught by hocon
...
now that hocon has a built-in map key validation,
some of the resource name validations are cought by hocon
2024-07-03 23:00:18 +02:00
zmstone
eaaee725c2
fix: upgrade to hocon 0.43.1
...
included 3 changes since 0.42.2
- allow validation of map keys
- improve crash stacktrace report
- avoid dumping array environment variable values
2024-07-03 23:00:14 +02:00
zmstone
7ee5b90084
Merge pull request #13400 from zmstone/0605-ACL-rules-in-http-authentication-response
...
feat(auth): support HTTP authn return ACL rules
2024-07-03 21:51:07 +02:00
Thales Macedo Garitezi
32ace85e1c
Merge branch 'release-57' into 20240703-m-sync-r57
2024-07-03 16:03:15 -03:00
Thales Macedo Garitezi
ae24b7a37b
Merge pull request #13404 from thalesmg/20240703-r57-refactor-mix-common-deps
...
ci(mix): refactor to avoid conflicts
2024-07-03 15:57:05 -03:00
Thales Macedo Garitezi
72579f9014
test(postgres bridge): attempt to stabilize flaky test
...
```
%%% emqx_bridge_pgsql_SUITE ==> tcp.sync.with_batch.t_table_removed: FAILED
%%% emqx_bridge_pgsql_SUITE ==> {{panic,
#{msg => "Unexpected result",
result =>
{run_stage_failed,exit,
{test_case_failed,
"unexpected result: {error,{recoverable_error,sync_required}}"},
[{emqx_bridge_pgsql_SUITE,'-t_table_removed/1-fun-3-',3,
[{file,
"/emqx/apps/emqx_bridge_pgsql/test/emqx_bridge_pgsql_SUITE.erl"},
{line,822}]},
```
```
Error: -03T17:52:54.046809+00:00 [error] Generic server <0.352770.0> terminating. Reason: {'module could not be loaded',[{undefined,handle_message,[90,<<"I">>,{state,ssl,{sslsocket,{gen_tcp,#Port<0.1671>,tls_connection,undefined},[<0.352774.0>,<0.352773.0>]},<<>>,{336,-2093820527},on_message,{codec,#{},[null,undefined],{oid_db,#{16 =>
...
2024-07-03T17:52:54.075446+00:00 [critical] Run stage failed: exit:{test_case_failed,"unexpected result: {error,\n {resource_error,\n #{reason => exception,\n msg =>\n #{error =>\n {exit,\n {{undef,\n [{undefined,handle_message,\n [90,<<\"I\">>,\n {state,ssl,\n {sslsocket,\n {gen_tcp,#Port<0.1671>,tls_connection,\n
```
2024-07-03 15:05:00 -03:00
Thales Macedo Garitezi
afb65817c4
ci(mix): refactor to avoid conflicts
...
This introduces a refactoring that will hopefully help avoid conflicts with ongoing work
to migrate our build / CI tooling to Mix.
2024-07-03 14:37:25 -03:00
Andrew Mayorov
187f5e5936
Merge pull request #13391 from keynslug/perf/EMQX-12611/avoid-stream-shuffle
...
perf(sessds): rotate through streams with iterators when fetching
2024-07-03 17:46:29 +02:00
Andrew Mayorov
d7d5eb2c52
test(bridge-s3): correct assertions to get rid of flakiness
2024-07-03 16:40:34 +02:00
Thales Macedo Garitezi
532c7831b2
Merge pull request #13384 from thalesmg/20240701-r57-mt-new-fields
...
feat(message transformation): add more read-only fields to context
2024-07-03 11:27:27 -03:00
Thales Macedo Garitezi
35f1ddc0eb
Merge pull request #13393 from thalesmg/20240702-r57-test-plugin-start-enabled
...
fix(plugins): ensure plugin apps are restarted when restarting `emqx_plugins`
2024-07-03 11:27:14 -03:00
zmstone
9194756963
feat(auth): support HTTP authn return ACL rules
2024-07-03 15:37:11 +02:00
Andrew Mayorov
950f4d9483
fix(sessds): defend restartable stream iterator from infinite loop
2024-07-03 15:21:16 +02:00
Andrew Mayorov
947af1faaf
chore(sessds): rename `iterate` -> `iter_next` for consistency
2024-07-03 15:21:16 +02:00
Thales Macedo Garitezi
c3579f338b
fix(authz api): add new `ignore` metric to status response
...
Fixes https://emqx.atlassian.net/browse/EMQX-12411
2024-07-03 10:16:18 -03:00
Thales Macedo Garitezi
e1420a27bb
fix(plugins): ensure plugin apps are restarted when restarting `emqx_plugins`
...
Fixes https://emqx.atlassian.net/browse/EMQX-12628
Fixes https://github.com/emqx/emqx/issues/13378
2024-07-03 09:51:42 -03:00
Thales Macedo Garitezi
2c3209e258
Merge pull request #13395 from thalesmg/20240702-r57-test-flaky-cluster-invite-timeout
...
test: attempt to fix flaky tests
2024-07-03 09:32:58 -03:00
zhongwencool
fe256363ad
Merge pull request #13331 from lafirest/fix/error-msg
...
fix(api_keys): improved the error message when bootstrapping api_key
2024-07-03 15:38:44 +08:00
zhongwencool
cfa29eaa6f
Merge remote-tracking branch 'upstream/release-57' into 20240702-m-sync-r57-mix-umbrella
2024-07-03 15:30:11 +08:00
zhongwencool
5f321702e7
Merge pull request #13398 from zhongwencool/authz-db-clear-table
...
fix: don't destory when authz'source unchanged
2024-07-03 15:29:39 +08:00
JianBo He
9f44c50025
Merge pull request #13350 from HJianBo/add-peersni-to-client-attr
...
feat: support to extract the client peersni field to clientinfo
2024-07-03 15:29:21 +08:00
zhongwencool
cfa7c3bf04
Merge remote-tracking branch 'upstream/release-57' into 20240702-m-sync-r57-mix-umbrella
2024-07-03 15:15:58 +08:00
zhongwencool
112433da87
fix: don't destory when authz'source unchanged
2024-07-03 13:13:23 +08:00
firest
ac6bbd2977
fix(api_keys): improved the error message when bootstrapping api_key
2024-07-03 11:08:47 +08:00
zhongwencool
0dfa3e8c86
chore: ensure the module is loaded
2024-07-03 10:11:33 +08:00
JianBo He
920e039487
chore: fix failed tests
2024-07-03 09:55:45 +08:00
zhongwencool
7c02e1979e
chore: add cluster_rpc_opts() type in emqx_config
2024-07-03 09:49:14 +08:00
zhongwencool
059baf9ea5
test: add authz test case
2024-07-03 09:49:13 +08:00
zhongwencool
e1c3b7587d
feat: do not fail on other nodes when the RPC succeeds on the first node
2024-07-03 09:49:13 +08:00
Thales Macedo Garitezi
9ef3eff4c6
Merge pull request #13394 from thalesmg/20240702-r57-atom-leak-schema-registry
...
fix(schema registry): avoid atom leak
2024-07-02 17:40:26 -03:00
Thales Macedo Garitezi
fdf43455d9
Merge pull request #13383 from thalesmg/20240701-r57-test-flaky-gconsu-multiple-pull-workers
...
test: attempts to stabilize flaky tests
2024-07-02 17:40:10 -03:00
Thales Macedo Garitezi
b0c0c02df9
test: attempt to fix flaky tests
...
```
%%% emqx_mgmt_api_cluster_SUITE ==> t_cluster_invite_api_timeout: FAILED
%%% emqx_mgmt_api_cluster_SUITE ==>
Failure/Error: ?assertMatch([ # { core_node := Core1 , replicant_nodes := [ # { node := Replicant , streams := _ } ] } , # { core_node := Core2 , replicant_nodes := [ # { node := Replicant , streams := _ } ] } ], lists : sort ( Core1Resp ))
expected: = [ # { core_node := Core1 , replicant_nodes := [ # { node := Replicant , streams := _ } ] } , # { core_node := Core2 , replicant_nodes := [ # { node := Replicant , streams := _ } ] } ]
got: [#{core_node => 'data_backup_core1@127.0.0.1',
replicant_nodes => []},
#{core_node => 'data_backup_core2@127.0.0.1',
replicant_nodes =>
[#{node => 'data_backup_replicant@127.0.0.1',
streams => 7}]}]
line: 111
```
2024-07-02 15:15:03 -03:00
Thales Macedo Garitezi
ea30d50125
fix(schema registry): avoid atom leak
...
Fixes https://emqx.atlassian.net/browse/EMQX-12603
2024-07-02 14:01:21 -03:00
Andrew Mayorov
1d5669d008
fix(sessds): tolerate removal of nonexistent gbt entries
2024-07-02 17:15:41 +02:00
Thales Macedo Garitezi
5532f40d83
Merge branch 'release-57' into 20240702-m-sync-r57-mix-umbrella
2024-07-02 11:52:36 -03:00
Thales Macedo Garitezi
f64bd313aa
Merge pull request #13263 from thalesmg/mix-umbrella-m-20240612
...
perf: "mixify" project to improve release speed (part 1)
2024-07-02 11:36:09 -03:00
zhongwencool
55298ab6f3
Merge pull request #13387 from zhongwencool/dont-override-authn-users
...
fix: don't override authn users when import_user from authn.boostrap_file
2024-07-02 22:33:16 +08:00
lafirest
3f0d59300b
Merge pull request #13348 from lafirest/fix/drop_payload
...
feat(log): allows custom the encoding of payload in the log
2024-07-02 21:47:48 +08:00
Andrew Mayorov
a57917b66b
perf(sessds): rotate through streams with iterators when fetching
...
This avoids expensive shuffling of the whole list of fetchable streams,
which can be quite long.
2024-07-02 15:42:33 +02:00
Andrew Mayorov
9a4f3f88e3
feat(sessds): allow stream iteration starting from a specific key
2024-07-02 15:40:40 +02:00
Andrew Mayorov
dc73b957b3
feat(sessds): use trees to hold streams in session state
2024-07-02 15:39:02 +02:00
Thales Macedo Garitezi
4df2e0be85
fix: bad rebase conflict resolution
2024-07-02 10:21:52 -03:00
zhongwencool
08596f886a
feat: add default csv file in authn-built-in-db
2024-07-02 21:18:38 +08:00
zhongwencool
8e904099c7
fix: add boostrap_file/type to post authn_api
2024-07-02 21:18:37 +08:00
zhongwencool
4d912516c8
fix: don't override authn users when import_user from authn.boostrap_file
2024-07-02 21:18:37 +08:00
Thales Macedo Garitezi
bd0c8f0204
fix: bad conflict resolution
2024-07-02 09:47:49 -03:00
Thales Macedo Garitezi
89bd69eb50
fix(bridge v1 api): return correct http response code when incompatible
2024-07-02 09:46:06 -03:00
Thales Macedo Garitezi
8843fcbbf4
perf: use manifest to track proto file compilation
2024-07-02 09:45:47 -03:00