14022aded1
feat(ds): allow isolated batches with preconditions
...
Namely, single message deletions and preconditions that can be used to
build complex "compare-and-swap"-style operations. Also allow user to
declare that atomic batches support is needed for a DB.
2024-07-17 15:57:17 +02:00
02e1007a16
feat(dslocal): implement `force_monotonic_timestamps => false`
2024-07-17 15:49:50 +02:00
3381eecd6f
chore: apply code review
2024-07-17 21:27:07 +08:00
3c832db13d
test: test cluster.links reloaded
2024-07-17 21:06:48 +08:00
937fb153c2
fix: fill_default/3 should populate default values for all parameters except the 'ds'
2024-07-17 21:06:48 +08:00
7b6b9580c8
test: add test for updating cluster.links
2024-07-17 21:06:48 +08:00
2783192f77
fix: update cluster.links via cli
2024-07-17 21:06:48 +08:00
083537daa3
fix: retry not_found if conf file not exist
2024-07-17 21:06:48 +08:00
ae3812da85
feat(ds): allow to turn monotonic timestamps off for DB
...
That tells implementation how to assign timestamps to messages. Current
implicit default is now `force_monotonic_timestamps => true`.
2024-07-17 14:40:23 +02:00
6b130c6422
fix(dsraft): preserve pending replica set transitions
...
Otherwise, information about pending replica set transitions taking a
long time to complete could be lost on subsequent target set changes and
node crashes.
2024-07-17 12:17:07 +02:00
292b331064
Merge remote-tracking branch 'upstream/release-57' into 20240717-sync-release-57
2024-07-17 11:29:25 +02:00
6697035812
Merge pull request #13441 from lafirest/feat/coap
...
feat(coap): use content-sensitive udp proxy for coap
2024-07-17 10:01:51 +08:00
1ad02a11e2
Merge pull request #13455 from thalesmg/20240711-m-mix-umbrella-part-III-no-ci
...
sync new mix build work to master
2024-07-16 14:41:10 -03:00
d04915d6a6
test(dsraft): increase `ra_server` logging level for debugging
2024-07-16 15:54:49 +02:00
78bb102311
test(dsraft): attempt to start select testcases from stable state
2024-07-16 15:54:49 +02:00
4a08bfc93f
feat(mix ct): improve failure logging
2024-07-15 09:26:04 -03:00
02a0ccfdd1
ci: preparations for new mix build
2024-07-15 09:26:04 -03:00
70786d6aca
test: fix suite apps
2024-07-15 09:26:04 -03:00
066fd0481b
feat(mix): compile asn1 files
2024-07-15 09:26:04 -03:00
9e4a84cf76
Merge pull request #13442 from thalesmg/20240709-r57-decouple-connector-action-hc
...
fix(resource manager): disentangle connector and channel health check frequencies
2024-07-15 09:12:07 -03:00
ec183f1d4c
test(coap): fix ci errors
2024-07-15 10:52:37 +08:00
46c2c75b7b
fix(connection): Make process_msg function tail-recursive
2024-07-14 06:00:00 +02:00
0e57b39cf2
feat(gcp pubsub producer): retry on 502 and 503 http status code responses
...
Fixes https://emqx.atlassian.net/browse/EMQX-12625
2024-07-12 15:29:59 -03:00
2401a2fb80
test(dsraft): run `t_join_leave_errors` case in tracing context
2024-07-12 18:28:24 +02:00
96c9020727
chore: improve protobuf decoding error messages
...
Fixes https://emqx.atlassian.net/browse/EMQX-12677
2024-07-12 13:27:30 -03:00
af81800aec
chore(dsraft): log a bit more informative messages in shard allocator
2024-07-12 18:24:58 +02:00
8e8b382ec0
chore(dsraft): provide more details when replica is unready
2024-07-12 18:23:23 +02:00
70a760850f
chore(dsraft): correct comment spelling errors
2024-07-12 15:27:29 +02:00
205ad507ea
test(dsraft): attempt to ensure testcases start from stable state
...
Where "stable state" is currently defined as "everyone knows and agrees
on the current leader".
2024-07-12 15:26:00 +02:00
9ca8aeb155
chore(mgmt): reduce test flakyness
2024-07-12 12:10:49 +03:00
854754eb60
feat(coap): use content-sensitive udp proxy for coap
2024-07-12 16:23:46 +08:00
83cc3ffeb0
fix(banned): let the bootfile of banned be optional
2024-07-12 13:58:14 +08:00
1b7d23cef4
Merge pull request #13451 from lafirest/fix/def_banned_file
...
fix: do not convert a empty file name to a empty list
2024-07-12 13:50:32 +08:00
2816170e9d
chore: add `$events.message_transformation_failed` to rule engine tester
...
Fixes https://emqx.atlassian.net/browse/EMQX-12679
2024-07-11 17:52:08 -03:00
5f595966d8
chore(message transformation): allow empty operation list
...
Fixes https://emqx.atlassian.net/browse/EMQX-12682
2024-07-11 17:52:08 -03:00
04b547d6f5
fix(schema registry): handle large names during lookup
...
Fixes https://emqx.atlassian.net/browse/EMQX-12692
2024-07-11 14:35:31 -03:00
f3c6d10f76
fix(mix): fix compile paths and deps
2024-07-11 14:19:23 -03:00
01d89be743
feat(message transformation): add timestamp and pub_props fields to read context
...
Fixes https://emqx.atlassian.net/browse/EMQX-12684
Fixes https://emqx.atlassian.net/browse/EMQX-12678
2024-07-11 12:15:31 -03:00
44e4b3616d
feat(variform): allow hyphens in identifiers
...
Fixes https://emqx.atlassian.net/browse/EMQX-12683
2024-07-11 12:15:23 -03:00
a4cc3ba9e8
Merge pull request #13375 from kjellwinblad/kjell/fix_connector_lister_speed_limit_clearing/EMQX-12514
...
fix: default value for max_conn_rate etc should be set to infinity
2024-07-11 16:36:01 +02:00
d9b5c5863b
fix: do not convert a empty file name to a empty list
2024-07-11 18:12:38 +08:00
c9e12f30cd
Merge pull request #13444 from lafirest/fix/oidc
...
fix(oidc): Avoid crashes and avoid deleting jwks on update
2024-07-11 17:55:50 +08:00
7664b06e98
Merge pull request #13434 from zmstone/0704-refine-rpc-config
...
0704 refine rpc config
2024-07-11 10:25:45 +02:00
4825079964
chore(ds): Support platform profile
2024-07-10 12:03:23 +02:00
b0e3e405cf
fix(oidc): Avoid crashes and avoid deleting jwks on update
2024-07-10 15:22:43 +08:00
44d533fe6d
Merge pull request #13432 from JimMoen/0705-fix-jwt-pem-check
...
fix: create authn jwt with bad public key
2024-07-10 10:33:54 +08:00
7a23ae7b4d
refactor: expose only server_port for rpc
...
previously, there were 4 port configs:
- tcp_server_port
- ssl_server_port
- tcp_client_port
- ssl_client_port
2024-07-09 22:26:29 +02:00
ee13773496
refactor: rename rpc.tcp_client_num to rpc.client_num
...
tcp_client_num is kept as an alias
2024-07-09 22:26:29 +02:00
48e604bda8
fix(mix grpc): include default erlc options
2024-07-09 15:56:30 -03:00
818070ad44
test(mix): add integration test path
2024-07-09 15:56:30 -03:00
5279ad76be
fix(grpc compiler): unload apps to avoid side effects
2024-07-09 15:56:30 -03:00
b91515b131
fix(schema registry mix): gpb is a runtime dep
2024-07-09 15:56:30 -03:00
6d94809950
Merge pull request #13415 from thalesmg/20240703-m-couchbase-action
...
feat: implement couchbase connector and action
2024-07-09 15:53:11 -03:00
3c370a90aa
Merge pull request #13436 from thalesmg/20240708-r57-custom-headers-jwks
...
feat(jwks): allow specifying custom request headers
2024-07-09 15:52:44 -03:00
9f8a1885a7
fix(resource manager): disentangle connector and channel health check frequencies
...
Fixes https://emqx.atlassian.net/browse/EMQX-12674
2024-07-09 14:53:39 -03:00
d25c4ba06f
Merge pull request #13421 from thalesmg/20240705-r57-docs-mt-api-examples
...
docs(message transformation): add api examples
2024-07-09 10:16:53 -03:00
3721be65ee
fix(ds): Improve comments
2024-07-09 13:15:15 +02:00
d7732a6aac
test(ds): Attempt to stabilize a flaky test
2024-07-09 13:15:15 +02:00
e70c1cfea3
test(ds): Improve stability of replication test suite
2024-07-09 13:15:15 +02:00
dc4ae82798
test(ds): Add message ID
2024-07-09 13:15:14 +02:00
d1b574a67e
perf(dslocal): Run heavy-duty operations in a temporary process
2024-07-09 13:15:14 +02:00
661f79544b
fix(ds): Optimize hot loop of skipstream storage layout
2024-07-09 13:15:14 +02:00
23dafbb03b
feat(ds): Add a benchmarking tool for storage efficiency analysis
2024-07-09 13:15:14 +02:00
afeb2ab8aa
feat(ds): Add metrics for skipstream layout
2024-07-09 13:15:14 +02:00
b68ebb9a73
test(dsrepl): Generalize tests to use different storage layouts
2024-07-09 13:15:14 +02:00
8c5e4a2376
test(ds): Generalize storage layout test suite for different layouts
2024-07-09 13:15:14 +02:00
086e7256f5
feat(ds): Add configuration schema for skipstream LTS layout
2024-07-09 13:15:14 +02:00
a4642d4d06
feat(ds): Add a new storage layout engine: "skipstream"
...
This layout is based on LTS as well, but it uses separate index
streams for constrained replay of streams with learned wildcards
2024-07-09 13:15:14 +02:00
de48077ac4
test(ds): Add new helper functions
...
- Improve message comparison
- Add set operations
2024-07-09 13:15:14 +02:00
210556e545
feat(ds): Generalize value serialization
...
- Add a new utility module for message serialization
- Add experimental serializer based on ASN.1
2024-07-09 13:15:14 +02:00
843973ef32
fix(ds): bitfield_lts: static_key_size -> static_key_bits
2024-07-09 13:15:14 +02:00
f84fb34692
feat(ds_lts): New APIs: info, reverse lookups and topic compression
2024-07-09 13:15:14 +02:00
eb80402ccb
fix(ds): Improve typespecs and descriptions in storage_layer
2024-07-09 13:15:14 +02:00
71dad0242e
docs(ds): Move Raft-related parts to emqx_ds_builtin_raft README
2024-07-09 13:15:14 +02:00
afe1c5617d
refactor(ds): Rename macros for bitfield_lts metrics
2024-07-09 13:15:14 +02:00
0f2c19b656
refactor(ds): Move end_of_stream detection logic for delete_next
2024-07-09 13:15:14 +02:00
b565976794
fix(ds): Fix hashing of empty wildcard topic levels in bitfield_lts
2024-07-09 13:15:13 +02:00
f00bb383d4
fix(ds builtin local): use `-include_lib` instead of relative path
2024-07-08 16:57:55 -03:00
811184ddad
feat(jwks): allow specifying custom request headers
...
Fixes https://emqx.atlassian.net/browse/EMQX-12655
2024-07-08 15:40:52 -03:00
d34fc7a03a
Merge pull request #13420 from thalesmg/20240705-r57-fix-mt-empty-topics
...
fix(schema validation & message transformation): forbid empty topic filter list
2024-07-08 10:15:08 -03:00
166f5e5f12
Merge pull request #13426 from thalesmg/20240705-r57-test-flaky-plugin-start-enabled
...
test(plugins): fix flaky test
2024-07-08 09:19:53 -03:00
820789a09f
fix: redact status when mark_fix_log begin
2024-07-08 17:32:45 +08:00
457ea93570
test: add cluster_sync cli test
2024-07-08 17:04:41 +08:00
f490a0cba2
feat: don't reset tnx_id when cluster_fix
2024-07-08 17:04:41 +08:00
298211d101
chore: apply suggestions from code review
...
Co-authored-by: zmstone <zmstone@gmail.com>
2024-07-08 17:04:41 +08:00
bdf3fc63a6
chore: add config leader to suggestion
2024-07-08 17:04:41 +08:00
22fc3c49cc
chore: combine some common code into one function
2024-07-08 17:04:41 +08:00
5b105fcdbb
chore: move emqx_conf_proto_v3 to emqx_conf_proto_v4
2024-07-08 17:04:41 +08:00
3ed4340145
test: fix cluster_rpc test failed
2024-07-08 17:04:41 +08:00
2069910ad1
feat: add cluster fix command
2024-07-08 17:04:41 +08:00
ae3b8fe146
test: create jwt authenticator with bad public key
2024-07-08 16:52:18 +08:00
f76444fbf8
fix: create authn jwt with bad public key
2024-07-08 16:52:18 +08:00
5fca0a16f9
feat: rename emqx_relup to emqx_post_upgrade
2024-07-08 10:33:09 +08:00
29d7a511f1
Merge pull request #13419 from zhongwencool/port-pr
...
Port: some minor bug fixes from master
2024-07-06 14:42:51 +08:00
f1b4467fe1
test(plugins): fix flaky test
...
Hypothesis is that both peer nodes were using the same directory and stepping on each
other's toes.
2024-07-05 14:17:42 -03:00
70fab51354
fix: handle `max_heap_size` = 0
...
Fixes https://github.com/emqx/emqx/issues/13417
Fixes https://emqx.atlassian.net/browse/EMQX-12659
2024-07-05 13:10:37 -03:00
c8258cebe8
Merge pull request #13414 from kjellwinblad/kjell/review_connector_error_logs_rabbitmq_etc/EMQX-12462
...
fix: make RabbitMQ error log messages easier to understand
2024-07-05 15:01:15 +02:00
36ee7bed77
docs(message transformation): add api examples
...
Fixes https://emqx.atlassian.net/browse/EMQX-12645
2024-07-05 09:59:27 -03:00
e7351d949d
fix(schema validation): forbid empty topic filter list
2024-07-05 09:51:43 -03:00
e99fee68c0
fix(message transformation): forbid empty topic filter list
...
Fixes https://emqx.atlassian.net/browse/EMQX-12646
2024-07-05 09:49:03 -03:00
Andrew Mayorov