yuanbiao/emqx
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
18,628 Commits 393 Branches 684 Tags 74 MiB
bb549cdf8b
Commit Graph

18628 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Thales Macedo Garitezi
bb549cdf8b feat(actions): allow multiple action info modules per application 2023-11-22 09:33:01 -03:00
Ivan Dyachkov
d30aff79f2
Merge pull request #11998 from id/1122-stop-building-macos11-packages 
ci: stop building packages for macos-11
 2023-11-22 12:03:08 +01:00
Ivan Dyachkov
c074ed43dd chore: add changelog 2023-11-22 09:58:51 +01:00
Ivan Dyachkov
f1f62d3af1 ci: stop building packages for macos-11 2023-11-22 09:48:08 +01:00
ieQu1
ee191803ea
Merge pull request #11990 from ieQu1/dev/ds-shards 
Implement a prototype of durable message sharding
 2023-11-22 00:57:54 +01:00
Thales Macedo Garitezi
18e274e587
Merge pull request #11969 from thalesmg/migrate-gcp-pubsub-actions-m-20231116 
feat(gcp_pubsub_producer): migrate GCP PubSub producer to actions
 2023-11-21 17:27:03 -03:00
Zaiming (Stone) Shi
261f9190c2
Merge pull request #11994 from zmstone/1121-remove-windows-from-ci 
ci: remove windows from CI
 2023-11-21 21:12:12 +01:00
ieQu1
3165b4f645 fix(ds): Abort application startup when rocksdb is not avialable 2023-11-21 20:27:07 +01:00
ieQu1
3d823beb11 fix(ds): Apply review remarks 2023-11-21 19:37:01 +01:00
ieQu1
4d47490734 chore(ds): Rebase configuration 2023-11-21 19:37:01 +01:00
ieQu1
f5c71e8068 refactor(ds): Add a wrapper to the store batch API 2023-11-21 19:37:01 +01:00
ieQu1
2a1f7d946a feat(ds): Shard messages by publisher client ID 2023-11-21 19:37:01 +01:00
ieQu1
62542e5844 feat(ds): Metadata storage for the replication layer 2023-11-21 19:37:01 +01:00
Zaiming (Stone) Shi
55d1b07a41 ci: remove windows from CI 
Starting from v5.4.0, we will stop release windows packages.
The windows build scripts are still around, will be deleted
in follow-up PRs
 2023-11-21 19:36:38 +01:00
Thales Macedo Garitezi
9e1796ec4f feat(gcp_pubsub_producer): migrate GCP PubSub producer to actions 
Fixes https://emqx.atlassian.net/browse/EMQX-11157
 2023-11-21 14:22:42 -03:00
Thales Macedo Garitezi
6c9a8461f7
Merge pull request #11989 from thalesmg/confluent-action-m-20231120 
feat: add confluent connector/action
 2023-11-21 11:01:40 -03:00
Thales Macedo Garitezi
068d151b14
Merge pull request #11983 from thalesmg/sync-r53-to-m-20231120 
sync `release-53` to `master`
 2023-11-21 09:02:51 -03:00
Thales Macedo Garitezi
75ee3ced68 feat: add confluent connector/action 
Fixes https://emqx.atlassian.net/browse/EMQX-11044

See also: https://emqx.atlassian.net/wiki/spaces/EMQX/pages/712179934/Confluent+Integration
 2023-11-21 08:59:42 -03:00
Ilya Averyanov
c6fd1e4c75
Merge pull request #11971 from savonarola/1116-no-auth-rebalance-status 
feat(rebalance): improve rebalance usability
 2023-11-21 12:10:18 +02:00
Andrew Mayorov
cd48c283db
Merge pull request #11988 from keynslug/ft/EMQX-11222/basic-config 
feat(schema): introduce separate root for new session persistence
 2023-11-21 15:02:21 +07:00
Thales Macedo Garitezi
6f8630304d
Merge pull request #11980 from kjellwinblad/kjell/fix_fixup_callbacks/EMQX-11428 
fix: bridge to action upgrade fixup hook should run after upgrade
 2023-11-20 16:19:43 -03:00
Kjell Winblad
7fb5ade832 fix(kafka_producer): hocon renames kafka field 2023-11-20 19:20:13 +01:00
Ivan Dyachkov
fc6d08ca97
Merge pull request #11977 from id/2011-disable-copilot 
chore: remove github copilot placeholder from pr template
 2023-11-20 19:09:21 +01:00
Kjell Winblad
d214ae8772
fix: problems found by @thalesmg in code review 
Co-authored-by: Thales Macedo Garitezi <thalesmg@gmail.com>
 2023-11-20 18:59:57 +01:00
Andrew Mayorov
110a5a4896
feat(schema): introduce separate root for new session persistence 
With some knobs to choose a storage backend. Support only builtin
RocksDB-based backend with minimal configuration for now.
 2023-11-20 23:49:14 +07:00
Andrew Mayorov
8e107ffe45
Merge pull request #11958 from keynslug/ft/EMQX-9745/preserve-acks 
feat(sessds): preserve acks / replays in session state
 2023-11-20 23:40:22 +07:00
Kjell Winblad
edbfe090c9 feat: add custom callback for creating connector from bridge V1 config 2023-11-20 17:23:51 +01:00
Andrew Mayorov
9684e79ee0
fix(sessds): ensure dup flag is on for replayed messages 2023-11-20 22:54:40 +07:00
Kjell Winblad
3aa8044475 fix(action): upgrade and downgrade strategy 
This commit fixes the upgrade and downgrade strategy when upgrading
from a bridge V1 to connector and action or the other way around so that
the custom callbacks get the complete unchanged input instead of the
result of the automatic translation. The automatic translation is used
if the callback is not defined.
 2023-11-20 16:40:27 +01:00
Thales Macedo Garitezi
53e796bbd0 Merge remote-tracking branch 'origin/release-53' into sync-r53-to-m-20231120 2023-11-20 11:49:52 -03:00
Andrew Mayorov
ef7cfd0202
feat(sessds): add field to ds_pubrange for forward-compat 2023-11-20 19:56:55 +07:00
Thales Macedo Garitezi
b42d4e5ab0
Merge pull request #11950 from thalesmg/fix-bridge-v1-examples-r53-20231114 
fix(bridges_v1): avoid merging action examples for non-v1 bridges
 2023-11-20 09:12:23 -03:00
Thales Macedo Garitezi
926078b82c
Merge pull request #11960 from thalesmg/fix-kafka-producer-channel-status-r53-20231116 
fix(kafka_producer): make status `connecting` while the client fails to connect
 2023-11-20 09:12:05 -03:00
Stefan Strigler
d99f033d74
Merge pull request #11967 from sstrigler/bridge-v1-type-fun 
feat(emqx_bridge): action_info with dynamic lookup
 2023-11-20 12:35:22 +01:00
Kjell Winblad
79a764f117 fix: bridge to action upgrade fix up hook should run after upgrade 
This commit changes how the `emqx_action_info` callback
`bridge_v1_to_action_fixup/1` works. It is now called after the
automatic upgrade instead of before. Since the full Bridge V1 config
might be needed to do the fixup, it is provided in a special field
`<<"__bridge_v1_conf__">>`. The `<<"__bridge_v1_conf__">>` field is
removed after the callback is called and can thus be ignored if it is
not needed.
 2023-11-20 12:06:21 +01:00
Stefan Strigler
84ff7b0b38 feat(emqx_bridge): action_info with dynamic lookup 
This allows a n:1 relation between v1 bridge_types to action/connector types as
it's the case with mongodb for instance, where we had `mongodb_single`
`mongodb_sharded` etc and the new implementation will just have `mongodb`.
 2023-11-20 10:22:37 +01:00
Andrew Mayorov
7081f1951f
refactor(sessds): use ds_pubrange record as is 
Instead of converting it into almost similar runtime representation.
 2023-11-20 15:40:43 +07:00
Andrew Mayorov
a5ff4144fe
test(sessds): add complex testcase for session replay 2023-11-20 15:40:43 +07:00
Ivan Dyachkov
ba2133abb3 chore: remove github copilot placeholder from pr template 
https://githubnext.com/copilot-for-prs-sunset
 2023-11-20 09:12:38 +01:00
Andrew Mayorov
1246d714c5
feat(sessds): preserve acks / ranges in mnesia for replays 2023-11-20 13:33:48 +07:00
Andrew Mayorov
5b40304d1f
chore(sessds): simplify subscriptions handling 
There's currently no point in storing parsed topic filters in the
subscriptions table.
 2023-11-20 13:33:48 +07:00
Andrew Mayorov
648b6ac63e
chore(sessds): rename iterators -> subscriptions 
Also try to make clearer the difference between 2 flavors of topic
filter representation in use.
 2023-11-20 13:33:48 +07:00
Ilya Averyanov
e93e9ed108 feat(rebalance): improve rebalance usability 
* make availability API endpoint public
* allow connections during wait_health_check interval
* make availability status calculation more consistent and lightweight
* refactor test to get rid of some mocks and to use cth
 2023-11-18 21:29:16 +03:00
Thales Macedo Garitezi
6c19d1e78e
Merge pull request #11968 from kjellwinblad/kjell/bridge_v1_upgrade_downgrade_fixup_callbacks 
Bridge V1 config upgrade downgrade fixup callbacks
 2023-11-17 17:57:26 -03:00
Ilya Averyanov
034d4dcdcf
Merge pull request #11965 from savonarola/1117-fix-mongo-resource-stop-53 
fix deadlock while stopping mongodb resource
 2023-11-17 21:53:11 +02:00
Thales Macedo Garitezi
eb3f54184e refactor: address review comments and avoid transformations without schema knowledge 2023-11-17 16:16:34 -03:00
Kjell Winblad
86c126ffcd feat: callbacks for fixup after automatic Bridge V1 upgrade/downgrade 
This commit adds callbacks to the emqx_action_info module for
doing fixes (such as changing a field name) after the automatic
split of a Bridge V1 config or the merge of connector and action
configs for the compatibility layer.
 2023-11-17 16:10:08 -03:00
Kjell Winblad
9feba802e9 chore: add convenience function for creating action schemas 2023-11-17 16:10:08 -03:00
Ilya Averyanov
58437cd35a fix(mongodb): fix deadlock while stopping mongodb resource 2023-11-17 12:34:36 +03:00
Ilya Averyanov
bdbadaa2ca
Merge pull request #11955 from savonarola/1115-fix-mongo-resource-stop 
fix: fix deadlock while stopping mongodb resource
 2023-11-17 11:31:24 +02:00