Commit Graph

303 Commits

Author SHA1 Message Date
Rory Z 4157524910
feat(redis connector): redis connector support cluster (#5074) 2021-06-25 11:47:57 +08:00
Shawn 704af9f3b1
The config handler phase2 (#5052)
* refator(config_handler): handle and validate the updates to raw_configs

* fix(hocon): update hocon to 0.8.0

* refactor(config_handler): check and apply envs only in top-level handler

* refactor(config_handler): update config from top level to bottom level

* refactor(emqx_data_bridge): move configs to emqx.conf

* fix(emqx_schema): remove the extra config path

* fix(config_handler): load the emqx.conf when starting emqx_config_handler

* fix(data_bridge): API not working

* feat(config_handler): save updated configs to emqx_override.conf

* fix(config_handler): cannot find the emqx.conf and emqx_override.conf

* fix(emqx_config): cannot find the correct path for etc dir

* fix(test): load load emqx_schema foreign refereced apps

* refactor(emqx_plugin): do not generate configs before load plugins

All configs (including the configs for plugins) now should go into
the `emqx.conf`.

* fix(tests): update the test cases for plugins

* fix(tests): don't include schema from apps when testing

* fix(tests): use emqx-ct-helper branch hocon
2021-06-25 11:47:18 +08:00
k32 a14ab5f90a
Merge pull request #5053 from k32/dev/mgmt-shard
feat(emqx_management): mqtt_app shard
2021-06-23 19:42:47 +02:00
Rory Z 263aaff6d6
feat: add authz (#4852)
* feat(authorization): add authorization api

* feat(authorization): add check function

* feat(authorization): use hocon config file

* feat(authz): add mysql connector

* feat(authz): support pgsql

* feat(connector): support redis

* chore(authz): use "publish/subscribe/all" instead of "pub/sub/pubsub"
2021-06-23 10:55:38 +08:00
k32 239255f251 feat(emqx_management): mqtt_app shard 2021-06-21 18:02:11 +02:00
Shawn 8978464269
change resource,connectors,data_bridges as normal apps (#5034) 2021-06-19 16:27:21 +08:00
Zaiming Shi 6865f36d90 chore(rebar.config): use hocon 0.6.0
hocon 0.6.0 added supports for sensitive config flagging
sub-struct type checking, and remote struct referencing
2021-06-18 09:02:25 +08:00
William Yang fd785240f5 feat(quic): bump quicer to 0.0.3 2021-06-17 09:03:10 +02:00
William Yang af2faed107 feat(quic): switch to deps on emqx quicer repo 2021-06-17 09:03:10 +02:00
k32 6505340cb8 feat(rlog): Introduce routing RLOG shard 2021-06-16 16:05:10 +02:00
turtleDeng 0515ef6e45
feat(connector): add more connector (#4985) 2021-06-16 11:28:26 +08:00
William Yang 3200bbb301 fix(build): test with centos branch 2021-06-15 15:36:04 +02:00
William Yang 14057c033d feat(quic): support stop/start quic listeners. 2021-06-15 15:36:03 +02:00
William Yang 9570d01792 fix(quic): error handling for getstats.
- return {error, closed} instead
- quicer demo/3 branch.
2021-06-15 15:36:03 +02:00
William Yang 087aa1dd53 feat(quic): handle stream close. 2021-06-15 15:36:03 +02:00
William Yang 899ba579fc feat(quic): compile and start quicer listener. 2021-06-15 15:36:03 +02:00
Zaiming Shi 909814a34d fix(hocon): pin hocon 0.5.1 2021-06-15 12:35:07 +02:00
k32 13803f9159 feat(rlog): Add RLOG to EMQX 2021-06-14 15:05:36 +02:00
zhanghongtong 3b21ad7225 Merge branch master into main-v4.3 2021-06-11 09:27:46 +08:00
zhouzb 2769eb7751 fix(ehttpc): update ehttpc tag to fix bad log 2021-06-10 10:49:12 +08:00
Zaiming Shi 1715b87dce chore: move root level src, test, include, priv and etc to apps/emqx 2021-06-07 09:09:28 +02:00
Zaiming (Stone) Shi 65a660aaea
Merge pull request #4903 from emqx/resolve-master-dev/v5.0-conflict-release-version
Auto-pull-request-on-2021-05-31
2021-06-05 15:31:21 +02:00
Zaiming (Stone) Shi ee48c961d0
Merge branch 'dev/v5.0' into license-conf 2021-06-05 13:18:58 +02:00
Zaiming (Stone) Shi 5dab6985c1
Merge branch 'dev/v5.0' into resolve-master-dev/v5.0-conflict-release-version 2021-06-05 11:51:02 +02:00
Zaiming Shi da6a8e3991 chore(http_lib): use lib app 2021-06-05 10:45:38 +02:00
z8674558 9c6276a654 chore(bin/emqx): support license conf option 2021-06-04 22:10:16 +09:00
z8674558 b4eb0c4df6 chore(bin/emqx): use hocon get 2021-06-03 17:03:08 +09:00
Zaiming Shi f7bd206b9b chore: pin cuttlefish 4.0.1 2021-06-02 14:18:00 +02:00
z8674558 52e69b20b4 chore(rebar.config): bump hocon; no more unused import 2021-06-02 16:55:26 +09:00
z8674558 9cb2facfe1 chore(emqx_resource): unify dependency hocon to root rebar.config 2021-06-01 21:05:04 +09:00
Zaiming Shi b485c75266 fix: emqtt performance
emqtt 1.2.3.1 has the fix for big binary concatenation performance
2021-06-01 17:29:16 +08:00
z8674558 4b174b0277 feat(conf): use hocon schema 2021-06-01 17:05:52 +09:00
Zaiming (Stone) Shi 913420588d
Merge branch 'dev/v5.0' into resolve-conflict-to-5.0 2021-05-31 09:17:21 +02:00
DDDHuang 9d1f6ccc4b chore: ekka support etcd v3 2021-05-31 09:07:52 +08:00
Zaiming Shi f2262469cc build: pin gpb 4.11.2
gpb is only to compile protobuf,
it is not included in release tarball.
for some reason rebar3 fetches an unknown version without this pin
2021-05-27 19:38:51 +02:00
k32 812faf08a1 chore(logger): Update snabbkaffe to 0.13.0 2021-05-25 21:15:59 +02:00
z8674558 31cbb7aa97 Merge branch 'master' of github.com:emqx/emqx into merge-master 2021-05-25 12:50:50 +09:00
Zaiming Shi e82e24d21f fix: pin cuttlefish v3.3.5
this cuttlefish release has only changes in a test module
2021-05-24 15:15:37 +02:00
zhouzb 09f51e51bd chore(update dep): update right tag for ehttpc 2021-05-14 19:27:04 +08:00
zhouzb c6771a57b6 chore(update dep): update dep of ehttpc 2021-05-14 19:27:04 +08:00
Zaiming Shi 814588d1c8 Merge remote-tracking branch 'origin/master' into resolve-conflict-master-to-v5.0 2021-05-07 22:24:38 +02:00
Zaiming Shi ec69e51386 build: pin cuttlefish v4.0.0 (hocon) 2021-05-07 21:46:04 +02:00
zhanghongtong 6595d53962 build(relup): update build script for support relup 2021-05-07 21:25:10 +02:00
Zaiming Shi 30c214d64b build: fix relup hook point name 2021-05-07 14:04:15 +02:00
z8674558 3c4e95a246 chore(rebar.config): cuttlefish 3.3.3 -> 3.3.4 2021-05-07 10:41:03 +00:00
Zaiming Shi d904a1048b Merge remote-tracking branch 'origin/master' into merge-master-to-dev/v5.0 2021-04-30 15:09:31 +02:00
wwhai 4facf4afe0 fix(deps): change ecpool to 0.5.1 2021-04-28 09:50:31 +08:00
k32 6d4da4a01a chore(snabbkaffe): Update version to 0.12.0 2021-04-26 14:20:52 +02:00
wwhai 92e8ba574c fix(deps): update ecpool to 0.5.2 2021-04-26 15:15:30 +08:00
Shawn ab5b4beffe fix(gen_rpc): the port discovery not working on a large offset 2021-04-25 13:58:33 +08:00
Zaiming Shi dad7d9c597 fix(config): pin cuttlefish 3.3.3
to be backward compatible to 4.2.x
cuttlefish 3.3.3 includes a fix to handle empty string
environment variable translated to 'undefined', but not `""`
2021-04-19 08:39:26 +02:00
zhouzb 9bedd1bb4f chore(ehttpc): update tag of ehttpc 2021-04-15 21:47:20 +08:00
Zaiming Shi 0a092c8ba0 chore(build): pin ekka 0.8.1
wait mnesia table
2021-04-13 19:38:34 +02:00
zhanghongtong be36e51f6e feat(redis): redis sentinel support ssl connect 2021-04-13 14:42:08 +08:00
z8674558 b0c3c713b5 Merge branch 'master' of github.com:emqx/emqx into merge-master-to-v5 2021-04-13 00:09:17 +09:00
z8674558 d010830de8 chore(rebar.config): bump cuttlefish 2021-04-12 07:30:02 +00:00
Zaiming Shi 2a9a5e74d7 fix(bin/emqx): print cuttlefish error 2021-04-10 08:48:13 +00:00
Yudai Kiyofuji e3a5f65c88
feat(config): print override env (#4517) 2021-04-09 16:28:01 +02:00
Zaiming Shi d033d71982 chore(build): Pin snabbkaffe 0.10.0 2021-04-08 00:02:27 +02:00
z8674558 62f1bd8120 chore(rebar.config): use z8674558/cuttlefish temporalily 2021-04-07 20:29:53 +09:00
z8674558 971e6ca90e Merge branch 'master' of github.com:emqx/emqx into merge-master-to-v5 2021-04-07 20:29:08 +09:00
z8674558 9db5452b6c refactor(emqx.schema): use override_env to support alternative env 2021-04-05 17:04:01 +09:00
z8674558 299d489ef9 refactor(bin/emqx): use cuttlefish `get` to get values from .conf 2021-04-02 08:42:58 +02:00
Zaiming Shi 236f75b33b chore(rebar.config): Snabbkaffee should be a default dependency 2021-03-30 10:08:13 +02:00
Karol Kaczmarek ac7d097f16 chore(deps): minirest 0.3.5 2021-03-20 15:21:31 +01:00
Zaiming Shi 8e45fa1c8b feat(observer_cli): Add observer_cli 2021-03-13 18:50:18 +01:00
Zaiming Shi 5f064a8e42 chore(test): enable cover only when necessary
So that ad-hoc ./rebar3 eunit and ct can run faster
2021-03-11 19:06:03 +01:00
z8674558 efd4ef8091 Merge branch 'dev/v5.0' of private:emqx/emqx into fix-merge-conflict-master-to-5.0 2021-03-04 22:12:09 +09:00
Zaiming Shi 6fb5c9de42 chore(deps): upgrade replayq to version 0.3.2 2021-03-02 18:10:26 +01:00
Zaiming Shi dd06d70bce refactor(build): Move parse_transform module to root app
So we do not have to workaround the compile order issue
2021-03-02 08:40:19 +08:00
Zaiming Shi 5edef84332
Merge branch 'dev/v5.0' into fix-merge-conflict-master-to-5.0 2021-03-01 19:58:16 +01:00
Zaiming Shi ddadece0b2 chore(build): include emqx version as compile info 2021-02-28 21:56:47 +01:00
Zaiming Shi c54636b6c2 chore(build): inject emqx_vsn to all modules as attribute 2021-02-26 22:26:19 +01:00
z8674558 74b7ea34d9 feat(bin): let cuttlefish read env var 2021-02-19 01:09:06 +09:00
Zaiming Shi d4a43aa85c
Merge pull request #4189 from emqx/dev/v4.3.0
Auto-pull-request-on-2021-02-13
2021-02-13 21:36:01 +01:00
JianBo He e3d19b03c5 chore(deps): upgrade cowboy to 2.8.2 2021-02-13 18:29:39 +08:00
Zaiming Shi 55253f914c
Merge pull request #4149 from emqx/dev/v4.3.0
Auto-pull-request-on-2021-02-04
2021-02-04 23:17:10 +01:00
JianBo He 52c747ca6b chore(cover): add coverall back 2021-02-04 14:22:17 +08:00
z8674558 e8729fb00e Merge branch 'dev/v5.0' of private:emqx/emqx into merge430 2021-01-29 17:11:12 +09:00
JianBo He 9d465ac81f chore(deps): upgrade replayq to 0.3.1 2021-01-28 16:24:42 +08:00
Zaiming Shi c422b200be
Merge pull request #4088 from emqx/dev/v4.3.0
Auto-pull-request-on-2021-01-27
2021-01-27 22:02:52 +01:00
JianBo He 02cb8d0211 chore(style): set warnings_as_errors compile option 2021-01-27 18:02:12 +08:00
Zaiming Shi 937390fe0f
Merge pull request #4072 from emqx/dev/v4.3.0
Auto-pull-request-on-2021-01-25
2021-01-25 22:05:03 +01:00
Zaiming Shi 17d70772a8 refactor(emqx_recon): Use latest version recon
Moved recon dependency from emqx_recon to root
2021-01-23 11:42:28 +01:00
Zaiming Shi b9071394c4 Merge remote-tracking branch 'origin/dev/v4.3.0' into chore-merge-v430-to-v50 2021-01-21 23:53:12 +01:00
Yudai Kiyofuji 455f210b4c
feat(cuttlefish): use hocon as a parsing function (#4008)
* chore(conf): add quotation for hocon

* chore(conf): fix paths incompatible with hocon

* chore(conf): use hocon as parsing function

* chore(docker): add quotation to some env variables for hocon
2021-01-19 19:52:17 +09:00
JianBo He 7df1dea4db
perf(esockd): upgrade esockd to 5.8.0 (#4018)
To better support hot upgrades, in esockd 5.8.0 we
avoid saving anonymous functions in state.
2021-01-15 18:54:43 +08:00
Zaiming Shi 765e37ea26 fix(ekka): Upgrade to 0.8.0 to allow remsh
Before ekka 0.8.0, when epmd is not used, ekka_dist would calculate
a port number from node name. This does not work for remote consoles
because a remsh node name is like remsh81random0-<target-node>
i.e. the calculated port number is always the same as the target node.

The fix in 0.8.0 allows remsh prefixed nodes to use a range of
ports to listen.
2021-01-15 08:59:20 +01:00
ayodele.akingbule 50981a976d chore(minirest): dependency update 2020-12-25 07:42:01 +08:00
ayodele.akingbule 61d73ea530 chore(dialyzer): optimize dialyzer run 2020-12-23 11:33:02 +01:00
Zaiming Shi 0fe86341af chore(build): mod_vsn parse_transform is not for default profile
Since plugins are compile as default profile, the parse_transform
provided by relup_helper may not present when compiling other plugins
2020-12-16 14:29:03 +01:00
Zaiming Shi 59346a1103 chore(build): remove relup_helper untar post hook for now 2020-12-16 09:22:47 +01:00
Zaiming Shi 4fbc64d84e chore(release): Add OTP_VERSION file to release dir 2020-12-14 10:58:44 +01:00
Shawn 10dbb5bc96
Fix testcases warns (#3906) 2020-12-11 18:54:48 +08:00
Zaiming Shi 7bdd093ef5 Merge remote-tracking branch 'origin/dev/v4.3.0' into umbrella-fix-build 2020-12-11 08:55:57 +01:00
Zaiming Shi de233bc234 chore(build): Ensure etc dirs are copied to build dir 2020-12-11 08:19:26 +01:00
Zaiming Shi d4fb3f99fe chore(xref): Ignore xref checks for enterprise and generated modules
Schema registry is so far only used in enterprise edition.
Ignore xref for generated modules for protobuf
2020-12-11 08:19:26 +01:00
Zaiming Shi b2d3358368 chore(rebar): Move no_debug_info to per-profile config 2020-12-10 11:43:28 +01:00
Zaiming Shi 4cfe4e9940 fix(eqmx_sasl): Dialyzer warning 2020-12-10 11:22:38 +01:00
Zaiming Shi 8a86593cae fix(xref): Ignore xref for generated modules for protobuf 2020-12-10 09:24:19 +01:00