Commit Graph

343 Commits

Author SHA1 Message Date
Zaiming (Stone) Shi 79be7f9420
Merge pull request #8308 from zmstone/0623-fix-relup
5.0: fix relup
2022-06-29 13:41:24 +01:00
Zaiming (Stone) Shi 01e29fb82d ci(relup): delete TODO, check both nodes for metrics data 2022-06-29 12:38:40 +02:00
Zaiming (Stone) Shi 888f637cdd docs(ci): add how to run in scripts/relup-test/README.md 2022-06-29 11:01:58 +02:00
Zaiming (Stone) Shi 4d4634335c ci: rename scripts/relup/ to scripts/relup-test 2022-06-29 08:07:19 +02:00
Zaiming (Stone) Shi 8b7fc490ae refactor: run relup test nodes in individual docker containers
When running EMQX in lux shell inside a docker container
the node won't boot due to load_failed for redbug modules
reason is still unknown
2022-06-29 07:10:45 +02:00
Zaiming (Stone) Shi b3f16ccb36 fix: Erlang distribution over TLS 2022-06-28 21:49:02 +02:00
Zaiming (Stone) Shi 184b337e84 chore: add a script to run relup lux test locally 2022-06-28 10:54:07 +02:00
Zaiming (Stone) Shi d3f8ebd10f ci: fix relup test workflow and upgrade builder to 5.0-17
builder 5.0-17 has emqtt-bench and lux included
so we do not need to rebuild the software for each ci job
2022-06-27 12:06:13 +02:00
ieQu1 a9ec193ef8 fix(prometheus): Disable authorization for metrics scraping endpoint 2022-06-23 00:31:53 +02:00
Zaiming (Stone) Shi e98cd47a16 ci: fix relup test for package build
the upgrade pacakage can only be .tar.gz package
2022-06-21 09:33:12 +02:00
Zaiming (Stone) Shi b467e11b2e fix(appup): fixed appup and version check scripts for 5.0 2022-06-20 22:20:31 +02:00
Zaiming (Stone) Shi 385566c1a0 docs: change descriptive info from 'community' to 'opensource' 2022-06-20 19:38:29 +02:00
Rory Z e986a6f2b4 ci: fix docker multi arch push error 2022-06-18 09:57:25 +08:00
Zaiming (Stone) Shi 9cd4587cfb
Merge pull request #8245 from DDDHuang/fix_mac
fix: mac build required pkg coreutils
2022-06-16 14:12:45 +01:00
Zaiming (Stone) Shi b3182609c3 ci: delete dpes cache from github work-flows 2022-06-16 13:07:27 +02:00
DDDHuang 7a875b3fec fix: mac build required pkg coreutils 2022-06-16 18:49:42 +08:00
Zaiming (Stone) Shi 92ea558ff3
Merge pull request #8238 from zmstone/0616-feat-add-dns-srv-record-resolution
feat: add dns.record_type config for cluster discovery
2022-06-16 10:53:28 +01:00
Zaiming (Stone) Shi 2e49ed74b9
Merge pull request #8235 from zmstone/0616-ci-ensure-sha256sum-for-macos-brew-install-coreutils
ci: ensure macos github runner installs coreutils
2022-06-16 10:02:01 +01:00
Zaiming (Stone) Shi 7d49d1ee5c feat: add dns.record_type config for cluster discovery 2022-06-16 08:59:09 +02:00
Zaiming (Stone) Shi 7715feb3e4 ci: ensure macos github runner installs coreutils 2022-06-16 07:53:20 +02:00
Zaiming (Stone) Shi 67b8e6c3bd test: add a script to test dns cluster node discovery 2022-06-16 01:34:16 +02:00
Zaiming (Stone) Shi b92708726a test: Dockerfile:s to build test images 2022-06-12 20:18:48 +02:00
Zaiming (Stone) Shi fc4d9e4dcd ci: use emqx-builder 5.0-16
Fixed openssl compatibility issue
2022-06-06 10:54:26 +02:00
ieQu1 83e5ec9b2d chore(ci): Bump emqx-schema-validate to 0.3.3 2022-05-31 18:00:33 +02:00
Zhongwen Deng 8aa60cc0a5 feat: generate a minimized emqx.conf 2022-05-31 19:20:27 +08:00
Zaiming (Stone) Shi 616f1ae302 ci: do not configure quic listener at all 2022-05-31 12:16:33 +02:00
Zaiming (Stone) Shi de6218dfa6 ci: do not configure quic listener for arm
quic listener is now not enabled by default
2022-05-31 12:11:23 +02:00
ieQu1 932384b7bd chore(ci): Bump schema validate to 0.3.2 2022-05-31 10:23:14 +02:00
Shawn 3385a8af75 chore: pin dashboard v0.34.0 2022-05-30 11:18:59 +08:00
Zaiming (Stone) Shi ebe4d7c3fb refactor: stop releasing edge edition
Prior to EMQX 5.0, the edge edition's main difference comaring
to standard edition are:
* Less number of plugins in the release (smaller package size)
* Smaller number is vm.args (for lower memory usage)

Starting from 5.0 most of the plugins are included as features,
the tuned vm.args arguments does not justify a special release edition.

Also as nanomq is getting mature,
EMQ's recommendtation for MQTT broker in edge is https://nanomq.io/
2022-05-26 20:05:46 +02:00
Shawn 3d7cab4288 fix: porting emqx_relup.erl from 4.4 2022-05-25 12:37:03 +08:00
Shawn eea9bd90b4 fix: remove the extra level of 'emqx' dir from .tar.gz 2022-05-25 02:00:01 +08:00
Shawn 7bc2d9edbb fix: remove bison from the required tools when building emqx 2022-05-21 14:17:12 +08:00
Shawn 5d65bdaa47 chore: ping emqx-builder to 5.0-15 2022-05-16 18:10:42 +08:00
Zaiming (Stone) Shi 4664a9fc53 ci(jq): temp fix for ACLOCAL paths 2022-05-16 09:56:50 +02:00
Zaiming (Stone) Shi 1c95c417f7
Merge pull request #7951 from zmstone/0514-fix-flaky-authn-test-case
0514 fix flaky authn test case
2022-05-16 06:55:28 +01:00
Zhongwen Deng ec625363cf fix: emqx can't start with systemctl 2022-05-15 17:13:56 +08:00
Zaiming (Stone) Shi 00198abfd7 chore: hint how to fix fmt in pre-commit hook 2022-05-15 09:19:31 +02:00
Zaiming (Stone) Shi f50fcf9f4e chore: delete per-app format scripts
Now that all apps are formated, we no longer need per-app format script
2022-05-11 09:15:32 +02:00
Shawn fc645f8d3e fix: please the spell checker 2022-05-07 23:44:36 +08:00
Shawn 48db7ceb5f fix: set AUTO_INSTALL_BUILD_DEPS for CI 2022-05-07 22:47:20 +08:00
Shawn d80b7c720b chore: check dependenies before building on Mac OSX 2022-05-07 22:16:44 +08:00
Zaiming (Stone) Shi eb03e6ca9b build(macos): do not depend on gsed 2022-05-07 08:56:12 +02:00
Kjell Winblad 74c33cd4e5 feat(rule_engine): add jq function to the rule engine
This commit adds a function to the rule engine that alows users
to transform text or JSON objects using [jq filter programs][1].

[jq][1] is a command line tool that can be used to transform
and filter JSON text using jq's built-in language. The rule engine
function that is added with this commit uses the
[Erlang jq NIF library][2] that wraps the jq C library in an
Erlang NIF function.

[1]: https://stedolan.github.io/jq/
[2]: https://github.com/emqx/jq
2022-05-04 17:09:16 +02:00
Xinyu Liu f28559ef62
Merge pull request #7820 from zmstone/0428-fix-flaky-test
test: ensure emqx_metrics gen_server stopped after each test
2022-04-29 14:21:21 +08:00
Zaiming (Stone) Shi e5c7c37861 ci: quick fix before emqx-builder image is renamed to el7 and el8 2022-04-29 07:59:24 +02:00
Zaiming (Stone) Shi 1e170da9e8 test: ensure emqx_metrics gen_server stopped after each test 2022-04-29 12:41:36 +08:00
Shawn 50f1dcef97 fix: update elixir CI yamls for getting rebar3 2022-04-28 23:07:38 +08:00
Shawn b05b77bcbc chore: port ensure-rebar3.sh from 4.x 2022-04-28 19:28:29 +08:00
Zaiming (Stone) Shi ad7272b162 ci: get OS from builder image name
cross build is running in container
can not run docker in dokcer
2022-04-28 10:48:02 +02:00
Zaiming (Stone) Shi 1064d14fcf
Merge pull request #7788 from zmstone/0426-add-pre-commit-hook-to-ensure-code-style
chore: add a pre-commit hook to auto format erlang code
2022-04-28 09:01:22 +01:00
Zaiming (Stone) Shi 37be7a4977 chore: update check-format.sh to reformat all apps 2022-04-27 15:50:17 +02:00
Zaiming (Stone) Shi af69899619 chore: add a pre-commit hook to auto format erlang code 2022-04-27 08:01:55 +02:00
DDDHuang 07444e3da5 chore: dashboard format code 2022-04-26 17:18:30 +08:00
DDDHuang 2ea66ebcee
Merge pull request #7749 from DDDHuang/fix_some_api
fix: create banned & dashboard default user name
2022-04-26 16:43:44 +08:00
DDDHuang 69f1a2ac86 fix: build i18n conf with dashboard app 2022-04-26 11:57:07 +08:00
Zaiming (Stone) Shi a4feb3e6e9 style: reformat emqx_auto_subscribe and emqx_conf 2022-04-25 18:05:10 +02:00
zhongwencool cee4607472
Merge pull request #7738 from zhongwencool/obfuscate_sensitive_config
feat: obfuscate sensitive values default_password
2022-04-24 14:05:23 +08:00
Zhongwen Deng 5223c3ee61 feat: obfuscate sensitive values default_password 2022-04-24 09:41:29 +08:00
Zaiming (Stone) Shi b445182335 style: reformat emqx_machine, emqx_plugin_libs, and emqx_statsd 2022-04-23 09:55:50 +02:00
firest c1ba15f8f0 fix(psk): reformat codes 2022-04-22 13:58:02 +08:00
zhongwencool d45700865e
Merge pull request #7708 from zhongwencool/i18n-conf
feat: emqx_conf_schema/emqx_plugins/emqx_dashboard I18n conf
2022-04-22 09:50:10 +08:00
ieQu1 67a94732ac chore(spellcheck): Bump container version to 0.3.1 2022-04-21 23:48:47 +02:00
Zhongwen Deng 393fbd2bdb feat: add emqx_dashboard i18n 2022-04-21 23:43:12 +08:00
Zaiming (Stone) Shi a0145f4692 chore(buildx.sh): no need to parameterise otp version and system 2022-04-19 22:25:59 +02:00
JimMoen db29080cd5 chore: add erlfmt app name and update git blame ignore revs 2022-04-19 18:57:41 +08:00
firest 48a9b37916 chore: update git-blame-ignore-revs 2022-04-19 15:46:25 +08:00
firest 2254764d88 chore: update git-blame-ignore-revs 2022-04-19 10:44:25 +08:00
zhongwencool ce915f0bbd
Merge pull request #7590 from zhongwencool/doc-i18n
feat: desc/label support i18n
2022-04-15 17:43:16 +08:00
Zhongwen Deng 700c2cfb39 feat: move *i18n.conf from etc to i18n dir 2022-04-15 10:43:37 +08:00
Zhongwen Deng 630cc8ee34 feat: support i18n with desc struct. 2022-04-15 08:42:13 +08:00
firest 4db2761804 chore: update git-blame-ignore-revs 2022-04-14 15:06:01 +08:00
JianBo He 8500200e81 Merge remote-tracking branch 'ce/master' into fmt-gw 2022-04-01 09:52:12 +08:00
JimMoen c192bb51e3 style: add `authn` & `authz` erlfmt and git blame ignore 2022-04-01 02:21:52 +08:00
JianBo He 3f6d78dda0 style(gateway): format gateway application 2022-03-31 17:41:32 +08:00
JianBo He 4249d4345b chore: support fmt subdir source files 2022-03-31 17:40:51 +08:00
Zaiming (Stone) Shi a125bf9469 style: add emqx_enterprise_conf erlfmt commit to git blame ignore 2022-03-25 16:55:59 +01:00
Zaiming (Stone) Shi ce7e66d039
Merge pull request #7411 from zmstone/style-erlfmt-app-lib-ee-emqx_license
style: erlfmt app lib-ee/emqx_license
2022-03-25 15:11:22 +01:00
Zaiming (Stone) Shi b49df4599a build: use latest builder images (alpine 3.15.1)
OpenSSL-1.1.1n
2022-03-25 07:38:39 +01:00
Zaiming (Stone) Shi ee1b826d2a chore: less verbose debug info from elvis-check 2022-03-25 07:26:43 +01:00
Zaiming (Stone) Shi 24c55ab5cc style: Add lib-ee/emqx_license to reformatted list 2022-03-25 07:15:16 +01:00
Thales Macedo Garitezi 690843ba24
chore: add emqx_modules to the CI format check 2022-03-22 09:53:46 -03:00
Zaiming (Stone) Shi 8cd5c0c83a chore: add a simple bash to wrap format_app.py to be used in CI 2022-03-21 17:16:28 +01:00
Zaiming (Stone) Shi 817aa3051b chore: make format_app.py accept path to app
prior to this change, the script accepts the app name
and assumes the app is in 'apps' sub dir.

however, we have lib-ee for enterprise,
we may also technically have the same app reside in more than
two sub-dirs e.g. lib-ce and lib-ee
2022-03-21 17:11:12 +01:00
Zaiming (Stone) Shi 9d96d3d10a test: fix auto_subscribe test case 2022-03-15 20:40:28 +01:00
Zaiming (Stone) Shi f9aba61dbb ci: run ct in concurrent jobs 2022-03-15 20:40:22 +01:00
Zaiming (Stone) Shi 02598feffc chore: make find-apps.sh able to print json 2022-03-15 15:36:44 +01:00
ieQu1 b79ef3f0d9 docs: Add documentation for the cluster 2022-03-14 10:36:09 +01:00
Chris Hicks ee4673ee9c
Merge pull request #7256 from mononym/format_script
feat: add file to assist in formatting application
2022-03-14 09:25:56 +01:00
Zaiming (Stone) Shi 49ad66b4bd ci: no need for rocksdb cache anymore 2022-03-11 14:54:00 +01:00
Chris f21fb241d6 feat: add file to assist in formatting application 2022-03-10 10:27:57 +01:00
Zhongwen Deng 02d9aae82d chore: add more log in check-nl-at-eof.sh 2022-03-08 14:56:44 +08:00
Zaiming (Stone) Shi e6495f4300 ci: upgrade emqx-builder to 5.0-8:1.13.3-24.2.1-1 2022-03-02 21:57:26 +01:00
Zaiming (Stone) Shi b68cb96bd2 refactor: make pkg-vsn.sh able to report both short and long version 2022-02-26 01:38:10 +01:00
Zaiming (Stone) Shi 7e575f54c3 build: down prioritise docker buildx 2022-02-25 11:33:01 +01:00
Zaiming (Stone) Shi 2d3859a79a build: get full version from pkg-full-vsn.sh
this is due to the mapping of :
centos7 -> el7
and rockylinux8 -> el8

with this fix, there is no need to repeat such mapping
in many differennt places
2022-02-25 11:33:01 +01:00
Zaiming (Stone) Shi b2cb7f1bd5 build: update to latest builder image 2022-02-25 09:09:30 +01:00
Zaiming (Stone) Shi fa91c7491f build: rockylinux 2022-02-25 09:09:30 +01:00
Zaiming (Stone) Shi bdd1c32ceb chore: cosmetic, only indentation fix 2022-02-24 13:08:32 +01:00
Zaiming (Stone) Shi bd39fc6bb2 chore(pkg-tests.sh): delete dead code 2022-02-24 13:08:32 +01:00
Zaiming (Stone) Shi c2bd30466f build: slient pushd and popd 2022-02-22 22:33:33 +01:00
Zaiming (Stone) Shi f173a2f61f
Merge pull request #7082 from zmstone/build-refine-scripts-and-ci
chore: relocate tests.sh
2022-02-22 14:29:42 +01:00
ieQu1 2b2c6a4d1b docs(node): Add documentation for the node 2022-02-21 19:53:11 +01:00
Zaiming (Stone) Shi 1aa9abdb4d chore: relocate tests.sh 2022-02-21 12:22:53 +01:00
k32 115c3f2d29 chore: Fix URLs 2022-02-21 10:13:09 +01:00
k32 ef0da4fc70 ci: Spellcheck documentation in the CI 2022-02-18 13:32:33 +01:00
zhanghongtong 093e7c3282 build(relup): add new script for download relup base packages 2022-02-16 18:23:02 +01:00
Zaiming (Stone) Shi 2e94880bb6 docs: More EMQ X -> EMQX rename in descriptive strings 2022-02-15 22:39:11 +01:00
Zaiming (Stone) Shi 072ecd06f6 chore: exclude alpha beta and rc tags when checking app.src vsn bump 2022-02-14 22:23:52 +01:00
Zaiming (Stone) Shi 525bf47618 chore(buildx.sh): set bash -x option after help message 2022-02-10 12:40:46 +01:00
Thales Macedo Garitezi eea217093b
fix(mix): include `node_dump` in tgz and packages 2022-02-07 18:15:17 -03:00
Ilya Averyanov 17599432d1 feat(license): add license application 2022-02-07 19:05:47 +03:00
William Yang c9561478ac ci(build-cache): elixir build cache 2022-02-02 12:33:35 +01:00
William Yang 5c36143186 ci: remove centos8 support
due to centos8 EOL
2022-02-01 15:22:41 +01:00
William Yang fd23581dc0
Merge pull request #6880 from qzhuyan/ci/william/aws-arm64-runner
ci: use aws arm64 runner in cross build jobs
2022-02-01 09:05:58 +01:00
Zaiming (Stone) Shi c643db6bca build: move otp version check to rebar.config.erl 2022-01-31 16:39:14 +01:00
William Yang 4b71495101 ci: export CODE_PATH in test 2022-01-31 16:14:24 +01:00
William Yang d7b70982d9 build(buildx): add support to run without docker 2022-01-31 16:14:22 +01:00
Thales Macedo Garitezi d4a16fc94a
Merge pull request #6887 from emqx/mix-use-mix_env
chore(mix): use MIX_ENV to define build profile and edition

Instead of reading some environment variables to define the build profile for the Elixir build, we use the MIX_ENV value to emulate Rebar3's profiles. Also, that makes the build output directory more similar to EMQ X's current scheme.
2022-01-31 10:38:00 -03:00
Thales Macedo Garitezi a597e92576
chore(mix): use MIX_ENV to define build profile and edition 2022-01-28 17:24:35 -03:00
William Yang 177d42cad4 ci(docker): scripts/docker-create-push-manifests.sh 2022-01-28 19:37:01 +01:00
k32 052bd9081d docs(schema): Fix typos in the schema files 2022-01-27 22:39:19 +01:00
Thales Macedo Garitezi bd0d331b64
Merge pull request #6636 from emqx/elixir-packages-mkII
ci(mix): build emqx packages with elixir
2022-01-27 11:10:30 -03:00
Kian-Meng Ang fc92e4c8bf docs: fix typos 2022-01-27 12:29:38 +01:00
Thales Macedo Garitezi bba595a91f
fix(elixir): guard against missing elixir installation 2022-01-26 16:59:50 -03:00
Thales Macedo Garitezi 9c68f4bd11
fix(tgz): replace zip with tgz after rebase 2022-01-26 16:59:49 -03:00
Thales Macedo Garitezi 1240c40364
chore(ci): build only a few zips with elixir, build docker image with
elixir
2022-01-26 16:59:49 -03:00
Thales Macedo Garitezi 59f0d5f537
chore(mix): use flag instead of elixirpkg to denote package type
Also, add Makefile target to build zip files with Elixir.
2022-01-26 16:59:49 -03:00
Thales Macedo Garitezi ba6d4e4a19
fix(ci): raspbian arch is arm, not arm64 2022-01-26 16:59:49 -03:00
Thales Macedo Garitezi a91880780a
chore(elixir): change image/package versioning convention
We now go from "most specific" to "most general" versions: Elixir ->
OTP -> OS.
2022-01-26 16:59:48 -03:00
Thales Macedo Garitezi 6dd11665bb
ci(mix): build emqx packages with elixir 2022-01-26 16:59:48 -03:00
Zaiming (Stone) Shi d44c6eedfd ci: find relup base version using a script 2022-01-26 18:29:55 +01:00
Zaiming (Stone) Shi f3fe3db771 build: fix shellcheck 2022-01-26 14:25:59 +01:00
Zaiming (Stone) Shi 391e480824 build: parameterise package version
so that community and enterprise edition can be built from the
same branch
2022-01-26 14:25:59 +01:00
Zaiming (Stone) Shi bfbc87aaca refactor(config): delete generated includes
In the following commits, the overrides will be loaded at runtime
2022-01-24 13:30:42 +01:00
Zaiming (Stone) Shi 638a9d1af7 build: change to build .tar.gz instead of zip 2022-01-13 18:54:01 +01:00
William Yang 56859a7fb0
Merge pull request #6716 from qzhuyan/ci/william/build-cache-for-cross-build-packages
build cache for cross build packages
2022-01-12 15:22:05 +01:00
William Yang e388ad1b21 ci(build-cache): add scripts/get-dep-refs.sh 2022-01-12 11:58:50 +01:00
Zaiming (Stone) Shi b2684b995d build: doc for win 2022-01-10 12:30:01 +01:00
Zaiming (Stone) Shi 4897e00aab chore(scripts): get-distro support windows 2022-01-10 12:15:23 +01:00
Zaiming (Stone) Shi 9f7b513a3f chore: fix copyright update script to include more files 2022-01-06 08:44:35 +01:00
Zaiming (Stone) Shi 153a44876e chore: add a script to update copyright end-year 2022-01-05 20:55:00 +01:00
Thales Macedo Garitezi b9494662ae
fix(ci): fix shellcheck file pattern
Since we started to use the portable shebang style for our scripts, we
need to update the pattern used to find scripts for Shellcheck to
check.
2022-01-05 11:34:04 -03:00
Zaiming (Stone) Shi 5df382f054
Merge pull request #6598 from zmstone/ci-port-changes-from-4.4
[5.0] CI port changes from 4.4
2022-01-04 18:52:25 +01:00
Zaiming (Stone) Shi 320506957c refactor(bin/emqx): wait for up to 120 seconds by default 2022-01-04 17:28:53 +01:00
Thales Macedo Garitezi 93cdf318c7
fix(ci): setup mix before running check 2022-01-04 13:28:03 -03:00
Thales Macedo Garitezi d78e9429f3
ci(mix): rm mix.lock from repo
While Mix is not the main build tool, we remove the commited
`mix.lock` file to reduce friction when updating dependencies, since
it requires remembering to run `mix deps.get` to update the
`mix.lock`, used by a CI check in
`scripts/check-elixir-deps-discrepancies.exs`.  We change said script
to produce the required file on the fly.
2022-01-04 12:10:58 -03:00
Thales Macedo Garitezi 1d71256305
chore(deps): update mix.lock (mongodb) 2022-01-03 10:02:59 -03:00
Thales Macedo Garitezi c29bc126ef
Merge pull request #6507 from emqx/build-with-mix-mkII
Build with Elixir Mix Release
2021-12-30 15:00:38 -03:00
Thales Macedo Garitezi fe444bf134
chore(shellcheck): use `git grep` to search only tracked files 2021-12-28 16:49:24 -03:00