48db7ceb5f
fix: set AUTO_INSTALL_BUILD_DEPS for CI
2022-05-07 22:47:20 +08:00
d80b7c720b
chore: check dependenies before building on Mac OSX
2022-05-07 22:16:44 +08:00
eb03e6ca9b
build(macos): do not depend on gsed
2022-05-07 08:56:12 +02:00
74c33cd4e5
feat(rule_engine): add jq function to the rule engine
...
This commit adds a function to the rule engine that alows users
to transform text or JSON objects using [jq filter programs][1].
[jq][1] is a command line tool that can be used to transform
and filter JSON text using jq's built-in language. The rule engine
function that is added with this commit uses the
[Erlang jq NIF library][2] that wraps the jq C library in an
Erlang NIF function.
[1]: https://stedolan.github.io/jq/
[2]: https://github.com/emqx/jq
2022-05-04 17:09:16 +02:00
f28559ef62
Merge pull request #7820 from zmstone/0428-fix-flaky-test
...
test: ensure emqx_metrics gen_server stopped after each test
2022-04-29 14:21:21 +08:00
e5c7c37861
ci: quick fix before emqx-builder image is renamed to el7 and el8
2022-04-29 07:59:24 +02:00
1e170da9e8
test: ensure emqx_metrics gen_server stopped after each test
2022-04-29 12:41:36 +08:00
50f1dcef97
fix: update elixir CI yamls for getting rebar3
2022-04-28 23:07:38 +08:00
b05b77bcbc
chore: port ensure-rebar3.sh from 4.x
2022-04-28 19:28:29 +08:00
ad7272b162
ci: get OS from builder image name
...
cross build is running in container
can not run docker in dokcer
2022-04-28 10:48:02 +02:00
1064d14fcf
Merge pull request #7788 from zmstone/0426-add-pre-commit-hook-to-ensure-code-style
...
chore: add a pre-commit hook to auto format erlang code
2022-04-28 09:01:22 +01:00
37be7a4977
chore: update check-format.sh to reformat all apps
2022-04-27 15:50:17 +02:00
af69899619
chore: add a pre-commit hook to auto format erlang code
2022-04-27 08:01:55 +02:00
07444e3da5
chore: dashboard format code
2022-04-26 17:18:30 +08:00
2ea66ebcee
Merge pull request #7749 from DDDHuang/fix_some_api
...
fix: create banned & dashboard default user name
2022-04-26 16:43:44 +08:00
69f1a2ac86
fix: build i18n conf with dashboard app
2022-04-26 11:57:07 +08:00
a4feb3e6e9
style: reformat emqx_auto_subscribe and emqx_conf
2022-04-25 18:05:10 +02:00
cee4607472
Merge pull request #7738 from zhongwencool/obfuscate_sensitive_config
...
feat: obfuscate sensitive values default_password
2022-04-24 14:05:23 +08:00
5223c3ee61
feat: obfuscate sensitive values default_password
2022-04-24 09:41:29 +08:00
b445182335
style: reformat emqx_machine, emqx_plugin_libs, and emqx_statsd
2022-04-23 09:55:50 +02:00
c1ba15f8f0
fix(psk): reformat codes
2022-04-22 13:58:02 +08:00
d45700865e
Merge pull request #7708 from zhongwencool/i18n-conf
...
feat: emqx_conf_schema/emqx_plugins/emqx_dashboard I18n conf
2022-04-22 09:50:10 +08:00
67a94732ac
chore(spellcheck): Bump container version to 0.3.1
2022-04-21 23:48:47 +02:00
393fbd2bdb
feat: add emqx_dashboard i18n
2022-04-21 23:43:12 +08:00
a0145f4692
chore(buildx.sh): no need to parameterise otp version and system
2022-04-19 22:25:59 +02:00
db29080cd5
chore: add erlfmt app name and update git blame ignore revs
2022-04-19 18:57:41 +08:00
48a9b37916
chore: update git-blame-ignore-revs
2022-04-19 15:46:25 +08:00
2254764d88
chore: update git-blame-ignore-revs
2022-04-19 10:44:25 +08:00
ce915f0bbd
Merge pull request #7590 from zhongwencool/doc-i18n
...
feat: desc/label support i18n
2022-04-15 17:43:16 +08:00
700c2cfb39
feat: move *i18n.conf from etc to i18n dir
2022-04-15 10:43:37 +08:00
630cc8ee34
feat: support i18n with desc struct.
2022-04-15 08:42:13 +08:00
4db2761804
chore: update git-blame-ignore-revs
2022-04-14 15:06:01 +08:00
8500200e81
Merge remote-tracking branch 'ce/master' into fmt-gw
2022-04-01 09:52:12 +08:00
c192bb51e3
style: add `authn` & `authz` erlfmt and git blame ignore
2022-04-01 02:21:52 +08:00
3f6d78dda0
style(gateway): format gateway application
2022-03-31 17:41:32 +08:00
4249d4345b
chore: support fmt subdir source files
2022-03-31 17:40:51 +08:00
a125bf9469
style: add emqx_enterprise_conf erlfmt commit to git blame ignore
2022-03-25 16:55:59 +01:00
ce7e66d039
Merge pull request #7411 from zmstone/style-erlfmt-app-lib-ee-emqx_license
...
style: erlfmt app lib-ee/emqx_license
2022-03-25 15:11:22 +01:00
b49df4599a
build: use latest builder images (alpine 3.15.1)
...
OpenSSL-1.1.1n
2022-03-25 07:38:39 +01:00
ee1b826d2a
chore: less verbose debug info from elvis-check
2022-03-25 07:26:43 +01:00
24c55ab5cc
style: Add lib-ee/emqx_license to reformatted list
2022-03-25 07:15:16 +01:00
690843ba24
chore: add emqx_modules to the CI format check
2022-03-22 09:53:46 -03:00
8cd5c0c83a
chore: add a simple bash to wrap format_app.py to be used in CI
2022-03-21 17:16:28 +01:00
817aa3051b
chore: make format_app.py accept path to app
...
prior to this change, the script accepts the app name
and assumes the app is in 'apps' sub dir.
however, we have lib-ee for enterprise,
we may also technically have the same app reside in more than
two sub-dirs e.g. lib-ce and lib-ee
2022-03-21 17:11:12 +01:00
9d96d3d10a
test: fix auto_subscribe test case
2022-03-15 20:40:28 +01:00
f9aba61dbb
ci: run ct in concurrent jobs
2022-03-15 20:40:22 +01:00
02598feffc
chore: make find-apps.sh able to print json
2022-03-15 15:36:44 +01:00
b79ef3f0d9
docs: Add documentation for the cluster
2022-03-14 10:36:09 +01:00
ee4673ee9c
Merge pull request #7256 from mononym/format_script
...
feat: add file to assist in formatting application
2022-03-14 09:25:56 +01:00
49ad66b4bd
ci: no need for rocksdb cache anymore
2022-03-11 14:54:00 +01:00
f21fb241d6
feat: add file to assist in formatting application
2022-03-10 10:27:57 +01:00
02d9aae82d
chore: add more log in check-nl-at-eof.sh
2022-03-08 14:56:44 +08:00
e6495f4300
ci: upgrade emqx-builder to 5.0-8:1.13.3-24.2.1-1
2022-03-02 21:57:26 +01:00
b68cb96bd2
refactor: make pkg-vsn.sh able to report both short and long version
2022-02-26 01:38:10 +01:00
7e575f54c3
build: down prioritise docker buildx
2022-02-25 11:33:01 +01:00
2d3859a79a
build: get full version from pkg-full-vsn.sh
...
this is due to the mapping of :
centos7 -> el7
and rockylinux8 -> el8
with this fix, there is no need to repeat such mapping
in many differennt places
2022-02-25 11:33:01 +01:00
b2cb7f1bd5
build: update to latest builder image
2022-02-25 09:09:30 +01:00
fa91c7491f
build: rockylinux
2022-02-25 09:09:30 +01:00
bdd1c32ceb
chore: cosmetic, only indentation fix
2022-02-24 13:08:32 +01:00
bd39fc6bb2
chore(pkg-tests.sh): delete dead code
2022-02-24 13:08:32 +01:00
c2bd30466f
build: slient pushd and popd
2022-02-22 22:33:33 +01:00
f173a2f61f
Merge pull request #7082 from zmstone/build-refine-scripts-and-ci
...
chore: relocate tests.sh
2022-02-22 14:29:42 +01:00
2b2c6a4d1b
docs(node): Add documentation for the node
2022-02-21 19:53:11 +01:00
1aa9abdb4d
chore: relocate tests.sh
2022-02-21 12:22:53 +01:00
115c3f2d29
chore: Fix URLs
2022-02-21 10:13:09 +01:00
ef0da4fc70
ci: Spellcheck documentation in the CI
2022-02-18 13:32:33 +01:00
093e7c3282
build(relup): add new script for download relup base packages
2022-02-16 18:23:02 +01:00
2e94880bb6
docs: More EMQ X -> EMQX rename in descriptive strings
2022-02-15 22:39:11 +01:00
072ecd06f6
chore: exclude alpha beta and rc tags when checking app.src vsn bump
2022-02-14 22:23:52 +01:00
525bf47618
chore(buildx.sh): set bash -x option after help message
2022-02-10 12:40:46 +01:00
eea217093b
fix(mix): include `node_dump` in tgz and packages
2022-02-07 18:15:17 -03:00
17599432d1
feat(license): add license application
2022-02-07 19:05:47 +03:00
c9561478ac
ci(build-cache): elixir build cache
2022-02-02 12:33:35 +01:00
5c36143186
ci: remove centos8 support
...
due to centos8 EOL
2022-02-01 15:22:41 +01:00
fd23581dc0
Merge pull request #6880 from qzhuyan/ci/william/aws-arm64-runner
...
ci: use aws arm64 runner in cross build jobs
2022-02-01 09:05:58 +01:00
c643db6bca
build: move otp version check to rebar.config.erl
2022-01-31 16:39:14 +01:00
4b71495101
ci: export CODE_PATH in test
2022-01-31 16:14:24 +01:00
d7b70982d9
build(buildx): add support to run without docker
2022-01-31 16:14:22 +01:00
d4a16fc94a
Merge pull request #6887 from emqx/mix-use-mix_env
...
chore(mix): use MIX_ENV to define build profile and edition
Instead of reading some environment variables to define the build profile for the Elixir build, we use the MIX_ENV value to emulate Rebar3's profiles. Also, that makes the build output directory more similar to EMQ X's current scheme.
2022-01-31 10:38:00 -03:00
a597e92576
chore(mix): use MIX_ENV to define build profile and edition
2022-01-28 17:24:35 -03:00
177d42cad4
ci(docker): scripts/docker-create-push-manifests.sh
2022-01-28 19:37:01 +01:00
052bd9081d
docs(schema): Fix typos in the schema files
2022-01-27 22:39:19 +01:00
bd0d331b64
Merge pull request #6636 from emqx/elixir-packages-mkII
...
ci(mix): build emqx packages with elixir
2022-01-27 11:10:30 -03:00
fc92e4c8bf
docs: fix typos
2022-01-27 12:29:38 +01:00
bba595a91f
fix(elixir): guard against missing elixir installation
2022-01-26 16:59:50 -03:00
9c68f4bd11
fix(tgz): replace zip with tgz after rebase
2022-01-26 16:59:49 -03:00
1240c40364
chore(ci): build only a few zips with elixir, build docker image with
...
elixir
2022-01-26 16:59:49 -03:00
59f0d5f537
chore(mix): use flag instead of elixirpkg to denote package type
...
Also, add Makefile target to build zip files with Elixir.
2022-01-26 16:59:49 -03:00
ba6d4e4a19
fix(ci): raspbian arch is arm, not arm64
2022-01-26 16:59:49 -03:00
a91880780a
chore(elixir): change image/package versioning convention
...
We now go from "most specific" to "most general" versions: Elixir ->
OTP -> OS.
2022-01-26 16:59:48 -03:00
6dd11665bb
ci(mix): build emqx packages with elixir
2022-01-26 16:59:48 -03:00
d44c6eedfd
ci: find relup base version using a script
2022-01-26 18:29:55 +01:00
f3fe3db771
build: fix shellcheck
2022-01-26 14:25:59 +01:00
391e480824
build: parameterise package version
...
so that community and enterprise edition can be built from the
same branch
2022-01-26 14:25:59 +01:00
bfbc87aaca
refactor(config): delete generated includes
...
In the following commits, the overrides will be loaded at runtime
2022-01-24 13:30:42 +01:00
638a9d1af7
build: change to build .tar.gz instead of zip
2022-01-13 18:54:01 +01:00
56859a7fb0
Merge pull request #6716 from qzhuyan/ci/william/build-cache-for-cross-build-packages
...
build cache for cross build packages
2022-01-12 15:22:05 +01:00
e388ad1b21
ci(build-cache): add scripts/get-dep-refs.sh
2022-01-12 11:58:50 +01:00
b2684b995d
build: doc for win
2022-01-10 12:30:01 +01:00
4897e00aab
chore(scripts): get-distro support windows
2022-01-10 12:15:23 +01:00
9f7b513a3f
chore: fix copyright update script to include more files
2022-01-06 08:44:35 +01:00
153a44876e
chore: add a script to update copyright end-year
2022-01-05 20:55:00 +01:00
b9494662ae
fix(ci): fix shellcheck file pattern
...
Since we started to use the portable shebang style for our scripts, we
need to update the pattern used to find scripts for Shellcheck to
check.
2022-01-05 11:34:04 -03:00
5df382f054
Merge pull request #6598 from zmstone/ci-port-changes-from-4.4
...
[5.0] CI port changes from 4.4
2022-01-04 18:52:25 +01:00
320506957c
refactor(bin/emqx): wait for up to 120 seconds by default
2022-01-04 17:28:53 +01:00
93cdf318c7
fix(ci): setup mix before running check
2022-01-04 13:28:03 -03:00
d78e9429f3
ci(mix): rm mix.lock from repo
...
While Mix is not the main build tool, we remove the commited
`mix.lock` file to reduce friction when updating dependencies, since
it requires remembering to run `mix deps.get` to update the
`mix.lock`, used by a CI check in
`scripts/check-elixir-deps-discrepancies.exs`. We change said script
to produce the required file on the fly.
2022-01-04 12:10:58 -03:00
1d71256305
chore(deps): update mix.lock (mongodb)
2022-01-03 10:02:59 -03:00
c29bc126ef
Merge pull request #6507 from emqx/build-with-mix-mkII
...
Build with Elixir Mix Release
2021-12-30 15:00:38 -03:00
fe444bf134
chore(shellcheck): use `git grep` to search only tracked files
2021-12-28 16:49:24 -03:00
0020cf592f
Merge remote-tracking branch 'origin/master' into build-with-mix-mkII
2021-12-28 11:28:40 -03:00
8342b3711d
chore(update_appup): Improve `update_appup.escript` (5.0)
...
Port of #6480 .
* Make the script regex-aware
This change makes the `update_appup.escript` check whether the new
version of an application (the _current_ one) is already contained in
entries in the _new_ .appup file for that application if such .appup
file contains regexes.
* Do not use `load_module` instructions if `restart_application` is present
Since the appup instruction `restart_application` already loads all
modules of a given application, there is no need to introduce those
instructions if a restart is already present.
* Do not force `.appup.src` render if contents are the same
To avoid losing comments and/or manual indentation in appup files that
are already up to date, we now check whether the contents have the
exact same terms as those we are about to write to an existint .appup
file.
* Insert `load_module`s after `application:stop`, if present
If there is already any `application:stop(Application)` call in the
appup instructions, we prefer to add `load_module` instructions after
it, so we can be sure that the load is replaced safely.
* Add expected versions check
For apps inside emqx umbrella, we try to bump only the patch part of
their version numbers, and use only 3-part version
numbers (`Major.Minor.Patch`). With those assumptions, we may infer
all versions that need to be covered in a given upgrade, and check if
those are covered in regexes.
2021-12-28 10:06:42 -03:00
a54e108296
ci(mix): add application mode check
...
This adds a CI check to ensure that applications and their modes are
in sync between Elixir and Rebar release builds.
2021-12-27 13:09:55 -03:00
68eb13d478
fix: portable shebang
2021-12-27 15:45:12 +01:00
c14e8db869
style(format): format elixir files
2021-12-27 10:51:12 -03:00
cc652c3343
ci(mix): add elixir deps check
...
Checks whether there are discrepancies between rebar3 and mix deps.
2021-12-24 14:44:49 -03:00
014b6d3cfd
chore(shellcheck): fix shellcheck linting warnings
2021-12-22 15:43:43 -03:00
4d9b4cb828
refactor: delete lib-extra
...
plugin development and deploy will different from 4.3
2021-12-16 12:48:13 +01:00
8493b61cb5
refactor(eqmx_limiter): use the new hierarchical token bucket to replace the old ratelimit code
2021-12-10 14:37:23 +08:00
540e5dbc0b
Merge pull request #6344 from emqx/update-appup-ext-deps-diff-50
...
chore(appup): make update_appup.escript output only differences for external dependencies [5.0]
Same as #6307 .
Currently, the update_appup.escript outputs as an error the full appup
file for external dependencies, even if all the changes are already
contained in the depency. Here, we make it only output the missing
actions to be inserted, to aid in seeing what are the differences.
2021-12-09 09:15:25 -03:00
257ee19be5
chore(dashboard): change dashboard repo and version
2021-12-09 11:31:31 +08:00
2eb7a71e49
chore(appup): make update_appup.escript output only differences for
...
external dependencies [5.0]
Same as #6307 .
Currently, the update_appup.escript outputs as an error the full appup
file for external dependencies, even if all the changes are already
contained in the depency. Here, we make it only output the missing
actions to be inserted, to aid in seeing what are the differences.
2021-12-01 08:52:40 -03:00
1a6b4d2d57
chore(appup): minor fixes to update_appup.escript (5.0)
...
- Fixes clause error on `create_stub/1`.
- Small optimization: do not download the same file multiple times
with `wget`.
- Fix: remove old file extension (`.app.src`) and preserve dirname
when creating stubs for apps.
2021-11-25 13:54:31 -03:00
a705bc1fc7
build: change package name scheme
...
`${PROFILE}-${PKG_VSN}-otp${OTP_VSN}-${SYSTEM}-${ARCH}.zip`
2021-11-20 20:44:48 +01:00
25d6a98aa4
build: get otp version and export OTP_VSN
2021-11-20 20:44:48 +01:00
6edd862dd5
refactor: no more EMQX_ENTERPRISE compile flag
...
The compile flag was introduced in EQM X 4.3 series
where CE and EE code was diverged large enough which made
non-practicle to determin edition at runtime.
such approach made testing quite challenging as we'll have to
build with different compile flags inorder to run per-edition
test cases
In this commit, we try to retrieve edition info from EMQX's
description text, (put to PT for fast access) at runtime
so we can test ALL editions from a super-set edition (EE).
2021-11-20 20:41:06 +01:00
970e6bebde
fix(update_appup): Sync version from 4.* branch
2021-11-18 12:33:48 +01:00
ce8e52f4d0
ci: fix job syntax
2021-11-04 18:32:03 +01:00
d1abb30818
ci: fix elvis check
2021-11-04 15:27:10 +01:00
dc58e4a441
ci: check code style
...
run elvis and nl-at-eof check
2021-11-04 14:47:05 +01:00
6f3cfbc102
chore: add a script to find files without new line at EOF
2021-11-04 14:39:27 +01:00
4dbe3ccf71
refactor(dashboard): rename 'password' field to 'pwdhash' ( #5990 )
...
* refactor(dashboard): rename 'password' field to 'pwdhash'
rename as it is not plaintext password stored in db
* refactor(emqx_dashboard): rename records
* test(emqx_dashboard_token): add test case to cover match specs
2021-10-26 20:41:33 +08:00
d784e63b9f
emqx_conf ( #5939 )
...
* feat(emqx_conf): move conf manager for emqx_machine to emqx_conf
* chore(emqx_conf): change emqx:get_config/2 to emqx_conf:get/2
* fix: common test failed
* fix: badmatch by typo wrong key
* fix(emqx_conf): get the wrong core nodes
* fix(emqx_conf): get core node's tnx_id not latest tnx_id
* fix: add ro_transation when copy conf file
* fix: delete debug info
* fix: change ekka_rlog to mria_rlog
* fix: remove cluster_rpc from emqx_machine.
* fix: don't call ekka:start/0 explicitly
* fix: ekka should be start in emqx_machine
2021-10-21 18:08:51 +08:00
010c70c200
chore: delete unused script
2021-09-28 20:40:46 +02:00
c0447d58b4
fix(config): configs in emqx_machine.conf was merged twice into emqx.conf
2021-08-20 19:04:52 +08:00
522d8e0a4a
refactor(config): split config and schema
2021-08-04 08:36:10 +02:00
32534d2372
chore(dashboard): update get-dashboard script
2021-08-03 17:21:01 +08:00
aa019b34ad
test(exhook): refine tests
2021-08-03 14:06:58 +08:00
00966d0114
chore(script): silent download rebar3
2021-07-30 10:40:14 +02:00
569d54a4c0
feat(dashboard): Update the configuration file to hocon
2021-07-26 15:00:40 +08:00
086b785cb0
chore: delete relup_deps injection
...
in v5, we will not rely on relup_deps to resolve app start
order after upgrade
2021-07-26 09:11:48 +08:00
9081a22b8c
chore(deps): deps in rebar must not be use branch
...
Can use tags or commit ids in rebar deps
Signed-off-by: zhanghongtong <rory-z@outlook.com>
2021-07-12 18:28:47 +08:00
e1a33c373c
chore(CI): disable apps version check in unstable tags
2021-07-05 15:10:57 +08:00
24292f4f4e
chore: delete plugins related configuration
2021-07-02 18:12:06 +08:00
918a26e921
feat(conf): merge all conf to emqx.conf
2021-07-02 17:01:16 +08:00
c094e5ddcc
chore(ct): cancel needless apps ct
2021-07-01 18:39:42 +08:00
33036a1a91
chore(plugins): rm emqx-pks-file plugin
2021-06-28 15:57:19 +08:00
9471f5ae07
fix(script): exclude non-edge apps in relup dependency
2021-06-28 11:42:55 +08:00
e4cb11fb43
chore: add more info in error message
2021-06-28 11:42:55 +08:00
4b1bb91516
chore: fix inject deps notfound emqx_reloader
2021-06-28 11:42:55 +08:00
Shawn