Commit Graph

699 Commits

Author SHA1 Message Date
William Yang d49a75ae28 chore: don't build quic on MacOS 2022-06-13 13:09:20 +02:00
Shawn f18eab402a fix(CI): don't use any authz sources when testing 2022-06-10 14:21:20 +08:00
Zaiming (Stone) Shi 7b559193d1
Merge pull request #8054 from Rory-Z/ci/change-base-image
build(docker): change docker base image to debian
2022-06-07 10:25:08 +01:00
Rory Z d5704c2c48 build(docker): change docker base image to debian, and add new tag for alpine image 2022-06-07 06:15:15 +02:00
Zhongwen Deng cd91b4b582 fix: dialyzer never match warning 2022-06-07 10:47:40 +08:00
Zaiming (Stone) Shi fc4d9e4dcd ci: use emqx-builder 5.0-16
Fixed openssl compatibility issue
2022-06-06 10:54:26 +02:00
Ilya Averyanov a6911517aa fix(ci): set explicit version for system-wide Erlang 2022-06-02 15:08:20 +03:00
Ilya Averyanov 0893a36dec fix(authn): removed explicit chain creation for security reasons 2022-06-02 14:03:19 +03:00
ieQu1 83e5ec9b2d chore(ci): Bump emqx-schema-validate to 0.3.3 2022-05-31 18:00:33 +02:00
Zaiming (Stone) Shi d249c2c22e
Merge pull request #8056 from thalesmg/move-db-config
chore(config): move db configs under cluster/node keys
2022-05-28 08:09:15 +01:00
Thales Macedo Garitezi d93977ccd3
ci(elixir): use `MIX_ENV` profiles for machine boot checks
With the change to using `MIX_ENV` for choosing a profile, the CI
check became out of date.
2022-05-27 09:07:46 -03:00
Zaiming (Stone) Shi ebe4d7c3fb refactor: stop releasing edge edition
Prior to EMQX 5.0, the edge edition's main difference comaring
to standard edition are:
* Less number of plugins in the release (smaller package size)
* Smaller number is vm.args (for lower memory usage)

Starting from 5.0 most of the plugins are included as features,
the tuned vm.args arguments does not justify a special release edition.

Also as nanomq is getting mature,
EMQ's recommendtation for MQTT broker in edge is https://nanomq.io/
2022-05-26 20:05:46 +02:00
Thales Macedo Garitezi e8d37a26da
fix(ci): run workaround before starting
line-break check was failing before:

```
Run ./scripts/check-nl-at-eof.sh
  ./scripts/check-nl-at-eof.sh
  shell: sh -e {0}
fatal: unsafe repository ('/__w/emqx/emqx' is owned by someone else)
To add an exception for this directory, call:

	git config --global --add safe.directory /__w/emqx/emqx
```
2022-05-26 14:02:22 -03:00
Shawn eea9bd90b4 fix: remove the extra level of 'emqx' dir from .tar.gz 2022-05-25 02:00:01 +08:00
JianBo He aae5e55e21 ci: upload all cover files 2022-05-19 14:13:53 +08:00
ieQu1 02eaaace20
Merge pull request #7965 from ieQu1/ci-avoid-duplicate-git-conf
ci: Avoid adding duplicate entries to git config
2022-05-16 18:59:29 +02:00
ieQu1 12860bf87b ci: Avoid adding duplicate entries to git config 2022-05-16 12:54:48 +02:00
Shawn 5d65bdaa47 chore: ping emqx-builder to 5.0-15 2022-05-16 18:10:42 +08:00
JianBo He ee9560718b chore: add description for feature-request 2022-05-16 11:56:19 +08:00
JianBo He 1ec111ad2e chore: update issue-template config.yml 2022-05-16 11:43:18 +08:00
JianBo He 70981455ea chore: update issue template 2022-05-16 11:35:43 +08:00
Zaiming (Stone) Shi 3bcd76a681 ci: try to prepare a compiled test profile for test jobs 2022-05-11 20:55:18 +02:00
Zaiming (Stone) Shi e95a14843d ci: delete otp 23 from ci matrix 2022-05-10 16:34:53 +02:00
Shawn 48db7ceb5f fix: set AUTO_INSTALL_BUILD_DEPS for CI 2022-05-07 22:47:20 +08:00
Shawn d80b7c720b chore: check dependenies before building on Mac OSX 2022-05-07 22:16:44 +08:00
Kjell Winblad 74c33cd4e5 feat(rule_engine): add jq function to the rule engine
This commit adds a function to the rule engine that alows users
to transform text or JSON objects using [jq filter programs][1].

[jq][1] is a command line tool that can be used to transform
and filter JSON text using jq's built-in language. The rule engine
function that is added with this commit uses the
[Erlang jq NIF library][2] that wraps the jq C library in an
Erlang NIF function.

[1]: https://stedolan.github.io/jq/
[2]: https://github.com/emqx/jq
2022-05-04 17:09:16 +02:00
Zaiming (Stone) Shi 8ff552c9cf
Merge pull request #7827 from qzhuyan/ci/william/build-ct-self-hosted
cI: ct self-hosted pull image from docker proxy instead
2022-04-29 16:31:22 +01:00
Zaiming (Stone) Shi edc6a6ab38 ci: run emqx app standalone tests only for pull requests 2022-04-29 10:11:05 +02:00
Xinyu Liu 635486bbaf
Merge pull request #7821 from terry-xiaoyu/update_ensure_rebar3
chore: port ensure-rebar3.sh from 4.x
2022-04-29 10:21:48 +08:00
William Yang be375ae621 ci: use docker image cache in aws 2022-04-28 18:01:12 +02:00
Shawn 50f1dcef97 fix: update elixir CI yamls for getting rebar3 2022-04-28 23:07:38 +08:00
William Yang 9bce83c10d ci(self-hosted): ct docker 2022-04-28 16:40:24 +02:00
Zaiming (Stone) Shi 71d166af27 ci: remove 'if: always()' from allgood jobs 2022-04-28 15:09:59 +02:00
Zaiming (Stone) Shi 94239d98df ci: no need to test apps/emqx if nothing changed in this sub-dir 2022-04-28 15:09:59 +02:00
Zaiming (Stone) Shi 89d242c3a3 ci: add 'allgood' summary jobs to a few builds
* build_slim_packages
* run_emqx_app_tests
* run_jmeter_tests
* run_test_cases
2022-04-28 15:09:59 +02:00
Zaiming (Stone) Shi 0ad463ac84 ci: do not use matrix for code_style_check
So the job can be used as 'required' for PRs
2022-04-28 15:09:59 +02:00
Zaiming (Stone) Shi a93eee5d08 ci: rename broker tests ci job to 'run_jmeter_tests' 2022-04-28 15:09:59 +02:00
Zaiming (Stone) Shi fdde829ab9 ci: better names to ci checks 2022-04-28 15:09:59 +02:00
William Yang 1db20678b1
Merge pull request #7806 from qzhuyan/ci/william/build-ct-self-hosted
ci(self-hosted): run ct
2022-04-28 15:03:16 +02:00
William Yang 89b7c87e19 ci(self-hosted): run ct 2022-04-28 13:32:55 +02:00
Zaiming (Stone) Shi ad7272b162 ci: get OS from builder image name
cross build is running in container
can not run docker in dokcer
2022-04-28 10:48:02 +02:00
Zaiming (Stone) Shi 4c0da19ee6 ci: try to clean up workspace before checkout 2022-04-27 16:11:19 +02:00
William Yang 106d45ca53 ci(self-hosted): clean before run 2022-04-27 11:48:20 +02:00
William Yang be67e27aa4 ci: build slim packages on self-hosted runners 2022-04-27 10:46:54 +02:00
JimMoen 1340c8e553 chore: fix typos in workflow file 2022-04-27 11:00:43 +08:00
ieQu1 3e171ef075 ci(mac): Increase wait time for node up 2022-04-26 16:57:13 +02:00
Thales Macedo Garitezi 208cc0fad8
feat(node_dump): add license info to node_dump 2022-04-25 11:42:20 -03:00
ieQu1 67a94732ac chore(spellcheck): Bump container version to 0.3.1 2022-04-21 23:48:47 +02:00
ieQu1 c5d97678c5 ci(spellcheck): Treat missing descriptions as erros 2022-04-05 00:11:38 +02:00
ieQu1 99b3f2f83e docs(schema): Document missing records and fields 2022-04-04 23:58:43 +02:00
xiangfangyang-tech 05ddf9f9d4 chore(autotest): turn on mysql&pgsql authz scripts test and mqtt topic rewrite&delayed publish 2022-03-31 16:58:04 +08:00
Zaiming (Stone) Shi b49df4599a build: use latest builder images (alpine 3.15.1)
OpenSSL-1.1.1n
2022-03-25 07:38:39 +01:00
ieQu1 93d1c4ec87 ci(spellcheck): Bump container version to 0.2.3 2022-03-23 14:24:00 +01:00
ieQu1 684879eaa6 ci(spellcheck): Bump validator container version 2022-03-22 19:09:20 +01:00
Zaiming (Stone) Shi 22682ff646
Merge pull request #7359 from zmstone/reformat-app-emqx
chore: reformat app emqx
2022-03-21 20:53:33 +01:00
Zaiming (Stone) Shi 4b68c82612 ci: move elvis check to the end 2022-03-21 17:54:30 +01:00
Zaiming (Stone) Shi 8cd5c0c83a chore: add a simple bash to wrap format_app.py to be used in CI 2022-03-21 17:16:28 +01:00
Zaiming (Stone) Shi d22769a2de ci: build enterprise for e tags 2022-03-21 15:29:28 +01:00
zhanghongtong 5d3d4cf85c ci: fix login error for aws ecr 2022-03-21 11:35:39 +08:00
zhouzb 82911e743f
Merge pull request #7296 from Rory-Z/ci/fix-login-error-for-aws-ecr
ci(cross build): fix login error for aws ecr
2022-03-18 17:21:11 +08:00
DDDHuang d1574977e5 fix(ci): update jmeter to 5.4.3 2022-03-18 15:06:21 +08:00
Zaiming (Stone) Shi f9aba61dbb ci: run ct in concurrent jobs 2022-03-15 20:40:22 +01:00
zhanghongtong 2f7f021197 ci(cross build): fix push aws ecr error when single arch image 2022-03-15 11:34:03 +08:00
zhanghongtong 20e2c41975 ci(cross build): add more if conditions 2022-03-15 11:29:55 +08:00
ieQu1 960c5ad0d5 ci: Run spellcheck 2022-03-14 22:27:46 +01:00
zhanghongtong d3f05d35a8 ci(cross build): fix login error for aws ecr 2022-03-14 15:26:20 +08:00
Zaiming (Stone) Shi 49ad66b4bd ci: no need for rocksdb cache anymore 2022-03-11 14:54:00 +01:00
xiangfangyang-tech 34c3710d99
Merge pull request #7277 from xiangfangyang-tech/autotest_broker_v5
chore(autotest): add some new steps in gitaction to run test scripts about authn authz
2022-03-11 14:11:36 +08:00
xiangfangyang-tech 5a456fda98 chore(autotest): add some authn authz test steps in git action 2022-03-11 10:55:16 +08:00
zhongwencool 6d272970f4
Merge pull request #7088 from ieQu1/fix-spellcheck-workflow
ci(spellcheck): Use a different action
2022-03-10 18:18:17 +08:00
Zaiming (Stone) Shi 9106b230a9
Merge pull request #7254 from zmstone/merge-proper-coverdata
Merge proper coverdata
2022-03-10 09:43:18 +01:00
xiangfangyang-tech a1c76f474b chore(autotest): add gitactions for new autotest scripts 2022-03-10 15:59:09 +08:00
Zaiming (Stone) Shi 4d59cbdbdc ci: ensure github token env variable for coveralls 2022-03-09 15:58:28 +01:00
Zaiming (Stone) Shi b78c70a378 ci: merge proper coverdata 2022-03-09 13:32:29 +01:00
Zaiming (Stone) Shi 632d5bf646 ci: explain why we need to run emqx app tests standalone 2022-03-09 13:06:18 +01:00
Zhongwen Deng b3a623897d fix: nl_at_eof warning 2022-03-08 15:01:56 +08:00
Rory Z 5f80ac54c2
Merge pull request #7116 from Rory-Z/ci/update-cross-build
ci(cross build): splitting cross builds and upload assets
2022-03-04 09:19:56 +08:00
Zaiming (Stone) Shi 0f93c23936
Merge pull request #7186 from zmstone/structured-build-info
build: more structured build info
2022-03-02 23:58:08 +01:00
Zaiming (Stone) Shi e6495f4300 ci: upgrade emqx-builder to 5.0-8:1.13.3-24.2.1-1 2022-03-02 21:57:26 +01:00
Zaiming (Stone) Shi d1cf1cca67 ci: add debian11 2022-03-02 21:56:10 +01:00
Zaiming (Stone) Shi 4e64010a3b build: more structured build info 2022-03-02 21:22:03 +01:00
DDDHuang 5eccee0311
Merge pull request #7155 from xujun540/run_api_tests
chore(autotest): Remove all API test scripts
2022-02-28 20:25:18 +08:00
xujun540 058bafd3b9 chore(autotest): Remove all API test scripts 2022-02-28 15:13:51 +08:00
Zaiming (Stone) Shi b68cb96bd2 refactor: make pkg-vsn.sh able to report both short and long version 2022-02-26 01:38:10 +01:00
Zaiming (Stone) Shi ea39a9944c ci: fix package name format for slim build 2022-02-25 12:19:43 +01:00
Zaiming (Stone) Shi 2d3859a79a build: get full version from pkg-full-vsn.sh
this is due to the mapping of :
centos7 -> el7
and rockylinux8 -> el8

with this fix, there is no need to repeat such mapping
in many differennt places
2022-02-25 11:33:01 +01:00
Zaiming (Stone) Shi 64fd321ad1 ci(spelling): check enterprise schema 2022-02-25 09:09:30 +01:00
Zaiming (Stone) Shi b2cb7f1bd5 build: update to latest builder image 2022-02-25 09:09:30 +01:00
Zaiming (Stone) Shi fa91c7491f build: rockylinux 2022-02-25 09:09:30 +01:00
xujun540 04279da8dd chore(autotest): Discard the container API test script 2022-02-25 14:11:57 +08:00
Thales Macedo Garitezi 8cac5f6b39
chore(ci): update emqx-builder image
Uses Elixir 1.13.3 and OTP 24.2.1-1.
2022-02-23 15:00:07 -03:00
Zaiming (Stone) Shi e6380a1911
Merge pull request #7104 from zmstone/fix-windows-build-5.0
[5.0] Fix windows build
2022-02-23 10:22:45 +01:00
zhanghongtong 5435a0978b ci(cross build): splitting cross builds and upload assets 2022-02-23 16:15:53 +08:00
zhongwencool b7f808db9e
Merge pull request #7027 from DDDHuang/error_code
feat: support http error code & error code api
2022-02-23 16:12:20 +08:00
DDDHuang ee4ced82c5 fix: remove jmeter SUITE 2022-02-23 13:55:34 +08:00
Zaiming (Stone) Shi a4e48b197c build: create sha256 sum right after package is built 2022-02-22 22:33:33 +01:00
Zaiming (Stone) Shi 6dedf4875a ci(windows): build windows package on otp 24 2022-02-22 22:33:27 +01:00
Zaiming (Stone) Shi f173a2f61f
Merge pull request #7082 from zmstone/build-refine-scripts-and-ci
chore: relocate tests.sh
2022-02-22 14:29:42 +01:00
k32 a60d230f28 ci(spellcheck): Use a different action 2022-02-21 14:32:49 +01:00
Zaiming (Stone) Shi 1aa9abdb4d chore: relocate tests.sh 2022-02-21 12:22:53 +01:00
Ilya Averyanov 2aeb1bc0e8
Merge pull request #7059 from savonarola/elixir-stylecheck
chore(codestyle): add formatting check for Elixir code
2022-02-21 11:43:14 +03:00
Ilya Averyanov 634d861b90 chore(codestyle): add formatting check for Elixir code 2022-02-18 19:43:48 +03:00
k32 1c62c6e60b docs: Add documentation for the sysmon roots 2022-02-18 16:26:18 +01:00
k32 ef0da4fc70 ci: Spellcheck documentation in the CI 2022-02-18 13:32:33 +01:00
Zaiming (Stone) Shi ee544c8298
Merge pull request #7028 from Rory-Z/build/add-download-relup
build(relup): add new script for download relup base packages
2022-02-17 06:28:20 +01:00
Rory Z 70ce5cbab3
Merge pull request #6929 from Rory-Z/ci/push-multiarch-image-for-aws-ecr-5.0
ci(build_packages): push muilt arch image for aws ecr
2022-02-17 11:45:30 +08:00
Shawn 76e61e849e
Update the desc for `node_dump` in issue templates
Putting the link to [node_dump script](https://github.com/emqx/emqx/blob/master/bin/node_dump)  will lead the user to download the node_dump script directly from the github, and run it.
2022-02-17 10:19:09 +08:00
zhanghongtong 093e7c3282 build(relup): add new script for download relup base packages 2022-02-16 18:23:02 +01:00
zhanghongtong 3875d5c0e2 ci(build_packages): fix the "if" for push aws ecr image 2022-02-08 16:41:16 +08:00
Ilya Averyanov 17599432d1 feat(license): add license application 2022-02-07 19:05:47 +03:00
zhanghongtong b6e3f66622 ci(build_packages): tag and push aws ecr image when after push docker image 2022-02-07 17:54:30 +08:00
zhanghongtong 420591d09a ci(build_packages): push muilt arch image for aws ecr 2022-02-07 16:09:09 +08:00
Thales Macedo Garitezi a37ee6aa05
fix(flaky_test): improve helm test preparation check 2022-02-03 09:44:10 -03:00
William Yang c9561478ac ci(build-cache): elixir build cache 2022-02-02 12:33:35 +01:00
Zaiming (Stone) Shi 8f5f58500c chore(stale_bot): exempt 'Enhancement' label 2022-02-01 16:55:11 +01:00
William Yang a2223836b9
Merge pull request #6908 from qzhuyan/ci/william/remove-centos8-support
ci: remove centos8 support
2022-02-01 16:11:25 +01:00
William Yang 5c36143186 ci: remove centos8 support
due to centos8 EOL
2022-02-01 15:22:41 +01:00
William Yang 978abe1798 ci: fix jobs triggers 2022-02-01 13:04:52 +01:00
William Yang fd23581dc0
Merge pull request #6880 from qzhuyan/ci/william/aws-arm64-runner
ci: use aws arm64 runner in cross build jobs
2022-02-01 09:05:58 +01:00
William Yang d2a7e549a2 ci(docker): update for the elixir parts 2022-01-31 16:22:43 +01:00
William Yang c00ca8e083 ci(docker): build cache for elixir 2022-01-31 16:14:24 +01:00
Thales Macedo Garitezi 6165ed010a
fix(ci): fix branch wildcard syntax 2022-01-31 10:50:20 -03:00
Thales Macedo Garitezi d4a16fc94a
Merge pull request #6887 from emqx/mix-use-mix_env
chore(mix): use MIX_ENV to define build profile and edition

Instead of reading some environment variables to define the build profile for the Elixir build, we use the MIX_ENV value to emulate Rebar3's profiles. Also, that makes the build output directory more similar to EMQ X's current scheme.
2022-01-31 10:38:00 -03:00
William Yang 9a5c5a7776 ci: fix include 2022-01-31 10:33:36 +01:00
Thales Macedo Garitezi a597e92576
chore(mix): use MIX_ENV to define build profile and edition 2022-01-28 17:24:35 -03:00
William Yang 5206824743 ci: push docker image on my own branch 2022-01-28 19:37:01 +01:00
William Yang 177d42cad4 ci(docker): scripts/docker-create-push-manifests.sh 2022-01-28 19:37:01 +01:00
William Yang 06cf419f02 ci: build arm64 in aws self-hosted 2022-01-28 19:36:59 +01:00
William Yang 528817d620 ci: enable ci tests on pushes.
- Secure tests on master branch after merge.

- Improve build cache hit rates
  Due to security reason, github only allow reuse cache from
  - same branch
  - base branch
  - default branch

  Branch Feature-A could not reuse the cache from Feature-B

- Developers could run the workflow in their own forked repo
  before make the PR, this could relieve the runners on upstream repo
2022-01-28 18:33:53 +01:00
Thales Macedo Garitezi bd0d331b64
Merge pull request #6636 from emqx/elixir-packages-mkII
ci(mix): build emqx packages with elixir
2022-01-27 11:10:30 -03:00
k32 8378f52d06
Merge pull request #6882 from kianmeng/fix-typos
(docs): fix typos
2022-01-27 13:25:44 +01:00
Kian-Meng Ang fc92e4c8bf docs: fix typos 2022-01-27 12:29:38 +01:00
Zaiming (Stone) Shi 97c0f92fcf ci: pin emqx-fvt ref 1.0.4-dev2 2022-01-26 23:32:21 +01:00
Thales Macedo Garitezi a88af8fcbc
ci(cache): use cache for elixir in fvt workflow 2022-01-26 16:59:50 -03:00
Thales Macedo Garitezi 506dad169a
chore(elixir_otp): bump emqx-builder images 2022-01-26 16:59:50 -03:00
Thales Macedo Garitezi e157064e24
fix(ci): use correct condition to build docker images 2022-01-26 16:59:50 -03:00
Thales Macedo Garitezi 06e31830fb
fix(ci): use tgz and elixir package name 2022-01-26 16:59:50 -03:00
Thales Macedo Garitezi aa1a1a7bb1
chore(ci): update CI container images 2022-01-26 16:59:50 -03:00
Thales Macedo Garitezi a974221ffa
chore(mix): split elixir docker image build into separate step 2022-01-26 16:59:50 -03:00
Thales Macedo Garitezi 9c68f4bd11
fix(tgz): replace zip with tgz after rebase 2022-01-26 16:59:49 -03:00
Thales Macedo Garitezi 1240c40364
chore(ci): build only a few zips with elixir, build docker image with
elixir
2022-01-26 16:59:49 -03:00
Thales Macedo Garitezi 3ec7d9ae24
chore(ci): use new tagged image with elixir 2022-01-26 16:59:49 -03:00
Thales Macedo Garitezi f66462ca6b
chore(ci): cache rocksdb+quicer for elixir packages 2022-01-26 16:59:49 -03:00
Thales Macedo Garitezi 59f0d5f537
chore(mix): use flag instead of elixirpkg to denote package type
Also, add Makefile target to build zip files with Elixir.
2022-01-26 16:59:49 -03:00
Thales Macedo Garitezi fca0d2bfd8
fix(ci): split elixir package building into own step
Since the job step may run out of execution time, by separating the
Elixir build from the traditional one may prevent timeouts.
2022-01-26 16:59:49 -03:00
Thales Macedo Garitezi ba6d4e4a19
fix(ci): raspbian arch is arm, not arm64 2022-01-26 16:59:49 -03:00
Thales Macedo Garitezi e874ec2b36
chore(images): use new image in more CI workflows 2022-01-26 16:59:49 -03:00
Thales Macedo Garitezi a91880780a
chore(elixir): change image/package versioning convention
We now go from "most specific" to "most general" versions: Elixir ->
OTP -> OS.
2022-01-26 16:59:48 -03:00
Thales Macedo Garitezi bc498a8041
ci(mix): add fvt tests and docker images with elixir 2022-01-26 16:59:48 -03:00
Thales Macedo Garitezi f24b3f416e
ci(mix): build slim packages with elixir 2022-01-26 16:59:48 -03:00
Thales Macedo Garitezi 6dd11665bb
ci(mix): build emqx packages with elixir 2022-01-26 16:59:48 -03:00
Zaiming (Stone) Shi d44c6eedfd ci: find relup base version using a script 2022-01-26 18:29:55 +01:00
Zaiming (Stone) Shi b44b090d9e ci: get package version per profile 2022-01-26 14:25:59 +01:00
Zaiming (Stone) Shi 5d6136fddb ci: test both ce and ee upgrade 2022-01-26 14:25:59 +01:00
Zaiming (Stone) Shi 391e480824 build: parameterise package version
so that community and enterprise edition can be built from the
same branch
2022-01-26 14:25:59 +01:00
JimMoen 31edd49f76 fix(topic_metrics): `POST` `PUT` need response 2022-01-20 10:15:06 +08:00
William Yang a67c463e8c ci: fix typo 2022-01-18 09:47:25 +01:00
William Yang b347769721 ci: fix indentation in yaml 2022-01-18 09:37:28 +01:00
William Yang 451324300b ci: speed up run_test_case jobs with cache 2022-01-17 08:33:15 +01:00
William Yang bf376afb5a ci: speedup all test jobs with build cache 2022-01-14 10:07:46 +01:00
Zaiming (Stone) Shi 38c0b7766c ci: fix emqx build profile to s3 dir mapping 2022-01-13 22:39:40 +01:00
Zaiming (Stone) Shi 5263f59f0e ci: rename artifact id in api tests flow 2022-01-13 20:28:21 +01:00
Zaiming (Stone) Shi 2faa3fb4cd ci: build test package from latest builder image 2022-01-13 18:54:01 +01:00
Zaiming (Stone) Shi ecd7ea0a2f ci: change to build and test with .tar.gz instead of .zip packages 2022-01-13 18:54:01 +01:00
William Yang fa59141d6d
Merge pull request #6741 from qzhuyan/ci/william/mac-cache-otp-install
ci(mac): cache otp install only
2022-01-13 14:55:08 +01:00
William Yang 30d119d3a9 ci(mac): cache otp install only
only cache otp installation instead of the entire kerl dir to save cache spaces
2022-01-13 11:41:45 +01:00
William Yang 1306946eb1 ci(cross-build-package): revert build cache for docker img
- The docker img use os: alpine, it is unliked to hit a cache.
- The build cache method casue the tag get overwritten among multi
arch builds
2022-01-13 11:26:34 +01:00
William Yang 56859a7fb0
Merge pull request #6716 from qzhuyan/ci/william/build-cache-for-cross-build-packages
build cache for cross build packages
2022-01-12 15:22:05 +01:00
William Yang e388ad1b21 ci(build-cache): add scripts/get-dep-refs.sh 2022-01-12 11:58:50 +01:00
xiangfangyang-tech 62c1f21eff
Merge pull request #6710 from xiangfangyang-tech/autotest_broker_test
chore(autotest): add autotest broker test git-action script
2022-01-12 17:05:37 +08:00
xiangfangyang-tech c398b75292 chore(autotest): add git action script for automate tests 2022-01-12 10:26:59 +08:00
William Yang 5312aa4a93 ci(cross-build-package): docker build with cache 2022-01-11 17:05:45 +01:00
Zaiming (Stone) Shi 32ac720064 ci: exclude edge + rlog test 2022-01-11 15:13:49 +01:00
k32 6a1ada8623
Merge pull request #6691 from k32/bpapi-run-check
test(bpapi): Run static checks in CI
2022-01-11 13:25:06 +01:00
William Yang 7520620a08 ci(cross_build_packages): use cache 2022-01-11 11:42:19 +01:00
k32 12e61c4bd3 test(dialyzer): Disable separate static checks workflow 2022-01-11 11:26:35 +01:00
k32 5ef3f37c26 test(bpapi): Only run static checks on ubuntu 2022-01-11 11:26:35 +01:00
k32 26f4b2495b test(bpapi): Run verification in CI 2022-01-11 11:26:35 +01:00
William Yang 06abc0d552
Merge pull request #6688 from qzhuyan/ci/william/build-cache-slim-packages
Ci/william/build cache slim packages
2022-01-11 10:58:31 +01:00
William Yang e54b1e0581 ci(build_slim_packages): reenable mac build 2022-01-11 09:58:04 +01:00
William Yang 11daef4ab3 ci: use build cache for build_slim_packages 2022-01-11 09:58:01 +01:00
Zaiming (Stone) Shi 8a92b9dafa docs: update Windows build instructions 2022-01-10 12:15:23 +01:00
Thales Macedo Garitezi 9059f2005a
fix(elixir): put Patch in version and add missing deps
Elixir requires that we use version of the form `Major.Minor.Patch`.
Also, Mix requires dependecies to be declared in `rebar.config` so it
can include the header files correctly.
2022-01-06 10:54:45 -03:00
JimMoen 9a115b99a4 Merge remote-tracking branch 'emqx/release-5.0-beta.3' into merge-5.0-beta.3-to-master 2022-01-06 14:08:45 +08:00
zhanghongtong 46eeeb36cc ci(static checks): timed trigger static check 2022-01-05 17:29:45 +01:00
JimMoen 7ae3c93892 chore(test): update api test script version 2022-01-05 14:37:25 +08:00
Zaiming (Stone) Shi eae2e3ad0c Merge remote-tracking branch 'origin/master' into merge-5.0-beta.3-to-master 2022-01-04 21:11:30 +01:00
Zaiming (Stone) Shi 5df382f054
Merge pull request #6598 from zmstone/ci-port-changes-from-4.4
[5.0] CI port changes from 4.4
2022-01-04 18:52:25 +01:00
Zaiming (Stone) Shi 05ccedd8ec Merge remote-tracking branch 'origin/master' into merge-5.0-beta.3-to-master 2022-01-04 17:32:50 +01:00
Zaiming (Stone) Shi 77652b9858 ci: refactor package build & test jobs 2022-01-04 17:28:53 +01:00
Thales Macedo Garitezi 93cdf318c7
fix(ci): setup mix before running check 2022-01-04 13:28:03 -03:00
Zaiming (Stone) Shi 8ba059bcd7
Merge pull request #6631 from emqx/rm-mix-lock
ci(mix): rm mix.lock from repo
2022-01-04 17:26:30 +01:00
Zaiming (Stone) Shi 55a94256c7 ci: build mac package only when labeled with 'mac' 2022-01-04 16:50:00 +01:00
Thales Macedo Garitezi d78e9429f3
ci(mix): rm mix.lock from repo
While Mix is not the main build tool, we remove the commited
`mix.lock` file to reduce friction when updating dependencies, since
it requires remembering to run `mix deps.get` to update the
`mix.lock`, used by a CI check in
`scripts/check-elixir-deps-discrepancies.exs`.  We change said script
to produce the required file on the fly.
2022-01-04 12:10:58 -03:00
Zaiming (Stone) Shi 503bf54c77 test(authz): fix meck calls
f
2022-01-04 13:54:25 +01:00
xiangfangyang-tech 14f8f5d5d1 chore(autotest): add git-action script 2022-01-04 15:19:06 +08:00
xiangfangyang-tech 8060a962f1 chore(autotest): add git-action script 2022-01-04 15:12:23 +08:00
Thales Macedo Garitezi f947bf6f98
ci(stale): increase number of operations per run
Since we currently have lots of issues, this may help with reaching
the 2nd page of issues.
2022-01-03 13:25:10 -03:00
Thales Macedo Garitezi 1454374b25
ci(stale): avoid spending operations on pull requests
We are interested in using stale actions only for issues, and
currently there's no clear/clean way of making it not enumerate pull
requests.  As a workaround, we attempt to minimize the number of
operations spent on pull requests by making it run only on pull
requests which have an inexistent tag, thus skipping all PRs.
2022-01-03 13:11:33 -03:00
Zaiming (Stone) Shi 719800914a Merge branch 'ci-run-dialyzer-on-slef-hosted' into merge-5.0-beta.3-to-master 2022-01-03 16:23:11 +01:00
Zaiming (Stone) Shi b98a00c35d ci: run dialyzer check on self-hosted runner 2022-01-03 16:07:14 +01:00
Thales Macedo Garitezi 95566c6f16
Merge pull request #6599 from emqx/stale-action
ci: enable stale GH action in place of stalebot

Since stalebot appears to have been unreliable
recently (https://github.com/probot/stale/issues/349), we can try to
use GH Actions to manage the stale issues.
2022-01-03 09:29:32 -03:00
Zaiming (Stone) Shi 2898fa76e1 Merge remote-tracking branch 'origin/release-5.0-beta.3' into merge-5.0-beta.3-to-master 2022-01-03 11:39:06 +01:00
Ilya Averyanov 852033a955
Merge pull request #6525 from savonarola/authn-ssl-tests
chore(authn): test authn ssl settings
2022-01-01 13:41:37 +03:00
Thales Macedo Garitezi 39999fb467
ci: enable stale GH action in place of stalebot
Since stalebot appears to have been unreliable
recently (https://github.com/probot/stale/issues/349), we can try to
use GH Actions to manage the stale issues.
2021-12-31 15:14:44 -03:00
Zaiming (Stone) Shi a52d26620f ci: fix static check group 2021-12-31 13:04:23 +01:00
Zaiming (Stone) Shi 2bfc5b1241 ci: run dialyzer check on self-hosted runner 2021-12-31 11:37:40 +01:00
JimMoen 4ebe47974d chore(test): update api test script version 2021-12-31 10:51:29 +08:00
Thales Macedo Garitezi c29bc126ef
Merge pull request #6507 from emqx/build-with-mix-mkII
Build with Elixir Mix Release
2021-12-30 15:00:38 -03:00
Zaiming (Stone) Shi 5cb2e5696d
Merge pull request #6309 from emqx/configure-stalebot
ci(stalebot): stalebot initial configuration
2021-12-30 14:35:51 +01:00
Ilya Averyanov a7ca6cb39f chore(authn): test MongoDB authn via ssl connection 2021-12-29 16:24:52 +03:00
Thales Macedo Garitezi a54e108296
ci(mix): add application mode check
This adds a CI check to ensure that applications and their modes are
in sync between Elixir and Rebar release builds.
2021-12-27 13:09:55 -03:00
Ilya Averyanov e2e2c98679 chore(authn): test Mysql authn via ssl connection 2021-12-27 11:16:31 +03:00
Ilya Averyanov 6de89d1207 chore(authn): test PostgreSQL authn via ssl connection 2021-12-27 11:16:31 +03:00
Ilya Averyanov 520629d6e2 chore(authn): test Redis authn via ssl connection 2021-12-27 11:16:31 +03:00
Thales Macedo Garitezi cc652c3343
ci(mix): add elixir deps check
Checks whether there are discrepancies between rebar3 and mix deps.
2021-12-24 14:44:49 -03:00
Thales Macedo Garitezi 67cca5d3a1
chore(mix): use the same script in mix release as in rebar release
Surprisingly enough, by doing small cirurgical changes in the existing
EMQX control scripts, we are able to get it running with Elixir and
with existing functionalities (`console`, `remote_console`, `start`,
`stop`, `ctl`, `foreground`, `eval`).
2021-12-23 17:20:04 -03:00
Thales Macedo Garitezi 238895a301
chore(mix): correctly define release version
With this, we no longer need the last hack in `mix_release.sh`.

A version schema with 3 parts (Major.Minor.Patch) is required by
Elixir:

https://hexdocs.pm/elixir/1.13.1/Version.html#module-versions
2021-12-22 15:43:43 -03:00
Thales Macedo Garitezi 62024854e5
chore(mix): wrap produced script and set required variables
We create a shim script that calls the one produced by Mix Release,
creating and setting the required configurations.
2021-12-22 15:15:19 -03:00
Thales Macedo Garitezi 917575de5a
chore(mix): minimal elixir mix release build
This commit enables a minimal working build of EMQX release using
Mix.  However, to properly start the release, several configuration
steps are still missing.  A `mix_release.sh` script does a few hacks
to get the release built with Mix to start properly, by first assuming
that `make emqx` has been run prior to the release, ran once to
generate the `app.*.config` files, and then it copies that and some
other files to the expected places.

Also, `emqx_telemetry` hangs the start procedure because it thinks
it's in an official release and tries to make a request.  We disable
it temporarily via config just to get a working build for now.
2021-12-21 13:51:22 -03:00
tigercl aceb4f1930
Merge pull request #6273 from Rory-Z/ci/add-push-ecr-for-5.0
ci: add new steps for push ecr image when release
2021-12-20 10:27:53 +08:00
Thales Macedo Garitezi 39005265e3
chore(stale): add new exempt tags based off issue handling diagram 2021-12-02 11:34:57 -03:00
zhouzb caf1784a90 build: update otp version 2021-12-02 15:25:11 +08:00
Ilya Averyanov 390575eafb chore(authn): add MongoDB backend tests 2021-11-29 21:17:56 +03:00
Zaiming Shi e2d7ff2b0f build: rename emqx-ee to emqx-enterprise 2021-11-29 14:53:47 +01:00
Thales Macedo Garitezi 6aa4442f33
ci(stalebot): stalebot initial configuration
This adds configuration for
[stalebot](https://github.com/probot/stale) to track our stale issues.

https://github.com/apps/stale
2021-11-25 16:09:31 -03:00
zhanghongtong 6a9bbc726e ci: add new steps for push ecr image when release 2021-11-23 17:55:56 +08:00
Ilya Averyanov 8cc0b43de7 chore(authn): add MySQL & PostgreSQL backend tests 2021-11-23 11:52:51 +03:00
Ilya Averyanov 071c2c99e8 refactor(authn resources): add `emqx_resource` and `emqx_authn` tests 2021-11-22 21:08:04 +03:00
Zaiming Shi 188f1b52c7 ci: rename action matrix dimention name opt_vsn to opt 2021-11-22 08:23:40 +01:00
Zaiming Shi 80aab3ae3f ci: parameterise cross-package build job with branch name 2021-11-22 00:10:44 +01:00
Zaiming Shi bab5d2f399 ci: do not run helm_test for enterprise for now 2021-11-20 20:55:22 +01:00
Zaiming Shi a705bc1fc7 build: change package name scheme
`${PROFILE}-${PKG_VSN}-otp${OTP_VSN}-${SYSTEM}-${ARCH}.zip`
2021-11-20 20:44:48 +01:00
Thales Macedo Garitezi a5c8b95dd8
Merge pull request #6131 from emqx/reenable-rlog-fvt-tests
test(rlog): reenable RLOG FVT tests
2021-11-19 08:46:15 -03:00
Zaiming Shi 2d1aeb655c ci: delete master branch from auto-sync 2021-11-19 08:43:58 +01:00
Thales Macedo Garitezi 315a06214f
test(rlog): reenable RLOG FVT tests
The RLOG DB backend tests in FVT were temporarily disabled due to some
paho tests being specially flaky in CI.

In particular, those tests had the common pattern of subscribing to a
topic, immediately publishing to that topic and then waiting for the
response.  When in CI and using RLOG, there seems to be more delays in
replication of data, and often this pattern would fail in the
constraint testing enviroment.
2021-11-18 18:03:30 -03:00
JimMoen e361cd5733
Fix dashboard APIs return (#6177)
* fix(dashboard_api): delete non-exist user wrongly return 204

* fix(dashboard): dashboard user should use `tags` not `tag`

* fix(dashboard): create/update user return 200 with full users list

* fix(dashboard): logout status code 204

* fix(dashboard): update pwd status code 204

* test: test suite for dashboard APIs

* refactor(dashboard): user info mnesia record name use description

* style: make elvis happy

* fix(api): dashboard swagger check request should not override env

* fix(dashboard): add/modify dashboard returns single record

* ci: update emqx-fvt version to new tag 1.0.2-dev1
2021-11-18 14:36:12 +08:00
JimMoen e07e3c7039 ci: update emqx-fvt version 2021-11-15 16:30:44 +08:00
Zaiming (Stone) Shi aac090ad7b
Merge pull request #6104 from emqx/issue-tmpl-askemq
chore(github-issue-template):  https://askemq.com/
2021-11-11 17:29:23 +01:00
Thales Macedo Garitezi 28e3727aae
fix(ci): temporarily disable rlog FVT tests (flakiness)
A few FVT tests are very flaky when run in rlog core+replicant cluster
configuration (for instance `V5/test_publish.py::test_topic`). We are
disabling this test configuration temporarily while we investigate
further and mitigate it.
2021-11-10 11:03:39 -03:00
William Yang b0dd944fa4
chore(github-issue-template): https://askemq.com/ 2021-11-09 11:33:32 +01:00
Thales Macedo Garitezi f8fc67b313
fix(lag): target only replica if rlog core+replicant
there seems to be race conditions related to some tests with sessions
hitting the core and the replicant alternately and rlog.

for intance, if there is some delay in this replication, a new
connection made to the replica with a just-created session in the core
may not have been replicated to the replicant, resulting in a test
failure if it expects the session to be present.

since such replication lags are inherent to the core-replicant
topology, we can try to target only the replicant to avoid seeing this
inconsistent view of the system during the tests.
2021-11-08 14:18:07 -03:00
Thales Macedo Garitezi c60feaaad2
test(fvt): extend functional verification tests to use replicant node
This parameterizes the Functional Verification Tests (FVTs) that run
in CI to use a replication log (RLOG) role of "replicant" for one of
the nodes.  With this addition, our FVTs may explore more scenarios
with data replication.
2021-11-07 17:02:57 -03:00
Zaiming Shi ce8e52f4d0 ci: fix job syntax 2021-11-04 18:32:03 +01:00
Zaiming Shi d1abb30818 ci: fix elvis check 2021-11-04 15:27:10 +01:00
Zaiming Shi dc58e4a441 ci: check code style
run elvis and nl-at-eof check
2021-11-04 14:47:05 +01:00
zhanghongtong 4fb303e4aa ci: change emqx-ci-helper version for build workflows 2021-10-28 09:22:53 +08:00
zhanghongtong f817ba0075 chore(CI): rename image 2021-10-22 13:40:01 +08:00
zhanghongtong b2d80125b6 build(docker): use ghcr image for build docker 2021-10-22 13:40:01 +08:00
zhanghongtong 7732796331 chore(CI): change otp version for docker compose file
Signed-off-by: zhanghongtong <rory-z@outlook.com>
2021-10-22 13:40:01 +08:00