Commit Graph

968 Commits

Author SHA1 Message Date
Shawn 4135910b42 chore: merge master into dev/ee5.0 2022-09-26 09:52:33 +08:00
Ivan Dyachkov fe80dccf9b build: extract macos packaging into reusable action 2022-09-19 19:25:27 +02:00
zhouzb 25b29de821
Merge pull request #8921 from Rory-Z/ci/fix-helm-push-error
ci(helm): fix helm push error
2022-09-14 09:21:31 +08:00
Ivan Dyachkov cb5be71165
Merge pull request #8897 from emqx/build-sign-macos-binaries
build: sign binary files in macos package
2022-09-13 16:31:32 +02:00
Zaiming (Stone) Shi 4534966e36 Merge remote-tracking branch 'origin/master' into dev/ee5.0 2022-09-13 12:16:54 +02:00
Rory Z b3355ff035 chore(helm): rename emqx-ee helm chart to emqx-enterprise 2022-09-13 17:43:00 +08:00
Zaiming (Stone) Shi d4e8a5377c ci: run spellcheck 0.4.0 2022-09-13 09:45:37 +02:00
Rory Z cbe2173547 chore(helm): add image.tag for helm chart 2022-09-13 15:31:14 +08:00
Rory Z 874414793f chore: add emqx enterprise helm chart 2022-09-13 14:06:39 +08:00
Ivan Dyachkov 7cfca31aaf build: sign binary files in macos package 2022-09-12 21:50:00 +02:00
Rory Z a58529edec ci(helm): fix helm push error 2022-09-08 09:32:59 +08:00
Rory Z c40b95de35 ci(docker): add edition for docker image labels 2022-09-07 10:42:54 +08:00
Zaiming (Stone) Shi befc4acced Merge remote-tracking branch 'origin/master' into merge-master-to-ee50-a 2022-09-06 20:31:38 +02:00
Zaiming (Stone) Shi f785da075b ci: only start required docker for integration tests 2022-09-06 19:25:53 +02:00
Thales Macedo Garitezi 3d4afd65df feat: add mongodb bridge (e5.0) 2022-09-01 14:47:14 -03:00
Zaiming (Stone) Shi 5a3fb4a011 Merge remote-tracking branch 'origin/master' into dev/ee5.0 2022-08-31 17:11:15 +02:00
Shawn edb2e7574f fix: don't update manifest if not an exact tag 2022-08-25 11:46:27 +08:00
Shawn d854ceb91a fix: exclude 'emqx-enterprise' when publish docker images 2022-08-25 09:11:22 +08:00
JianBo He 995115d56f
Merge pull request #8601 from Rory-Z/master
ci: use action to update helm repo
2022-08-23 09:05:19 +08:00
Xinyu Liu 5f7dc431b4
Merge pull request #8718 from emqx/master
merge master into dev/ee5.0
2022-08-15 08:58:20 +08:00
Zaiming (Stone) Shi 150465a600 ci: run eunit and proper tests per build profile 2022-08-14 19:07:40 +02:00
Shawn b3162fe5ff fix: conflicts between master and ee5.0 2022-08-14 22:24:09 +08:00
Zaiming (Stone) Shi d63d6b5f27 ci: do not run opensource edition test for lib-ee apps 2022-08-13 21:04:48 +02:00
Zaiming (Stone) Shi 4949fb222e ci(test): do not fail coverdata uppload if no file found
the optional make <app>-ct action should not fail the
following upload action
2022-08-13 19:09:41 +02:00
Zaiming (Stone) Shi fbb97b16be ci: test all apps with dual profile
no need to test emqx-enterprise profile if the
EMQX_RELEASE_EDITION compilation flag is not used though
2022-08-12 16:21:22 +02:00
Rory Z 54298183fb ci: do not push enterprise image to aws ecr 2022-08-12 09:50:50 +08:00
JimMoen d51ca2672a fix: spellcheck and update checker repo version 2022-08-09 11:50:05 +08:00
firest 0f8e80afb8 chore: fix ci workflows error 2022-08-09 11:22:53 +08:00
Rory Z a831ab40b1 ci: use action to update helm repo 2022-07-29 10:26:37 +08:00
zhouzb ccc734c6ee
Merge pull request #8382 from zmstone/0701-upload-rpm-and-deb-from-slim-builds
ci: upload deb and rpm packages from slim build jobs too
2022-07-26 09:34:20 +08:00
Rory Z 96a45205c4
Merge pull request #8541 from Rory-Z/master
chore: update docker entry point, support dns cluster in k8s
2022-07-25 09:42:37 +08:00
Rory Z 7b270db8d9 chore: update docker entry point, support dns cluster in k8s 2022-07-22 10:18:30 +08:00
Thales Macedo Garitezi e45422b220 ci(mac): drop macos 10.15
Github is dropping support for macos 10.15 in its CI at 2022-08-30.
2022-07-21 11:59:03 -03:00
JimMoen ab17fd80e7 ci: common test add redis-sentinel 2022-07-13 10:37:16 +08:00
Zaiming (Stone) Shi 97731c61ec
Merge pull request #8430 from zmstone/0706-publish-5.0-docker-images-to-ecr
ci: publish 5.0 images to ecr
2022-07-06 14:42:30 +01:00
Zaiming (Stone) Shi 1c48be07c7 ci: publish 5.0 images to ecr 2022-07-06 13:53:56 +02:00
Thales Macedo Garitezi 8296e004a0 refactor(ci): use more generic script 2022-07-05 09:01:00 -03:00
Thales Macedo Garitezi b56be77ee7 fix(docker): avoid tagging elixir image as latest 2022-07-04 17:02:52 -03:00
Zaiming (Stone) Shi e0f8b83b1d ci: fix GitHub action syntax .github/workflows/run_relup_tests.yaml 2022-07-03 12:06:34 +02:00
Zaiming (Stone) Shi 6072d49b2c ci: ignore relup test if no old version is found 2022-07-02 19:57:31 +02:00
Zaiming (Stone) Shi afbbd33496 ci: fix cron triggered cross-build 2022-07-02 19:49:37 +02:00
Zaiming (Stone) Shi 14aa134ed0 ci: no need to download upgrade base packages for opensource edition 2022-07-02 12:13:36 +02:00
Zaiming (Stone) Shi 1d8fbc7c50
Merge pull request #8373 from HJianBo/fix-make-coverall
Test: fix make coverall
2022-07-02 07:24:39 +01:00
Zaiming (Stone) Shi 8383e592cd
ci: delete empty var 2022-07-02 08:23:58 +02:00
Thales Macedo Garitezi 4bf2fad52a ci(release): fix release step script 2022-07-01 14:10:59 -03:00
Zaiming (Stone) Shi 9db86e7c39 ci: upload deb and rpm packages from slim build jobs too 2022-07-01 14:45:59 +02:00
JianBo He e464c3890e chore: get coverall logs 2022-07-01 13:52:07 +08:00
Zaiming (Stone) Shi 550441a131 build: release default package names 2022-07-01 07:46:20 +02:00
Zaiming (Stone) Shi ea399e11d5 ci: release elixir build on el8 instead of el7 2022-07-01 07:43:03 +02:00
Zaiming (Stone) Shi 114d784d1a refactor: move scripts/relup-base-vsns.sh to sub-dir 2022-07-01 07:43:03 +02:00
Zaiming (Stone) Shi bdb370bf4e ci: ensure git safe dir for cross-build prepare stage 2022-07-01 07:43:03 +02:00
Rory Z 270aeb01d8 ci: fix build error 2022-07-01 11:51:50 +08:00
Rory Z ee66e872a3 ci: fix build error 2022-07-01 11:33:22 +08:00
JianBo He 094ed05897
Merge pull request #8351 from HJianBo/compatible-password-field
Authn: backword compatibility for 4.x authn data
2022-07-01 11:10:59 +08:00
JianBo He 3696c3d333 chore: print coverall fails log 2022-07-01 09:51:37 +08:00
Zhongwen Deng b3ec3c9dfb chore: reformat mix.exs 2022-06-30 21:41:16 +08:00
Zaiming (Stone) Shi 84d2fde987
ci: fix relup log upload path (in case of failure)
Co-authored-by: Thales Macedo Garitezi <thalesmg@gmail.com>
2022-06-29 14:41:16 +02:00
Zaiming (Stone) Shi 2af6290040 ci: fix work dir 2022-06-29 09:50:30 +02:00
Zaiming (Stone) Shi e16fdef6bf ci: upload less data in build artifacts 2022-06-29 08:00:55 +02:00
Zaiming (Stone) Shi 8b7fc490ae refactor: run relup test nodes in individual docker containers
When running EMQX in lux shell inside a docker container
the node won't boot due to load_failed for redbug modules
reason is still unknown
2022-06-29 07:10:45 +02:00
Zaiming (Stone) Shi 184b337e84 chore: add a script to run relup lux test locally 2022-06-28 10:54:07 +02:00
Zaiming (Stone) Shi f7a2112a5a ci: define package name instead of globing 2022-06-27 22:22:35 +02:00
Zaiming (Stone) Shi 5c7298eb41 ci: fix wrong upload dir in case of relup test falure 2022-06-27 20:06:49 +02:00
Zaiming (Stone) Shi 4ecff7bd32 ci: fix base package download url 2022-06-27 19:42:43 +02:00
Zaiming (Stone) Shi 46e5127b15 ci: fix type in ci job output 2022-06-27 15:49:27 +02:00
Zaiming (Stone) Shi 129915a199 ci: fix build output name 2022-06-27 15:20:34 +02:00
Zaiming (Stone) Shi 1ba3ae9a44 chore: build emqx packages in one go 2022-06-27 15:11:17 +02:00
Zaiming (Stone) Shi d3f8ebd10f ci: fix relup test workflow and upgrade builder to 5.0-17
builder 5.0-17 has emqtt-bench and lux included
so we do not need to rebuild the software for each ci job
2022-06-27 12:06:13 +02:00
Zaiming (Stone) Shi 0d6c4e0996 Merge remote-tracking branch 'xinyu/fix_relup_testcases' into 0623-fix-relup 2022-06-24 06:00:16 +02:00
Zaiming (Stone) Shi 6aeb73821f ci: relup test upload packages after falure 2022-06-23 23:11:51 +02:00
Zaiming (Stone) Shi bcefec1935 ci: fix relup test 2022-06-23 21:59:43 +02:00
Shawn 9ec88198cb fix: remove one_more_emqx.sh from the relup.lux 2022-06-23 09:14:57 +08:00
Shawn 5d81f159d6 fix(CI): syntax errors in run_relup_tests.yaml 2022-06-22 14:53:34 +08:00
Shawn 08207c086c fix: update integration testcases for relup 2022-06-22 11:56:57 +08:00
Rory Z 7980aa316e ci: fix spell error 2022-06-18 10:03:34 +08:00
Rory Z e986a6f2b4 ci: fix docker multi arch push error 2022-06-18 09:57:25 +08:00
Rory Z e7ffe10966 ci: fix docker push error 2022-06-18 08:52:44 +08:00
Zaiming (Stone) Shi 420bc17c05 ci: delete arm from manifset merge job 2022-06-18 02:15:57 +02:00
Zaiming (Stone) Shi 8deff722e4 ci: no ecr registry for now 2022-06-18 01:56:01 +02:00
Zaiming (Stone) Shi aa7148fbc6 ci: adjust matrix dimensions order 2022-06-18 01:50:27 +02:00
Zaiming (Stone) Shi 9d6b81ccf4 ci: fix bad matrix dimensions for elixir docker image build 2022-06-18 01:34:53 +02:00
Zaiming (Stone) Shi 2b4085fe4d ci: use prepare step generated value to decide 'latest' docker tag 2022-06-18 01:21:00 +02:00
Zaiming (Stone) Shi 140216a67b ci: always need to login docker registry before push 2022-06-18 01:05:53 +02:00
Zaiming (Stone) Shi 797964a3f7 ci: add profile as input for build_packages workflow 2022-06-18 00:57:54 +02:00
Zaiming (Stone) Shi 536b056b01 ci: build only one profile at a time 2022-06-18 00:49:06 +02:00
Zaiming (Stone) Shi 12b96702f4 ci: use raw value for docker tags
resolve docker tag from git tag
2022-06-18 00:28:36 +02:00
Zaiming (Stone) Shi fb54617dba ci: fix profile resolution 2022-06-17 23:41:37 +02:00
Zaiming (Stone) Shi c1fdfcc2d7 ci: make possilbe to manually build specific profile 2022-06-17 23:32:12 +02:00
Zaiming (Stone) Shi d1b2ea80d2 ci: fix github workflow syntax 2022-06-17 22:25:04 +02:00
Zaiming (Stone) Shi 61b984c031 ci: fix github workflow syntax 2022-06-17 22:24:08 +02:00
Zaiming (Stone) Shi 56de8af04f ci: fix github workflow syntax 2022-06-17 22:23:20 +02:00
Zaiming (Stone) Shi ee5e402bab ci: fix workflow yaml syntax 2022-06-17 22:16:15 +02:00
Zaiming (Stone) Shi 28c6f70aa3 ci: push docker images at git tag event 2022-06-17 20:06:40 +02:00
Zaiming (Stone) Shi ec8f3834b7 ci: upload windows package 2022-06-17 13:57:51 +02:00
Zaiming (Stone) Shi 72cbe5c831
Merge pull request #8244 from zmstone/0616-pin-quic-0.0.12-make-user-of-build-cache
0616 pin quic 0.0.12 make use of build cache
2022-06-16 14:10:19 +01:00
Zaiming (Stone) Shi a2a4c813e7
Merge pull request #8246 from Rory-Z/feat/helm-support-dns-cluster
feat(helm): support dns cluster
2022-06-16 14:10:06 +01:00
Zaiming (Stone) Shi b3182609c3 ci: delete dpes cache from github work-flows 2022-06-16 13:07:27 +02:00
Rory Z 780bda2803 feat(helm): support dns cluster 2022-06-16 18:48:27 +08:00
Zaiming (Stone) Shi ddf5d5c6a6
ci: add codeball review
Experimental!
2022-06-16 11:12:12 +02:00
Zaiming (Stone) Shi 7715feb3e4 ci: ensure macos github runner installs coreutils 2022-06-16 07:53:20 +02:00
Zaiming (Stone) Shi c8170f6a50 ci: disable quicer build cache fro cross-build jobs 2022-06-16 01:00:11 +02:00
Zaiming (Stone) Shi 2d61de777b ci: upload artifacts for all builds (not just tags) 2022-06-15 14:30:05 +02:00
William Yang d49a75ae28 chore: don't build quic on MacOS 2022-06-13 13:09:20 +02:00
Shawn f18eab402a fix(CI): don't use any authz sources when testing 2022-06-10 14:21:20 +08:00
Zaiming (Stone) Shi 7b559193d1
Merge pull request #8054 from Rory-Z/ci/change-base-image
build(docker): change docker base image to debian
2022-06-07 10:25:08 +01:00
Rory Z d5704c2c48 build(docker): change docker base image to debian, and add new tag for alpine image 2022-06-07 06:15:15 +02:00
Zhongwen Deng cd91b4b582 fix: dialyzer never match warning 2022-06-07 10:47:40 +08:00
Zaiming (Stone) Shi fc4d9e4dcd ci: use emqx-builder 5.0-16
Fixed openssl compatibility issue
2022-06-06 10:54:26 +02:00
Ilya Averyanov a6911517aa fix(ci): set explicit version for system-wide Erlang 2022-06-02 15:08:20 +03:00
Ilya Averyanov 0893a36dec fix(authn): removed explicit chain creation for security reasons 2022-06-02 14:03:19 +03:00
ieQu1 83e5ec9b2d chore(ci): Bump emqx-schema-validate to 0.3.3 2022-05-31 18:00:33 +02:00
Zaiming (Stone) Shi d249c2c22e
Merge pull request #8056 from thalesmg/move-db-config
chore(config): move db configs under cluster/node keys
2022-05-28 08:09:15 +01:00
Thales Macedo Garitezi d93977ccd3
ci(elixir): use `MIX_ENV` profiles for machine boot checks
With the change to using `MIX_ENV` for choosing a profile, the CI
check became out of date.
2022-05-27 09:07:46 -03:00
Zaiming (Stone) Shi ebe4d7c3fb refactor: stop releasing edge edition
Prior to EMQX 5.0, the edge edition's main difference comaring
to standard edition are:
* Less number of plugins in the release (smaller package size)
* Smaller number is vm.args (for lower memory usage)

Starting from 5.0 most of the plugins are included as features,
the tuned vm.args arguments does not justify a special release edition.

Also as nanomq is getting mature,
EMQ's recommendtation for MQTT broker in edge is https://nanomq.io/
2022-05-26 20:05:46 +02:00
Thales Macedo Garitezi e8d37a26da
fix(ci): run workaround before starting
line-break check was failing before:

```
Run ./scripts/check-nl-at-eof.sh
  ./scripts/check-nl-at-eof.sh
  shell: sh -e {0}
fatal: unsafe repository ('/__w/emqx/emqx' is owned by someone else)
To add an exception for this directory, call:

	git config --global --add safe.directory /__w/emqx/emqx
```
2022-05-26 14:02:22 -03:00
Shawn eea9bd90b4 fix: remove the extra level of 'emqx' dir from .tar.gz 2022-05-25 02:00:01 +08:00
JianBo He aae5e55e21 ci: upload all cover files 2022-05-19 14:13:53 +08:00
ieQu1 02eaaace20
Merge pull request #7965 from ieQu1/ci-avoid-duplicate-git-conf
ci: Avoid adding duplicate entries to git config
2022-05-16 18:59:29 +02:00
ieQu1 12860bf87b ci: Avoid adding duplicate entries to git config 2022-05-16 12:54:48 +02:00
Shawn 5d65bdaa47 chore: ping emqx-builder to 5.0-15 2022-05-16 18:10:42 +08:00
Zaiming (Stone) Shi 3bcd76a681 ci: try to prepare a compiled test profile for test jobs 2022-05-11 20:55:18 +02:00
Zaiming (Stone) Shi e95a14843d ci: delete otp 23 from ci matrix 2022-05-10 16:34:53 +02:00
Shawn 48db7ceb5f fix: set AUTO_INSTALL_BUILD_DEPS for CI 2022-05-07 22:47:20 +08:00
Shawn d80b7c720b chore: check dependenies before building on Mac OSX 2022-05-07 22:16:44 +08:00
Kjell Winblad 74c33cd4e5 feat(rule_engine): add jq function to the rule engine
This commit adds a function to the rule engine that alows users
to transform text or JSON objects using [jq filter programs][1].

[jq][1] is a command line tool that can be used to transform
and filter JSON text using jq's built-in language. The rule engine
function that is added with this commit uses the
[Erlang jq NIF library][2] that wraps the jq C library in an
Erlang NIF function.

[1]: https://stedolan.github.io/jq/
[2]: https://github.com/emqx/jq
2022-05-04 17:09:16 +02:00
Zaiming (Stone) Shi 8ff552c9cf
Merge pull request #7827 from qzhuyan/ci/william/build-ct-self-hosted
cI: ct self-hosted pull image from docker proxy instead
2022-04-29 16:31:22 +01:00
Zaiming (Stone) Shi edc6a6ab38 ci: run emqx app standalone tests only for pull requests 2022-04-29 10:11:05 +02:00
Xinyu Liu 635486bbaf
Merge pull request #7821 from terry-xiaoyu/update_ensure_rebar3
chore: port ensure-rebar3.sh from 4.x
2022-04-29 10:21:48 +08:00
William Yang be375ae621 ci: use docker image cache in aws 2022-04-28 18:01:12 +02:00
Shawn 50f1dcef97 fix: update elixir CI yamls for getting rebar3 2022-04-28 23:07:38 +08:00
William Yang 9bce83c10d ci(self-hosted): ct docker 2022-04-28 16:40:24 +02:00
Zaiming (Stone) Shi 71d166af27 ci: remove 'if: always()' from allgood jobs 2022-04-28 15:09:59 +02:00
Zaiming (Stone) Shi 94239d98df ci: no need to test apps/emqx if nothing changed in this sub-dir 2022-04-28 15:09:59 +02:00
Zaiming (Stone) Shi 89d242c3a3 ci: add 'allgood' summary jobs to a few builds
* build_slim_packages
* run_emqx_app_tests
* run_jmeter_tests
* run_test_cases
2022-04-28 15:09:59 +02:00
Zaiming (Stone) Shi 0ad463ac84 ci: do not use matrix for code_style_check
So the job can be used as 'required' for PRs
2022-04-28 15:09:59 +02:00
Zaiming (Stone) Shi a93eee5d08 ci: rename broker tests ci job to 'run_jmeter_tests' 2022-04-28 15:09:59 +02:00
Zaiming (Stone) Shi fdde829ab9 ci: better names to ci checks 2022-04-28 15:09:59 +02:00
William Yang 1db20678b1
Merge pull request #7806 from qzhuyan/ci/william/build-ct-self-hosted
ci(self-hosted): run ct
2022-04-28 15:03:16 +02:00
William Yang 89b7c87e19 ci(self-hosted): run ct 2022-04-28 13:32:55 +02:00
Zaiming (Stone) Shi ad7272b162 ci: get OS from builder image name
cross build is running in container
can not run docker in dokcer
2022-04-28 10:48:02 +02:00
Zaiming (Stone) Shi 4c0da19ee6 ci: try to clean up workspace before checkout 2022-04-27 16:11:19 +02:00
William Yang 106d45ca53 ci(self-hosted): clean before run 2022-04-27 11:48:20 +02:00
William Yang be67e27aa4 ci: build slim packages on self-hosted runners 2022-04-27 10:46:54 +02:00
JimMoen 1340c8e553 chore: fix typos in workflow file 2022-04-27 11:00:43 +08:00
ieQu1 3e171ef075 ci(mac): Increase wait time for node up 2022-04-26 16:57:13 +02:00
Thales Macedo Garitezi 208cc0fad8
feat(node_dump): add license info to node_dump 2022-04-25 11:42:20 -03:00
ieQu1 67a94732ac chore(spellcheck): Bump container version to 0.3.1 2022-04-21 23:48:47 +02:00
ieQu1 c5d97678c5 ci(spellcheck): Treat missing descriptions as erros 2022-04-05 00:11:38 +02:00
ieQu1 99b3f2f83e docs(schema): Document missing records and fields 2022-04-04 23:58:43 +02:00
xiangfangyang-tech 05ddf9f9d4 chore(autotest): turn on mysql&pgsql authz scripts test and mqtt topic rewrite&delayed publish 2022-03-31 16:58:04 +08:00
Zaiming (Stone) Shi b49df4599a build: use latest builder images (alpine 3.15.1)
OpenSSL-1.1.1n
2022-03-25 07:38:39 +01:00
ieQu1 93d1c4ec87 ci(spellcheck): Bump container version to 0.2.3 2022-03-23 14:24:00 +01:00
ieQu1 684879eaa6 ci(spellcheck): Bump validator container version 2022-03-22 19:09:20 +01:00
Zaiming (Stone) Shi 22682ff646
Merge pull request #7359 from zmstone/reformat-app-emqx
chore: reformat app emqx
2022-03-21 20:53:33 +01:00
Zaiming (Stone) Shi 4b68c82612 ci: move elvis check to the end 2022-03-21 17:54:30 +01:00
Zaiming (Stone) Shi 8cd5c0c83a chore: add a simple bash to wrap format_app.py to be used in CI 2022-03-21 17:16:28 +01:00
Zaiming (Stone) Shi d22769a2de ci: build enterprise for e tags 2022-03-21 15:29:28 +01:00
zhanghongtong 5d3d4cf85c ci: fix login error for aws ecr 2022-03-21 11:35:39 +08:00
zhouzb 82911e743f
Merge pull request #7296 from Rory-Z/ci/fix-login-error-for-aws-ecr
ci(cross build): fix login error for aws ecr
2022-03-18 17:21:11 +08:00
DDDHuang d1574977e5 fix(ci): update jmeter to 5.4.3 2022-03-18 15:06:21 +08:00
Zaiming (Stone) Shi f9aba61dbb ci: run ct in concurrent jobs 2022-03-15 20:40:22 +01:00
zhanghongtong 2f7f021197 ci(cross build): fix push aws ecr error when single arch image 2022-03-15 11:34:03 +08:00
zhanghongtong 20e2c41975 ci(cross build): add more if conditions 2022-03-15 11:29:55 +08:00
ieQu1 960c5ad0d5 ci: Run spellcheck 2022-03-14 22:27:46 +01:00
zhanghongtong d3f05d35a8 ci(cross build): fix login error for aws ecr 2022-03-14 15:26:20 +08:00
Zaiming (Stone) Shi 49ad66b4bd ci: no need for rocksdb cache anymore 2022-03-11 14:54:00 +01:00
xiangfangyang-tech 34c3710d99
Merge pull request #7277 from xiangfangyang-tech/autotest_broker_v5
chore(autotest): add some new steps in gitaction to run test scripts about authn authz
2022-03-11 14:11:36 +08:00
xiangfangyang-tech 5a456fda98 chore(autotest): add some authn authz test steps in git action 2022-03-11 10:55:16 +08:00
zhongwencool 6d272970f4
Merge pull request #7088 from ieQu1/fix-spellcheck-workflow
ci(spellcheck): Use a different action
2022-03-10 18:18:17 +08:00
Zaiming (Stone) Shi 9106b230a9
Merge pull request #7254 from zmstone/merge-proper-coverdata
Merge proper coverdata
2022-03-10 09:43:18 +01:00
xiangfangyang-tech a1c76f474b chore(autotest): add gitactions for new autotest scripts 2022-03-10 15:59:09 +08:00
Zaiming (Stone) Shi 4d59cbdbdc ci: ensure github token env variable for coveralls 2022-03-09 15:58:28 +01:00
Zaiming (Stone) Shi b78c70a378 ci: merge proper coverdata 2022-03-09 13:32:29 +01:00
Zaiming (Stone) Shi 632d5bf646 ci: explain why we need to run emqx app tests standalone 2022-03-09 13:06:18 +01:00
Zhongwen Deng b3a623897d fix: nl_at_eof warning 2022-03-08 15:01:56 +08:00
Rory Z 5f80ac54c2
Merge pull request #7116 from Rory-Z/ci/update-cross-build
ci(cross build): splitting cross builds and upload assets
2022-03-04 09:19:56 +08:00
Zaiming (Stone) Shi 0f93c23936
Merge pull request #7186 from zmstone/structured-build-info
build: more structured build info
2022-03-02 23:58:08 +01:00
Zaiming (Stone) Shi e6495f4300 ci: upgrade emqx-builder to 5.0-8:1.13.3-24.2.1-1 2022-03-02 21:57:26 +01:00
Zaiming (Stone) Shi d1cf1cca67 ci: add debian11 2022-03-02 21:56:10 +01:00
Zaiming (Stone) Shi 4e64010a3b build: more structured build info 2022-03-02 21:22:03 +01:00
DDDHuang 5eccee0311
Merge pull request #7155 from xujun540/run_api_tests
chore(autotest): Remove all API test scripts
2022-02-28 20:25:18 +08:00
xujun540 058bafd3b9 chore(autotest): Remove all API test scripts 2022-02-28 15:13:51 +08:00
Zaiming (Stone) Shi b68cb96bd2 refactor: make pkg-vsn.sh able to report both short and long version 2022-02-26 01:38:10 +01:00
Zaiming (Stone) Shi ea39a9944c ci: fix package name format for slim build 2022-02-25 12:19:43 +01:00
Zaiming (Stone) Shi 2d3859a79a build: get full version from pkg-full-vsn.sh
this is due to the mapping of :
centos7 -> el7
and rockylinux8 -> el8

with this fix, there is no need to repeat such mapping
in many differennt places
2022-02-25 11:33:01 +01:00
Zaiming (Stone) Shi 64fd321ad1 ci(spelling): check enterprise schema 2022-02-25 09:09:30 +01:00
Zaiming (Stone) Shi b2cb7f1bd5 build: update to latest builder image 2022-02-25 09:09:30 +01:00
Zaiming (Stone) Shi fa91c7491f build: rockylinux 2022-02-25 09:09:30 +01:00
xujun540 04279da8dd chore(autotest): Discard the container API test script 2022-02-25 14:11:57 +08:00
Thales Macedo Garitezi 8cac5f6b39
chore(ci): update emqx-builder image
Uses Elixir 1.13.3 and OTP 24.2.1-1.
2022-02-23 15:00:07 -03:00
Zaiming (Stone) Shi e6380a1911
Merge pull request #7104 from zmstone/fix-windows-build-5.0
[5.0] Fix windows build
2022-02-23 10:22:45 +01:00
zhanghongtong 5435a0978b ci(cross build): splitting cross builds and upload assets 2022-02-23 16:15:53 +08:00
zhongwencool b7f808db9e
Merge pull request #7027 from DDDHuang/error_code
feat: support http error code & error code api
2022-02-23 16:12:20 +08:00
DDDHuang ee4ced82c5 fix: remove jmeter SUITE 2022-02-23 13:55:34 +08:00
Zaiming (Stone) Shi a4e48b197c build: create sha256 sum right after package is built 2022-02-22 22:33:33 +01:00
Zaiming (Stone) Shi 6dedf4875a ci(windows): build windows package on otp 24 2022-02-22 22:33:27 +01:00
Zaiming (Stone) Shi f173a2f61f
Merge pull request #7082 from zmstone/build-refine-scripts-and-ci
chore: relocate tests.sh
2022-02-22 14:29:42 +01:00
k32 a60d230f28 ci(spellcheck): Use a different action 2022-02-21 14:32:49 +01:00
Zaiming (Stone) Shi 1aa9abdb4d chore: relocate tests.sh 2022-02-21 12:22:53 +01:00
Ilya Averyanov 2aeb1bc0e8
Merge pull request #7059 from savonarola/elixir-stylecheck
chore(codestyle): add formatting check for Elixir code
2022-02-21 11:43:14 +03:00
Ilya Averyanov 634d861b90 chore(codestyle): add formatting check for Elixir code 2022-02-18 19:43:48 +03:00
k32 1c62c6e60b docs: Add documentation for the sysmon roots 2022-02-18 16:26:18 +01:00
k32 ef0da4fc70 ci: Spellcheck documentation in the CI 2022-02-18 13:32:33 +01:00
Zaiming (Stone) Shi ee544c8298
Merge pull request #7028 from Rory-Z/build/add-download-relup
build(relup): add new script for download relup base packages
2022-02-17 06:28:20 +01:00
Rory Z 70ce5cbab3
Merge pull request #6929 from Rory-Z/ci/push-multiarch-image-for-aws-ecr-5.0
ci(build_packages): push muilt arch image for aws ecr
2022-02-17 11:45:30 +08:00
zhanghongtong 093e7c3282 build(relup): add new script for download relup base packages 2022-02-16 18:23:02 +01:00
zhanghongtong 3875d5c0e2 ci(build_packages): fix the "if" for push aws ecr image 2022-02-08 16:41:16 +08:00
Ilya Averyanov 17599432d1 feat(license): add license application 2022-02-07 19:05:47 +03:00
zhanghongtong b6e3f66622 ci(build_packages): tag and push aws ecr image when after push docker image 2022-02-07 17:54:30 +08:00
zhanghongtong 420591d09a ci(build_packages): push muilt arch image for aws ecr 2022-02-07 16:09:09 +08:00
Thales Macedo Garitezi a37ee6aa05
fix(flaky_test): improve helm test preparation check 2022-02-03 09:44:10 -03:00
William Yang c9561478ac ci(build-cache): elixir build cache 2022-02-02 12:33:35 +01:00
Zaiming (Stone) Shi 8f5f58500c chore(stale_bot): exempt 'Enhancement' label 2022-02-01 16:55:11 +01:00
William Yang a2223836b9
Merge pull request #6908 from qzhuyan/ci/william/remove-centos8-support
ci: remove centos8 support
2022-02-01 16:11:25 +01:00
William Yang 5c36143186 ci: remove centos8 support
due to centos8 EOL
2022-02-01 15:22:41 +01:00
William Yang 978abe1798 ci: fix jobs triggers 2022-02-01 13:04:52 +01:00
William Yang fd23581dc0
Merge pull request #6880 from qzhuyan/ci/william/aws-arm64-runner
ci: use aws arm64 runner in cross build jobs
2022-02-01 09:05:58 +01:00
William Yang d2a7e549a2 ci(docker): update for the elixir parts 2022-01-31 16:22:43 +01:00
William Yang c00ca8e083 ci(docker): build cache for elixir 2022-01-31 16:14:24 +01:00
Thales Macedo Garitezi 6165ed010a
fix(ci): fix branch wildcard syntax 2022-01-31 10:50:20 -03:00
Thales Macedo Garitezi d4a16fc94a
Merge pull request #6887 from emqx/mix-use-mix_env
chore(mix): use MIX_ENV to define build profile and edition

Instead of reading some environment variables to define the build profile for the Elixir build, we use the MIX_ENV value to emulate Rebar3's profiles. Also, that makes the build output directory more similar to EMQ X's current scheme.
2022-01-31 10:38:00 -03:00
William Yang 9a5c5a7776 ci: fix include 2022-01-31 10:33:36 +01:00
Thales Macedo Garitezi a597e92576
chore(mix): use MIX_ENV to define build profile and edition 2022-01-28 17:24:35 -03:00
William Yang 5206824743 ci: push docker image on my own branch 2022-01-28 19:37:01 +01:00
William Yang 177d42cad4 ci(docker): scripts/docker-create-push-manifests.sh 2022-01-28 19:37:01 +01:00
William Yang 06cf419f02 ci: build arm64 in aws self-hosted 2022-01-28 19:36:59 +01:00
William Yang 528817d620 ci: enable ci tests on pushes.
- Secure tests on master branch after merge.

- Improve build cache hit rates
  Due to security reason, github only allow reuse cache from
  - same branch
  - base branch
  - default branch

  Branch Feature-A could not reuse the cache from Feature-B

- Developers could run the workflow in their own forked repo
  before make the PR, this could relieve the runners on upstream repo
2022-01-28 18:33:53 +01:00
Thales Macedo Garitezi bd0d331b64
Merge pull request #6636 from emqx/elixir-packages-mkII
ci(mix): build emqx packages with elixir
2022-01-27 11:10:30 -03:00
Zaiming (Stone) Shi 97c0f92fcf ci: pin emqx-fvt ref 1.0.4-dev2 2022-01-26 23:32:21 +01:00
Thales Macedo Garitezi a88af8fcbc
ci(cache): use cache for elixir in fvt workflow 2022-01-26 16:59:50 -03:00
Thales Macedo Garitezi 506dad169a
chore(elixir_otp): bump emqx-builder images 2022-01-26 16:59:50 -03:00
Thales Macedo Garitezi e157064e24
fix(ci): use correct condition to build docker images 2022-01-26 16:59:50 -03:00
Thales Macedo Garitezi 06e31830fb
fix(ci): use tgz and elixir package name 2022-01-26 16:59:50 -03:00
Thales Macedo Garitezi aa1a1a7bb1
chore(ci): update CI container images 2022-01-26 16:59:50 -03:00
Thales Macedo Garitezi a974221ffa
chore(mix): split elixir docker image build into separate step 2022-01-26 16:59:50 -03:00
Thales Macedo Garitezi 9c68f4bd11
fix(tgz): replace zip with tgz after rebase 2022-01-26 16:59:49 -03:00
Thales Macedo Garitezi 1240c40364
chore(ci): build only a few zips with elixir, build docker image with
elixir
2022-01-26 16:59:49 -03:00
Thales Macedo Garitezi 3ec7d9ae24
chore(ci): use new tagged image with elixir 2022-01-26 16:59:49 -03:00
Thales Macedo Garitezi f66462ca6b
chore(ci): cache rocksdb+quicer for elixir packages 2022-01-26 16:59:49 -03:00
Thales Macedo Garitezi 59f0d5f537
chore(mix): use flag instead of elixirpkg to denote package type
Also, add Makefile target to build zip files with Elixir.
2022-01-26 16:59:49 -03:00
Thales Macedo Garitezi fca0d2bfd8
fix(ci): split elixir package building into own step
Since the job step may run out of execution time, by separating the
Elixir build from the traditional one may prevent timeouts.
2022-01-26 16:59:49 -03:00
Thales Macedo Garitezi ba6d4e4a19
fix(ci): raspbian arch is arm, not arm64 2022-01-26 16:59:49 -03:00
Thales Macedo Garitezi e874ec2b36
chore(images): use new image in more CI workflows 2022-01-26 16:59:49 -03:00
Thales Macedo Garitezi a91880780a
chore(elixir): change image/package versioning convention
We now go from "most specific" to "most general" versions: Elixir ->
OTP -> OS.
2022-01-26 16:59:48 -03:00
Thales Macedo Garitezi bc498a8041
ci(mix): add fvt tests and docker images with elixir 2022-01-26 16:59:48 -03:00
Thales Macedo Garitezi f24b3f416e
ci(mix): build slim packages with elixir 2022-01-26 16:59:48 -03:00
Thales Macedo Garitezi 6dd11665bb
ci(mix): build emqx packages with elixir 2022-01-26 16:59:48 -03:00
Zaiming (Stone) Shi d44c6eedfd ci: find relup base version using a script 2022-01-26 18:29:55 +01:00
Zaiming (Stone) Shi b44b090d9e ci: get package version per profile 2022-01-26 14:25:59 +01:00
Zaiming (Stone) Shi 5d6136fddb ci: test both ce and ee upgrade 2022-01-26 14:25:59 +01:00
Zaiming (Stone) Shi 391e480824 build: parameterise package version
so that community and enterprise edition can be built from the
same branch
2022-01-26 14:25:59 +01:00
JimMoen 31edd49f76 fix(topic_metrics): `POST` `PUT` need response 2022-01-20 10:15:06 +08:00
William Yang a67c463e8c ci: fix typo 2022-01-18 09:47:25 +01:00
William Yang b347769721 ci: fix indentation in yaml 2022-01-18 09:37:28 +01:00
William Yang 451324300b ci: speed up run_test_case jobs with cache 2022-01-17 08:33:15 +01:00
William Yang bf376afb5a ci: speedup all test jobs with build cache 2022-01-14 10:07:46 +01:00
Zaiming (Stone) Shi 38c0b7766c ci: fix emqx build profile to s3 dir mapping 2022-01-13 22:39:40 +01:00
Zaiming (Stone) Shi 5263f59f0e ci: rename artifact id in api tests flow 2022-01-13 20:28:21 +01:00
Zaiming (Stone) Shi 2faa3fb4cd ci: build test package from latest builder image 2022-01-13 18:54:01 +01:00
Zaiming (Stone) Shi ecd7ea0a2f ci: change to build and test with .tar.gz instead of .zip packages 2022-01-13 18:54:01 +01:00
William Yang fa59141d6d
Merge pull request #6741 from qzhuyan/ci/william/mac-cache-otp-install
ci(mac): cache otp install only
2022-01-13 14:55:08 +01:00
William Yang 30d119d3a9 ci(mac): cache otp install only
only cache otp installation instead of the entire kerl dir to save cache spaces
2022-01-13 11:41:45 +01:00
William Yang 1306946eb1 ci(cross-build-package): revert build cache for docker img
- The docker img use os: alpine, it is unliked to hit a cache.
- The build cache method casue the tag get overwritten among multi
arch builds
2022-01-13 11:26:34 +01:00
William Yang 56859a7fb0
Merge pull request #6716 from qzhuyan/ci/william/build-cache-for-cross-build-packages
build cache for cross build packages
2022-01-12 15:22:05 +01:00
William Yang e388ad1b21 ci(build-cache): add scripts/get-dep-refs.sh 2022-01-12 11:58:50 +01:00
xiangfangyang-tech 62c1f21eff
Merge pull request #6710 from xiangfangyang-tech/autotest_broker_test
chore(autotest): add autotest broker test git-action script
2022-01-12 17:05:37 +08:00
xiangfangyang-tech c398b75292 chore(autotest): add git action script for automate tests 2022-01-12 10:26:59 +08:00
William Yang 5312aa4a93 ci(cross-build-package): docker build with cache 2022-01-11 17:05:45 +01:00
Zaiming (Stone) Shi 32ac720064 ci: exclude edge + rlog test 2022-01-11 15:13:49 +01:00
k32 6a1ada8623
Merge pull request #6691 from k32/bpapi-run-check
test(bpapi): Run static checks in CI
2022-01-11 13:25:06 +01:00
William Yang 7520620a08 ci(cross_build_packages): use cache 2022-01-11 11:42:19 +01:00
k32 12e61c4bd3 test(dialyzer): Disable separate static checks workflow 2022-01-11 11:26:35 +01:00
k32 5ef3f37c26 test(bpapi): Only run static checks on ubuntu 2022-01-11 11:26:35 +01:00
k32 26f4b2495b test(bpapi): Run verification in CI 2022-01-11 11:26:35 +01:00
William Yang 06abc0d552
Merge pull request #6688 from qzhuyan/ci/william/build-cache-slim-packages
Ci/william/build cache slim packages
2022-01-11 10:58:31 +01:00
William Yang e54b1e0581 ci(build_slim_packages): reenable mac build 2022-01-11 09:58:04 +01:00
William Yang 11daef4ab3 ci: use build cache for build_slim_packages 2022-01-11 09:58:01 +01:00
Zaiming (Stone) Shi 8a92b9dafa docs: update Windows build instructions 2022-01-10 12:15:23 +01:00
Thales Macedo Garitezi 9059f2005a
fix(elixir): put Patch in version and add missing deps
Elixir requires that we use version of the form `Major.Minor.Patch`.
Also, Mix requires dependecies to be declared in `rebar.config` so it
can include the header files correctly.
2022-01-06 10:54:45 -03:00
JimMoen 9a115b99a4 Merge remote-tracking branch 'emqx/release-5.0-beta.3' into merge-5.0-beta.3-to-master 2022-01-06 14:08:45 +08:00
zhanghongtong 46eeeb36cc ci(static checks): timed trigger static check 2022-01-05 17:29:45 +01:00
JimMoen 7ae3c93892 chore(test): update api test script version 2022-01-05 14:37:25 +08:00
Zaiming (Stone) Shi eae2e3ad0c Merge remote-tracking branch 'origin/master' into merge-5.0-beta.3-to-master 2022-01-04 21:11:30 +01:00
Zaiming (Stone) Shi 5df382f054
Merge pull request #6598 from zmstone/ci-port-changes-from-4.4
[5.0] CI port changes from 4.4
2022-01-04 18:52:25 +01:00
Zaiming (Stone) Shi 05ccedd8ec Merge remote-tracking branch 'origin/master' into merge-5.0-beta.3-to-master 2022-01-04 17:32:50 +01:00
Zaiming (Stone) Shi 77652b9858 ci: refactor package build & test jobs 2022-01-04 17:28:53 +01:00
Thales Macedo Garitezi 93cdf318c7
fix(ci): setup mix before running check 2022-01-04 13:28:03 -03:00
Zaiming (Stone) Shi 8ba059bcd7
Merge pull request #6631 from emqx/rm-mix-lock
ci(mix): rm mix.lock from repo
2022-01-04 17:26:30 +01:00
Zaiming (Stone) Shi 55a94256c7 ci: build mac package only when labeled with 'mac' 2022-01-04 16:50:00 +01:00
Thales Macedo Garitezi d78e9429f3
ci(mix): rm mix.lock from repo
While Mix is not the main build tool, we remove the commited
`mix.lock` file to reduce friction when updating dependencies, since
it requires remembering to run `mix deps.get` to update the
`mix.lock`, used by a CI check in
`scripts/check-elixir-deps-discrepancies.exs`.  We change said script
to produce the required file on the fly.
2022-01-04 12:10:58 -03:00
Zaiming (Stone) Shi 503bf54c77 test(authz): fix meck calls
f
2022-01-04 13:54:25 +01:00
xiangfangyang-tech 14f8f5d5d1 chore(autotest): add git-action script 2022-01-04 15:19:06 +08:00
xiangfangyang-tech 8060a962f1 chore(autotest): add git-action script 2022-01-04 15:12:23 +08:00
Thales Macedo Garitezi f947bf6f98
ci(stale): increase number of operations per run
Since we currently have lots of issues, this may help with reaching
the 2nd page of issues.
2022-01-03 13:25:10 -03:00
Thales Macedo Garitezi 1454374b25
ci(stale): avoid spending operations on pull requests
We are interested in using stale actions only for issues, and
currently there's no clear/clean way of making it not enumerate pull
requests.  As a workaround, we attempt to minimize the number of
operations spent on pull requests by making it run only on pull
requests which have an inexistent tag, thus skipping all PRs.
2022-01-03 13:11:33 -03:00
Zaiming (Stone) Shi 719800914a Merge branch 'ci-run-dialyzer-on-slef-hosted' into merge-5.0-beta.3-to-master 2022-01-03 16:23:11 +01:00
Zaiming (Stone) Shi b98a00c35d ci: run dialyzer check on self-hosted runner 2022-01-03 16:07:14 +01:00
Thales Macedo Garitezi 95566c6f16
Merge pull request #6599 from emqx/stale-action
ci: enable stale GH action in place of stalebot

Since stalebot appears to have been unreliable
recently (https://github.com/probot/stale/issues/349), we can try to
use GH Actions to manage the stale issues.
2022-01-03 09:29:32 -03:00
Zaiming (Stone) Shi 2898fa76e1 Merge remote-tracking branch 'origin/release-5.0-beta.3' into merge-5.0-beta.3-to-master 2022-01-03 11:39:06 +01:00
Ilya Averyanov 852033a955
Merge pull request #6525 from savonarola/authn-ssl-tests
chore(authn): test authn ssl settings
2022-01-01 13:41:37 +03:00
Thales Macedo Garitezi 39999fb467
ci: enable stale GH action in place of stalebot
Since stalebot appears to have been unreliable
recently (https://github.com/probot/stale/issues/349), we can try to
use GH Actions to manage the stale issues.
2021-12-31 15:14:44 -03:00
Zaiming (Stone) Shi a52d26620f ci: fix static check group 2021-12-31 13:04:23 +01:00
Zaiming (Stone) Shi 2bfc5b1241 ci: run dialyzer check on self-hosted runner 2021-12-31 11:37:40 +01:00
JimMoen 4ebe47974d chore(test): update api test script version 2021-12-31 10:51:29 +08:00
Ilya Averyanov a7ca6cb39f chore(authn): test MongoDB authn via ssl connection 2021-12-29 16:24:52 +03:00
Thales Macedo Garitezi a54e108296
ci(mix): add application mode check
This adds a CI check to ensure that applications and their modes are
in sync between Elixir and Rebar release builds.
2021-12-27 13:09:55 -03:00
Ilya Averyanov e2e2c98679 chore(authn): test Mysql authn via ssl connection 2021-12-27 11:16:31 +03:00
Ilya Averyanov 6de89d1207 chore(authn): test PostgreSQL authn via ssl connection 2021-12-27 11:16:31 +03:00
Ilya Averyanov 520629d6e2 chore(authn): test Redis authn via ssl connection 2021-12-27 11:16:31 +03:00
Thales Macedo Garitezi cc652c3343
ci(mix): add elixir deps check
Checks whether there are discrepancies between rebar3 and mix deps.
2021-12-24 14:44:49 -03:00
Thales Macedo Garitezi 67cca5d3a1
chore(mix): use the same script in mix release as in rebar release
Surprisingly enough, by doing small cirurgical changes in the existing
EMQX control scripts, we are able to get it running with Elixir and
with existing functionalities (`console`, `remote_console`, `start`,
`stop`, `ctl`, `foreground`, `eval`).
2021-12-23 17:20:04 -03:00
Thales Macedo Garitezi 238895a301
chore(mix): correctly define release version
With this, we no longer need the last hack in `mix_release.sh`.

A version schema with 3 parts (Major.Minor.Patch) is required by
Elixir:

https://hexdocs.pm/elixir/1.13.1/Version.html#module-versions
2021-12-22 15:43:43 -03:00
Thales Macedo Garitezi 62024854e5
chore(mix): wrap produced script and set required variables
We create a shim script that calls the one produced by Mix Release,
creating and setting the required configurations.
2021-12-22 15:15:19 -03:00
Thales Macedo Garitezi 917575de5a
chore(mix): minimal elixir mix release build
This commit enables a minimal working build of EMQX release using
Mix.  However, to properly start the release, several configuration
steps are still missing.  A `mix_release.sh` script does a few hacks
to get the release built with Mix to start properly, by first assuming
that `make emqx` has been run prior to the release, ran once to
generate the `app.*.config` files, and then it copies that and some
other files to the expected places.

Also, `emqx_telemetry` hangs the start procedure because it thinks
it's in an official release and tries to make a request.  We disable
it temporarily via config just to get a working build for now.
2021-12-21 13:51:22 -03:00
tigercl aceb4f1930
Merge pull request #6273 from Rory-Z/ci/add-push-ecr-for-5.0
ci: add new steps for push ecr image when release
2021-12-20 10:27:53 +08:00
zhouzb caf1784a90 build: update otp version 2021-12-02 15:25:11 +08:00
Ilya Averyanov 390575eafb chore(authn): add MongoDB backend tests 2021-11-29 21:17:56 +03:00
Zaiming Shi e2d7ff2b0f build: rename emqx-ee to emqx-enterprise 2021-11-29 14:53:47 +01:00
zhanghongtong 6a9bbc726e ci: add new steps for push ecr image when release 2021-11-23 17:55:56 +08:00
Ilya Averyanov 8cc0b43de7 chore(authn): add MySQL & PostgreSQL backend tests 2021-11-23 11:52:51 +03:00
Ilya Averyanov 071c2c99e8 refactor(authn resources): add `emqx_resource` and `emqx_authn` tests 2021-11-22 21:08:04 +03:00
Zaiming Shi 188f1b52c7 ci: rename action matrix dimention name opt_vsn to opt 2021-11-22 08:23:40 +01:00
Zaiming Shi 80aab3ae3f ci: parameterise cross-package build job with branch name 2021-11-22 00:10:44 +01:00
Zaiming Shi bab5d2f399 ci: do not run helm_test for enterprise for now 2021-11-20 20:55:22 +01:00
Zaiming Shi a705bc1fc7 build: change package name scheme
`${PROFILE}-${PKG_VSN}-otp${OTP_VSN}-${SYSTEM}-${ARCH}.zip`
2021-11-20 20:44:48 +01:00
Thales Macedo Garitezi a5c8b95dd8
Merge pull request #6131 from emqx/reenable-rlog-fvt-tests
test(rlog): reenable RLOG FVT tests
2021-11-19 08:46:15 -03:00
Zaiming Shi 2d1aeb655c ci: delete master branch from auto-sync 2021-11-19 08:43:58 +01:00
Thales Macedo Garitezi 315a06214f
test(rlog): reenable RLOG FVT tests
The RLOG DB backend tests in FVT were temporarily disabled due to some
paho tests being specially flaky in CI.

In particular, those tests had the common pattern of subscribing to a
topic, immediately publishing to that topic and then waiting for the
response.  When in CI and using RLOG, there seems to be more delays in
replication of data, and often this pattern would fail in the
constraint testing enviroment.
2021-11-18 18:03:30 -03:00
JimMoen e361cd5733
Fix dashboard APIs return (#6177)
* fix(dashboard_api): delete non-exist user wrongly return 204

* fix(dashboard): dashboard user should use `tags` not `tag`

* fix(dashboard): create/update user return 200 with full users list

* fix(dashboard): logout status code 204

* fix(dashboard): update pwd status code 204

* test: test suite for dashboard APIs

* refactor(dashboard): user info mnesia record name use description

* style: make elvis happy

* fix(api): dashboard swagger check request should not override env

* fix(dashboard): add/modify dashboard returns single record

* ci: update emqx-fvt version to new tag 1.0.2-dev1
2021-11-18 14:36:12 +08:00
JimMoen e07e3c7039 ci: update emqx-fvt version 2021-11-15 16:30:44 +08:00
Thales Macedo Garitezi 28e3727aae
fix(ci): temporarily disable rlog FVT tests (flakiness)
A few FVT tests are very flaky when run in rlog core+replicant cluster
configuration (for instance `V5/test_publish.py::test_topic`). We are
disabling this test configuration temporarily while we investigate
further and mitigate it.
2021-11-10 11:03:39 -03:00
Thales Macedo Garitezi f8fc67b313
fix(lag): target only replica if rlog core+replicant
there seems to be race conditions related to some tests with sessions
hitting the core and the replicant alternately and rlog.

for intance, if there is some delay in this replication, a new
connection made to the replica with a just-created session in the core
may not have been replicated to the replicant, resulting in a test
failure if it expects the session to be present.

since such replication lags are inherent to the core-replicant
topology, we can try to target only the replicant to avoid seeing this
inconsistent view of the system during the tests.
2021-11-08 14:18:07 -03:00
Thales Macedo Garitezi c60feaaad2
test(fvt): extend functional verification tests to use replicant node
This parameterizes the Functional Verification Tests (FVTs) that run
in CI to use a replication log (RLOG) role of "replicant" for one of
the nodes.  With this addition, our FVTs may explore more scenarios
with data replication.
2021-11-07 17:02:57 -03:00
Zaiming Shi ce8e52f4d0 ci: fix job syntax 2021-11-04 18:32:03 +01:00
Zaiming Shi d1abb30818 ci: fix elvis check 2021-11-04 15:27:10 +01:00
Zaiming Shi dc58e4a441 ci: check code style
run elvis and nl-at-eof check
2021-11-04 14:47:05 +01:00
zhanghongtong 4fb303e4aa ci: change emqx-ci-helper version for build workflows 2021-10-28 09:22:53 +08:00
zhanghongtong f817ba0075 chore(CI): rename image 2021-10-22 13:40:01 +08:00
zhanghongtong b2d80125b6 build(docker): use ghcr image for build docker 2021-10-22 13:40:01 +08:00
zhanghongtong 7732796331 chore(CI): change otp version for docker compose file
Signed-off-by: zhanghongtong <rory-z@outlook.com>
2021-10-22 13:40:01 +08:00
zhanghongtong 46a794e38b chore(CI): use concurrency to cancel in-progress workflows 2021-10-22 13:40:01 +08:00
zhanghongtong 4d27d371eb chore(CI): change otp version for workflows 2021-10-22 13:40:01 +08:00
zhanghongtong d334b27e56 chore(CI): better build docker image 2021-10-20 18:24:08 +08:00
zhanghongtong d7a3141a43 chore(CI): use tag of emqtt-bench in github actions 2021-10-19 17:35:38 +08:00
xujun540 cb317b3d7a chore(autotest): modify api automation script version 2021-10-19 15:36:17 +08:00
zhanghongtong bd00c7d3c7 chore(CI): do not update latest tag for docker hub when pre-release 2021-10-11 09:29:51 +08:00
zhanghongtong 48599324de chore(CI): fix push docker error for build packages workflows' 2021-09-29 20:43:05 +08:00
xujun540 e1de837664 chore(autotest): add tag 2021-09-28 19:15:00 +08:00
Zaiming (Stone) Shi 5d89b8d33b
Merge pull request #5804 from Rory-Z/chore/add-macos11-for-workflows
chore(CI): add macos 11 for build workflows
2021-09-26 13:48:20 +02:00
xujun540 92c02c0c8b chore(autotest): add and run test scripts and modify plug-ins 2021-09-26 14:04:43 +08:00
zhanghongtong f091858a27 chore(CI): add macos 11 for build workflows
Signed-off-by: zhanghongtong <rory-z@outlook.com>
2021-09-26 12:33:59 +08:00
zhanghongtong 1e8948e091 chore(CI): use ghcr
Signed-off-by: zhanghongtong <rory-z@outlook.com>
2021-09-16 14:33:59 +08:00
xujun540 a45cbf504b chore(test): modify format 2021-09-16 11:09:47 +08:00
xujun540 a673f18c41 chore(test): modify format 2021-09-16 11:09:47 +08:00
xujun540 4a4014855f chore(autotest): add api test script 2021-09-16 11:09:47 +08:00
zhanghongtong d443d26fce fix(auth mnesia api): fix api error for file type 2021-09-13 17:13:30 +08:00
xujun540 a6e335e715
chore(autotest): add api test script configuration 2021-09-11 10:38:18 +08:00
xiangfangyang-tech 5f94b8e1ff
chore(CI): add api test workflows for github actions (#5640) 2021-09-03 15:05:30 +08:00
Zaiming (Stone) Shi c64af6a78c
Merge pull request #5532 from zhongwencool/master
feat(emqx_cluster_call): ensure the consistency of resources
2021-08-27 09:40:31 +02:00
DDDHuang 86231f795d
refactor: close managment http 8081 (#5564) 2021-08-27 13:46:39 +08:00
zhongwencool 11e87ab9a3 chore(CI): DIAGNOSTIC=1 for more error message 2021-08-26 17:17:47 +08:00
zhanghongtong a2bafd1a18 feat(authz): support authorization config file part 2 2021-08-25 10:15:00 +08:00
zhanghongtong 0111306224 chore(CI): fix log attachment overwrite error 2021-08-24 16:15:14 +08:00
zhanghongtong 41f2b77ec3 chore(CI): update workflows
Signed-off-by: zhanghongtong <rory-z@outlook.com>
2021-08-24 15:04:27 +08:00
zhanghongtong c90fc9578e chore(CI): using docker official actions for build packages workflow
Signed-off-by: zhanghongtong <rory-z@outlook.com>
2021-08-13 15:28:00 +08:00
zhanghongtong c78945441c chore(CI): timed trigger code synchronization 2021-08-13 15:20:36 +08:00
zhanghongtong d1faf93bbf chore(CI): rename artifact for build packages workflows
Signed-off-by: zhanghongtong <rory-z@outlook.com>
2021-08-13 10:30:42 +08:00
Zaiming (Stone) Shi 64ddb13d8e
Merge pull request #5450 from zmstone/chore-update-otp-version-for-ci
chore: update otp version in CI
2021-08-11 14:02:54 +02:00
Zaiming Shi 4abb3e65eb test(ci): dump haproxy logs if test failed 2021-08-11 10:39:40 +08:00
Zaiming Shi bf94051d56 chore: update otp version in CI 2021-08-10 15:56:22 +02:00
x1001100011 0fe3083cd7 build: add erlang 24.0.1 for ci 2021-08-09 11:12:25 +02:00
zhanghongtong cf20fc6db7 chore(CI): easier build packages
Signed-off-by: zhanghongtong <rory-z@outlook.com>
2021-08-04 22:20:54 +08:00
zhanghongtong b69059d442 build: easier build docker
Signed-off-by: zhanghongtong <rory-z@outlook.com>
2021-08-04 09:31:02 +08:00
Shawn f8f7493352 fix(test): set RETRY_INTERVAL and MAX_TOPIC_ALIAS for paho test 2021-07-17 17:36:01 +08:00
DDDHuang d04e1c6f54
refactor: clients api; status api; adapter minirest v1
The serious influence:
authn:
api
authz:
api; api test suit
dashboard:
all closed
lwm2m:
api;
modules:
api(api_topic_metrics, modules_api); test suit(emqx_modules_SUITE)
prometheus:
api
retainer:
api; api test suit
rule_engine:
api: api test suit
telemetry:
api
2021-07-12 10:05:51 +08:00
DDDHuang c11a8c6db6 refactor: clients api; status api; adapter minirest v1
The serious influence:

authn:
    api
authz:
    api; api test suit
dashboard:
    all closed
lwm2m:
    api;
modules:
    api(api_topic_metrics, modules_api); test suit(emqx_modules_SUITE)
prometheus:
    api
retainer:
    api; api test suit
rule_engine:
    api: api test suit
telemetry:
    api
2021-07-09 18:09:07 +08:00
William Yang 939f3855d5 ci(build-packages): docker fail fast: false 2021-07-07 13:41:47 +02:00
William Yang 9d760ff5bd ci(build-packages): rm rebar.lock in prepare phase 2021-07-07 13:41:47 +02:00
William Yang 606e48560c ci: build-package set fail-fast to false
To get better overall vision
2021-07-06 10:18:14 +02:00
zhanghongtong b2801299cb chore(CI): cancel build of 32-bit docker 2021-07-06 09:25:56 +08:00
zhanghongtong 2f5ab6a974 chore(CI): fix macos build error 2021-07-05 13:28:56 +08:00
Rory Z b93ec0a83a chore(CI): fix github workflows error (#1) 2021-07-02 17:01:16 +08:00
Turtle 918a26e921 feat(conf): merge all conf to emqx.conf 2021-07-02 17:01:16 +08:00
Rory Z d7c1cf6a5f chore(CI): delete compatibility test suite 2021-06-28 11:44:01 +08:00
Rory Z 8eca3e3a4e chore(CI): update ci env 2021-06-28 11:44:01 +08:00
Shawn 36c7785fd0 The config handler phase2 (#5052)
* refator(config_handler): handle and validate the updates to raw_configs

* fix(hocon): update hocon to 0.8.0

* refactor(config_handler): check and apply envs only in top-level handler

* refactor(config_handler): update config from top level to bottom level

* refactor(emqx_data_bridge): move configs to emqx.conf

* fix(emqx_schema): remove the extra config path

* fix(config_handler): load the emqx.conf when starting emqx_config_handler

* fix(data_bridge): API not working

* feat(config_handler): save updated configs to emqx_override.conf

* fix(config_handler): cannot find the emqx.conf and emqx_override.conf

* fix(emqx_config): cannot find the correct path for etc dir

* fix(test): load load emqx_schema foreign refereced apps

* refactor(emqx_plugin): do not generate configs before load plugins

All configs (including the configs for plugins) now should go into
the `emqx.conf`.

* fix(tests): update the test cases for plugins

* fix(tests): don't include schema from apps when testing

* fix(tests): use emqx-ct-helper branch hocon
2021-06-28 11:43:48 +08:00
zhanghongtong d4784a0d33 chore(CI): upload logs when emqx ct failed 2021-06-28 11:43:31 +08:00
zhanghongtong 05150ce58b revert: chore(CI): update events that trigger workflows
This reverts commit 002cbb6d8b
2021-06-28 11:42:55 +08:00
zhanghongtong 2f7373dd1c chore(CI): update events that trigger workflows 2021-06-28 11:42:55 +08:00
zhanghongtong d7da6b2379 chore(CI): delete needless link when build packages 2021-06-28 11:42:55 +08:00
zhanghongtong 1ecd0a54b9 chore(CI): add DIAGNOSTIC=1 when build windows 2021-06-28 11:42:55 +08:00
zhanghongtong 96c07a5055 chore(CI): upload rebar3.crashdump file when slim build failure 2021-06-28 11:42:38 +08:00
Zaiming Shi c84af95190 chore: ensure new env override prefix variable 2021-06-15 12:35:08 +02:00
zhanghongtong 3b21ad7225 Merge branch master into main-v4.3 2021-06-11 09:27:46 +08:00
zhanghongtong 3604593b86 chore(CI): use emqx otp in mac by kerl build 2021-06-10 14:28:57 +08:00
zhanghongtong 1098df815a chore(CI): fix relup error 2021-06-10 09:25:37 +08:00
turtleDeng a564e0c4bf
Merge pull request #4947 from emqx/dev/v5.0
Merge dev/v5.0 to master
2021-06-07 17:26:38 +08:00
zhanghongtong 5d30e52e73 chore(CI): fix error for sync code to enterprise 2021-06-07 16:02:01 +08:00
zhanghongtong d5366c7f5f chore(CI): change base branch to sync enterprise 2021-06-07 15:47:37 +08:00
Zaiming Shi 045a944192 chore(ci): check emqx app standalone 2021-06-07 09:09:28 +02:00
Zaiming Shi 948ff66111 test: fix rebar3 eunit arg
--dir apps/app_name causes rebar3 to crash because eunit handler
injects a `[]` as one of the extra_src_dirs option
2021-06-07 09:09:28 +02:00
Zaiming (Stone) Shi 729e9697cd
Merge pull request #4943 from emqx/master
Auto-pull-request-on-2021-06-05
2021-06-07 09:05:42 +02:00
Zaiming Shi e01222ef21 build: build macos package on correct OTP release 2021-06-05 19:53:56 +02:00
zhanghongtong 8f936e3839 chore(CI): remove raspbian9 in build packages workflows 2021-06-05 23:28:28 +08:00
zhanghongtong 7d0324fb1b chore(CI): fix download packages error in build packages 2021-06-05 18:57:00 +08:00
Zaiming (Stone) Shi 5dab6985c1
Merge branch 'dev/v5.0' into resolve-master-dev/v5.0-conflict-release-version 2021-06-05 11:51:02 +02:00
zhanghongtong d5059a2a37 chore(CI): fix download packages error in build packages 2021-06-05 17:49:27 +08:00
tigercl 12bab3716b
Merge pull request #4936 from Rory-Z/chore/change-trigger
chore(CI): update events that trigger workflows
2021-06-05 14:54:41 +08:00
zhanghongtong d825535d04 chore(CI): update events that trigger workflows 2021-06-05 14:09:12 +08:00
zhanghongtong 2052521715 chore(CI): fix relup error in enterprise 2021-06-05 01:44:53 +08:00
zhanghongtong 2711dc6219 chore(CI): fix appup workflows 2021-06-05 00:59:23 +08:00
zhanghongtong 6c4f297192 chore(CI): update build packages workflows for appup 2021-06-04 21:32:00 +08:00
Zaiming (Stone) Shi 913420588d
Merge branch 'dev/v5.0' into resolve-conflict-to-5.0 2021-05-31 09:17:21 +02:00
JianBo He 3a89b1f00b
chore(action): fix syntax error (#4885) 2021-05-31 15:08:52 +08:00
Rory Z 11352c4eaa
chore(ci): use cache for macos in slim build (#4883) 2021-05-28 09:57:55 +08:00
zhanghongtong a7d3dced5e chore(ci): ensure rebar3 in actions 2021-05-27 21:50:03 +08:00
Zaiming Shi 0424200978 build: ensure rebar3 in PATH for build_packages action 2021-05-27 12:42:21 +02:00
Zaiming Shi 925aa55951 build: add back macos erlang install cache 2021-05-27 16:18:17 +08:00
Zaiming Shi 0ac3e6e0ce build: ensure rebar3 in PATH 2021-05-27 16:18:17 +08:00
z8674558 31cbb7aa97 Merge branch 'master' of github.com:emqx/emqx into merge-master 2021-05-25 12:50:50 +09:00
Zaiming Shi 6015b4ac4a build: disable macos build cache for now 2021-05-24 21:12:15 +02:00
zhanghongtong f2ccf97780 chore(CI): fix relup tests error in enterprise repo 2021-05-24 18:00:48 +08:00
zhanghongtong 09084e4e27 chore(CI): fix relup tests error in enterprise repo 2021-05-24 15:11:46 +08:00
Zaiming Shi 7a969e085f test: ensure erlang 23 in more github actions 2021-05-21 17:59:17 +02:00
Zaiming Shi a8cb5678b5 test: ensure erlang 23 in github action 2021-05-21 16:48:01 +02:00
zhanghongtong 18036fdf3b chore(CI): show rebar3.crushdump when actions failed 2021-05-17 15:09:12 +08:00
zhanghongtong db4a76fe75 chore(CI): relup test support any commit 2021-05-14 05:41:00 +09:00
Rory-Z 0788aa972f chore(CI): fix app version check 2021-05-14 05:41:00 +09:00
zhanghongtong fb643fc53f chore(CI): add apps version check 2021-05-14 05:41:00 +09:00
z8674558 efe0c2fe1a fix(docker-entrypoint): do not mv loaded_plugins file, copy it by cat 2021-05-14 05:41:00 +09:00
zhanghongtong 0abdde0bad chore(CI): use cache for mac 2021-05-14 05:41:00 +09:00
Turtle 7ef173f2c2 chore(slim): fix build silm macosx fail 2021-05-14 05:41:00 +09:00
zhanghongtong b288710429 chore(CI): update build workflows 2021-05-14 05:41:00 +09:00
zhanghongtong 9c244679dc chore(CI): relup test support any commit 2021-05-13 19:05:34 +08:00
Rory-Z 0bf76adfd5 chore(CI): fix app version check 2021-05-12 10:34:54 +08:00
zhanghongtong bb490e7d6e chore(CI): add apps version check 2021-05-11 09:07:48 +08:00
z8674558 50f4e0617b fix(docker-entrypoint): do not mv loaded_plugins file, copy it by cat 2021-05-10 20:54:33 +09:00
zhanghongtong 29bbc0802b chore(CI): use cache for mac 2021-05-09 10:58:00 +08:00
Turtle a07fece436 chore(slim): fix build silm macosx fail 2021-05-08 21:32:16 +08:00
zhanghongtong 934d3c405d chore(CI): update build workflows 2021-05-08 13:57:02 +08:00
Zaiming Shi 814588d1c8 Merge remote-tracking branch 'origin/master' into resolve-conflict-master-to-v5.0 2021-05-07 22:24:38 +02:00
Zaiming Shi 05324dfd7c build(ci): download old versions 2021-05-07 21:25:10 +02:00
Zaiming (Stone) Shi 0d9a9fc966
Merge branch 'dev/v5.0' into resolve-conflict-master-to-v5.0 2021-05-07 08:43:26 +02:00
zhanghongtong 88df1713b1 chore(CI): fix relup tests error 2021-05-07 10:18:14 +08:00
zhanghongtong 323c1a4896 chore(CI): fix relup tests error 2021-05-07 09:32:52 +08:00
Zaiming Shi cd53568f36 build: pin otp 23.2.7.2-emqx-2 2021-05-06 21:05:39 +02:00
zhanghongtong e44bd431b9 chore(CI): when uplpad release asset, distinguish between enterprise and opensource repos 2021-05-05 15:18:34 +08:00
Zaiming Shi d904a1048b Merge remote-tracking branch 'origin/master' into merge-master-to-dev/v5.0 2021-04-30 15:09:31 +02:00
Zaiming Shi cacb56a25c build: pin erl23.2.7.2-emqx-1 2021-04-27 21:23:40 +02:00
k32 5fe1e30ad9 chore(ci): Don't fail builds when coveralls is misbehaving 2021-04-26 14:27:22 +02:00