Commit Graph

968 Commits

Author SHA1 Message Date
Ivan Dyachkov 915f0171b3 ci: fix manual trigger of release workflow 2023-11-28 17:26:44 +01:00
Ivan Dyachkov f463f267cf ci: fix insufficient permissions for github token in release workflow 2023-11-28 16:52:10 +01:00
Ivan Dyachkov c1ef0f71e8 ci: fix access to prerelease field in github object 2023-11-28 10:54:40 +01:00
Ivan Dyachkov f1f62d3af1 ci: stop building packages for macos-11 2023-11-22 09:48:08 +01:00
Zaiming (Stone) Shi 55d1b07a41 ci: remove windows from CI
Starting from v5.4.0, we will stop release windows packages.
The windows build scripts are still around, will be deleted
in follow-up PRs
2023-11-21 19:36:38 +01:00
Ivan Dyachkov e15553f9bd ci: fix pattern for on push branch 2023-11-09 16:45:08 +01:00
Ivan Dyachkov 0c91bec98d chore: merge 'upstream/release-53' 2023-11-08 09:24:38 +01:00
Ivan Dyachkov 4495054714 ci: optimize runners usage
- always use github runners for lightweight jobs
- prefer self-hosted runners in private forks
- prefer self-hosted runners for workflows with large matrix
2023-11-02 16:13:31 +01:00
Ivan Dyachkov 8e7edaf745 ci: limit retention on all artifacts 2023-11-02 16:13:31 +01:00
Ivan Dyachkov a69cfdc8cd ci: do not use github's macos runner in PRs 2023-11-02 16:13:31 +01:00
Ivan Dyachkov b1ab213081 chore: merge 'upstream/release-53' into 1031-sync-r53 2023-10-31 11:06:25 +01:00
William Yang c2966f8c00 ci(helm): test urgly workaround 2023-10-30 22:58:33 +01:00
William Yang bf9f0213d8 ci(helm): enable debug console logging 2023-10-30 22:58:22 +01:00
Ivan Dyachkov 045875d18d ci: make CI a little faster and less flaky
- use latest ubuntu22.04 emqx-builder image in compose files
- use xl runners for compiling and for emqx app tests
- make helm tests less flaky
2023-10-30 10:32:27 +01:00
Zaiming (Stone) Shi 3aebe4a289 ci: only enable cover-compile by default in CI
so the ad-hoc make apps/appname-ct run can be faster
2023-10-28 00:39:55 +02:00
William Yang f52b4a9e32 fix: gen_rpc tcp client port align with server port 2023-10-25 12:11:35 +02:00
William Yang 6346e0d28a fix(gen_rpc): ssl client port align with server port 2023-10-24 22:33:52 +02:00
William Yang 2a7d73e62c ci: fix helm chart test 2023-10-24 21:19:37 +02:00
William Yang a9b42af8b3
Merge pull request #11796 from qzhuyan/fix/william/gen_rpc-driver
fix(gen_rpc): ensure client/server use same driver
2023-10-23 08:24:17 +02:00
Ivan Dyachkov f94d5757bb Merge remote-tracking branch 'upstream/release-53' into 1021-sync-r53 2023-10-21 08:44:32 +02:00
Ivan Dyachkov 41dba71901 chore: emqx-builder 5.2-3 2023-10-20 16:26:53 +02:00
William Yang 1808ad2373 ci(helm): test gen_rpc transports 2023-10-20 13:28:31 +02:00
Ivan Dyachkov 82bac3e136 Merge remote-tracking branch 'upstream/release-53' into 1018-sync-r53 2023-10-18 08:04:45 +02:00
Ivan Dyachkov 898279099b ci: update remaining docker images in workflows to use public.ecr.aws 2023-10-17 22:36:43 +02:00
Ivan Dyachkov fb6b02c1ea ci: explicitly specify architecture in runner labels 2023-10-17 18:57:46 +02:00
Ivan Dyachkov 220893177d ci: rerun failed checks for up to 3 times 2023-10-14 10:04:55 +02:00
Andrew Mayorov 0144ed9981
Merge pull request #11753 from keynslug/chore/smaller-ci-artifacts
chore(ci): try to reduce CI artifacts footprint
2023-10-13 16:56:47 +07:00
Zaiming (Stone) Shi dd03be29a6
Merge pull request #11751 from zmstone/1011-refactor-move-emqx_license-app-to-apps
1011 refactor move emqx_license app to apps
2023-10-13 06:45:49 +02:00
Andrew Mayorov 08b2b36b87
feat(ci): push some envs through artifact files in workflows
So that we could optimize away the need for the full git history.
2023-10-13 00:40:25 +07:00
Andrew Mayorov 397686fd18
fix(ci-conf): stop requiring git index in conf tests 2023-10-12 18:31:42 +07:00
Andrew Mayorov 419b80d11e
chore(ci): try to reduce CI artifacts footprint
To speed up uploads and downloads in dependent jobs.
2023-10-12 17:56:15 +07:00
Ivan Dyachkov fd15939ae8 chore(ci): limit token scope in workflows 2023-10-12 08:41:50 +02:00
Zaiming (Stone) Shi d753edc0fd chore: remove lib-ee in scripts 2023-10-11 20:12:57 +02:00
Ivan Dyachkov 7212e8acee chore(ci): add ossf scorecard analysis workflow 2023-10-11 09:59:27 +02:00
Zaiming (Stone) Shi 9ab49a7ae3 Merge remote-tracking branch 'origin/master' into 0919-auth-refactor 2023-10-09 14:18:10 +02:00
Ivan Dyachkov 74686ed86b ci: update labels 2023-10-06 08:44:47 +02:00
Ivan Dyachkov 52f6816cb9 ci: explicitly pull postgres image 2023-10-05 15:55:04 +02:00
Ivan Dyachkov 64f866387c ci: compress ct logs before uploading 2023-10-05 14:36:56 +02:00
Ivan Dyachkov d7725c72cf ci: fix node_dump 2023-10-05 13:33:54 +02:00
Ivan Dyachkov 9a881290b9 ci: use ephemeral self hosted runners 2023-10-05 13:33:51 +02:00
Ilya Averyanov 1eb75b43c4 chore(auth): split emqx_authn and emqx_authz apps 2023-10-05 13:41:50 +03:00
Zaiming (Stone) Shi b7587fe48e ci: add -y to apt update 2023-09-29 13:31:46 +02:00
Zaiming (Stone) Shi 878b7b86dc test: run eunit test for 'emqx' app with a node name 2023-09-27 12:59:06 +02:00
Ivan Dyachkov ec43268eee chore: update scripts and CI to work with 5.3.X 2023-09-21 19:29:00 +02:00
Zaiming (Stone) Shi e794143ae1 Merge remote-tracking branch 'origin/release-52' into 0906-sync-release-52-to-master 2023-09-06 09:08:22 +02:00
Thales Macedo Garitezi 69dfc8e31d
Merge pull request #11505 from thalesmg/docker-eee-r52-20230823
ci(test_docker): export enterprise image with elixir for testing
2023-08-24 12:17:47 -03:00
Thales Macedo Garitezi 0037295c83 ci(test_docker): export enterprise image with elixir for testing 2023-08-24 10:27:25 -03:00
SergeTupchiy 467f60805f
Merge pull request #11499 from SergeTupchiy/EMQX-10390-mnesia-hook-fix-upgrade-otp
chore: bump OTP to 25.3.2-2 and EMQX builder to 5.1-4
2023-08-24 11:13:05 +03:00
Ivan Dyachkov 7adbf319b1 ci: use more sensible name for checks 2023-08-24 08:21:06 +02:00
Serge Tupchii bac0f7107c chore: bump OTP to 25.3.2-2 and EMQX builder to 5.1-4 2023-08-23 19:35:36 +03:00
Ilya Averyanov 92a293a67b chore(ci): pin pytest-retry version 2023-08-23 17:34:15 +03:00
Ilya Averyanov 44b080f5b3 chore(ci): pin pytest-retry version 2023-08-23 17:33:24 +03:00
Thales Macedo Garitezi a6a023eff7 ci: add `integration_test` dir to `emqx` application
This gives us a place where to put tests that exercise multiple umbrella application,
which is more closely related to `emqx`, but in a way that doesn't affect the standalone
app tests.
2023-08-16 11:48:47 -03:00
Ivan Dyachkov 3daff225c0
Merge pull request #11451 from id/0815-ci-do-not-publish-prerelease-artifacts 2023-08-15 21:45:06 +02:00
Thales Macedo Garitezi b416100943 ci: fix output source 2023-08-15 14:40:19 -03:00
Ivan Dyachkov f00553a174 ci(release): do not publish prerelease artifacts to emqx.io, packagecloud and helm repo 2023-08-15 19:34:13 +02:00
Ivan Dyachkov e91d22b0d5 ci(docker): emqx-enterprise repo does not exist in ECR 2023-08-15 19:34:10 +02:00
Thales Macedo Garitezi 4151fe5045 ci(refactor): compute before/after references in parent workflow 2023-08-15 14:33:39 -03:00
Thales Macedo Garitezi 124c5d94e5
ci: fix variable usage
Co-authored-by: Ivan Dyachkov <dev@dyachkov.org>
2023-08-15 14:25:38 -03:00
Thales Macedo Garitezi 8a6bb6f5f3 ci: restore emqx app standalone tests
Those were accidentally removed during a refactoring.

They are needed because we provide the `emqx` application as a standalone dependency for
plugins.
2023-08-15 13:48:39 -03:00
Zaiming (Stone) Shi fa9e9f3348
Merge pull request #11442 from zmstone/0814-sync-release-52-to-master
0814 sync release 52 to master
2023-08-15 16:21:55 +02:00
Ivan Dyachkov 1e6ba2e748 ci: add daily build of emqx-enterprise for debian10 platform 2023-08-14 11:39:55 +02:00
Ivan Dyachkov 7bdefd065f chore: update scripts, workflows and documentation to support release-52 2023-08-11 11:11:58 +02:00
Ivan Dyachkov be9b8e5fa8 ci: upgrade emqx/push-helm-action to v1.1 2023-08-11 08:51:17 +02:00
Ivan Dyachkov 9ad44f1bba ci: do not run tests on tag push 2023-08-10 09:57:53 +02:00
Ivan Dyachkov d6476481c9 ci(packages): run publish_artifacts on github hosted runner to get sudo 2023-08-10 07:58:57 +02:00
Ivan Dyachkov c587a753da fix(docker): use 'make $PROFILE-docker' in CI 2023-08-09 14:45:17 +02:00
Ivan Dyachkov c35ad653f3 ci: process both string and boolean values of inputs.publish 2023-08-09 09:33:17 +02:00
Ivan Dyachkov 34759b64f5 ci(docker): pass PKG_VSN to Dockerfile to avoid calling pkg-vsn.sh 2023-08-09 09:23:08 +02:00
Ivan Dyachkov 92d4f6cb0b ci: pass secrets to docker and packages workflows 2023-08-09 09:22:55 +02:00
Thales Macedo Garitezi acb87403a5 ci: fix path to Dockerfile 2023-08-08 17:44:03 -03:00
Thales Macedo Garitezi 1ca202fef7 ci: fix build package script
Since the runner changed from `ubuntu-22.04` to self hosted runner, `sudo` is no longer
passwordless.
2023-08-08 15:49:34 -03:00
Ivan Dyachkov 0e54db9039 ci: build slim packages on push to branches 2023-08-07 09:42:51 +02:00
Ivan Dyachkov 4767b952dd ci: move sanity checks to the main workflow 2023-08-06 14:16:56 +02:00
Ivan Dyachkov 6093f03cb9 ci: make $PROFILE instead of make $PROFILE-compile 2023-08-06 14:16:56 +02:00
Ivan Dyachkov fdf02a7083 ci: restore make test-compile 2023-08-06 14:16:56 +02:00
Ivan Dyachkov d100acf701 ci: fail faster in helm tests 2023-08-06 14:16:56 +02:00
Ivan Dyachkov ec75fa32cf ci: use git ref for workflow concurrency detection 2023-08-06 14:16:56 +02:00
Ivan Dyachkov a32b8fd21f ci: use single entry point for push event 2023-08-06 14:16:56 +02:00
Ivan Dyachkov 9699064a08 ci: move windows build from slim_packages to scheduled daily build 2023-08-06 14:16:56 +02:00
Ivan Dyachkov dc8487ef71 ci: delete elixir_release workflow as it is covered by slim_packages 2023-08-06 14:16:56 +02:00
Ivan Dyachkov 362235021c ci: refactor workflows to use single entry point on pull request trigger 2023-08-06 14:16:56 +02:00
Ivan Dyachkov b7f0f7b32d chore: merge master into release-51 2023-07-19 09:28:05 +02:00
Ivan Dyachkov 2594998fd0 ci: self-hosted runners for build-packages 2023-07-18 17:12:20 +02:00
Ivan Dyachkov 2b5bd9f183 ci: separate steps to build and test packages 2023-07-18 17:12:18 +02:00
Ivan Dyachkov cfcdc094b5 ci: always upload artefacts on build_packages 2023-07-18 16:15:10 +02:00
Ivan Dyachkov f541fc3e3d feat: build debian12 packages 2023-07-18 16:15:10 +02:00
Ivan Dyachkov ca51732d8e
Merge pull request #11292 from emqx/update-rocksdb 2023-07-18 16:14:50 +02:00
Thales Macedo Garitezi 99378355ea ci: bump builder image -> 5.1-3 2023-07-18 09:00:29 -03:00
Ivan Dyachkov 0c448a7546 ci: add codeql workflow 2023-07-14 12:49:22 +02:00
Ivan Dyachkov d450d34ab3 ci: fix and speedup jmeter download 2023-07-13 09:26:16 +02:00
Thales Macedo Garitezi 06010f7ca9 Merge remote-tracking branch 'origin/release-51' into sync-r51-20230712 2023-07-12 16:47:45 -03:00
Ivan Dyachkov 088ff8b17c ci: fix rerun apps check token scope and improve logging 2023-07-11 14:36:48 +02:00
Ivan Dyachkov a43bf5e4fa ci: release Amazon Linux 2023 packages 2023-07-10 16:21:56 +02:00
Ivan Dyachkov d795274f96 ci: rerun apps version check on release 2023-07-10 13:53:13 +02:00
Rory Z ccacb50393 ci: do not set latest for elixir image 2023-07-06 14:15:42 +08:00
Rory bb5b2d4bda
Merge pull request #11190 from Rory-Z/ci/add-semver-docekr-tag
ci: add semver version for docker
2023-07-05 16:35:00 +08:00
zhongwencool f2c5f4932c
Merge pull request #11148 from lafirest/fix/mcall_error_report
fix(emqx_conf): don't sync the MFA to a leaved node
2023-07-04 19:56:52 +08:00
Rory Z 721967ef0b ci: add semver version for docker 2023-07-04 19:20:43 +08:00
Ivan Dyachkov 1779491f5e ci: update performance test 2023-07-03 13:06:00 +02:00
Ivan Dyachkov 460ea0e957 ci(jmeter): collect emqx logs 2023-06-29 09:28:50 +02:00
Zaiming (Stone) Shi 41de679557 ci: run example config check in ci 2023-06-27 14:23:18 +02:00
Ivan Dyachkov 9bebdf9439 ci(jmeter): fix jmeter download url for older versions 2023-06-26 09:10:57 +02:00
Zaiming (Stone) Shi a757afcb7e
Merge pull request #11122 from zmstone/0622-ci-split-emqx-app-suites
ci: split apps/emqx common test suites into chunks
2023-06-22 18:17:00 +02:00
Thales Macedo Garitezi 2f00cf7f84
Merge pull request #11107 from thalesmg/fix-mongo-health-check-reason-master
fix(mongo): return health check failure reason
2023-06-22 09:30:34 -03:00
Zaiming (Stone) Shi d6cd56558a ci: split apps/emqx common test suites into chunks 2023-06-22 10:35:00 +02:00
Thales Macedo Garitezi 9790d66b92 ci: debug dependency discrepancy check 2023-06-21 15:09:37 -03:00
JianBo He f5932dc9a4 fix: add libsasl2-modules-gssapi-mit for CI
To supplement for #11076
2023-06-19 17:21:41 +08:00
JianBo He 5f9bd5e4c9
chore: update .github/workflows/build_and_push_docker_images.yaml
Co-authored-by: Thales Macedo Garitezi <thalesmg@gmail.com>
2023-06-15 23:17:04 +08:00
JianBo He e38236eb05 build: fix the EXTRA_DEPS not working in workflows 2023-06-15 21:55:53 +08:00
zhongwencool 85d787f561
Merge pull request #11017 from id/0612-ci-fix-matrix-dimensions-in-build-packages
ci: fix matrix dimensions in build_packages
2023-06-12 17:51:36 +08:00
Ivan Dyachkov 7a78df1660 ci: fix matrix dimensions in build_packages 2023-06-12 09:03:30 +02:00
Thales Macedo Garitezi 683b4d2f0f ci: upgrade setup-beam -> v1.15.4 2023-06-09 10:39:02 -03:00
Zaiming (Stone) Shi 0b87ea4cdc
Merge pull request #10929 from zmstone/0602-ci-pin-otp-25.3.2-1-elixir-1.14.5
ci: upgrade to otp 25.3.2-1 and elixir 1.14.5
2023-06-02 21:46:08 +02:00
Zaiming (Stone) Shi 9c1f77d733 ci: upgrade to otp 25.3.2-1 and elixir 1.14.5 2023-06-02 18:01:09 +02:00
Zaiming (Stone) Shi 28c564d15b Merge remote-tracking branch 'origin/master' into release-51 2023-06-02 16:25:48 +02:00
Thales Macedo Garitezi 90d862cad9
Merge pull request #10915 from thalesmg/fvt-retry-plugin-v50
ci(fvt): add `pytest-retry` plugin
2023-06-02 09:26:43 -03:00
Thales Macedo Garitezi e47e2c9c12 ci(fvt): add `pytest-retry` plugin 2023-06-01 18:05:27 -03:00
Ivan Dyachkov 8cdb1458c7 ci: add ui(dashboard) tests based on pytest and selenium 2023-06-01 20:01:24 +02:00
William Yang 8f4a950a6f ci(emqx-ct-standalone): enable erl distribution while start CT 2023-06-01 14:54:44 +02:00
William Yang a2f8e87389 test(config): default zone and global defaults 2023-06-01 14:54:14 +02:00
Ivan Dyachkov 239f71cecf
Merge pull request #10899 from id/0530-update-perf-test
0530 update perf test
2023-05-31 23:17:10 +02:00
Thales Macedo Garitezi dc4ae1a424 ci: make emqx standalone test output more readable 2023-05-31 10:56:06 -03:00
Ivan Dyachkov ac94a00c5b ci: adjust perf test parameters 2023-05-31 15:46:48 +02:00
Ivan Dyachkov 2078c0a5c7 ci: add 1m conns in perf test 2023-05-31 13:28:55 +02:00
Ivan Dyachkov 78ed78240f ci: update perf test 2023-05-31 10:41:33 +02:00
Zaiming (Stone) Shi 5aaac86e28 ci: prepare for 5.1 release 2023-05-30 08:03:42 +02:00
Thales Macedo Garitezi d12c393abc ci(docker): don't fetch deps outside docker build context
The dependencies outside EMQX are symlinked with full paths from the
GH action environment.  When we run `buildx`, the paths are all wrong,
and the documentation generation fails when it tries to prepare the
library paths.
2023-05-29 16:58:46 -03:00
Zaiming (Stone) Shi 687664efdb ci: delete otp 24 from emqx app standalone job matrix 2023-05-26 15:49:25 +02:00
Thales Macedo Garitezi d05a18493b ci: fix conf tests group concurrency key
`run_test_cases.yaml` and `run_conf_tests.yaml` seem to be cancelling
each other.
2023-05-25 16:58:05 -03:00
Zaiming (Stone) Shi a1b8e2a42a ci: test windows build with a ping after start 2023-05-24 22:14:27 +02:00
Zaiming (Stone) Shi b5e1bc4cc8 ci: check ping output in windows package start/stop test 2023-05-23 14:10:19 +02:00
Zaiming (Stone) Shi 732a7be187 Merge remote-tracking branch 'origin/release-50' 2023-05-22 17:46:54 +02:00
Andrew Mayorov 9aaa0b6fe1
Merge pull request #9927 from emqx/file-transfer
feat: implement file transfer over mqtt
2023-05-19 18:35:13 +03:00
JianBo He 90d1a0096c chore: make spellcheck happy 2023-05-17 17:52:08 +08:00
JianBo He 07e46592a8 chore(ci): add conf tests 2023-05-17 17:52:08 +08:00
Andrew Mayorov 53e961f8b2
ci: ensure dialyzer plt cache is updated on changes 2023-05-16 18:47:59 +03:00
Ivan Dyachkov a264827b78 ci: emqx-builder 5.0-35 2023-05-15 08:14:22 +02:00
Ivan Dyachkov b3a989970d ci: move package upload to packagecloud.io to release workflow
Fixes #10693
2023-05-14 15:19:46 +02:00
Ivan Dyachkov 47c1fb734a ci: update performance test 2023-05-12 23:33:41 +02:00
Ilya Averyanov 7fa166f034 Merge branch 'release-50' into file-transfer
* release-50: (73 commits)
  feat: add RabbitMQ bridge
  docs: improve rule engine labels and descriptions
  chore: bump version && update changes
  refactor(rocketmq): move rocketmq bridge into its own app
  test: dashboard_listener_test crash
  chore: bump chart versions
  chore: bump ee version to e5.0.4-alpha.1
  test: fix inter-suite flakiness
  build: compatibility to make 4.4+
  feat: add IotDB bridge
  ci: ensure git safe dir in build_packages
  ci: ensure git safe dir
  test: check_oom's max_mailbox_size
  feat: rename max_message_queue_len to max_mailbox_size
  fix(buffer_worker): fix inflight count when updating inflight item
  chore: prepare for v5.0.25-rc.1 release
  docs: add change log entry
  fix: non_neg_integer() translated to minimum = 1 in bridge-api-en.json
  chore: `MQTT X` -> `MQTTX`
  chore: make sure brod_gssapi app is included in relese package
  ...
2023-05-09 23:30:22 +05:00
Ivan Dyachkov a45ef4d94d ci: remove unnecessary matrix dimensions 2023-05-09 13:50:36 +02:00
Ivan Dyachkov b688ec6ef8 ci: ensure git safe dir in build_packages 2023-05-08 14:54:08 +02:00
Ivan Dyachkov 84ccb0bd77 ci: fix typo in workflow file name 2023-05-08 09:54:51 +02:00
Ivan Dyachkov 5b6561f33e ci(perf_test): run scheduled perf test workflow in emqx org only 2023-05-08 09:54:51 +02:00
Ivan Dyachkov 86ea3f2de2 ci(build_packages_cron): remove non-existing dependency
also build emqx package on master only, and ee on release-50 only
2023-05-08 09:54:48 +02:00
Zaiming (Stone) Shi 429d193af7 ci: github action boolean in env check 'true' string 2023-05-05 23:58:24 +02:00
Zaiming (Stone) Shi a7f8e33321 ci: no need to prepare source zip
source.zip was need in v4 enterprise because the rebar3 deps
fetch had to be done in the github runner host, but not inside
the runner docker containers.

now that all dependencies are opensource, there is no need for
this step any more.
2023-05-05 22:57:16 +02:00
Zaiming (Stone) Shi 22815d4cec ci(buildx): use a special builder value to indicate host build 2023-05-05 22:20:34 +02:00
Zaiming (Stone) Shi e739e3cadb ci: ensure == compare is not empty on the left 2023-05-05 21:49:15 +02:00