Commit Graph

569 Commits

Author SHA1 Message Date
Ivan Dyachkov
8232d8bc8b ci: download actionlint from github releases 2023-08-06 14:16:56 +02:00
Ivan Dyachkov
559cda5d74 ci: accept 'ci/*' branches in parse-git-ref.sh 2023-08-06 14:16:56 +02:00
Ivan Dyachkov
dce2719c30 chore: fix scripts/check-i18n-style.escript to exit with 1 when there are errors 2023-08-06 14:16:56 +02:00
Ivan Dyachkov
43116a0797 ci: fix regex in parse-git-ref.sh 2023-08-06 14:16:56 +02:00
Ivan Dyachkov
a32b8fd21f ci: use single entry point for push event 2023-08-06 14:16:56 +02:00
firest
f98f97f37e feat(ldap): set test env and add test suites 2023-08-01 18:49:54 +08:00
Thales Macedo Garitezi
620b5fc048 fix(spellcheck): fix several spellcheck issues not caught in CI
Fixes some issus later found by CI that somehow didn't block the originating PRs.

Example failure:

https://github.com/emqx/emqx/actions/runs/5715470851/job/15485284918?pr=11372
2023-07-31 14:32:12 -03:00
Dennis Zhuang
975795a6e0 feat: add ci test 2023-07-24 17:58:48 +08:00
Dennis Zhuang
c5078980f3 feat: adds the greptimedb bridge to emqx modules 2023-07-24 17:58:48 +08:00
Paulo Zulato
27630ca215
Merge pull request #11261 from paulozulato/feat-bridge-kinesis
Implement Amazon Kinesis Producer bridge
2023-07-18 16:48:34 -03:00
Ivan Dyachkov
8293fce7f2 chore: fix pkg-tests.sh 2023-07-18 17:12:20 +02:00
Ivan Dyachkov
ca51732d8e
Merge pull request #11292 from emqx/update-rocksdb 2023-07-18 16:14:50 +02:00
Andrew Mayorov
143cdb9e44
chore: bump jq to v0.3.10 2023-07-18 14:11:39 +02:00
Thales Macedo Garitezi
99378355ea ci: bump builder image -> 5.1-3 2023-07-18 09:00:29 -03:00
Paulo Zulato
484519dcf9 feat(kinesis): implement Amazon Kinesis Producer bridge
Fixes https://emqx.atlassian.net/browse/EMQX-10474
Fixes https://emqx.atlassian.net/browse/EMQX-10475
2023-07-17 11:51:42 -03:00
Thales Macedo Garitezi
26d4ee5780 ci(fix): actually fail check for missing reboot apps 2023-07-13 09:02:20 -03:00
Thales Macedo Garitezi
06010f7ca9 Merge remote-tracking branch 'origin/release-51' into sync-r51-20230712 2023-07-12 16:47:45 -03:00
Ivan Dyachkov
088ff8b17c ci: fix rerun apps check token scope and improve logging 2023-07-11 14:36:48 +02:00
Ivan Dyachkov
1ca2f413c4 fix: add ezstd_nif.so to macos signing 2023-07-10 21:11:26 +02:00
Thales Macedo Garitezi
d97d5b8af7 ci(machine_boot): add ci check for missing reboot apps
In order to avoid forgetting to add an application to
`emqx_machine_boot:sorted_reboot_apps`, this script checks for any calls to
`mria:create_table` in all EMQX applications and checks it against said function in
`emqx_machine_boot`.

Example run:

```
ͳ scripts/check_missing_reboot_apps.exs --profile emqx-enterprise
Some applications are missing from `emqx_machine_boot:sorted_reboot_apps/0`!
Missing applications:
  * emqx_durable_storage
  * emqx_ee_schema_registry

Hint: maybe add them to `emqx_machine_boot:basic_reboot_apps_edition/1`

Applications that call `mria:create_table` need to be added to that list;
 otherwise, when a node joins a cluster, it might lose tables.
```

Example problem: https://github.com/emqx/emqx/pull/11242
2023-07-10 14:38:58 -03:00
Ivan Dyachkov
d795274f96 ci: rerun apps version check on release 2023-07-10 13:53:13 +02:00
Ivan Dyachkov
2570bc3090 fix(scripts): make shellcheck happy
also use EMQX_NODE__ROLE instead of EMQX_NODE__DB_ROLE
2023-07-10 08:41:11 +02:00
Ivan Dyachkov
a31b5f1ac1 chore: add scripts/dev-cluster-host.sh 2023-07-09 19:35:12 +02:00
JimMoen
583ccfaafd
test(hstreamdb): create stream and wirte data 2023-07-07 12:25:36 +08:00
JimMoen
1587f038a5
feat: hstreamdb bridge with batch query 2023-07-07 12:25:36 +08:00
zhongwencool
82ea9e5a04 test: dashbaord api ct failed 2023-06-29 10:49:39 +08:00
zhongwencool
e26c30ff0c feat: refactor dashboard https ssl_options 2023-06-29 10:49:39 +08:00
Zaiming (Stone) Shi
41de679557 ci: run example config check in ci 2023-06-27 14:23:18 +02:00
Zaiming (Stone) Shi
a069b351fd test: add test script to verify config example files 2023-06-27 14:23:18 +02:00
Zaiming (Stone) Shi
a757afcb7e
Merge pull request #11122 from zmstone/0622-ci-split-emqx-app-suites
ci: split apps/emqx common test suites into chunks
2023-06-22 18:17:00 +02:00
Thales Macedo Garitezi
7ef03d9e1f
Merge pull request #11090 from thalesmg/gcp-pubsub-consumer
feat(gcp_pubsub_consumer): implement GCP PubSub Consumer bridge
2023-06-22 09:17:45 -03:00
Zaiming (Stone) Shi
d6cd56558a ci: split apps/emqx common test suites into chunks 2023-06-22 10:35:00 +02:00
Zaiming (Stone) Shi
f95787d229 test: make possible to test core/replica locally 2023-06-20 12:42:00 +02:00
Thales Macedo Garitezi
b442910ff1 feat(gcp_pubsub_consumer): implement GCP PubSub Consumer bridge
Fixes https://emqx.atlassian.net/browse/EMQX-10281
2023-06-19 16:04:12 -03:00
zhongwencool
3331af4757 feat: make gateway and slow_subs low level and hide rule_engine 2023-06-13 11:47:38 +08:00
Thales Macedo Garitezi
54985c1d9d ci(run.sh): fix cookie generation
Sometimes, the generated cookie could be interpret by erlang as a
flag (e.g.: `+8w7uIsgUeG80c/ZgUDD9g==`) if not escaped properly,
causing the start up to fail.
2023-06-09 14:09:07 -03:00
Zaiming (Stone) Shi
7d2ea3dc76 docs: refine some desc 2023-06-08 13:58:31 +02:00
Zaiming (Stone) Shi
085ffb617f chore: add 'mcast' to spellcheck dict 2023-06-07 12:05:24 +02:00
JimMoen
bed1efd99f
build: bump dashboard tag v1.2.6-beta.1 and e1.1.0-beta.2
The dashboard asset zip file will contain version after these two tags.
2023-06-07 10:26:36 +08:00
Zaiming (Stone) Shi
0b87ea4cdc
Merge pull request #10929 from zmstone/0602-ci-pin-otp-25.3.2-1-elixir-1.14.5
ci: upgrade to otp 25.3.2-1 and elixir 1.14.5
2023-06-02 21:46:08 +02:00
Thales Macedo Garitezi
33aa879ad4
Merge pull request #10910 from thalesmg/unify-restart-interval-v50
feat(resource): deprecate `auto_restart_interval` in favor of `health_check_interval`
2023-06-02 16:20:36 -03:00
Zaiming (Stone) Shi
9c1f77d733 ci: upgrade to otp 25.3.2-1 and elixir 1.14.5 2023-06-02 18:01:09 +02:00
Ivan Dyachkov
1761e669f0
Merge pull request #10916 from id/0601-add-ui-tests-in-ci
ci: add ui(dashboard) tests based on pytest and selenium
2023-06-02 09:07:41 +02:00
Ivan Dyachkov
8cdb1458c7 ci: add ui(dashboard) tests based on pytest and selenium 2023-06-01 20:01:24 +02:00
Thales Macedo Garitezi
99796224d8 refactor(resource): rename request_timeout -> request_ttl
See
https://emqx.atlassian.net/wiki/spaces/P/pages/612368639/open+e5.1+remove+auto+restart+interval+from+buffer+worker+resource+options
2023-06-01 13:01:53 -03:00
Thales Macedo Garitezi
10425eb925 feat(resource): deprecate auto_restart_interval in favor of health_check_interval
See:
https://emqx.atlassian.net/wiki/spaces/P/pages/612368639/open+e5.1+remove+auto+restart+interval+from+buffer+worker+resource+options

Current problem:

In 5.0.x, we have two timer options that control the state changing of buffer worker
resources: auto_restart_interval and health_check_interval.

- auto_restart_interval controls how often the resource attempts to transition from
disconnected to connected.

- health_check_interval controls how often the resource is checked and potentially moved
from connected to disconnected or connecting.

The existence of two independent timers for very similar purposes is confusing to users,
QA and even developers.  Also, an intimately related configuration is request_timeout,
which can interact badly with auto_restart_interval if the latter is poorly configured:
requests may always expire if request_timeout < auto_restart_interval and if the resource
enters the disconnected state.  For health_check_interval, we attempt to derive a sane
default that gives requests a chance to retry (if request timeout is finite, then the
resource retries requests with a period of min(health_check_interval, request_timeout /
3).

Another problem with the separate auto_restart_interval is that its default value (60 s)
is too high when compared to the default request timeout and health check, leading to the
problems described above if not tuned.

Proposed solution:

We propose to drop auto_restart_interval in favor of health_check_interval, which will be
used for both disconnected -> connected and connected -> {disconnected, connecting}
transition checks.  With that, the resource will attempt to reconnect at the same interval
as the health check, which currently is 15 s.

Also, as two smaller changes to accompany this one:

- Increase the default request_timeout from 15 s to 45 s.
- Rename request_timeout to request_ttl.
2023-06-01 11:20:06 -03:00
Thales Macedo Garitezi
cd2e21e89f ci: check if given schema.json exists before running spellcheck
Prints helpful message when schema.json does not exist, as otherwise
the "file" will be mounted as an empty directory inside the
spellchecker container.
2023-05-31 09:59:00 -03:00
Zaiming (Stone) Shi
74582ad36e test(conf-test): use major version number as prefix to find old config 2023-05-30 09:59:57 +02:00
Zaiming (Stone) Shi
65506eb15e build: remove changelog base compare
all changes in the future will have a compare base
2023-05-30 09:32:42 +02:00
Zaiming (Stone) Shi
5aaac86e28 ci: prepare for 5.1 release 2023-05-30 08:03:42 +02:00