31b441a46e
feat(s3): add S3 client application
2023-04-07 17:25:22 +03:00
a8f8228a12
Merge pull request #10308 from thalesmg/test-increase-peer-timeout-v50
...
test(peer): increase init and startup timeout for peer nodes
2023-04-03 15:46:13 -03:00
0e5a22f500
test(cassandra): cap test container memory usage
...
Default memory usage is excessive.
2023-04-03 10:20:19 -03:00
3765f5f120
Merge pull request #10297 from paulozulato/fix-eval
...
fix: keep eval command backward compatible with v4
2023-03-31 11:29:57 -03:00
9bbca07943
Merge pull request #10298 from emqx/release-50
...
Merge release-50 back to master
2023-03-31 15:35:51 +02:00
161435d29d
fix: keep eval command backward compatible with v4
...
Keeps "eval" command evaluating only Erlang expressions, even on Elixir
node.
Fixes: https://emqx.atlassian.net/browse/EMQX-8947
2023-03-30 14:20:49 -03:00
b2b9732edb
fix(tdengine): make password a required field (rv5.0)
...
Fixes https://emqx.atlassian.net/browse/EMQX-9395
```
2023-03-29T09:59:02.655495+00:00 [warning] msg: start_resource_failed, mfa: emqx_resource_manager:start_resource/2, line: 524, id: <<"bridge:tdengine:jimmoen-test-trigger">>, reason: {error,function_clause,[{emqx_ee_connector_tdengine,on_start,[<<"bridge:tdengine:jimmoen-test-trigger:1076">>,#{database => <<"db">>,enable => true,pool_size => 8,resource_opts => #{auto_restart_interval => 60000,batch_size => 1,batch_time => 0,health_check_interval => 15000,max_queue_bytes => 104857600,query_mode => sync,request_timeout => 15000,start_after_created => true,start_timeout => 5000,worker_pool_size => 16},server => "127.0.0.1",sql => <<"insert into mqtt.t_mqtt_msg(ts, msgid, mqtt_topic, qos, payload, arrived) values (${ts}, ${id}, ${topic}, ${qos}, ${payload}, ${timestamp})">>,username => <<"root">>}],[{file,"emqx_ee_connector_tdengine.erl"},{line,76}]},{emqx_resource,call_start,3,[{file,"emqx_resource.erl"},{line,359}]},{emqx_resource_manager,start_resource,2,[{file,"emqx_resource_manager.erl"},{line,513}]},{gen_statem,loop_state_callback,11,[{file,"gen_statem.erl"},{line,1205}]},{proc_lib,init_p_do_apply,3,[{file,"proc_lib.erl"},{line,226}]}]}
```
2023-03-29 10:07:02 -03:00
bfa5922209
Merge pull request #10140 from HJianBo/cassa
...
feat: support cassandra data bridge
2023-03-27 10:23:02 +08:00
761847b74a
ci: update emqx-builders with OTP 24.3.4.2-3 and 25.1.2-3
...
These OTP versions implement mnesia_hook:unregister_hook/1
2023-03-23 11:59:43 +02:00
9b63bdc1e0
chore: apply review suggestions
...
- Rename sql to cql
- Add tests for `bridges_probe` API
2023-03-23 15:27:34 +08:00
8cbbc9f271
Merge remote-tracking branch 'upstream/master' into cassa
2023-03-23 11:53:17 +08:00
4ad3579966
test(bridges): add test suite for RocketMQ
2023-03-22 10:36:58 +08:00
539ec2f774
chore(bridge): cover username/password auth for cassandra bridges
2023-03-21 13:55:53 +08:00
12942b676d
Merge remote-tracking branch 'upstream/master' into cassa
2023-03-20 09:50:27 +08:00
678cc937c0
test(bridge): cover ssl testing for cassandra bridge
2023-03-17 18:25:05 +08:00
5f0828a2ea
ci: add certs for cassandra tls
2023-03-17 16:39:10 +08:00
c0a216a740
feat(bridge): support cassandra bridge
2023-03-17 11:34:48 +08:00
5eaaa83b82
chore: simplify run.sh
...
- get rid of sudo
- do not change permissions of existing files
- use our own docker image to generate certs to make it working on arm
- bump kafka docker image version to have access to multiplatofrm one
2023-03-16 13:43:01 -03:00
1051df7af8
test: add kafka to toxiproxy
2023-03-16 13:43:01 -03:00
fc37d9b3cd
fix(mysql): be explicit that batch queries are parameterless
...
So that mysql client won't attempt to prepare them automatically, thus
trashing the server's prepared statements table and making interaction
overall heavier.
2023-03-10 18:42:04 +03:00
225cbab9ce
ci(mysql): drop outdated config options
...
Also make them look as recommended in the documentation.
2023-03-10 18:42:00 +03:00
984dd3446d
test(bridges): add test suite for DynamoDB
2023-03-08 11:13:51 +08:00
67acdf0888
feat: add clickhouse database bridge
...
This commit adds a Clickhouse bridge to EMQX 5. The bridge is similar to
the Clickhouse bridge in the 4.4, but adds the possibility to use
different formats (such as JSON) for values to be inserted.
2023-03-02 12:22:11 +01:00
de740a2fd9
ci: use official zookeeper image
...
Former one ate almost all of my free memory for some reason. This
one looks more predictable.
2023-02-24 15:03:03 +03:00
977bfb3d6c
ci(kafka): use more suitable env variable to pass jaas conf
2023-02-20 18:19:07 +01:00
7c917334dc
ci: enforce stricter condition on ssl_cert_gen dependency
2023-02-20 18:16:20 +01:00
c7f535abc7
chore: bump OTP-24 image version to 24.3.4.2-2
2023-02-17 11:16:26 +03:00
6bf385793c
Merge pull request #9978 from thalesmg/fix-psql-tls-v50
...
fix(pgsql): fix ssl option for pgsql connector to match previous behavior (5.0)
2023-02-16 09:20:32 -03:00
c684730bbe
chore(ci): remove legacy helper Makefile
2023-02-16 11:30:56 +02:00
dbda504f2c
fix(pgsql): fix ssl option for pgsql connector to match previous behavior (5.0)
...
Fixes https://github.com/emqx/emqx/issues/9907
At v5.0.14, we changed the `ssl` option for the Postgres connector
from `true` to `required`, but there was another transformation in
`conn_opts/2` that led to an incorrect configuration. This change
ended up preventing users from connecting to Postgres with their
previous configurations after upgrading EMQX.
2023-02-15 14:06:33 -03:00
0420e9acb5
test(bridges): add test cases for TDEngine
2023-02-14 22:04:29 +08:00
202f6d0181
ci: stop building alpine docker image
2023-02-09 14:19:35 +01:00
fce1e74c3d
fix(connector): fix redis cluster resource recovery
2023-01-31 16:55:05 +02:00
f6fbbf3ee3
chore(bridges): reduce Redis bridge flakyness
2023-01-18 14:34:11 +02:00
ea405fe55d
test(bridges): add test case for the PostgreSQL backend
2023-01-06 11:56:28 +08:00
6d7e6e6ea7
ci: delay Kafka topic creation
2022-12-29 14:30:30 +01:00
2e1cdd039e
ci: include OTP-25 in some workflows
...
* Use OTP-25 exclusively for Elixir builds
* Include OTP-25 in slim package builds
* Include OTP-25 in test workflow matrices
2022-12-16 13:45:04 +03:00
40809b2ad0
Merge remote-tracking branch 'origin/dev/ee5.0' into release-50
2022-12-09 11:45:52 +01:00
f3b069a0d9
test: fix config load for lib-ee tests
2022-12-07 15:50:50 +01:00
6692b0c895
feat(bridge): add Redis bridge
2022-12-06 23:15:42 +03:00
eb62192838
test: expand EE mysql bridge test with toxiproxy
2022-12-01 10:27:51 +01:00
83fe35b148
Merge remote-tracking branch 'origin/dev/ee5.0' into 1116-sync-v5.0.10-to-ee50
2022-11-18 19:23:31 +01:00
09455edae8
Merge tag 'v5.0.10' into dev/ee5.0
2022-11-16 16:20:30 +01:00
7bbd6353aa
chore: fix /.cache and /.erlang.cookie in erlang container
2022-11-09 09:30:32 +01:00
d90b3760b1
ci(ct/run.sh): use host uid and gid in erlang container for ct
2022-11-09 09:53:03 +08:00
04588148b7
test(influxdb): increase influxdb bridge/connector coverage (ee5.0)
2022-11-07 15:15:49 -03:00
4135910b42
chore: merge master into dev/ee5.0
2022-09-26 09:52:33 +08:00
5ec4b0a6ca
fix: fix entrypoint in docker compose for Kafka bridge test
2022-09-23 15:58:22 +02:00
ac37c5d58a
test: github actions debug printouts
2022-09-23 15:02:01 +02:00
a3c88b40a0
test: changes to make Kafka container run in GitHub action
2022-09-23 14:33:41 +02:00
c4f7d385b5
test: fix true not allowed as docker compose env var value
2022-09-23 11:47:12 +02:00
9f3e38aeb0
test: fix error in script detected by spellcheck script
2022-09-23 10:37:30 +02:00
ba34326010
ci(kafka): fix shellcheck errors
2022-09-23 08:58:51 +02:00
7aa99b26b9
chore: add git commit hook for git-blame-ignore-revs
...
ignore redis log files
2022-09-23 12:37:07 +08:00
ac2922fc4c
test: Kafka bridge cases for all combinations of SASL and SSL
2022-09-16 16:44:12 +02:00
5820b028cb
feat: add test case for Kerberos Kafka authentication
2022-09-14 17:03:37 +02:00
f0e03086a6
test: add test cases for Kafka SASL auth mechanisms plain and scram
2022-09-13 19:46:56 +02:00
0c1595be02
feat: Add Kafka connector
2022-09-13 19:46:56 +02:00
3d4afd65df
feat: add mongodb bridge (e5.0)
2022-09-01 14:47:14 -03:00
b08991cb44
chore: upgrade minirest to 1.3.7
2022-08-17 23:31:27 +08:00
abcdad39e5
chore: bump fvt_test's minirest to latest(1.3.6)
2022-08-03 16:29:06 +08:00
387a1d822a
Merge pull request #8410 from zmstone/0704-add-haproxy-to-cluster-example-secript
...
0704 add haproxy to cluster example script
2022-07-19 19:27:05 +01:00
ab17fd80e7
ci: common test add redis-sentinel
2022-07-13 10:37:16 +08:00
a95474669e
chore: remove duplicated haproxy config section
...
the mgmt and dashbaord endpoints are both merged 18083 now
no need to declare twice
2022-07-04 17:57:13 +02:00
8b7fc490ae
refactor: run relup test nodes in individual docker containers
...
When running EMQX in lux shell inside a docker container
the node won't boot due to load_failed for redbug modules
reason is still unknown
2022-06-29 07:10:45 +02:00
184b337e84
chore: add a script to run relup lux test locally
2022-06-28 10:54:07 +02:00
f7a2112a5a
ci: define package name instead of globing
2022-06-27 22:22:35 +02:00
67710472f5
ci: debug boot in relup test
2022-06-27 20:49:20 +02:00
d3f8ebd10f
ci: fix relup test workflow and upgrade builder to 5.0-17
...
builder 5.0-17 has emqtt-bench and lux included
so we do not need to rebuild the software for each ci job
2022-06-27 12:06:13 +02:00
0d6c4e0996
Merge remote-tracking branch 'xinyu/fix_relup_testcases' into 0623-fix-relup
2022-06-24 06:00:16 +02:00
bcefec1935
ci: fix relup test
2022-06-23 21:59:43 +02:00
9ec88198cb
fix: remove one_more_emqx.sh from the relup.lux
2022-06-23 09:14:57 +08:00
0d980904e0
fix: tmp - test relup
2022-06-22 22:16:03 +08:00
efffc450d0
fix: update relup.lux
2022-06-22 19:21:40 +08:00
5d81f159d6
fix(CI): syntax errors in run_relup_tests.yaml
2022-06-22 14:53:34 +08:00
08207c086c
fix: update integration testcases for relup
2022-06-22 11:56:57 +08:00
f18eab402a
fix(CI): don't use any authz sources when testing
2022-06-10 14:21:20 +08:00
fc4d9e4dcd
ci: use emqx-builder 5.0-16
...
Fixed openssl compatibility issue
2022-06-06 10:54:26 +02:00
d0c5de1da6
chore(config): move db configs under cluster/node keys
2022-05-26 14:02:22 -03:00
eea9bd90b4
fix: remove the extra level of 'emqx' dir from .tar.gz
2022-05-25 02:00:01 +08:00
5d65bdaa47
chore: ping emqx-builder to 5.0-15
2022-05-16 18:10:42 +08:00
e95a14843d
ci: delete otp 23 from ci matrix
2022-05-10 16:34:53 +02:00
74c33cd4e5
feat(rule_engine): add jq function to the rule engine
...
This commit adds a function to the rule engine that alows users
to transform text or JSON objects using [jq filter programs][1].
[jq][1] is a command line tool that can be used to transform
and filter JSON text using jq's built-in language. The rule engine
function that is added with this commit uses the
[Erlang jq NIF library][2] that wraps the jq C library in an
Erlang NIF function.
[1]: https://stedolan.github.io/jq/
[2]: https://github.com/emqx/jq
2022-05-04 17:09:16 +02:00
b49df4599a
build: use latest builder images (alpine 3.15.1)
...
OpenSSL-1.1.1n
2022-03-25 07:38:39 +01:00
a1c76f474b
chore(autotest): add gitactions for new autotest scripts
2022-03-10 15:59:09 +08:00
a85d636a68
feat(rlog): use rlog as the default db backend
2022-03-08 13:34:05 -03:00
e6495f4300
ci: upgrade emqx-builder to 5.0-8:1.13.3-24.2.1-1
2022-03-02 21:57:26 +01:00
8cac5f6b39
chore(ci): update emqx-builder image
...
Uses Elixir 1.13.3 and OTP 24.2.1-1.
2022-02-23 15:00:07 -03:00
1aa9abdb4d
chore: relocate tests.sh
2022-02-21 12:22:53 +01:00
1b3b2c0d03
feat: add eval-erl command to `bin/emqx`
...
This allows Erlang expressions to be evaluated easily even on nodes
running Elixir.
2022-02-04 16:53:27 -03:00
6d557bc0ca
ci(pytest): pin pytest version at 6.2.5
...
After a major version release (7.0.0), our current FVT tests all
failed due to some change in the lib. Our pytest version in CI was
not pinned, and picked this update up.
2022-02-04 10:19:29 -03:00
506dad169a
chore(elixir_otp): bump emqx-builder images
2022-01-26 16:59:50 -03:00
9c68f4bd11
fix(tgz): replace zip with tgz after rebase
2022-01-26 16:59:49 -03:00
3ec7d9ae24
chore(ci): use new tagged image with elixir
2022-01-26 16:59:49 -03:00
59f0d5f537
chore(mix): use flag instead of elixirpkg to denote package type
...
Also, add Makefile target to build zip files with Elixir.
2022-01-26 16:59:49 -03:00
5a7943f583
chore(ci): grep `emqx ctl listeners` to check if node is listening
2022-01-26 16:59:49 -03:00
ba6d4e4a19
fix(ci): raspbian arch is arm, not arm64
2022-01-26 16:59:49 -03:00
e874ec2b36
chore(images): use new image in more CI workflows
2022-01-26 16:59:49 -03:00
bc498a8041
ci(mix): add fvt tests and docker images with elixir
2022-01-26 16:59:48 -03:00
6dd11665bb
ci(mix): build emqx packages with elixir
2022-01-26 16:59:48 -03:00
b44b090d9e
ci: get package version per profile
2022-01-26 14:25:59 +01:00
d8f49f8a5f
Merge pull request #6732 from JimMoen/telemetry-api-refactor
...
refactor(api): telemetry api swagger spec
2022-01-14 09:36:54 +08:00
ecd7ea0a2f
ci: change to build and test with .tar.gz instead of .zip packages
2022-01-13 18:54:01 +01:00
82e3565344
chore: major mode file variable for Emacs
2022-01-13 15:53:47 +08:00
b9494662ae
fix(ci): fix shellcheck file pattern
...
Since we started to use the portable shebang style for our scripts, we
need to update the pattern used to find scripts for Shellcheck to
check.
2022-01-05 11:34:04 -03:00
3ee4d69988
ci: fix rpm install package name
...
prior to this fix, package name 'emqx' was hard coded
this commit fixes it to use EMQX_NAME variable
because it can be 'emqx-edge' or 'emqx-enterprise'
2022-01-04 17:28:53 +01:00
77652b9858
ci: refactor package build & test jobs
2022-01-04 17:28:53 +01:00
7208669946
chore(authn): reduce number of pre-generated certificates, refactor
...
tests
2021-12-30 13:49:14 +03:00
a7ca6cb39f
chore(authn): test MongoDB authn via ssl connection
2021-12-29 16:24:52 +03:00
e2e2c98679
chore(authn): test Mysql authn via ssl connection
2021-12-27 11:16:31 +03:00
6de89d1207
chore(authn): test PostgreSQL authn via ssl connection
2021-12-27 11:16:31 +03:00
520629d6e2
chore(authn): test Redis authn via ssl connection
2021-12-27 11:16:31 +03:00
6ad71a483e
chore(authz): test Redis backend with real Redis
2021-12-17 14:18:54 +03:00
4402327da0
ci(deb): remove system V test
2021-12-02 22:46:22 +01:00
caf1784a90
build: update otp version
2021-12-02 15:25:11 +08:00
390575eafb
chore(authn): add MongoDB backend tests
2021-11-29 21:17:56 +03:00
8cc0b43de7
chore(authn): add MySQL & PostgreSQL backend tests
2021-11-23 11:52:51 +03:00
071c2c99e8
refactor(authn resources): add `emqx_resource` and `emqx_authn` tests
2021-11-22 21:08:04 +03:00
a705bc1fc7
build: change package name scheme
...
`${PROFILE}-${PKG_VSN}-otp${OTP_VSN}-${SYSTEM}-${ARCH}.zip`
2021-11-20 20:44:48 +01:00
315a06214f
test(rlog): reenable RLOG FVT tests
...
The RLOG DB backend tests in FVT were temporarily disabled due to some
paho tests being specially flaky in CI.
In particular, those tests had the common pattern of subscribing to a
topic, immediately publishing to that topic and then waiting for the
response. When in CI and using RLOG, there seems to be more delays in
replication of data, and often this pattern would fail in the
constraint testing enviroment.
2021-11-18 18:03:30 -03:00
670281a0fa
ci: change localhost to 127.0.0.1 for support new curl version
2021-11-18 15:30:41 +08:00
030e4857ec
docs(issue): mark solution as TODO and link related issue
...
https://github.com/emqx/emqx/issues/6094
2021-11-08 15:36:54 -03:00
f8fc67b313
fix(lag): target only replica if rlog core+replicant
...
there seems to be race conditions related to some tests with sessions
hitting the core and the replicant alternately and rlog.
for intance, if there is some delay in this replication, a new
connection made to the replica with a just-created session in the core
may not have been replicated to the replicant, resulting in a test
failure if it expects the session to be present.
since such replication lags are inherent to the core-replicant
topology, we can try to target only the replicant to avoid seeing this
inconsistent view of the system during the tests.
2021-11-08 14:18:07 -03:00
c60feaaad2
test(fvt): extend functional verification tests to use replicant node
...
This parameterizes the Functional Verification Tests (FVTs) that run
in CI to use a replication log (RLOG) role of "replicant" for one of
the nodes. With this addition, our FVTs may explore more scenarios
with data replication.
2021-11-07 17:02:57 -03:00
f817ba0075
chore(CI): rename image
2021-10-22 13:40:01 +08:00
7732796331
chore(CI): change otp version for docker compose file
...
Signed-off-by: zhanghongtong <rory-z@outlook.com>
2021-10-22 13:40:01 +08:00
a591f00c5b
chore(ci): increase wait time for emqx stop when running on arm
2021-09-29 14:21:30 +02:00
ad46208fa5
chore(ci): dump debug log if failed to stop
2021-09-29 12:56:09 +02:00
deac54c847
chore(for editor): Add comments for Emacs major mode.
2021-09-16 15:43:30 +08:00
6e7d3d05e4
ci: install openssl11 for centos7 amd64 only
2021-09-07 09:49:09 +08:00
cff15dfc44
chore(CI): fix env error for test wrokflows
2021-09-03 15:44:38 +08:00
2426482ae1
ci: install openssl11 as deps.
2021-09-02 08:29:02 +02:00
86231f795d
refactor: close managment http 8081 ( #5564 )
2021-08-27 13:46:39 +08:00
092f29fecd
refactor(CI): update the ENVs for new listener,zone configs
2021-08-26 09:11:30 +08:00
5177ba02d6
fix(config): update ENVs for logger
2021-08-23 18:25:45 +08:00
64ddb13d8e
Merge pull request #5450 from zmstone/chore-update-otp-version-for-ci
...
chore: update otp version in CI
2021-08-11 14:02:54 +02:00
ae8c3cf779
chore(ci): make use of haproxy mqtt sticky session
2021-08-11 10:39:40 +08:00
1d755f1272
test(ci): create certificate chain in tmp dir
...
the haproxy container boot script has no permission writing to
the mounted dir.
2021-08-11 10:39:40 +08:00
1a4f7f190d
test(ci): update haproxy version to 2.4
2021-08-11 10:39:40 +08:00
bf94051d56
chore: update otp version in CI
2021-08-10 15:56:22 +02:00
cd92f73ca1
test: add debug print
2021-08-09 22:09:11 +02:00
0fe3083cd7
build: add erlang 24.0.1 for ci
2021-08-09 11:12:25 +02:00
672f94e118
Merge pull request #5430 from zmstone/refactor-simplify-ci-scripts
...
refactor: simplify ci scripts
2021-08-09 11:09:44 +02:00
9f3063a823
refactor: bin/emqx call fucntions for error logs
2021-08-09 10:28:04 +02:00
40a9932167
Merge pull request #5427 from tigercl/feat/redis-authn
...
feat(authn redis): support authn with redis
2021-08-09 11:11:37 +08:00
c473f9990a
test: run package test uder emqx user
...
no need to su before start
2021-08-08 11:14:26 +02:00
3761db0525
feat(authn redis): support authn with redis
2021-08-06 14:05:31 +08:00
bc23ff5e47
feat: add graceful shutdown
...
prior to this cahnge emqx node shutdown is done by init:stop
which might have undesired stop order of the applications
in this change, emqx_machine_terminator is added to stop apps
in defined order and then terminate the node in infinite loop
2021-08-05 14:11:58 +02:00
cf20fc6db7
chore(CI): easier build packages
...
Signed-off-by: zhanghongtong <rory-z@outlook.com>
2021-08-04 22:20:54 +08:00
318beef503
chore(relup tests): check rules matched
...
Signed-off-by: zhanghongtong <rory-z@outlook.com>
2021-07-22 10:57:45 +08:00
Ilya Averyanov