3765f5f120
Merge pull request #10297 from paulozulato/fix-eval
...
fix: keep eval command backward compatible with v4
2023-03-31 11:29:57 -03:00
9bbca07943
Merge pull request #10298 from emqx/release-50
...
Merge release-50 back to master
2023-03-31 15:35:51 +02:00
161435d29d
fix: keep eval command backward compatible with v4
...
Keeps "eval" command evaluating only Erlang expressions, even on Elixir
node.
Fixes: https://emqx.atlassian.net/browse/EMQX-8947
2023-03-30 14:20:49 -03:00
b2b9732edb
fix(tdengine): make password a required field (rv5.0)
...
Fixes https://emqx.atlassian.net/browse/EMQX-9395
```
2023-03-29T09:59:02.655495+00:00 [warning] msg: start_resource_failed, mfa: emqx_resource_manager:start_resource/2, line: 524, id: <<"bridge:tdengine:jimmoen-test-trigger">>, reason: {error,function_clause,[{emqx_ee_connector_tdengine,on_start,[<<"bridge:tdengine:jimmoen-test-trigger:1076">>,#{database => <<"db">>,enable => true,pool_size => 8,resource_opts => #{auto_restart_interval => 60000,batch_size => 1,batch_time => 0,health_check_interval => 15000,max_queue_bytes => 104857600,query_mode => sync,request_timeout => 15000,start_after_created => true,start_timeout => 5000,worker_pool_size => 16},server => "127.0.0.1",sql => <<"insert into mqtt.t_mqtt_msg(ts, msgid, mqtt_topic, qos, payload, arrived) values (${ts}, ${id}, ${topic}, ${qos}, ${payload}, ${timestamp})">>,username => <<"root">>}],[{file,"emqx_ee_connector_tdengine.erl"},{line,76}]},{emqx_resource,call_start,3,[{file,"emqx_resource.erl"},{line,359}]},{emqx_resource_manager,start_resource,2,[{file,"emqx_resource_manager.erl"},{line,513}]},{gen_statem,loop_state_callback,11,[{file,"gen_statem.erl"},{line,1205}]},{proc_lib,init_p_do_apply,3,[{file,"proc_lib.erl"},{line,226}]}]}
```
2023-03-29 10:07:02 -03:00
bfa5922209
Merge pull request #10140 from HJianBo/cassa
...
feat: support cassandra data bridge
2023-03-27 10:23:02 +08:00
761847b74a
ci: update emqx-builders with OTP 24.3.4.2-3 and 25.1.2-3
...
These OTP versions implement mnesia_hook:unregister_hook/1
2023-03-23 11:59:43 +02:00
9b63bdc1e0
chore: apply review suggestions
...
- Rename sql to cql
- Add tests for `bridges_probe` API
2023-03-23 15:27:34 +08:00
8cbbc9f271
Merge remote-tracking branch 'upstream/master' into cassa
2023-03-23 11:53:17 +08:00
4ad3579966
test(bridges): add test suite for RocketMQ
2023-03-22 10:36:58 +08:00
539ec2f774
chore(bridge): cover username/password auth for cassandra bridges
2023-03-21 13:55:53 +08:00
12942b676d
Merge remote-tracking branch 'upstream/master' into cassa
2023-03-20 09:50:27 +08:00
678cc937c0
test(bridge): cover ssl testing for cassandra bridge
2023-03-17 18:25:05 +08:00
5f0828a2ea
ci: add certs for cassandra tls
2023-03-17 16:39:10 +08:00
c0a216a740
feat(bridge): support cassandra bridge
2023-03-17 11:34:48 +08:00
5eaaa83b82
chore: simplify run.sh
...
- get rid of sudo
- do not change permissions of existing files
- use our own docker image to generate certs to make it working on arm
- bump kafka docker image version to have access to multiplatofrm one
2023-03-16 13:43:01 -03:00
1051df7af8
test: add kafka to toxiproxy
2023-03-16 13:43:01 -03:00
fc37d9b3cd
fix(mysql): be explicit that batch queries are parameterless
...
So that mysql client won't attempt to prepare them automatically, thus
trashing the server's prepared statements table and making interaction
overall heavier.
2023-03-10 18:42:04 +03:00
225cbab9ce
ci(mysql): drop outdated config options
...
Also make them look as recommended in the documentation.
2023-03-10 18:42:00 +03:00
984dd3446d
test(bridges): add test suite for DynamoDB
2023-03-08 11:13:51 +08:00
67acdf0888
feat: add clickhouse database bridge
...
This commit adds a Clickhouse bridge to EMQX 5. The bridge is similar to
the Clickhouse bridge in the 4.4, but adds the possibility to use
different formats (such as JSON) for values to be inserted.
2023-03-02 12:22:11 +01:00
de740a2fd9
ci: use official zookeeper image
...
Former one ate almost all of my free memory for some reason. This
one looks more predictable.
2023-02-24 15:03:03 +03:00
977bfb3d6c
ci(kafka): use more suitable env variable to pass jaas conf
2023-02-20 18:19:07 +01:00
7c917334dc
ci: enforce stricter condition on ssl_cert_gen dependency
2023-02-20 18:16:20 +01:00
c7f535abc7
chore: bump OTP-24 image version to 24.3.4.2-2
2023-02-17 11:16:26 +03:00
6bf385793c
Merge pull request #9978 from thalesmg/fix-psql-tls-v50
...
fix(pgsql): fix ssl option for pgsql connector to match previous behavior (5.0)
2023-02-16 09:20:32 -03:00
c684730bbe
chore(ci): remove legacy helper Makefile
2023-02-16 11:30:56 +02:00
dbda504f2c
fix(pgsql): fix ssl option for pgsql connector to match previous behavior (5.0)
...
Fixes https://github.com/emqx/emqx/issues/9907
At v5.0.14, we changed the `ssl` option for the Postgres connector
from `true` to `required`, but there was another transformation in
`conn_opts/2` that led to an incorrect configuration. This change
ended up preventing users from connecting to Postgres with their
previous configurations after upgrading EMQX.
2023-02-15 14:06:33 -03:00
0420e9acb5
test(bridges): add test cases for TDEngine
2023-02-14 22:04:29 +08:00
202f6d0181
ci: stop building alpine docker image
2023-02-09 14:19:35 +01:00
fce1e74c3d
fix(connector): fix redis cluster resource recovery
2023-01-31 16:55:05 +02:00
f6fbbf3ee3
chore(bridges): reduce Redis bridge flakyness
2023-01-18 14:34:11 +02:00
ea405fe55d
test(bridges): add test case for the PostgreSQL backend
2023-01-06 11:56:28 +08:00
6d7e6e6ea7
ci: delay Kafka topic creation
2022-12-29 14:30:30 +01:00
2e1cdd039e
ci: include OTP-25 in some workflows
...
* Use OTP-25 exclusively for Elixir builds
* Include OTP-25 in slim package builds
* Include OTP-25 in test workflow matrices
2022-12-16 13:45:04 +03:00
40809b2ad0
Merge remote-tracking branch 'origin/dev/ee5.0' into release-50
2022-12-09 11:45:52 +01:00
f3b069a0d9
test: fix config load for lib-ee tests
2022-12-07 15:50:50 +01:00
6692b0c895
feat(bridge): add Redis bridge
2022-12-06 23:15:42 +03:00
eb62192838
test: expand EE mysql bridge test with toxiproxy
2022-12-01 10:27:51 +01:00
83fe35b148
Merge remote-tracking branch 'origin/dev/ee5.0' into 1116-sync-v5.0.10-to-ee50
2022-11-18 19:23:31 +01:00
09455edae8
Merge tag 'v5.0.10' into dev/ee5.0
2022-11-16 16:20:30 +01:00
7bbd6353aa
chore: fix /.cache and /.erlang.cookie in erlang container
2022-11-09 09:30:32 +01:00
d90b3760b1
ci(ct/run.sh): use host uid and gid in erlang container for ct
2022-11-09 09:53:03 +08:00
04588148b7
test(influxdb): increase influxdb bridge/connector coverage (ee5.0)
2022-11-07 15:15:49 -03:00
4135910b42
chore: merge master into dev/ee5.0
2022-09-26 09:52:33 +08:00
5ec4b0a6ca
fix: fix entrypoint in docker compose for Kafka bridge test
2022-09-23 15:58:22 +02:00
ac37c5d58a
test: github actions debug printouts
2022-09-23 15:02:01 +02:00
a3c88b40a0
test: changes to make Kafka container run in GitHub action
2022-09-23 14:33:41 +02:00
c4f7d385b5
test: fix true not allowed as docker compose env var value
2022-09-23 11:47:12 +02:00
9f3e38aeb0
test: fix error in script detected by spellcheck script
2022-09-23 10:37:30 +02:00
ba34326010
ci(kafka): fix shellcheck errors
2022-09-23 08:58:51 +02:00
7aa99b26b9
chore: add git commit hook for git-blame-ignore-revs
...
ignore redis log files
2022-09-23 12:37:07 +08:00
ac2922fc4c
test: Kafka bridge cases for all combinations of SASL and SSL
2022-09-16 16:44:12 +02:00
5820b028cb
feat: add test case for Kerberos Kafka authentication
2022-09-14 17:03:37 +02:00
f0e03086a6
test: add test cases for Kafka SASL auth mechanisms plain and scram
2022-09-13 19:46:56 +02:00
0c1595be02
feat: Add Kafka connector
2022-09-13 19:46:56 +02:00
3d4afd65df
feat: add mongodb bridge (e5.0)
2022-09-01 14:47:14 -03:00
387a1d822a
Merge pull request #8410 from zmstone/0704-add-haproxy-to-cluster-example-secript
...
0704 add haproxy to cluster example script
2022-07-19 19:27:05 +01:00
ab17fd80e7
ci: common test add redis-sentinel
2022-07-13 10:37:16 +08:00
a95474669e
chore: remove duplicated haproxy config section
...
the mgmt and dashbaord endpoints are both merged 18083 now
no need to declare twice
2022-07-04 17:57:13 +02:00
d3f8ebd10f
ci: fix relup test workflow and upgrade builder to 5.0-17
...
builder 5.0-17 has emqtt-bench and lux included
so we do not need to rebuild the software for each ci job
2022-06-27 12:06:13 +02:00
f18eab402a
fix(CI): don't use any authz sources when testing
2022-06-10 14:21:20 +08:00
fc4d9e4dcd
ci: use emqx-builder 5.0-16
...
Fixed openssl compatibility issue
2022-06-06 10:54:26 +02:00
d0c5de1da6
chore(config): move db configs under cluster/node keys
2022-05-26 14:02:22 -03:00
5d65bdaa47
chore: ping emqx-builder to 5.0-15
2022-05-16 18:10:42 +08:00
e95a14843d
ci: delete otp 23 from ci matrix
2022-05-10 16:34:53 +02:00
74c33cd4e5
feat(rule_engine): add jq function to the rule engine
...
This commit adds a function to the rule engine that alows users
to transform text or JSON objects using [jq filter programs][1].
[jq][1] is a command line tool that can be used to transform
and filter JSON text using jq's built-in language. The rule engine
function that is added with this commit uses the
[Erlang jq NIF library][2] that wraps the jq C library in an
Erlang NIF function.
[1]: https://stedolan.github.io/jq/
[2]: https://github.com/emqx/jq
2022-05-04 17:09:16 +02:00
b49df4599a
build: use latest builder images (alpine 3.15.1)
...
OpenSSL-1.1.1n
2022-03-25 07:38:39 +01:00
a1c76f474b
chore(autotest): add gitactions for new autotest scripts
2022-03-10 15:59:09 +08:00
a85d636a68
feat(rlog): use rlog as the default db backend
2022-03-08 13:34:05 -03:00
e6495f4300
ci: upgrade emqx-builder to 5.0-8:1.13.3-24.2.1-1
2022-03-02 21:57:26 +01:00
8cac5f6b39
chore(ci): update emqx-builder image
...
Uses Elixir 1.13.3 and OTP 24.2.1-1.
2022-02-23 15:00:07 -03:00
1b3b2c0d03
feat: add eval-erl command to `bin/emqx`
...
This allows Erlang expressions to be evaluated easily even on nodes
running Elixir.
2022-02-04 16:53:27 -03:00
6d557bc0ca
ci(pytest): pin pytest version at 6.2.5
...
After a major version release (7.0.0), our current FVT tests all
failed due to some change in the lib. Our pytest version in CI was
not pinned, and picked this update up.
2022-02-04 10:19:29 -03:00
506dad169a
chore(elixir_otp): bump emqx-builder images
2022-01-26 16:59:50 -03:00
3ec7d9ae24
chore(ci): use new tagged image with elixir
2022-01-26 16:59:49 -03:00
5a7943f583
chore(ci): grep `emqx ctl listeners` to check if node is listening
2022-01-26 16:59:49 -03:00
e874ec2b36
chore(images): use new image in more CI workflows
2022-01-26 16:59:49 -03:00
bc498a8041
ci(mix): add fvt tests and docker images with elixir
2022-01-26 16:59:48 -03:00
b9494662ae
fix(ci): fix shellcheck file pattern
...
Since we started to use the portable shebang style for our scripts, we
need to update the pattern used to find scripts for Shellcheck to
check.
2022-01-05 11:34:04 -03:00
7208669946
chore(authn): reduce number of pre-generated certificates, refactor
...
tests
2021-12-30 13:49:14 +03:00
a7ca6cb39f
chore(authn): test MongoDB authn via ssl connection
2021-12-29 16:24:52 +03:00
e2e2c98679
chore(authn): test Mysql authn via ssl connection
2021-12-27 11:16:31 +03:00
6de89d1207
chore(authn): test PostgreSQL authn via ssl connection
2021-12-27 11:16:31 +03:00
520629d6e2
chore(authn): test Redis authn via ssl connection
2021-12-27 11:16:31 +03:00
6ad71a483e
chore(authz): test Redis backend with real Redis
2021-12-17 14:18:54 +03:00
caf1784a90
build: update otp version
2021-12-02 15:25:11 +08:00
390575eafb
chore(authn): add MongoDB backend tests
2021-11-29 21:17:56 +03:00
8cc0b43de7
chore(authn): add MySQL & PostgreSQL backend tests
2021-11-23 11:52:51 +03:00
071c2c99e8
refactor(authn resources): add `emqx_resource` and `emqx_authn` tests
2021-11-22 21:08:04 +03:00
a705bc1fc7
build: change package name scheme
...
`${PROFILE}-${PKG_VSN}-otp${OTP_VSN}-${SYSTEM}-${ARCH}.zip`
2021-11-20 20:44:48 +01:00
315a06214f
test(rlog): reenable RLOG FVT tests
...
The RLOG DB backend tests in FVT were temporarily disabled due to some
paho tests being specially flaky in CI.
In particular, those tests had the common pattern of subscribing to a
topic, immediately publishing to that topic and then waiting for the
response. When in CI and using RLOG, there seems to be more delays in
replication of data, and often this pattern would fail in the
constraint testing enviroment.
2021-11-18 18:03:30 -03:00
030e4857ec
docs(issue): mark solution as TODO and link related issue
...
https://github.com/emqx/emqx/issues/6094
2021-11-08 15:36:54 -03:00
f8fc67b313
fix(lag): target only replica if rlog core+replicant
...
there seems to be race conditions related to some tests with sessions
hitting the core and the replicant alternately and rlog.
for intance, if there is some delay in this replication, a new
connection made to the replica with a just-created session in the core
may not have been replicated to the replicant, resulting in a test
failure if it expects the session to be present.
since such replication lags are inherent to the core-replicant
topology, we can try to target only the replicant to avoid seeing this
inconsistent view of the system during the tests.
2021-11-08 14:18:07 -03:00
c60feaaad2
test(fvt): extend functional verification tests to use replicant node
...
This parameterizes the Functional Verification Tests (FVTs) that run
in CI to use a replication log (RLOG) role of "replicant" for one of
the nodes. With this addition, our FVTs may explore more scenarios
with data replication.
2021-11-07 17:02:57 -03:00
f817ba0075
chore(CI): rename image
2021-10-22 13:40:01 +08:00
7732796331
chore(CI): change otp version for docker compose file
...
Signed-off-by: zhanghongtong <rory-z@outlook.com>
2021-10-22 13:40:01 +08:00
86231f795d
refactor: close managment http 8081 ( #5564 )
2021-08-27 13:46:39 +08:00
092f29fecd
refactor(CI): update the ENVs for new listener,zone configs
2021-08-26 09:11:30 +08:00
5177ba02d6
fix(config): update ENVs for logger
2021-08-23 18:25:45 +08:00
64ddb13d8e
Merge pull request #5450 from zmstone/chore-update-otp-version-for-ci
...
chore: update otp version in CI
2021-08-11 14:02:54 +02:00
ae8c3cf779
chore(ci): make use of haproxy mqtt sticky session
2021-08-11 10:39:40 +08:00
1d755f1272
test(ci): create certificate chain in tmp dir
...
the haproxy container boot script has no permission writing to
the mounted dir.
2021-08-11 10:39:40 +08:00
1a4f7f190d
test(ci): update haproxy version to 2.4
2021-08-11 10:39:40 +08:00
bf94051d56
chore: update otp version in CI
2021-08-10 15:56:22 +02:00
0fe3083cd7
build: add erlang 24.0.1 for ci
2021-08-09 11:12:25 +02:00
3761db0525
feat(authn redis): support authn with redis
2021-08-06 14:05:31 +08:00
f8f7493352
fix(test): set RETRY_INTERVAL and MAX_TOPIC_ALIAS for paho test
2021-07-17 17:36:01 +08:00
e3cfc922b2
fix(docker): set console log to debug when testing
2021-07-17 15:49:50 +08:00
c9cf8b66e7
fix(docker): cannot set log_level using os env
2021-07-17 15:25:18 +08:00
72d3b2db1b
fix(docker): update the env names in scripts
2021-07-17 14:25:07 +08:00
4d279e47d8
chore(merge): merge code from master
2021-07-17 01:20:57 +08:00
9239d3a840
chore(CI): update emqx cluster docker compose file
2021-07-16 23:17:51 +08:00
7d66760c1e
fix(hocon): start emqx failed using os env configs
2021-07-15 11:55:31 +08:00
53df218e6a
feat(connector): mongo support replica set
2021-07-06 18:07:06 +08:00
fd0a211629
chore(authz): mongo connector support ssl
2021-07-05 17:57:03 +08:00
694f3bd67f
feat(authz): support mongo single
2021-07-05 17:57:03 +08:00
918a26e921
feat(conf): merge all conf to emqx.conf
2021-07-02 17:01:16 +08:00
2b082f9cf9
chore(connector): update connector ssl schema
2021-06-29 18:22:44 +08:00
0431c64708
test(ci): fix path to cert dir
2021-06-07 09:09:28 +02:00
4b174b0277
feat(conf): use hocon schema
2021-06-01 17:05:52 +09:00
efe0c2fe1a
fix(docker-entrypoint): do not mv loaded_plugins file, copy it by cat
2021-05-14 05:41:00 +09:00
cd53568f36
build: pin otp 23.2.7.2-emqx-2
2021-05-06 21:05:39 +02:00
cacb56a25c
build: pin erl23.2.7.2-emqx-1
2021-04-27 21:23:40 +02:00
48b0cc37ed
chore(docker compose): update emqx cluster compose file
2021-04-19 18:19:53 +08:00
5c49d5e49d
chore(build): Pin Erlang/OTP 23.2.7.1-emqx-1
2021-04-17 22:15:34 +02:00
ef88b283e8
chore(CI): fix redis ssl cluster error
2021-04-15 21:51:27 +08:00
ed2a675404
chore(fvt test): update emqx cluster compose file
2021-04-15 21:51:27 +08:00
48cbb9c0ed
chore(CI): cts support redis sentinel ssl
2021-04-10 11:06:09 +08:00
355b42c623
chore(CI): cts support redis sentinel
2021-04-10 11:06:09 +08:00
0b904bb28b
chore(CI): add password for redis cluster in actions
2021-04-07 15:21:18 +08:00
e44855bfb7
chore(CI): add password for redis in actions
2021-04-07 15:21:18 +08:00
9be1d94f44
chore(CI): add ssl user for mysql
2021-03-31 19:44:38 +08:00
65e044abc0
chore(CI): update redis image
2021-03-30 18:02:37 +08:00
ac9a229c37
chore(CI): update docker compose file
2021-03-30 18:02:37 +08:00
Paulo Zulato