yuanbiao
/
emqx
1
0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
22,836 Commits 393 Branches 684 Tags 74 MiB
Commit Graph

234 Commits

Author SHA1 Message Date
Serge Tupchii bac0f7107c chore: bump OTP to 25.3.2-2 and EMQX builder to 5.1-4 2023-08-23 19:35:36 +03:00
Ilya Averyanov 92a293a67b chore(ci): pin pytest-retry version 2023-08-23 17:34:15 +03:00
Ilya Averyanov 44b080f5b3 chore(ci): pin pytest-retry version 2023-08-23 17:33:24 +03:00
firest 184e03387a fix(ldap): fix status detection and auto reconnecting errors 2023-08-22 17:06:00 +08:00
JimMoen 13ebcd6290
Merge pull request #11478 from JimMoen/hstreamdb-tls-support 
Hstreamdb tls support
 2023-08-22 10:40:54 +08:00
JimMoen f559ac3410
ci: bump hstreamdb & zookeeper image vsn 2023-08-21 17:57:21 +08:00
Paulo Zulato 2c458b62f5 feat(redis): add support for `username` on AUTH command 
Fixes https://emqx.atlassian.net/browse/EMQX-9911
 2023-08-18 14:50:06 -03:00
Ilya Averyanov fc3720627b chore(ci): fix zookeeper version for hstreamdb 2023-08-18 14:49:21 -03:00
Ilya Averyanov fa62931aff chore(ci): fix zookeeper version for hstreamdb 2023-08-17 19:04:19 +03:00
Ilya Averyanov bd2155198a ci: wait for hstore container when starting hstream server 2023-08-17 17:21:55 +03:00
Ivan Dyachkov 362235021c ci: refactor workflows to use single entry point on pull request trigger 2023-08-06 14:16:56 +02:00
firest f98f97f37e feat(ldap): set test env and add test suites 2023-08-01 18:49:54 +08:00
Thales Macedo Garitezi 399f849f7b feat(rabbitmq_bridge): add TLS support 
Fixes https://emqx.atlassian.net/browse/EMQX-10605
 2023-07-27 15:52:46 -03:00
Dennis Zhuang c6a7f3e2ad test: make test passed 21/29 2023-07-24 17:58:48 +08:00
Dennis Zhuang 975795a6e0 feat: add ci test 2023-07-24 17:58:48 +08:00
Paulo Zulato 27630ca215
Merge pull request #11261 from paulozulato/feat-bridge-kinesis 
Implement Amazon Kinesis Producer bridge
 2023-07-18 16:48:34 -03:00
Thales Macedo Garitezi 99378355ea ci: bump builder image -> 5.1-3 2023-07-18 09:00:29 -03:00
Paulo Zulato 484519dcf9 feat(kinesis): implement Amazon Kinesis Producer bridge 
Fixes https://emqx.atlassian.net/browse/EMQX-10474
Fixes https://emqx.atlassian.net/browse/EMQX-10475
 2023-07-17 11:51:42 -03:00
JimMoen 583ccfaafd
test(hstreamdb): create stream and wirte data 2023-07-07 12:25:36 +08:00
Thales Macedo Garitezi 7ef03d9e1f
Merge pull request #11090 from thalesmg/gcp-pubsub-consumer 
feat(gcp_pubsub_consumer): implement GCP PubSub Consumer bridge
 2023-06-22 09:17:45 -03:00
Zaiming (Stone) Shi fe1cc5ca92 ci: delete temp fix code 2023-06-21 16:41:11 +02:00
Thales Macedo Garitezi b442910ff1 feat(gcp_pubsub_consumer): implement GCP PubSub Consumer bridge 
Fixes https://emqx.atlassian.net/browse/EMQX-10281
 2023-06-19 16:04:12 -03:00
JianBo He a3e50a0d4c chore: pin paho-test version to avoid test failures 2023-06-19 21:12:48 +08:00
Zaiming (Stone) Shi 0b87ea4cdc
Merge pull request #10929 from zmstone/0602-ci-pin-otp-25.3.2-1-elixir-1.14.5 
ci: upgrade to otp 25.3.2-1 and elixir 1.14.5
 2023-06-02 21:46:08 +02:00
Zaiming (Stone) Shi 9c1f77d733 ci: upgrade to otp 25.3.2-1 and elixir 1.14.5 2023-06-02 18:01:09 +02:00
Zaiming (Stone) Shi 28c564d15b Merge remote-tracking branch 'origin/master' into release-51 2023-06-02 16:25:48 +02:00
Thales Macedo Garitezi 90d862cad9
Merge pull request #10915 from thalesmg/fvt-retry-plugin-v50 
ci(fvt): add `pytest-retry` plugin
 2023-06-02 09:26:43 -03:00
firest ea9b1e13d5 test(rocketmq): add an ACL test case 2023-06-02 11:19:06 +08:00
Thales Macedo Garitezi e47e2c9c12 ci(fvt): add `pytest-retry` plugin 2023-06-01 18:05:27 -03:00
Stefan Strigler 6c0fb0e2ea test: run tests against iotdb013 container 2023-05-31 11:30:13 +02:00
Stefan Strigler d775a1e16c test: add iotdb-0.13.4 container 2023-05-30 16:32:38 +02:00
Ilya Averyanov 7fa166f034 Merge branch 'release-50' into file-transfer 
* release-50: (73 commits)
  feat: add RabbitMQ bridge
  docs: improve rule engine labels and descriptions
  chore: bump version && update changes
  refactor(rocketmq): move rocketmq bridge into its own app
  test: dashboard_listener_test crash
  chore: bump chart versions
  chore: bump ee version to e5.0.4-alpha.1
  test: fix inter-suite flakiness
  build: compatibility to make 4.4+
  feat: add IotDB bridge
  ci: ensure git safe dir in build_packages
  ci: ensure git safe dir
  test: check_oom's max_mailbox_size
  feat: rename max_message_queue_len to max_mailbox_size
  fix(buffer_worker): fix inflight count when updating inflight item
  chore: prepare for v5.0.25-rc.1 release
  docs: add change log entry
  fix: non_neg_integer() translated to minimum = 1 in bridge-api-en.json
  chore: `MQTT X` -> `MQTTX`
  chore: make sure brod_gssapi app is included in relese package
  ...
 2023-05-09 23:30:22 +05:00
Kjell Winblad 70cf1533db feat: add RabbitMQ bridge 2023-05-09 14:32:26 +02:00
firest a119100a0e refactor(rocketmq): move rocketmq bridge into its own app 2023-05-09 15:57:56 +08:00
Stefan Strigler d231e708cb feat: add IotDB bridge 2023-05-08 16:19:01 +02:00
Ilya Averyanov dd3471bc22 Merge branch 'master' into file-transfer 
* master: (194 commits)
  fix(limiter): update change && fix deprecated version
  chore: update changes
  perf(limiter): simplify the memory represent of limiter configuration
  ci(perf test): update tf variable name and set job timeout
  ci: fix artifact name in scheduled packages workflow
  fix: build_packages_cron.yaml workflow
  ci: move scheduled builds to a separate workflow
  build: check mnesia compatibility when generating mria config
  docs: fix a typo in api doc description
  feat(./dev): use command style and added 'ctl' command
  test: fix delayed-pubish test case flakyness
  refactor: remove raw_with_default config load option
  chore: add changelog for trace timestrap
  feat: increase the time precision of trace logs to microseconds
  chore: make sure topic_metrics/rewrite's default is []
  docs: Update changes/ce/perf-10417.en.md
  chore: bump `snabbkaffe` to 1.0.8
  ci: run static checks in separate jobs
  chore(schema): mark deprecated quic listener fields ?IMPORTANCE_HIDDEN
  chore: remove unused mqtt cap 'subscription_identifiers'
  ...
 2023-05-05 16:50:18 +03:00
William Yang 9903f34470 test(docker): set global mqtt config 
Set global mqtt config instead of default zone
 2023-05-02 21:50:36 +02:00
Paulo Zulato dd90b2f498 feat(oracle): Oracle Database integration 2023-04-27 13:07:20 -03:00
Thales Macedo Garitezi 56b884ab17 style: change docker compose file name 2023-04-25 14:28:00 -03:00
Thales Macedo Garitezi ad4be08bb2 feat: implement Pulsar Producer bridge (e5.0) 
Fixes https://emqx.atlassian.net/browse/EMQX-8398
 2023-04-24 10:28:26 -03:00
firest 0b46acda87 test(opents): add test cases for OpenTSDB 2023-04-23 11:03:20 +08:00
Ilya Averyanov 0211bcf030 Merge branch 'master' into file-transfer 
* master: (279 commits)
  chore: shorten ct/run.sh script
  chore: rename cassandra_impl to cassandra_connector
  chore: fix mix.exs checking
  refactor(cassandra): move cassandra bridge into its own app
  chore: apply review suggestions
  chore: update changes/ce/fix-10449.en.md
  test: add a test for authn {}
  chore: add changlog for authn_http validation
  fix: always check authn_http's header and ssl_option
  chore: apply suggestions from code review
  fix(emqx_bridge): validate Webhook bad URL and return 'BAD_REQUEST' if it's invalid
  fix(emqx_alarm): add safe call API to activate/deactivate alarms and use it in resource_manager
  perf(emqx_alarm): use dirty Mnesia operations to activate an alarm
  ci: simplify find-apps.sh for ee apps
  perf(emqx_resource): don't reactivate alarms on reoccurring errors
  ci: check if Elixir files are formatted in pre-commit hook
  fix(dynamo): fix field name errors
  chore: remove *_collector for prometheus api's example
  chore: make plugins config to low level
  chore: re-split dynamo i18n file
  ...
 2023-04-21 17:37:17 +03:00
JimMoen 2484a79c7a
test: create bridge with invalid password 2023-04-14 12:52:08 +08:00
JimMoen 1b2cf6d421
ci: newest SQL Serevr 2019 image and rm deprecated env `SA_PASSWORD` 2023-04-14 10:02:47 +08:00
JimMoen 57505cdfb3
ci: unmount odbcinst.ini file 2023-04-14 10:02:47 +08:00
JimMoen c366267b0f
test: MS SQL Server data bridge 2023-04-14 10:02:46 +08:00
Ilya Averyanov be99242e32 fix(ft-s3): fix review comments 2023-04-07 17:36:47 +03:00
Ilya Averyanov 31b441a46e feat(s3): add S3 client application 2023-04-07 17:25:22 +03:00
Thales Macedo Garitezi a8f8228a12
Merge pull request #10308 from thalesmg/test-increase-peer-timeout-v50 
test(peer): increase init and startup timeout for peer nodes
 2023-04-03 15:46:13 -03:00
Thales Macedo Garitezi 0e5a22f500 test(cassandra): cap test container memory usage 
Default memory usage is excessive.
 2023-04-03 10:20:19 -03:00
Paulo Zulato 3765f5f120
Merge pull request #10297 from paulozulato/fix-eval 
fix: keep eval command backward compatible with v4
 2023-03-31 11:29:57 -03:00
Zaiming (Stone) Shi 9bbca07943
Merge pull request #10298 from emqx/release-50 
Merge release-50 back to master
 2023-03-31 15:35:51 +02:00
Paulo Zulato 161435d29d fix: keep eval command backward compatible with v4 
Keeps "eval" command evaluating only Erlang expressions, even on Elixir
node.

Fixes: https://emqx.atlassian.net/browse/EMQX-8947
 2023-03-30 14:20:49 -03:00
Thales Macedo Garitezi b2b9732edb fix(tdengine): make password a required field (rv5.0) 
Fixes https://emqx.atlassian.net/browse/EMQX-9395

```
2023-03-29T09:59:02.655495+00:00 [warning] msg: start_resource_failed, mfa: emqx_resource_manager:start_resource/2, line: 524, id: <<"bridge:tdengine:jimmoen-test-trigger">>, reason: {error,function_clause,[{emqx_ee_connector_tdengine,on_start,[<<"bridge:tdengine:jimmoen-test-trigger:1076">>,#{database => <<"db">>,enable => true,pool_size => 8,resource_opts => #{auto_restart_interval => 60000,batch_size => 1,batch_time => 0,health_check_interval => 15000,max_queue_bytes => 104857600,query_mode => sync,request_timeout => 15000,start_after_created => true,start_timeout => 5000,worker_pool_size => 16},server => "127.0.0.1",sql => <<"insert into mqtt.t_mqtt_msg(ts, msgid, mqtt_topic, qos, payload, arrived) values (${ts}, ${id}, ${topic}, ${qos}, ${payload}, ${timestamp})">>,username => <<"root">>}],[{file,"emqx_ee_connector_tdengine.erl"},{line,76}]},{emqx_resource,call_start,3,[{file,"emqx_resource.erl"},{line,359}]},{emqx_resource_manager,start_resource,2,[{file,"emqx_resource_manager.erl"},{line,513}]},{gen_statem,loop_state_callback,11,[{file,"gen_statem.erl"},{line,1205}]},{proc_lib,init_p_do_apply,3,[{file,"proc_lib.erl"},{line,226}]}]}
```
 2023-03-29 10:07:02 -03:00
JianBo He bfa5922209
Merge pull request #10140 from HJianBo/cassa 
feat: support cassandra data bridge
 2023-03-27 10:23:02 +08:00
Serge Tupchii 761847b74a ci: update emqx-builders with OTP 24.3.4.2-3 and 25.1.2-3 
These OTP versions implement mnesia_hook:unregister_hook/1
 2023-03-23 11:59:43 +02:00
JianBo He 9b63bdc1e0 chore: apply review suggestions 
- Rename sql to cql
- Add tests for `bridges_probe` API
 2023-03-23 15:27:34 +08:00
JianBo He 8cbbc9f271 Merge remote-tracking branch 'upstream/master' into cassa 2023-03-23 11:53:17 +08:00
firest 4ad3579966 test(bridges): add test suite for RocketMQ 2023-03-22 10:36:58 +08:00
JianBo He 539ec2f774 chore(bridge): cover username/password auth for cassandra bridges 2023-03-21 13:55:53 +08:00
JianBo He 12942b676d Merge remote-tracking branch 'upstream/master' into cassa 2023-03-20 09:50:27 +08:00
JianBo He 678cc937c0 test(bridge): cover ssl testing for cassandra bridge 2023-03-17 18:25:05 +08:00
JianBo He 5f0828a2ea ci: add certs for cassandra tls 2023-03-17 16:39:10 +08:00
JianBo He c0a216a740 feat(bridge): support cassandra bridge 2023-03-17 11:34:48 +08:00
Ivan Dyachkov 5eaaa83b82 chore: simplify run.sh 
- get rid of sudo
- do not change permissions of existing files
- use our own docker image to generate certs to make it working on arm
- bump kafka docker image version to have access to multiplatofrm one
 2023-03-16 13:43:01 -03:00
Thales Macedo Garitezi 1051df7af8 test: add kafka to toxiproxy 2023-03-16 13:43:01 -03:00
Andrew Mayorov fc37d9b3cd
fix(mysql): be explicit that batch queries are parameterless 
So that mysql client won't attempt to prepare them automatically, thus
trashing the server's prepared statements table and making interaction
overall heavier.
 2023-03-10 18:42:04 +03:00
Andrew Mayorov 225cbab9ce
ci(mysql): drop outdated config options 
Also make them look as recommended in the documentation.
 2023-03-10 18:42:00 +03:00
firest 984dd3446d test(bridges): add test suite for DynamoDB 2023-03-08 11:13:51 +08:00
Kjell Winblad 67acdf0888 feat: add clickhouse database bridge 
This commit adds a Clickhouse bridge to EMQX 5. The bridge is similar to
the Clickhouse bridge in the 4.4, but adds the possibility to use
different formats (such as JSON) for values to be inserted.
 2023-03-02 12:22:11 +01:00
Andrew Mayorov de740a2fd9
ci: use official zookeeper image 
Former one ate almost all of my free memory for some reason. This
one looks more predictable.
 2023-02-24 15:03:03 +03:00
Ivan Dyachkov 977bfb3d6c ci(kafka): use more suitable env variable to pass jaas conf 2023-02-20 18:19:07 +01:00
Ivan Dyachkov 7c917334dc ci: enforce stricter condition on ssl_cert_gen dependency 2023-02-20 18:16:20 +01:00
Andrew Mayorov c7f535abc7
chore: bump OTP-24 image version to 24.3.4.2-2 2023-02-17 11:16:26 +03:00
Thales Macedo Garitezi 6bf385793c
Merge pull request #9978 from thalesmg/fix-psql-tls-v50 
fix(pgsql): fix ssl option for pgsql connector to match previous behavior (5.0)
 2023-02-16 09:20:32 -03:00
Ilya Averyanov c684730bbe chore(ci): remove legacy helper Makefile 2023-02-16 11:30:56 +02:00
Thales Macedo Garitezi dbda504f2c fix(pgsql): fix ssl option for pgsql connector to match previous behavior (5.0) 
Fixes https://github.com/emqx/emqx/issues/9907

At v5.0.14, we changed the `ssl` option for the Postgres connector
from `true` to `required`, but there was another transformation in
`conn_opts/2` that led to an incorrect configuration.  This change
ended up preventing users from connecting to Postgres with their
previous configurations after upgrading EMQX.
 2023-02-15 14:06:33 -03:00
firest 0420e9acb5 test(bridges): add test cases for TDEngine 2023-02-14 22:04:29 +08:00
Ivan Dyachkov 202f6d0181 ci: stop building alpine docker image 2023-02-09 14:19:35 +01:00
Ilya Averyanov fce1e74c3d fix(connector): fix redis cluster resource recovery 2023-01-31 16:55:05 +02:00
Ilya Averyanov f6fbbf3ee3 chore(bridges): reduce Redis bridge flakyness 2023-01-18 14:34:11 +02:00
firest ea405fe55d test(bridges): add test case for the PostgreSQL backend 2023-01-06 11:56:28 +08:00
Zaiming (Stone) Shi 6d7e6e6ea7 ci: delay Kafka topic creation 2022-12-29 14:30:30 +01:00
Andrew Mayorov 2e1cdd039e
ci: include OTP-25 in some workflows 
* Use OTP-25 exclusively for Elixir builds
* Include OTP-25 in slim package builds
* Include OTP-25 in test workflow matrices
 2022-12-16 13:45:04 +03:00
Zaiming (Stone) Shi 40809b2ad0 Merge remote-tracking branch 'origin/dev/ee5.0' into release-50 2022-12-09 11:45:52 +01:00
Zaiming (Stone) Shi f3b069a0d9 test: fix config load for lib-ee tests 2022-12-07 15:50:50 +01:00
Ilya Averyanov 6692b0c895 feat(bridge): add Redis bridge 2022-12-06 23:15:42 +03:00
Erik Timan eb62192838 test: expand EE mysql bridge test with toxiproxy 2022-12-01 10:27:51 +01:00
Zaiming (Stone) Shi 83fe35b148 Merge remote-tracking branch 'origin/dev/ee5.0' into 1116-sync-v5.0.10-to-ee50 2022-11-18 19:23:31 +01:00
Zaiming (Stone) Shi 09455edae8 Merge tag 'v5.0.10' into dev/ee5.0 2022-11-16 16:20:30 +01:00
Ivan Dyachkov 7bbd6353aa chore: fix /.cache and /.erlang.cookie in erlang container 2022-11-09 09:30:32 +01:00
Ivan Dyachkov d90b3760b1 ci(ct/run.sh): use host uid and gid in erlang container for ct 2022-11-09 09:53:03 +08:00
Thales Macedo Garitezi 04588148b7 test(influxdb): increase influxdb bridge/connector coverage (ee5.0) 2022-11-07 15:15:49 -03:00
Shawn 4135910b42 chore: merge master into dev/ee5.0 2022-09-26 09:52:33 +08:00
Kjell Winblad 5ec4b0a6ca fix: fix entrypoint in docker compose for Kafka bridge test 2022-09-23 15:58:22 +02:00
Kjell Winblad ac37c5d58a test: github actions debug printouts 2022-09-23 15:02:01 +02:00
Kjell Winblad a3c88b40a0 test: changes to make Kafka container run in GitHub action 2022-09-23 14:33:41 +02:00
Kjell Winblad c4f7d385b5 test: fix true not allowed as docker compose env var value 2022-09-23 11:47:12 +02:00
Kjell Winblad 9f3e38aeb0 test: fix error in script detected by spellcheck script 2022-09-23 10:37:30 +02:00
Zaiming (Stone) Shi ba34326010 ci(kafka): fix shellcheck errors 2022-09-23 08:58:51 +02:00