89614245f6
test: use macro for authentication root name
2021-12-06 08:00:42 +01:00
a1f79850b4
refactor: allow accessing override config paths
2021-12-06 08:00:42 +01:00
a723e41390
test: fix a flaky test which gets interfered by other test cases
2021-12-06 08:00:42 +01:00
5525cb3262
refactor: only apply environment variables on base config
2021-12-06 08:00:42 +01:00
a681079ba7
refactor: remove special env override from schema
...
EMQX_NODE_NAME and EMQX_NODE_COOKIE are translated into
EMQX_NODE__NAME and EMQX_NODE__COOKIE
2021-12-06 08:00:42 +01:00
d9a980c7e1
docs: fix config doc, avoid using <text> in doc body
2021-12-06 08:00:42 +01:00
e6e28f9002
docs: fix emqx_schema doc style
2021-12-06 08:00:42 +01:00
bfc36efa0e
fix: pin hocon 0.21.1
2021-12-06 08:00:37 +01:00
1b0da3cc58
fix(alarm): alarm message with .2f format
2021-12-06 14:36:51 +08:00
9e8b4ab237
Merge pull request #6298 from tigercl/feat/cluster-authn
...
feat(authn): support sync configuration in the cluster
2021-12-06 10:04:48 +08:00
867cc3c4ad
test: ensure emqx_connector is loaded
2021-12-04 09:33:14 +01:00
5d3cb6ae1c
refactor(authn): align authn config root name
...
authn configs are checked independently per-auth provider,
this was to make authn providers more plugable.
in order to make environment variable overrides work for authn,
we need to have a unified view of the config layout,
no matter from root level, or partially checking per-provider
config independently, i.e. we try to use the same config envelop.
2021-12-04 09:33:14 +01:00
bc8a0d7060
fix(listeners): fix typo in listener type
...
`emqx_listeners:{current,max}_conns` were matching on type `tcl`.
However, this type doesn't exist (it's not defined in
`?TYPES_STRING`). Therefore, this clause would never match. It seems
that the intention was that it shouldbe `tcp`.
2021-12-03 15:55:51 -03:00
dfa45c909a
fix(crash_dump): Fix hocon schema related to the erlang crash dump
2021-12-03 18:45:45 +01:00
fd9f6bd140
fix(crash_dump): Replace crash dump directory with a file
2021-12-03 18:18:24 +01:00
954179b959
Merge pull request #6370 from k32/perf
...
chore(mria): Bump version to 0.1.4
2021-12-03 17:39:21 +01:00
2ceb660344
chore(mria): Bump version to 0.1.4
2021-12-03 17:13:12 +01:00
1dfc37cd18
test(authn): fix test cases
2021-12-03 15:55:34 +08:00
f645a4eada
test(retainer): add test case for stopping publish clear msg
2021-12-03 14:42:27 +08:00
4b3b29873a
feat(retainer): allow to stop publish clear msg
2021-12-03 14:41:42 +08:00
d4246ad2f6
fix(vm): add literal_alloc memory calculation
2021-12-03 14:41:33 +08:00
a7cd1ad30b
fix(mgmt): node memory usage info
2021-12-03 14:41:33 +08:00
e1bcbd012c
feat(authn): support sync configuration in the cluster
2021-12-03 14:14:40 +08:00
85a6f0f1e8
Merge pull request #6350 from zhongwencool/emqx-conf
...
feat: support eqmx_ctl cluster_call command.
2021-12-03 11:27:21 +08:00
858891dbf5
fix: rewrite ct badmatch
2021-12-03 09:54:44 +08:00
f6c61189c4
chore(HTTP): prometheus or json format by accept header
2021-12-02 10:30:50 +08:00
a58493f7a4
test(authz): fix test suite for schema check and app start
2021-12-02 10:12:10 +08:00
effa3b8b90
style: make elvis happy
2021-12-02 10:12:10 +08:00
d7ec368884
fix(authz): fix mongo resources create
2021-12-02 10:12:10 +08:00
68af284570
fix(authz): http source create and update
2021-12-02 10:12:10 +08:00
e7a7d64004
feat(conf): skip/fast_forward tnx_id via cluster_call cli
2021-12-02 09:30:27 +08:00
b983a18cdf
fix(auth): replace query with cmd
2021-12-01 20:24:43 +08:00
c1a7d7bede
fix(conf): emqx_conf return nest error
2021-12-01 16:08:49 +08:00
25c4f4aa4e
Merge pull request #6339 from zhongwencool/swagger-ct-test
...
chore(swagger): add test for sub fields
2021-12-01 14:12:14 +08:00
e888e1ef8d
Merge pull request #6338 from tigercl/fix/superuser
...
fix(authn): fix superuser when missing is_superuser_field
2021-12-01 14:00:56 +08:00
1f6e2e7397
chore: add test for sub fields
2021-12-01 12:01:44 +08:00
6b8997cbda
fix(authn): fix superuser when missing is_superuser_field
2021-12-01 09:23:36 +08:00
d2fa0a71f4
refactor: give psk auth a better namespace
2021-12-01 00:33:20 +01:00
a92970a904
feat(mria): Add RPC-related configuration to the schema
2021-11-30 21:59:59 +01:00
6b65151f69
Merge pull request #6325 from savonarola/test-authn-resources-scram
...
chore(authn): add SCRAM mechanism tests
2021-11-30 12:16:20 +03:00
e196f8150d
Merge pull request #6329 from lafirest/fix/event
...
fix(emqx_gateway): fix the function_clause error when client disconne…
2021-11-30 16:52:11 +08:00
cfe2954a88
fix(emqx_gateway): fix the function_clause error when client disconnect after connection created
2021-11-30 12:25:06 +08:00
36cece7a49
Merge pull request #6314 from JimMoen/fix-re-escape
...
fix(authz): placehodler regular escape
2021-11-30 10:21:28 +08:00
e6d7e59c18
Merge pull request #6278 from savonarola/test-authn-resources-mongo
...
chore(authn): add MongoDB backend tests
2021-11-29 22:27:52 +03:00
4941b4d1a0
Merge pull request #6316 from savonarola/test-authn-resources-jwt
...
chore(authn): add JWKS backend tests
2021-11-29 22:03:41 +03:00
0baec8e27d
chore(authn): unify Mongo type parameter naming
2021-11-29 21:39:28 +03:00
390575eafb
chore(authn): add MongoDB backend tests
2021-11-29 21:17:56 +03:00
4580c03ebc
chore(authn): add SCRAM mechanism tests
2021-11-29 20:49:45 +03:00
581cb6ac5d
Merge pull request #6268 from HJianBo/reduce-case-logs
...
test(gw): reduce useless log print
2021-11-29 11:03:40 +08:00
726e25d6ae
chore(authn): add JWKS backend tests
2021-11-26 18:40:21 +03:00
284619ef86
Merge pull request #6310 from emqx/test-fix-possible-flakiness
...
test(flakiness): prevent possible flakiness in test
If the spawned process doesn't have enough time to be properly set up,
the returned stacktrace may be empty, making the test fail. By
synchronizing the startup, we know that the process will have a proper
stacktrace by the time of the assertion.
2021-11-26 08:09:05 -03:00
759b03a6ad
Merge pull request #6306 from savonarola/ct-output
...
chore(ct): remove verbose output during tests
2021-11-26 12:54:21 +03:00
1d3558ebe0
style: make elvis happy
2021-11-26 17:46:38 +08:00
f697028b70
Fix ping not return pong ( #6285 )
...
* fix: ./bin/emqx ping return pong
* chore: waiting longer for logger flush log to disk
* fix: change swagger page's limit from 100 to 1000
* chore: type wrong
* fix: sync log to disk by logger_disk_log_h:filesync
2021-11-26 17:02:45 +08:00
b41c41570a
fix(authz): placehodler regular escape
2021-11-26 15:39:42 +08:00
124ba7a071
Merge pull request #6311 from emqx/release-5.0-beta.2
...
Sync bug fixes
2021-11-26 14:24:19 +08:00
12d8ebcc15
Merge pull request #6303 from tigercl/fix/authn-jwt
...
fix(authn): fix jwt authn
2021-11-26 13:36:01 +08:00
349fd1608b
style(authn): improve code formatting
2021-11-26 10:29:57 +08:00
d6288a0b70
test(flakiness): prevent possible flakiness in test
...
If the spawned process doesn't have enough time to be properly set up,
the returned stacktrace may be empty, making the test fail. By
synchronizing the startup, we know that the process will have a proper
stacktrace by the time of the assertion.
2021-11-25 17:15:07 -03:00
ea0fa24ce5
chore(ct): remove verbose output during tests
2021-11-25 18:30:50 +03:00
e6c2600718
chore(authn): add HTTP backend tests
2021-11-25 15:09:13 +03:00
ecd3c9f85c
test(authn): add test cases for jwt authn
2021-11-25 19:03:11 +08:00
15654b5b28
fix(authn): add handling of invalid secret
2021-11-25 17:17:44 +08:00
d88bfdfe14
fix(authn): verify claims type is wrong
2021-11-25 16:42:08 +08:00
f74e34b6a5
fix(conf): change `max_topic_levels` default configuration
2021-11-25 10:11:24 +08:00
db3f7ff749
feat(sys_mon): remove `current_function`
...
Since we now output `current_stacktrace`, `current_function` is now
redundant.
2021-11-24 12:16:16 -03:00
a41d0d49bd
test(impossible_case): remove impossible case test
...
Since `emqx_vm:get_process_info/1` only accepts PIDs as arguments,
it's impossible for `emqx_sys_mon:procinfo/1` to return after
receiving the atom `undefined`.
2021-11-24 11:34:36 -03:00
75a17431d5
feat(sys_mon): Add proc_lib:initial_call/1 and current_stacktrace
...
This adds the information from `proc_lib:initial_call/1` and the
current stacktrace from the process info to `emqx_sys_mon:procinfo/1`
to aid in debugging some warnings with no context such as the
following:
```
2021-11-23T12:33:59.387818+00:00 [warning] info: [{old_heap_block_size,45988046},{heap_block_size,22177879},{mbuf_size,0},{stack_size,40},{old_heap_size,22354134},{heap_size,7106339}], line: 130, mfa: emqx_sys_mon:handle_info/2, msg: large_heap, procinfo: [{pid,<0.2667.0>},{memory,579763664},{total_heap_size,68510672},{heap_size,22177879},{stack_size,40},{min_heap_size,233},{initial_call,{proc_lib,init_p,5}},{current_function,{gen,do_call,4}},{registered_name,[]},{status,running},{message_queue_len,360945},{group_leader,<0.1660.0>},{priority,normal},{trap_exit,false},{reductions,16493271},{last_calls,false},{catchlevel,4},{trace,0},{suspending,[]},{sequential_trace_token,[]},{error_handler,error_handler}]
```
2021-11-24 11:24:27 -03:00
3400a3b978
Merge pull request #6288 from savonarola/handle-authn-backends-own-validations
...
fix(authn): handle authn backends own validations
2021-11-24 15:18:11 +03:00
ac3707e4a9
fix(authn): handle authn backends own validations
2021-11-24 14:05:46 +03:00
fb6ab93f47
fix(dialyzer): fix redundant cases
2021-11-24 18:21:08 +08:00
261ca3d625
fix(connector): fix crash in health checking of mongo connection
2021-11-24 16:48:35 +08:00
793da3d039
fix: add auto subscription swagger example
2021-11-24 16:47:33 +08:00
ca89a8da61
Merge pull request #6274 from emqx/persistent-sessions-ram-backend
...
feat(persistent_sessions): add choice between ram or disc backends in…
2021-11-24 09:25:14 +01:00
d7c7292321
fix(authz): placeholder regular replace
2021-11-24 11:10:30 +08:00
9f04ac5bfd
Merge pull request #6269 from savonarola/test-authn-resources-mysql-pgsql
...
chore(authn): add MySQL & PostgreSQL backend tests
2021-11-23 20:03:52 +03:00
fda2e86187
Merge pull request #6107 from Spycsh/slog
...
chore: refactor slog under emqx, conf and exhook
2021-11-23 16:39:06 +01:00
9a97a7a1c7
chore(persistent_session): remove quotes around boolean in config
2021-11-23 16:24:40 +01:00
df2dda2e10
chore(persistent_session): make more table creation parameterized
2021-11-23 16:23:47 +01:00
9eaedbf246
test(persistent_sessions): add back test groups lost in refactoring
2021-11-23 16:17:27 +01:00
46788ad31b
chore(persistent_sessions): add descriptions of persistent session configs
2021-11-23 13:53:04 +01:00
0865fc6e57
test(persistent_sessions): increase wait time for cm unregister in test
2021-11-23 13:52:02 +01:00
6eb4a617bc
test(persistent_sessions): make another attempt at fixing flaky test
2021-11-23 13:29:47 +01:00
4d92e2b6af
fix(connector): fix options handling for mongo connector
2021-11-23 20:01:21 +08:00
08acb5d435
feat(persistent_sessions): add choice between ram or disc backends in mnesia
2021-11-23 11:51:21 +01:00
8cc0b43de7
chore(authn): add MySQL & PostgreSQL backend tests
2021-11-23 11:52:51 +03:00
27270ca679
test(gw): fix elvis warnings
2021-11-23 16:36:11 +08:00
5204a1c6d4
test(gw): reduce useless log print
2021-11-23 16:01:40 +08:00
ef0e440d27
feat: http trace api for 5.0 ( #6200 )
...
* feat: port log trace http api for 5.0
* fix: name must printable unicode len<256
* fix: check-nl-at-eof warning
* fix: handler_id always atom
2021-11-23 13:49:12 +08:00
6a60c17970
fix: add lw gateway endpoint placeholder support ( #6267 )
2021-11-23 12:08:45 +08:00
af5002733b
Merge pull request #6256 from terry-xiaoyu/resource_metrics2
...
Add metrics to emqx_resource and emqx_bridges
2021-11-23 11:14:25 +08:00
d7725f799c
fix(flaky_test): improve live connection count test on CI ( #6257 )
...
* fix(flaky_test): improve live connection count test on CI
It seems that a race condition that is triggered more often in CI can
make the test fail, possibly due to the ETS write not being seen by
the subsequent read in the test.
* style(elvis): fix NL in emqx_connector.conf
2021-11-23 11:12:45 +08:00
21bd9bba55
fix: generate palce holder ( #6250 )
...
* fix: generate place holder
* style: whitespace cleanup
* refactor(authz): placeholder for athuz
* test: authz test suite for placeholder
* fix: lw place holder suite
* fix: auth n redis suite
Co-authored-by: JimMoen <LnJimMoen@outlook.com>
2021-11-23 10:56:43 +08:00
46838a08cc
fix(resource): update testcases for after_query functions
2021-11-23 10:41:45 +08:00
6fb464fc05
Merge pull request #6059 from tigercl/fix/ssl
...
fix(ssl): fix API returns the certificate file name instead of the certificate content
2021-11-23 10:38:12 +08:00
9aa63358e6
fix(resource): type spec for resource_data()
2021-11-23 10:04:31 +08:00
29ad6d215e
feat(resource): add metrics to emqx_resource
2021-11-23 10:04:31 +08:00
4c149f92c1
feat(bridge): support metrics for bridges
2021-11-23 09:36:10 +08:00
50542ec441
Merge pull request #6248 from HJianBo/gw-improve-apis-1
...
Add authentication data management APIs for gateway
2021-11-23 09:12:04 +08:00
5aa8ba45d3
fix(authn): add the case when the instance does not exist
2021-11-22 23:30:05 +01:00
2b282b9666
fix(ssl): Return the content of certificates in HTTP response
2021-11-22 23:30:05 +01:00
81d425cb27
fix(ssl): fix the issue that the content of TLS certificate is not converted to path
2021-11-22 23:30:05 +01:00
c89a663b53
chore: refactor slog under emqx, conf and exhook
2021-11-22 23:12:17 +01:00
c202688abf
Merge pull request #6258 from tigercl/chore/dashboard
...
chore(dashboard): disable by default
2021-11-22 22:34:26 +01:00
071c2c99e8
refactor(authn resources): add `emqx_resource` and `emqx_authn` tests
2021-11-22 21:08:04 +03:00
b59ad6b186
Merge pull request #6252 from JimMoen/fix-clients-cluster-query
...
fix(mgmt): fix broken `ets:continuation` been sent between nodes
2021-11-22 15:28:16 +01:00
63f1d88ed3
chore(dashboard): disable by default
2021-11-22 22:23:06 +08:00
a0e81226d7
fix(elvis): improve some code format
2021-11-22 19:10:00 +08:00
37aeb28a79
fix(connector): test case conflict
2021-11-22 18:52:43 +08:00
1e2eac0fce
test(gw): add tests for authm data-mgmt
2021-11-22 17:38:59 +08:00
4eb27ce25b
fix(gw): fix bad paging params
2021-11-22 17:38:59 +08:00
7d9930b64e
feat(gw): support data-management apis gw's authn
2021-11-22 17:38:59 +08:00
4f752fb5ab
chore(gw): fix elvis warnings
2021-11-22 17:38:59 +08:00
f033fad7b3
refactor(gw): deps on emqx_dasboard_swagger
2021-11-22 17:38:59 +08:00
f0c61068e8
fix(authn): test cases issues
2021-11-22 17:35:33 +08:00
ea3c809287
fix(emqx_conf): merge issues
2021-11-22 17:35:33 +08:00
07e3e43a21
fix(authn): xref issues
2021-11-22 17:35:33 +08:00
9c93ea0338
feat(connector): add API for /connectors_test
2021-11-22 17:35:33 +08:00
c66c6b53b2
feat(connector): add APIs for connector
2021-11-22 17:35:33 +08:00
bcf5f499da
feat(connector): add APIs for connector
2021-11-22 17:35:33 +08:00
4dac90f4a7
refactor(bridges): add POST /bridges for creating
2021-11-22 17:35:32 +08:00
c4668b4047
fix(bridge): load emqx_conf in testcases
2021-11-22 17:35:32 +08:00
339749764d
fix(bridge): update the testcases for HTTP bridges
2021-11-22 17:35:32 +08:00
7d64013edd
refactor(connector): add connector configs
2021-11-22 17:35:32 +08:00
cf3f2c3057
fix(dialyzer): remote the extra str/1
2021-11-22 17:35:32 +08:00
e41736f5cb
fix(bridge): update testcases for bridge APIs
2021-11-22 17:35:32 +08:00
7996d8f709
refactor(bridge): rename the APIs for emqx_bridge
2021-11-22 17:35:32 +08:00
1e6884ee7d
fix(bridge): convert confs for http bridge when creating
2021-11-22 17:35:32 +08:00
f01f9632c1
fix(bridge): cannot start mqtt bridge from config
2021-11-22 17:35:32 +08:00
63f942a1b8
feat(bridge): add descriptions to the mqtt bridge schema
2021-11-22 17:35:32 +08:00
0cbdaa0f40
refactor(bridge): update config struct for mqtt bridge
2021-11-22 17:35:32 +08:00
d046f9c6e7
fix(bridge): improve the schema of connector_http
2021-11-22 17:35:32 +08:00
dd9e2c4b24
refactor(bridge): the configs for http bridges
2021-11-22 17:35:32 +08:00
90a65b8d04
Merge pull request #6242 from emqx/update-otp-version-and-pkg-name-scheme
...
Update otp version and pkg name scheme
2021-11-22 10:34:24 +01:00
08899552fe
fix(mgmt): fix broken `ets:continuation` been sent between nodes
2021-11-22 17:16:12 +08:00
6da039cf4f
Merge pull request #6231 from tigercl/fix/http-authn
...
fix(authn): fix pick worker error and match more http response
2021-11-22 09:10:44 +08:00
3d449b5acf
fix(authn): create authn chain tab in start_link
2021-11-21 19:52:29 +03:00
6ca6d60858
fix(dashboard): change hash from sha3_256 to sha256
...
old version os has no support for it
2021-11-20 21:21:11 +01:00
a705bc1fc7
build: change package name scheme
...
`${PROFILE}-${PKG_VSN}-otp${OTP_VSN}-${SYSTEM}-${ARCH}.zip`
2021-11-20 20:44:48 +01:00
f84d1aa75e
style: fix some elvis style check
2021-11-20 20:41:06 +01:00
6edd862dd5
refactor: no more EMQX_ENTERPRISE compile flag
...
The compile flag was introduced in EQM X 4.3 series
where CE and EE code was diverged large enough which made
non-practicle to determin edition at runtime.
such approach made testing quite challenging as we'll have to
build with different compile flags inorder to run per-edition
test cases
In this commit, we try to retrieve edition info from EMQX's
description text, (put to PT for fast access) at runtime
so we can test ALL editions from a super-set edition (EE).
2021-11-20 20:41:06 +01:00
8621257809
Merge pull request #6240 from savonarola/reinit-authn-1
...
fix(authn): transfer chain tab to emqx_authentication_sup
2021-11-19 19:57:14 +03:00
c86887491c
fix(authn): transfer chain tab to emqx_authentication_sup
...
To preserve configuration after emqx_authentication crashes.
2021-11-19 16:41:22 +03:00
c9a59968ef
refactor(emqx_schema): Code style
2021-11-19 11:41:29 +01:00
deccba3406
fix(schema): Improve configuration of the internal DB
2021-11-19 11:41:08 +01:00
a074cf24d0
Merge pull request #6219 from tigercl/fix/authz-certs
...
fix(authz): fix badmatch when reading certs
2021-11-19 11:25:29 +08:00
980a6ceae9
fix(authn): fix pick worker error and match more http response
2021-11-19 11:19:52 +08:00
905e58c93a
Merge pull request #5997 from HJianBo/gw-fixes-part3
...
Gateway improvement part.3
2021-11-19 09:29:51 +08:00
47851c2430
fix(authz): fix badmatch when reading certs
2021-11-18 14:36:59 +08:00
e361cd5733
Fix dashboard APIs return ( #6177 )
...
* fix(dashboard_api): delete non-exist user wrongly return 204
* fix(dashboard): dashboard user should use `tags` not `tag`
* fix(dashboard): create/update user return 200 with full users list
* fix(dashboard): logout status code 204
* fix(dashboard): update pwd status code 204
* test: test suite for dashboard APIs
* refactor(dashboard): user info mnesia record name use description
* style: make elvis happy
* fix(api): dashboard swagger check request should not override env
* fix(dashboard): add/modify dashboard returns single record
* ci: update emqx-fvt version to new tag 1.0.2-dev1
2021-11-18 14:36:12 +08:00
53b51e31f0
fix(api_schema): add authn mongo missing fields
2021-11-18 12:41:40 +08:00
33f5eec802
feat: set keepalive via http api ( #6171 )
...
* feat: set keepalive via http api
* fix: make cluster_rpc test case solider
2021-11-18 10:56:58 +08:00
8d653b6d39
Merge pull request #6173 from zmstone/refactor-retainer-use-ordered-set
...
[5.0] refactor(retainer): use ordered_set Mnesia table type
2021-11-18 00:28:57 +01:00
e52d8138bf
test(persistent_session_SUITE): fix another flaky test
...
Make sure that the connection process dies before terminating the
snabbkaffe trace.
2021-11-17 14:04:06 +01:00
5914b8ad3d
Fix flaky tests for persistent sessions ( #6202 )
...
* test(persistent_session_SUITE): remove redundant sleep and trap_exits
* test(persistent_session_SUITE): fix race for started snabbkaffe
Sometimes snabbkaffe was not started when publishing from a different
process. Wrap the publishing code in a ?check_trace to make sure it is
started, and make sure the publish process is truly down before ending
the trace.
* test(persistent_session_SUITE): fix takeover race
Make sure the previous session is unregistered before trying to
connect again. Sometimes the new session was trying to take over the
session that was shutting down still.
2021-11-17 18:55:11 +08:00
7950e26774
Merge pull request #6193 from tigercl/feat/mongo-srv-5.0
...
feat(mongo srv): support srv record for mongo connector
2021-11-17 15:42:01 +08:00
ad2dbb5a49
chore(gw-sn): append messge headers
2021-11-17 14:51:27 +08:00
04c204374a
chore: All placeholders are placed in the same header file ( #6190 )
...
* chore: All placeholders are placed in the same header file
* feat: Separate placeholders from the rules engine
2021-11-17 14:40:48 +08:00
a7a5e2d1f4
fix: can't get default key if all key if default ( #6181 )
2021-11-17 14:27:51 +08:00
57075902a3
fix(mgmt_api): kickout non-existing clientid should return code `404` ( #6180 )
2021-11-17 12:29:27 +08:00
f8a625a67f
feat(mongo srv): support srv record for mongo connector
2021-11-17 12:12:30 +08:00
d0bdf27e0c
chore: fix elvis warnings
2021-11-17 11:04:09 +08:00
7c48bcabed
fixt: generate api ( #6124 )
...
* fix: generate api
* fix: banned suite
* fix: generate api bad rpc
* fix: bad message suite
* fix: create banned with check existed
2021-11-17 10:55:48 +08:00
f23d2f2c92
chore: refine case side-effect
2021-11-17 10:46:46 +08:00
814e01c0cb
test(authz): deps on emqx_conf instead of meck emqx_schema
2021-11-17 10:46:38 +08:00
ae5792fa64
chore(emqx_cm): remove unused tracepoints
2021-11-16 14:37:15 +01:00
c9b86a8375
test: make testcases not rely on timer:sleep
2021-11-16 13:50:01 +01:00
05f3bc8c90
fix(emqx_cm): make takeover session less likely to hit a race
2021-11-16 13:49:45 +01:00
c0e388e52a
style: make elvis happy
2021-11-16 19:35:35 +08:00
ac693c0dcb
refactor(retainer): use ordered_set Mnesia table type
...
ordered_set is compatible to set in all the existing APIs
and in addition, it provides a more deterministic traversing
cursor in case we want to change the current dirty_select
based "select ALL" implementation
2021-11-16 12:33:59 +01:00
1dc0a2e8b5
fix(mgmt_api): kickout non-existing clientid should return code `404`
2021-11-16 17:32:12 +08:00
883c1b2e59
chore(gw): remove needless lines
2021-11-16 10:00:54 +08:00
cf1d98adc6
chore(gw): save cert files
2021-11-16 10:00:54 +08:00
5a08fa6a03
docs(gw): add gateway comment
2021-11-16 10:00:54 +08:00
1f067d6f3b
docs(gw): add docs for gateway schema
2021-11-16 10:00:54 +08:00
bc3f3b4c55
test(gw): more robust testing
2021-11-16 10:00:53 +08:00
287859fe36
chore(gw): integrate emqx-conf
2021-11-16 09:58:37 +08:00
0b36b73ee1
fix(emqx_conf): fix badmatch for returned error value
2021-11-16 09:58:37 +08:00
cf17a55079
chore(gw): rename cm-registry shard name
2021-11-16 09:58:37 +08:00
c05ecdbcb8
fix(api): DELETE success wrongly returned code 200 ( #6135 )
2021-11-16 09:28:57 +08:00
ff23e9dde1
test: sync with emqx_cm process before flushing emqx_pool
2021-11-15 22:27:16 +01:00
a113b9b65d
chore: fix elvis warnings
2021-11-15 22:26:46 +01:00
9e333ac8b3
fix(emqx_cm): fix typos
2021-11-15 22:26:46 +01:00
dd771c5568
fix(emqx_mgmt_cli): idempontent kick. now it always returns ok
2021-11-15 22:26:46 +01:00
7e2ca9e287
fix(session): force kill session for 'kick' and 'discard'
...
Prior to this fix, 'kick' and 'discard' calls may timeout (or
fail for other reason), failures lead to only a log, then
continue to allow the new session to get registered.
As a result, in case a client is stuck, there is no way to
force it to step down, end up with multiple connections (sessions)
for the client ID in dashboard.
After this fix, the stale pids are notified to shutdown
via a gen_server:call, and forced with a exit(Pid, kill) for any
exception happend to the gen_server:call
2021-11-15 22:26:46 +01:00
650905667b
Merge pull request #6172 from JimMoen/fix-emqx_cm-ct
...
test: add tasks flushing in emqx_cm cases
2021-11-15 17:17:27 +01:00
cf80aaacc3
test: add tasks flushing in emqx_cm cases
2021-11-15 20:40:43 +08:00
9761fe2f6d
Merge pull request #6009 from tigercl/fix/authn
...
fix(authn): fix handling of query result
2021-11-15 13:32:56 +01:00
dcc5ae0642
test: API return code section
2021-11-15 16:30:44 +08:00
b3f9220d02
style: make elvis happy
2021-11-15 16:30:44 +08:00
106aa559e0
fix(api): DELETE success wrongly returned code 200
2021-11-15 16:30:44 +08:00
59e6b6ee5b
test(cm): add sleep time for multicore scheduling ( #6164 )
2021-11-15 15:43:26 +08:00
1476accd63
fix: monitor bad mnesia write & rpc call ( #6060 )
2021-11-15 15:28:19 +08:00
01f29ab052
chore(swagger): lwm2m2 http api to hocon ( #6153 )
2021-11-15 15:08:50 +08:00
5a928ad8c3
test(cm): add sleep time for multicore scheduling
2021-11-15 13:52:15 +08:00
f0107868d4
fix: test suite stable ( #6136 )
...
* fix: test suite stable
2021-11-12 10:53:30 +08:00
9b17757ae8
style: make elvis happy
2021-11-12 09:29:26 +08:00
37cdd429b2
fix(api): remove sessionID from client information
2021-11-12 09:29:26 +08:00
bc6e49804f
feat: support CORS request
...
feat: support CORS request
2021-11-11 20:27:39 +08:00
7a5da76197
Mgmt http api banned ( #5998 )
...
* fix(swagger): don't transform [log,publish] to a list.pwd
* chore: replace banned-api by hocon schema
* fix(api): code style warning
2021-11-11 16:35:29 +08:00
a65597e302
Authz api mnesia refactor ( #6082 )
...
* refactor(authz): macro move to hrl and rename, add meta example
* refactor(authz_api_mnesia): use config schemas for request validations
* chore(authz_api_mnesia): suite module typerefl fit
* chore(style): authz_api_mnesia style format
2021-11-11 16:29:36 +08:00
b96a106463
style: make elvis happy
2021-11-10 22:54:58 +01:00
9c1972020c
test: fix flaky test emqx_stomp_SUITE:t_rest_clienit_inf
2021-11-10 22:51:18 +01:00
4f0311b6f8
Merge pull request #6093 from savonarola/add-authn-tests
...
chore(authn mnesia): reimplement emqx_authn_mnesia provider tests
2021-11-10 21:20:46 +03:00
a0a88e23b0
chore(authn mnesia): reimplement emqx_authn_mnesia provider tests
2021-11-10 17:13:04 +03:00
60d5017eea
style(elvis): fix elvis style complaints
2021-11-10 11:12:10 -03:00
8fe342a02d
feat(stats): track live channel / client count
...
Track connected client count
In order to correctly display the number of _connected_ clients in our
monitor dashboard, we need to track those connections that are
actually connected to clients, not considering connections from
persistent sessions that are disconnected. Today, the
`connections.count` that is displayed in the dashboards considers
those disconnected persistent sessions as well.
The new statistics can be found in the
[`emqx_management`](https://github.com/emqx/emqx/tree/main-v4.4/apps/emqx_management )
plugin, under `/api/v4/stats`, in the keys
`live_connections.{max,count}`.
2021-11-10 11:12:10 -03:00
e8f6035c34
feat(emqx_lwm2m): add some lwm2m api ( #6047 )
2021-11-10 14:20:33 +08:00
2d159ad9a1
fix(test): flaky mqtt expiry test case. ( #6099 )
2021-11-10 09:55:36 +08:00
ac23214447
fix(api): config api on sepcific node ( #6100 )
...
* fix(api): config api on sepcific node
* chore(style): code style for elvis checking
2021-11-10 09:38:45 +08:00
eea789451b
feat: sha3_256 dashboard account's password ( #6084 )
2021-11-09 15:41:28 +08:00
0f8ad29e91
Merge pull request #6078 from savonarola/auth-api-schema-examples
...
refactor(authn api): add more schema examples
2021-11-08 19:44:02 +03:00
b873b92717
fix(test): cluster_rpc retry interval incorrect ( #6038 )
2021-11-08 23:23:17 +08:00
5726444645
Merge pull request #6066 from k32/remove-nosuspend-5
...
fix(emqx_connection): Add backpressure to TCP connections
2021-11-08 13:39:38 +01:00
a84b84aac9
refactor(authn api): reformat for elvis compliance
2021-11-05 19:36:26 +03:00
1e036bf74d
refactor(authn api): add more schema examples
2021-11-05 16:12:14 +03:00
3b02366a5b
Merge pull request #6064 from zmstone/style-check-newline-at-eof
...
Style: check newline at EOF
2021-11-04 18:01:45 +01:00
0a5a9bd7d0
fix(emqx_connection): Add backpressure to TCP connections
...
Fixes #5494
2021-11-04 16:24:47 +01:00
d1abb30818
ci: fix elvis check
2021-11-04 15:27:10 +01:00
56e2a9741f
style: ensure newline at EOF for all files
2021-11-04 14:40:14 +01:00
48ddd056b5
test(authn): add test cases for authn
2021-11-04 10:03:34 +08:00
ca4bb100ec
fix(authn): fix bad parsing for postgresql SQL
2021-11-04 10:01:54 +08:00
aed9ad3f7d
Merge pull request #6037 from savonarola/fix-authn-api-atom-leak
...
fix(authn api): eliminate possible atom leak
2021-11-03 23:17:47 +03:00
a139a0d453
fix(config): pin hocon 0.20.6
...
fix translation error
2021-11-03 11:15:35 +01:00
89cd68d36f
refactor(persistent_sessions): fix coding style
2021-11-02 09:33:54 +01:00
8385eff98e
fix(persistent_sessions): we only need to persist if the session expired
2021-11-02 09:27:50 +01:00
b7ed649185
test(persistent_session): wait in test to avoid race
2021-11-01 14:56:10 +01:00
796553b5ea
fix(authn api): eliminate possible atom leak
2021-11-01 16:51:48 +03:00
ce49a281ed
fix(persistent_sessions): protect against looking up stale data
2021-11-01 14:21:01 +01:00
329dd4d780
test(persistent_session): try to fix flaky snabbkaffe failure
2021-11-01 14:21:01 +01:00
1f13a6caad
chore(persistent_sessions): tune mnesia parameters for better dump behavior
2021-11-01 14:21:01 +01:00
ec68d7fc58
test(persistent_sessions): stabilize flaky tests
2021-11-01 14:21:01 +01:00
7ae6e04582
fix(persistent_sessions): channels can terminate without a session
2021-11-01 14:21:01 +01:00
29fb9b3361
fix(authn): fix bad type of hash
2021-11-01 18:49:13 +08:00
800b4b32c7
refactor(authn api): use config schemas for request validations ( #5999 )
2021-11-01 17:52:03 +08:00
d9cb0283f3
fix(alarm): duration unit in dashboard, microsecond => millisecond
2021-10-29 16:48:13 +08:00
c64637ca39
test(authn): add test case of version checking
2021-10-29 14:18:25 +08:00
966348db05
fix(authn): fix version switching error when updating multiple times
2021-10-29 10:12:29 +08:00
e62fde321c
Emqx alarm ( #5994 )
...
* chore(alarm): normalize_message outside emqx_alarm
* chore(alarm): don't cache config in emqx_alarm; remove dirty_write/read; add desc/example to alarm; add more test
* chore(alarm_api): alarm_api with hocon schema
* fix: activted's nullable is true
* fix(swagger): translate map to object
* fix(cluster_rpc): debug failed cluster_rpc test
* fix: Update schema description
Co-authored-by: Zaiming (Stone) Shi <zmstone@gmail.com>
Co-authored-by: Zaiming (Stone) Shi <zmstone@gmail.com>
2021-10-28 18:03:51 +08:00
2c69c00906
Merge pull request #6010 from qzhuyan/perf/William/pool-worker-pickup
...
During the benchmark test of ehttpc, we found the gproc's random pool or round-robin pool doesn't scale well.
This PR makes emqx prefer to use the hash pool.
changed:
retainer pool: from random to hash
connector : from random to hash (default)
bridge : from random to hash (default)
authn_http : from random to hash (example)
unchanged:
worker pool type: hash
broker pool type: hash
resource type: hash
exproto type: hash
dashboard type: hash
2021-10-28 09:40:14 +02:00
48c7788d6f
Merge pull request #5875 from emqx/extend-persistent-sessions
...
Extend persistent sessions
2021-10-27 09:12:13 +02:00
a712daaebc
fix(authn): fix bad list comprehension
2021-10-27 15:08:02 +08:00
5e6dab435a
perf(pool): authz http example pool_type to hash
2021-10-27 08:48:41 +02:00
9c8cd6c437
perf(pool): change emqx_connector default pool type to hash
2021-10-27 08:47:02 +02:00
34979c51d7
perf(config): emqx_bridge default hash pool
2021-10-27 08:45:13 +02:00
1c93331e34
perf(pool): emqx_authn_http pool type hash
2021-10-27 08:43:34 +02:00
edc1581b4b
perf(pool): change emqx_retainer_pool type to hash
2021-10-27 08:26:02 +02:00
7311132d49
fix(authn): fix handling of query result
2021-10-27 09:22:17 +08:00
4dbe3ccf71
refactor(dashboard): rename 'password' field to 'pwdhash' ( #5990 )
...
* refactor(dashboard): rename 'password' field to 'pwdhash'
rename as it is not plaintext password stored in db
* refactor(emqx_dashboard): rename records
* test(emqx_dashboard_token): add test case to cover match specs
2021-10-26 20:41:33 +08:00
99836b2660
fix(persistent_sessions): add back the trap_exit
2021-10-26 10:52:27 +02:00
4a07d5e1f3
refactor(paginate): use exported fun call `{M,F}`
2021-10-26 16:16:37 +08:00
3683ba13ee
fix(authn): users pagination on spec listener_id and authn_id
2021-10-26 16:16:37 +08:00
eb452bd237
feat(authn_scram): authn_scram users page query
2021-10-26 16:16:37 +08:00
0bd5cd9336
feat(authn): authn users page query
2021-10-26 16:16:37 +08:00
a399ac20e9
fix(authn): api description using binary string
2021-10-26 16:16:37 +08:00
558416af1d
chore(persistent_sessions): remove redundant trap_exit flag
2021-10-26 10:01:02 +02:00
28417ad1d7
fix(persistent_sessions): allow for some failures of workers
2021-10-26 09:55:57 +02:00
234641ccf4
refactor(persistent_sessions): don't start session sup when disabled
2021-10-26 09:54:41 +02:00
e3dc9b3f4f
fix(persistent_sessions): start the message gc timer
2021-10-26 09:53:49 +02:00
f39ccfb304
chore(persistent_sessions): address review comments
2021-10-26 09:53:18 +02:00
c5142a6d11
fix(authz): add license headers
2021-10-26 14:30:39 +08:00
f44bda806a
chore(authz): fix test suite page params
2021-10-26 14:02:19 +08:00
be6ba14ddf
fix(authz): authz rules page query
2021-10-26 14:02:19 +08:00
b36865e970
fix(api): escape the searching string
2021-10-26 10:34:03 +08:00
666b319729
Merge pull request #5989 from zmstone/refactor-ssl-certs-lib
...
refactor(tls): move ssl files handling to emqx_tls_lib
2021-10-25 12:42:29 +02:00
a0e77d22b0
fix: typo in apps/emqx_authz/src/emqx_authz.erl
...
Co-authored-by: Rory Z <Rory-Z@outlook.com>
2021-10-25 08:57:44 +02:00
3c2292e74f
chore(authz): add more test case
2021-10-25 13:43:28 +08:00
a2da746bf9
chore(authz): implement create_dry_run in other function clause
...
Signed-off-by: zhanghongtong <rory-z@outlook.com>
2021-10-25 13:43:28 +08:00
2307bdd868
fix(emqx_resource): fix InstId type error
2021-10-25 13:43:28 +08:00
198ae4c782
fix(authz): fix configuration could be updated with incorrect values
...
when updating the configuration, first check with emqx_resouce:create_dry_run/2
Signed-off-by: zhanghongtong <rory-z@outlook.com>
2021-10-25 13:43:28 +08:00
0d53ea9db7
Merge pull request #5974 from tigercl/fix/mysql-query
...
fix(authn): fix sql parse for mysql
2021-10-25 10:38:15 +08:00
a7413bc11e
fix(authn): save certificates to certs dir
2021-10-24 16:21:57 +02:00
71d2e6bebd
refactor(authz): call emqx_tls_lib to save & read SSL files
2021-10-24 10:44:47 +02:00
a7771afd9d
refactor(tls): move ssl files handling to emqx_tls_lib
...
This is an attempt ot make it more generic for other APPs to use.
Aslo added test cases to cover most of the code paths.
2021-10-23 18:20:38 +02:00
d0950b9b9d
fix(emqx_telemetry): add default value to get_value
2021-10-23 00:24:07 +08:00
bdeb1685e0
Merge pull request #5977 from zmstone/chore-pin-hocon-0.20.5
...
Pin hocon 0.20.5
2021-10-22 16:36:12 +02:00
90795a6f42
Rewrite http api with hocon schema ( #5980 )
...
* feat: rewrite http api with hocon
* fix: crash when default_username is empty
* chore: udpate rewrite api with emqx_conf's cluster_rpc
* fix: spec wrong
2021-10-22 17:01:29 +08:00
0937c81632
test: fix emqx_config_SUITE
2021-10-22 09:45:01 +02:00
64787f4ccd
test(persistent_session): fix bad guard
2021-10-22 01:03:08 +02:00
10de564abf
test(persistent_sessions): test websocket connection
2021-10-22 00:46:58 +02:00
aa6053291e
fix(schema): add roots for emqx_zone_schema
...
emqx_zone_schema is never used at root level, but for config doc
generation, it needs the roots.
2021-10-21 23:11:02 +02:00
b03b0717ce
docs: authenticator_config ref link to the struct
2021-10-21 23:11:02 +02:00
f9b211cce6
chore: pin hocon 0.20.5
...
for two changes:
default string values are filled with binary() instead of [integer()]
better reference links in config document
2021-10-21 23:09:51 +02:00
9188f5b67e
fix(persistent_sessions): postpone table creation until configs are loaded
2021-10-21 15:23:22 +02:00
fe4d14303c
fix(persistent_session): fix rebase error
2021-10-21 15:23:22 +02:00
ec429857e0
refactor(persistent_sessions): code format changes after review
2021-10-21 15:23:21 +02:00
655d31726a
feat(persistent_session): add early removal of delivered message
2021-10-21 15:23:21 +02:00
b9b8111edb
test: add new proper types to #session{} after rebase
2021-10-21 15:23:21 +02:00
fd71bc50ab
fix(persistent_session): Make sure to discard expired sessions on reconnect
2021-10-21 15:23:21 +02:00
f2d26f5e03
test(persistent_sessions): Remove bogus stopping of quicer
2021-10-21 15:23:21 +02:00
12639addb9
fix(persistent_session): Make sure the connection processs is dead
2021-10-21 15:23:21 +02:00
ed0f435546
chore(persistent_sessions): correct copyright information in new files
2021-10-21 15:23:21 +02:00
fdba441f4f
fix(persistent_sessions): revert bogus table type change
2021-10-21 15:23:21 +02:00
7808ffe600
fix(persistent_sessions): protect (un)subscribe from calling session router
2021-10-21 15:23:21 +02:00
7b394267dd
feat: persistent sessions stored in mnesia
...
* Persistent sessions can survive node/connection process down
* Internal SessionID is generated, external ClientID is as before
* Sessions are persisted to mnesia
* A session router is added in parallel to the ordinary router
* Messages that are subscribed to by a persistent session are
persisted by publisher
* Information about persisted and delivered messages are stored in
mnesia per session.
* A resume protocol similar to takeover is implemented for resuming
from mnesia
* Can be configured (and enabled) by the top lever config
"persistent_session_store"
2021-10-21 15:23:21 +02:00
fc7b4c0009
refactor: make it possible to use different tries
...
In preparation for persistent sessions
2021-10-21 15:23:21 +02:00
24e870672c
refactor: use set_session in preparation for persistent sessions
2021-10-21 15:23:21 +02:00
e37ecc10a6
style(behaviour attrs): unify behaviour declarations
2021-10-21 15:10:59 +03:00
d784e63b9f
emqx_conf ( #5939 )
...
* feat(emqx_conf): move conf manager for emqx_machine to emqx_conf
* chore(emqx_conf): change emqx:get_config/2 to emqx_conf:get/2
* fix: common test failed
* fix: badmatch by typo wrong key
* fix(emqx_conf): get the wrong core nodes
* fix(emqx_conf): get core node's tnx_id not latest tnx_id
* fix: add ro_transation when copy conf file
* fix: delete debug info
* fix: change ekka_rlog to mria_rlog
* fix: remove cluster_rpc from emqx_machine.
* fix: don't call ekka:start/0 explicitly
* fix: ekka should be start in emqx_machine
2021-10-21 18:08:51 +08:00
7fdcca587a
fix(authn): fix handling of pgsql response
2021-10-21 17:41:16 +08:00
Zaiming (Stone) Shi