64341fdc23
fix(swagger): remote api_secret field form api_key api
2021-12-09 17:57:57 +08:00
98be2e15b1
Merge pull request #6405 from k32/sysmon
...
feat(system_monitor): Add system_monitor application
2021-12-09 10:22:40 +01:00
0614c157ec
fix(elvis): elvis warning
2021-12-09 16:42:10 +08:00
cf11f3f8ee
feat(api-key): support api_key/secret
2021-12-09 16:42:10 +08:00
159ba63530
chore: upgrade grpc-erl to 0.6.4
2021-12-09 15:06:18 +08:00
5d4604701c
chore: fix elvis warnings
2021-12-09 15:06:18 +08:00
34cc8cc7f5
chore: put the pool_size default value to avoid hot upgrade failure
2021-12-09 15:06:18 +08:00
e7ccd88719
test(props): cover messages headers
2021-12-09 15:06:18 +08:00
f132d09483
chore(exhook): parse pool_size
2021-12-09 15:06:18 +08:00
143c685452
feat(exhook): expose process pool_size for grpc client
2021-12-09 15:06:18 +08:00
2b7c311807
chore: upgrade grpc to 0.6.4
2021-12-09 15:06:18 +08:00
262fb13a71
chore(exhook): fix diaylzer warnings
2021-12-09 15:06:17 +08:00
20ba9d285f
feat(exhook): expose headers for on_messages_publish hook
2021-12-09 15:06:17 +08:00
f25c8cdf0f
Merge pull request #6410 from lafirest/fix/lw_cmd_record
...
fix(emqx_lwm2m): limit the max size of cmd record
2021-12-09 14:57:01 +08:00
e662628581
chore(gw): fix bad default value in query-string
2021-12-09 14:50:28 +08:00
c9cbaeff95
fix(emqx_lwm2m): limit the max size of cmd record
2021-12-09 14:39:11 +08:00
028f1fa71c
chore(gw): fix listener examples
2021-12-09 11:33:09 +08:00
f7941cd2bb
Merge pull request #6387 from terry-xiaoyu/improve_connector_apis
...
Improve bridge and connector APIs
2021-12-09 10:54:55 +08:00
7aa08a82d5
Merge pull request #6283 from DDDHuang/as_doc_example
...
fix: add auto subscription swagger example
2021-12-09 10:35:08 +08:00
1c9d867c5e
chore(authz): add test for authz backend creation dry run
2021-12-08 21:38:10 +03:00
b7d227d2ef
chore(authz): move file backend to a separate module
2021-12-08 21:38:10 +03:00
056558e445
chore(authz): encapsulate authz backend logic
2021-12-08 21:38:10 +03:00
2b5fe9179e
fix(live_conn): fix live connection count on race condition (5.0)
...
Port from #6406 to 5.0.
When multiple clients try to connect concurrently using the same
client ID, they all call `emqx_channel:ensure_connected`, increasing
the live connection count, but only one will successfully acquire the
lock for that client ID. This means that all other clients that
increased the live connection count will not get to call neither
`emqx_channel:ensure_disconnected` nor be monitored for `DOWN`
messages, effectively causing a count leak.
By moving the increment to `emqx_cm:register_channel`, which is only
called inside the lock, we can remove this leakage.
Also, during the handling of `DOWN` messages, we now iterate over all
channel PIDs returned by `eqmx_misc:drain_down`, since it could be
that one or more PIDs are not contained in the `pmon` state.
2021-12-08 15:15:27 -03:00
9fbc247e29
feat(system_monitor): Add system_monitor application
2021-12-08 16:34:10 +01:00
d76f82d3d2
fix(bridges): add new option 'enable' for bridge configs
2021-12-08 18:16:38 +08:00
afb2cf19c2
Merge pull request #6297 from HJianBo/gw-improve-apis-2
...
Standardize HTTP-APIs return value and Status/Error Code
2021-12-08 18:02:13 +08:00
92f116afa4
Merge pull request #6393 from emqx/fix-takeover-race-on-enqueued-messages
2021-12-08 11:00:46 +01:00
7c261b5356
chore(gw): improve examples for _gateway_api
2021-12-08 17:18:39 +08:00
e48f10d2d6
chore(gw): ignore needless args
2021-12-08 11:33:11 +08:00
a937a3d4dc
chore(gw): fix bad argument type
2021-12-08 11:13:00 +08:00
0eff5358ca
chore(gw): add examples for gw&client api
2021-12-08 10:52:27 +08:00
2b0a3e8ba3
refactor(authn): unify password hashing
2021-12-07 23:38:26 +03:00
9276a5bc3c
Merge pull request #6394 from zmstone/fix-typo-in-hook-point-name
...
fix: typo takeovered -> takenover
2021-12-07 21:06:30 +01:00
14bef1ba31
refactor: make clauses safe for future reordering
2021-12-07 16:14:32 +01:00
5440b431a1
fix: typo takeovered -> takenover
2021-12-07 16:06:23 +01:00
e6ecc6ca60
fix(emqx_channel): fix race condition in session takeover
...
Sessions must not enqueue messages when another process is taking over
the client id, since it already passed on the message queue in the
session state.
Without this fix, messages arriving after `{takeover, 'begin'} to a
channel with no connection (i.e., a persistent session) would be lost.
2021-12-07 14:17:59 +01:00
12fbcd8181
feat(connector): add num_of_bridges to the response of GET /connectors
2021-12-07 15:09:08 +08:00
098d8eacb7
fix(metrics): update testcases for plugin_libs_metrics
2021-12-07 10:12:04 +08:00
cc96880f18
fix(dialyzer): some dialyzer issue
2021-12-07 09:56:57 +08:00
6903997b94
feat(connector): add new option 'mode' to mqtt connectors
2021-12-07 09:56:57 +08:00
9b4fe87ed0
fix(bridges): update testcases for bridge APIs
2021-12-07 09:56:57 +08:00
e1794fbce6
fix(connector): create different schema for POST,PUT,GET methods
2021-12-07 09:56:57 +08:00
56d46c80eb
refactor(rule): generate swagger from hocon schema for /bridges
2021-12-07 09:56:57 +08:00
affe69afd6
fix(rules): update the test cases for rule APIs
2021-12-07 09:48:47 +08:00
416b9f8d7c
refactor(rule): generate swagger from hocon schema for /rules
2021-12-07 09:48:47 +08:00
24bded99d5
refactor(metrics): rename speed to rate in emqx_plugin_libs_metrics
2021-12-07 09:47:53 +08:00
e07fce791f
feat(connector): add examples to the swagger doc
2021-12-07 09:47:53 +08:00
4eef9a5bac
Merge pull request #6378 from emqx/fix-flaky-tests-persistent-session-SUITE
...
test(flaky_tests): fix persistent_session_SUITE
2021-12-06 14:01:34 +01:00
b6dede3679
Merge pull request #6372 from emqx/fix-typo-listeners
...
fix(listeners): fix typo in listener type
`emqx_listeners:{current,max}_conns` were matching on type `tcl`.
However, this type doesn't exist (it's not defined in
`?TYPES_STRING`). Therefore, this clause would never match. It seems
that the intention was that it shouldbe `tcp`.
2021-12-06 09:06:54 -03:00
6ed3dbd39b
test(persistent_session_SUITE): protect against non-atom sinks
2021-12-06 12:40:58 +01:00
2d46ae7517
fix(typo): fix more typos and restore rate_limit config after test
2021-12-06 08:14:50 -03:00
e62b094f3b
test(snabbkaffe): Update to latest snabbkaffe
...
In particular, this should remove the flaky snabbkaffe failures in
persistent session SUITE where the snabbkaffe_nemesis is trying to
make an ets:lookup in a table that no longer exists.
2021-12-06 11:22:25 +01:00
a6a1b288d2
Merge pull request #6365 from JimMoen/fix-vm-mem-info
...
fix(vm_mem): info calc and display
2021-12-06 17:47:52 +08:00
366c757959
test(flaky_tests): fix persistent_session_SUITE
...
Increase timeout on message receive and ensure more info when the test fails.
2021-12-06 10:42:19 +01:00
b0b2adca37
Merge pull request #6377 from DDDHuang/alram_api_info
...
fix(alarm): alarm message with .2f format
2021-12-06 17:42:02 +08:00
d735e2e755
chore: delete 500 error
2021-12-06 16:34:00 +08:00
f1dbeb4bda
chore: fix bad result match
2021-12-06 16:34:00 +08:00
dab3e14686
fix(gw): fix static checking
2021-12-06 16:34:00 +08:00
7f04837ad2
fix(gw): fix elvis warnings
2021-12-06 16:34:00 +08:00
3f35604d16
refactor(gw): fix gateway http api schema
2021-12-06 16:34:00 +08:00
f3f3f12635
refactor: improve the _api_clieints implement
2021-12-06 16:33:59 +08:00
01c50992e9
refactor: improve gw api
2021-12-06 16:33:38 +08:00
169848c027
feat(gw): return the created/updated resource info
2021-12-06 16:32:46 +08:00
bc012d6554
chore(gw): change lwm2m&coap api path
2021-12-06 16:30:59 +08:00
68a7c096b0
Merge pull request #6362 from zmstone/emqx-config-put-raw-with-env-vars
...
fix: config put raw with env vars
2021-12-06 09:22:32 +01:00
fbe66cb9f2
Merge pull request #6351 from zhongwencool/prometheus-accept-header
...
chore(HTTP): prometheus or json format by accept header
2021-12-06 16:12:54 +08:00
1ae1460e44
Merge pull request #6364 from HJianBo/stop_publish_clear_msg_for_5
...
Allow to stop publish clear message
2021-12-06 16:06:38 +08:00
a1ad6098b3
build: generate document to dashboard priv dir
2021-12-06 08:52:10 +01:00
96de7e6b30
docs: refine authn and auth config docs
2021-12-06 08:00:42 +01:00
ed073f9966
test: fix emqx_rewrite_SUITE with new path info in schema check failure
2021-12-06 08:00:42 +01:00
e774e976a7
fix: ensure atom connector is loaded when emqx_conf_schema is loaded
2021-12-06 08:00:42 +01:00
89614245f6
test: use macro for authentication root name
2021-12-06 08:00:42 +01:00
a1f79850b4
refactor: allow accessing override config paths
2021-12-06 08:00:42 +01:00
a723e41390
test: fix a flaky test which gets interfered by other test cases
2021-12-06 08:00:42 +01:00
5525cb3262
refactor: only apply environment variables on base config
2021-12-06 08:00:42 +01:00
a681079ba7
refactor: remove special env override from schema
...
EMQX_NODE_NAME and EMQX_NODE_COOKIE are translated into
EMQX_NODE__NAME and EMQX_NODE__COOKIE
2021-12-06 08:00:42 +01:00
d9a980c7e1
docs: fix config doc, avoid using <text> in doc body
2021-12-06 08:00:42 +01:00
e6e28f9002
docs: fix emqx_schema doc style
2021-12-06 08:00:42 +01:00
bfc36efa0e
fix: pin hocon 0.21.1
2021-12-06 08:00:37 +01:00
1b0da3cc58
fix(alarm): alarm message with .2f format
2021-12-06 14:36:51 +08:00
9e8b4ab237
Merge pull request #6298 from tigercl/feat/cluster-authn
...
feat(authn): support sync configuration in the cluster
2021-12-06 10:04:48 +08:00
867cc3c4ad
test: ensure emqx_connector is loaded
2021-12-04 09:33:14 +01:00
5d3cb6ae1c
refactor(authn): align authn config root name
...
authn configs are checked independently per-auth provider,
this was to make authn providers more plugable.
in order to make environment variable overrides work for authn,
we need to have a unified view of the config layout,
no matter from root level, or partially checking per-provider
config independently, i.e. we try to use the same config envelop.
2021-12-04 09:33:14 +01:00
bc8a0d7060
fix(listeners): fix typo in listener type
...
`emqx_listeners:{current,max}_conns` were matching on type `tcl`.
However, this type doesn't exist (it's not defined in
`?TYPES_STRING`). Therefore, this clause would never match. It seems
that the intention was that it shouldbe `tcp`.
2021-12-03 15:55:51 -03:00
dfa45c909a
fix(crash_dump): Fix hocon schema related to the erlang crash dump
2021-12-03 18:45:45 +01:00
fd9f6bd140
fix(crash_dump): Replace crash dump directory with a file
2021-12-03 18:18:24 +01:00
954179b959
Merge pull request #6370 from k32/perf
...
chore(mria): Bump version to 0.1.4
2021-12-03 17:39:21 +01:00
2ceb660344
chore(mria): Bump version to 0.1.4
2021-12-03 17:13:12 +01:00
1dfc37cd18
test(authn): fix test cases
2021-12-03 15:55:34 +08:00
f645a4eada
test(retainer): add test case for stopping publish clear msg
2021-12-03 14:42:27 +08:00
4b3b29873a
feat(retainer): allow to stop publish clear msg
2021-12-03 14:41:42 +08:00
d4246ad2f6
fix(vm): add literal_alloc memory calculation
2021-12-03 14:41:33 +08:00
a7cd1ad30b
fix(mgmt): node memory usage info
2021-12-03 14:41:33 +08:00
e1bcbd012c
feat(authn): support sync configuration in the cluster
2021-12-03 14:14:40 +08:00
85a6f0f1e8
Merge pull request #6350 from zhongwencool/emqx-conf
...
feat: support eqmx_ctl cluster_call command.
2021-12-03 11:27:21 +08:00
858891dbf5
fix: rewrite ct badmatch
2021-12-03 09:54:44 +08:00
f6c61189c4
chore(HTTP): prometheus or json format by accept header
2021-12-02 10:30:50 +08:00
a58493f7a4
test(authz): fix test suite for schema check and app start
2021-12-02 10:12:10 +08:00
effa3b8b90
style: make elvis happy
2021-12-02 10:12:10 +08:00
d7ec368884
fix(authz): fix mongo resources create
2021-12-02 10:12:10 +08:00
68af284570
fix(authz): http source create and update
2021-12-02 10:12:10 +08:00
e7a7d64004
feat(conf): skip/fast_forward tnx_id via cluster_call cli
2021-12-02 09:30:27 +08:00
b983a18cdf
fix(auth): replace query with cmd
2021-12-01 20:24:43 +08:00
c1a7d7bede
fix(conf): emqx_conf return nest error
2021-12-01 16:08:49 +08:00
25c4f4aa4e
Merge pull request #6339 from zhongwencool/swagger-ct-test
...
chore(swagger): add test for sub fields
2021-12-01 14:12:14 +08:00
e888e1ef8d
Merge pull request #6338 from tigercl/fix/superuser
...
fix(authn): fix superuser when missing is_superuser_field
2021-12-01 14:00:56 +08:00
1f6e2e7397
chore: add test for sub fields
2021-12-01 12:01:44 +08:00
6b8997cbda
fix(authn): fix superuser when missing is_superuser_field
2021-12-01 09:23:36 +08:00
d2fa0a71f4
refactor: give psk auth a better namespace
2021-12-01 00:33:20 +01:00
a92970a904
feat(mria): Add RPC-related configuration to the schema
2021-11-30 21:59:59 +01:00
6b65151f69
Merge pull request #6325 from savonarola/test-authn-resources-scram
...
chore(authn): add SCRAM mechanism tests
2021-11-30 12:16:20 +03:00
e196f8150d
Merge pull request #6329 from lafirest/fix/event
...
fix(emqx_gateway): fix the function_clause error when client disconne…
2021-11-30 16:52:11 +08:00
cfe2954a88
fix(emqx_gateway): fix the function_clause error when client disconnect after connection created
2021-11-30 12:25:06 +08:00
36cece7a49
Merge pull request #6314 from JimMoen/fix-re-escape
...
fix(authz): placehodler regular escape
2021-11-30 10:21:28 +08:00
e6d7e59c18
Merge pull request #6278 from savonarola/test-authn-resources-mongo
...
chore(authn): add MongoDB backend tests
2021-11-29 22:27:52 +03:00
4941b4d1a0
Merge pull request #6316 from savonarola/test-authn-resources-jwt
...
chore(authn): add JWKS backend tests
2021-11-29 22:03:41 +03:00
0baec8e27d
chore(authn): unify Mongo type parameter naming
2021-11-29 21:39:28 +03:00
390575eafb
chore(authn): add MongoDB backend tests
2021-11-29 21:17:56 +03:00
4580c03ebc
chore(authn): add SCRAM mechanism tests
2021-11-29 20:49:45 +03:00
581cb6ac5d
Merge pull request #6268 from HJianBo/reduce-case-logs
...
test(gw): reduce useless log print
2021-11-29 11:03:40 +08:00
726e25d6ae
chore(authn): add JWKS backend tests
2021-11-26 18:40:21 +03:00
284619ef86
Merge pull request #6310 from emqx/test-fix-possible-flakiness
...
test(flakiness): prevent possible flakiness in test
If the spawned process doesn't have enough time to be properly set up,
the returned stacktrace may be empty, making the test fail. By
synchronizing the startup, we know that the process will have a proper
stacktrace by the time of the assertion.
2021-11-26 08:09:05 -03:00
759b03a6ad
Merge pull request #6306 from savonarola/ct-output
...
chore(ct): remove verbose output during tests
2021-11-26 12:54:21 +03:00
1d3558ebe0
style: make elvis happy
2021-11-26 17:46:38 +08:00
f697028b70
Fix ping not return pong ( #6285 )
...
* fix: ./bin/emqx ping return pong
* chore: waiting longer for logger flush log to disk
* fix: change swagger page's limit from 100 to 1000
* chore: type wrong
* fix: sync log to disk by logger_disk_log_h:filesync
2021-11-26 17:02:45 +08:00
b41c41570a
fix(authz): placehodler regular escape
2021-11-26 15:39:42 +08:00
124ba7a071
Merge pull request #6311 from emqx/release-5.0-beta.2
...
Sync bug fixes
2021-11-26 14:24:19 +08:00
12d8ebcc15
Merge pull request #6303 from tigercl/fix/authn-jwt
...
fix(authn): fix jwt authn
2021-11-26 13:36:01 +08:00
349fd1608b
style(authn): improve code formatting
2021-11-26 10:29:57 +08:00
d6288a0b70
test(flakiness): prevent possible flakiness in test
...
If the spawned process doesn't have enough time to be properly set up,
the returned stacktrace may be empty, making the test fail. By
synchronizing the startup, we know that the process will have a proper
stacktrace by the time of the assertion.
2021-11-25 17:15:07 -03:00
ea0fa24ce5
chore(ct): remove verbose output during tests
2021-11-25 18:30:50 +03:00
e6c2600718
chore(authn): add HTTP backend tests
2021-11-25 15:09:13 +03:00
ecd3c9f85c
test(authn): add test cases for jwt authn
2021-11-25 19:03:11 +08:00
15654b5b28
fix(authn): add handling of invalid secret
2021-11-25 17:17:44 +08:00
d88bfdfe14
fix(authn): verify claims type is wrong
2021-11-25 16:42:08 +08:00
f74e34b6a5
fix(conf): change `max_topic_levels` default configuration
2021-11-25 10:11:24 +08:00
db3f7ff749
feat(sys_mon): remove `current_function`
...
Since we now output `current_stacktrace`, `current_function` is now
redundant.
2021-11-24 12:16:16 -03:00
a41d0d49bd
test(impossible_case): remove impossible case test
...
Since `emqx_vm:get_process_info/1` only accepts PIDs as arguments,
it's impossible for `emqx_sys_mon:procinfo/1` to return after
receiving the atom `undefined`.
2021-11-24 11:34:36 -03:00
75a17431d5
feat(sys_mon): Add proc_lib:initial_call/1 and current_stacktrace
...
This adds the information from `proc_lib:initial_call/1` and the
current stacktrace from the process info to `emqx_sys_mon:procinfo/1`
to aid in debugging some warnings with no context such as the
following:
```
2021-11-23T12:33:59.387818+00:00 [warning] info: [{old_heap_block_size,45988046},{heap_block_size,22177879},{mbuf_size,0},{stack_size,40},{old_heap_size,22354134},{heap_size,7106339}], line: 130, mfa: emqx_sys_mon:handle_info/2, msg: large_heap, procinfo: [{pid,<0.2667.0>},{memory,579763664},{total_heap_size,68510672},{heap_size,22177879},{stack_size,40},{min_heap_size,233},{initial_call,{proc_lib,init_p,5}},{current_function,{gen,do_call,4}},{registered_name,[]},{status,running},{message_queue_len,360945},{group_leader,<0.1660.0>},{priority,normal},{trap_exit,false},{reductions,16493271},{last_calls,false},{catchlevel,4},{trace,0},{suspending,[]},{sequential_trace_token,[]},{error_handler,error_handler}]
```
2021-11-24 11:24:27 -03:00
3400a3b978
Merge pull request #6288 from savonarola/handle-authn-backends-own-validations
...
fix(authn): handle authn backends own validations
2021-11-24 15:18:11 +03:00
ac3707e4a9
fix(authn): handle authn backends own validations
2021-11-24 14:05:46 +03:00
fb6ab93f47
fix(dialyzer): fix redundant cases
2021-11-24 18:21:08 +08:00
261ca3d625
fix(connector): fix crash in health checking of mongo connection
2021-11-24 16:48:35 +08:00
793da3d039
fix: add auto subscription swagger example
2021-11-24 16:47:33 +08:00
ca89a8da61
Merge pull request #6274 from emqx/persistent-sessions-ram-backend
...
feat(persistent_sessions): add choice between ram or disc backends in…
2021-11-24 09:25:14 +01:00
d7c7292321
fix(authz): placeholder regular replace
2021-11-24 11:10:30 +08:00
9f04ac5bfd
Merge pull request #6269 from savonarola/test-authn-resources-mysql-pgsql
...
chore(authn): add MySQL & PostgreSQL backend tests
2021-11-23 20:03:52 +03:00
fda2e86187
Merge pull request #6107 from Spycsh/slog
...
chore: refactor slog under emqx, conf and exhook
2021-11-23 16:39:06 +01:00
9a97a7a1c7
chore(persistent_session): remove quotes around boolean in config
2021-11-23 16:24:40 +01:00
df2dda2e10
chore(persistent_session): make more table creation parameterized
2021-11-23 16:23:47 +01:00
zhongwencool