016ae0524f
fix(aeh_producer): remove timestamp template field
...
Fixes https://emqx.atlassian.net/browse/EMQX-10847
Checking the whole Kafka message from AEH, it seems like the timestamp type is append,
which means that it’s the broker who controls the timestamp, and the timestamp defined by
the producer is ignored.
Ref: https://kafka.apache.org/documentation/#brokerconfigs_log.message.timestamp.type
Example message consumed from AEH:
```
%{
"headers" => %{},
"key" => "",
"offset" => 4,
"topic" => "test0",
"ts" => 1692879703006,
"ts_type" => "append",
"value" => "{\"username\":\"undefined\",\"topic\":\"t/aeh/produ\",\"timestamp\":1692879692189,\"qos\":0,\"publish_received_at\":1692879692189,\"pub_props\":{\"User-Property\":{}},\"peerhost\":\"undefined\",\"payload\":\"aaaa\",\"node\":\"emqx@127.0.0.1\",\"metadata\":{\"rule_id\":\"rule_aehp\"},\"id\":\"000603AA44B34E08F4AF000006E30003\",\"flags\":{},\"event\":\"message.publish\",\"clientid\":\"undefined\"}"
}
```
Note the ts_type above is append.
Example message from a Kafka broker whose ts type is create:
```
%{
"headers" => %{},
"key" => "",
"offset" => 4,
"topic" => "test-topic-three-partitions",
"ts" => 1692881883668,
"ts_type" => "create",
"value" => "{\"username\":\"undefined\",\"topic\":\"t/kafka/produ\",\"timestamp\":1692881883668,\"qos\":0,\"publish_received_at\":1692881883668,\"pub_props\":{\"User-Property\":{}},\"peerhost\":\"undefined\",\"payload\":\"aaaaaa\",\"node\":\"emqx@127.0.0.1\",\"id\":\"000603AAC7529FEEF4AC000007050000\",\"flags\":{},\"event\":\"message.publish\",\"clientid\":\"undefined\"}"
}
```
Unfortunately, I couldn’t find anywhere in AEH where that configuration could be changed.
2023-08-24 14:20:42 -03:00
0381ac0410
fix(kafka_producer): use correct timestamp template field
...
Fixes https://emqx.atlassian.net/browse/EMQX-10847
2023-08-24 14:20:42 -03:00
3eb6ea2501
Merge pull request #11515 from kjellwinblad/kjell/release-51/v5.1.6
...
Changes for release of v5.1.6
2023-08-24 18:42:30 +02:00
aad9b1c27d
Merge pull request #11493 from kjellwinblad/kjell/fix/11488
...
fix: HTTP API /api/v5/publish schema
2023-08-24 17:46:29 +02:00
69dfc8e31d
Merge pull request #11505 from thalesmg/docker-eee-r52-20230823
...
ci(test_docker): export enterprise image with elixir for testing
2023-08-24 12:17:47 -03:00
237d1ae255
docs: Generate changelog for v5.1.6
2023-08-24 16:51:51 +02:00
fa6a98e2a3
chore: fix format of file to pass format check
2023-08-24 16:50:35 +02:00
9fe5080705
build: bump versions before release
2023-08-24 16:46:27 +02:00
c215fe3736
fix: stop otel deps appication before reboot
2023-08-24 22:14:14 +08:00
60e6217496
fix(kafka): fix result handling when sending message with invalid header
...
Fixes https://emqx.atlassian.net/browse/EMQX-10846
2023-08-24 10:41:42 -03:00
0037295c83
ci(test_docker): export enterprise image with elixir for testing
2023-08-24 10:27:25 -03:00
e5041de9cc
fix(gcp_consumer): handle 401 errors
...
Fixes https://emqx.atlassian.net/browse/EMQX-10852
2023-08-24 09:03:34 -03:00
62423b0b12
refactor(topic_index): less special handling for leading $ words
2023-08-24 13:30:10 +02:00
a30d87e14f
refactor(topic_index): remove more unnecessary next calls
...
also avoid using records (setelement) for recursive return values
2023-08-24 12:25:04 +02:00
a1e6635614
refactor(topic_index): no forced ceiling entry in index table
2023-08-24 12:25:04 +02:00
f4c8c6be55
refactor(topic_index): optimize trie-search performance
2023-08-24 12:25:04 +02:00
6b152b3cb7
test: add more debug output
2023-08-24 12:25:04 +02:00
ae094e363c
chore: fix a typo in log message
2023-08-24 12:25:04 +02:00
6085442958
fix(ldap): expose request_timeout to prevent infinite hang
2023-08-24 16:50:38 +08:00
467f60805f
Merge pull request #11499 from SergeTupchiy/EMQX-10390-mnesia-hook-fix-upgrade-otp
...
chore: bump OTP to 25.3.2-2 and EMQX builder to 5.1-4
2023-08-24 11:13:05 +03:00
a00e25ceb4
Merge pull request #11511 from id/0824-ci-use-stable-name-for-checks
...
ci: use more sensible name for checks
2023-08-24 09:12:48 +02:00
7adbf319b1
ci: use more sensible name for checks
2023-08-24 08:21:06 +02:00
2322b27542
Merge pull request #11497 from zhongwencool/prometheus-metrics
...
Prometheus metrics
2023-08-24 12:06:32 +08:00
f00395b237
Merge pull request #11466 from zhongwencool/hocon-converter-not-running
...
fix: hocon converter not working when make_serializable is true
2023-08-24 10:00:16 +08:00
8d2be27ade
chore: add changlog for 11466
2023-08-24 06:46:50 +08:00
84dd3b83bb
fix: hocon converter not working when make_serializable is true(check_plain)
2023-08-24 06:46:47 +08:00
f72ba6819f
Merge pull request #11498 from zhongwencool/fix-otel-stop-error-log
...
fix: stop otel deps application in terminate crashed
2023-08-24 06:40:24 +08:00
bac0f7107c
chore: bump OTP to 25.3.2-2 and EMQX builder to 5.1-4
2023-08-23 19:35:36 +03:00
e421c963dc
Merge pull request #11502 from savonarola/0823-fix-pytest-retry
...
chore(ci): pin pytest-retry version
2023-08-23 19:31:16 +03:00
3aa15556a9
Merge pull request #11504 from savonarola/0823-fix-pytest-retry-release-52
...
chore(ci): pin pytest-retry version
2023-08-23 18:44:07 +03:00
92a293a67b
chore(ci): pin pytest-retry version
2023-08-23 17:34:15 +03:00
44b080f5b3
chore(ci): pin pytest-retry version
2023-08-23 17:33:24 +03:00
bc460b8887
Merge pull request #11496 from zhongwencool/erlang-prometheus-collector-disabled-default
...
feat: disabled the Erlang VM Prometheus exporter by default
2023-08-23 17:09:07 +08:00
d287b736ec
chore: add changelog for 11497
2023-08-23 17:02:30 +08:00
58be7f709b
fix: stop otel deps application in terminate crashed
2023-08-23 16:45:41 +08:00
6bb15541c7
feat: rename olp metrics to overload_protection metrics
2023-08-23 15:25:54 +08:00
b9a97923c4
feat: add some authz/connection missing metrics
2023-08-23 14:47:53 +08:00
141676185d
feat: add authentication metrics to prometheus
2023-08-23 14:15:16 +08:00
4928c69758
feat: add authorization metrics to prometheus
2023-08-23 14:11:59 +08:00
df9f8da178
feat: add overload_protection metrics to prometheus
2023-08-23 14:07:37 +08:00
188a81913e
test: add prometheus api test
2023-08-23 11:23:43 +08:00
ae10415fc3
feat: disabled the Erlang VM Prometheus exporter by default to improve performance and security
2023-08-23 09:03:22 +08:00
61536b5362
Merge pull request #11494 from paulozulato/fix-kinesis-validators
...
fix(kinesis): set validators for static constraints
2023-08-22 18:28:35 -03:00
8700aab570
Merge pull request #11492 from thalesmg/fix-greptime-syntax-parse-r52-20230822
...
fix(greptimedb_bridge): avoid double-parsing write syntax during probe and remove code duplication
2023-08-22 16:17:06 -03:00
20b46091f9
fix(kinesis): set validators for static constraints
...
Fixes https://emqx.atlassian.net/browse/EMQX-10833
2023-08-22 14:42:44 -03:00
f007b44426
fix(data_import): rm duplicate import call and fix test
2023-08-22 13:29:15 -03:00
ee2897e5de
test(refactor): move test to integration tests dir
2023-08-22 13:29:15 -03:00
c1f49abad2
test: fix inter-suite flakiness
2023-08-22 13:29:15 -03:00
dad27091be
test: rm custom option
2023-08-22 13:29:15 -03:00
dbfacae283
fix: reinstate transactions
2023-08-22 13:29:15 -03:00
Thales Macedo Garitezi