Commit Graph

768 Commits

Author SHA1 Message Date
Vincent Bernat
a9bef1c3fc tests: extend Diff() helper to accept new options 2022-08-31 14:30:08 +02:00
Vincent Bernat
c3d2fc64f8 helpers/mapstructure: turn panic while decoding to an error message
While there is more helpful information in a panic, this is confusing
to the user. With the amount of code using reflection, it seems better
to have clearer messages to help the user find the faulty section if
any.
2022-08-30 20:32:45 +02:00
Vincent Bernat
8eab4277c6 inlet/snmp: fix parsing of inlet.snmp.communities as a string
Fix #116
2022-08-30 20:08:39 +02:00
Vincent Bernat
e775ddff0a inlet/snmp: remove debug code 2022-08-30 15:44:47 +02:00
Vincent Bernat
9b7891429b inlet/flow: fix retry logic for sampling rate test 2022-08-30 14:59:04 +02:00
Vincent Bernat
a8d2d88df4 inlet/flow: for sampling rate test, estimate again on retry 2022-08-30 08:34:12 +02:00
Vincent Bernat
ff5d50db43 inlet/flow: retry rate limiting test a few times 2022-08-30 08:02:06 +02:00
dependabot[bot]
edd431cede build: bump vue-router from 4.1.4 to 4.1.5 in /console/frontend
Bumps [vue-router](https://github.com/vuejs/router) from 4.1.4 to 4.1.5.
- [Release notes](https://github.com/vuejs/router/releases)
- [Commits](https://github.com/vuejs/router/compare/v4.1.4...v4.1.5)

---
updated-dependencies:
- dependency-name: vue-router
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
2022-08-30 00:16:25 +02:00
dependabot[bot]
8ee8280cac build: bump @vueuse/core from 9.1.0 to 9.1.1 in /console/frontend
Bumps [@vueuse/core](https://github.com/vueuse/vueuse/tree/HEAD/packages/core) from 9.1.0 to 9.1.1.
- [Release notes](https://github.com/vueuse/vueuse/releases)
- [Commits](https://github.com/vueuse/vueuse/commits/v9.1.1/packages/core)

---
updated-dependencies:
- dependency-name: "@vueuse/core"
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
2022-08-30 00:15:47 +02:00
dependabot[bot]
8cda7c0de2 build: bump eslint-plugin-vue from 9.3.0 to 9.4.0 in /console/frontend
Bumps [eslint-plugin-vue](https://github.com/vuejs/eslint-plugin-vue) from 9.3.0 to 9.4.0.
- [Release notes](https://github.com/vuejs/eslint-plugin-vue/releases)
- [Commits](https://github.com/vuejs/eslint-plugin-vue/compare/v9.3.0...v9.4.0)

---
updated-dependencies:
- dependency-name: eslint-plugin-vue
  dependency-type: direct:development
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
2022-08-30 00:11:11 +02:00
dependabot[bot]
e0f2a21c0e build: bump @vueuse/router from 9.1.0 to 9.1.1 in /console/frontend
Bumps [@vueuse/router](https://github.com/vueuse/vueuse/tree/HEAD/packages/router) from 9.1.0 to 9.1.1.
- [Release notes](https://github.com/vueuse/vueuse/releases)
- [Commits](https://github.com/vueuse/vueuse/commits/v9.1.1/packages/router)

---
updated-dependencies:
- dependency-name: "@vueuse/router"
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
2022-08-30 00:10:53 +02:00
dependabot[bot]
849b9b5779 build: bump eslint from 8.22.0 to 8.23.0 in /console/frontend
Bumps [eslint](https://github.com/eslint/eslint) from 8.22.0 to 8.23.0.
- [Release notes](https://github.com/eslint/eslint/releases)
- [Changelog](https://github.com/eslint/eslint/blob/main/CHANGELOG.md)
- [Commits](https://github.com/eslint/eslint/compare/v8.22.0...v8.23.0)

---
updated-dependencies:
- dependency-name: eslint
  dependency-type: direct:development
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
2022-08-30 00:10:25 +02:00
dependabot[bot]
e556ab8db3 build: bump github.com/rs/zerolog from 1.27.0 to 1.28.0
Bumps [github.com/rs/zerolog](https://github.com/rs/zerolog) from 1.27.0 to 1.28.0.
- [Release notes](https://github.com/rs/zerolog/releases)
- [Commits](https://github.com/rs/zerolog/compare/v1.27.0...v1.28.0)

---
updated-dependencies:
- dependency-name: github.com/rs/zerolog
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
2022-08-30 00:09:59 +02:00
dependabot[bot]
c58748c73f build: bump @codemirror/view from 6.2.0 to 6.2.1 in /console/frontend
Bumps [@codemirror/view](https://github.com/codemirror/view) from 6.2.0 to 6.2.1.
- [Release notes](https://github.com/codemirror/view/releases)
- [Changelog](https://github.com/codemirror/view/blob/main/CHANGELOG.md)
- [Commits](https://github.com/codemirror/view/compare/6.2.0...6.2.1)

---
updated-dependencies:
- dependency-name: "@codemirror/view"
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
2022-08-30 00:04:09 +02:00
Vincent Bernat
41744ff7ad inlet/flow: be more lenient on the test about sampling rate 2022-08-28 00:11:04 +02:00
Vincent Bernat
a2c1a848b9 inlet/snmp: fix configuration parsing for inlet.snmp.ports 2022-08-27 23:51:23 +02:00
Vincent Bernat
b45fb45393 docs: mention Kafka retention.bytes is per-partition 2022-08-27 08:16:14 +02:00
Vincent Bernat
6bfd3a0bd0 inlet/snmp: use netip.Addr internally instead of string
Also, make SubnetMap use `netip.Addr` as well.
2022-08-27 08:13:57 +02:00
Vincent Bernat
7e3fc03c11 inlet/snmp: add inlet.snmp.ports to configure SNMP port to use
Fix #103
2022-08-27 07:19:40 +02:00
Vincent Bernat
e9144c7657 conntrackfixer: make it work with older versions of Docker daemon
Fix #104
2022-08-27 07:03:25 +02:00
Vincent Bernat
74ba5b1dac build: update flake.nix to use Go 1.19 2022-08-24 10:50:15 +02:00
Vincent Bernat
88ad9b11ec docs: add a word about validation "improvements" in changelog 2022-08-24 10:14:04 +02:00
Vincent Bernat
8552465bac inlet/flow: make "max flows/s" test more lenient 2022-08-24 10:10:37 +02:00
Vincent Bernat
e93b57034c orchestrator/clickhouse: fix Networks field validation 2022-08-24 10:10:22 +02:00
Vincent Bernat
743c98a78f cmd/config: better validation
With maps and slices, we need to explicitely use `dive` to validate
the inner structs.
2022-08-24 00:34:24 +02:00
Vincent Bernat
0dca0fc4af inlet/flow: fix validation of inlet.flow.rate-limit v1.5.7 2022-08-24 00:01:35 +02:00
Vincent Bernat
27668fa492 build: prepare for release 2022-08-23 23:53:08 +02:00
Vincent Bernat
506c15800a inlet/flow: add a per-exporter flow rate-limiter
This is useful if we cannot tune the sampling rate of the source
equipment and it is too high for us. The sampling rate is adapted.
This is difficult to test, so hopefully, this is correct!
2022-08-23 20:47:19 +02:00
Vincent Bernat
47a87db796 docs: fix default resolutions in documentation 2022-08-23 11:28:25 +02:00
Vincent Bernat
625571fa92 docs: add a few tips for space usage 2022-08-23 10:43:43 +02:00
Vincent Bernat
844396a9d9 inlet/flow: remove unused code in test
We do not test received flows here because flow parsing testing is
done otherwhere.
2022-08-23 08:32:03 +02:00
dependabot[bot]
8ca0f5f97a build: bump @codemirror/commands in /console/frontend
Bumps [@codemirror/commands](https://github.com/codemirror/commands) from 6.0.1 to 6.1.0.
- [Release notes](https://github.com/codemirror/commands/releases)
- [Changelog](https://github.com/codemirror/commands/blob/main/CHANGELOG.md)
- [Commits](https://github.com/codemirror/commands/compare/6.0.1...6.1.0)

---
updated-dependencies:
- dependency-name: "@codemirror/commands"
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
2022-08-23 00:14:06 +02:00
dependabot[bot]
0ad98f241b build: bump vue-router from 4.1.3 to 4.1.4 in /console/frontend
Bumps [vue-router](https://github.com/vuejs/router) from 4.1.3 to 4.1.4.
- [Release notes](https://github.com/vuejs/router/releases)
- [Commits](https://github.com/vuejs/router/compare/v4.1.3...v4.1.4)

---
updated-dependencies:
- dependency-name: vue-router
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
2022-08-23 00:13:39 +02:00
dependabot[bot]
774f12b122 build: bump github.com/ClickHouse/clickhouse-go/v2 from 2.2.0 to 2.3.0
Bumps [github.com/ClickHouse/clickhouse-go/v2](https://github.com/ClickHouse/clickhouse-go) from 2.2.0 to 2.3.0.
- [Release notes](https://github.com/ClickHouse/clickhouse-go/releases)
- [Changelog](https://github.com/ClickHouse/clickhouse-go/blob/main/v1_v2_CHANGES.md)
- [Commits](https://github.com/ClickHouse/clickhouse-go/compare/v2.2.0...v2.3.0)

---
updated-dependencies:
- dependency-name: github.com/ClickHouse/clickhouse-go/v2
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
2022-08-23 00:10:56 +02:00
dependabot[bot]
c9afe92791 build: bump vite from 3.0.7 to 3.0.9 in /console/frontend
Bumps [vite](https://github.com/vitejs/vite/tree/HEAD/packages/vite) from 3.0.7 to 3.0.9.
- [Release notes](https://github.com/vitejs/vite/releases)
- [Changelog](https://github.com/vitejs/vite/blob/main/packages/vite/CHANGELOG.md)
- [Commits](https://github.com/vitejs/vite/commits/v3.0.9/packages/vite)

---
updated-dependencies:
- dependency-name: vite
  dependency-type: direct:development
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
2022-08-23 00:08:11 +02:00
Vincent Bernat
1aed86a439 inlet/geoip: use low-level maxminddb-golang to query GeoIP database
The higher-level geoip2-golang will decode far more records when
requesting for a country. This takes time and since we do that for
each packet, this is costly. Half of the CPU time of the inlet is
spent looking up into this database. This should improve performance
quite a bit.
2022-08-22 22:09:53 +02:00
Vincent Bernat
c4199110e6 docs: mention docker-compose restart 2022-08-22 21:40:34 +02:00
Vincent Bernat
d9d3e8023a http: do not restrict LocalAddr() to tests
It is also used to let the orchestrator knows its own address.
2022-08-21 14:51:08 +02:00
Vincent Bernat
3e3bcbdada http: use a method to get local address
And limit its export to testing.
2022-08-21 08:20:14 +02:00
Vincent Bernat
18ee3eac6f build: switch to Go 1.19
This enables us to use atomic.Pointer!
2022-08-19 17:46:49 +02:00
Vincent Bernat
93e5bf6065 inlet/snmp: use a map to convert text to priv/auth protocol 2022-08-18 10:59:38 +02:00
Vincent Bernat
2daed3d5d4 inlet/core: replace ignore-asn-from-flow by asn-providers
This will be useful once we get an additional source for AS numbers,
notably BGP.
2022-08-17 23:25:37 +02:00
Vincent Bernat
9ee4554a7d cmd: add even more tests against configuration 2022-08-17 19:49:45 +02:00
Vincent Bernat
dbb191b267 doc: also mention change about previous period line in changelog 2022-08-16 23:16:13 +02:00
Vincent Bernat
d2f9e9a115 doc: mention one additional bugfix for 1.5.6 v1.5.6 2022-08-16 21:27:24 +02:00
Vincent Bernat
096b08a1e3 build: prepare for release 2022-08-16 21:22:26 +02:00
Vincent Bernat
c41fa8cb55 common/helpers: opt-in for custom formatters for diff
Many stuff has a `String()` method that would hide details.
2022-08-16 21:21:22 +02:00
Vincent Bernat
f9b507ff35 common/helpers: add a helper to test configuration decoding
For each case, we test from native map and from YAML. This should
capture all the cases we are interested.

Also, simplify pretty diff by using stringer for everything. I don't
remember why this wasn't the case. Maybe IP addresses? It's possible
to opt out by overriding formatters.
2022-08-16 21:15:23 +02:00
Vincent Bernat
86be453440 inlet/snmp: fix default-community conversion when config comes from YAML
YAML unmarshal keys as interface. All this is a bit fragile. There
should be a way to test more.
2022-08-16 20:28:08 +02:00
Vincent Bernat
b4a29fab0e cmd: test orchestrator configuration
This should help catching bugs like the one fixed by the latest
commit.
2022-08-16 19:43:28 +02:00