Commit Graph

702 Commits

Author SHA1 Message Date
Vincent Bernat
67fa164b45 build: also reset cache for Linux 2022-07-19 08:13:51 +02:00
Vincent Bernat
6e8d86b753 build: reset bin cache when building
For some reason, the latest commit had no effect.

```
Run actions/cache@v3
  with:
    path: bin
    key: Linux-gobin-c15ba10654923ac92ea1283181e691ac48f702a5b13860f427e6854acdbc2b0f
  env:
    CI_AKVORADO_FUNCTIONAL_TESTS: true
```
2022-07-19 08:08:18 +02:00
Vincent Bernat
f985fff834 build: restore bin only for matching go version 2022-07-19 08:02:01 +02:00
Vincent Bernat
254fb15bcf inlet/udp: explain a bit more the various socket options 2022-07-18 22:46:55 +02:00
Vincent Bernat
56e42539e9 inlet/udp: drop extraneous call to fmt.Println 2022-07-18 22:44:29 +02:00
Vincent Bernat
50112ded57 inlet/udp: ask the kernel to timestamp incoming packets
With very large receive buffer, we may process many packets in burst
and not account for the real receive time. The kernel is able to
provide us with a timestamp, use it. We ask for hardware timestamps if
possible.
2022-07-18 22:43:01 +02:00
Vincent Bernat
c465ceb206 build: exclude generated files from coverage 2022-07-18 21:40:36 +02:00
Vincent Bernat
5e96712de9 orchestrator/clickhouse: do not load old Kafka tables when executing tests
Instead of ignoring them as a result, ignore them when loading them.
This also speeds test up as dropping these tables can take time when
there are several of them (for some reason). This should be safe as we
have no code trying to interact with them.
2022-07-18 20:59:36 +02:00
Vincent Bernat
f0a4438539 docker-compose: add a service to clean conntrack entries
When the inlet container starts, there is a race condition between the
moment Docker sets up a competing listening socket on the host to
ensure the port is free and the moment it sets up the NAT rules. If
packets are received during this interval, a conntrack entry is
created and the NAT rule is ignored. These entries need to be flushed.
Docker tries to do that but is not very successful. The service watch
docker events and flush the needed conntrack entries when the
container starts.
2022-07-18 20:40:53 +02:00
Vincent Bernat
301c1f4757 inlet/flow: version flow message names as well
ClickHouse do not like to have several proto files with the same
message name. We also put a version in the message name to solve this.
We use a hack to have this invisble from Go (struct FlowMessage
instead of struct FlowMessagevX). This works because the descriptor is
already encoded (and contains FlowMessagevX). Moreover, FlowMessage
"v1" is still FlowMessage as it will be in use when users will
upgrade. FlowMessagev0 was never used in a released version, so we
don't care.
2022-07-18 15:48:11 +02:00
Vincent Bernat
83f54d94cc build: cancel latest release 2022-07-18 12:01:18 +02:00
Vincent Bernat
ca33c695b3 build: prepare for release 2022-07-18 11:37:09 +02:00
Vincent Bernat
02dc9401e2 orchestrator: add more attributes to classify networks
Like for exporters, we add role, site, region, and tenant. This time,
this is done in ClickHouse.
2022-07-18 11:34:56 +02:00
dependabot[bot]
f8ee5fe97d build: bump @vitejs/plugin-vue from 3.0.0 to 3.0.1 in /console/frontend
Bumps [@vitejs/plugin-vue](https://github.com/vitejs/vite/tree/HEAD/packages/plugin-vue) from 3.0.0 to 3.0.1.
- [Release notes](https://github.com/vitejs/vite/releases)
- [Changelog](https://github.com/vitejs/vite/blob/main/packages/plugin-vue/CHANGELOG.md)
- [Commits](https://github.com/vitejs/vite/commits/v3.0.1/packages/plugin-vue)

---
updated-dependencies:
- dependency-name: "@vitejs/plugin-vue"
  dependency-type: direct:development
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
2022-07-18 11:23:36 +02:00
dependabot[bot]
00d55aa49a build: bump @vueuse/core from 8.9.3 to 8.9.4 in /console/frontend
Bumps [@vueuse/core](https://github.com/vueuse/vueuse/tree/HEAD/packages/core) from 8.9.3 to 8.9.4.
- [Release notes](https://github.com/vueuse/vueuse/releases)
- [Commits](https://github.com/vueuse/vueuse/commits/v8.9.4/packages/core)

---
updated-dependencies:
- dependency-name: "@vueuse/core"
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
2022-07-18 11:23:19 +02:00
dependabot[bot]
329d1c0454 build: bump @vueuse/router from 8.9.3 to 8.9.4 in /console/frontend
Bumps [@vueuse/router](https://github.com/vueuse/vueuse/tree/HEAD/packages/router) from 8.9.3 to 8.9.4.
- [Release notes](https://github.com/vueuse/vueuse/releases)
- [Commits](https://github.com/vueuse/vueuse/commits/v8.9.4/packages/router)

---
updated-dependencies:
- dependency-name: "@vueuse/router"
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
2022-07-18 11:23:06 +02:00
dependabot[bot]
922f7a7dd9 build: bump eslint from 8.19.0 to 8.20.0 in /console/frontend
Bumps [eslint](https://github.com/eslint/eslint) from 8.19.0 to 8.20.0.
- [Release notes](https://github.com/eslint/eslint/releases)
- [Changelog](https://github.com/eslint/eslint/blob/main/CHANGELOG.md)
- [Commits](https://github.com/eslint/eslint/compare/v8.19.0...v8.20.0)

---
updated-dependencies:
- dependency-name: eslint
  dependency-type: direct:development
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
2022-07-18 11:22:40 +02:00
dependabot[bot]
1f33731219 build: bump vite from 3.0.0 to 3.0.1 in /console/frontend
Bumps [vite](https://github.com/vitejs/vite/tree/HEAD/packages/vite) from 3.0.0 to 3.0.1.
- [Release notes](https://github.com/vitejs/vite/releases)
- [Changelog](https://github.com/vitejs/vite/blob/main/packages/vite/CHANGELOG.md)
- [Commits](https://github.com/vitejs/vite/commits/v3.0.1/packages/vite)

---
updated-dependencies:
- dependency-name: vite
  dependency-type: direct:development
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
2022-07-18 11:22:17 +02:00
dependabot[bot]
eb60aba549 build: bump docker/metadata-action from 3 to 4
Bumps [docker/metadata-action](https://github.com/docker/metadata-action) from 3 to 4.
- [Release notes](https://github.com/docker/metadata-action/releases)
- [Upgrade guide](https://github.com/docker/metadata-action/blob/master/UPGRADE.md)
- [Commits](https://github.com/docker/metadata-action/compare/v3...v4)

---
updated-dependencies:
- dependency-name: docker/metadata-action
  dependency-type: direct:production
  update-type: version-update:semver-major
...

Signed-off-by: dependabot[bot] <support@github.com>
2022-07-18 11:20:27 +02:00
dependabot[bot]
77caa1fbcd build: bump actions/download-artifact from 2 to 3
Bumps [actions/download-artifact](https://github.com/actions/download-artifact) from 2 to 3.
- [Release notes](https://github.com/actions/download-artifact/releases)
- [Commits](https://github.com/actions/download-artifact/compare/v2...v3)

---
updated-dependencies:
- dependency-name: actions/download-artifact
  dependency-type: direct:production
  update-type: version-update:semver-major
...

Signed-off-by: dependabot[bot] <support@github.com>
2022-07-18 11:19:43 +02:00
Vincent Bernat
716276e843 build: create directory for ClickHouse mocks 2022-07-18 11:10:40 +02:00
Vincent Bernat
ce4b31ac12 build: keep dependabot message prefix below 15 characters 2022-07-18 11:06:52 +02:00
Vincent Bernat
d3e8dd233e build: fix dependabot configuration file 2022-07-18 11:04:22 +02:00
Vincent Bernat
fe4030ca45 build: do not rely on ex either
This is a bit of a nightmare tool. Different versions accepting
different flags (nvi vs vim) and when something is wrong, you are
stuck into some interactive/not really interactive tool.
2022-07-18 11:04:22 +02:00
Vincent Bernat
1e147704c7 inlet: classify exporters to group, role, site, region, and tenant
Previously, this was done only for groups. Encoding everything into
groups is a bit restrictive. The same should be done for IP networks.
2022-07-18 11:01:30 +02:00
Vincent Bernat
2e6ede700b doc: mention that SNMP is required for Akvorado to work 2022-07-18 09:25:22 +02:00
Vincent Bernat
096972ba45 build: enable dependabot 2022-07-17 22:49:30 +02:00
Vincent Bernat
f86f0d6bb1 build: add names for each CI job 2022-07-17 16:19:18 +02:00
Vincent Bernat
9aaf724b13 inlet/snmp: really fix validation for cache-check-interval 2022-07-17 16:05:26 +02:00
Vincent Bernat
795f5e2ade build: ensure clean remove old flow schemas 2022-07-17 16:04:05 +02:00
Vincent Bernat
0fd281963e inlet/snmp: fix validation string for cache-check-interval 2022-07-17 13:36:03 +02:00
Vincent Bernat
b222235b85 doc: remove logo
This is silly. It's on the screenshot just below. I was going to fix
it with:

<img src="console/frontend/src/assets/images/akvorado.svg" style="float: left; padding: 0 3% 3% 0;" width="100">
2022-07-17 11:11:13 +02:00
Vincent Bernat
aa568437c1 doc: add Akvorado logo 2022-07-17 11:07:27 +02:00
Vincent Bernat
e963a4f899 doc: add a warning about future plans 2022-07-17 11:03:51 +02:00
Vincent Bernat
14145e35f7 doc: update future plans
See https://twitter.com/taktv6/status/1548583801873485826 for context.
2022-07-17 10:58:45 +02:00
Vincent Bernat
f285114278 orchestrator/clickhouse: cap the number of consumers
ClickHouse does not allow more consumers than the number of physical
CPUs. Unless configured otherwise, the number of threads match the
number of physical CPUs. We bound the number of consumers to this
number.

Fix #13
2022-07-17 00:49:05 +02:00
Vincent Bernat
d17ba347ad doc: add more troubleshooting tips 2022-07-17 00:31:59 +02:00
Vincent Bernat
a80064c3b4 build: install vim to get ex on Alpine Linux 2022-07-16 21:25:41 +02:00
Vincent Bernat
13e8c65bfb inlet/flow: make it compile on MacOS 2022-07-16 21:15:17 +02:00
Vincent Bernat
e6a10f7627 build: make sed invocations compatible with MacOS 2022-07-16 21:15:17 +02:00
Vincent Bernat
c23f840f30 build: display messages about linting/formatting before doing it 2022-07-16 19:44:01 +02:00
Vincent Bernat
19a4210c91 build: make linting/format work on MacOS 2022-07-16 19:36:31 +02:00
Vincent Bernat
f859ef841f build: run fmt/lint on JS code also when code is changing
Otherwise, it was run only when node_modules was updated.
2022-07-16 19:25:21 +02:00
Vincent Bernat
1dec35f80f doc: update changelog for latest commit 2022-07-16 18:29:21 +02:00
Benjamin Collet
ef3b6dfc6b Convert InIfBoundary/OutIfBoundary from Enum8 to String to use as a dimension 2022-07-16 18:28:10 +02:00
Vincent Bernat
f6c70864a4 docker: add an UI for Kafka to help debug issues 2022-07-16 14:44:47 +02:00
Vincent Bernat
e1d587c00a build: do not build changelog.md by default
It is only useful in CI.
2022-07-16 09:23:28 +02:00
Vincent Bernat
ee23c8b503 doc: mention the version running for the demo 2022-07-16 09:21:49 +02:00
Vincent Bernat
74eadb55cb docker: avoid starting bogus "akvorado-image" service 2022-07-16 09:18:48 +02:00
Vincent Bernat
89e7109bfa doc: add documentation on how to configure IPFIX/sFlow on Juniper
Even if sFlow is not supported yet.
2022-07-16 09:12:47 +02:00