Commit Graph

1370 Commits

Author SHA1 Message Date
Vincent Bernat
e4b30ecea7 common/helpers: fix race condition when checking last access on expire 2023-02-01 12:03:58 +01:00
Vincent Bernat
680433eef2 console/frontend: fix time range selection 2023-02-01 11:46:13 +01:00
Vincent Bernat
67f9379c18 inlet/flow: restore setting TimeReceived on UDP/file receive
Most of the time, this is not in the hotpath as with UDP, we use the
time reported by the kernel.
2023-02-01 11:36:33 +01:00
Vincent Bernat
ddf47418b7 inlet/snmp: fix racy test (more) 2023-02-01 11:20:09 +01:00
Vincent Bernat
f7c5a15f95 inlet/snmp: fix race problem in test 2023-02-01 09:54:01 +01:00
Vincent Bernat
513e7d348c docs: don't get into too many code details in changelog 2023-02-01 09:11:49 +01:00
Vincent Bernat
61bcfa53b4 inlet/core: convert classifier cache to internal cache helper
This also reduce the amount of `time.Now()` to one per flow. Far lower
than it previously was. `time.Now()` should usually be quick, but on
some VM, it can be slow (100 times) due to a missing or dysfunctional
TSC.

We also modify the SNMP component to not rely on clock either (it must be
externally provided). Internally, it can still use the system clock (not
on the hot path).
2023-02-01 09:11:11 +01:00
Vincent Bernat
577e27f7d4 inlet/snmp: move cache to helpers
We will reuse this implementation for classifiers too.
2023-02-01 09:11:11 +01:00
dependabot[bot]
737d3da843 build: bump vue-echarts from 6.5.1 to 6.5.2 in /console/frontend
Bumps [vue-echarts](https://github.com/ecomfe/vue-echarts) from 6.5.1 to 6.5.2.
- [Release notes](https://github.com/ecomfe/vue-echarts/releases)
- [Changelog](https://github.com/ecomfe/vue-echarts/blob/main/CHANGELOG.md)
- [Commits](https://github.com/ecomfe/vue-echarts/compare/v6.5.1...v6.5.2)

---
updated-dependencies:
- dependency-name: vue-echarts
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
2023-01-31 14:04:17 +01:00
dependabot[bot]
f70f07dd8e build: bump typescript from 4.9.4 to 4.9.5 in /console/frontend
Bumps [typescript](https://github.com/Microsoft/TypeScript) from 4.9.4 to 4.9.5.
- [Release notes](https://github.com/Microsoft/TypeScript/releases)
- [Commits](https://github.com/Microsoft/TypeScript/commits)

---
updated-dependencies:
- dependency-name: typescript
  dependency-type: direct:development
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
2023-01-31 14:04:03 +01:00
dependabot[bot]
bfb51fa9f7 build: bump github.com/bits-and-blooms/bitset from 1.4.0 to 1.5.0 (#438) 2023-01-31 11:12:45 +00:00
dependabot[bot]
78ba1cbaf1 build: bump prettier-plugin-tailwindcss in /console/frontend (#443) 2023-01-31 10:55:46 +00:00
dependabot[bot]
2a0b7ff1e9 build: bump @vitest/coverage-c8 in /console/frontend (#444) 2023-01-31 10:55:36 +00:00
dependabot[bot]
128c1dcdff build: bump @headlessui/vue from 1.7.7 to 1.7.8 in /console/frontend (#442) 2023-01-31 10:55:25 +00:00
dependabot[bot]
feb0e6fc38 build: bump @vueuse/router from 9.11.1 to 9.12.0 in /console/frontend (#435) 2023-01-31 10:55:15 +00:00
dependabot[bot]
357f20858e build: bump eslint from 8.32.0 to 8.33.0 in /console/frontend (#437) 2023-01-31 10:55:02 +00:00
dependabot[bot]
8646d08e49 build: bump github.com/antonmedv/expr from 1.10.4 to 1.10.5
Bumps [github.com/antonmedv/expr](https://github.com/antonmedv/expr) from 1.10.4 to 1.10.5.
- [Release notes](https://github.com/antonmedv/expr/releases)
- [Commits](https://github.com/antonmedv/expr/compare/v1.10.4...v1.10.5)

---
updated-dependencies:
- dependency-name: github.com/antonmedv/expr
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
2023-01-31 11:54:47 +01:00
dependabot[bot]
9312a80a08 build: bump github.com/go-playground/validator/v10 (#439) 2023-01-31 10:54:30 +00:00
dependabot[bot]
c36a183ed0 build: bump github.com/rs/zerolog from 1.28.0 to 1.29.0
Bumps [github.com/rs/zerolog](https://github.com/rs/zerolog) from 1.28.0 to 1.29.0.
- [Release notes](https://github.com/rs/zerolog/releases)
- [Commits](https://github.com/rs/zerolog/compare/v1.28.0...v1.29.0)

---
updated-dependencies:
- dependency-name: github.com/rs/zerolog
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
2023-01-31 11:54:07 +01:00
dependabot[bot]
64fd274e87 build: bump @vueuse/core from 9.11.1 to 9.12.0 in /console/frontend
Bumps [@vueuse/core](https://github.com/vueuse/vueuse/tree/HEAD/packages/core) from 9.11.1 to 9.12.0.
- [Release notes](https://github.com/vueuse/vueuse/releases)
- [Commits](https://github.com/vueuse/vueuse/commits/v9.12.0/packages/core)

---
updated-dependencies:
- dependency-name: "@vueuse/core"
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
2023-01-31 11:51:39 +01:00
Vincent Bernat
65e3e1783a common/schema: check for dependencies between columns 2023-01-30 06:48:16 +01:00
Vincent Bernat
7ebb3b5a21 orchestrator/clickhouse: fix disabling DstASPath 2023-01-30 06:48:16 +01:00
vincentbernat
39295c5619 build: flake.lock automated update 2023-01-30 05:48:23 +01:00
Vincent Bernat
584965fe97 inlet/flow: do not record flow decoding time
Same as previous commit, this is mostly pointless and it costs some CPU.
2023-01-29 20:39:28 +01:00
Vincent Bernat
957084ad96 inlet/core: do not record flow processing time
This is expensive to do so. It's mostly useless. One can profile if
needed.
2023-01-29 20:39:26 +01:00
Vincent Bernat
b8698bc060 cmd: accept an !include tag for YAML files 2023-01-29 14:48:57 +01:00
Vincent Bernat
9884844adf cmd: switch to gopkg.in/yaml.v3 for YAML parsing 2023-01-29 13:09:22 +01:00
Vincent Bernat
6d660e0887 docker: make console depends on ClickHouse
What we cannot really make depends on ClickHouse is the orchestrator as
there is a chicken/egg problem.
2023-01-27 23:11:39 +01:00
Vincent Bernat
dc32174533 common/reporter: fix panic recovery on missed healthcheck 2023-01-27 23:08:19 +01:00
Vincent Bernat
51988449d2 common/schema: fix GenerateFrom for DstNet* v1.7.1 2023-01-27 22:49:17 +01:00
Vincent Bernat
e5096251d9 inlet/flow: extract DstASPath from sFlow if available 2023-01-27 20:59:22 +01:00
Vincent Bernat
dc012192a9 inlet/core: rename constants for ASN providers 2023-01-27 17:00:42 +01:00
Vincent Bernat
9a67ed579c console/frontend: fix Apply/Refresh button 2023-01-27 11:43:04 +01:00
Vincent Bernat
711cdb1cdc docker: update kafka-ui 2023-01-27 10:55:28 +01:00
Vincent Bernat
afe2c65b38 docs: mention conversion time for SrcPort and DstPort 2023-01-27 09:45:28 +01:00
Vincent Bernat
45f92d729e docs: prepare for release v1.7.0 2023-01-26 18:39:06 +01:00
Vincent Bernat
d3b1ae7ad2 common/schema: allow to move some data in or out the main table 2023-01-26 00:33:57 +01:00
Ultrabug
6482c4c258 docs(readme): fix typo in project description 2023-01-25 21:42:08 +01:00
Vincent Bernat
a39dea1674 orchestrator/clickhouse: add clickhouse.kafka.engine-settings 2023-01-25 20:53:56 +01:00
Vincent Bernat
cf3cf626d2 docs: move schema definition into orchestrator section
Otherwise, this is confusing as to where to configure it. It should be
the same for the three components.
2023-01-25 08:15:49 +01:00
Vincent Bernat
3684d06f90 docs: update documentation regarding flow protobuf definitions 2023-01-25 08:13:39 +01:00
Vincent Bernat
6099691d05 orchestrator/clickhouse: check migration run when enabling all columns 2023-01-24 12:03:05 +01:00
Vincent Bernat
bd8928c9f1 common/schema: fix ClickHouse type for Src/DstMAC 2023-01-24 11:41:48 +01:00
dependabot[bot]
005a6412ad build: bump github.com/docker/docker (#428) 2023-01-23 22:34:20 +00:00
Vincent Bernat
2dfc258f6a inlet/core: bump expr to 1.10.4 2023-01-23 23:21:40 +01:00
dependabot[bot]
a96e3c6a04 build: bump github.com/ClickHouse/clickhouse-go/v2 from 2.5.0 to 2.5.1 (#426) 2023-01-23 22:04:04 +00:00
dependabot[bot]
2d92cdc799 build: bump @vueuse/router from 9.10.0 to 9.11.1 in /console/frontend
Bumps [@vueuse/router](https://github.com/vueuse/vueuse/tree/HEAD/packages/router) from 9.10.0 to 9.11.1.
- [Release notes](https://github.com/vueuse/vueuse/releases)
- [Commits](https://github.com/vueuse/vueuse/commits/v9.11.1/packages/router)

---
updated-dependencies:
- dependency-name: "@vueuse/router"
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
2023-01-23 22:49:25 +01:00
dependabot[bot]
692975401e build: bump @vueuse/core from 9.10.0 to 9.11.1 in /console/frontend
Bumps [@vueuse/core](https://github.com/vueuse/vueuse/tree/HEAD/packages/core) from 9.10.0 to 9.11.1.
- [Release notes](https://github.com/vueuse/vueuse/releases)
- [Commits](https://github.com/vueuse/vueuse/commits/v9.11.1/packages/core)

---
updated-dependencies:
- dependency-name: "@vueuse/core"
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
2023-01-23 22:49:15 +01:00
dependabot[bot]
dc1eeb52ad build: bump github.com/Shopify/sarama from 1.38.0 to 1.38.1
Bumps [github.com/Shopify/sarama](https://github.com/Shopify/sarama) from 1.38.0 to 1.38.1.
- [Release notes](https://github.com/Shopify/sarama/releases)
- [Changelog](https://github.com/Shopify/sarama/blob/main/CHANGELOG.md)
- [Commits](https://github.com/Shopify/sarama/compare/v1.38.0...v1.38.1)

---
updated-dependencies:
- dependency-name: github.com/Shopify/sarama
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
2023-01-23 22:48:41 +01:00
dependabot[bot]
8b27bb8f18 build: bump typescript-language-server in /console/frontend
Bumps [typescript-language-server](https://github.com/typescript-language-server/typescript-language-server) from 3.0.2 to 3.0.3.
- [Release notes](https://github.com/typescript-language-server/typescript-language-server/releases)
- [Changelog](https://github.com/typescript-language-server/typescript-language-server/blob/master/CHANGELOG.md)
- [Commits](https://github.com/typescript-language-server/typescript-language-server/compare/v3.0.2...v3.0.3)

---
updated-dependencies:
- dependency-name: typescript-language-server
  dependency-type: direct:development
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
2023-01-23 22:47:56 +01:00