Signed-off-by: Erik Hollensbe <firstname.lastname@example.org>
|9 months ago|
|migrations||9 months ago|
|src||9 months ago|
|.env||9 months ago|
|.gitignore||9 months ago|
|Cargo.lock||9 months ago|
|Cargo.toml||9 months ago|
|LICENSE||9 months ago|
|README.md||9 months ago|
|diesel.toml||9 months ago|
|docker-compose.yml||9 months ago|
Kleene: A commonality matcher for large text files
Kleene generates patterns composed from a group of log files that share common data. It can then use this data to then match against a larger set of log files to determine which of them matches the content.
Soon, you will be able to register your logs in a database for ongoing pattern revision. Additionally, further enhancements to the pattern generation algorithm are expected to come soon.
Get a copy of cargo, a tool to drive rust builds. Then,
cargo install --git https://code.hollensbe.org/erikh/kleene
There are currently two commands:
kleene train <files> > pattern_file, which emits a pattern over standard output;
kleenepatterns have null characters in them (
\0) so it is important they are not copy-pasted. Redirect standard output to a file.
kleene match <files> < pattern_fileaccepts a pattern over standard input and matches it against the files, terminating immediately on the first mismatch currently.
It should perform reasonably well on large files.
Erik Hollensbe email@example.com