Document Rspamd Bayesian filter bulk training #152
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
stephdl
requested changes
Dec 10, 2024
Comment on lines
+200
to
+201
| runagent -m mail1 podman exec -i dovecot rspamc-wrapper --help | ||
|
|
There was a problem hiding this comment.
runagent -m mail1 podman exec -i dovecot /usr/local/lib/dovecot/sieve-pipe/rspamc-wrapper --help
the path is not found
[mail1@R1 toto]$ runagent -m mail1 podman exec -i dovecot rspamc-wrapper --help
Error: crun: executable file `rspamc-wrapper` not found in $PATH: No such file or directory: OCI runtime attempted to invoke a command that was not found
Comment on lines
+204
to
+205
| runagent -m mail1 podman exec -i dovecot rspamc-wrapper learn_spam < spamarchive.mbox | ||
|
|
There was a problem hiding this comment.
I cannot train rspamd like we did with NS7. The most hard part is that the spam are not inthe container
mkdir spam
cd spam
wget http://untroubled.org/spam/2024-01.7z
7z e 2024-01.7z
# we need to push to the container the spam mail
tar -cvf files.tar *.txt
podman cp files.tar dovecot:/tmp
podman exec dovecot tar -xvf /tmp/files.tar -C /tmp/spam
# now we can make to learn
podman exec -i dovecot /usr/local/lib/dovecot/sieve-pipe/rspamc-wrapper learn_spam /tmp/spam
# now we can verify
podman exec -i dovecot /usr/local/lib/dovecot/sieve-pipe/rspamc-wrapper stat
Results for command: stat (0.06 seconds)
Messages scanned: 0
Messages learned: 475
Connections count: 0
Control connections count: 518
Pools allocated: 571
Pools freed: 536
Bytes allocated: 26470776
Memory chunks allocated: 293
Shared chunks allocated: 3
Chunks freed: 0
Oversized chunks: 333
Fuzzy hashes in storage "rspamd.com": 10610683149
Fuzzy hashes stored: 10610683149
Statfile: BAYES_SPAM type: redis; length: 0; free blocks: 0; total blocks: 0; free: 0.00%; learned: 0; users: 0; languages: 0
Statfile: BAYES_HAM type: redis; length: 0; free blocks: 0; total blocks: 0; free: 0.00%; learned: 0; users: 0; languages: 0
Total learns: 0
| To read HAM message from `first.user`'s mailbox, specify its path, | ||
| relative to Dovecot's working directory: | ||
|
|
||
| runagent -m mail1 podman exec -i dovecot rspamc-wrapper learn_ham first.user/Maildir/cur |
There was a problem hiding this comment.
runagent -m mail1 podman exec -i dovecot /usr/local/lib/dovecot/sieve-pipe/rspamc-wrapper learn_ham first.user/Maildir/cur
same issue I suppose, path and how to train with external mail
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
This PR documents the manual procedure to train the Bayesian filters from mail messages already stored in the disk.
It also adds a symbolic link to
rspamc-wrappercommand, which is currently used by the global Sieve filter to trigger the IMAP-driven learn procedure. The symbolic link is just convenience for the manual procedure.Refs