Skip to content
master
Switch branches/tags
Go to file
Code

Latest commit

 

Git stats

Files

Permalink
Failed to load latest commit information.
Type
Name
Latest commit message
Commit time
src
 
 
 
 
 
 
 
 
 
 

README.md

List of NSFW (not suitable for work) language in YARA(http://virustotal.github.io/yara/) pattern-matching format

based upon work from https://github.com/LDNOOBW/List-of-Dirty-Naughty-Obscene-and-Otherwise-Bad-Words

this database powers the nsfw language feature of the https://scanii.com content analysis service

Compiling the rules

$ make
 mkdir -p dist
 yarac src/cs-language-nsfw.yara dist/cs-language-nsfw.yara.db; yarac src/da-language-nsfw.yara dist/da-language-nsfw.yara.db; yarac src/de-language-nsfw.yara dist/de-language-nsfw.yara.db; yarac src/en-language-nsfw.yara dist/en-language-nsfw.yara.db; yarac src/eo-language-nsfw.yara dist/eo-language-nsfw.yara.db; yarac src/es-language-nsfw.yara dist/es-language-nsfw.yara.db; yarac src/fi-language-nsfw.yara dist/fi-language-nsfw.yara.db; yarac src/fr-language-nsfw.yara dist/fr-language-nsfw.yara.db; yarac src/hi-language-nsfw.yara dist/hi-language-nsfw.yara.db; yarac src/hu-language-nsfw.yara dist/hu-language-nsfw.yara.db; yarac src/it-language-nsfw.yara dist/it-language-nsfw.yara.db; yarac src/ja-language-nsfw.yara dist/ja-language-nsfw.yara.db; yarac src/ko-language-nsfw.yara dist/ko-language-nsfw.yara.db; yarac src/nl-language-nsfw.yara dist/nl-language-nsfw.yara.db; yarac src/no-language-nsfw.yara dist/no-language-nsfw.yara.db; yarac src/pl-language-nsfw.yara dist/pl-language-nsfw.yara.db; yarac src/pt-language-nsfw.yara dist/pt-language-nsfw.yara.db; yarac src/ru-language-nsfw.yara dist/ru-language-nsfw.yara.db; yarac src/sv-language-nsfw.yara dist/sv-language-nsfw.yara.db; yarac src/th-language-nsfw.yara dist/th-language-nsfw.yara.db; yarac src/tlh-language-nsfw.yara dist/tlh-language-nsfw.yara.db; yarac src/tr-language-nsfw.yara dist/tr-language-nsfw.yara.db; yarac src/zh-language-nsfw.yara dist/zh-language-nsfw.yara.db;

Creating single bundle rule

$ make bundle
mkdir -p dist
yarac src/cs-language-nsfw.yara dist/cs-language-nsfw.yara.db; yarac src/da-language-nsfw.yara dist/da-language-nsfw.yara.db; yarac src/de-language-nsfw.yara dist/de-language-nsfw.yara.db; yarac src/en-language-nsfw.yara dist/en-language-nsfw.yara.db; yarac src/eo-language-nsfw.yara dist/eo-language-nsfw.yara.db; yarac src/es-language-nsfw.yara dist/es-language-nsfw.yara.db; yarac src/fi-language-nsfw.yara dist/fi-language-nsfw.yara.db; yarac src/fr-language-nsfw.yara dist/fr-language-nsfw.yara.db; yarac src/hi-language-nsfw.yara dist/hi-language-nsfw.yara.db; yarac src/hu-language-nsfw.yara dist/hu-language-nsfw.yara.db; yarac src/it-language-nsfw.yara dist/it-language-nsfw.yara.db; yarac src/ja-language-nsfw.yara dist/ja-language-nsfw.yara.db; yarac src/ko-language-nsfw.yara dist/ko-language-nsfw.yara.db; yarac src/nl-language-nsfw.yara dist/nl-language-nsfw.yara.db; yarac src/no-language-nsfw.yara dist/no-language-nsfw.yara.db; yarac src/pl-language-nsfw.yara dist/pl-language-nsfw.yara.db; yarac src/pt-language-nsfw.yara dist/pt-language-nsfw.yara.db; yarac src/ru-language-nsfw.yara dist/ru-language-nsfw.yara.db; yarac src/sv-language-nsfw.yara dist/sv-language-nsfw.yara.db; yarac src/th-language-nsfw.yara dist/th-language-nsfw.yara.db; yarac src/tlh-language-nsfw.yara dist/tlh-language-nsfw.yara.db; yarac src/tr-language-nsfw.yara dist/tr-language-nsfw.yara.db; yarac src/zh-language-nsfw.yara dist/zh-language-nsfw.yara.db;
yarac src/language-nsfw.yara dist/language-nsfw.db

this will create a single langauge-nsfw.db compiled yara rule with all the individual languages

Using signature database

$yara dist/language-nsfw.db nsfw-language-sample.txt 
content_da_language_nsfw nsfw-language-sample.txt
content_en_language_nsfw nsfw-language-sample.txt
content_nl_language_nsfw nsfw-language-sample.txt