Permalink
Browse files

updated README/added Metadata

  • Loading branch information...
1 parent c09eb9c commit d0417912d6768ff294f7114657a4e3983848db98 Felix Richter committed Oct 17, 2010
Showing with 41 additions and 32 deletions.
  1. +14 −0 METADATA.md
  2. +27 −10 README.md
  3. +0 −22 plugins/verydemotivational.js
View
@@ -0,0 +1,14 @@
+Metadata Management
+===================
+For every picture a number of meta data should be saved:
+- HTTP-Header:
+ - url
+ - mimetype
+ - size
+ - last-modified
+- External Info:
+ - alt text
+ - info
+ - (picture name)
+ - (tags)
+
View
@@ -12,23 +12,40 @@ It's main purpose is derived from this XKCD quote:
The name was borrowed from [the 'fucking magnets' meme](http://knowyourmeme.com/memes/f-cking-magnets-how-do-they-work).
-Used node.js libraries:
-=======================
-
- * [Trollopjs for commandline parsing](http://github.com/bentomas/trollopjs)
- * [Node-Streamlogger for logging](http://github.com/andrewvc/node-streamlogger)
- * [Node-Htmlparser for logging](http://github.com/tautologistics/node-htmlparser)
- * [Colored.js for colored VT100 output](http://github.com/pfleidi/colored.js)
+FEATURES
+=======
+- download all the funny pictures on the internet directly to your hard disk
+- extensible plugin facility with multi-module support
+- modules for high-quality funny pics
+ - icanhascheezburger-network like failblog and lolcats
+ - soup.io
+ - kqe
+ - bildschirmarbeiter
+ - ... more
+- FUNNY PICTURES ALL THE WAY
TODO:
=====
* Live Ticker (scheduler) - partly implemented
- * Other Plugins
- * Backwards grabbing
+ * Other Plugins ( recently added cheezburger\_network)
* Add debugging and inspection howto
* Support commandline options like loglevel
- * Use node-htmlparser instead of own regex
+ * Use node-htmlparser instead of own regex (used in cheezburger as first
+ plugin
+ * meta data for every picture
+
+Used node.js libraries:
+=======================
+
+ * [Trollopjs for commandline parsing](http://github.com/bentomas/trollopjs)
+ * [Node-Streamlogger for logging](http://github.com/andrewvc/node-streamlogger)
+ * [Node-Htmlparser for Screen Scraping](http://github.com/tautologistics/node-htmlparser)
+ * [soupselect for CSS selectors after HTML-parsing](http://github.com/harryf/node-soupselect.git)
+ * [Coloredjs for colored VT100 output](http://github.com/pfleidi/colored.js)
+
+in short:
+npm install trollop htmlparser soupselect
Workaround to delete downloaded html files:
@@ -1,22 +0,0 @@
-var Mag = require('../lib/magnetlib');
-
-exports.createPlugin = function (log) {
- var out = {};
- var MAIN="http://verydemotivational.com/";
- out.LIVE = undefined;
- out.BACKWARDS = MAIN;
- out.NAME = "verydemotivational.com plugin";
-
-
- out.getImages = function getImages(content) {
- var imageFilter = /<img src=["'](\S+)["'] alt="[\s\S]+" title="[\s\S]*">/g;
- return Mag.getMatches(imageFilter, content.data);
- };
-
- out.getNextUrl = function getNextUrl(content) {
- var urlPattern = /<a href="(\S+)"\s*>Next/
- return urlPattern.exec(content.data);
- };
-
- return [out];
-};

0 comments on commit d041791

Please sign in to comment.