-
Notifications
You must be signed in to change notification settings - Fork 0
References
Juan Rodriguez Hortala edited this page Jul 13, 2014
·
34 revisions
- Java 6 API
- org.apache.commons.configuration.PropertiesConfiguration
- Storm Core 0.9.1-incubating-SNAPSHOT API
- API documentation for Apache HTTP Components: Client Fluent API, Apache HttpClient quickstart, Apache Http Components fundamentals
- Guava: Google Core Libraries for Java 17.0 API
- Jedis API docs, Redis commands
- SLF4J Javadoc and two-page user manual, because "In general, and when possible, Storm topologies and topology components should use the slf4j API for logging."
- Fugue, "this library attempts to round out some of the deficiencies that a functional programmer finds when using Guava", Fugue Javadoc.
- Apache Avro Java API
- Some resources for Apache Metamodel:
- Current web examples
- Examples from InfoQ post
- Blog post by Kasper Sørensen, more about concepts than code
- Mirror of MetaModel-4.1.0-RC1-incubating API docs
- CartoDB
- Mondrian
- Periodic processing in bare Storm: ClockSpout, tick touples at Implementing Real-Time Trending Topics With a Distributed Rolling Count Algorithm in Storm
- Storm and Kafka
- Guava: functional idioms, Idea Graveyard
-
Google AutoValue
- Note the documentation says "AutoValue does not and will not support creating mutable value types (https://github.com/google/auto/tree/master/value#restrictions-and-non-features). As can be seen in the generated code, this means the generated class has no setters, but an attribute may have a mutable type: this is similar to what happens with Python tuples, once created the tuple componentsare fixed, but you are free to mutate a single component (e.g.
t = ([], 1); t[0].append(1)) - Using the AutoValue Code Generator in Eclipse
- Note the documentation says "AutoValue does not and will not support creating mutable value types (https://github.com/google/auto/tree/master/value#restrictions-and-non-features). As can be seen in the generated code, this means the generated class has no setters, but an attribute may have a mutable type: this is similar to what happens with Python tuples, once created the tuple componentsare fixed, but you are free to mutate a single component (e.g.
- Guice (pronounced 'juice') is a lightweight dependency injection framework for Java 5 and above, brought to you by Google.
- Reflections, useful for handling resources inside jars.
-
Appending to Avro files in HDFS, see also this, it's finally working although only it reasonably recent versions of Hadoop, see here and here. Other option is using
org.apache.avro.file.appendAllFrom()but that would be sequential. - Stream processing
- HBase in HDP 2.1 and OpenTSDB: Check http://hortonworks.com/community/forums/topic/change-for-zookeeper-znode-parent/ for OpenTSDB config
- This blog post about Storm and Graphite shows an interesting alternative
- Customizing HDP 2.1
- Use VirtualBox with "bridged adapter" for the network configuration
- how to install gui to centos minimal: http://namhuy.net/475/how-to-install-gui-to-centos-minimal.html
- Spark stream processing
- Running Spark Streaming in local mode requires at least 2 local nodes, as seen here (and suffered anyhow): "Make sure you are using master as "local[n]" with n > 1 (assuming you are running it in local mode). The way Spark Streaming works is that it assigns a core to the data receiver, and so if you run the program with only one core (i.e., with local or local[1]), then it wont have resources to process data along with receiving it."
- Real-time data analysis using Spark
- Spark Streaming, Kafka and HBase
- Kafka and Spark Streaming Java example, Scala example
- Top 3 Troubleshooting Tips to Keep You Sparking