Posts tagged "spark":

Exploring Stack Exchange data with Clojure using Apache Spark and Flambo

Apache Spark is a is a fast and general engine for large-scale data processing (as in terabytes or larger data sets), and Flambo is a Clojure DSL for working with Spark. Stack Exchange is a network of question and answer websites with a variety of topics (the most popular one being Stack Overflow). They periodically provide a creative commons licensed database dump. We'll be using data from the Stack Exchange Gaming Site as a toy dataset to work with them.