Stroom

In 2016 GCHQ released Stroom to the open source community via GitHub.

​

Stroom is a highly scalable data storage, processing and analysis platform that is an ideal open source solution for very large scale collection, storage and management of log data. There are many products on the market that help organisations make use of this data. They range from very expensive enterprise offerings priced by the volume of log data they ingest to some open source solutions which provide some good solutions for log data exploitation but not for general log data management.

​

Stroom provides functionality to process log data so that it can be transformed, enriched and visualised data via search indexes or statistical abstractions.  Alternatively, it can be forwarded on to other tools such as elastic, Splunk or Hadoop/Spark.