Skip to content

Document Types

Every kind of document Stroom holds in its explorer tree, by group.

Stroom stores everything you create as a document in the explorer tree. There are 35 types, in 5 groups.

The Type column is the identifier used in exports, in the API, and anywhere a document is referred to by type rather than by name.

Configuration

DocumentTypeWhat it is
DictionaryDictionaryA Dictionary is essentially a list of 'words', where each 'word' is separated by a new line.
DocumentationDocumentationA Document type for simply storing user created documentation, e.g. adding a Documentation document into a folder to describe the contents of that folder.
Elastic ClusterElasticClusterDefines the connection details for a single Elasticsearch cluster.
Git RepoGitRepoContains the configuration for a connection to a Git repository.
Kafka ConfigurationKafkaConfigDefines the connection details for a single Kafka cluster.
OpenAI ModelOpenAIModelDefines the settings required to connect to an OpenAI-compatible API and interact with a model.
Rule SetReceiveDataRuleSetThe rules that decide whether arriving data is received, rejected or silently dropped. One per system rather than one per feed.
S3 ConfigurationS3ConfigDefines the config for S3
ScriptScriptContains a Javascript script that is used as the source for a visualisation Document.
VisualisationVisualisationDefines a data visualisation that can be used in a Dashboard Document.

Data processing

DocumentTypeWhat it is
FeedFeedThe is Stroom's way of compartmentalising data that has been ingested or created by a Pipeline.
PipelinePipelineA Pipeline defines a chain of Pipeline elements that consumes from a source of data (a Stream of raw data or cooked events) then processes it according to the elements used in the chain.
ProcessorProcessorA pipeline's processing configuration. Created for you when you add a processor filter, rather than something you make directly.
Processor FilterProcessorFilterSelects which streams a pipeline processes. This is the document behind a row on a pipeline's Processors tab.

Indexing

DocumentTypeWhat it is
Elastic IndexElasticIndexDefines an index that exists within an Elasticsearch cluster.
FloorMap Event StoreFloorMapEventStoreHolds the events a floor map draws, keyed by the entity they are about. Part of the floor map feature rather than a general-purpose store.
Lucene IndexIndexLucene Index is the standard built-in index within Stroom and is one of many data sources.
PathwaysPathwaysAnalyses trace logs held in a Plan B store to learn the paths that traces take between services, e.g. A -> B -> C.
Plan BPlanBDefines a place to store state
Solr IndexSolrIndexSolr Index represents an index on a Solr cluster.
SQL Temporal StoreSqlTemporalStoreA temporal key-value store held in the database, loaded from pipelines and editable in place. Used for facts that change over time and need correcting, including the facts behind a floor map.
Statistic StoreStatisticStoreDefines a logical statistic store used to hold statistical data of a particular type and aggregation window.
TracesTracesHolds trace data for the pathways feature, which turns traces into the routes entities take. Specialised rather than general-purpose.
ViewViewA view is an abstraction over a data source (such as a Lucene Index) and optionally an extraction pipeline.
DocumentTypeWhat it is
Analytic RuleAnalyticRuleDefines an analytic rule which can be run to alert on events meeting a criteria.
AnnotationAnnotationAn annotation records notes and workflow state against one or more events, typically while investigating them.
Annotation GroupAnnotationGroupGroups related annotations so an investigation spanning several events is worked as one thing.
DashboardDashboardThe Dashboard Document defines a data querying and visualisation dashboard.
Data GeneratorDataGenDefines a data generator which can be used to send data into a Stroom Feed.
Floor MapFloorMapA plan of a physical space with live events drawn on it. Reads one store for the shape of the site and another for what is happening on it.
QueryQueryA Query Document defines a query and is used to execute that query and view its results.
ReportReportDefines a report that can be run at scheduled intervals and sent to individuals via email.

Transformation

DocumentTypeWhat it is
Text ConverterTextConverterA Text Converter Document defines the specification for splitting text data into records/fields using Data Splitter or for wrapping fragment XML with a pipeline element.
XML SchemaXMLSchemaThis Document defines an that can be used within Stroom for validation of XML documents.
XSL TranslationXSLTThe content of this Document is an document for transforming data in a pipeline.

Built-in data sources

These are not documents and you do not create them. Stroom registers them as types so that a dashboard or query can select them as a data source, alongside the indexes and stores you build yourself.

Data sourceType
AnalyticsAnalytics
AnnotationsAnnotations
DualDual
Index ShardsIndexShards
Plan B ShardsPlanBShards
Processor TasksProcessorTasks
Reference Data Store (This Node Only)ReferenceDataStore
Stream StoreStreamStore
Task ManagerTaskManager

All documentation