Time-Based Partitioning

A Fusion collection can be configured to map to multiple Solr collections, known as partitions in this context, where each partition contains data from a specific time range. An example is time-based partitioning for logs:

Once a collection is configured for time-base partitioning, Fusion automatically ages out old partitions and creates new ones, using the configured partition sizes, expiration intervals, and so on. No manual maintenance is needed.

Configuration options

When time series indexing is enabled for a collection, you can configure these options using the UI or the
Collections API. None are required.

UI Label,
API Name

Description

Timestamp Field NametimestampFieldName

The name of the field from which to read timestamps. The default is "timestamp".

Partition Time PeriodtimePeriod

The time range for each partition. The default is one day.

Max Active PartitionsmaxActivePartitions

The number of partitions to keep active.

Delete Expired PartitionsdeleteExpired

"True" to automatically delete partitions that fall outside of the maxActivePartitions window, at intervals of scheduleIntervalMinutes. The default is "false".

Preemptive Create EnabledpreemptiveCreateEnabled

"True" (the default) to create partitions in advance.

Schedule IntervalscheduleIntervalMinutes

The interval, in minutes, at which to perform background maintenance, including preemptively creating partitions (preemptiveCreateEnabled) and deleting expired partitions (deleteExpired). The default is five minutes.

Partition Num ShardsnumShards

The number of shards per partition. The default is the value configured for the main Fusion collection.

Partition Replication FactorreplicationFactor

The number of copies to keep, per partition. The default is the value configured for the main Fusion collection.

Partition Config NameconfigName

The name of the Solr configuration set to be applied to new partitions; the default is the configuration used by the primary collection.