Materialized views
These settings control materialized view SQL support, background refresh, and
row-expiry cleanup. Materialized views refresh on a dedicated worker pool sized
by mat.view.refresh.worker.count; 0 disables
refresh. Row-expiry cleanup runs on the
write pool, so it keeps running when
refresh is disabled.
To cap the native memory a single refresh may allocate, see
cairo.mat.view.refresh.memory.limit.bytes.
cairo.mat.view.enabled
- Default:
true - Reloadable: no
Enables or disables SQL support and the refresh job for materialized views.
cairo.mat.view.max.refresh.retries
- Default:
10 - Reloadable: yes
Maximum number of immediate retries within a single refresh attempt. A retry
happens when the base table changes structurally during the refresh, when a
refresh step produces an oversized transaction, or when a step fails with an
out-of-memory error, including a breach of the
refresh memory limit.
Retries after an oversized transaction or an out-of-memory error shrink the
refresh interval step; a retry after a structural change recompiles the view
with the same step, and if it keeps failing the refresh is queued again. Once
the out-of-memory retries are exhausted or the step cannot shrink further, the
error propagates and the deferred retries governed by
cairo.mat.view.refresh.busy.retry.limit take over.
cairo.mat.view.parallel.sql.enabled
- Default:
true - Reloadable: no
When disabled, SQL executed by the materialized view refresh job always runs single-threaded.
cairo.mat.view.refresh.busy.retry.limit
- Default:
10 - Reloadable: no
Maximum number of deferred retries after an incremental or scheduled period
refresh fails with a transient error. If all retries fail, the view is
invalidated. A successful refresh resets the counter; 0 disables deferred
retries.
Transient errors include a busy base table or view and out-of-memory errors,
including breaches of the
refresh memory limit. Full
refreshes and user-requested REFRESH ... RANGE FROM ... TO ... do not use these
deferred retries.
cairo.mat.view.refresh.busy.retry.timeout
- Default:
1000 - Reloadable: no
Delay in milliseconds before a deferred retry for an incremental or scheduled
period refresh. The retry is timer-driven and does not block a refresh worker.
The deprecated cairo.mat.view.refresh.oom.retry.timeout key is accepted but
has no effect; deferred out-of-memory retries use this backoff.
cairo.mat.view.row.expiry.cleanup.enabled
- Default:
true - Reloadable: no
Turns on the background job that frees disk for rows removed by an eligible
EXPIRE ROWS policy. Turning the job off does not
turn off read filtering, so expired rows stay hidden from query results either
way.
cairo.mat.view.row.expiry.cleanup.max.cached.partitions
- Default:
16384 - Reloadable: no
How many partitions, across all materialized views, the
EXPIRE ROWS cleanup job remembers as checked
and free of expired rows. On later runs the job skips a remembered partition
until its contents change, instead of counting its rows again.
Only a WHEN condition that decides each row from that row's own values uses
this, such as price < 2.0 or timestamp < '2024-01-03'. A comparison of the
designated timestamp with a TIMESTAMP value, such as
timestamp < dateadd('d', -7, now()), is decided from each partition's time
range and never counts rows.
Once the job remembers this many partitions, it keeps those and adds no more,
so each run counts the rows of every other unchanged partition again. Raise the
limit if your views hold more partitions under such a policy than this, at the
cost of a little heap memory per partition. The job keeps this in memory only,
so its first run after a restart counts every partition once. Set this to 0
to make every run count every partition. A negative value stops the server from
starting.
cairo.mat.view.row.expiry.cleanup.min.expired.fraction
- Default:
0.5 - Reloadable: no
How large the share of expired rows in a partition must be before the background
cleanup job rewrites that partly-expired partition to reclaim the space. Set this
to 0 to rewrite as soon as any row expires, or to 1 to turn off rewriting of
partly-expired partitions. Fully expired partitions are still removed.
mat.view.refresh.worker.affinity
- Default: none
- Reloadable: no
Comma-separated list of numerical CPU core indexes, one per refresh worker.
mat.view.refresh.worker.count
- Default:
2on hosts with up to 8 CPU cores,3on up to 32 cores,4on larger hosts. This is the same CPU-based default aswal.apply.worker.count; setting that key does not change this one. - Reloadable: no
Number of dedicated worker threads assigned to refresh materialized views. A
value of 0 disables materialized view refresh: CREATE MATERIALIZED VIEW
still succeeds, but nothing refreshes the view. Live views use their own pool,
sized by
live.view.refresh.worker.count.
mat.view.refresh.worker.fiber.enabled
- Default:
true - Reloadable: no
Runs the materialized view refresh pool in Fiber mode, where work can suspend
and release its worker instead of holding it until it finishes. Setting this to
false puts the pool in legacy mode.
Unlike the pools that serve user queries, this one is not a prerequisite for QuestDB Enterprise resource groups, because materialized view refresh runs outside them.
mat.view.refresh.worker.haltOnError
- Default:
false - Reloadable: no
Flag that indicates if the worker thread must stop when an unexpected error occurs.