The grid (core) ยท console.warn
the export stream was stopped after {maxResu...
Printed by The grid (core), prefixed [lattice], since 1.79.0.
Warnings reference › source.elasticsearch.truncated
- Identifier
source.elasticsearch.truncated- Raised by
- The grid (core)
- Since
- 1.79.0
What happened
execute(query, { stream: true }) - the walk selection.stream() drives for a predicate selection and a whole-result export - is a point-in-time + search_after walk with no total, and maxResultRows bounds how far it goes. The row past the cap is never asked for, so a set larger than the cap is under-counted unless this is read: named once rather than a stream that quietly stopped short.
The fix
Raise maxResultRows to your ceiling, or drop it to read the stream unbounded (however many rows the matching set holds).
The smallest fix
elasticsearchAdapter({ url, index, maxResultRows: 500000 });
Reference
Covered in full at the API reference.