Class Partition

java.lang.Object
dev.vortex.api.Partition

public final class Partition extends Object
A unit of scan work that materializes into an Arrow stream. Partitions are single-pass: calling scanArrow(BufferAllocator) consumes the partition and transfers ownership of its native memory to the returned ArrowReader. If the partition is never consumed, its native memory is released automatically via VortexCleaner.
  • Method Details

    • rowCount

      public OptionalLong rowCount()
      Estimated row count of the partition. Empty when unknown.
    • scanArrow

      public org.apache.arrow.vector.ipc.ArrowReader scanArrow(org.apache.arrow.memory.BufferAllocator allocator)
      Consume the partition and return an ArrowReader that yields record batches. The caller must close the reader when finished; doing so releases the native partition resources as well.