Reference

Data::Stream::Bulk::Chunked(3pm)

combine streams into larger chunks

NAME

Data::Stream::Bulk::Chunked - combine streams into larger chunks

VERSION

version 0.11

SYNOPSIS

  use Data::Stream::Bulk::Chunked;
  Data::Stream::Bulk::Chunked->new(
      stream     => $s,
      chunk_size => 10000,
  );

DESCRIPTION

This is a stream which wraps an existing stream to give more items in a single block. This can simplify application code which does its own processing one block at a time, and where processing larger blocks is more efficient.

ATTRIBUTES

stream

The stream to chunk. Required.

chunk_size

The minimum number of items to return in a block. Defaults to 1 (which does nothing).

METHODS

get_more

See Data::Stream::Bulk::DoneFlag.

Returns at least "chunk_size" items. Note that this isn't guaranteed to return exactly "chunk_size" items - it just returns multiple full blocks from the backend. Also, the final block returned may have less than "chunk_size" items.

AUTHOR

Yuval Kogman <[email protected]>

COPYRIGHT AND LICENSE

This software is copyright (c) 2012 by Yuval Kogman.

This is free software; you can redistribute it and/or modify it under the same terms as the Perl 5 programming language system itself.

History