fletcher.algorithms.string_builder_nojit module

class fletcher.algorithms.string_builder_nojit.BitVector(initial_size: int)

Bases: object

Builder that constructs a buffer based on bit-packed chunks.

As the memory is owned by this object but we cannot override __del__, you need to explicitly call delete() to free the native memory.

Methods

expand()

Double the size of the underlying buffer and copy over the existing data.

append_false
append_true
delete
get

append_false()

append_true()

delete()

expand()

Double the size of the underlying buffer and copy over the existing data.

This allocates a new buffer and copies the data.

get(idx)

class fletcher.algorithms.string_builder_nojit.ByteVector(initial_size: int)

Bases: object

Builder that constructs a buffer based on byte-sized chunks.

As the memory is owned by this object but we cannot override __del__, you need to explicitly call delete() to free the native memory.

Methods

append(byte)	Append a single byte to the stream.
append_bytes(ptr, length)	Append a range of bytes.
append_int16(i16)	Append a signed 16bit integer.
append_int32(i32)	Append a signed 32bit integer.
append_int64(i64)	Append a signed 64bit integer.
append_uint32(i32)	Append an unsigned 32bit integer.
expand()	Double the size of the underlying buffer and copy over the existing data.

delete
get_int16
get_int32
get_int64
get_uint32
get_uint8

append(byte)

Append a single byte to the stream.

append_bytes(ptr, length)

Append a range of bytes.

append_int16(i16)

Append a signed 16bit integer.

append_int32(i32)

Append a signed 32bit integer.

append_int64(i64)

Append a signed 64bit integer.

append_uint32(i32)

Append an unsigned 32bit integer.

delete()

expand()

Double the size of the underlying buffer and copy over the existing data.

This allocates a new buffer and copies the data.

get_int16(idx)

get_int32(idx)

get_int64(idx)

get_uint32(idx)

get_uint8(idx)

class fletcher.algorithms.string_builder_nojit.StringArrayBuilder(initial_size: int)

Bases: object

Numba-based builder to construct pyarrow.StringArray instances.

As Numba doesn’t allow us to override __del__, we must always call delete to free up the used (native) memory.

Methods

append_null
append_value
delete

append_null()

append_value(ptr, length)

delete()

fletcher.algorithms.string_builder_nojit.byte_for_bits(num_bits)

fletcher.algorithms.string_builder_nojit.finalize_string_array(sba, typ) → pyarrow.lib.Array

Take a StringArrayBuilder and returns a pyarrow.StringArray. The native memory in the StringArrayBuilder is free’d during this method call and this is unusable afterwards but also doesn’t leak any memory.