ds_resource_plugin_py_lib.common.serde.deserialize

File: __init__.py Region: ds_resource_plugin_py_lib/common/serde/deserialize

Description

Deserializer implementations for dataset content.

Submodules

Classes

AwsWranglerDeserializer

Extensible class to deserialize dataset content.

DataDeserializer

Extensible class to deserialize dataset content.

PandasDeserializer

Extensible class to deserialize dataset content.

Package Contents

class ds_resource_plugin_py_lib.common.serde.deserialize.AwsWranglerDeserializer[source]

Bases: ds_resource_plugin_py_lib.common.serde.deserialize.base.DataDeserializer

Extensible class to deserialize dataset content.

Not supposed to be used directly, but to be subclassed.

format: ds_resource_plugin_py_lib.common.resource.dataset.storage_format.DatasetStorageFormatType
kwargs: dict[str, Any]
__call__(value: Any, **kwargs: Any) → pandas.DataFrame[source]

Deserialize a value into a pandas DataFrame. :param value: The value to deserialize. :param **kwargs: Additional keyword arguments.

Returns:

A pandas DataFrame.

class ds_resource_plugin_py_lib.common.serde.deserialize.DataDeserializer[source]

Bases: ds_common_serde_py_lib.Serializable

Extensible class to deserialize dataset content.

Not supposed to be used directly, but to be subclassed.

abstractmethod __call__(value: Any, **kwargs: Any) → Any[source]
get_next(_value: Any, **_kwargs: Any) → bool[source]
get_end_cursor(_value: Any, **_kwargs: Any) → str | None[source]
class ds_resource_plugin_py_lib.common.serde.deserialize.PandasDeserializer[source]

Bases: ds_resource_plugin_py_lib.common.serde.deserialize.base.DataDeserializer

Extensible class to deserialize dataset content.

Not supposed to be used directly, but to be subclassed.

format: ds_resource_plugin_py_lib.common.resource.dataset.storage_format.DatasetStorageFormatType
kwargs: dict[str, Any]
__call__(value: Any, **_kwargs: Any) → pandas.DataFrame[source]

Deserialize a value into a pandas DataFrame. :param value: The value to deserialize. :param **kwargs: Additional keyword arguments.

Returns:

A pandas DataFrame.