universal_transfer_operator.datasets.file.types.base

Module Contents

Classes

FileTypes

Abstract File type class, meant to be the interface to all client code for all supported file types
class universal_transfer_operator.datasets.file.types.base.FileTypes(path, normalize_config=None)

Bases: abc.ABC

Abstract File type class, meant to be the interface to all client code for all supported file types

Parameters:

  • path (str) –

  • normalize_config (dict | None) –

abstract property name

get file type

abstract export_to_dataframe(stream, **kwargs)

read file from one of the supported locations and return dataframe :param stream: file stream object

Return type:

pandas.DataFrame

abstract create_from_dataframe(df, stream)

Write file to one of the supported locations :param df: pandas dataframe :param stream: file stream object

Parameters:

  • df (pandas.DataFrame) –

  • stream (io.TextIOWrapper) –

Return type:

None