universal_transfer_operator.datasets.file.types

Submodules

• universal_transfer_operator.datasets.file.types.base
• universal_transfer_operator.datasets.file.types.csv
• universal_transfer_operator.datasets.file.types.json
• universal_transfer_operator.datasets.file.types.ndjson
• universal_transfer_operator.datasets.file.types.parquet

Package Contents

Functions

create_file_type(path[, filetype, normalize_config])	Factory method to create FileType super objects based on the file extension in path or filetype specified.
get_filetype(filepath)	Return a FileType given the filepath. Uses a native strategy, using the file extension.

universal_transfer_operator.datasets.file.types.create_file_type(path, filetype=None, normalize_config=None)

Factory method to create FileType super objects based on the file extension in path or filetype specified.

Parameters:

• path (str) –

• filetype (FileTypeConstants | None) –

• normalize_config (dict | None) –

Return type:

base.FileTypes

universal_transfer_operator.datasets.file.types.get_filetype(filepath)

Return a FileType given the filepath. Uses a native strategy, using the file extension. :param filepath: URI or Path to a file :type filepath: str or pathlib.PosixPath :return: The filetype (e.g. csv, ndjson, json, parquet) :rtype: universal_transfer_operator.constants.FileType

Parameters:

filepath (str | pathlib.PosixPath) –

Return type:

universal_transfer_operator.constants.FileType