Changelog
0.1.0
Features
Add
UniversalTransferOperator
that allows data transfers between supported source and target Datasets in Apache Airflow. The supported datasets are:File
andTable
. It offers a consistent agnostic interface, simplifying the users’ experience, so they do not need to use specific providers or operators for transfers. #1492 , #1619Add transfer support for the following databases:
Databases |
Transfer Mode supported |
Pull Request |
---|---|---|
SQLite |
non-native, third-party |
|
Google BigQuery |
non-native, third-party |
|
Snowflake |
non-native, third-party |
Add transfer support for the following filesystems:
File stores |
Transfer Mode supported |
Pull Request |
---|---|---|
Amazon S3 |
non-native, third-party |
|
Local |
non-native, third-party |
|
Google GCS |
non-native, third-party |
|
SFTP |
non-native |