Changelog

0.1.0

Features

  • Add UniversalTransferOperator that allows data transfers between supported source and target Datasets in Apache Airflow. The supported datasets are: File and Table. It offers a consistent agnostic interface, simplifying the users’ experience, so they do not need to use specific providers or operators for transfers. #1492 , #1619

  • Add transfer support for the following databases:

Databases

Transfer Mode supported

Pull Request

SQLite

non-native, third-party

#1731

Google BigQuery

non-native, third-party

#1732

Snowflake

non-native, third-party

#1735

  • Add transfer support for the following filesystems:

File stores

Transfer Mode supported

Pull Request

Amazon S3

non-native, third-party

#1492, #1621

Local

non-native, third-party

#1735

Google GCS

non-native, third-party

#1492, #1621

SFTP

non-native

#1725, #1866

Docs

  • Add Sphinx documentation and update the Readme.md #1844 , #29

Misc

  • Add the GitHub workflow to build docs, run pre-commit checks and run all tests as part of CI. #2 , #30 , #1844

  • Add Makefile to build and test locally. #1492 , #5