Supported Engines¶
SqlTask supports all databases that have a SqlAlchemy dialect and driver. The following engines have dedicated support for the following insert modes:
Database |
Insert mode |
|||
---|---|---|---|---|
Single |
Multirow |
CSV |
Parquet |
|
BigQuery |
Yes |
Yes |
Yes |
|
Postgres |
Yes |
Yes |
Yes |
|
Snowflake |
Yes |
Yes |
Yes |
|
Sql Server |
Yes |
Yes |
||
Sqlite |
Yes |
Yes |
Engines not listed above will default to using multirow inserts if supported, falling back to single row inserts as a last resort.
Engine customization¶
engine_params: Optional dict of parameter that get destructured as keyword arguments for create_engine call in the engine. Allows customization of engine connection pool and such.
For example, to set engine to use a connection pool size of one, pass engine_params = {“pool_size”: 1}