FTP
FTP/SFTP Data Connector Documentation
FTP (File Transfer Protocol) and SFTP (SSH File Transfer Protocol) are network protocols used for transferring files between a client and server, with FTP being less secure and SFTP providing encrypted file transfer over SSH.
The FTP/SFTP Data Connector enables federated/accelerated SQL query across supported file formats stored in FTP/SFTP servers.
Configuration
from
from
The from
field takes one of two forms: ftp://<host>/<path>
or sftp://<host>/<path>
where <host>
is the host to connect to and <path>
is the path to the file or directory to read from.
If a folder is provided, all child files will be loaded.
name
name
The dataset name. This will be used as the table name within Spice.
Example:
params
params
FTP
file_format
ftp_port
Optional, specifies the port of the FTP server. Default is 21. E.g. ftp_port: 21
ftp_user
The username for the FTP server. E.g. ftp_user: my-ftp-user
ftp_pass
client_timeout
Optional. Specifies timeout for FTP connection. E.g. client_timeout: 30s
. When not set, no timeout will be configured for FTP client.
hive_partitioning_enabled
Optional. Enable partitioning using hive-style partitioning from the folder structure. Defaults to false
SFTP
file_format
sftp_port
Optional, specifies the port of the SFTP server. Default is 22. E.g. sftp_port: 22
sftp_user
The username for the SFTP server. E.g. sftp_user: my-sftp-user
sftp_pass
client_timeout
Optional. Specifies timeout for SFTP connection. E.g. client_timeout: 30s
. When not set, no timeout will be configured for SFTP client.
hive_partitioning_enabled
Optional. Enable partitioning using hive-style partitioning from the folder structure. Defaults to false
Examples
Connecting to FTP
Connecting to SFTP
Last updated
Was this helpful?