relational.read

Read a table from an SQL-compatible data store

Properties

Name	Type	Description	Required
batch_size	`integer`	Maximum number of records yielded per downstream batch. Default: `1000` Minimum: `1`	no
connection (The connection to use for loading)	`string`	Logical connection name as defined in the connections.dy.yaml	yes
schema (The table schema of the table)	`string`	If left blank, the default schema of this connection will be used as defined in the connections.dy.yaml	no
table (The table name)	`string`	Table name	yes
columns (Optional subset of columns to load)	`array`		no
fetch_size	`integer`	Driver-level rows fetched per round-trip. Defaults to 10000. Default: `10000` Minimum: `1`	no

Example

id: read_snowflake
type: relational.read
properties:
  connection: eu_datalake
  table: employees
  schema: dbo

columns[]: Optional subset of columns to load

Items: name of column

No properties.

Example

- fname
- lname: last_name