Declaring Data Sources

Tecton Objects

tecton.declarative.BatchSource

Declare a BatchSource, used to read batch data into Tecton.

tecton.declarative.StreamSource

Declare a StreamSource, used to read streaming data into Tecton.

tecton.declarative.RequestSource

Declare a RequestSource, for using request-time data in an OnDemandFeatureView.

Config Classes

tecton.declarative.FileConfig

Configuration used to reference a file or directory (S3, etc.)

tecton.declarative.HiveConfig

Configuration used to reference a Hive table.

tecton.declarative.DatetimePartitionColumn

Helper class to tell Tecton how underlying flat files are date/time partitioned for Hive/Glue data sources.

tecton.declarative.KafkaConfig

Configuration used to reference a Kafka stream.

tecton.declarative.KinesisConfig

Configuration used to reference a Kinesis stream.

tecton.declarative.RedshiftConfig

Configuration used to reference a Redshift table or query.

tecton.declarative.SnowflakeConfig

Configuration used to reference a Snowflake table or query.

tecton.declarative.spark_batch_config

Declare a tecton.declarative.data_source.SparkBatchConfig for configuring a batch source with a Data Source Function.

tecton.declarative.spark_stream_config

Declare an tecton.declarative.data_source.SparkStreamConfig for configuring a stream source with a Data Source Function.

Helpers

tecton.FilterContext

FilterContext is passed as an argument to Data Source Function for time filtering.

Data Source Internal Classes

tecton.declarative.data_source.SparkBatchConfig

Configuration used to define a batch source using a Data Source Function.

tecton.declarative.data_source.SparkStreamConfig

Configuration used to define a stream source using a Data Source Function.