Skip to main content
AWS Messaging 0.13.0Last updated in version 0.13.0

Kinesis Firehose Delivery Stream Module

View Source Release Notes

This module creates an Amazon Kinesis Data Firehose.

Destination to Amazon S3​

This module currently only supports a fully managed service for delivering real-time streaming data to Amazon S3 and also deployed lambda for data transformation. Use the var.s3_bucket_arn to specify the s3 destination path and the var.kinesis_stream_arn to specify the kinesis data stream, we also have a Map variable var.processing_configurations which provides a way to configure the attributes for data transformation.

Sample Usage​

main.tf

# ------------------------------------------------------------------------------------------------------
# DEPLOY GRUNTWORK'S KINESIS-FIREHOSE MODULE
# ------------------------------------------------------------------------------------------------------

module "kinesis_firehose" {

  source = "git::git@github.com:gruntwork-io/terraform-aws-messaging.git//modules/kinesis-firehose?ref=v0.13.0"

  # ----------------------------------------------------------------------------------------------------
  # REQUIRED VARIABLES
  # ----------------------------------------------------------------------------------------------------

  # The ARN of the kinesis data stream.
  kinesis_stream_arn = <string>

  # The name of the Kinesis Data Firehose.
  name = <string>

  # The ARN of the S3 bucket you want to export the data to.
  s3_bucket_arn = <string>

  # ----------------------------------------------------------------------------------------------------
  # OPTIONAL VARIABLES
  # ----------------------------------------------------------------------------------------------------

  # The processing configuration for the Kinesis Data Firehose.
  extended_s3_processors = []

}


Reference​

Required​

kinesis_stream_arnstringrequired

The ARN of the kinesis data stream.

namestringrequired

The name of the Kinesis Data Firehose.

s3_bucket_arnstringrequired

The ARN of the S3 bucket you want to export the data to.

Optional​

extended_s3_processorslist(object(…))optional

The processing configuration for the Kinesis Data Firehose.

list(object({
    type = string
    parameters = list(object({
      parameter_name  = string
      parameter_value = string
    }))
  }))
[]