PubSub
    • Dark
      Light

    PubSub

    • Dark
      Light

    Article Summary

    This article is specific to the following platforms - BigQuery - Delta Lake.

    Cloud Pub/Sub

    The Cloud Pub/Sub component allows messages to be published to a topic on Google Cloud Platform (GCP). Other applications can subscribe to these topics to receive such messages. The end result is fast, reliable, and secure communication between GCP services applications.

    To publish messages from Matillion ETL, you must first ensure that topics are available to publish to (and ideally, that relevant applications are subscribed to these topics). To view, edit, and create topics, visit the Topics GCP page while logged into your GCP account and project.

    Official help for getting starting with Cloud Pub/Sub can be found here.


    Properties

    PropertySettingDescription
    NameStringA human-readable name for the component.
    ProjectSelectSelect the name of the GCP project to use. The chosen project must be affiliated with the GCP account connected to Matillion ETL.
    TopicSelectThe name of the topic to publish to. Matillion ETL will automatically gather topics available to your project. To view and create topics, navigate to Pub/Sub→Topics from the main upper-left menu on the GCP dashboard or follow this link.
    MessageStringInput the contents of the message.
    AttributesKey-value PairsAssign key-value pairs to be included with the message to be used by the subscribed application. These may commonly be data regarding the message itself.