Google has expanded the capabilities of its Cloud Logger with the beta of Cloud Logging Connector.
This will allow for users to stream logs to Google Cloud Pub/Sub, which adds the capability to stream log data to users’ own endpoints and further expands the ability to make Big Data useful.
By using Cloud Pub/Sub, users have access to real-time messaging on one global, managed service that can help create more reliable and flexible applications. This system allows for users to push log events to another Webhook, or to pull them in as they happen.
The Cloud Logging Connector makes the use of the multiple tools from the company simpler, with tools such as Dataflow being able to benefit more from the interconnectivity.
Cloud Dataflow, allows users to build, deploy and run data processing pipelines at any scale and with the use of the Cloud Pub/Sub export mechanism, users can combine different log tables for correlation, as well as parse and enrich the data for custom needs.