Technology, Data and Science

Advanced Google Dataflow

Once you’ve mastered the basics of Google Dataflow, you may wonder what else you can do with it. This course focuses on more advanced uses for Apache Beam and Dataflow. After providing a quick overview, instructor Kishan Iyer introduces you to stream processing with Dataflow. He shows you how to publish messages to Pub/Sub, access messages published there, and set up a pipeline that works with Pub/Sub and BigQuery. Kishan also goes over how to read and monitor messages on Pub/Sub. Next, he walks you through several different windowing operations and join operations in Dataflow. Kishan covers code-free stream processing, preparing to use Dataflow SQL, executing jobs with Dataflow SQL, and creating parametrized queries with Dataflow SQL. Plus, he discusses how to launch streaming jobs with a template and verify results for a template job.

Note: This course was created by Kishan Iyer. We are pleased to host this training in our library.

Learn More