⚙️Google Cloud Dataflow
Also known as Dataflow, Cloud Dataflow, Google Dataflow
Google runs your Beam job for you. You never touch a machine.
Think of it like
It is like a kitchen you rent by the hour. You bring the recipe, and they bring the cooks.
Example
A game studio writes its event pipeline in Beam. Dataflow runs it all day. It adds workers each evening, when most people play.
Why it matters
It is the main reason teams pick Beam. On Google Cloud, it turns a Beam pipeline into a running job with nothing to set up.
Definition
Common mistake
Key takeaways
- 1Beam in. It runs pipelines written in Beam.
- 2No machines. Google starts and stops the workers.
- 3Grows with load. Workers are added when work piles up.