Architecture & DeploymentΒΆ
Sparkflows can be installed in one of two ways:
- On a standalone machine. In this case all the processing would happen within the single process.
- This can be used to run Sparkflows on your laptop/desktop.
- On the Edge node of a Hadoop/Spark Cluster.
- In this case, the jobs for processing would be submitted to the Hadoop/Spark Cluster.