FAQ

• Scheduling Workflows
  • How can I schedule the workflows I create ?
• Custom Nodes
  • Does Fire Insights allow me to create my own custom nodes?
• Distributions Supported
  • What distributions or platforms are supported with Sparkflows?
  • Can I run Sparkflows on my Amazon AWS cluster or Microsoft Azure or Google Cloud?
• Workflow Export - Import
  • How does one export/import workflows between instances?
• Submit Apache Spark Jobs
  • When running on a Apache Spark cluster how does Sparkflows submit the spark jobs?
• Multi User Support
  • How does the Sparkflows platform handle multi-user support (i.e. Can user 1 see or edit user 2’s data sources, pipelines, etc)
• Data Sources
  • How does one define a new data source and establish a connection?
• Hadoop Installation Pre-Requisites
  • Linux
  • JDK
  • Disable IPV6
  • Selinux
  • Steps Involved in Installing Hadoop
  • After Installation of Cloudera Manager
  • Add proxy user in HDFS
  • Create HDFS directory
  • Install Spark2
  • Login Again into Cloudera Manager
  • In YARN increase Container memory to 8GB
  • AFTER INSTALLATION GET CDH TO USE JAVA 8
  • Install Sparkflows
  • Upload the Fire Insights example data directory onto HDFS
  • Log into Fire Insights