Developer Guide

• Custom Node Development in Browser
  • Click on CREATE PROCESSORS
  • Execute Code
  • Schema Update Code
  • Testing the custom processor
  • Using the new Processor
  • Export Custom Processors
  • Import Custom Processors
• Custom Node Development & Deployment (Java/Scala)
  • Step 1 : Start by cloning the github repo: writing-new-node
  • Step 2 : Install the Fire core jar to the local maven repository
  • Step 3 : Code the new custom node
  • Step 4 : Create the node JSON file
  • Step 5 : Deploy the Custom Node in the Fire Server
  • Use the custom node in Spark submit when running on the Spark cluster
• Databricks Custom Node Example JSON
  • Execution Code
  • Schema Propagation Code
• Building and Running Custom Node
  • Install the scorecardpy dependencies
  • Go to Custom Processors
  • Click on CREATE PROCESSORS
  • Execute Code
  • Schema Update Code
  • Using the new Processor