Requirements:
- Node v21.5.0
- Java 8 or 11
- Scala 2.12
- SBT 1.3.13
- IntelliJ IDEA with Scala and SBT plugins
- Visual Studio Code
-
Clone the repository:
git clone https://github.com/dataflint/spark.git cd spark
-
Set up the Spark Plugin:
- Open the
spark-plugin
folder with IntelliJ IDEA - Ensure Scala and SBT plugins are installed in IntelliJ
- Open the
-
Set up the UI:
- Open the repository with Visual Studio Code
- Install UI dependencies:
cd spark-ui npm install
-
Build the UI for the plugin:
cd spark-ui npm run deploy
-
(Optional) Install Local CORS Proxy (LCP) for local development:
brew install lcp
-
Run one of the examples in the
spark-examples-351
project using IntelliJ -
Access the Spark UI:
- Browse to
http://localhost:10000
- Open DataFlint successfully
- Browse to
For live frontend development, follow these steps:
-
Start the development server and proxy:
cd spark-ui npm run start npm run proxy
-
Access the development UI:
- Browse to
http://localhost:4000
- This should run the DataFlint UI with live reloading
- Browse to
- Please ensure your code follows the project's coding standards
- Submit pull requests for review
Thank you for contributing to DataFlint!