8. Conclusion

Congratulations!

In this tutorial, you have:

  • Understood what Spark clusters are.
  • Created a Spark cluster, utilising the same Conda environment as your notebook.
  • Started a Spark context in a Python notebook.
  • Started a Spark session in an R notebook.
  • Performed Spark calculations in Python and R.
  • Deleted the Spark cluster.

Where next?

You may want to consider these next steps: