Comece a spark-shell com mais espaço de heap
./spark-shell --driver-memory 2g
Sajal Sirohi
./spark-shell --driver-memory 2g