I just noticed that Spark 2.0.2 is already released.
Previously all our testings are done under spark version 1, I think we'll need to look into this newer version. The only problem is that the school linearb computer and Hadoop cluster doesn't have the newest version of spark installed yet. I'll try to install it on my own cluster first.
I just noticed that Spark 2.0.2 is already released.
Previously all our testings are done under spark version 1, I think we'll need to look into this newer version. The only problem is that the school linearb computer and Hadoop cluster doesn't have the newest version of spark installed yet. I'll try to install it on my own cluster first.