Skip to content

Instantly share code, notes, and snippets.


Riccardo Maldini maldins46

View GitHub Profile
maldins46 /
Last active July 1, 2021 15:14
Connect to Unibo Hadoop cluster via Unix terminal

Connect to Unibo Hadoop Cluster via Unix terminal, for lab sessions

During our Big Data lab sessions, we use PuTTY and WinSCP to connect to the Hadoop cluster. This solution cannot be accomplished from students with a Linux/MacOS device, as these programs are not available outside Windows.

On live sessions, it is easy to do this using Guacamole; but if you want to use Spark outside of lab hours, different solutions are required.

As I'm following lessions with a MacOS device, I was searching a rapid solution to do this, without installing too much external software. I found a way to go using ssh and scp via terminal (tested with bash or zsh), that are pre-installed into the majority of MacOS and Linux systems.