Skip to Content

SSH Configurations

I’m spending most of this long discontinuous weekend to run through all the notebooks - while I find this course really helped me get a theoretical understanding of what neural nets are and how they work, I find that it takes me an inordinate amount of time to produce actual code - probably due to the fact that I never wrote anything while doing the course.

So this time around, I’m simply recreating each of the notebooks as quickly as I can, but ensuring that I’m actually implementing everything myself as compared to just running cells in their notebooks

Since I don’t have a GPU on my laptop, I’m using the server that the MIDAS team @IIIT Delhi gave me access to.

The server they have is paltry compared to the insane amounts of computation groups like OpenAI and Google mention so casually in their blog posts and papers - but it’s significantly more than what I need at the moment. Prior to this, I used a Paperspace account, and still have one, but the significant advantage I have here is that I can edit files on the server in real time since the latency is much lower.

Whether I’m using paper space or this server, I wanted to document a little setup that makes getting a notebook up and running even faster than manually running through each of the steps you normally have to do. Quite honestly, this is really trivial, but it shaves a few seconds off my time, so I thought I’d share.

using a ssh config to forward jupyter notebooks on the server to my localmachine

Host paperspace
     HostName  # put your server's ip address/hostname here
     IdentityFile ~/.ssh/id_rsa # point it to your ssh key
     User paperspace
     LocalForward 8888 localhost:8888

Host iiitd
     IdentityFile ~/.ssh/
     User karmanya
     LocalForward 8888 localhost:8888

This one is very straightforward, and the course recommends that you do this in lesson 1 itself. What this does is allow to run to any terminal and simply type in ssh iiitd or ssh paperspace and connect to the server. You’d also need to add your ssh public key to an authorized_hosts file on your server.

Editing the bash profile

I don’t see many people doing this, (and on the IIITD Server it doesn’t make much sense since the server is always running) but on paperspace since you pay per hour, I turn the server off when I’m not using it. I add 2 lines to my ~/.profile file in the server.

conda activate fastai && cd ~/fastai
jupyter notebook

What these do simple activate the conda environment, navigate to the directory where I keep all my notebooks and run jupyter from that directory. I started doing this after I noticed the lines that conda inserts into your bashrc file to explicitly remind you that you always have the base environment activated when you open a terminal and do python-y things. The reason this is in .profile and not .bashrc is that bashrc will cause the commands to run every time you open a terminal as opposed .profile or .bash_profile which will run every time I log into the server.

This setup isn’t permanent, in that I’ll eventually move towards putting things into a docker image, since I’ve been on a docker kick after I saw jesse frazelle’s really cool talk, but yeah. It works well enough for now.