Jupyter \index{jupyter} is an open-source web-based notebook tool that you can use as your development environment.
Jupyter \index{jupyter} is an open-source web-based notebook tool that you can use as your development environment.
A coding notebook enables you to intermix markdown and code blocks that you can execute in a single document. This is heavily used in the education and research fields because it makes writing reports easy and reproducible. With Jupyter you can create content that has live code, equations, visualizations and explanatory text.
A coding notebook enables you to intermix markdown and code blocks that you can execute in a single document. This is heavily used in education and research fields because it makes writing reports easy and reproducible. With Jupyter you can create content that has live code, equations, visualizations and explanatory text. Jupyter is a
Jupyter Lab extends the basic notebook functionality and provides you a full web environment to work in. Using this interface you can open terminals, manage files, and even tile multiple editors.
Jupyter Lab extends the basic Jypyter notebook functionality and provides you a full web environment to work in. Using this interface you can open terminals, manage files, and even tile multiple editors.
Applications of Jupyter Jab:
Applications of Jupyter Jab:
\begin{itemize}
\begin{itemize}
\item Quick experimentation
\item Quick experimentation
\item Telling a story with data
\item Writing a report
\item Writing a report
\item Sharing code snippets for education
\item Sharing code snippets for education
\item Generating graphics
\end{itemize}
\end{itemize}
In this document we are going to go over the basic installation and usage of Jupyter Lab for personal use developing python\index{python}. In the advanced usage section we go over how to use Jupyter on a remote server. This is particularly useful when you want to run algorithms on a remote computer.
This document goes over the basic installation and usage of Jupyter Lab for personal development.
In the advanced usage section we go over how to use Jupyter\index{jupyter} on a remote server.
\section{Installation}
\section{Installation}
To install, first go to \href{https://jupyterlab.readthedocs.io/en/stable/getting_started/installation.html}{Jupyter Install}\footnote{\url{ https://jupyterlab.readthedocs.io/en/stable/getting_started/installation.html}}for a detailed guide. This user document assumes that you install Jupyter Lab. \textbf{Do Not Only Install Jupyter Notebook. }
Full installation instructions can be found on the Jupyter website. \footnote{\url{ https://jupyterlab.readthedocs.io/en/stable/getting_started/installation.html}}This user document goes over how to install Jupyter Lab.
\subsection{Prerequisites}
\subsection{Prerequisites}
In order to install Jupyter, you must have Python installed. Your version of Python \textbf{must be 3.3 or greater}. As part of having Python, you will also have pip. Click \href{https://www.python.org/downloads/}{here}\footnote{\url{ https://www.python.org/downloads/}} for the latest version of Python.
In order to install Jupyter Lab, you must have Python installed. Your version of Python \textbf{must be 3.3 or greater}.
As part of having Python, you will also need to have PIP. Although PIP usually comes with your Python installation, there are some exceptions on Linux where you have to install the two seperately.
Go to the Python\index{python} website\footnote{\url{ https://www.python.org/downloads/}} to download the latest version of Python.
However, we highly recommend you take the time now to install \href{https://docs.conda.io/projects/conda/en/latest/user-guide/install/}{Conda}\index{anaconda}now because it'll be helpful later one with some of the more advanced features of Jupyter as well as machine learning focused Python.
We highly recommend you take the time to install \href{https://docs.conda.io/projects/conda/en/latest/user-guide/install/}{Conda}\index{anaconda}because it will be helpful later on with some of the more advanced features of Jupyter as well as machine learning in Python.
You should also have either Firefox, Chrome or Safari as these are the only browsers Jupyter\index{jupyter} is currently known to work with.
You should also have either Firefox, Chrome, or Safari because these are the only browsers Jupyter\index{jupyter} is currently known to work well with.
\subsection{Installation on Linux}
\subsection{Installation on Linux}
There a two ways of installing Jupyter on Linux.\\
There are two ways of installing Jupyter on Linux.\\
\\
\\
Using pip\index{pip} the command is \textbf{pip install jupyterlab}.\\
Using pip\index{pip}, the command is:.\\
\begin{lstlisting}
$pip install jupyterlab
\end{lstlisting}
\\
\\
Using conda the command is \textbf{conda install -c conda-forge jupyterlab}
Using conda, the command is:
\begin{lstlisting}
$conda install -c conda-forge jupyterlab
\end{lstlisting}
\subsection{Installation on Windows}
\subsection{Installation on Windows}
Installation on Windows is the same as installation on Linux except that you must also add the user-level bin directory if you installed using \textbf{pip install --user}.
Installation on Windows is the same as installation on Linux except that you must also use the flag to install at a user level if you don't want to run the command as an administrator:
\begin{lstlisting}
>pip install jupyterlab --user
\end{lstlisting}
\section{Usage}
\section{Usage}
To run Jupyter Lab, open your computer's command terminal and enter the following command. This will open Jupyter Lab in your default web browser.
To run Jupyter Lab, open your computer's command terminal and enter the following command. This will open Jupyter Lab in your default web browser.
\texttt{jupyter lab}
\begin{lstlisting}
jupyter lab
\end{lstlisting}
\tabfigref{fig:jupyterlablauncher} is what you will see upon first running Jupyter Lab. Otherwise, it can open to the most recent notebook you were working on.
Figure 1 is what you will see upon first running Jupyter Lab. Otherwise, it will open to the most recent notebook you were working on.
\begin{figure}[h!]
\begin{figure}[h!]
\centering
\centering
@ -139,42 +182,44 @@ To run Jupyter Lab, open your computer's command terminal and enter the followin
\subsection{Navigation}
\subsection{Navigation}
Once Jupyter Lab is running, you will see on the left side of the screen a column of icons. Each icon will open a different panel to the right of it when you click it. From top to bottom, these icons have the following functions:
Once Jupyter Lab is running, you will see on the left side of the window a column of icons.
Each icon will open a different panel to the right when clicked.
\begin{itemize}
\begin{itemize}
\item File Browser (folder icon): displays a file browser for the user to open, move, or delete their files.
\item File Browser (folder icon): displays a file browser for the user to open, move, or delete their files.
\item Running Terminals and Kernels (square stop button inside a circle): shows the user all currently active terminal and kernel sessions.
\item Running Terminals and Kernels (square stop button): shows the user all currently active terminal and kernel sessions.
\item Commands (palette icon): allows the user to enter various commands into Jupyter Lab.
\item Commands (palette icon): allows the user to enter various commands into Jupyter Lab.
\item Notebook Tools (wrench icon): shows various options for the user's current notebook.
\item Notebook Tools (wrench icon): shows various options for the user's current notebook.
\item Open Tabs (a tabbed window icon): lists all currently open tabs in Jupyter Lab.
\item Open Tabs (a tabbed window icon): lists all currently open tabs in Jupyter Lab.
\end{itemize}
\end{itemize}
Additionally, the top toolbar contains the following different drop-down menus: File, Edit, View, Run, Kernel, Tabs, Settings, and Help.
Additionally, the top toolbar contains the following different drop-down menus: "File", "Edit", "View", "Run", "Kernel", "Tabs", "Settings", and "Help".
\subsection{Creating a Notebook}
\subsection{Creating a Notebook}
To create a notebook (the working document for both python code and text markdown) from the launcher (\tabfigref{fig:jupyterlablauncher}), click on the Python 3 icon under the orange notebook symbol. Alternatively, if you don't have the launcher open, you can click on File in the toolbar, click New, and finally click Notebook.
To create a notebook from the launcher (figure 1), click on the Python 3 icon under the orange notebook symbol. Alternatively, if you don't have the launcher open, you can click on "File" in the toolbar, click "New", and finally click "Notebook".
This will open an empty, untitled notebook. If you right click on the tab above, or on the name of your notebook in the "Open Tabs" panel on the left, you can rename your notebook.
This will open an empty, untitled notebook. If you right click on the tab above, or on the name of your notebook in the "Open Tabs" panel on the left, you can rename your notebook.
\subsection{Running a Notebook}
\subsection{Running a Notebook}
With a notebook open, you can start writing in the editor, the big empty area on the right half of the screen. Just above the editor, you will find the icon to save the open notebook.
With a notebook open, you can start writing in the editor-- the big empty area on the right half of the screen. Just above the editor, you will find the icon to save the open notebook.
There are also a number of icons that directly relate to the "cells" you are writing in. A cell is either python code, markdown, or raw text. You can change what type of text a cell is by clocking on the drop-down menu just above the editor that will say either "Code", "Markdown", or "Raw".
There are also a number of icons that directly relate to the cells you are modifying. A cell may contain either Python\index{python} code, markdown\index{markdown}, or raw text. You can change what type of text a cell is by clicking on the drop-down menu just above the editor that will say either "Code", "Markdown", or "Raw".
Notebooks work through these cells, in order from top to bottom. The icons above the editor, from left to right, do the following:
The icons above the editor, from left to right, do the following things:
\begin{itemize}
\begin{itemize}
\itemadd a cell after the currently selected cell.
\itemcut the currently selected cells.
\itemcopy the selected cells.
\itempaste the cells from the clipboard.
\itemrun the selected cells and advance to the next cell.
\iteminterrupt the kernel.
\itemand restart the kernel.
\itemAdd a cell after the currently selected cell.
\itemCut the currently selected cell.
\itemCopy the selected cell.
\itemPaste the cell from the clipboard.
\itemRun the selected cells and advance to the next cell.
\itemInterrupt the kernel.
\itemRestart the kernel.
\end{itemize}
\end{itemize}
The following example shows how to write code, run code, and insert raw text into the notebook. First, write some python code and click the "Run selected cells and advance" button (circled in red in the figure below). Our output is shown in the next figure (output is given its own unique cell immediately after the cell that produced it).
The following example shows how to write code, run code, and insert raw text into the notebook. First, write some python code and click the "Run selected cells and advance" button (circled in red in the figure below). Our output is shown in figure 2. When a notebooks runs all cells, it executes top to bottom.
\begin{figure}[h!]
\begin{figure}[h!]
\centering
\centering
@ -190,7 +235,10 @@ The following example shows how to write code, run code, and insert raw text int
\label{fig:codeafterrunning}
\label{fig:codeafterrunning}
\end{figure}
\end{figure}
You can also insert raw text into your document, as shown below. To do this, change the drop-down menu from Code (or Markdown) to Raw, and type what you want in the cell.
You can also insert raw text into your document, as shown below.
To do this, change the drop-down menu from "Code" (or "Markdown") to "Raw", and type what you want in the cell.
This is demonstrated in figure 4.
\begin{figure}[h!]
\begin{figure}[h!]
\centering
\centering
@ -200,73 +248,81 @@ You can also insert raw text into your document, as shown below. To do this, cha
\end{figure}
\end{figure}
\subsection{Exporting Notebooks}
\subsection{Exporting Notebooks}
In order to export the document, click the \textbf{File} tab, mouse down to \textbf{Export Notebook As...} and then click any of the myriad of formats to export as that format. The most popular export formats are PDF, Markdown \index{markdown}, and HTML.
In order to export the document, click the \textbf{File} tab, mouse down to \textbf{Export Notebook As...} and then click a desired format-- Jupyter supports a lot of format types.
The most popular export formats are PDF, Markdown\index{markdown}, and HTML.
\subsection{Customization}
\subsection{Customization}
Customization of Jupyter is in general exceptionally easy.\\
In general, customization of Jupyter easy.\\
\\
\\
In order to change the theme, one simply needs to go to the \textbf{Settings} tab and drop down to JupyterLab Theme. This will allow you to change from light to dark mode as well as the font sizes for the code, content and UI.\\
To change the Jupyter theme, go to the "Settings" tab and drop down to Jupyter\index{jupyter}Lab Theme. This will allow you to change from light to dark mode as well as the font sizes for the code, content and UI.\\
\\
\\
Scrolling down the rest of the Settings you see many other things that can be customized.\\
Scrolling down the rest of the settings you see many other things that can be customized.\\
\\
\\
Advanced settings allows you to customize many aspects of Jupyter Lab such as keyboard shortcuts, terminal settings, and a myriad of others. \tabfigref{fig:configuration} shows the configuration menu for Jupyter Lab.
Advanced settings allows you to customize many aspects of Jupyter Lab such as keyboard shortcuts, terminal settings, and a myriad of others. Figure 5 shows the configuration menu for Jupyter\index{jupyter} Lab.
\begin{figure}[h!]
\begin{figure}[h!]
\centering
\centering
\includegraphics[width=15cm]{settings.jpg}
\includegraphics[width=15cm]{settings.jpg}
\caption{Code after being run}
\caption{Settings window}
\label{fig:configuration}
\label{fig:configuration}
\end{figure}
\end{figure}
\section{Advanced Usage}
\section{Advanced Usage}
In this section we are going to go over how to use multiple programming languages in Jupyter\index{jupyter} and how to connect to your Jupyter Lab instance remotely.
This section goes over how to use multiple programming languages in Jupyter\index{jupyter} and how to connect to your Jupyter Lab instance remotely.
\subsection{Multiple Kernels}
\subsection{Multiple Kernels}
Adding a Kernel in Jupyter enables you to program with another programming language like R\index{r} or Scala\index{scala}.
Up to this point we have been working with the python kernel\index{python} which enables you to make python notebooks. The ability to use multiple kernels is useful for education and having cohesion within one IDE\index{IDE}.
Adding a Kernel in Jupyter enables you to program with another programming language, such as R\index{r} or Scala\index{scala}.
Up to this point, we have been working with the Python kernel\index{python} which enables you to make python notebooks. The ability to use multiple kernels is useful for education and having cohesion within one IDE\index{IDE}.
You can view a complete list of kernels can be found on Jupyter's Github wiki.\footnote{\url{https://github.com/jupyter/jupyter/wiki/Jupyter-kernels}}
\begin{figure}[h!]
\begin{figure}[h!]
\centering
\centering
\includegraphics[width=50mm]{exampleKernels.PNG}
\includegraphics[width=50mm]{exampleKernels.PNG}
\caption{Example of multiple kernels}
\caption{Example of multiple kernels installed}
\label{fig:multKernels}
\label{fig:multKernels}
\end{figure}
\end{figure}
\tabfigref{fig:jupyter_server} shows an example of what your launcher would look like with multiple kernels installed.
The most common way to install a kernel is by using the Anaconda\index{anaconda} prompt, pip\index{pip} support is limited here.
Once you start adding multiple kernels, it is best if you start running Jupyter Lab through docker\index{docker} because it would make porting it to another computer easier. A popular docker jupyter lab instance with Scala, Python, and R can be found here:
Figure 6 shows an example of what your launcher would look like with multiple kernels installed.
The most common way to install a kernel is by using the Anaconda\index{anaconda} prompt -- pip\index{pip} support is limited here.
Once you start adding multiple kernels, it is best if you start running Jupyter Lab through Docker\index{docker} because it would make porting it to another computer easier. A popular Docker Jupyter lab instance with Scala, Python, and R can be found on Jupyter's Docker hub profile\footnote{\url{https://hub.docker.com/u/jupyter/}}.
\subsection{Remote Connection}
\subsection{Remote Connection}
If you have a firewall Jupyter Lab will only be available on your
local machine at "localhost:8888", however, it is possible to connect to Jupyter Lab from remote computers.
This is helpful because you can connect to the same Jupyter instance from multiple computers. This would also save you resources on your local computer so you can program on a lightweight chrome-book that would not be able to run a full IDE\index{IDE} like Pycharm\index{pycharm}.
If you have a firewall, Jupyter Lab will only be reachable on your
local machine at "localhost:8888".
However, it is possible to connect to Jupyter Lab from remote computers.
Remote access is helpful since it enables multiple people to connect to the same Jupyter instance. This would also save you resources on your local machine so you can program on a lightweight chrome-book that would not be able to run a full IDE\index{IDE} like Pycharm\index{pycharm}.
The first step to enable remote host would be to set a password that you can connect to the notebook using. You can set a password that you use to log into the website using the following command:
The first step to enable remote host would be to set a password that you can connect to the notebook using. You can set a password that you use to log into the website by executing the following command in a terminal:
\texttt{jupyter notebook password}
\begin{lstlisting}
jupyter notebook password
\end{lstlisting}
The Second step would be to launch the Jupyter Lab instance in a headless environment -- it never launches a web browser.
The second step would be to launch the Jupyter Lab instance in a headless environment -- it never launches a web browser.
A headless environments means that you never launch a GUI and it operates solely as a console application.
\texttt{jupyter lab --no-browser --port=6000}
\begin{lstlisting}
jupyter lab --no-browser --port=6000
\end{lstlisting}
The final step is to connect to the Jupyter Lab instance from your
The final step is to connect to the Jupyter Lab instance from your
remote computer. The easiest way to do this is via a local port
forward in SSH\index{ssh}. This command essentially forwards all of the traffic on your local machine on a specific port to a remote computer over a ssh connection. The main benefit of doing this is that all the traffic over the connection is encrypted.
remote computer.
The easiest way to do this is via a local port forward in SSH\index{ssh}.
The command at listing 1 forwards all of the traffic from your local machine to a specific port on a remote computer over a SSH connection.
The main benefit of SSH is that all the traffic over the connection is encrypted.
\tabfigref{fig:jupyter_server} shows an overview of what the network architecture looks like.
Figure 7 shows an overview of what the network architecture looks like.
\begin{lstlisting}[caption=SSH command for local port forwarding]
ssh -L 6000:localhost:6000 user@remote-host
\end{lstlisting}
\begin{figure}[h!]
\begin{figure}[h!]
\centering
\centering
@ -275,8 +331,8 @@ forward in SSH\index{ssh}. This command essentially forwards all of the traffic
\label{fig:jupyter_server}
\label{fig:jupyter_server}
\end{figure}
\end{figure}
After you execute the command above on your remote computer you
would be able to access your Jupyter Lab instance on your computer's "localhost:6000".
After you execute the command above on your remote computer, you
will be able to access your Jupyter Lab instance at "localhost:6000" even though it is only running on the remote computer at port 6000.
\newpage
\newpage
@ -284,15 +340,16 @@ would be able to access your Jupyter Lab instance on your computer's "localhost:
\begin{itemize}[label={}]
\begin{itemize}[label={}]
\item{\bf Anaconda}: Anaconda is a package manager for the R and Python languages aimed towards data science" \footnote{\url{ https://www.anaconda.com}}.\index{anaconda}\\
\item{\bf Anaconda}: Anaconda is a package manager for the R and Python languages aimed towards data science" \footnote{\url{ https://www.anaconda.com}}.\index{anaconda}\\
\item{\bf IDE}: Interactive Development Environment.\index{IDE}\\
\item{\bf IDE}: Interactive Development Environment-- some popular IDEs are Pycharm, Netbeans, and Visual Studio.\index{IDE}\\
\item{\bf Jupyter}: Nonprofit organization created to "develop open-source software, open-standards, and services for interactive computing across dozens of programming languages" \footnote{\url{ https://jupyter.org/}}.\index{jupyter}\\
\item{\bf Jupyter}: Nonprofit organization created to "develop open-source software, open-standards, and services for interactive computing across dozens of programming languages" \footnote{\url{ https://jupyter.org/}}.\index{jupyter}\\
\item{\bf Markdown(MD)}: Lightweight markup-language -- used to define layout and style for a document \footnote{\url{https://en.wikipedia.org/wiki/Markdown}}.\index{markdown}\\
\item{\bf pip}: Tool for installing and managing python packages \footnote{\url{ https://pypi.org/project/pip/}}.\index{pip}\\
\item{\bf pip}: Tool for installing and managing python packages \footnote{\url{ https://pypi.org/project/pip/}}.\index{pip}\\
\item{\bf Pycharm}: A popular versitile python IDE developed by \href{https://www.jetbrains.com/}{Jetbrains}.\index{IDE}\\
\item{\bf Pycharm}: A popular versatile Python IDE developed by \href{https://www.jetbrains.com/}{Jetbrains}.\index{IDE}\\
\item{\bf Python}: High-level interpreted, general purpose programming language \footnote{\url{ https://www.python.org/}}.\index{python}\\
\item{\bf Python}: High-level interpreted, general purpose programming language \footnote{\url{ https://www.python.org/}}.\index{python}\\
\item{\bf R}: Programming language for statistical computing and graphics \footnote{\url{ https://www.r-project.org/}}.\index{r}\\
\item{\bf R}: Programming language for statistical computing and graphics \footnote{\url{ https://www.r-project.org/}}.\index{r}\\
\item{\bf Scala}: General purpose functional programming language that runs on the JVM \footnote{\url{ https://scala-lang.org/}}.\index{scala}\\
\item{\bf Scala}: General purpose functional programming language that runs on the JVM \footnote{\url{ https://scala-lang.org/}}.\index{scala}\\
\item{\bfssh}: Secure Socket Shell -- used in connecting to a remote computer over a encrypted channel.\index{ssh}\\
\item{\bfSSH}: Secure Socket Shell -- used in connecting to a remote computer over a encrypted channel.\index{ssh}\\
Jeffery Russell
4 years ago
