Introduction ¶
Why HoloViews? ¶
HoloViews is an open-source Python 2 and 3 library for data analysis and visualization. Python already has excellent tools like numpy, pandas, and xarray for data processing, and bokeh and matplotlib for plotting, so why yet another library?
HoloViews helps you understand your data better, by letting you work seamlessly with both the data and its graphical representation.
HoloViews focuses on bundling your data together with the appropriate metadata to support both analysis and visualization, making your raw data and its visualization equally accessible at all times. This process can be unfamiliar to those used to traditional data-processing and plotting tools, and this getting-started guide is meant to demonstrate how it all works at a high level. More detailed information about each topic is then provided in the User Guide .
With HoloViews, instead of building a plot using direct calls to a plotting library, you first describe your data with a small amount of crucial semantic information required to make it visualizable, then you specify additional metadata as needed to determine more detailed aspects of your visualization. This approach provides immediate, automatic visualization that can be effortlessly requested at any time as your data evolves, rendered automatically by one of the supported plotting libraries (such as Bokeh or Matplotlib).
Tabulated data: subway stations ¶
To illustrate how this process works, we will demonstrate some of the key features of HoloViews using a collection of datasets related to transportation in New York City. First let's run some imports to make numpy and pandas accessible for loading the data. Here we start with a table of subway station information loaded from a CSV file with pandas:
import pandas as pd
import numpy as np
import holoviews as hv
hv.extension('bokeh')
This is the standard way to make the numpy and pandas libraries available in the namespace. We recommend always importing HoloViews as
hv
and if you haven't already installed HoloViews, check out the install instructions on our
homepage
.
Note that after importing HoloViews as
hv
we run
hv.extension('bokeh')
to load the bokeh plotting extension, allowing us to generate visualizations with
Bokeh
. In the next section we will see how you can use other plotting libraries such as
matplotlib
and even how you can mix and match between them.
Now let's load our subway data using pandas:
station_info = pd.read_csv('../assets/station_info.csv')
station_info.head()
We see that this table contains the subway station name, its latitude and longitude, the year it was opened, the number of services available from the station and ther names, and finally the yearly ridership (in millions for 2015).
Elements
of visualization
¶
We can immediately visualize some of the the data in this table as a scatter plot. Let's view how ridership varies with the number of services offered at each station:
scatter = hv.Scatter(station_info, 'services', 'ridership')
scatter
Here we passed our dataframe to
hv.Scatter
to create an
object
called
scatter
, which is independent of any plotting library. HoloViews provides a wide range of Element types, all visible in the
Reference Gallery
.
In this example,
scatter
is a simple wrapper around our dataframe that knows that the 'services' column is the independent variable, normally plotted along the x-axis, and that the 'ridership' column is a dependent variable, plotted on the y-axis. These are our
dimensions
which we will describe in more detail a little later.
Given that we have the handle
scatter
on our
Scatter
object, we can show that it is indeed an object and not a plot by printing it:
print(scatter)
The bokeh plot above is simply the rich, visual representation of
scatter
which is plotted automatically by HoloViews and displayed automatically in the
Jupyter notebook
. Although HoloViews itself is independent of notebooks, this convenience makes working with HoloViews easiest in the notebook environment.
Compositional
Layouts
¶
The class
Scatter
is a subclass of
Element
. As shown in our
element gallery
, Elements are the simplest viewable components in HoloViews. Now that we have a handle on
scatter
, we can demonstrate the compositionality of these objects:
layout = scatter + hv.Histogram(np.histogram(station_info['opened'], bins=24), kdims=['opened'])
layout
In a single line using the
+
operator, we created a new, compositional object called a
Layout
built from our scatter visualizations and a
Histogram
that shows how many subway stations opened in Manhattan since 1900. Note that once again, all the plotting is happening behind the scenes. The
layout
is a not a plot, it's a new object that exists independently of any given plotting system:
print(layout)
Array data: taxi dropoffs ¶
So far we have visualized data in a
pandas
DataFrame
but
HoloViews
is as agnostic to data formats as it is to plotting libraries; see
Customizing Plots
for more information. This means we can work with array data as easily as we can work with tabular data. To demonstrate this, here are some
numpy arrays
relating to taxi dropoff locations in New York City:
taxi_dropoffs = {hour:arr for hour, arr in np.load('../assets/hourly_taxi_data.npz').items()}
#print('Hours: {hours}'.format(hours=', '.join(taxi_dropoffs.keys())))
print('Taxi data contains {num} arrays (one per hour).\nDescription of the first array:\n'.format(num=len(taxi_dropoffs)))
np.info(taxi_dropoffs['0'])
As we can see, this dataset contains 24 arrays (one for each hour of the day) of taxi dropoff locations (by latitude and longitude), aggregated over one month in 2015. The array shown above contains the accumulated dropoffs for the first hour of the day.
bounds = (-74.05, 40.70, -73.90, 40.80)
image = hv.Image(taxi_dropoffs['0'], ['lon','lat'], bounds=bounds)
HoloViews supports
numpy
,
xarray
,
iris
, and
dask
arrays when working with array data (see
Gridded Datasets
). We can also compose elements containing array data with those containing tabular data. To illustrate, let's pass our tabular station data to a
Points
element which is used to mark positions in two-dimensional space:
points = hv.Points(station_info, ['lon','lat'])
image + image * points
On the left, we have the visual representation of the
image
object we declared. Using
+
we put it into a
Layout
together with a new compositional object created with the
*
operator called an
Overlay
. This particular overlay displays the station positions on top of our image which works correctly as both elements contain data that exist in the same space, namely New York City.
This overlay on the right lets us see the location of all the subway stations in relation to our midnight taxi dropoffs. Of course, HoloViews allows you to visually express more of the available information with our points. For instance, you could represent the ridership of each subway by point color or point size. For more information see Customizing Plots .
dictionary = {int(hour):hv.Image(arr, ['lon','lat'], bounds=bounds)
for hour, arr in taxi_dropoffs.items()}
hv.HoloMap(dictionary, kdims='Hour')
This is yet another object which is rendered by the HoloViews plotting system with Bokeh behind the scenes:
holomap = hv.HoloMap(dictionary, kdims='Hour')
print(holomap)
As this a
HoloMap
is a container for our
Image
elements, we can use the methods it offers to return new containers. For instance, in the next cell we select three different hours of the morning from the
HoloMap
and display them as a
Layout
:
holomap.select(Hour={3,6,9}).layout()
Here the
select
method picks values from the specified 'Hour' dimension. The various Elements like
Scatter
and
Image
all accept two types of dimensions:
key dimensions
(i.e., indexing dimensions or independent variables), and
value dimensions
(resulting data or dependent variables). These attributes are named
kdims
and
vdims
, respectively, and can be passed as the second and third positional argument for all Elements other than Histogram. As you can see above, the `HoloMap
of
Image
s also has a
kdims
argument, allowing it to be indexed over those dimensions. The
kdims
and
vdims`` accept either single dimensions or lists of dimensions, and let you express the space in which your data lives.
Note how the
Image
elements where the holomap is constructed are declared using key dimensions of
['lat','lon']
which describes the fact that New York City is being viewed in terms of longitude and latitude. This semantic information is automatically mapped to our visualization by the HoloViews plotting system, which sets the x-axis and y-axis labels accordingly. In the case of the
HoloMap
we used a key dimension of
'Hour'
to declare that the interactive slider ranges over the hours of the day.
%%opts Image [xrotation=90] Points (color='deepskyblue' marker='v' size=6)
hotspot = points.select(lon=(-73.99, -73.96), lat=(40.75,40.765))
composition = holomap * hotspot
composition
The line starting with
%%opts
used to specify the visual style is part of the HoloViews options system described in the next 'Getting started' section which also describes how to achieve the same effect with standard Python syntax.
In the cell above we created and styled a composite object within a few short lines of code. Furthermore, this composite object relates tabular and array data and is immediately presented in a way that can be explored interactively. This way of working enables highly productive exploration, allowing new insights to be gained easily. For instance, after exploring with the slider we notice a hotspot of taxi dropoffs at 7am which we can select as follows:
composition.select(Hour=7)
We can now see that the slice of subway locations was chosen in relation to the hotspot in taxi dropoffs around 7am in the morning. This area of Manhattan just south of Central Park contains many popular tourist attractions, including Times Square, and we can infer that tourists often take short taxi rides from the subway stations into this area.
At this point it may appear that HoloViews is about easily generating explorative, interactive visualizations
from
your data. In fact, as we have been building these visualizations we have actually been working
with
our data, as we can show by examining the
.data
attribute of our sliced subway locations:
hotspot.data
We see that slicing the HoloViews
Points
object in the visualization sliced the underlying data, with the structure of the table left intact. We can see that the Times Square 42nd Street station is indeed one of the subway stations surrounding our taxi dropoff hotspot. This seamless interplay and exchange between the raw data and easy-to-generate visualizations of it is crucial to how HoloViews helps you understand your data.
Onwards ¶
The next getting-started section shows how to do Customization of the visual appearance of your data, allowing you highlight the most important features and change the look and feel. Other related topics for deeper study:
- The above plots did not require any special geographic-data support, but when working with larger areas of the Earth's surface (for which curvature becomes significant) or when overlaying data with geographic features, the separate GeoViews library provides convenient geo-specific extensions to HoloViews.
- The taxi array data was derived from a very large tabular dataset and rasterized using datashader , an optional add-on to HoloViews and Bokeh that makes it feasible to work with very large datasets in a web browser.