nesting
This module is a Python port of the nest operator from Mike Bostock's d3.js.
Install it with pip: pip install nesting
Usage
Nest allows elements in an array to be grouped into a hierarchical tree structure;
think of it like the GROUP BY operator in SQL, except you can have multiple levels of
grouping, and the resulting output is a tree rather than a flat table. The levels in
the tree are specified by key functions. The leaf nodes of the tree can be sorted by
value, while the internal nodes can be sorted by key. An optional rollup function will
collapse the elements in each leaf node using a summary function. The nest operator
(the object returned by nesting.Nest) is reusable, and does not retain any references to the
data that is nested.
For example, consider the following tabular data structure of Barley yields, from various sites in Minnesota during 1931-2:
yields = [
{"yield": 27.00, "variety": "Manchuria", "year": 1931, "site": "University Farm"},
{"yield": 48.87, "variety": "Manchuria", "year": 1931, "site": "Waseca"},
{"yield": 27.43, "variety": "Manchuria", "year": 1931, "site": "Morris"},
{"yield": 43.07, "variety": "Glabron", "year": 1931, "site": "University Farm"},
{"yield": 55.20, "variety": "Glabron", "year": 1931, "site": "Waseca"},
{"yield": 16.18, "variety": "Glabron", "year": 1932, "site": "University Farm"},
]To facilitate visualization, it may be useful to nest the elements first by year, and then by variety, as follows:
from nesting import Nest
(Nest()
.key( lambda d: d['year'] )
.key( lambda d: d['variety'] )
.entries(yields))Or more concisely:
(Nest()
.key('year')
.key('variety')
.entries(yields))...as both the key and prop functions will interpret non-callables as they key to look up.
This returns a nested array. Each element of the outer array is a key-values pair, listing the values for each distinct key:
[ Entry(key=1931, values=[
Entry(key="Manchuria", values=[
{"yield": 27.00, "variety": "Manchuria", "year": 1931, "site": "University Farm"},
{"yield": 48.87, "variety": "Manchuria", "year": 1931, "site": "Waseca"},
{"yield": 27.43, "variety": "Manchuria", "year": 1931, "site": "Morris"}, ]),
Entry(key="Glabron", values=[
{"yield": 43.07, "variety": "Glabron", "year": 1931, "site": "University Farm"},
{"yield": 55.20, "variety": "Glabron", "year": 1931, "site": "Waseca"}, ]),
]),
Entry(key=1932, values=[
Entry(key="Glabron", values=[
{"yield": 16.18, "variety": "Glabron", "year": 1932, "site": "University Farm"}, ]),
]),
]Entry is a named tuple, making the parts both accessible by name (key, values) and indexable (0=key, 1=values).
If you want a nested dict, use the map method:
>>> Nest().key('year').key('variety').map(yields)
OrderedDict([
(1931, OrderedDict([
('Glabron', [
{'year': 1931, 'site': 'University Farm', 'yield': 43.07, 'variety': 'Glabron'},
{'year': 1931, 'site': 'Waseca', 'yield': 55.2, 'variety': 'Glabron'} ]),
('Manchuria', [
{'year': 1931, 'site': 'University Farm', 'yield': 27.0, 'variety': 'Manchuria'},
{'year': 1931, 'site': 'Waseca', 'yield': 48.87, 'variety': 'Manchuria'},
{'year': 1931, 'site': 'Morris', 'yield': 27.43, 'variety': 'Manchuria'} ])
])),
(1932, OrderedDict([
('Glabron', [
{'year': 1932, 'site': 'University Farm', 'yield': 16.18, 'variety': 'Glabron'} ])
]))
])The nested form allows easy iteration and generation of hierarchical structures in SVG or HTML.
This port is open-source, freely licensed under the MIT License.
