HAIRY VISUALIZATION PROBLEMS



Modern data visualizations are often tours de force of artistic and graphic design. They can transcend the data and transform into artwork worthy of MoMA. These visualization often derive their visual impact for the sheer quantity of data they display. And while anyone would rather have this adorning their wall than an delimited data file, the visualization is scantily more useful for deriving useful conclusions than the underlying data file.

Force-directed networks, one the D3-iest of D3 layouts, often suffers this fate. As Martin Krzywinski, who describes these visualizations as "hairballs," puts it...

The central drawback of hairball-based visualization is that they cannot be tuned to address a user's specific questions. Implicit in the hairball approach is the assumption that all questions that the user wishes to answer are addressable by the layout algorithm. When this assumption is wrong (as it usually is), the user is left to construct another hairball, based on another layout algorithm, to attempt to answer the unanswered questions. Unfortunately, the set of questions answerable by a hairball is very difficult to determine — no such list exists because of the complex interplay of data and layout.

So how do we reappropriate layout decisions to better answer questions relevant to our data?

Develop a hypothesis
Map the parameters of the hypothesis onto parameters governing the layout
Run the layout algorithm
Determine whether the hypothesis is correct

You'll notice that the common plug-and-chug method of implementing force-directed network graphs skips steps 1 and 2, which makes step 4 exceedingly hard. Remember, absent intervention, d3.layout.force knows only about connectivity, and there's usually more to the story. Look what the force-directed algorithm will let you do with the United States:

In the next post, we'll discuss how to bring some intelligence to these visualizations so that they can be used to inform, rather than simply to decorate walls.




XLP Capital is a family office and as such is not required to be registered as an investment adviser with the U.S. Securities and Exchange Commission. Investments are made available only to accredited, qualified, or institutional investors that are eligible as family office clients, pursuant to the rules of the U.S. Investment Advisors Act of 1940. XLP does not seek or solicit investment for these funds or any other funds, and nothing on this page should constitute a solicitation for investment. The descriptions on this page is provided for information value only, as examples of prior investment related work XLP has conducted. XLP Capital assumes no liability for investment losses direct and indirectly resulting from recommendations made, implied, or inferred by its research. Likewise, XLP Capital assumes no claim to investment gains direct or indirectly resulting from trading profits, investment management or advisory fees obtained by following investment recommendations made, implied, or inferred by its research. Investment involves risk, and all investments should be made with the supervision of a professional investment manager or advisor. The materials on the Website are not an offer to sell or a solicitation of an offer to buy any investment, security or commodity, nor shall any security be offered or sold to any person, in any jurisdiction in which such offer would be unlawful under the securities laws of such jurisdiction.