Information-based clustering

Slonim N, Atwal G, Tkačik G, Bialek W. 2005. Information-based clustering. PNAS. 102(51), 18297–18302.

Journal Article | Published
Slonim,N.; Atwal,G.; Aksenov, VitaliiISTA ; Bialek, William S
In an age of increasingly large data sets, investigators in many different disciplines have turned to clustering as a tool for data analysis and exploration. Existing clustering methods, however, typically depend on several nontrivial assumptions about the structure of data. Here, we reformulate the clustering problem from an information theoretic perspective that avoids many of these assumptions. In particular, our formulation obviates the need for defining a cluster "prototype," does not require an a priori similarity metric, is invariant to changes in the representation of the data, and naturally captures nonlinear relations. We apply this approach to different domains and find that it consistently produces clusters that are more coherent than those extracted by existing algorithms. Finally, our approach provides a way of clustering based on collective notions of similarity rather than the traditional pairwise measures.
Publishing Year
Date Published
Journal Title
18297 - 18302

Cite this

Slonim N, Atwal G, Tkačik G, Bialek W. Information-based clustering. PNAS. 2005;102(51):18297-18302. doi:10.1073/pnas.0507432102
Slonim, N., Atwal, G., Tkačik, G., & Bialek, W. (2005). Information-based clustering. PNAS. National Academy of Sciences.
Slonim, N., G. Atwal, Gašper Tkačik, and William Bialek. “Information-Based Clustering.” PNAS. National Academy of Sciences, 2005.
N. Slonim, G. Atwal, G. Tkačik, and W. Bialek, “Information-based clustering,” PNAS, vol. 102, no. 51. National Academy of Sciences, pp. 18297–18302, 2005.
Slonim N, Atwal G, Tkačik G, Bialek W. 2005. Information-based clustering. PNAS. 102(51), 18297–18302.
Slonim, N., et al. “Information-Based Clustering.” PNAS, vol. 102, no. 51, National Academy of Sciences, 2005, pp. 18297–302, doi:10.1073/pnas.0507432102.
All files available under the following license(s):
Copyright Statement:
This Item is protected by copyright and/or related rights. [...]

Link(s) to Main File(s)
Access Level
OA Open Access


Marked Publications

Open Data ISTA Research Explorer

Search this title in

Google Scholar