Modes of information flow

James RG, Masante Ayala BD, Zakirov BO, Crutchfield JP. 2026. Modes of information flow. Entropy. 28(10), 1162.

Download
OA 2026_Entropy_James.pdf 855.66 KB [Published Version]

Journal Article | Published | English

Scopus indexed
Author
James, Ryan G.; Masante Ayala, Blanca Daniella; Zakirov, Bakhtiyar OlimovichISTA; Crutchfield, James P.
Abstract
Information flow between components of a system takes many forms and is key to understanding the organization and functioning of large-scale, complex systems. We demonstrate three modalities of information flow from time series X to time series Y. Intrinsic information flow exists when the past of X is individually predictive of the present of Y, independent of Y’s past; this is most commonly considered information flow. Shared information flow exists when X’s past is predictive of Y’s present in the same manner as Y’s past; this occurs due to synchronization or common driving, for example. Finally, synergistic information flow occurs when neither X’s nor Y’s pasts are predictive of Y’s present on their own, but taken together they are. The two most broadly-employed information-theoretic methods of quantifying information flow—time-delayed mutual information and transfer entropy—are both sensitive to a pair of these modalities: time-delayed mutual information to both intrinsic and shared flow, and transfer entropy to both intrinsic and synergistic flow. To quantify each mode individually we introduce our cryptographic flow ansatz, positing that intrinsic flow is synonymous with secret key agreement between X and Y. Since the secret key agreement rate is not directly computable, we estimate intrinsic flow by an easily-computed upper bound on it—the intrinsic mutual information—so that the resulting three-way split is relative to this bound. We use it to quantify the three flow modalities in a variety of systems including asymmetric flows, coupled chaotic dynamical systems, leader-follower collective dynamics, and financial markets.
Publishing Year
Date Published
2026-10-21
Journal Title
Entropy
Publisher
MDPI
Acknowledgement
This material is based upon work supported by, or in part by, John Templeton Foundation grant 52095, Foundational Questions Institute grant FQXi-RFP-1609, the U.S. Army Research Laboratory and the U.S. Army Research Office under contract W911NF-13-1-0390 and grant W911NF-18-1-0028, and via Intel Corporation support of CSC as an Intel Parallel Computing Center. B.Z. was supported by the 2017 NSF Research Experience for Undergraduates Program and B.D.M.A. by a UC MEXUS-CONACYT Doctoral Fellowship. We thank D. Feldspar for helpful discussions. As an External Faculty member, J.P.C. thanks the Santa Fe Institute and the Telluride Science and Innovation Center for their hospitality during visits
Volume
28
Issue
10
Article Number
1162
eISSN
IST-REx-ID

Cite this

James RG, Masante Ayala BD, Zakirov BO, Crutchfield JP. Modes of information flow. Entropy. 2026;28(10). doi:10.3390/e28101162
James, R. G., Masante Ayala, B. D., Zakirov, B. O., & Crutchfield, J. P. (2026). Modes of information flow. Entropy. MDPI. https://doi.org/10.3390/e28101162
James, Ryan G., Blanca Daniella Masante Ayala, Bakhtiyar Olimovich Zakirov, and James P. Crutchfield. “Modes of Information Flow.” Entropy. MDPI, 2026. https://doi.org/10.3390/e28101162.
R. G. James, B. D. Masante Ayala, B. O. Zakirov, and J. P. Crutchfield, “Modes of information flow,” Entropy, vol. 28, no. 10. MDPI, 2026.
James RG, Masante Ayala BD, Zakirov BO, Crutchfield JP. 2026. Modes of information flow. Entropy. 28(10), 1162.
James, Ryan G., et al. “Modes of Information Flow.” Entropy, vol. 28, no. 10, 1162, MDPI, 2026, doi:10.3390/e28101162.
All files available under the following license(s):
Creative Commons Attribution 4.0 International Public License (CC-BY 4.0):
Main File(s)
File Name
Access Level
OA Open Access
Date Uploaded
2026-11-18
MD5 Checksum
422bc679909f8816a4f67bde0f4f7553


Export

Marked Publications

Metadata Export

Sources

PMID: 42940884
PubMed | Europe PMC

Search this title in

Google Scholar