We live in the Information Age. Some physicists believe that information is a fundamental aspect of nature. All such theories rest on the adequacy of information theory. In this post I shall argue ...

To understand complex brain processes, there is a clear need to shift from traditional single-cell studies of trial-averaged responses to single-trial analyses of multiple neurons. In this respect, ...

Information theory underpins modern digital communication by quantifying information and delineating the limits of data transmission. Among its most celebrated implementations are Low-Density ...

Information Theory Meets Deep Neural Networks: Theory and Applications. The previous volume can be viewed here: Volume I Deep Neural Networks (DNNs) have become one of the most popular research ...

Philosophy of Science, Vol. 65, No. 3 (Sep., 1998), pp. 472-501 (30 pages) Information theory offers a measure of "mutual information" which provides an appropriate measure of tracking efficiency for ...

We question whether the growing popularity of model selection based on information theory (IT) and using the Akaike's Information Criterion (AIC) represent a useful paradigm shift in data analysis or ...

Abraham Moles's newly translated Information Theory and Esthetic Perception is a book with one interesting idea, which emerges, crablike, from the murky burrow of Chapter Five. The idea is that ...

Tim Bayne is affiliated with the Canadian Institute for Advanced Research (CIFAR). Science is hard. The science of consciousness is particularly hard, beset with philosophical difficulties and a ...