We live in the Information Age. Some physicists believe that information is a fundamental aspect of nature. All such theories rest on the adequacy of information theory. In this post I shall argue ...

To understand complex brain processes, there is a clear need to shift from traditional single-cell studies of trial-averaged responses to single-trial analyses of multiple neurons. In this respect, ...

Information theory underpins modern digital communication by quantifying information and delineating the limits of data transmission. Among its most celebrated implementations are Low-Density ...

Information Theory Meets Deep Neural Networks: Theory and Applications. The previous volume can be viewed here: Volume I Deep Neural Networks (DNNs) have become one of the most popular research ...

The identities or bounds that relate information measures (e.g., the entropy and mutual information) and estimation measures (e.g., the minimum means square error ...

We question whether the growing popularity of model selection based on information theory (IT) and using the Akaike's Information Criterion (AIC) represent a useful paradigm shift in data analysis or ...

Like a brain, a deep neural network has layers of neurons—artificial ones that are figments of computer memory. When a neuron fires, it sends signals to connected neurons in the layer above. During ...

Abraham Moles's newly translated Information Theory and Esthetic Perception is a book with one interesting idea, which emerges, crablike, from the murky burrow of Chapter Five. The idea is that ...

Tim Bayne is affiliated with the Canadian Institute for Advanced Research (CIFAR). Science is hard. The science of consciousness is particularly hard, beset with philosophical difficulties and a ...