Entropy Rate for Hidden Markov Chains with rare transitions

Abstract

We consider Hidden Markov Chains obtained by passing a Markov Chain with rare transitions through a noisy memoryless channel. We obtain asymptotic estimates for the entropy of the resulting Hidden Markov Chain as the transition rate is reduced to zero.

To appear in Hidden Markov Processes by Marcus, Petersen and Weissman (eds); CUP