This book constitutes the refereed proceedings of the IberSPEECH 2016 Conference, held in Lisbon, Portugal, in November 2016. The 27 papers presented were carefully reviewed and selected from 48 submissions. The selected articles in this volume are organized into four different topics: Speech Production, Analysis, Coding and Synthesis; Automatic Speech Recognition; Paralinguistic Speaker Trait Characterization; Speech and Language Technologies in Different Application Fields