Caution: this post is written in 2018 and maybe out-of-date! Table of Contents Batch Normalization layer in TensorFlow How to apply batch-normalization in TensorFlow The pitfall: UPDATE_OPS Batch Normalization layer in TensorFlow In this post, I’m not going to explain the math behind what batch normalization does and why it could help if we apply batch-normalization in our deep networks. For a quick look of what batch normalization is, check this post.