Thanks for sharing! I hope a detailed, line-by-line explanation of the backward pass can be added. I previously tried deriving it by hand but couldn’t get it right. I’ll need to revisit it again later.