LESSWRONG
LW

All of tfluids's Comments + Replies

A Simple Introduction to Neural Networks

Just another quick question about this part: The first term is $\frac{\partial ℓ}{\partial z_{9}} = \frac{\partial (y - z_{9})^{2}}{\partial z_{9}} = 2 z_{9}$ .

Shouldn't this be: $\frac{\partial (y - z_{9})^{2}}{\partial z_{9}} = - 2 (y - z_{9})$ ?

You mentioned just after something about notation, but I wanted to understand a bit better in case I'm missing something

2Rafael Harth3y

I believe you're correct. (I haven't thought through the full context, but that shouldn't be necessary for that equation... I hope.) I've edited it. Thanks!

A Simple Introduction to Neural Networks

tfluids3y30

Cool, thanks a lot. I assumed the notation was right.

Thanks for the post, by the way, really great work.

A Simple Introduction to Neural Networks

tfluids3y30

Just wondering, you refer to the derivative here but the notation is for the partial derivative, which one is correct?

2Rafael Harth3y

Partial, I think. I mean, it's all with respect to one variable. (Looking at this post now, it really should have included concrete numbers in addition to the symbols, which would also have answered the question. Idk if I'll get around to fixing it...)