Skip to content

Prevent Regression Layer from being NaN#93

Open
thomaswmanion wants to merge 1 commit into
karpathy:masterfrom
thomaswmanion:master
Open

Prevent Regression Layer from being NaN#93
thomaswmanion wants to merge 1 commit into
karpathy:masterfrom
thomaswmanion:master

Conversation

@thomaswmanion
Copy link
Copy Markdown

Since x.w[i] or yi can yet be defined, if it is invalid math, we should set the change in y to 0.

This caused a lot of NaN's in brain otherwise.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant