Search
Home page
Browse
A
B
C
D
E
F
G
H
I
J
K
L
M
N
O
P
Q
R
S
T
U
V
W
X
Y
Z
#
new
Store
Blog
Advertise
Add a definition
User settings
Browse
A
B
C
D
E
F
G
H
I
J
K
L
M
N
O
P
Q
R
S
T
U
V
W
X
Y
Z
#
new
Store
Blog
Advertise
Search
Karpathy Constant
The
Karpathy constant
is one of the best learning rates for the popular Adam (deep
neural network
)
optimizer
. It is defined as η = 3e-4. The actual symbol for the constant is α_k.
What is the correct
learning
rate for
adam
in this case?
Just use the
Karpathy constant
dude
by
randomrandomrandomdude
November 23, 2017
Flag
Get the
Karpathy Constant
mug.
More random definitions