# Hinge Loss

## Hinge loss (SVM loss)

1. **Definition:** The correct score should be larger than a margin (1, and the 1 here actually can be arbitrary) than wrong scores 
2. **Min** 0, **Max** infinity
3. **At the initial time**, every class scores should be similar and the expected loss is C-1 ( each wrong class has loss 1, and there are C - 1 wrong classes)
4. **Squared hinge loss** is different from hinge loss, squared loss focusing more on the bad cases, a small difference may have huge loss value at the end.

![](https://443921002-files.gitbook.io/~/files/v0/b/gitbook-legacy-files/o/assets%2F-LGHUhl6VYqrZm4Re77O%2F-LP8-kKpmTZDLmcaKLID%2F-LP81K9GYzvQS2CN4oEW%2FScreen%20Shot%202018-10-18%20at%202.16.00%20PM.png?alt=media\&token=43914d4a-59d4-496e-b650-d3fb5d4ad7b1)