What loss function to use in CNN-SVM model

Sat, 08 Jun 2019 09:24:21 +0000

I am using Matlab R2018b and am trying to infuse SVM classifier within CNN. My plan is to use CNN only as a feature extractor and use SVM as the classifier. I know people have already implemented it a few years back either in tensorflow or in other platforms. In implementing this I got stuck at a point during backward propagation. I got puzzled about which loss function I need to implement to upgrade the gradients and the parameters.

Few points came up during this:

1. I got a feeling to implement the hinge loss here. But which form of hinge loss should I implement? Should I move on to the second form of hinge loss implementation for calculating loss during backward propagation?

2. Besides, calculating the backward loss, should I calculate the forward loss as well to find out the loss occurred in the model?

Any form of advice doing this CNN-svm infusion will be appreciated as I am unable to find any such material implemented in Matlab to get help.

Thanks.

How to calculate LogLoss in logistic regression?

Mon, 18 Mar 2019 20:34:40 +0000

The dataset of pass/fail in an exam for 5 students is given in the table below. If we use Logistic Regression as the classifier and assume the model suggested by the optimizer will become the following for Odds of passing a course:

$\log_e(Odds) = -64 + 2 \times hours$

1) How to calculate the loss of model for the student who studied 33 hours?

2) What is the total loss of the model given in equation below?

$Logloss = -\frac{1}{N} \sum_{i=1}^N(y_i\log_e(p_i) + (1 - y_i)\log_e(1 - p_i))$

Ask Ghassem - Recent questions tagged loss

What loss function to use in CNN-SVM model

How to calculate LogLoss in logistic regression?