我正在使用 Support Vector Regression作为 GridSearchCV 中的估计器.但是我想更改误差函数:我想定义自己的自定义误差函数，而不是使用默认值(R-squared:确定系数)。

我尝试用 make_scorer 制作一个，但没有成功。

我阅读了文档，发现可以创建 custom estimators ，但我不需要重新制作整个估算器 - 只需重新制作错误/评分函数。

我想我可以通过将可调用对象定义为记分员来做到这一点，就像 docs 中所说的那样。 .

但我不知道如何使用估算器:在我的例子中是 SVR。我是否必须切换到分类器(例如 SVC)？我将如何使用它？

我的自定义错误函数如下:

def my_custom_loss_func(X_train_scaled, Y_train_scaled):
    error, M = 0, 0
    for i in range(0, len(Y_train_scaled)):
        z = (Y_train_scaled[i] - M)
        if X_train_scaled[i] > M and Y_train_scaled[i] > M and (X_train_scaled[i] - Y_train_scaled[i]) > 0:
            error_i = (abs(Y_train_scaled[i] - X_train_scaled[i]))**(2*np.exp(z))
        if X_train_scaled[i] > M and Y_train_scaled[i] > M and (X_train_scaled[i] - Y_train_scaled[i]) < 0:
            error_i = -(abs((Y_train_scaled[i] - X_train_scaled[i]))**(2*np.exp(z)))
        if X_train_scaled[i] > M and Y_train_scaled[i] < M:
            error_i = -(abs(Y_train_scaled[i] - X_train_scaled[i]))**(2*np.exp(-z))
    error += error_i
    return error

变量 M 不为空/零。为简单起见，我只是将其设置为零。

谁能展示这个自定义评分功能的示例应用程序？感谢您的帮助!

最佳答案

Jamie 有一个充实的示例，但这里有一个直接来自 scikit-learn documentation 的使用 make_scorer 的示例:

import numpy as np
def my_custom_loss_func(ground_truth, predictions):
    diff = np.abs(ground_truth - predictions).max()
    return np.log(1 + diff)

# loss_func will negate the return value of my_custom_loss_func,
#  which will be np.log(2), 0.693, given the values for ground_truth
#  and predictions defined below.
loss  = make_scorer(my_custom_loss_func, greater_is_better=False)
score = make_scorer(my_custom_loss_func, greater_is_better=True)
ground_truth = [[1, 1]]
predictions  = [0, 1]
from sklearn.dummy import DummyClassifier
clf = DummyClassifier(strategy='most_frequent', random_state=0)
clf = clf.fit(ground_truth, predictions)
loss(clf,ground_truth, predictions) 

score(clf,ground_truth, predictions)

通过 sklearn.metrics.make_scorer 定义自定义记分器时，约定是以 _score 结尾的自定义函数返回一个值以最大化。对于以 _loss 或 _error 结尾的记分员，返回一个值以使其最小化。您可以通过在 make_scorer 中设置 greater_is_better 参数来使用此功能。 .也就是说，对于较高值更好的得分者，此参数将是 True，而对于较低值更好的得分者，此参数将是 False。 GridSearchCV然后可以在适当的方向进行优化。

然后您可以将您的函数转换为记分员，如下所示:

from sklearn.metrics.scorer import make_scorer

def custom_loss_func(X_train_scaled, Y_train_scaled):
    error, M = 0, 0
    for i in range(0, len(Y_train_scaled)):
        z = (Y_train_scaled[i] - M)
        if X_train_scaled[i] > M and Y_train_scaled[i] > M and (X_train_scaled[i] - Y_train_scaled[i]) > 0:
            error_i = (abs(Y_train_scaled[i] - X_train_scaled[i]))**(2*np.exp(z))
        if X_train_scaled[i] > M and Y_train_scaled[i] > M and (X_train_scaled[i] - Y_train_scaled[i]) < 0:
            error_i = -(abs((Y_train_scaled[i] - X_train_scaled[i]))**(2*np.exp(z)))
        if X_train_scaled[i] > M and Y_train_scaled[i] < M:
            error_i = -(abs(Y_train_scaled[i] - X_train_scaled[i]))**(2*np.exp(-z))
    error += error_i
    return error


custom_scorer = make_scorer(custom_loss_func, greater_is_better=True)

然后将 custom_scorer 传入 GridSearchCV与其他评分函数一样:clf = GridSearchCV(scoring=custom_scorer).

关于python - 如何在 scikit-learn 中创建/自定义自己的记分器功能？，我们在Stack Overflow上找到一个类似的问题： https://stackoverflow.com/questions/32401493/