Question

我正在使用带有文本Yelp餐厅评论及其“星级”评分的数据集。我的数据是df，看起来像这样：

Textual Review           Numeric rating
"super cool restaurant"  5
"horrible experience"    1

我建立了MultinomialNB模型，该模型可以预测“星号”（1-代表负数，5代表正数；仅使用这两个类别）。

import pandas as pd
import numpy as np
from textblob import TextBlob
from sklearn.feature_extraction.text import CountVectorizer
from sklearn.model_selection import train_test_split
from sklearn.naive_bayes import MultinomialNB
from sklearn.metrics import confusion_matrix, classification_report
from nltk.corpus import stopwords
import string
import numpy

df = pd.read_csv('YELP_rev.csv')
#subsetting only the reviews on the extreme sides of the rating
df_class = df[(df['Numeric rating'] ==1) | (df['Numeric rating'] == 5)]

X = df_class['Textual review']
y = df_class['Numeric rating']
vectorizer=CountVectorizer()
X = vectorizer.fit_transform(X)

X_train, X_test, y_train, y_test = train_test_split(X, y, test_size=0.3, random_state=101)

nb = MultinomialNB()
#fiting the model with X_train, y_train
nb.fit(X_train, y_train)
#doing preditions
pred = nb.predict(X_test)
print(confusion_matrix(y_test, pred))



precision    recall  f1-score   support

           1       0.43      0.33      0.38         9
           5       0.90      0.93      0.92        61

   micro avg       0.86      0.86      0.86        70
   macro avg       0.67      0.63      0.65        70
weighted avg       0.84      0.86      0.85        70

我要尝试的是预测用户提供的餐厅评论的“星级”评分。这是我的尝试：

test_review = input("Enter a review:")  

def input_process(text):
    nopunc = [char for char in text if char not in string.punctuation]
    nopunc = ''.join(nopunc)
    return [word for word in nopunc.split() if word.lower() not in stopwords.words('english')]

new_x=vectorizer.transform(input_process(test_review))
test_review_rate = nb.predict(new_x)
print(test_review_rate)

我不确定我得到的输出是否正确，因为我得到了一系列的分数。 有人可以帮助我解释这些分数吗？ 我是否只取平均值，这将成为我对该评价的“星级”？

>>Enter a review:We had dinner here for my birthday in Stockholm. The restaurant was very popular, so I would advise you book in advance.Blahblah
#my output
>>[5 5 5 5 5 5 5 5 5 1 5 1 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5
 5 5 5 5]

ps我意识到样本数据很差，我的模型偏向正评级！预先感谢！

Answer 1

您需要将join的单词重新组合成一个字符串。现在，input_process函数的输出是一个单词列表，因此您的模型将每个单词解释为一个单独的输入样本，这就是为什么您在其中得到每个单词得分的原因您的评论，而不是整体得分。

您的代码有一些更改：

def input_process(text):
    # Something you can try for removing punctuations
    translator = str.maketrans('', '', string.punctuation)
    nopunc = text.translate(translator)
    words = [word for word in nopunc.split() if word.lower() not in stopwords.words('english')]
    # Join the words back and return as a string
    return ' '.join(words)

# vectorizer.transform takes a list as input
# You will have to pass your single string input as a list
new_x=vectorizer.transform([input_process(test_review)])

使用朴素贝叶斯训练过的模型预测“用户输入”评论

1 个答案: