🔒 need help in nlp

[valid valley]

I want to remove stop words

[pale otter]

@valid valley

Python help channel opened

Remember to:

• Ask your Python question, not if you can ask or if there's an expert who can help.
• Show a code sample as text (rather than a screenshot) and the error message, if you've got one.
• Explain what you expect to happen and what actually happens.

:warning: Do not pip install anything that isn't related to your question, especially if asked to over DMs.

Closes after a period of inactivity, or when you send !close.

[valid valley]

Why are the stopwords like this

The last column is very weird

Same sentence using the same function is different

def remove_stopwords(text):
    doc = nlp(text)
    filtered_words = [token.text for token in doc if not token.is_stop]
    clean_text = ' '.join(filtered_words)
    return clean_text

df['lemmatized_text_stop'] = df['lemmatized_text'].apply(remove_stop_words)```

I think its tokenizing each letter

whereas it should do each word

idk where the problem is

[valid valley]

hlo

[pale otter]

@valid valley

Python help channel closed

This help channel has been closed and it's no longer possible to send messages here. If your question wasn't answered, feel free to create a new post in #1035199133436354600. To maximize your chances of getting a response, check out this guide on asking good questions.