I got this code from chatGPT, but how can i verify that the outliers have actually been removed?
import pandas as pd
import numpy as np
Read the data
df = pd.read_csv('clean_Dataset.csv', delimiter=',')
Function to remove outliers using the IQR method
def remove_outliers_iqr(data):
q1 = np.percentile(data, 25)
q3 = np.percentile(data, 75)
iqr = q3 - q1
lower_bound = q1 - 1.5 * iqr
upper_bound = q3 + 1.5 * iqr
filtered_data = data[(data >= lower_bound) & (data <= upper_bound)]
return filtered_data
Iterate over each numerical column in the DataFrame
for column in df.select_dtypes(include=np.number):
df[column] = remove_outliers_iqr(df[column])
Display the cleaned DataFrame
display(df)