#🔒 PYSPARK -->ValueError: can not infer schema from empty dataset

6 messages · Page 1 of 1 (latest)

feral orchidBOT
#

@analog island

Python help channel opened

Remember to:

  • Ask your Python question, not if you can ask or if there's an expert who can help.
  • Show a code sample as text (rather than a screenshot) and the error message, if you've got one.
  • Explain what you expect to happen and what actually happens.

:warning: Do not pip install anything that isn't related to your question, especially if asked to over DMs.

Closes after a period of inactivity, or when you send !close.
analog island
analog island
# 
file_name2 = 'AG_Threshold'+str(date.today())+'.csv' 
path = new_folder_path+file_name2
df2 = threshold_calculation(master_booking_df)

file_name = 'Threshold_Approved_By'+str(date.today())+'.csv' 
shp_path = folder_url_shrpt+file_name
df = process_df()

#write_df_as_csv(ctx, path,df2) #write the AG_threshold csv
#write_df_as_csv(ctx, shp_path,df) #write the Threshold_approved_by csv

#display(df2)
display(df)

im trying to display my df but keep getting this error which ill attach in full below. I would really appreciate it if someone could take a look at my text file (it wouldnt let me just paste it) and help me debug this issue, for some reason it is returning an empty dataset when it shouldnt

feral orchidBOT
#

@analog island

Python help channel closed

This help channel has been closed and it's no longer possible to send messages here. If your question wasn't answered, feel free to create a new post in #1035199133436354600. To maximize your chances of getting a response, check out this guide on asking good questions.