#is it possible to extract file from website in spark submit command only?

3 messages · Page 1 of 1 (latest)

storm sparrow
#

as title says, is it possible to extract file from website in spark submit command, without putting any code related to web-scraping or so in spark driver program? you cannot define anything in spark context or spark session as well.

robust pilotBOT
#

⌛ This post has been reserved for your question.

Hey @storm sparrow! Please use /close or the Close Post button above when you're finished. Please remember to follow the help guidelines. This post will be automatically closed after 300 minutes of inactivity.

TIP: Narrow down your issue to simple and precise questions to maximize the chance that others will reply in here.