getting actor input schema | Apify & Crawlee | Page 1

wary cave Sep 16, 2022, 5:59 PM

#

Hi. how to get an actor input-schema.json ?

cinder magnet Sep 16, 2022, 6:54 PM

#

You want the input schema of an actor existing on the platform?

#

Which actor?

wary cave Sep 16, 2022, 6:58 PM

#

I mean any actor

#

for example I want to create a GUI client for running actor and need the INPUT_SCHEMA.json to construct the GUI interface

#

is there any way to get the input-schema using api or else ?

cinder magnet Sep 16, 2022, 7:43 PM

#

It doesn't seem possible

#

The only way I can find is to go to the actor's source code tab:
https://apify.com/apify/google-search-scraper/source-code

Then visit the repo:
https://github.com/apify/actor-google-search-scraper

And grab the INPUT_SCHEMA.json from there

wary cave Sep 17, 2022, 2:42 AM

#

Thanks. I guess I can scrape directly from the actor page. but I wonder if there an official way to do this 🍻

cinder magnet Sep 18, 2022, 7:42 PM

#

@junior wolf Know of any potential way that I might be missing?

wary cave Sep 19, 2022, 11:26 AM

#

yeah. for example https://apify.com/apify/web-scraper if you look on the HTML source there is <script id="__NEXT_DATA__" type="application/json">...... the input_schema is there 😃

Apify

Web Scraper · Apify

Crawls arbitrary websites using the Chrome browser and extracts data from pages using a provided JavaScript code. The actor supports both recursive crawling and lists of URLs and automatically manages concurrency for maximum performance. This is Apify's basic tool for web crawling and scraping.

cinder magnet Sep 19, 2022, 2:37 PM

#

wary cave yeah. for example https://apify.com/apify/web-scraper if you look on the HTML so...

Oh epic! Yeah we're using NextJS for static pages. Just wasn't aware the data was present in the __NEXT_DATA__ object. Cool find!!

#

Scrape us!! Haha

#

Very excited to see what you build 🙂 Be sure to share it in #🗨apify-chat once you deploy it!

wary cave Sep 20, 2022, 12:36 AM

#

sure 😄 although I am a bit hesitate to use actor to scrap its own host, is it ethical ? 😄 maybe next updates will add the ability to get the schema using api.

#getting actor input schema