Recreate Web Browser GPT app in API

[trim hornet]

Hey there!
I want to use AI to extract contact information from a website for my sales agents to call and pitch my products. I used the Web Browser GPT app inside ChatGPT and it worked perfectly fine. The problem is:

I am super limited in terms of usage
I cant really integrate it into my own system since its not an API
I already used stuff like webpilot.ai but it did not perform very well. Looks like it just makes a brief search and not really a deep search through the entire webpage.

Is there a setup where i can do deep web search through the openai api? Cause i really need to search through the entire website including subpages.

My prompt is:

Search WEBSITE_URL_HERE and all possible subpages! Extract the best person to pitch products to, or if you cant find a specific person, please extract the best contact information! Deliver the results in this format:

Name:
Phone:
Email:
Address:
Very short summary about the facility and the person

You would really help me if you can advice me on how to build such a setup

Kind regards

[crude tiger]

you need to implement that yourself via function calling and use bing or google search api

[trim hornet]

Ok thank you. Is it possible to implement such deep search functionality

Like exploring sub pages of a certain website

[crude tiger]

search services have stuff cached but if you want live info you need to do web crawling yourself

[sage cedar]

recursive stuff or just click on every hyperlink in the page as index it as an input. Wont work on big sites though

[trim hornet]

I would describe it as intelligent search

I think you will understand what I need if you run the prompt I shared above with a nursing homes homepage in your region