#Looking for contributions on AWS project
5 messages · Page 1 of 1 (latest)
Would appreciate a lot!
Looking for contributions on AWS project
i think the reason the crawler isn't crawling is that there is no call to website.crawl().await.
#[tokio::main]
async fn main() -> Result<(), Box<dyn std::error::Error>> {
let mut website: Website = Website::new("https://crawler-test.com/");
website.crawl().await;
let links = website.get_links();
for link in links {
println!("- {:?}", link.as_ref());
}
Ok(())
}
this prints a bunch of urls