< Back to Importing

Scrape URLs From Page

At Admin Panel -> Topics -> Add Topics you have a "Page Link Scraper" area. This allows you to scrape URLs from a web page to add them to your directory. Type a URL here and it'll place all URLs from that page into your "bulk addition" box except:

You'll be able to review the list and remove those links you don't actually want to add. For those you do want, it can retrieve the titles and meta descriptions automatically. This can help you build your directory quickly, if you know a page (say a wikipedia list) which lists the sites you'll want.