Skip to main content

Websites

Crawl your website to automatically generate FAQs from your existing content.

Accessing Websites​

  1. Click Knowledge in the sidebar
  2. Click on a knowledge base card
  3. Click Websites in the side navigation

Adding a Website​

  1. Click the New Website + button
  2. Enter your website URL in the modal (e.g., https://example.com)
  3. Click Add

Orki will start crawling your website in the background. Feel free to do something else or close the app while the crawl is running.

How Crawling Works​

When you add a website, Orki crawls up to 100 pages, going two levels deep from the page you add. Every page fetched counts toward a monthly link quota based on your plan.

Example: What Gets Found​

If you add https://orki.ai:

LinkDepthFound?
orki.ai/about1 level✓ Yes
orki.ai/about/team2 levels✓ Yes
orki.ai/products/phones/iphone3 levels✗ No

If you need pages that are more than 2 levels deep, add the parent path as a separate website.

Example: To get all phone product pages, add https://orki.ai/products/phones as a website. This will find:

  • orki.ai/products/phones/iphone (1 level from your starting point)
  • orki.ai/products/phones/samsung (1 level from your starting point)

Checking Crawl Status​

Once the crawl is complete, you'll see:

  • Done tag on the website card
  • Number of links found

Click View Details to see all discovered links.

The View Details page has two tabs:

TabDescription
Inactive PagesLinks found but not yet added to your knowledge base
Active PagesLinks you've selected to generate FAQs from
  1. Go to the Inactive Pages tab
  2. Find the link you want
  3. Click Generate on that row

The link moves to Active Pages and FAQ generation begins in the background.

Tip: You can add multiple links at once. FAQ generation runs in the background, so you don't need to wait.

Checking FAQ Generation Status​

In the Active Pages tab, each link shows its current status:

StatusMeaning
ProcessingThe page is being fetched
ReadingExtracting content from the page
CleaningCleaning up the extracted content
FinalizingGenerating FAQs from the content
DoneFAQs have been generated
FailedSomething went wrong

If a Page Fails​

  1. Click Re-scrape on that page's row — this deletes the page's FAQs and regenerates them from a fresh fetch
  2. If the whole crawl failed, use the Retry button on the website
  3. If it still fails, contact support

Viewing Generated FAQs​

Once a link shows "Done", the FAQs appear in your FAQ table.

To see FAQs from your websites:

  1. Go to the FAQs page
  2. Use the Source dropdown to filter by "Website"
  3. You can also search by keyword to find specific FAQs

Editing FAQs​

To edit a generated FAQ:

  1. Click the pencil icon on the FAQ row
  2. The row becomes editable text boxes
  3. Make your changes
  4. Click the check icon to save

Deleting FAQs​

Select the FAQs you don't want and delete them. You can always regenerate them later.

If you no longer want FAQs from a specific link:

  1. Go to the Active Pages tab
  2. Click Remove on that row

This removes all FAQs generated from that link. You can re-add it anytime if you change your mind.

Keeping Content Fresh​

Website content changes — prices, policies, opening hours. Two re-scrape options keep your knowledge base up to date:

  • Re-scrape (per page) — deletes that page's FAQs and regenerates them from a fresh fetch. Any manual edits to those FAQs are lost, and the fetch counts toward your monthly link quota.
  • Re-scrape Website (per website) — re-crawls the whole website (up to 100 pages, 2 levels deep). New pages are added and existing pages get refreshed content. Every page fetched counts toward your monthly link quota.

Re-scrape whenever the source pages change significantly.

Best Use Cases for Websites​

Website crawling works best for:

  • General company information - About us, contact details
  • Policies - Return policy, shipping policy, privacy policy
  • Business hours and locations
  • Blog content and articles
  • Service descriptions

If you have many products, website crawling may miss some items or generate incomplete FAQs. Instead, use the E-commerce Products feature which is designed specifically for product catalogs.

Exception: If you have just a handful of products (like travel packages or service tiers), website FAQs work fine.

Website Limits​

You have monthly and total limits for websites based on your plan. Check your current usage in Settings > Billing.

Next Steps​