feat(docsearch-website): Updated docs

[NatanTechofNY]

Changelog

✨ New & Updated Documentation Pages

• create-crawler.mdx

  • Added a step-by-step guide for new DocSearch apps (after July 2nd, 2024) to add domains, verify ownership, create a crawler, and run a test crawl.
  • Included an info/caution box about the 7-day domain verification grace period and DocSearch approval.
  • Added a screenshot for domain management.
  • Updated links to use the new Crawler UI dashboard.

• crawler-configuration-visual.mdx

  • Modernized to match the new Algolia Crawler UI and documentation style.
  • Updated/added sections:
    • Trigger a new crawl
    • Monitor your crawls
    • Update your config (now includes both the Visual Configuration UI and the code editor, with screenshots)
    • Search preview (placeholder)
    • URL tester
    • New: DocSearch Tab (with screenshot and explanation)
    • New: Suggestions (with screenshot and explanation)
  • Updated image references to match new UI screenshots.
  • Updated links to point to the new Crawler UI dashboard.

• manage-your-crawls.mdx

  • Marked as deprecated with a prominent caution at the top.
  • Added links to the new Crawler UI and updated documentation.
  • Updated references to the new dashboard.

• crawler.mdx

  • Modernized to match the latest Algolia documentation.
  • Added a caution for legacy users and clear links to new getting started/configuration docs.
  • Removed outdated and redundant content.
  • Updated links to use the new Crawler UI dashboard.

• v4/askai.mdx

  • Clarified that AskAI allows users to bring their own LLM provider/model and API keys, and use LLMs with the context of any Algolia index.
  • Refined the “Overview” and “Why you should use AskAI” sections to avoid repetition and clearly separate technical features from business/user benefits.

🖼️ Screenshots and Visuals

• Added/updated image references for new Crawler UI features:
  • DocSearch tab (crawler-visual-docsearch.png)
  • Suggestions tab (crawler-visual-suggestions.png)
  • Other updated UI screenshots for each section

🧭 Sidebar/Navigation

• Ensured new pages are referenced in the sidebar for discoverability.

🛠️ General Improvements

• Improved clarity, structure, and alignment with the latest Algolia documentation style.
• Added or updated admonitions (info/caution) for user guidance and migration context.
• Linked to official Algolia documentation and FAQs where appropriate.
• Updated various links throughout the docs to point to the new Crawler UI dashboard (https://dashboard.algolia.com/crawler).

[netlify]

✅ Deploy Preview for docsearch ready!

Name	Link
🔨 Latest commit	604afdf
🔍 Latest deploy log	https://app.netlify.com/projects/docsearch/deploys/686ec98f1111a100087408a6
😎 Deploy Preview	https://deploy-preview-2662--docsearch.netlify.app
📱 Preview on mobile	Toggle QR Code... Use your smartphone camera to open QR code link.

---

To edit notification comments on pull requests, go to your Netlify project configuration.