Sometimes one webpage is not enough context to answer the questions you might have or you want to fill some database/Search API AI with a lot of context for your chatbot.
Now it possible using the Simple Crawler or the ScrapingBot in Drupal. They now have Depth Crawlers, that goes and scrapes links following whatever rules you set and stores it all as context.
In this example we use the context to answer some question using OpenAI.
Modules used:
https://www.drupal.org/project/ai_interpolator_openai
https://www.drupal.org/project/ai_interpolator_simple_crawler
Complexity
Normal