Skip to main content

​
Overview

Cofounder interacts with the web in three primary ways:
  1. Web searching
  2. Web scraping
  3. Website monitoring.
This page provides a comprehensive guide on how to leverage these capabilities effectively.

​
Web Searching

Cofounder’s web search system allows you to find relevant content across the internet. Simply ask Cofounder to search the web for a specific query or URL and cofounder will handle it.

​
Key Features

Search Queries: Use specific search terms for better accuracy. For example, “Search for ‘latest AI news’” returns recent AI-related articles and updates.

​
Web Scraping

Cofounder can extract detailed content from specific URLs. This is useful for obtaining structured content from websites. If the website cannot be scraped, Cofounder will try searching the web to obtain the sample information. Cofounder cannot access websites that require a login or authentication.

​
Examples

  • “Scrape content from https://example.com”.
  • “Extract information from LinkedIn profile <link>” handles professional profile data extraction.

​
Website Monitoring

Cofounder can monitor changes to websites or collections of websites. This is ideal for ongoing monitoring and notifications, such as competitor intelligence, trend detection, or blogs. Note that you might have specifically say “Monitor for changes” to ensure Cofounder understands you want to set up monitoring.

​
How it works

Cofounder will create a flow that will be responsible to check for changes. Under the hood, we use a concept call websets, which is just a collection of websites. Do not remove the webset_id from the flow, as that is how Cofounder knows what websites to check. We recommend adding a final notification step like Email me changes or Slack DM me changes to ensure you see the output.

​
Input Methods for website monitoring

Cofounder can handle list of urls in 3 ways.
  • Provide specific website addresses Monitor changes to https://techcrunch.com and https://theverge.com
  • Just mention site names, we’ll find the URLs, i.e. Monitor changes to TechCrunch and The Verge
  • Upload a csv file with a list of URLs

​
Cadence

  • Cofound can work on any cadence. Most websites do not change more than once per week or once per month.
⌘I