Scheduled Automation

Daily Web Digest to Your Inbox (Firecrawl)

A scheduled job that scrapes the pages and sites you care about with Firecrawl, summarizes the fresh content with an LLM, and emails you a clean daily digest.

What It Does

This recipe is a low-effort personal news/digest worker. Once a day it pulls the latest content from a list of URLs (a blog, a docs changelog, a competitor’s pricing page, a subreddit), turns the messy HTML into clean markdown with Firecrawl, summarizes what’s new with an LLM, and sends you one tidy email. It’s the “morning briefing from the open web” without building a scraper from scratch.

The Stack

  • Firecrawl — /scrape returns clean LLM-ready markdown for a page; map + crawl cover whole sites; the hosted /agent endpoint can autonomously research and summarize a site.
  • A scheduler — run it daily on Val Town Cron (free scheduled functions) or any cron in the catalog.
  • An LLM — summarize the scraped content with a free/BYOK model such as Mistral AI (La Plateforme).
  • Email delivery — any SMTP/email API to send the digest.

Step-by-Step Outline

  1. List your sources — the handful of URLs you want watched.
  2. Scrape — call Firecrawl /scrape per URL (or crawl for a section) to get clean markdown.
  3. Detect what’s new — diff against the previous run, or just summarize today’s top items.
  4. Summarize — prompt the LLM to produce a short, skimmable digest with links.
  5. Schedule + send — wrap it in a daily cron function and email yourself the result.

Source

Firecrawl — How to build an agent that summarizes a website quickly (pattern also shown as a daily Firecrawl → summarize → email workflow on n8n)