You told us you run an agency. The agents agencies start with → You told us you lead a go-to-market team. The agents GTM teams start with →
Connectors/Web crawler
internal · internal

Web crawler

Built into Nexus; no account, no credential.

setup
built in
usage cost
no per-call cost
required by
25 agents
used by
1 more, when present
Requires it

These agents cannot run without it.

g2m-discovery
G2M discovery
Crawls the client and competitors to draft the go-to-market strategy every downstream agent is grounded in.
required
brand-identity
Brand identity
Extracts colors, type, voice, pillars and imagery rules into a reusable brand model.
required
paid-ads-strategy
Paid-ads strategy
Objective-by-channel benchmarks and client targets that grade every paid report.
required
social-strategy
Social strategy
Growth pillars, hook library, format mix and a 90-day roadmap for brand social.
required
webinar-strategy
Webinar strategy
The plan for a webinar program: who it is for, the targets, format mix and cadence, topic pillars and backlog, speakers, promotion, the hot-lead rule and a 12-month roadmap.
required
proposal-research
Proposal research
Prospect and competitor research that feeds a priced, branded proposal.
required
keyword-research
Keyword research
A scored keyword universe from Planner data, grouped into themes and intents.
required
seo-aeo-baseline
SEO + AEO baseline
The first-run baseline across crawl, rankings and answer-engine probes.
required
technical-seo-audit
Technical SEO audit
Crawlability, indexation, redirects, schema and Core Web Vitals as one prioritized fix list.
required
aeo-visibility-monthly
AI visibility monitor
Probes ChatGPT, Claude, Perplexity and Gemini with the client's buyer queries and tracks who gets cited.
required
content-gap-analysis
Content gap analysis
Topics competitors rank and get cited for that the client does not, prioritized against strategy.
required
seo-orchestrator
SEO orchestrator
Runs the monthly SEO cadence end to end and keeps the live SEO dashboard current.
required
site-health-monthly
Site health pulse
A lightweight monthly health check between deep audits.
required
content-engine
Content review agent
Per-piece review and remediation against the brief, the QA report and the brand voice.
required
content-engine-discovery
Content discovery
Finds what to write next from inventory, competitors and demand signals.
required
page-content-structure
Page content structure
Section-by-section structure for a landing or service page before copy is written.
required
competitor-moves
Competitor moves
What changed on competitor sites since the last sweep.
required
competitor-ux-audit
Competitor UX audit
Onboarding, copy psychology and trust placement, as a comparative teardown.
required
knowledge-enrichment
Knowledge enrichment
Finds what third parties have published about the client and files it, clearly marked as outside observation.
required
google-ads-lp-audit
Landing-page audit
Message match and conversion friction on the pages ads send traffic to.
required
author-identity
Author identity
Voice, point of view, signature stories and posting cadence per author, from their real writing.
required
lead-account-discovery
Account discovery
Scored look-alike accounts, incremental to what is already on file.
required
lead-account-enrichment
Account enrichment
Competitors, positioning gaps and a why-now for each approved target.
required
web-sitemap
Web sitemap
Site structure from the G2M, competitors, the current site and keyword demand.
required
web-wireframe
Web wireframe
Section-level blueprints per page type, with CTAs, proof and schema slots.
required
Governance

Reads are free to run; writes are gated.

  • Credentials live per client on an encrypted volume, never in a prompt.
  • Anything Nexus would write through this connector previews first and needs a human yes.
Evidence for this connector
25 agents that require it1 agents that use it when present49 agents in the registry20 live dashboards6 governance claims with code behind them

System facts are generated from the same model this page renders from. Client work appears here only with the client’s written consent, so live dashboards are never linked.

Machine twin: /connectors/web_crawl.json · /nexus.json · /llms.txt

See what Nexus would run for your team.

A two-minute evaluation: what you want to change, what you run on, and the agents, connectors and cost band that fit. It stays in your browser until you send it.

Just want updates? Leave your work email.