magnus919

GroktoCrawl Project Gutenberg Adapter — Demo

groktocrawl scrape https://www.gutenberg.org/ebooks/11 → full Alice in Wonderland as chapter-structured markdown.

The Problem

Public-domain books are the largest open corpus of high-quality text on the internet. But getting them into a format an LLM, RAG system, or agent can use means:

1. Finding the right download URL (EPUB? plain text? illustrated?)
2. Dealing with Gutenberg's boilerplate header/footer in plain-text downloads

magnus919

name	slopsearx
description	Cloud-native, stateless, AI-agent-first meta search engine with 48 plugin engines. SearXNG-compatible API, category routing, distributed rate limiting, and agent-native YAML+Markdown output.

SlopSearX Skill — Agent Demo

magnus919

GroktoCrawl + Skill Demo: 20 Adapters, One Command

What this demonstrates: How the GroktoCrawl CLI combined with its skill document creates a seamless experience for both human CLI users and AI agents. The CLI handles 20+ different site types through a transparent adapter system — one scrape command, radically different structured output depending on what you feed it. The skill tells agents exactly which command to reach for and when.

---

Part 1: The CLI Experience — Five Content Types, One Command

The adapter system dispatches to the right handler automatically. You don't pick an adapter; you just scrape <url>.

magnus919

SlopSearX — Live Demo Results (2026-06-10)

All 16 API-key-free search engines queried against localhost:8888. Each section shows the exact curl command and its output.

pypi — PyPI — Python Package Index

curl -s "http://localhost:8888/search?q=requests&engines=pypi&format=json"

magnus919

SlopSearX — Live Demo Results (2026-06-10)

All 16 API-key-free search engines queried against localhost:8888. Each section shows the exact curl command and its output.

---

1. PyPI — Python Package Index

magnus919

SlopSearX — Live Demo Results (2026-06-10)

All 16 API-key-free search engines queried against localhost:8888. Each section shows the exact curl command used and its output.

---

1. PyPI — Python Package Index

magnus919

SlopSearX — Live Demo Results (2026-06-10)

All 16 API-key-free search engines demoed against the running server. Server: uvicorn slopsearx.server:app --port 8888

---

1. PyPI — Python Package Index

Query: requests | Status: ok (1 result, 52ms)

magnus919

SlopSearX: Security Engines Milestone — Live Demo

Deployed live on bishop.local:8090. 15 new security engine adapters across two PRs.

PR #79 — 6 No-Key Security Engines (merged)

Engine	Type	Description	Demo Status
CRT.sh	API	Certificate Transparency log search	Timeout from network (API reachable, 20s response)
URLhaus	API (POST)	Malware URL/payload tracking	API now requires auth (changed)
FIRST EPSS	API	CVE exploit probability (0-1)	Working

magnus919

Groktocrawl Security Adapters

Demo against CVE-2024-3094 (xz backdoor) and 8.8.8.8 (Google DNS).

---

NVD API — nvd.py (priority 200)

Enriched CVE data via NVD API v2.0: CVSS, CWE, tagged references.

magnus919

Groktocrawl CVE Adapters — structured CVE data from public APIs

Demo against CVE-2024-3094 (xz backdoor), the most critical CVE of 2024.

---

Adapter 1: NVD API (nvd.nist.gov)

The NVD adapter returns enriched data: CVSS scores, CWE classification, tagged references, and CPE matches.