{
"count": 2,
"items": [
{
"url": "https://en.wikipedia.org/wiki/Web_scraping",
"finalUrl": "https://en.wikipedia.org/wiki/Web_scraping",
"statusCode": 200,
"fetchedAt": "2026-11-16T07:09:31Z",
"error": null,
"title": "Web scraping - Wikipedia",
"description": null,
"language": "en",
"author": null,
"publishedDate": "2005-09-17",
"markdown": "# Web scraping\n\n**Web scraping**, **web harvesting**, or **web data extraction** is [data scraping](https://en.wikipedia.org/wiki/Data_scraping) used for [extracting data](https://",
"wordCount": 4062,
"headings": [
"Web scraping",
"History",
"Techniques",
"Human copy-and-paste",
"Text pattern matching",
"HTTP programming",
"HTML parsing",
"DOM parsing",
"Vertical aggregation",
"Semantic annotation recognizing",
"Computer vision web-page analysis",
"Legal issues",
"United States",
"European Union",
"Australia",
"India",
"Methods to prevent web scraping",
"See also",
"References"
],
"truncated": false,
"extractor": "trafilatura",
"contentHash": "ea8f9c85ca035c5fccbb5e8d"
},
{
"statusCode": 200,
"fetchedAt": "2026-11-16T07:09:30Z",
"error": null,
"title": "Your AI agent just got 20,000+ new tools on x402",
"description": "10x more tools agents can pay for, in USDC. No API key.",
"language": "en",
"author": "Štěpán Škopek",
"publishedDate": "2026-06-30",
"markdown": "The value of AI agents is proportional to the size of tasks they can handle without human input. The longer and more complex the job, the more valuable an agent becomes. And to com",
"wordCount": 1681,
"headings": [
"Paying for Actors over x402",
"Give your agent a Coinbase wallet",
"Alternatively you can use npx awal address to view wallet funding address and then npx awal balance to check the wallet balance",
"Install the \"Get started\" skill to use `awal` CLI",
"Ask your agent",
"Enabling x402 payments in MCP",
"Under the hood: The exact and upto settlement schemes",
"The technical workflow",
"Settlement, bookkeeping, and refunds",
"A real world use case: trading signals from social data",
"Get started with a drop-in agent skill",
"List of useful resources"
],
"truncated": false,
"extractor": "trafilatura",
"contentHash": "8e34492754a93a2a949734bb"
}
]
}
curl --location --request GET 'https://zylalabs.com/api/14819/web+fetch+api/38413/web+fetch?startUrls=https://en.wikipedia.org/wiki/Web_scraping,https://blog.apify.com/introducing-x402-agentic-payments/&maxPages=20&crawl=false&maxDepth=1&includeLinks=false&includeImages=false&maxCharsPerPage=OptionaltimeoutSecs=20' --header 'Authorization: Bearer YOUR_API_KEY'
注册后,每个开发者都会被分配一个个人 API 访问密钥,这是一个唯一的字母和数字组合,用于访问我们的 API 端点。要使用 网络抓取 API 进行身份验证,只需在 Authorization 标头中包含您的 bearer token。
| 标头 | 描述 |
|---|---|
授权
|
必需
应为 Bearer access_key. 订阅后,请查看上方的"您的 API 访问密钥"。
|
将网页转换为干净的Markdown格式以用于LLM提示 RAG和AI代理 移除菜单和广告 返回标题 元描述 语言 日期 标题 文本 单词计数 可选链接和图片 同站爬虫
每个请求最多返回100个结果,具体取决于端点
每个请求从公共源收集实时数据 相同的请求可以在缓存中服务最长达6小时
列表参数接受多个用逗号分隔的值,例如:伦敦,巴黎
Web Fetch API 返回结构化的数据来自网页,包括标题、元描述、语言、发布日期、标题、文本内容、字数,以及可选的链接和图像,全部以干净的 Markdown 格式进行排版
响应中的关键字段包括 `url` `finalUrl` `statusCode` `fetchedAt` `title` `description` `language` `publishedDate` `siteName` `markdown` 和 `text` 提供了有关抓取网页的全面细节
响应数据以JSON格式组织,包含结果的`count`和`items`数组。每个项目包括详细字段,如URL、标题和内容,便于解析和使用
该API提供信息,例如页面标题、元描述、语言、发布日期、标题、正文、字数以及可选的链接和图像,从而允许丰富的内容提取
`statusCode` 表示 HTTP 响应状态 `fetchedAt` 显示数据检索的时间 `markdown` 包含经过清理的文本,便于在应用程序中使用,例如 LLM 提示