网络爬虫 API

API ID 15115

一个订阅中的网页工具:任何 URL 转换为适用于 LLMs 和 RAG 的干净 Markdown,使用 Open Graph 的链接预览,Twitter 卡片和网站图标,完整网页截图,以及一次调用的页面报告,Markdown + 元数据

API 文档

端点

请求
链接预览API - Open Graph 元标签 URL数据 无需密钥 每个请求返回最多100个结果 作为JSON
Endpoint ID: 40172
GET https://zylalabs.com/api/15115/web+scraping+api/40172/link+preview+api
输入参数

链接预览 — 端点功能

对象 描述
urls 可选 Web page, image, PDF or video URLs to preview, up to 50 per run (http or https; a URL without a scheme gets https). Each URL returns one row. Private, internal and localhost addresses are refused with an error row. Several values: comma separated.

剩余免费测试请求:3 / 3。


输入参数

urls
API 示例响应
JSON
{
    "count": 2,
    "items": [
        {
            "url": "https://example.com",
            "finalUrl": "https://example.com",
            "status": "ok",
            "httpStatus": 200,
            "title": "Example Domain",
            "description": null,
            "image": null,
            "imageWidth": null,
            "imageHeight": null,
            "imageAlt": null,
            "siteName": "example.com",
            "favicon": "https://example.com/favicon.ico",
            "type": null,
            "locale": null,
            "lang": "en",
            "canonical": null,
            "author": null,
            "publishedTime": null,
            "modifiedTime": null,
            "twitterCard": null,
            "twitterSite": null,
            "twitterCreator": null,
            "themeColor": null,
            "oembedUrl": null,
            "jsonLdTypes": [],
            "contentType": "text/html",
            "contentLength": null,
            "redirected": false,
            "error": null,
            "source": "The page's own HTML meta tags (Open Graph, Twitter Cards, JSON-LD, link tags)"
        },
        {
            "url": "https://en.wikipedia.org/wiki/Bulgaria",
            "finalUrl": "https://en.wikipedia.org/wiki/Bulgaria",
            "status": "ok",
            "httpStatus": 200,
            "title": "Bulgaria - Wikipedia",
            "description": null,
            "image": "https://thumb.wikimedia.org/wikipedia/commons/thumb/9/9a/Flag_of_Bulgaria.svg/1280px-Flag_of_Bulgaria.svg.png?utm_source=en.wikipedia.org&utm_campaign=index&utm_content=thumbnail",
            "imageWidth": 1200,
            "imageHeight": 720,
            "imageAlt": null,
            "siteName": "en.wikipedia.org",
            "favicon": "https://en.wikipedia.org/static/favicon/wikipedia.ico",
            "type": "website",
            "locale": null,
            "lang": "en",
            "canonical": "https://en.wikipedia.org/wiki/Bulgaria",
            "author": null,
            "publishedTime": null,
            "modifiedTime": null,
            "twitterCard": null,
            "twitterSite": null,
            "twitterCreator": null,
            "themeColor": null,
            "oembedUrl": null,
            "jsonLdTypes": [],
            "contentType": "text/html",
            "contentLength": null,
            "redirected": false,
            "error": null,
            "source": "The page's own HTML meta tags (Open Graph, Twitter Cards, JSON-LD, link tags)"
        }
    ]
}
链接预览 — 代码片段

curl --location --request GET 'https://zylalabs.com/api/15115/web+scraping+api/40172/link+preview+api?urls=https://example.com,https://en.wikipedia.org/wiki/Bulgaria' --header 'Authorization: Bearer YOUR_API_KEY' 


    
请求
网站内容爬虫 - LLM 的 Markdown 和 RAG 每个请求返回最多 100 条结果作为 JSON
Endpoint ID: 40173
GET https://zylalabs.com/api/15115/web+scraping+api/40173/website+content+crawler
输入参数

网站内容爬虫 — 端点功能

对象 描述
startUrls 可选 Web pages to convert to clean Markdown, one full URL per entry (http or https). Public pages only, no login pages. Several values: comma separated.
maxPages 可选 Hard limit on pages fetched in one run (also limits what you pay for). Failed pages count too.
crawl 可选 When on, the API also follows links that stay on the same domain as each start URL, up to Max crawl depth and Max pages.
maxDepth 可选 Only used when crawling. 1 = start URLs plus the pages they link to.
includeLinks 可选 Add the page links to every result as internalLinks and externalLinks lists (absolute URLs, up to 200 each).
includeImages 可选 Add the page images (absolute URL and alt text, up to 100) to every result.
maxCharsPerPage 可选 Cut markdown and text after this many characters to fit LLM context windows. 0 = no limit. The truncated flag tells you when a page was cut.
timeoutSecs 可选 Give up on a page that does not answer within this time.

剩余免费测试请求:3 / 3。


输入参数

startUrls
maxPages
crawl
maxDepth
includeLinks
includeImages
maxCharsPerPage
timeoutSecs
API 示例响应
JSON
{
    "count": 2,
    "items": [
        {
            "url": "https://en.wikipedia.org/wiki/Web_scraping",
            "finalUrl": "https://en.wikipedia.org/wiki/Web_scraping",
            "statusCode": 200,
            "fetchedAt": "2026-11-20T12:23:23Z",
            "error": null,
            "title": "Web scraping - Wikipedia",
            "description": null,
            "language": "en",
            "author": null,
            "publishedDate": "2005-09-17",
            "markdown": "# Web scraping\n\n**Web scraping**, **web harvesting**, or **web data extraction** is [data scraping](https://en.wikipedia.org/wiki/Data_scraping) used for [extracting data](https://",
            "wordCount": 4062,
            "headings": [
                "Web scraping",
                "History",
                "Techniques",
                "Human copy-and-paste",
                "Text pattern matching",
                "HTTP programming",
                "HTML parsing",
                "DOM parsing",
                "Vertical aggregation",
                "Semantic annotation recognizing",
                "Computer vision web-page analysis",
                "Legal issues",
                "United States",
                "European Union",
                "Australia",
                "India",
                "Methods to prevent web scraping",
                "See also",
                "References"
            ],
            "truncated": false,
            "extractor": "trafilatura",
            "contentHash": "ea8f9c85ca035c5fccbb5e8d"
        },
        {
            "statusCode": 200,
            "fetchedAt": "2026-11-20T12:23:22Z",
            "error": null,
            "title": "Your AI agent just got 20,000+ new tools on x402",
            "description": "10x more tools agents can pay for, in USDC. No API key.",
            "language": "en",
            "author": "Štěpán Škopek",
            "publishedDate": "2026-06-30",
            "markdown": "The value of AI agents is proportional to the size of tasks they can handle without human input. The longer and more complex the job, the more valuable an agent becomes. And to com",
            "wordCount": 1681,
            "headings": [
                "Paying for Actors over x402",
                "Give your agent a Coinbase wallet",
                "Alternatively you can use npx awal address to view wallet funding address and then npx awal balance to check the wallet balance",
                "Install the \"Get started\" skill to use `awal` CLI",
                "Ask your agent",
                "Enabling x402 payments in MCP",
                "Under the hood: The exact and upto settlement schemes",
                "The technical workflow",
                "Settlement, bookkeeping, and refunds",
                "A real world use case: trading signals from social data",
                "Get started with a drop-in agent skill",
                "List of useful resources"
            ],
            "truncated": false,
            "extractor": "trafilatura",
            "contentHash": "8e34492754a93a2a949734bb"
        }
    ]
}
网站内容爬虫 — 代码片段

curl --location --request GET 'https://zylalabs.com/api/15115/web+scraping+api/40173/website+content+crawler?startUrls=https://en.wikipedia.org/wiki/Web_scraping,https://blog.apify.com/introducing-x402-agentic-payments/&maxPages=20&crawl=false&maxDepth=1&includeLinks=false&includeImages=false&maxCharsPerPage=OptionaltimeoutSecs=20' --header 'Authorization: Bearer YOUR_API_KEY' 


    
请求
网站截图 - URL 转换为 PNG JPEG PDF 每个请求最多返回 100 个结果作为 JSON
Endpoint ID: 40174
GET https://zylalabs.com/api/15115/web+scraping+api/40174/website+screenshot
输入参数

网站截图 — 端点功能

对象 描述
urls 可选 Public web pages to capture, one URL per entry (http or https; a bare domain like also works). Login pages and private network addresses are not supported. Several values: comma separated.
device 可选 Viewport preset: desktop 1366x768, desktop-hd 1920x1080, laptop 1280x800, tablet 820x1180 (2x), mobile 390x844 (3x, touch). The real Chromium browser is used for all of them.
fullPage 可选 Capture the whole scrollable page (up to Max height). Off = only the visible viewport, like a thumbnail.
format 可选 PNG (lossless), JPEG (smaller files, set JPEG quality) or PDF (one long page with backgrounds).
jpegQuality 可选 Only for JPEG: 10-100. Lower = smaller file.
viewportWidth 可选 Optional. Overrides the device preset width (320-3840). 0 = use the preset.
viewportHeight 可选 Optional. Overrides the device preset height (240-2160). 0 = use the preset.
maxHeight 可选 Full-page captures are cut at this height (very long pages make huge files). The truncated flag tells you when this happened.
waitUntil 可选 When the page counts as loaded: load (default), domcontentloaded (fastest), networkidle (no network for 500 ms, best for heavy JavaScript apps).
delayMs 可选 Wait this long after loading before the capture (animations, charts, fonts). 0-30000.
waitForSelector 可选 Optional. Wait until this element is visible before the capture, for example #main.chart-ready.
elementSelector 可选 Optional CSS selector. When set, only the first matching element is captured (PNG/JPEG), for example header, #pricing.product-card.
hideCookieBanners 可选 Hide common cookie/consent popups (OneTrust, Cookiebot, Usercentrics, Didomi, Quantcast and more) with CSS so they do not cover the page. Nothing is clicked or accepted.
hideSelectors 可选 Optional CSS selectors to hide before the capture (chat widgets, sticky headers, ads), one per entry.
darkMode 可选 Ask the page for its dark color scheme (prefers-color-scheme: dark).

剩余免费测试请求:3 / 3。


输入参数

urls
device
fullPage
format
jpegQuality
viewportWidth
viewportHeight
maxHeight
waitUntil
delayMs
waitForSelector
elementSelector
hideCookieBanners
hideSelectors
darkMode
API 示例响应
JSON
{
    "count": 3,
    "items": [
        {
            "url": "https://en.wikipedia.org/wiki/Screenshot",
            "finalUrl": "https://en.wikipedia.org/wiki/Screenshot",
            "statusCode": 200,
            "title": "Screenshot - Wikipedia",
            "device": "desktop",
            "format": "png",
            "fullPage": true,
            "screenshotUrl": "https://radarbg.com/m/f/5ksUSH6EjK5ibH7VQ/shot-en.wikipedia.org-ce96fea443.png?s=ErwLjTxR8PZ7XagJ2tJ4",
            "key": "shot-en.wikipedia.org-ce96fea443.png",
            "takenAt": "2026-11-20T12:23:27Z",
            "error": null,
            "width": 1366,
            "height": 4266,
            "deviceScaleFactor": 1,
            "pageHeight": 4266,
            "truncated": false,
            "bytes": 854337,
            "sha256": "3077114932e6bc294786b8d1f103fe1b1e557ea76ecfc0766cbe57148b25c745",
            "contentHash": "b4667f19d8a8e0ea6bb4ecbc",
            "loadTimeMs": 1967,
            "warning": null
        },
        {
            "url": "https://www.python.org",
            "finalUrl": "https://www.python.org/",
            "statusCode": 200,
            "title": "Welcome to Python.org",
            "device": "desktop",
            "format": "png",
            "fullPage": true,
            "screenshotUrl": "https://radarbg.com/m/f/5ksUSH6EjK5ibH7VQ/shot-www.python.org-4863eab2e0.png?s=A4O6s61PQ1w1QDM1Xqg0",
            "key": "shot-www.python.org-4863eab2e0.png",
            "takenAt": "2026-11-20T12:23:29Z",
            "error": null,
            "width": 1366,
            "height": 2721,
            "deviceScaleFactor": 1,
            "pageHeight": 2721,
            "truncated": false,
            "bytes": 435190,
            "sha256": "8385ba1cda9d901603edfb96ed645ce5829324dd05a37607e7b9faf12c319e43",
            "contentHash": "6b150c6c4b711eb0a7f276ea",
            "loadTimeMs": 1256,
            "warning": null
        },
        {
            "statusCode": 200,
            "title": "source: Marketplace of ready-to-run tools for AI",
            "device": "desktop",
            "format": "png",
            "fullPage": true,
            "key": "shot-source.com-7c0cb88185.png",
            "takenAt": "2026-11-20T12:23:29Z",
            "error": null,
            "width": 1366,
            "height": 10000,
            "deviceScaleFactor": 1,
            "pageHeight": 10072,
            "truncated": true,
            "bytes": 948673,
            "sha256": "411747907bc325eff8d89eaed41f474b6ef19592eabdd3634689e8a54ca35207",
            "contentHash": "97d76a744a8bc2de6e93d9e2",
            "loadTimeMs": 3985,
            "warning": null
        }
    ]
}
网站截图 — 代码片段

curl --location --request GET 'https://zylalabs.com/api/15115/web+scraping+api/40174/website+screenshot?urls=https://apify.com,https://en.wikipedia.org/wiki/Screenshot,https://www.python.org&device=desktop&fullPage=true&format=png&jpegQuality=80&viewportWidth=OptionalviewportHeight=OptionalmaxHeight=10000&waitUntil=load&delayMs=OptionalhideCookieBanners=true&darkMode=false' --header 'Authorization: Bearer YOUR_API_KEY' 


    
请求
一个请求一个URL:主要内容以干净的Markdown格式提供给LLMs,包括字数、语言、作者,以及标题、描述、Open Graph图像、网站名称和favicon 大约1-3秒
Endpoint ID: 40175
GET https://zylalabs.com/api/15115/web+scraping+api/40175/web+page+report
输入参数

网页报告 — 端点功能

对象 描述
url 可选 Page URL (url value)
maxChars 可选 Cut the Markdown after this many characters

剩余免费测试请求:3 / 3。


输入参数

url
maxChars
API 示例响应
JSON
{
    "count": 1,
    "items": [
        {
            "url": "https://en.wikipedia.org/wiki/Web_scraping",
            "finalUrl": "https://en.wikipedia.org/wiki/Web_scraping",
            "checkedAt": "2026-11-20T12:23:31Z",
            "title": "Web scraping - Wikipedia",
            "description": null,
            "image": null,
            "siteName": "en.wikipedia.org",
            "favicon": "https://en.wikipedia.org/static/favicon/wikipedia.ico",
            "language": "en",
            "author": null,
            "wordCount": 4062,
            "markdown": "# Web scraping\n\n**Web scraping**, **web harvesting**, or **web data extraction** is [data scraping](https://en.wikipedia.org/wiki/Data_scraping) used for [extracting data](https://",
            "truncated": false,
            "openGraph": {
                "url": "https://en.wikipedia.org/wiki/Web_scraping",
                "finalUrl": "https://en.wikipedia.org/wiki/Web_scraping",
                "status": "ok",
                "httpStatus": 200,
                "title": "Web scraping - Wikipedia",
                "description": null,
                "image": null,
                "imageWidth": null,
                "imageHeight": null,
                "imageAlt": null,
                "siteName": "en.wikipedia.org",
                "favicon": "https://en.wikipedia.org/static/favicon/wikipedia.ico",
                "type": "website",
                "locale": null,
                "lang": "en",
                "canonical": "https://en.wikipedia.org/wiki/Web_scraping",
                "author": null,
                "publishedTime": null,
                "modifiedTime": null,
                "twitterCard": null,
                "twitterSite": null,
                "twitterCreator": null,
                "themeColor": null,
                "oembedUrl": null,
                "jsonLdTypes": [],
                "contentType": "text/html",
                "contentLength": null,
                "redirected": false,
                "error": null,
                "source": "The page's own HTML meta tags (Open Graph, Twitter Cards, schema.org JSON-LD, link tags)"
            },
            "partErrors": null
        }
    ]
}
网页报告 — 代码片段

curl --location --request GET 'https://zylalabs.com/api/15115/web+scraping+api/40175/web+page+report?url=https://en.wikipedia.org/wiki/Web_scraping&maxChars=50000' --header 'Authorization: Bearer YOUR_API_KEY' 


    

API 访问密钥和身份验证

注册后,每个开发者都会被分配一个个人 API 访问密钥,这是一个唯一的字母和数字组合,用于访问我们的 API 端点。要使用 网络爬虫 API 进行身份验证,只需在 Authorization 标头中包含您的 bearer token。

标头
标头 描述
授权 必需 应为 Bearer access_key. 订阅后,请查看上方的"您的 API 访问密钥"。

无长期承诺。随时升级、降级或取消。

起价
$10,000/年


  • 自定义数量
  • 自定义速率限制
  • 专业客户支持
  • 实时 API 监控

概览

一项订阅中的网页工具:任何 URL 转换为 LLM 和 RAG 的干净 Markdown 使用 Open Graph 的链接预览 Twitter 卡片和网站图标 全页面网站截图以及一键页面报告 Markdown + 元数据

网络爬虫 API FAQs

一个订阅中的网页工具:任何URL转为适用于LLM和RAG的干净Markdown,带Open Graph、Twitter卡片和网站图标的链接预览,全页面网站截图以及一次调用的页面报告(Markdown + 元数据)

每个请求最多返回100个结果,具体取决于端点

每个请求从公共来源收集实时数据 相同的请求可以从缓存中提供长达6小时

列表参数接受多个用逗号分隔的值,例如:伦敦,巴黎

该端点接受这些查询参数,均为可选:url,maxChars。Url:页面 URL(url 值)maxChars:在此字符数后截断 Markdown

一般常见问题

Zyla API Hub 就像一个大型 API 商店,您可以在一个地方找到数千个 API。我们还为所有 API 提供专门支持和实时监控。注册后,您可以选择要使用的 API。请记住,每个 API 都需要自己的订阅。但如果您订阅多个 API,您将为所有这些 API 使用相同的密钥,使事情变得更简单。
价格以 USD(美元)、EUR(欧元)、CAD(加元)、AUD(澳元)和 GBP(英镑)列出。我们接受所有主要的借记卡和信用卡。我们的支付系统使用最新的安全技术,由 Stripe 提供支持,Stripe 是世界上最可靠的支付公司之一。如果您在使用卡片付款时遇到任何问题,请通过 [email protected]

此外,如果您已经以这些货币中的任何一种(USD、EUR、CAD、AUD、GBP)拥有有效订阅,该货币将保留用于后续订阅。只要您没有任何有效订阅,您可以随时更改货币。
定价页面上显示的本地货币基于您 IP 地址的国家/地区,仅供参考。实际价格以 USD(美元)为单位。当您付款时,即使您在我们的网站上看到以本地货币显示的等值金额,您的卡片对账单上也会以美元显示费用。这意味着您不能直接使用本地货币付款。
有时,银行可能会因其欺诈保护设置而拒绝收费。我们建议您首先联系您的银行,检查他们是否阻止了我们的收费。此外,您可以访问账单门户并更改关联的卡片以进行付款。如果这些方法不起作用并且您需要进一步帮助,请通过 [email protected]
价格由月度或年度订阅决定,具体取决于所选计划。
API 调用根据成功请求从您的计划中扣除。每个计划都包含您每月可以进行的特定数量的调用。只有成功的调用(由状态 200 响应指示)才会计入您的总数。这确保失败或不完整的请求不会影响您的月度配额。
Zyla API Hub 采用月度订阅系统。您的计费周期将从您购买付费计划的那一天开始,并在下个月的同一日期续订。因此,如果您想避免未来的费用,请提前取消订阅。
要升级您当前的订阅计划,只需转到 API 的定价页面并选择您要升级到的计划。升级将立即生效,让您立即享受新计划的功能。请注意,您之前计划中的任何剩余调用都不会转移到新计划,因此在升级时请注意这一点。您将被收取新计划的全部金额。
要检查您本月剩余多少 API 调用,请参考响应标头中的 "X-Zyla-API-Calls-Monthly-Remaining" 字段。例如,如果您的计划允许每月 1,000 个请求,而您已使用 100 个,则响应标头中的此字段将显示 900 个剩余调用。
要查看您的计划允许的最大 API 请求数,请检查 "X-Zyla-RateLimit-Limit" 响应标头。例如,如果您的计划包括每月 1,000 个请求,此标头将显示 1,000。
"X-Zyla-RateLimit-Reset" 标头显示您的速率限制重置之前的秒数。这告诉您何时您的请求计数将重新开始。例如,如果它显示 3,600,则意味着还有 3,600 秒直到限制重置。
是的,您可以随时通过访问您的账户并在账单页面上选择取消选项来取消您的计划。请注意,升级、降级和取消会立即生效。此外,取消后,您将不再有权访问该服务,即使您的配额中还有剩余调用。
为了让您有机会在没有任何承诺的情况下体验我们的 API,我们提供 7 天免费试用,允许您免费进行最多 50 次 API 调用。此试用只能使用一次,因此我们建议将其应用于您最感兴趣的 API。虽然我们的大多数 API 都提供免费试用,但有些可能不提供。试用在 7 天后或您进行了 50 次请求后结束,以先发生者为准。如果您在试用期间达到 50 次请求限制,您需要"开始您的付费计划"以继续发出请求。您可以在个人资料中的订阅 -> 选择您订阅的 API -> 定价标签下找到"开始您的付费计划"按钮。或者,如果您在第 7 天之前不取消订阅,您的免费试用将结束,您的计划将自动计费,授予您访问计划中指定的所有 API 调用的权限。请记住这一点以避免不必要的费用。
7 天后,您将被收取试用期间订阅的计划的全额费用。因此,在试用期结束前取消很重要。因忘记及时取消而提出的退款请求不被接受。
当您订阅 API 免费试用时,您可以进行最多 50 次 API 调用。如果您希望超出此限制进行额外的 API 调用,API 将提示您执行"开始您的付费计划"。您可以在个人资料中的订阅 -> 选择您订阅的 API -> 定价标签下找到"开始您的付费计划"按钮。
付款订单在每月 20 日至 30 日之间处理。如果您在 20 日之前提交请求,您的付款将在此时间范围内处理。
您可以通过我们的聊天渠道联系我们以获得即时帮助。我们始终在线,时间为上午 8 点至下午 5 点(EST)。如果您在该时间之后联系我们,我们将尽快回复您。此外,您可以通过 [email protected]

相关 API


您可能还喜欢