{
"url": "https://example.com/",
"title": "Example Domain",
"author": null,
"published": null,
"site_name": "example.com",
"description": null,
"language": "en",
"format": "markdown",
"content": "This domain is for use in documentation examples without needing permission. This is not a service; avoid relying on it for testing and monitoring purposes.",
"word_count": 25,
"characters": 156,
"empty": false,
"fetched_in_ms": 64
}
curl --location --request GET 'https://zylalabs.com/api/14966/web+page+reader+api/39299/convert+a+web+page+to+clean+markdown?url=https://example.com/&format=markdown&include_links=true&include_images=false&include_tables=true&main_content_only=true' --header 'Authorization: Bearer YOUR_API_KEY'
{
"url": "https://example.com/",
"title": "Example Domain",
"description": null,
"image": null,
"site_name": null,
"type": null,
"author": null,
"published": null,
"language": "en",
"canonical": null,
"favicon": "data:,",
"theme_color": null,
"twitter_card": null,
"open_graph": [],
"twitter": [],
"structured_data_types": [],
"status": 200,
"redirected_from": []
}
curl --location --request GET 'https://zylalabs.com/api/14966/web+page+reader+api/39300/link+preview+metadata+and+open+graph+data?url=https://example.com/' --header 'Authorization: Bearer YOUR_API_KEY'
{
"url": "https://example.com/",
"total": 0,
"internal": 0,
"external": 0,
"links": []
}
curl --location --request GET 'https://zylalabs.com/api/14966/web+page+reader+api/39301/list+the+links+on+a+page?url=https://example.com/&scope=all&limit=200' --header 'Authorization: Bearer YOUR_API_KEY'
{
"url": "https://example.com/",
"status": 200,
"score": 65,
"title": "Example Domain",
"meta_description": null,
"h1": [],
"headings": {
"h1": 0,
"h2": 0,
"h3": 0,
"h4": 0,
"h5": 0,
"h6": 0
},
"canonical": null,
"robots_meta": null,
"word_count": 26,
"images": 0,
"images_without_alt": 0,
"html_bytes": 577,
"response_ms": 64,
"redirects": [],
"checks": [
{
"check": "title",
"status": "warn",
"detail": "14 characters (15 to 60 is the usual target)."
},
{
"check": "meta_description",
"status": "fail",
"detail": "Missing meta description."
},
{
"check": "h1",
"status": "fail",
"detail": "0 <h1> heading(s); one is expected."
}
],
"note": "Checks the HTML as delivered; content added by JavaScript is not seen."
}
curl --location --request GET 'https://zylalabs.com/api/14966/web+page+reader+api/39302/on-page+seo+audit?url=https://example.com/' --header 'Authorization: Bearer YOUR_API_KEY'
{
"host": "example.com",
"has_robots_txt": false,
"allowed": true,
"user_agent": "*",
"sitemaps": [],
"crawl_delay": null
}
curl --location --request GET 'https://zylalabs.com/api/14966/web+page+reader+api/39303/read+robots+rules+and+test+a+url+against+them?url=https://example.com/&user_agent=*' --header 'Authorization: Bearer YOUR_API_KEY'
{
"sitemap": "https://www.sitemaps.org/sitemap.xml",
"type": "urls",
"total": 84,
"offset": 0,
"entries": [
{
"url": "https://www.sitemaps.org/",
"last_modified": "2016-11-21"
},
{
"url": "https://www.sitemaps.org/protocol.html",
"last_modified": "2022-12-15"
},
{
"url": "https://www.sitemaps.org/faq.html",
"last_modified": "2016-11-21"
}
]
}
curl --location --request GET 'https://zylalabs.com/api/14966/web+page+reader+api/39304/parse+an+xml+sitemap?url=https://www.sitemaps.org/sitemap.xml&limit=500&offset=Optional' --header 'Authorization: Bearer YOUR_API_KEY'
注册后,每个开发者都会被分配一个个人 API 访问密钥,这是一个唯一的字母和数字组合,用于访问我们的 API 端点。要使用 网页阅读器 API 进行身份验证,只需在 Authorization 标头中包含您的 bearer token。
| 标头 | 描述 |
|---|---|
授权
|
必需
应为 Bearer access_key. 订阅后,请查看上方的"您的 API 访问密钥"。
|
获取您命名的页面 提取器自我识别并遵循robots.txt
JavaScript未运行,因此在浏览器中构建的页面返回的信息很少 阻止机器人或在robots.txt中禁止爬虫的网站返回错误而不是内容 大于3 MB的页面、非标准端口和非公共地址会被拒绝 你有责任使用你获取的内容的权利