Search Scrape and Feed API

API ID 14297

Search the web, read a page as clean text, extract or crawl site content and parse RSS and Atom feeds into structured JSON for research and monitoring apps.

API Documentation

Endpoints

Request
Runs a web search and returns ranked results with title, URL and snippet, so an app can retrieve current information without a browser.
Endpoint ID: 35829
GET https://zylalabs.com/api/14297/search+scrape+and+feed+api/35829/web+search+results
INPUT PARAMETERS

Web Search Results — Endpoint Features

Object Description
q Required Search query text, for example ireland rail timetable.

Free test requests remaining: 3 of 3.


INPUT PARAMETERS

q
API EXAMPLE RESPONSE
JSON
{"query":"ireland rail timetable","count":8,"results":[{"title":"Rail transport in Ireland","url":"https://en.wikipedia.org/wiki/Rail_transport_in_Ireland","snippet":"Rail transport in Ireland (InterCity, commuter and freight) is provided by Iarnród Éireann in the Republic of Ireland and by Northern Ireland Railways","source":"Wikipedia","extract":"Rail transport in Ireland (InterCity, commuter and freight) is provided by Iarnród Éireann in the Republic of Ireland and by Northern Ireland Railways in Northern Ireland.\nMost routes in the Republic radiate from Dublin. Northern Ireland has suburban routes from Belfast and two main InterCity lines, to Derry and cross-border to Dublin.\nThe accompanying map of the current railway network shows lines that are fully operational (in red), carrying freight only traffic (in black) and with dotted black lines those which have been \"mothballed\" (i.e. closed to traffic but potentially easy to re-open).","page_id":609867},{"title":"Iarnród Éireann","url":"https://en.wikipedia.org/wiki/Iarnr%C3%B3d_%C3%89ireann","snippet":"Iarnród Éireann, (Irish: [ˈiəɾˠnˠɾˠoːd̪ˠ ˈeːɾʲən̪ˠ]) or Irish Rail, is the operator of the national railway network of Ireland. Established on 2 February","source":"Wikipedia"},{"title":"Newbridge railway station (Ireland)","url":"https://en.wikipedia.org/wiki/Newbridge_railway_station_(Ireland)","snippet":"in Ireland "Timetables". Irish Rail. Archived from the original on 2 April 2019. Retrieved 8 August 2012. "Newbridge station" (PDF). Railscot - Irish Railways","source":"Wikipedia"},{"title":"British railway technical manuals","url":"https://en.wikipedia.org/wiki/British_railway_technical_manuals","snippet":"Network Rail in PDF format only. GB Rail Timetable, published from December 2007 (originally as "UK Rail Timetable", although Northern Ireland was not","source":"Wikipedia"},{"title":"Arriva Rail North","url":"https://en.wikipedia.org/wiki/Arriva_Rail_North","snippet":"2018 timetable fallout. Conversely, Arriva contended that there had been "collective system inability", citing Network Rail's inadequate timetabling to","source":"Wikipedia"},{"title":"List of countries by rail transport network size","url":"https://en.wikipedia.org/wiki/List_of_countries_by_rail_transport_network_size","snippet":"This is a sortable list of countries by rail transport network size based on length of rail lines. For the purposes of this page, railway has been defined","source":"Wikipedia"},{"title":"High-speed rail in Europe","url":"https://en.wikipedia.org/wiki/High-speed_rail_in_Europe","snippet":"High-speed rail (HSR) has developed in Europe as an increasingly popular and efficient means of transport. The first high-speed rail lines on the continent","source":"Wikipedia"},{"title":"Sutton railway station (Ireland)","url":"https://en.wikipedia.org/wiki/Sutton_railway_station_(Ireland)","snippet":"original on 6 July 2024. Retrieved 6 July 2024. "Amchlár DART/DART Timetable" (PDF). Irish Rail. 13 May 2024. Archived (PDF) from the original on 5 July 2024","source":"Wikipedia"}],"sources":["Wikipedia"],"has_api_key":false,"wikipedia_enabled":true,"note":"Wikipedia + DuckDuckGo results. For full web search, get a free Bing API key (azure.com) and I deploy instantly."}
Web Search Results — CODE SNIPPETS

curl --location --request GET 'https://zylalabs.com/api/14297/search+scrape+and+feed+api/35829/web+search+results?q=ireland rail timetable' --header 'Authorization: Bearer YOUR_API_KEY' 


    
Request
Fetches a public page and returns its title, description, word count and readable text with the markup stripped out.
Endpoint ID: 35830
GET https://zylalabs.com/api/14297/search+scrape+and+feed+api/35830/read+page+as+text
INPUT PARAMETERS

Read Page as Text — Endpoint Features

Object Description
url Required Public page URL including the https scheme.

Free test requests remaining: 3 of 3.


INPUT PARAMETERS

url
API EXAMPLE RESPONSE
JSON
{
    "url": "https://example.com",
    "title": "Example Domain",
    "description": "",
    "word_count": 25,
    "reading_time_minutes": 1,
    "language": "unknown",
    "content": "This domain is for use in documentation examples without needing permission. This is not a service; avoid relying on it for testing and monitoring purposes.",
    "links": {
        "total": 0,
        "list": []
    },
    "images": {
        "total": 0,
        "list": []
    },
    "meta": {
        "status": 200,
        "content_type": "text/html; charset=utf-8",
        "canonical": "",
        "feed": ""
    }
}
Read Page as Text — CODE SNIPPETS

curl --location --request GET 'https://zylalabs.com/api/14297/search+scrape+and+feed+api/35830/read+page+as+text?url=https://example.com' --header 'Authorization: Bearer YOUR_API_KEY' 


    
Request
Fetches a public page and returns its title, content type, HTTP status and the extracted text content for storage or analysis.
Endpoint ID: 35831
GET https://zylalabs.com/api/14297/search+scrape+and+feed+api/35831/extract+page+content
INPUT PARAMETERS

Extract Page Content — Endpoint Features

Object Description
url Required Public page URL including the https scheme.

Free test requests remaining: 3 of 3.


INPUT PARAMETERS

url
API EXAMPLE RESPONSE
JSON
{
    "url": "https://example.com",
    "title": "Example Domain",
    "content_type": "text/html; charset=utf-8",
    "content": "Example Domain\nThis domain is for use in documentation examples without needing permission. This is not a service; avoid relying on it for testing and monitoring purposes.",
    "word_count": 27,
    "scrape_time_ms": 3,
    "status": 200
}
Extract Page Content — CODE SNIPPETS

curl --location --request GET 'https://zylalabs.com/api/14297/search+scrape+and+feed+api/35831/extract+page+content?url=https://example.com' --header 'Authorization: Bearer YOUR_API_KEY' 


    
Request
Follows links from a root URL and reports how many URLs were discovered and how many pages were fetched with their text.
Endpoint ID: 35832
GET https://zylalabs.com/api/14297/search+scrape+and+feed+api/35832/crawl+site+links
INPUT PARAMETERS

Crawl Site Links — Endpoint Features

Object Description
url Required Root URL to start crawling from, including the https scheme.

Free test requests remaining: 3 of 3.


INPUT PARAMETERS

url
API EXAMPLE RESPONSE
JSON
{
    "target": "https://example.com",
    "domain": "example.com",
    "total_urls_found": 1,
    "pages_fetched": 1,
    "sitemap_found": false,
    "pages": [
        {
            "url": "https://example.com",
            "title": "Example Domain",
            "meta_description": "",
            "word_count": 32,
            "external_links": 0,
            "status": 200,
            "content_type": "text/html; charset=utf-8"
        }
    ],
    "summary": {
        "total_words": 32,
        "avg_word_count": 32,
        "errors": 0
    }
}
Crawl Site Links — CODE SNIPPETS

curl --location --request GET 'https://zylalabs.com/api/14297/search+scrape+and+feed+api/35832/crawl+site+links?url=https://example.com' --header 'Authorization: Bearer YOUR_API_KEY' 


    
Request
Parses an RSS, Atom or JSON feed and returns the feed title and its entries as structured items, ready for a news reader or digest.
Endpoint ID: 35833
GET https://zylalabs.com/api/14297/search+scrape+and+feed+api/35833/parse+rss+and+atom+feeds
INPUT PARAMETERS

Parse RSS and Atom Feeds — Endpoint Features

Object Description
url Required Feed URL including the https scheme.

Free test requests remaining: 3 of 3.


INPUT PARAMETERS

url
API EXAMPLE RESPONSE
JSON
{
    "feed": {
        "title": "BBC News",
        "url": "https://feeds.bbci.co.uk/news/rss.xml",
        "entries_count": 34
    },
    "entries": [
        {
            "title": "Zelensky says Ukraine has right to defend itself after Trump calls refinery strikes a 'disgrace'",
            "link": "https://www.bbc.co.uk/news/articles/c58jz174w89ro?at_medium=RSS&at_campaign=rss",
            "description": "",
            "pubDate": "Fri, 16 Oct 2026 13:25:48 GMT",
            "guid": "https://www.bbc.co.uk/news/articles/c58jz174w89ro#1"
        },
        {
            "title": "Norwegian teen 'hitman' detained for UK murder plot",
            "link": "https://www.bbc.co.uk/news/articles/cw8rzpl1ldkdo?at_medium=RSS&at_campaign=rss",
            "description": "",
            "pubDate": "Fri, 16 Oct 2026 13:43:21 GMT",
            "guid": "https://www.bbc.co.uk/news/articles/cw8rzpl1ldkdo#1"
        },
        {
            "title": "Israeli settlers attack Palestinians in West Bank during olive harvest",
            "link": "https://www.bbc.co.uk/news/videos/cqn06zx2r15jo?at_medium=RSS&at_campaign=rss",
            "description": "",
            "pubDate": "Fri, 16 Oct 2026 11:40:41 GMT",
            "guid": "https://www.bbc.co.uk/news/videos/cqn06zx2r15jo#1"
        },
        {
            "title": "British father fined for causing his two-year-old son's death in Cyprus hotel fall",
            "link": "https://www.bbc.co.uk/news/articles/cvj6j1klez88o?at_medium=RSS&at_campaign=rss",
            "description": "",
            "pubDate": "Fri, 16 Oct 2026 13:01:06 GMT",
            "guid": "https://www.bbc.co.uk/news/articles/cvj6j1klez88o#1"
        },
        {
            "title": "Watch: Did Tesla really just unveil a flying car?",
            "link": "https://www.bbc.co.uk/news/videos/ckly4mj1g3n9o?at_medium=RSS&at_campaign=rss",
            "description": "",
            "pubDate": "Fri, 16 Oct 2026 12:32:31 GMT",
            "guid": "https://www.bbc.co.uk/news/videos/ckly4mj1g3n9o#1"
        },
        {
            "title": "Catherine says nature can help children's emotional growth",
            "link": "https://www.bbc.co.uk/news/articles/cmly0n4nzq5qo?at_medium=RSS&at_campaign=rss",
            "description": "",
            "pubDate": "Fri, 16 Oct 2026 12:06:22 GMT",
            "guid": "https://www.bbc.co.uk/news/articles/cmly0n4nzq5qo#1"
        },
        {
            "title": "Burnham invites Swinney to work together on 'deeper Scottish devolution'",
            "link": "https://www.bbc.co.uk/news/articles/cmlykv9pey7go?at_medium=RSS&at_campaign=rss",
            "description": "",
            "pubDate": "Fri, 16 Oct 2026 13:24:14 GMT",
            "guid": "https://www.bbc.co.uk/news/articles/cmlykv9pey7go#1"
        },
        {
            "title": "Woman says she was left 'bewildered and confused' by alleged Russell Brand assault",
            "link": "https://www.bbc.co.uk/news/articles/ck8dz6m1d2n6o?at_medium=RSS&at_campaign=rss",
            "description": "",
            "pubDate": "Fri, 16 Oct 2026 14:06:59 GMT",
            "guid": "https://www.bbc.co.uk/news/articles/ck8dz6m1d2n6o#1"
        },
        {
            "title": "We must save water as drought becomes new normal, says minister",
            "link": "https://www.bbc.co.uk/news/articles/cq0ld4g0309go?at_medium=RSS&at_campaign=rss",
            "description": "",
            "pubDate": "Fri, 16 Oct 2026 12:15:15 GMT",
            "guid": "https://www.bbc.co.uk/news/articles/cq0ld4g0309go#1"
        },
        {
            "title": "Ten-year-old Willow among children to benefit from pioneering same-day test to spot infections",
            "link": "https://www.bbc.co.uk/news/articles/cw5yn83m8gypo?at_medium=RSS&at_campaign=rss",
            "description": "",
            "pubDate": "Fri, 16 Oct 2026 00:34:45 GMT",
            "guid": "https://www.bbc.co.uk/news/articles/cw5yn83m8gypo#1"
        },
        {
            "title": "Police officer who raped two women jailed for 12 years",
            "link": "https://www.bbc.co.uk/news/articles/cqkg53v29005o?at_medium=RSS&at_campaign=rss",
            "description": "",
            "pubDate": "Fri, 16 Oct 2026 10:54:24 GMT",
            "guid": "https://www.bbc.co.uk/news/articles/cqkg53v29005o#1"
        },
        {
            "title": "The hero dinner lady who died saving five children in the Aberfan disaster",
            "link": "https://www.bbc.co.uk/news/articles/cw1m49yve2n4o?at_medium=RSS&at_campaign=rss",
            "description": "",
            "pubDate": "Fri, 16 Oct 2026 05:11:56 GMT",
            "guid": "https://www.bbc.co.uk/news/articles/cw1m49yve2n4o#2"
        },
        {
            "title": "Your child didn't get a party invite - here’s what to do",
            "link": "https://www.bbc.co.uk/news/articles/cr86zjee80p9o?at_medium=RSS&at_campaign=rss",
            "description": "",
            "pubDate": "Fri, 16 Oct 2026 11:17:28 GMT",
            "guid": "https://www.bbc.co.uk/news/articles/cr86zjee80p9o#2"
        },
        {
            "title": "'People call them pervert glasses': Blind users fear backlash over smart tech",
            "link": "https://www.bbc.co.uk/news/articles/cq2d6e56n85go?at_medium=RSS&at_campaign=rss",
            "description": "",
            "pubDate": "Fri, 16 Oct 2026 05:23:00 GMT",
            "guid": "https://www.bbc.co.uk/news/articles/cq2d6e56n85go#2"
        },
        {
            "title": "I find it quite demoralising in store - why I do all my shopping online",
            "link": "https://www.bbc.co.uk/news/articles/c36lk280kd1o?at_medium=RSS&at_campaign=rss",
            "description": "",
            "pubDate": "Thu, 15 Oct 2026 23:16:12 GMT",
            "guid": "https://www.bbc.co.uk/news/articles/c36lk280kd1o#2"
        },
        {
            "title": "They fled Russia, but the West sent them back",
            "link": "https://www.bbc.co.uk/news/articles/c6x23qpzjklwo?at_medium=RSS&at_campaign=rss",
            "description": "",
            "pubDate": "Fri, 16 Oct 2026 04:57:28 GMT",
            "guid": "https://www.bbc.co.uk/news/articles/c6x23qpzjklwo#2"
        },
        {
            "title": "Our business ads were taken down for saying 'pregnancy' on Instagram",
            "link": "https://www.bbc.co.uk/news/articles/cvj6jznp9ww9o?at_medium=RSS&at_campaign=rss",
            "description": "",
            "pubDate": "Fri, 16 Oct 2026 00:53:58 GMT",
            "guid": "https://www.bbc.co.uk/news/articles/cvj6jznp9ww9o#2"
        },
        {
            "title": "Weekly quiz: Which star is lending his voice to Gromit?",
            "link": "https://www.bbc.co.uk/news/articles/c3gr85dl78y4o?at_medium=RSS&at_campaign=rss",
            "description": "",
            "pubDate": "Thu, 15 Oct 2026 17:52:33 GMT",
            "guid": "https://www.bbc.co.uk/news/articles/c3gr85dl78y4o#2"
        },
        {
            "title": "Sign up now",
            "link": "https://www.bbc.co.uk/news/articles/c2lkky9zngvo?at_medium=RSS&at_campaign=rss",
            "description": "",
            "pubDate": "Wed, 09 Sep 2026 10:24:59 GMT",
            "guid": "https://www.bbc.co.uk/news/articles/c2lkky9zngvo#3"
        },
        {
            "title": "Mother of Henry Nowak's killer could be released early",
            "link": "https://www.bbc.co.uk/news/articles/cqze4l9l2eywo?at_medium=RSS&at_campaign=rss",
            "description": "",
            "pubDate": "Fri, 16 Oct 2026 09:40:37 GMT",
            "guid": "https://www.bbc.co.uk/news/articles/cqze4l9l2eywo#4"
        }
    ]
}
Parse RSS and Atom Feeds — CODE SNIPPETS

curl --location --request GET 'https://zylalabs.com/api/14297/search+scrape+and+feed+api/35833/parse+rss+and+atom+feeds?url=https://feeds.bbci.co.uk/news/rss.xml' --header 'Authorization: Bearer YOUR_API_KEY' 


    

API Access Key & Authentication

After signing up, every developer is assigned a personal API access key, a unique combination of letters and digits provided to access to our API endpoint. To authenticate with the Search Scrape and Feed API simply include your bearer token in the Authorization header.

Headers
Header Description
Authorization Required Should be Bearer access_key. See "Your API Access Key" above when you are subscribed.

No long-term commitment. Upgrade, downgrade, or cancel anytime.

Starts at
$10,000/Year


  • Custom Volume
  • Custom Rate Limit
  • Specialized Customer Support
  • Real-Time API Monitoring

Overview

Search the web, read a page as clean text, extract or crawl site content and parse RSS and Atom feeds into structured JSON for research and monitoring apps.

General FAQs

To obtain your API key, first sign in to your account and navigate to the API you want to use. From the API's Pricing section, choose a plan and complete the subscription process. Once subscribed, return to the API page and you will see your API Access Key displayed at the top of the documentation page. You can use this key to authenticate your requests.

You can’t switch APIs during the free trial. If you subscribe to a different API, your trial will end and the new subscription will start as a paid plan.

The free trial lasts for 7 days and allows you to make up to 50 API requests.

No, the free trial is available only once, so we recommend using it on the API that interests you the most. Most of our APIs offer a free trial, but some may not include this option.

Yes. If the API offers a free trial, you will see a "Free 7-Day Trial" option in its Pricing section. The trial lasts for 7 days and allows up to 50 API requests, enabling you to evaluate the API before subscribing to a paid plan.

Zyla API Hub is like a big store for APIs, where you can find thousands of them all in one place. We also offer dedicated support and real-time monitoring of all APIs. Once you sign up, you can pick and choose which APIs you want to use. Just remember, each API needs its own subscription. But if you subscribe to multiple ones, you'll use the same key for all of them, making things easier for you.

Prices are listed in USD (United States Dollar), EUR (Euro), CAD (Canadian Dollar), AUD (Australian Dollar), and GBP (British Pound). We accept all major debit and credit cards. Our payment system uses the latest security technology and is powered by Stripe, one of the world's most reliable payment companies. If you have any trouble paying by card, just contact us at [email protected]

Additionally, if you already have an active subscription in any of these currencies (USD, EUR, CAD, AUD, GBP), that currency will remain for subsequent subscriptions. You can change the currency at any time as long as you don't have any active subscriptions.
The local currency shown on the pricing page is based on the country of your IP address and is provided for reference only. The actual prices are in USD (United States Dollar). When you make a payment, the charge will appear on your card statement in USD, even if you see the equivalent amount in your local currency on our website. This means you cannot pay directly with your local currency.
Occasionally, a bank may decline the charge due to its fraud protection settings. We suggest reaching out to your bank initially to check if they are blocking our charges. Also, you can access the Billing Portal and change the card associated to make the payment. If these does not work and you need further assistance, please contact our team at [email protected]
Prices are determined by a recurring monthly or yearly subscription, depending on the chosen plan.
API calls are deducted from your plan based on successful requests. Each plan comes with a specific number of calls that you can make per month. Only successful calls, indicated by a Status 200 response, will be counted against your total. This ensures that failed or incomplete requests do not impact your monthly quota.
Zyla API Hub works on a recurring monthly subscription system. Your billing cycle will start the day you purchase one of the paid plans, and it will renew the same day of the next month. So be aware to cancel your subscription beforehand if you want to avoid future charges.
To upgrade your current subscription plan, simply go to the pricing page of the API and select the plan you want to upgrade to. The upgrade will be instant, allowing you to immediately enjoy the features of the new plan. Please note that any remaining calls from your previous plan will not be carried over to the new plan, so be aware of this when upgrading. You will be charged the full amount of the new plan.
To check how many API calls you have left for the current month, refer to the 'X-Zyla-API-Calls-Monthly-Remaining' field in the response header. For example, if your plan allows 1,000 requests per month and you've used 100, this field in the response header will indicate 900 remaining calls.

You can monitor your API usage through the response headers included with every request:

x-zyla-api-calls-monthly-used: Shows the total number of API requests you have used during the current billing period.
x-zyla-api-calls-monthly-remaining: Shows the number of API requests you have remaining for the current billing period.

The 'X-Zyla-RateLimit-Reset' header shows the number of seconds until your rate limit resets. This tells you when your request count will start fresh. For example, if it displays 3,600, it means 3,600 seconds are left until the limit resets.

Yes, you can cancel your subscription at any time. Simply go to the Pricing section of the API you're subscribed to and click the "Unsubscribe" button.

Please note that upgrades, downgrades, and cancellations take effect immediately. Once your subscription is canceled, access to the service will end immediately, regardless of any remaining API calls in your quota.

After 7 days, you will be charged the full amount for the plan you were subscribed to during the trial. Therefore, it's important to cancel before the trial period ends. Refund requests for forgetting to cancel on time are not accepted.
When you subscribe to an API free trial, you can make up to 50 API calls. If you wish to make additional API calls beyond this limit, the API will prompt you to perform an "Start Your Paid Plan." You can find the "Start Your Paid Plan" button in your profile under Subscription -> Choose the API you are subscribed to -> Pricing tab.
You can contact us through our chat channel to receive immediate assistance. We are always online from 8 am to 5 pm (EST). If you reach us after that time, we will get back to you as soon as possible. Additionally, you can contact us via email at [email protected]

Please have a look at our Refund Policy: https://zylalabs.com/terms#refund


Related APIs