Web Content Extraction API

The Web Content Extraction API Extracts core content and metadata from news articles and blogs easily, providing structured data for analysis or integration into applications.

About the API: 

With Article Web Content Extraction API, accessing the main content and metadata of news or blog posts becomes simple and efficient. Designed to capture the essential information of an article, this API allows you to obtain the main text, title, author, publication date and other key data from a given URL. Ideal for users who need to integrate content into their applications without dealing with the complexity of a manual scraping process, this API provides well-structured JSON responses. Applications can use the data for multiple purposes, such as content analysis, creating automatic summaries or public opinion studies on social networks. The API is compatible with popular news sites and blogs, making it a reliable tool for those looking to optimize their workflows with up-to-date and easily accessible data.

API Documentation

Endpoints


Sends a GET request with the url parameter to receive the main content and metadata of an article.The response returns data in structured JSON.



                                                                            
GET https://zylalabs.com/api/5376/web+content+extraction+api/6957/article+content
                                                                            
                                                                        

Article Content - Endpoint Features

Object Description
url [Required]
Test Endpoint

API EXAMPLE RESPONSE

       
                                                                                                        
                                                                                                                                                                                                                            [{"url":"https://www.nytimes.com/athletic/5891368/2024/11/01/inter-miami-neymar-move/","title":"Gerardo Martino dismisses speculation about Neymar joining Messi, Suarez at Inter Miami","description":"Inter Miami coach Gerardo Martino said speculation about Neymar joining Inter Miami is just that — speculation — and would likely need a change in Major League Soccer (MLS) salary rules to be a real possibility.\nSpeaking at the team’s training session before Saturday’s playoff game in Atlanta, Martino was asked about the possibility of Neymar joining the team in 2025 following a Wall Street Journal report that the Brazilian winger purchased a waterfront lot in Miami for $26 million.\n&#8220;Everyone that buys at home here is going to come to play?” Martino asked, with a laugh. \n“I...","links":["https://www.nytimes.com/athletic/5891368/2024/11/01/inter-miami-neymar-move/"],"image":"https://static01.nyt.com/athletic/uploads/wp/2024/11/01142712/GettyImages-2180026734-1-scaled-e1730485664868.jpg?width=1200&height=630&fit=cover","content":"<div><p><span>Inter Miami coach Gerardo Martino said speculation about Neymar joining Inter Miami is just that — speculation — and would likely need a change in Major League Soccer (MLS) salary rules to be a real possibility.</span></p><p><span>Speaking at the team’s training session before Saturday’s playoff game in Atlanta, Martino was asked about the possibility of Neymar joining the team in 2025 following a <a target=\"_blank\" href=\"https://www.wsj.com/real-estate/luxury-homes/neymar-miami-home-ed7b99a6\">Wall Street Journal report</a> that the Brazilian winger purchased a waterfront lot in Miami for $26 million.</span></p><p><span>“Everyone that buys at home here is going to come to play?” Martino asked, with a laugh. </span></p><p><span>“</span><span>I arrived in Barcelona at the same time as [Neymar]. It was a good year and for me being able to coach such highly-regarded players will always be a very special memory. Nothing more than that,” he said.</span></p><p><span>Reporters continued to press Martino on the potential for a reunion considering the fact that four former Barcelona players — Lionel Messi, Luis Suarez, Jordi Alba and Sergio Busquets — have already reunited with the MLS club in South Florida.</span></p><p><span>Could he imagine a scenario with all five together?</span></p><p><span>“With [Lionel Messi] and the rest of the boys already here, anything can happen,” Martino said. “What I can’t imagine is if the league doesn’t make the salary cap more flexible, how it would be carried out. After writing it or saying it in the media, it’s all good, nothing happens, it doesn’t have any consequences. But what would the implementation be like? No one explains that. And the reality is that if there is something that the MLS has, it is that the rules are strict and can’t be broken, unless the MLS decides to change.”</span></p><p><span>“What’s happening is throwing out names just to throw them out.”</span></p><p><span>A reporter pointed out a recent report from </span><i><span>The Athletic</span></i><span> that <a target=\"_blank\" href=\"https://www.nytimes.com/athletic/5865369/2024/10/23/mls-calendar-fall-spring/\">MLS is considering changing the format of its calendar as early as 2026</a>, and Martino quipped that those changes would be in two years’ time, not a few months.</span></p><p><span>“The truth is that one cannot talk so easily and freely about whether a player could come or not,” Martino said. “It seems to me that when we talk about this, another type of support is needed. We cannot talk or mention a player because he bought a house here or has a girlfriend from Fort Lauderdale.</span></p><p><span>“It’s nonsense, you have to speak conclusively. First you have to analyze what the league offers and if this is really possible. Starting from that base, today this is impossible, so there is no reason to continue the conversation.”</span></p><h2><strong>What would Miami need to do to sign Neymar?</strong></h2><p><span>Martino is right. Under MLS rules, Neymar could not fit on to Inter Miami’s roster as it’s currently constructed — at least not as a designated player.</span></p><p><span>In MLS, teams are heavily restricted in how their owners are able to spend money on rosters, with the bulk of the outlay focused on the top three to six spots on the roster. </span></p><p><span>Teams are given two options of how to build their roster. They can have three designated players (DPs): players whose budget hit, calculated by acquisition costs and salary, are unlimited, but who hit the cap at the “maximum budget charge;” and three under-22 initiative players: players aged 22 or younger whose acquisition costs do not count toward the cap, but whose salary is restricted to the league’s “maximum salary budget charge.”</span></p><p><span>Teams can also opt to carry just two designated players and have four “U-22 players.” Those teams also receive a payment of up to $2 million in “allocation money” which is, essentially, an accounting currency that provides extra cap space in the form of “dollars”.</span></p><p><span>OK, take a breath. Rub your eyes. </span></p><p><span>Let’s try to sort out what that means for Miami.</span></p><p><span>Currently, Inter Miami have opted for the 2-and-4 format: two DPs, Lionel Messi and Sergio Busquets, and four U-22s: Tomás Avilés, Diego Gómez, Federico Redondo and Benjamin Cremaschi.</span></p><p><span>It’s important to recognize that this format opens up more cap space for teams because U-22 players hit the budget at a lower cap number and the league provides that $2 million in GAM, which can be used to buy down other players’ cap hits. </span></p><p><span>In 2025, DPs will hit the cap at $743,750, while U-22s will hit the cap at either $150,000 (aged 20 or below) or $200,000 (aged 21 or 22). Which means Inter Miami is saving about $550,000 in cap space by taking a fourth U-22 rather than a third DP — and that’s without accounting for the extra $2 million in GAM. That matters for Inter Miami because they are carrying multiple players who make significant money, but aren’t DPs, including Alba, Suarez, Julian Gressel and Nico Freire.</span></p><p><span>In order to fit Neymar, Inter Miami would need one of two scenarios to play out. </span></p><p><span>The first is easy: Neymar would have to agree to come on a deal similar to Alba and Suarez. That is, take a discount to play with his friends. That was made easier for Alba, in part, because he was being paid out many millions of dollars still from Barcelona. Neymar is out of contract in Saudi Arabia in the summer. Would there be a payout if he agreed to leave early? Would he be willing to make a maximum of $1.744 million in 2025? </span></p><p><span>If so, he could fit — as long as Miami found a way to cut salary elsewhere to accommodate his arrival.</span></p><p><span>Second, Miami could opt to switch to a 3-and-3 format: three designated player and three U-22s. This would be very difficult to achieve on multiple levels. First, Miami would have to get rid of not one, but two U-22s. So while Gomez’s sale to Brighton seems to be all wrapped up for January, Miami would have to move another U-22 because Facundo Farias is on a U-22 deal and will be coming back from his season-ending injury.</span></p><p><span>Then, after selling or trading a U-22 player, Miami would have to make sure they had the requisite cap space open to accommodate a third DP hitting the books at that $743,750 — which, in theory, could be easier than taking him on that $1.744 number, but not when you get rid of the $2 million in allocation money the team is getting from MLS in the 2-and-4 format. </span></p><p><span>In other words, making Neymar a DP would likely necessitate multiple player sales, both from the team’s arsenal of U-22 players and also from the rest of the roster.</span></p><p><span>Not impossible, but difficult. And complicated. </span></p><p><em>(Francois Nel/Getty Images)</em></p>\n</div><div><p><span><strong><a href=\"https://www.nytimes.com/athletic/author/paul-tenorio/\" target=\"_blank\">Paul Tenorio</a></strong>  is a senior writer for The Athletic who covers soccer. He has previously written for the Washington Post, the Orlando Sentinel, FourFourTwo, ESPN and MLSsoccer.com.</span> <span>Follow Paul on Twitter <strong><a target=\"_blank\" href=\"https://twitter.com/PaulTenorio\">@PaulTenorio</a></strong></span></p></div>","author":"Paul Tenorio","favicon":"https://www.nytimes.com/athletic/static/img/athletic-icon-144x144.png","source":"nytimes.com","published":"2024-11-01t18:37:31+00:00","ttr":222,"type":"article"}]
                                                                                                                                                                                                                    
                                                                                                    

Article Content - CODE SNIPPETS


curl --location --request GET 'https://zylalabs.com/api/5376/web+content+extraction+api/6957/article+content?url=https://www.nytimes.com/athletic/5891368/2024/11/01/inter-miami-neymar-move/' --header 'Authorization: Bearer YOUR_API_KEY' 


    

API Access Key & Authentication

After signing up, every developer is assigned a personal API access key, a unique combination of letters and digits provided to access to our API endpoint. To authenticate with the Web Content Extraction API REST API, simply include your bearer token in the Authorization header.
Headers
Header Description
Authorization [Required] Should be Bearer access_key. See "Your API Access Key" above when you are subscribed.

Simple Transparent Pricing

No long term commitments. One click upgrade/downgrade or cancellation. No questions asked.

🚀 Enterprise

Starts at
$ 10,000/Year


  • Custom Volume
  • Specialized Customer Support
  • Real-Time API Monitoring

Customer favorite features

  • ✔︎ Only Pay for Successful Requests
  • ✔︎ Free 7-Day Trial
  • ✔︎ Multi-Language Support
  • ✔︎ One API Key, All APIs.
  • ✔︎ Intuitive Dashboard
  • ✔︎ Comprehensive Error Handling
  • ✔︎ Developer-Friendly Docs
  • ✔︎ Postman Integration
  • ✔︎ Secure HTTPS Connections
  • ✔︎ Reliable Uptime

Send the URL of the article to be analyzed as a parameter to obtain the main content and metadata.

The Web Content Extraction it is an API that extracts content and metadata from news articles and blogs in a structured format.

Receives an article URL and returns the main content, title, author, and other metadata in JSON.

Create automatic summaries of news and blogs. Collect data for content analysis. Monitor news and blogs for public opinion analysis.

190 requests per minute on all plans

There are different plans suits everyone including a free trial for small amount of requests, but it’s rate is limit to prevent abuse of the service.

The API uses API keys for authentication. To access the API, include your API key in the request header. The API key is provided upon registration and should be kept secure.

The API returns detailed information about the age and history of a domain, including years, months and days since its creation, as well as expiration and update dates.

Zyla API Hub is like a big store for APIs, where you can find thousands of them all in one place. We also offer dedicated support and real-time monitoring of all APIs. Once you sign up, you can pick and choose which APIs you want to use. Just remember, each API needs its own subscription. But if you subscribe to multiple ones, you'll use the same key for all of them, making things easier for you.

Prices are listed in USD (United States Dollar), EUR (Euro), CAD (Canadian Dollar), AUD (Australian Dollar), and GBP (British Pound). We accept all major debit and credit cards. Our payment system uses the latest security technology and is powered by Stripe, one of the world’s most reliable payment companies. If you have any trouble paying by card, just contact us at [email protected]

Additionally, if you already have an active subscription in any of these currencies (USD, EUR, CAD, AUD, GBP), that currency will remain for subsequent subscriptions. You can change the currency at any time as long as you don't have any active subscriptions.

The local currency shown on the pricing page is based on the country of your IP address and is provided for reference only. The actual prices are in USD (United States Dollar). When you make a payment, the charge will appear on your card statement in USD, even if you see the equivalent amount in your local currency on our website. This means you cannot pay directly with your local currency.

Occasionally, a bank may decline the charge due to its fraud protection settings. We suggest reaching out to your bank initially to check if they are blocking our charges. Also, you can access the Billing Portal and change the card associated to make the payment. If these does not work and you need further assistance, please contact our team at [email protected]

Prices are determined by a recurring monthly or yearly subscription, depending on the chosen plan.

API calls are deducted from your plan based on successful requests. Each plan comes with a specific number of calls that you can make per month. Only successful calls, indicated by a Status 200 response, will be counted against your total. This ensures that failed or incomplete requests do not impact your monthly quota.

Zyla API Hub works on a recurring monthly subscription system. Your billing cycle will start the day you purchase one of the paid plans, and it will renew the same day of the next month. So be aware to cancel your subscription beforehand if you want to avoid future charges.

To upgrade your current subscription plan, simply go to the pricing page of the API and select the plan you want to upgrade to. The upgrade will be instant, allowing you to immediately enjoy the features of the new plan. Please note that any remaining calls from your previous plan will not be carried over to the new plan, so be aware of this when upgrading. You will be charged the full amount of the new plan.

To check how many API calls you have left for the current month, refer to the ‘X-Zyla-API-Calls-Monthly-Remaining’ field in the response header. For example, if your plan allows 1000 requests per month and you've used 100, this field in the response header will indicate 900 remaining calls.

To see the maximum number of API requests your plan allows, check the ‘X-Zyla-RateLimit-Limit’ response header. For instance, if your plan includes 1000 requests per month, this header will display 1000.

The ‘X-Zyla-RateLimit-Reset’ header shows the number of seconds until your rate limit resets. This tells you when your request count will start fresh. For example, if it displays 3600, it means 3600 seconds are left until the limit resets.

Yes, you can cancel your plan anytime by going to your account and selecting the cancellation option on the Billing page. Please note that upgrades, downgrades, and cancellations take effect immediately. Additionally, upon cancellation, you will no longer have access to the service, even if you have remaining calls left in your quota.

You can contact us through our chat channel to receive immediate assistance. We are always online from 8 am to 5 pm (EST). If you reach us after that time, we will get back to you as soon as possible. Additionally, you can contact us via email at [email protected]

To let you experience our APIs without any commitment, we offer a 7-day free trial that allows you to make API calls at no cost during this period. Please note that you can only use this trial once, so make sure to use it with the API that interests you the most. Most of our APIs provide a free trial, but some may not support it.

After 7 days, you will be charged the full amount for the plan you were subscribed to during the trial. Therefore, it’s important to cancel before the trial period ends. Refund requests for forgetting to cancel on time are not accepted.

When you subscribe to an API trial, you can make only 25% of the calls allowed by that plan. For example, if the API plan offers 1000 calls, you can make only 250 during the trial. To access the full number of calls offered by the plan, you will need to subscribe to the full plan.

 Service Level
100%
 Response Time
2,381ms

Category:


Related APIs