Page endpoint

What can you do with the page endpoint?

  • Scrape availability and pricing from product detail page urls
  • When used in combination with a sitemap: scrape the full contents of a webshop
  • Scrape content and images from product detail page urls

API response

request_id unique ShoppingScraper request_id
query link link the requested url from ShoppingScraper
endpoint type page endpoint
app found webshop
metadata additional metadata to be used for your own internal references
geo country selected country for request

language selected language
status response response from API request
message status message of response
stats results number of offers found on this page
timestamp record of the time of the request
pagespeed amount of seconds of request
results classification type of data returned
title matched product title with EAN 
brand brand of the product
category name of the category and urls associated with the breadcrumb
mpn/ean found mpn or ean on the product page
sku Google Shopping product id or doc id
link Google Shopping URL of matched product
currency used currency of country
stats offers number of sellers found for this EAN
offers price price of product at specific seller offer
offers shipment shipment type of seller offer
offers shippingCosts shipping costs of specific seller offer
offers totalPrice total price incl. shipping of specific seller offer
offers seller seller name
offers availability availability of specific product offer
offers state state of specific product offer
offers ranking ranking of product offer
content specs specifications found
content description description found 
content images multiple images found
reviews scale maximum score given for review
reviews rating average rating of product
reviews count total count of number of reviews
Register now and get 100 credits for free!

Parameters


Description Example values
metadata Add your own metadata to your request, will be added to the payload internal product id = 5555
url Add the url of the product detail page here https://www.ikea.com/gb/en/p/billy-bookcase-white-00263850/
api_key Your ShoppingScraper API key no example to show here 😉

Geolocation

We retrieve the product detail page from various data connections. Currently we don't offer to select the geolocation, this is on our roadmap.

Sample URL

https://api.shoppingscraper.com/page/?api_key={API_KEY}&url={URL}&metadata={producitd:5555}

Sample payload

{
  "shoppingscraper": {
    "request_id": "85a845e3-b5a9-4e60-a6b6-a38f7c8c538e",
    "query": {
      "link": "http://api.shoppingscraper.com/page/?api_key=xxxxxx&url=https://www.ikea.com/gb/en/p/billy-bookcase-white-00263850/"
    },
    "endpoint": {
      "type": "page",
      "app": "ikea"
    },
    "metadata": {
      
    },
    "geo": {
      "country": "uk",
      "language": "en"
    },
    "status": {
      "response": 200,
      "message": "OK"
    },
    "stats": {
      "results": 1,
      "timestamp": "Tue Aug 08 2022 11:22:38 UTC+0000",
      "pagespeed": 1.749
    },
    "results": [
      {
        "classification": "product",
        "title": "BILLY Bookcase - white 80x28x202 cm",
        "brand": "IKEA",
        "category": [
          {
            "name": "Products",
            "url": "https://www.ikea.com/gb/en/cat/products-products/"
          },
          {
            "name": "Storage & organisation",
            "url": "https://www.ikea.com/gb/en/cat/storage-organisation-st001/"
          },
          {
            "name": "Bookcases & shelving units",
            "url": "https://www.ikea.com/gb/en/cat/bookcases-shelving-units-st002/"
          },
          {
            "name": "Bookcases",
            "url": "https://www.ikea.com/gb/en/cat/bookcases-10382/"
          },
          {
            "name": "BILLY Bookcase",
            "url": "https://www.ikea.com/gb/en/p/billy-bookcase-white-00263850/"
          }
        ],
        "mpn": "002.638.50",
        "extended": {
          
        },
        "sku": "002.638.50",
        "link": "https://www.ikea.com/gb/en/p/billy-bookcase-white-00263850/",
        "currency": "GBP",
        "ranking": {
          
        },
        "stats": {
          "offers": 1
        },
        "offers": [
          {
            "price": 50.0,
            "shipment": "standard",
            "shippingCosts": 0.0,
            "seller": "IKEA",
            "availability": "InStock",
            "state": "new",
            "ranking": {
              "productList": 1
            }
          }
        ],
        "content": {
          "specs": [
            
          ],
          "description": "BILLY Bookcase - white 80x28x202 cm. Adjustable shelves; adapt space between shelves according to your needs. A simple unit can be enough storage for a limited space or the foundation for a larger storage solution if your needs change. Min. ceiling height required: 205 cm.",
          "images": [
            "https://www.ikea.com/gb/en/images/products/billy-bookcase-white__0625599_pe692385_s5.jpg",
            "https://www.ikea.com/gb/en/images/products/billy-bookcase-white__1051924_pe845813_s5.jpg",
            "https://www.ikea.com/gb/en/images/products/billy-bookcase-white__0394567_pe561390_s5.jpg",
            "https://www.ikea.com/gb/en/images/products/billy-bookcase-white__0249652_pe387976_s5.jpg",
            "https://www.ikea.com/gb/en/images/products/billy-bookcase-white__1065929_ph181488_s5.jpg",
            "https://www.ikea.com/gb/en/images/products/billy-bookcase-white__1065928_ph182491_s5.jpg",
            "https://www.ikea.com/gb/en/images/products/billy-bookcase-white__1065965_ph158750_s5.jpg",
            "https://www.ikea.com/gb/en/images/products/billy-bookcase-white__1065956_ph161331_s5.jpg",
            "https://www.ikea.com/gb/en/images/products/billy-bookcase-white__0546689_pe656300_s5.jpg"
          ],
          "reviews": {
            "scale": 5,
            "rating": 4.7,
            "count": 173
          }
        },
        "thumbnail": "https://www.ikea.com/gb/en/images/products/billy-bookcase-white__0625599_pe692385_s5.jpg",
        "reviews": {
          
        }
      }
    ]
  }
}
Register now and get 100 credits for free!

Free trial

Did this answer your question? Thanks for the feedback There was a problem submitting your feedback. Please try again later.

Let Scotty help you. Send us a message. Send us a message.