Scraping Coinmarketcap data returns only the first 10 results, why the rest 90 don’t return?

I've no issue scraping it and even scrapping any number of the pages I define but it shows only the first 10 results of each page

def scrap_pages(page_num):
for page in range(1, page_num+1):
    headers = {'User-Agent': 
    'Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/47.0.2526.106 Safari/537.36'}

    url = "https://coinmarketcap.com/?page={}".format(page)
    page_tree = requests.get(url, headers=headers)
    pageSoup = BeautifulSoup(page_tree.content, 'html.parser')

    print("Page {} Parsed successfully!".format(url))


Read more here: https://stackoverflow.com/questions/66334006/scraping-coinmarketcap-data-returns-only-the-first-10-results-why-the-rest-90-d

Content Attribution

This content was originally published by XIII at Recent Questions - Stack Overflow, and is syndicated here via their RSS feed. You can read the original post over there.

%d bloggers like this: