Investing.com is not allowing anymore to scrape historical prices

English Quotes
1

I’ve got this ISIN in portfolio - it’s italian bond (BTP) - IT0005547390. I’m used to get historical quotes from investing.com via the “table on website” provider, by inserting the URL: https://www.investing.com/rates-bonds/it0005547390-historical-data

I do the same for all other bonds I have in portfolio, as I cannot find their quotes anywhere else.

But since June 26th, investing.com is returning an HTTP 403 error:

image
image1326×1058 70.2 KB

Any tricks I can use to get the quotes ? Or does the embedded scraper need to be updated so it doesn’t get banned by investing.com ?

Thanks for your support

2

https://www.investing.com/rates-bonds/it0005547390-historical-data works for me

grafik
grafik666×846 52.5 KB

Maybe the 403-return is just for your IP - too much request from you?

3

Hey, thanks for your feedback

It seems the issue is still there.

This time I’ve logged my IP and tried to cURL the same URL from the command line and I still get a 403. But I can browse to the very same URL with a browser and don’t get any error!

So likely the issue is in one of the following:

  1. PP calls investing.com URLs in too short a timespan for investing to allow it (I’ve got a few bonds in my pf)

  2. investing.com doesn’t like my IP. But would there any reason why ?

I will try with a different IP and see if I get blocked again!

4

Try another URL too: https://de.investing.com/rates-bonds/it0005547390-historical-data