Main causes

  • Client uses an outdated HTTP version that the server no longer supports – scrapers using old libraries or default settings may send HTTP/1.0 requests when the server only supports HTTP/1.1 or HTTP/2.

  • Server is configured to only accept requests from specific HTTP versions for security or compatibility reasons.

  • Misconfiguration in server settings that restricts it from accepting the HTTP version used in the request.

  • Network devices (like proxies or firewalls) between the client and server that block certain HTTP versions.

1
2
3
4
5
6
7
8
9
10
11
12
13

Try Scraper API with 5K results

Common fixes

  • Check the HTTP version used in your request and compare it with the versions supported by the server.

  • Update your web scraping libraries.

  • Update your client or server software to ensure compatibility with the HTTP version used.

  • Modify the HTTP version in your request headers to match one that the server supports.

  • Contact the server administrator to confirm the supported HTTP versions and request an update if necessary.

1
2
3
4
5
6
7
8
9
10
11
12
13

Forget HTTP errors with Scraper API

Web scraper API

Self-Service

Public data delivery from a majority of websites

From

49

Useful resources

How to Send HTTP Headers With cURL
How to Send HTTP Headers With cURL
author avatar

Augustas Pelakauskas

2025-06-27

Python request library
Python Requests Library: 2025 Guide
Authors avatar

Adomas Sulcas

2025-01-02

Crawl a Website visual
15 Tips on How to Crawl a Website Without Getting Blocked
adelina avatar

Adelina Kiskyte

2024-03-15

Get the latest news from data gathering world

I'm interested