What induces the error?

  • Malformed request syntax that nginx cannot parse or process.

  • Requests that fail to meet specific security rules set in nginx configurations.

  • Suspicious patterns in requests that suggest potential security threats like SQL injection or cross-site scripting.

  • Excessive request rate (rate limiting) that triggers nginx to drop further requests from a client.

# Request example 
curl -X GET https://sandbox.oxylabs.io/ -H 'Accept: text/html' -H 'Accept-Encoding: gzip, deflate' -H 'User-Agent: Mozilla/5.0'

Try Scraper API with 5K results

Common solutions

  • Review the API documentation to identify all required precondition headers for your request.

  • Match header with the correct entity tag (ETag) in your request to ensure data consistency.

  • Ensure that all headers are correctly formatted and values are properly quoted as per the HTTP specification.

  • Use tools like Postman or cURL to test and verify that the headers are being sent correctly in your requests.

# Response example 
HTTP/1.1 444 Connection Closed
Connection: close
Content-Length: 0

Leave errors behind with our API

Web Scraper API

Self-Service

Public data delivery from a majority of websites

From

49

Useful resources

How to Rotate Proxies in Python Using Requests and AIOHTTP
How to Rotate Proxies in Python Using Requests and AIOHTTP
roberta avatar

Roberta Aukstikalnyte

2024-11-06

SOCKS vs HTTP Proxy
Choosing Between SOCKS vs HTTP Proxy
Vejune avatar

Vejune Tamuliunaite

2023-06-21

Most Common HTTP Headers
Vytautas Kirjazovas avatar

Vytautas Kirjazovas

2021-09-20

Get the latest news from data gathering world

I'm interested