When running web scraping operations, you may wonder how to check if your proxies are running correctly and efficiently. While the most effective way to test proxy servers is by using your own script, other ways may be useful even with a lack of technical experience.
Why do you need to test proxies?
Testing proxy servers is essential for ensuring optimal performance, security, and reliability. The success of many tasks, including web data extraction, depends on properly functioning proxies.
This article will clarify how to test proxies, what parameters should be considered, and what proxy checker tools might assist, including simple and advanced ones.
What do you need to test proxies?
The first thing that can be done is to check if your proxy is actually operating. To test proxies for connectivity, you can simply use terminal commands.
Usually, proxies are set up in a browser, which allows you to track their activity. In one of our previous articles, we explained how to use proxy settings in Chrome.
One more way to see if your proxy is running is via a proxy manager. Proxy managers are a perfect match if you use multiple proxies and want to switch between them without much effort. One of the easy-to-use proxy managers is Oxylabs Proxy Manager. Also, check out this Residential Proxy API, which helps manage sub-users and get statistics on traffic consumption.
How to check if a proxy is working
To perform a proxy server test via Windows and macOS, you need to ping a host. Open a terminal and enter the following command:
ping <proxy_host>For example, to test Oxylabs Residential Proxies:
ping pr.oxylabs.ioWith a response, you’ll receive some basic proxy metrics, such as response time, indicating a functioning proxy.
Pinging Oxylabs Residential Proxies
IP checkers
You can also use online IP checkers to see if your proxy is working. Many of them are accessible on the internet, but to demonstrate how their general logic works, we can refer to whatismyproxy.com. For testing a proxy server, you have to go to the website, and it will immediately reveal your IP address and location, as well as the HTTP headers of the software you’re using.
Although some IP checkers can show your IP address and whether you’re connecting through a proxy, their functionality is quite limited. More advanced tools are needed for a more detailed analysis.
IP databases
Some websites use third-party IP location databases, such as IP2Location or MaxMind, to understand what kind of users visit their websites and if they are real in the first place. To figure that out, an IP status or usage type must be checked. IP location databases have their own methods to determine whether the IP address belongs to data centers or is residential.
The easiest way to check the proxy status is by visiting ip2location.com. This IP database, which is widely considered to be one of the most accurate, allows you to check the details of your IP address, including the likely usage type.
Suppose a residential proxy that you’re trying to use is recognized as a datacenter by this database. In that case, the chances are that many of your target websites will see the same information and may block this proxy and an actual residential IP address much faster.
IP databases determine the usage type of your proxies
FOGLDN Proxy Tester
To test proxy speed, such tools as FOGLDN Proxy Tester can be used. It enables direct ping times to any website worldwide. Since it shows how long it takes to connect, you can use it to monitor the latency of your proxies. With this proxy tester, you can test any proxy type, including rotating proxies.
FOGLDN Proxy Tester has its drawbacks. For example, if the test run fails, you won’t be able to know the exact reason. It doesn’t reveal the location of the proxy, its usage type, and the level of anonymity. Finally, you can’t control the number of requests made, as well as their frequency.
This proxy tester is easy to use. You can test proxies with this tool by accomplishing the following steps:
Download the tool.
Add the list of the proxies you want to test. If you’re using a rotating gateway address, you can add it multiple times.
Enter a URL to test.
Select TEST PROXIES.
Hidemy.name
A more advanced free proxy checker is hidemy.name. It can detect the proxy type, precise location, speed, and anonymity level. Hidemy.name proxy checker provides a list of proxies automatically collected from numerous websites all over the internet, including private databases. Proxies can be sorted out by their protocol types, such as HTTP, HTTPS, and SOCKS.
Another feature that hidemy.name can determine is the level of anonymity, i.e., whether your actual IP address remains concealed and if there is a chance that the destination server can suspect that you are behind a proxy server. The anonymity categories that this proxy checker offers in their proxy lists include:
No anonymity. The server you are reaching is aware of your real IP and that you’re connecting through a proxy.
Low anonymity. The remote server is aware that you are using a proxy. However, your actual IP address stays hidden.
Average anonymity. The destination server can be tricked into thinking it knows your IP address, but the IP address displayed is inaccurate. The server is aware that you are using a proxy.
High anonymity. The server you are reaching detects neither your actual IP address nor whether proxies are involved.
One more thing that is more likely to be a matter of concern is whether your proxies are blocked from specific websites or not. The only way to tell if a proxy is blocked is to test proxies directly on the targeted websites. Your IP may be marked as suspicious at some point, but you might need to make many requests before any blocking.
Custom software
Another way to check proxies is to write your own script or software. Scripting for automated testing gives more control over how to check your proxies. This, however, takes time and effort. The basic approach is to write a scraper that takes a proxy for a list and uses it to extract data from a simple, preferably static, website that returns a bare minimum of information.
The first step is to understand whether the proxy responds at all. You need to check the content of the body, either by looking for a specific string in the HTML output or by checking the content size (if the content is static). You can look at the status code in response headers. An HTTP status code 200 would suggest that the proxy worked and you were able to get the content, but checking the actual output is always more reliable.
Every request with a proxy should have a reasonable timeout set up. It could be 10 seconds for a datacenter proxy and up to 30 seconds for a residential proxy. If no content returns in that amount of time, you can consider the proxy to be unusable. It also makes sense to log the amount of time it took to complete each request. Some requests may not timeout, but they still can be too slow for real-life use cases. All this data should then be written down in a database or printed out on the screen for analysis.
Writing your own script is one of the most reliable ways to test a proxy
Here’s a quick visual summary of all the proxy testing methods described above.
| Testing method | Pros | Cons |
|---|---|---|
| IP checkers | Free, simple to use. | Limited, only basic info. |
| IP databases | In-depth info, including proxy type determination. | Paid. |
| FOGLDN Proxy Tester | Free, latency testing. | No test failure report, limited customization options. |
| Hidemy.name | Rich functionality, anonymity level testing. | Most features are paid. |
| Custom software | Freedom of control. | Significant time and effort required. |
Conclusion
There are multiple proxy checker tools you can use to test proxies. To test a proxy server, IP checkers are accessible online and can reveal your software’s IP address, location, and HTTP headers. IP databases, such as IP2Location or MaxMind, may assist in checking the IP status of your proxy and its usage type. FOGLDN Proxy Tester, an easy-to-use tester that works with many proxy types, helps monitor the latency of your proxies. The hidemy.name proxy checker can determine the level of anonymity.
Although numerous proxy checkers and testers exist, the most effective and reliable way to test proxies is by writing a script capable of sending requests to specific websites and getting responses, as well as counting the time it took to complete the request.
We also suggest reading this article about how proxies help perform load testing.
Frequently asked questions
What is proxy testing?
Proxy testing is a software check that determines the performance and reliability of a proxy server. Here’s the importance of proxy metrics for some of the testing areas:
Load – subjecting the proxy server to heavy loads to evaluate its scalability and capacity.
Security – assessing the security measures the proxy server implements to protect against threats such as unauthorized access.
Functionality – ensures that the proxy server correctly handles requests and responses according to the supported protocols, adhering to industry standards.
Protocol compatibility – checks support for protocols such as HTTP, HTTPS, FTP, SOCKS, and DNS.
Can proxies be detected?
Yes, various methods can detect proxies, including HTTP headers inspection and IP address analysis.
To avoid detection, you should use quality proxies. For the most difficult scenarios, opt for Residential Proxies as they originate from genuine everyday devices, maximizing the organic traffic resemblance.
How to test a proxy in the command line?
To test a proxy in the command line, input a command, such as ping, to make requests through the proxy server and analyze responses.
How do you verify a proxy server?
To test a proxy connection, regardless of the tool you are using, send a request or visit a website that returns your IP address and additional information. If the returned information differs from your actual device and location data, proxy verification is successful.
About the author
Maryia Stsiopkina
Senior Content Manager
Maryia Stsiopkina is a Senior Content Manager at Oxylabs. As her passion for writing was developing, she was writing either creepy detective stories or fairy tales at different points in time. Eventually, she found herself in the tech wonderland with numerous hidden corners to explore. At leisure, she does birdwatching with binoculars (some people mistake it for stalking), makes flower jewelry, and eats pickles.
All information on Oxylabs Blog is provided on an "as is" basis and for informational purposes only. We make no representation and disclaim all liability with respect to your use of any information contained on Oxylabs Blog or any third-party websites that may be linked therein. Before engaging in scraping activities of any kind you should consult your legal advisors and carefully read the particular website's terms of service or receive a scraping license.
Related articles
Get the latest news from data gathering world
Scale up your business with Oxylabs®