Back to blog

OpenAI Agents SDK Integration With Oxylabs Web Scraper API
OpenAI Agents SDK Integration With Oxylabs Web Scraper API

Learn how to build AI agents that scrape and analyze web content by combining OpenAI's Agents SDK with Oxylabs Web Scraper API for cost-effective web access.

vytenis kaubre avatar

Vytenis Kaubrė

2025-03-14

3 min read

Most popular articles
YouTube Downloader: The Ultimate Solution for AI-Ready Data

YouTube Downloader: The Ultimate Solution for AI-Ready Data

As part of Oxylabs’ commitment to pioneering web scraping solutions, YouTube Downloader takes video extraction to the next level.

Akvilė Lūžaitė avatar

Akvilė Lūžaitė

2025-03-18

2 min read

Project 4beta + ICIJ

Project 4β Partners with International Consortium of Investigative Journalists

Oxylabs' pro bono initiative "Project 4β" partners with The International Consortium of Investigative Journalists (ICIJ), a globally recognized network of investigative reporters.

Gabija Birgile avatar

Gabija Birgile

2025-03-14

2 min read

Markov Tarpits: An Evolving Strategy Against AI Crawlers

Are AI crawler traps a viable website defense or a lose-lose strategy? Read this post to learn about Markov tarpits and their potential successes and risks.

vytenis kaubre avatar

Vytenis Kaubrė

2025-03-12

2 min read

Leveraging AI for Large-Scale Scraping and Parsing

Watch this new webinar to explore how artificial intelligence is revolutionizing our approach to web scraping and parsing challenges.

Maryia Stsiopkina avatar

Maryia Stsiopkina

2025-03-06

1 min read

Web Scraper API Now Supports Model Context Protocol

Boost your AI’s accuracy with Web Scraper API’s new Model Context Protocol (MCP) integration—deliver real-time, structured web data straight to LLMs.

vytenis kaubre avatar

Vytenis Kaubrė

2025-03-04

3 min read

Google Now Requires JavaScript for Search Results

Learn what the new Google requirement means for your company. Discover a quick guide on sending requests with a headless browser & JS enabled.

roberta avatar

Roberta Aukstikalnyte

2025-02-10

2 min read

web scraping trends and challenges 2025

Web Scraping Trends and Challenges for 2025

Watch our new webinar to find out the key challenges and trends for web scraping in 2025.

Akvilė Lūžaitė avatar

Akvilė Lūžaitė

2025-02-03

1 min read

AI in 2025: Experts Predict a Bursting Bubble, More Regulation, and New Developments

Adi Andrei and Ali Chaudhry, esteemed AI experts and members of Oxylabs' AI/ML advisory board, joined Julius Černiauskas, CEO at Oxylabs, to share their insights on the potential future of AI in 2025.

Vytautas Kirjazovas avatar

Vytautas Kirjazovas

2025-01-09

2 min read

Browsing, Labor Division, and Data Management: How AI Will Change Life in 2025?

Oxylabs experts discuss predictions for major AI and machine learning (ML) developments in 2025 in their industry and other spheres.

Vytautas Kirjazovas avatar

Vytautas Kirjazovas

2025-01-07

2 min read

How to Navigate AI, Legal, and Web Scraping: Asking a Professional

In this interview, we sit down with a legal professional to shed light on the ever-changing legal framework surrounding web scraping.

roberta avatar

Roberta Aukstikalnyte

2025-01-07

6 min read

Oxylabs+Censuswide

Free White Paper: Addressing the Main Challenges of Public Web Data Gathering

New research conducted by Oxylabs in partnership with Censuswide has surveyed scraping professionals to uncover the key issues they face when gathering public web data and the role of artificial intelligence (AI) in addressing them.

Gabija Birgile avatar

Gabija Birgile

2025-01-06

2 min read

4beta and Stanford University

Project 4β Partners with Stanford University Researcher

Oxylabs' pro bono initiative, Project 4β, has partnered with Olivia Martin, a PhD student in Economics at Stanford University's School of Humanities and Sciences to enhance research with data collection solutions.

Gabija Birgile avatar

Gabija Birgile

2024-12-12

2 min read

Oxylabs fake discounts research

Oxylabs’ Research on Fake Discounts: Are Shopping Events Worth the Deal?

Discover how Oxylabs’ advanced data collection infrastructure was leveraged to analyze the prevalence of fake discounts in major US marketplaces during Black Friday 2024. Explore key insights from this in-depth case study.

Vytautas Kirjazovas avatar

Vytautas Kirjazovas

2024-12-10

7 min read

4beta and Carnegie Mellon University researcher

Carnegie Mellon University Researcher Joins Project 4β

Oxylabs' pro bono initiative, Project 4β, has partnered with Liying Qiu, a PhD student in Business Technologies at Carnegie Mellon University's Tepper School of Business to advance research with data collection solutions.

Gabija Birgile avatar

Gabija Birgile

2024-12-10

1 min read

4beta and The Pulitzer Center

Project 4β Partners with The Pulitzer Center

Oxylabs' pro bono initiative "Project 4β" partners with The Pulitzer Center, a renowned non-profit organization known for advancing in-depth, high-impact journalism on underreported global issues.

Gabija Birgile avatar

Gabija Birgile

2024-12-05

1 min read

How Scraped Data Can Help Train LLMs and AI Tools

Watch our new webinar to learn how high-quality scraped data fuels LLMs and AI tools. Expert insights, challenges, and live demos await!

Maryia Stsiopkina avatar

Maryia Stsiopkina

2024-11-04

1 min read

Introducing Oxy Parser, an Open-Source Data Parsing Tool

Introducing Oxy Parser, an Open-Source Data Parsing Tool

Oxy Parser is an open-source data parsing tool that automates HTML structurization using Pydantic models and automated XPaths.

author avatar

Augustas Pelakauskas

2024-10-15

2 min read

Enhance Your Data Workflow: All-In-One Web Scraper API and OxyCopilot

Today marks a major milestone for both Oxylabs and the web scraping industry: the launch of our unified Web Scraper API, now enhanced with the OxyCopilot feature.

Maryia Stsiopkina avatar

Maryia Stsiopkina

2024-09-25

3 min read

Project 4beta Partners with Northwestern University Researchers to Explore Digital Redlining

"Project 4β" partners with researchers from Northwestern University to provides free access to Oxylabs' web intelligence collection solutions to investigate the phenomenon of digital redlining.

Gabija Birgile avatar

Gabija Birgile

2024-08-13

2 min read

Leveraging Web Scraping for Economic Research: A Collaboration with Researcher from Aston University

Oxylabs' pro bono initiative "Project 4β" partners with Dr. Ngoc Dieu Linh Vi, a lecturer in Economics at Aston University to provide free access to Oxylabs web scraping solutions.

Gabija Birgile avatar

Gabija Birgile

2024-08-12

2 min read

Top News on Everything Data Gathering

Subscribe to our newsletter and get monthly scraping updates delivered right to your email.

No spam whatsoever, just pure data gathering news, trending topics and useful links. Unsubscribe anytime.