Now You Can Block OpenAI's Web Crawler

Slashdot
By msmashAug 8, 2023, 12:01 pm123 pts
OpenAI now lets you block its web crawler from scraping your site to help train GPT models. From a report: OpenAI said website operators can specifically disallow its GPTBot crawler on their site's Robots.txt file or block its IP address. "Web pages crawled with the GPTBot user agent may potentially be used to…

Read Article Share
Share Article
- email
- x.com
- facebook
- pocket
- reddit
- tumblr
- linkedin
- pinterest

Trending Today on Tech News Tube

Google’s AI Inbox could be a glimpse of Gmail’s future

The Verge

Google’s AI Inbox could be a glimpse of Gmail’s future 130

Google announces a new protocol to facilitate commerce using AI agents

TechCrunch

Google announces a new protocol to facilitate commerce using AI agents 124

China Tests a Supercritical CO2 Generator in Commercial Operation

Slashdot

China Tests a Supercritical CO2 Generator in Commercial Operation 121

Forget the robots, these are the best computing innovations at CES 2026

TechRadar

Forget the robots, these are the best computing innovations at CES 2026 121

Wing to expand drone delivery to another 150 Walmart stores

TechCrunch

Wing to expand drone delivery to another 150 Walmart stores 120

Nvidia CEO Jensen Huang Says AI Doomerism Has 'Done a Lot of Damage'

Slashdot

Nvidia CEO Jensen Huang Says AI Doomerism Has 'Done a Lot of Damage' 118

MSI focuses on AI and business at CES 2026

TechRadar

MSI focuses on AI and business at CES 2026 112

RIP Guy Moon, Composer of ‘Fairly Oddparents,’ ‘Danny Phantom,’ and More

Gizmodo

RIP Guy Moon, Composer of ‘Fairly Oddparents,’ ‘Danny Phantom,’ and More 109

About Tech News Tube

Tech News Tube is a real time news feed of the latest technology news headlines.

Follow all of the top tech sites in one place, on the web or your mobile device.

Featured

Streamer Spend To Top $100B For First…

Streamer Spend To Top $100B For First Time In 2026

Amazon's AI Tool Listed Products from…

Amazon's AI Tool Listed Products from Small Businesses Without Their Knowledge

Meta admits to Instagram password reset…

Meta admits to Instagram password reset mess, denies data leak

Finnish Startup IXI Plans New…

Finnish Startup IXI Plans New Autofocusing Eyeglasses

How Many Years Left Until the Hubble…

How Many Years Left Until the Hubble Space Telescope Reenters Earth's…

Google's new commerce framework cranks…

Google's new commerce framework cranks up the heat on 'agentic shopping'

Bitcoin Mining is Being Used to Offset…

Bitcoin Mining is Being Used to Offset Heating Costs in Greenhouses and Homes

Walmart Announces Drone Delivery,…

Walmart Announces Drone Delivery, Integration with Google's AI Chatbot Gemini

California's governor plans to set aside…

California's governor plans to set aside $200 million for state EV tax credits

Gentoo Linux Plans Migration from GitHub…

Gentoo Linux Plans Migration from GitHub Over 'Attempts to Force Copilot Usage…