Tag Archives: scraping

The $10 Billion “Echo”: Why Paying Experts to Train AI Might Be a Bridge to Nowhere

AI bot, echo chamber, start-up tech in Silicon Valley

There’s a new giant in Silicon Valley called Mercor. Valued at a staggering $10 billion (a massive jump from its $2 billion valuation just months ago), their business model is simple: they pay doctors, lawyers, and engineers to sit down and teach AI how to do their jobs. By early 2026, the company is reportedly paying out over $1.5 million daily to a network of 30,000+ experts.

On the surface, it might look like a savvy way for tech

... Continue reading
Posted in Technology in the News | Tagged , , , , , , , , , , , | 1 Comment

How to deal with bad bots and crawlers that waste your server resources and harm your website?

bots-and-crawlers-harm-website

It is true that there are bad bots and crawlers that can potentially harm your website by consuming server resources, engaging in scraping, or attempting to exploit vulnerabilities. These malicious bots can negatively impact your website's performance, security, and user experience.

To address this issue, it's possible to implement measures to block or restrict the activities of bad bots and crawlers without affecting the good bots and crawlers that are used by legitimate search engines.

Here are some methods for

... Continue reading
Posted in Ask David!, Website Traffic | Tagged , , , , , , , , , , , , , , | Leave a comment

How to reduce your website spam with a Contact Form vs Posted Email Address

Posting your email address online so spiders can crawl it, vs using a secure contact form

Why Posting Your Email Address Attracts Spam

Spiders are not just the lovable daddy long legs like on "Honey I shrunk the Kids", or the creepy crawlers that give you the puffed up eye lid morning present.  On the internet, they are used to "scrape" emails off of websites.  So if you post your email addresses on your website you are prone to being scraped by one of these virtual creepy crawlers and getting on an unwanted mass emailing list.

... Continue reading
Posted in Emails, General, Website Security | Tagged , , , , , , , , , , , , , , , | Leave a comment