Engineering insights
Tutorials, deep dives, and practical guides for building AI agents with real-time web search.
Your Agent's Web Search Tool Cannot See the Price
Search snippets never carry Amazon's price: 46 Amazon results returned zero. Call Scavio's /api/v1/amazon/product by ASIN rather than rendering the page.
eBay Sold Listings Now Require a Login. What Can Price Research Use Instead?
eBay now redirects logged-out sold-listing searches to sign-in. Price research still works on live data: ask spread by condition, watchers, bids, sold counts.
How to Find Businesses With Recent Bad Google Reviews
Sort by lowest rating, one page per business, then filter on last-edit date. That found all 46 Phoenix profiles carrying a recent 1-star, for 60 credits.
How to Get Real URLs From Google AI Overview Citations
Follow the 302 on each google.com/goto token. Across 336 AI Overview citations from Scavio's /api/v2/google on two runs, 334 were unusable as returned.
How to Get More Than 10 Results From a Google Search API
Page the SERP with start=0,10,20; new domains dry up at start=70. For a full business list, partition Scavio's /api/v2/google/maps/search by map center.
How Reliable Is AI Overview Citation Tracking? 30 Identical Requests
Sample each query five times, not once. Across 30 identical requests only 57% of cited publishers appeared every time, and Scavio's /api/v2/google returns them.
Google Local Pack Scraping: Why the location Parameter Returns the Wrong City
Pass ll coordinates to Scavio's /api/v2/google/maps/search, not a location string to the SERP endpoint. Over six cities that scored 6 of 6 against 0 of 18.
Why Does a TikTok Comment Scrape Return Half the Comments?
The comment count includes replies. Paginate Scavio's TikTok comments endpoint, dedupe by cid, then fetch every thread from the replies endpoint to reach 86%.
Does Google AI Mode Cite Local Businesses? 8 Markets, 57 Citations
Almost never. Across 8 US markets only 5 of 57 AI Mode citations pointed at the ranked business's own site, and Scavio's ai-mode endpoint returns that list.
Why Do TikTok Profile Scrapers Keep Breaking? It Is the secUid, Not the Proxy
Resolve the username to a secUid once through Scavio's TikTok profile endpoint, cache it as the stable key, then gate on payload presence, not HTTP status.
How to Track Competitors' Facebook Ads in 2026 (With Real Data From 4 Brands)
Resolve each competitor to a numeric Page ID, query the Meta Ad Library by that ID instead of by brand name, and snapshot daily before stopped ads vanish.
Amazon Buy Box API: Tracking Sellers and Prices Without False Alarms in 2026
Most MAP violation alerts are not violations, they are the Buy Box rotating between sellers. Pin to the offer, normalise delivered price, kill the false alarms.
Instagram API Without OAuth: What Actually Needs Meta Login in 2026
Only owned-account metrics need Meta's OAuth chain. Public Instagram profile and post data needs none of it, and Scavio returns it as JSON from a username.
Google Maps API Costs $600 a Month. Here's What to Use Instead.
A Google Maps API bill hitting $600/month is almost always the pan-to-search loop, not the data. Fix the timing, or pull the list via Scavio at $1 for 5,000 places.
Google Custom Search API Shuts Down Jan 1, 2027: What to Use Instead
Google Custom Search JSON API shuts down January 1, 2027. Vertex AI Search is not a drop-in. Scavio returns Google results as structured JSON from one endpoint.
Tavily Alternatives After the Nebius Acquisition (2026)
Tavily was acquired by Nebius for $275M. The best alternative is Scavio if your agent needs multi-platform search beyond web, or Exa for semantic retrieval.
What Reddit's API Actually Costs in 2026 (and Cheaper Ways to Get the Data)
Verified 2026 Reddit API pricing and rate limits, why commercial access is an enterprise contract with no self-serve tier, and the structured alternatives developers use.
Why Exa Search Costs So Much (and Cheaper Alternatives) in 2026
Exa runs $0.007 per search and $12-15 per 1,000 for Deep Search. Audit redundant queries first, then move high-volume lookups to a cheaper structured backend.
SEO API with no monthly subscription: yes, it exists (2026)
Pay-as-you-go SEO APIs exist. Scavio charges $0.01/credit with no monthly fee across 50 platforms. DataForSEO is $0.002/req with a $50 deposit. Compared here.
Is MCP dead in 2026?
No, MCP is not dead in 2026, but the critics had a point. Context bloat, the fixes that shipped, the registry numbers, and the cases where a plain CLI still wins.
Brave Search API Free Credit: What the Fine Print Actually Means
Brave Search API gives $5 per month in free credit, covering roughly 1,000 queries. The 50 QPS cap and basic result format limit usefulness for agents.
DataForSEO $50 Minimum vs No-Minimum Credit APIs
DataForSEO requires $50 upfront. Scavio and SerpAPI let you test free first: Scavio gives 50 credits with no card across Google, Amazon, YouTube and Reddit.
How to Evaluate SERP API Providers: A Practical Framework
Evaluating SERP API providers requires testing five dimensions: latency, parse accuracy, platform coverage, pricing model, and free tier limits. Here is a checklist.
Custom Rank Tracker After Google I/O 2026
After Google I/O 2026 a rank tracker needs organic position and AI Overview citations. Ahrefs and Semrush do not track AI Mode yet. Build your own for under $30/mo.
Hermes Agent: Browser Automation vs Search API
When a Hermes Agent task needs a headless browser, when it needs a structured search API, and when a bundled scraper skill will quietly rot. A decision framework with working code.
Local LLM Web Search: Beyond SearXNG in 2026
SearXNG gets blocked under sustained use. MCP search APIs work with Ollama, LM Studio, oMLX without self-hosting. Structured results, multi-platform, no proxy maintenance.
Pi Coding Agent Search: Ketch, SearXNG, APIs Compared
Pi Coding Agent search tool comparison: Ketch for URL extraction, SearXNG for privacy, MCP search APIs for multi-platform reliability. Setup code for each.
SearXNG Keeps Getting Blocked: Why API Search Wins
SearXNG scrapes search engines that block automated queries within hours. Scavio gives authorized API access with structured JSON across 50 platforms at $0.005/query.
Tavily MCP Hits Rate Limits in 20 Min: Alternatives
Tavily free tier MCP hits rate limits in 20 min of active agent use. Switch to Scavio MCP for 50 free credits with no per-minute throttle across 50 platforms.
Walmart Seller Product Research via API
Walmart product data via API: pricing, ratings, review counts, seller info at $0.005/query. No scraping, no proxies. Cross-platform comparison with Amazon included.