Tutorial

How to Scrape Google Shopping with Go

Step-by-step guide to scraping Google Shopping search results using Go and the Scavio API. Get shopping results, prices, merchant names as structured JSON.

Google Shopping contains valuable data — shopping results, prices, merchant names, product ratings, and more. Scraping this data directly means dealing with anti-bot detection, CAPTCHAs, IP rotation, and constantly breaking selectors. The Scavio API handles all of that and returns clean, structured JSON from a single POST request.

This tutorial shows you how to scrape Google Shopping using Go and the Scavio API. By the end, you will have a working Go script that fetches real-time Google Shopping data and parses the results.

Prerequisites

  • Go installed on your machine
  • A Scavio API key (free tier includes 500 credits/month — no credit card required)

Step 1: Install Dependencies

net/http is built into Go, so there is nothing to install.

Bash
# net/http is in Go's standard library — no installation needed

Step 2: Make Your First Google Shopping Search

Send a POST request to the Scavio Google Shopping API endpoint with your query. The API returns structured JSON with shopping results, prices, merchant names, and more.

package main

import (
	"bytes"
	"encoding/json"
	"fmt"
	"io"
	"net/http"
)

func main() {
	apiKey := "your_scavio_api_key"

	body, _ := json.Marshal(map[string]interface{}{
		"query": query,
		"tbs": "shop",
	})

	req, _ := http.NewRequest("POST", "https://api.scavio.dev/api/v1/search", bytes.NewBuffer(body))
	req.Header.Set("x-api-key", apiKey)
	req.Header.Set("Content-Type", "application/json")

	client := &http.Client{}
	resp, err := client.Do(req)
	if err != nil {
		panic(err)
	}
	defer resp.Body.Close()

	result, _ := io.ReadAll(resp.Body)

	var data map[string]interface{}
	json.Unmarshal(result, &data)
	formatted, _ := json.MarshalIndent(data, "", "  ")
	fmt.Println(string(formatted))
}

Step 3: Example Response

The API returns structured JSON. Here is an example response for a Google Shopping search:

JSON
{
  "search_metadata": { "status": "success" },
  "shopping_results": [
    {
      "position": 1,
      "title": "Sony WH-1000XM5 Wireless Headphones",
      "price": "$278.00",
      "merchant": "Amazon.com",
      "rating": 4.7,
      "reviews": 12450,
      "shipping": "Free shipping"
    }
  ]
}

Every field is structured and typed — no HTML parsing, no CSS selectors, no regex extraction. Your Go code can access any field directly.

Step 4: Full Working Example

Here is a complete, runnable Go script that searches Google Shopping and prints the results:

package main

import (
	"bytes"
	"encoding/json"
	"fmt"
	"io"
	"net/http"
	"os"
)

// SearchGoogleShopping queries Google Shopping via Scavio and returns structured results.
func SearchGoogleShopping(query string) (map[string]interface{}, error) {
	apiKey := os.Getenv("SCAVIO_API_KEY")

	body, err := json.Marshal(map[string]interface{}{
		"query": query,
		"tbs": "shop",
	})
	if err != nil {
		return nil, err
	}

	req, err := http.NewRequest("POST", "https://api.scavio.dev/api/v1/search", bytes.NewBuffer(body))
	if err != nil {
		return nil, err
	}
	req.Header.Set("x-api-key", apiKey)
	req.Header.Set("Content-Type", "application/json")

	resp, err := (&http.Client{}).Do(req)
	if err != nil {
		return nil, err
	}
	defer resp.Body.Close()

	result, err := io.ReadAll(resp.Body)
	if err != nil {
		return nil, err
	}

	var data map[string]interface{}
	if err := json.Unmarshal(result, &data); err != nil {
		return nil, err
	}
	return data, nil
}

func main() {
	results, err := SearchGoogleShopping("sony wh-1000xm5")
	if err != nil {
		fmt.Fprintf(os.Stderr, "Error: %v\n", err)
		os.Exit(1)
	}
	formatted, _ := json.MarshalIndent(results, "", "  ")
	fmt.Println(string(formatted))
}

Why Use Scavio Instead of Scraping Google Shopping Directly?

  • No proxy management. Direct scraping requires rotating proxies to avoid IP bans. Scavio handles all of this server-side.
  • No CAPTCHA solving. Google Shopping aggressively blocks automated requests. Scavio returns clean data every time.
  • Structured JSON output. No HTML parsing or CSS selector maintenance. Get typed, consistent data from every request.
  • Multi-platform in one API. Search Google, Amazon, YouTube, and Walmart from the same API key with the same authentication pattern.
  • Free tier included. 500 credits/month with no credit card required. Each search costs 1 credit.

Frequently Asked Questions

Scraping publicly available data from Google Shopping is generally legal, but you should review Google Shopping's Terms of Service. Using the Scavio API avoids the legal gray areas of direct scraping since Scavio handles all data collection through proper channels and returns structured results via API.

Direct scraping of Google Shopping requires managing proxies, CAPTCHAs, rate limits, and anti-bot detection. The Scavio API handles all of this for you. Send a POST request with your query and get structured JSON back — no proxy management or browser automation needed.

The Scavio API returns structured JSON with shopping results, prices, merchant names, product ratings, shipping info, product images. All data is returned in a clean, consistent format that is easy to parse in Go.

Scavio offers a free tier with 500 credits per month. Each API request costs 1 credit regardless of which platform you search. No credit card required to start. Paid plans start at $30/month for higher volumes.

Scavio returns Google Shopping results in 1-3 seconds on average. Results are fetched in real time from Google Shopping — there is no caching layer or stale data. Every request returns live results.

Start Scraping Google Shopping with Go

Get your free Scavio API key and start fetching Google Shopping data in Go. 500 free credits/month — no credit card required.