Government Data Search for Lead Generation

Government websites are goldmines for lead generation. State licensing databases list every licensed contractor, electrician, plumber, and real estate agent. SEC filings reveal company financials. FDA approvals signal new market entrants. But government sites are notoriously hard to scrape: inconsistent layouts, anti-bot protections, no APIs, and different structures across every state.

The site: operator approach

Instead of scraping government sites directly, search Google with the site: operator to find indexed pages on specific government domains. Google has already crawled and indexed the content. You get structured results without dealing with each site's unique layout.

import requests, os

H = {'x-api-key': os.environ['SCAVIO_API_KEY']}

def search_gov(query: str, domain: str) -> list:
    resp = requests.post('https://api.scavio.dev/api/v1/search',
        headers=H,
        json={'platform': 'google', 'query': f'site:{domain} {query}'},
        timeout=10)
    return resp.json().get('organic', [])

# Find licensed contractors in Florida:
leads = search_gov('general contractor active license',
                    'myfloridalicense.com')

# Find SEC filings for a company:
filings = search_gov('annual report 2025', 'sec.gov')

Lead generation from licensing databases

State licensing databases are the most actionable government data source for agencies. Every entry is a verified business in a specific trade. Filter by license type, status (active), and location. Cross-reference with a general Google search to check their online presence. Businesses with active licenses but weak online presence are your highest-value leads.

Enrichment pipeline

After finding a business in a government database, enrich with a general Google search for their business name. Does the first result go to their own website or to a directory? Do they have Google reviews? Are they running ads? The enrichment data tells you how to position your outreach: "I noticed you have a 5-star Google rating but no website to capture that traffic."

Compliance considerations

Government data is public by definition. Using Google to find publicly available licensing records is straightforward. The data is already published online by the government for public access. Your pipeline simply makes the discovery process programmatic instead of manual.