What is Haystack?
End-to-end NLP framework for building search, RAG, and question answering pipelines. Developed by deepset.
How It Works
Scavio connects to Haystack via HTTP requests. Once connected, your Haystack agent can search Google, Amazon, YouTube, and Walmart in real time. Each search returns structured JSON -- no HTML parsing, no scraping infrastructure.
Setup
pip install haystack-ai requestsCode Example
Here is a complete Haystack integration with Scavio:
from haystack import Pipeline
from haystack.components.generators import OpenAIGenerator
import requests
import json
def scavio_search(query: str) -> str:
response = requests.post(
"https://api.scavio.dev/api/v1/search",
headers={"x-api-key": "your_scavio_api_key", "Content-Type": "application/json"},
json={"query": query},
)
return json.dumps(response.json(), indent=2)
# Search and pass results to the LLM
search_results = scavio_search("best AI frameworks 2026")
generator = OpenAIGenerator(model="gpt-4o")
response = generator.run(
prompt=f"Based on these search results, provide a summary:\n{search_results}"
)
print(response["replies"][0])Full Working Example
A production-ready example with error handling:
from haystack.components.generators import OpenAIGenerator
import requests
import json
def scavio_search(query: str) -> str:
response = requests.post(
"https://api.scavio.dev/api/v1/search",
headers={"x-api-key": "your_scavio_api_key", "Content-Type": "application/json"},
json={"query": query},
)
return json.dumps(response.json(), indent=2)
search_results = scavio_search("best AI frameworks 2026")
generator = OpenAIGenerator(model="gpt-4o")
response = generator.run(
prompt=f"Based on these search results, provide a detailed summary:\n{search_results}"
)
print(response["replies"][0])Available Platforms
Once connected, your Haystack agent has access to all four Scavio platforms:
- Google — Web search with knowledge graph, PAA, and AI overviews
- Amazon — Product search with prices, ratings, and reviews
- Reddit — Community, posts & threaded comments from any subreddit
- YouTube — Video search with transcripts and metadata
- Walmart — Product search with pricing and fulfillment data
- LinkedIn — Post, profile, and company discovery via search
- TikTok — Trending video, creator, and product discovery
- Shopify — Cross-store product discovery and enrichment
- X (Twitter) — Post and profile discovery via search
- Apple App Store — App discovery, ranking, and review data
- Google Play Store — Android app discovery and ranking data
- Google Reviews — Business review extraction with ratings and responses
- Google Scholar — Academic paper search with citation counts
- Google Ads Transparency — Competitor ad creative and transparency data via SERP
- Reddit Comments Tree — Deep threaded comment fetch for brand monitoring
- YouTube Shorts — Shorts-specific search with metadata
- YouTube Playlists — Playlist discovery and removal tracking
- Google Jobs — Live jobs-board search for recruiting
- Amazon Bestsellers — Bestseller rank-change feed across categories
Pricing
Scavio offers a free tier with 50 credits on signup (1 credit per search). No credit card required. This is enough to build and test your Haystack integration. Paid plans start at $30/month for higher volumes.