What is Haystack?
End-to-end NLP framework for building search, RAG, and question answering pipelines. Developed by deepset.
Searching X (Twitter) with Haystack
This integration lets your Haystack agent search X (Twitter) in real time via the Scavio API. The agent gets back structured JSON with post snippets, author handles, timestamps, engagement signals — ready for reasoning and decision-making.
Setup
Bash
pip install haystack-ai requestsCode Example
Here is a complete Haystack agent that searches X (Twitter) using Scavio:
Python
from haystack import Pipeline
from haystack.components.generators import OpenAIGenerator
import requests
import json
def scavio_search(query: str) -> str:
response = requests.post(
"https://api.scavio.dev/api/v1/search",
headers={"x-api-key": "your_scavio_api_key", "Content-Type": "application/json"},
json={"query": query},
)
return json.dumps(response.json(), indent=2)
# Search and pass results to the LLM
search_results = scavio_search("site:x.com AI agents 2026")
generator = OpenAIGenerator(model="gpt-4o")
response = generator.run(
prompt=f"Based on these search results, provide a summary:\n{search_results}"
)
print(response["replies"][0])Full Working Example
A production-ready example with error handling:
Python
from haystack.components.generators import OpenAIGenerator
import requests
import json
def scavio_search(query: str) -> str:
response = requests.post(
"https://api.scavio.dev/api/v1/search",
headers={"x-api-key": "your_scavio_api_key", "Content-Type": "application/json"},
json={"query": query},
)
return json.dumps(response.json(), indent=2)
search_results = scavio_search("site:x.com AI agents 2026")
generator = OpenAIGenerator(model="gpt-4o")
response = generator.run(
prompt=f"Based on these search results, provide a detailed summary:\n{search_results}"
)
print(response["replies"][0])Pricing
Scavio offers a free tier with 500 credits/month (1 credit per search). No credit card required. This is enough to build and test your Haystack integration. Paid plans start at $30/month for higher volumes.