Bright Data
Search, Crawl and Scrape any site, at scale, without getting blocked
0.5.1Bright Data is a web data platform that provides proxy and scraping infrastructure. This Arcade toolkit enables large-scale, block-resistant web scraping, search, and structured data extraction without managing proxies or browser automation.
Capabilities
- Web scraping: Fetch any public webpage and receive clean Markdown output, suitable for LLM ingestion or content analysis.
- Multi-engine search: Query Google, Bing, or Yandex with configurable parameters including result count, search type (web/images), and country targeting.
- Structured data feeds: Extract typed, schema-consistent records from major platforms — Amazon, LinkedIn, Instagram, Facebook, X, YouTube, Zillow, Booking.com, and ZoomInfo — without writing custom parsers.
Secrets
-
BRIGHTDATA_API_KEY— Your Bright Data account API key, used to authenticate all requests to the Bright Data platform. Obtain it from the Bright Data control panel under Account Settings → API Token. A paid Bright Data account is required; the key grants access based on your zone and product permissions. -
BRIGHTDATA_ZONE— The Bright Data proxy zone name that routes scraping and data feed requests. Zones are created and managed in the Bright Data control panel under Proxies & Scraping Infrastructure. Each zone corresponds to a specific product (e.g., Scraping Browser, Residential Proxies, Web Unlocker). Use the zone name (not the zone ID) exactly as it appears in the dashboard. The zone must have permissions aligned with the operations you intend to perform.
For guidance on storing secrets in Arcade, see the Arcade secrets documentation. Secrets can be managed via the Arcade dashboard.
Available tools(3)
| Tool name | Description | Secrets | |
|---|---|---|---|
Scrape a webpage and return content in Markdown format using Bright Data.
Examples:
scrape_as_markdown("https://example.com") -> "# Example Page
Content..."
scrape_as_markdown("https://news.ycombinator.com") -> "# Hacker News
..."
| 2 | ||
Search using Google, Bing, or Yandex with advanced parameters using Bright Data.
Examples:
search_engine("climate change") -> "# Search Results
## Climate Change - Wikipedia
..."
search_engine("Python tutorials", engine="bing", num_results=5) -> "# Bing Results
..."
search_engine("cats", search_type="images", country_code="us") -> "# Image Results
..."
| 2 | ||
Extract structured data from various websites like LinkedIn, Amazon, Instagram, etc.
NEVER MADE UP LINKS - IF LINKS ARE NEEDED, EXECUTE search_engine FIRST.
Supported source types:
- amazon_product, amazon_product_reviews
- linkedin_person_profile, linkedin_company_profile
- zoominfo_company_profile
- instagram_profiles, instagram_posts, instagram_reels, instagram_comments
- facebook_posts, facebook_marketplace_listings, facebook_company_reviews
- x_posts
- zillow_properties_listing
- booking_hotel_listings
- youtube_videos
Examples:
web_data_feed("amazon_product", "https://amazon.com/dp/B08N5WRWNW")
-> "{"title": "Product Name", ...}"
web_data_feed("linkedin_person_profile", "https://linkedin.com/in/johndoe")
-> "{"name": "John Doe", ...}"
web_data_feed(
"facebook_company_reviews", "https://facebook.com/company", num_of_reviews=50
) -> "[{"review": "...", ...}]" | 2 |