SearchLocal

One place to collect
data for every module.

Coupons, events and more — scraped, deduplicated and synced to production from a single control room.

SearchLocal Scraper · Admin

SearchLocal

Welcome back

Sign in to manage scraping jobs.

SearchLocalScraper Admin
Administrator
SearchLocal

Dashboard

Live overview of every module and data source.

Recent activity

All sources, newest first

Automation

Keep every source refreshing on its own, forever - no more re-scraping by hand. A source's already-scraped pages are periodically re-checked instead of only ever being visited once.

Scrape control

Configure and run a Groupon scrape batch.

Source · Groupon

Start a batch

Live progress

Job history

Cities

Review and fix the city slugs Groupon scrapes are built from.

Source · Groupon
CityStateSlugZip countStatusActions

Categories

Choose which categories are included in scrapes.

Source · Groupon
CatalogNameSlugDepthParentActive

Event listings

Everything collected for the Events module, from every source.

EventCategoryVenueCity, StateStartsPriceSource

Scrape control

Collect events from findlocal.community (sitemap + every city page, so nothing is missed).

Source · findlocal.community

Start a batch

Live progress

Job history

Scrape control

Pull events for the US (by state) from the Ticketmaster Discovery API.

Source · Ticketmaster API

Start a batch

Uses the Ticketmaster Discovery API, US only, one state at a time (states don't overlap, so no event is fetched twice): 5,000 calls/day per key and 5/second. Each batch stops by itself at the per-run call cap or when the daily quota runs out.

Live progress

Job history

Eventbrite — free events

Pull free events (by state) from Eventbrite's public listing pages. Every city is covered: a state's list contains all its cities, and each event keeps its own venue city.

Source · eventbrite.com (web pages, no API)

Start a batch

Eventbrite has no API, so this reads its web pages politely: one request every few seconds, and a per-run request cap. If Eventbrite starts answering "429 too many requests" the run cools down, then stops by itself and picks up where it left off next time. A busy state can take an hour or more. This only lists the events; the Eventbrite details job then reads each event's own page for the full description and organizer. Don't run both at once — they share one rate limit.

Live progress

Job history

Eventbrite — event details

Read each stored Eventbrite event's own page once to add what the listing doesn't have: the full description, the organizer and photos. Soonest events first.

Source · eventbrite.com (web pages, no API)

Start a batch

One request per event, spaced out. It also re-checks that each event is really free and marks events whose page was deleted as cancelled. Don't run it at the same time as the Eventbrite listing job — they share one rate limit.

Live progress

Job history

Duplicate events

The same event can be stored by more than one source. One real event should be one record, so the copy from the lower-ranked source is removed: Ticketmaster > Eventbrite > findlocal. Scan first to see what would go; nothing changes until you click Remove.

All event sources

Find and remove duplicates

With this off, only copies whose ticket link carries a Ticketmaster or Eventbrite id are matched - certain, but it misses most. Events with the same title and time at a different venue are never touched either way.

Working... a scan of a large database can take a minute or two.

Latest result

Removed so far

Most recently removed

each keeps its link, so a wrong match can be re-scraped

findlocal cities

The city pages findlocal.community lists in its footer. Each one is read page by page to find events the sitemap omits. A city page is a metro label, not a venue city: its home state is only the fallback when an event's address has none.

Source · findlocal.community

Add a city

for a city page findlocal serves but its footer doesn't list; the page is checked live first

CitySlugHome stateStoredOn siteCoverageLast readCrawlActions

Ticketmaster areas

Ticketmaster has no city slugs. A batch covers areas: the 50 states + DC (on by default: they cover the whole US without overlap), the 211 market areas (DMAs, off by default: they overlap the states about 2.3×) and any named cities you add.

Source · Ticketmaster API

Add a city

one named town, as "City, ST" - it joins the default batch

NameSlugTypeCode / stateKeyStored eventsLast runFetchedStatusDefault batchActions