WebScraperAI Studio

Help

Questions or problems? Email wekstuff@gmail.com. Please include your macOS version and, if it's about a site, its address.

Getting started

  1. Open the Practice Shop (File › Open the Practice Shop) and click Catalog.
  2. Choose Collect › Auto-Detect Items. The app finds the repeating product cards and suggests columns.
  3. Choose Collect › Collect This Page Only, then File › Export Rows to save the table.

The same steps work on any page you open in the app's address bar.

Choosing columns

Pick

Choose Collect › Pick Values on the Page, then click a value. The app finds the matching value in every item and adds a column. Picking a link's text offers its address as a second column. Press Esc to stop picking.

Auto-Detect

The app looks for the repeating items on the page and suggests up to eight columns, such as titles, prices, ratings and links. If it chose the wrong items, the inspector's Items section offers the other groups it found.

Describe

Collect › Describe Columns lets you type the columns you want, separated by commas. On macOS 26 or later with Apple Intelligence turned on, Apple's on-device model matches your words to the page; nothing is sent anywhere. Otherwise the app matches your words itself. The sheet always says which one it used.

Cleaning values

Each column in the inspector can be renamed, moved, set to a type (text, number or price, date, link, or image address) and given a pattern that keeps only part of a value. Ratings like “Rated 4.5 out of 5” and counts like “128 reviews” become plain numbers automatically.

Collecting across pages

In the inspector's Pages section, choose Follow “Next” pages or Scroll to load more. The app finds the page's Next control itself; you can also type a CSS selector for it. Choose how many pages to read, up to 50 (5 at first), and how long to wait between them, 3 seconds at first (change the starting value in Settings › Collecting). Collect › Stop keeps the rows collected so far. Collecting across pages is part of the full unlock.

Site rules (robots.txt)

Before every automated step (another page, more scrolling, or a watch check) the app reads the site's robots.txt and follows it. If a site asks for a longer wait, the longer wait is used. The inspector's Site rules section shows what the current site allows.

The app never answers cookie or consent prompts, never signs in for you, never solves CAPTCHAs and never downloads files. It closes ordinary pop-ups only with their own Close buttons, and you can turn that off per recipe. It names itself to sites as WebScraperAIStudio.

Recipes

File › Save Recipe (⌘S) keeps the page address, items, columns, paging settings and the last rows. The free version keeps 3 recipes; the full unlock keeps any number. File › Export Recipe File and Import Recipe File move recipes between Macs as .webscraper.json files.

Watching for changes

With a recipe saved, choose Collect › Watch for Changes. The app checks it again every hour, every 6 hours, daily or weekly, and compares the new rows with the last ones. Collect › Change History lists each check: new items, removed items and price drops or rises.

Exporting

File › Export Rows saves CSV, tab-separated text or JSON, and with the full unlock, Excel workbooks (.xlsx) and SQLite databases. CSV and tab-separated files protect you from spreadsheet formulas hidden in page text: values starting with =, +, - or @ get a leading apostrophe. You can turn this off in Settings › Collecting.

Keyboard shortcuts

ActionShortcut
New recipe⌘N
Open the Practice Shop⇧⌘H
Import a recipe file⌘O
Save recipe⌘S
Export rows⇧⌘E
Pick values on the page⇧⌘P
Auto-detect items⇧⌘A
Describe columns⌘K
Collect rows⌘↩
Collect this page only⇧⌘↩
Stop⌘.
Open location (address bar)⌘L
Reload, back, forward⌘R ⌘[ ⌘]
Bookmark this page⌘D
Show or hide the inspector⌥⌘I

Purchases

Your data

Recipes, rows, change history and bookmarks are stored in the app's own container on your Mac. Settings › Privacy › Cookies and website data clears the built-in browser's cookies, logins and cached pages. Deleting a recipe removes its rows and history. Nothing is uploaded; see the privacy policy.