New Ecommerce SEO article: Use Screaming Frog + ChatGPT to automate SEO text for category pages.
In 10 minutes, this process writes 250 pages:
Dec 4, 2024 · 1:10 PM UTC
So I debated writing this article for a long time but super excited to collaborate with @screamingfrog on this one.
This process details how you can create that bottom of the page "SEO text" you see on category pages on commerce sites: screamingfrog.co.uk/using-ai…
If you've worked in commerce SEO long enough, you probably understand that this strategy works quite well. SearchPilot did a study that found removing this text caused a -4% drop in traffic.
Polls I've taken say that 82% of people say that this strategy is effective.
searchpilot.com/resources/ca…
The problem is that this takes a ton of resourcing that some commerce sites might not have.
If you have a lot of SKUs and 5,000+ category pages, this would take a lot of bandwidth from writers.
The good news is that you can use Screaming Frog's OpenAI integration to at least serve as a STARTING POINT.
Here's the process:
1. Generate Templated Questions: You'll want to do some research to find the templated questions you want to create at scale.
This will depend on your industry but a fashion brand might use questions like "What can you wear with [Category]". Write these down in a document.
3. Enable Storing HTML: In Screaming Frog go to Configuration > Spider > Extraction.
In the “HTML” box ensure that both “Store HTML” and “Store Rendered HTML” are turned on.
4. Connect Screaming Frog to OpenAI: Navigate to Configuration > API Access > AI > OpenAI.
Add your API key here and click "Connect"
5. Configure Your Prompt: Next go to the Prompt Configuration” tab and select “Add". You'll see a table to configure your prompt.
Set the "Text" to "Page Text" and add your prompt into the "Prompt" column. Here's the information I used (your prompt will be different)
6. Filter Your Category Pages: Filter to have Screaming Frog only crawl category pages.
Go to Configuration > Include to open the “Include” filter then type "/your_category_directory/.*"
7. Start Your Crawl: Start your crawl and then navigate to the "AI" column in the right side bar and find your prompt name.
You'll see the text created in this report.
You'll find that Screaming Frog very quickly generates this text.
If you have a 10,000 category pages, Screaming Frog would create this in just 7 hours.
The output is quite good as well. 80% of the output I see when running this serves a strong starting point
I repeat, this process is meant to be utilized as a starting point only. You need a copywriter to review, improve the content, structure internal linking etc.
However, if this is a huge task for your site, this process will get the ball rolling: screamingfrog.co.uk/using-ai…
