Find Content Gaps in Websites: Market Research and SEO n8n Workflow

You can use the InfraNodus GraphRAG API to generate topical summaries of the top websites for any niche and then use its AI advice endpoints to identify content gaps related to them. 

This can be very useful for research, marketing, and SEO applications as you can quickly get an overview of the main topics that are available online for a certain niche and then also reveal the content gaps this discourse. 

For example, if we analyze the top websites for "body and physical practices, fitness, etc." we will see that most of them are talking about the health and fitness aspects and another big topic is the community aspect. However, there is a gap between the two topics: which means that most of the websites (companies) that talk about this topic don't mention the two in the same context. This might be an opportunity: bridging the gap between health, fitness but also emphasizing the community aspect that comes with a collective practice. 

Targeting those content gaps will offer opportunities to contribute to the discourse in a positive and constructive way and take over unoccupied niches. 

Here is how you can conduct this research using the n8n automation tool together with InfraNodus.

Note — you can read a more detailed explanation of how this workflow works from a conceptual perspective at https://support.noduslabs.com/hc/en-us/articles/20454382597916-Beat-Your-Competition-Target-Their-Content-Gaps-with-this-n8n-Automation-Workflow

n8n Content Gap Research Automation

For this workflow, you don't need any AI connections, only the InfraNodus one.

The workflow template described below is available on our GitHub: https://github.com/infranodus/n8n-infranodus-workflow-templates

There is a variation of this flow that uses an AI agent (based on OpenAI) that will use various InfraNodus endpoints as tools. That agent will provide more detailed responses. 

The workflow operates in 2 stages:

1) Data enrichment (using InfraNodus' GraphRAG to generate topical summaries and graph summaries for every URL you're analyzing)

2) Insight generation (using InfraNodus to identify the main topical clusters and gaps in those summaries.

It consists of the following steps:

Step 0: Preparing the workflow

Before execution starts, you need to have a Google Sheet file with a list of companies (Name column) and their URLs (URL column). It also needs the Topical Summary column and the Graph Summary column.

A sample Google Sheet is provided with the workflow. You need to make sure you add its name everywhere where the Google Sheet n8n node is used.

This file has list of the websites or companies that operate in a certain field or that write about a certain topic. You can prepare this list in the following ways:

- Manually filling it in using your own knowledge

- Using a sub-workflow available in the workflow we provide in the template (it will use Perplexity to perform a search and then populate the Google sheets with a list of websites)

- Using a Deep Research agent like Manus AI or Google / ChatGPT Deep Research prompting the model to deliver a CSV file with a list of companies / links, which you would then import into Google Sheets

Once you have the file ready, the following steps are performed:

Steps 1-2: Triggering and Launching the workflow

Use the manual trigger to start the workflow. It will then read the data from the Google sheet, split it into batches of 10 to avoid rate-limit request and proceed to the next steps.

Step 3: Scraping the url content

The next step is scraping the content. We retrieve the content of the URL pages, clean it, and deliver clean text to the next step.

Steps 5-7: Use InfraNodus GraphRAG Content Enhancer to get a topical summary and graph summary

InfraNodus will then generate a topical summary and a graph summary of every website and store them into the Google Sheet you provided.

You can use this data later for other purposes, for example, creating SEO-friendly articles, or visualizing the content (copy and paste the column into InfraNodus visual text analysis tool to do that):

Steps 8-10: Use InfraNodus AI to generate insight based on the content gaps

Once the Google Sheets is complete and enriched with the topical summaries and graph summaries, we will now send all the topical summaries to InfraNodus' `graphAndAdvice` endpoint to generate a response that will emphasize the main recurrent topics and gaps between them.

Another endpoint will generate interesting research questions that can help bridge those gaps. You can replace it with the Idea Generation endpoint (by changing `requestMode` from `question` to `idea`) and it will generate a business idea based on the gap. 

Once it's done, the insight advice will be saved to a Google Doc file of your choice.