Indexly
Search engine optimizationUpdated April 27, 2026

Keyword research

Definition

Keyword research is the practice of identifying the queries your audience actually types into Google, Bing, and AI assistants — with their volume, intent, difficulty, and competitive landscape — to ground content investment in real demand. In 2026, modern keyword research extends beyond head-term and long-tail keywords to include *prompts*: the conversational queries buyers send to ChatGPT, Claude, Perplexity, and AI Mode.

How keyword research works

A complete keyword research workflow captures four data points per query:

  • Search volume: how often the query is run per month. Google Search Console gives you yours; third-party tools (Ahrefs, Semrush, Indexly) estimate competitor and category volumes.

  • Search intent: informational, navigational, commercial, or transactional — which determines what content format will rank.

  • Difficulty: a composite signal of how competitive the SERP is. High difficulty + high volume = expensive to win.

  • AI prompt volume (new in 2026): how often the same intent gets asked of ChatGPT, Claude, or Perplexity. Some queries have collapsed on Google and exploded on AI assistants — only AI-aware keyword research surfaces this shift.

Sources include Search Console, Google Keyword Planner, third-party tools, AI prompt logs, sales and support transcripts, and Reddit/community mining.

Keyword research vs prompt research

Traditional keyword research targets typed queries on Google. Prompt research targets conversational queries on AI assistants.

The two diverge in three ways:

  1. Length and specificity. Typed queries are 2–4 words. Prompts are full sentences with qualifiers and follow-ups.

  2. Volume sources. Typed query volume comes from Google data. Prompt volume comes from prompt logs, sales conversations, and direct sampling of AI assistants.

  3. Intent shape. Typed queries often start research; prompts often skip ahead to evaluation ("compare X and Y") or decision ("which is best for [scenario]").

In 2026, mature programs run both — typed-query research for SEO and prompt research for GEO/AEO — then deduplicate the overlap.

4

Data points to capture per query — volume, intent, difficulty, AI prompt volume

Indexly framework

100–500

Recommended buyer-prompt baseline for AI prompt research

Indexly best practice

Quarterly

Recommended cadence for re-running keyword + prompt research

Indexly best practice

Why it matters

Keyword research is what prevents publishing into the void. Three concrete payoffs:

  1. Content matches demand. Researched topics have measurable audience volume; un-researched topics often turn out to have none.

  2. Intent shapes format. Knowing whether a query is informational or transactional decides whether to write a definition page, comparison page, or product page.

  3. AI search gaps surface early. Some queries have low Google volume and high AI prompt volume — the highest-leverage opportunity for brands moving into GEO/AEO. Only AI-aware keyword research finds them.

How to run keyword research

Six-step workflow:

  1. Mine first-party sources. Search Console, sales call transcripts, support tickets, community forums. The richest signal is usually internal, not bought.

  2. Expand with third-party tools. Ahrefs, Semrush, or Indexly pull keyword universes around seed terms.

  3. Add prompt research. Sample AI assistants directly with seed prompts and capture follow-up questions. Indexly aggregates prompt-volume data across ChatGPT, Claude, Perplexity, and AI Mode.

  4. Cluster by intent. Group queries into informational, comparison, and decision intent. Different formats win different intents.

  5. Score by difficulty + volume + AI demand. Build a composite priority score. Top of the list is what you fund first.

  6. Re-run quarterly. Search behavior shifts — especially as AI assistants capture more informational queries. Quarterly refreshes catch the drift.

Frequently asked questions

Is keyword research still relevant in 2026?

Yes — but it now includes AI prompts alongside typed queries. Some informational keywords have collapsed on Google and exploded on ChatGPT and Perplexity. Traditional keyword research alone misses these shifts; AI-aware research catches them.

How is prompt research different from keyword research?

Prompts are longer, more conversational, and often skip past research-stage queries to evaluation or decision intent. They live in AI assistant logs rather than Google's keyword universe. Mature programs run both and deduplicate the overlap.

How many keywords should a research project surface?

Quality over quantity. 100–500 high-confidence queries (with intent classification and volume) is far more useful than 5,000 raw keywords. Most effort should go into clustering and prioritization.

Where do AI prompt volumes come from?

A mix of direct sampling (running prompts against AI assistants on a recurring schedule), aggregated prompt logs from tools like Indexly, sales-call transcripts, support tickets, and community mining (Reddit, niche forums). No single source is authoritative; triangulation matters.

How often should I refresh keyword research?

Quarterly for most categories. After a Google core update or a major shift in AI assistant behavior, run an ad-hoc refresh. Year-over-year comparisons reveal whether your category is migrating from Google to AI search.

Keyword clustering

Keyword clustering is the practice of grouping related queries into topical clusters that map to a single page or content asset — instead of building one page per individual keyword. Clustering is what turns a 5,000-keyword research dump into a 20-cluster content roadmap and is foundational to both modern SEO and Generative Engine Optimization (GEO).

Search intent

Search intent is the underlying goal behind a query — what the user is actually trying to accomplish when they search. Classifying intent is the foundation of modern SEO and AI search optimization because the right answer for an informational query ("what is share of voice") is structurally different from the right answer for a transactional query ("buy AI visibility tracking software").

SERP analysis

SERP analysis is the systematic study of a search engine results page for a target query — the ranked links, AI Overviews, People Also Ask boxes, knowledge panels, video carousels, and ads — to understand what Google thinks the user wants and what content format is winning. In 2026, SERP analysis has expanded to include AI Mode citations and AI Overview source lists alongside the traditional ten blue links.

Content gap analysis

Content gap analysis is the systematic comparison of your site's content coverage against competitors and against the queries your audience actually searches — surfacing topics where competitors rank or earn AI citations and you don't. In 2026 it expands beyond Google rankings to include AI search gaps — topics where ChatGPT, Claude, Perplexity, and AI Overviews cite competitors but never mention you.

AI content strategy

AI content strategy is the deliberate plan for producing, structuring, and maintaining content so it earns visibility inside AI assistants — ChatGPT, Claude, Perplexity, Gemini, Grok, and Google AI Overviews. It rebuilds traditional editorial planning around the way LLMs choose, cite, and synthesize sources rather than the way Google ranks links.