Every SEO campaign lives or dies on the quality of its keyword research. Choose the wrong keywords — too broad, too competitive, or misaligned with your audience's actual search intent — and you can spend months creating content that ranks for nothing, or ranks for terms that never convert. After 15 years building keyword strategies for businesses across India and internationally, I want to share the complete keyword research framework that I use for every client engagement — one that consistently finds the keywords where ranking is both achievable and commercially valuable.
Search Intent — The Foundation of All Keyword Research
Search intent is the "why" behind a search query — what is the searcher actually trying to accomplish? Google's entire ranking system is built around matching the right content to the right intent. If your content doesn't match the intent of the keyword you're targeting, you will not rank, regardless of how well-optimised the page is. There are four types of search intent:
| Intent Type | What Searchers Want | Example Keywords | Best Content Type | Conversion Potential |
|---|---|---|---|---|
| Informational | Learn about a topic | "what is SEO," "how does keyword research work" | Blog posts, guides, explainers | Low (top of funnel) |
| Navigational | Find a specific website or brand | "UnstopGrowth SEO," "Ahrefs login" | Brand pages, login pages | Medium (existing awareness) |
| Commercial | Research before buying | "best SEO agency Chandigarh," "Ahrefs vs SEMrush" | Comparison pages, reviews, case studies | High (evaluation stage) |
| Transactional | Complete an action or purchase | "hire SEO agency," "SEO services price," "book free consultation" | Service pages, landing pages | Very High (decision stage) |
Keyword Metrics That Actually Matter
When evaluating keywords, most beginners focus only on search volume. This is a mistake that leads to targeting keywords you'll never rank for, or keywords that don't drive revenue. The three metrics that matter most are:
Free Keyword Research Tools — The Complete Stack
You do not need to spend ₹20,000/month on SEO tools to do excellent keyword research. Here are the best free tools and exactly how to use them:
- Google Keyword Planner (GKP): The original. Requires a Google Ads account (free to create, doesn't require spending). Enter your seed keywords to get related terms, volume ranges, and competition levels. Best used for: discovering new keyword themes and validating that commercial demand exists for a topic. Limitation: volume is shown in wide ranges and is paid-search focused.
- Google Search Console (GSC): If you have GSC installed on your website, this is a goldmine — it shows the exact queries your pages are already ranking for (positions 1–100), clicks, impressions, and CTR. Filter by queries where you rank in positions 8–20 — these are "quick win" opportunities where a content update could push you onto page 1 with minimal effort. This is often the fastest route to more organic traffic.
- AnswerThePublic (free tier): Generates visualisations of all question-based searches around a keyword — "What," "How," "Why," "Can," "Which," "Are," "When," "Where." This is an outstanding tool for finding informational content topics. Enter your main topic keyword and AnswerThePublic shows you exactly what your audience is asking Google.
- Google Autocomplete and People Also Ask: Search your seed keyword and study the autocomplete suggestions (8 variations Google shows as you type). Then scroll to the "People Also Ask" section in the results — these are real questions with proven search demand. Both sources provide long-tail keyword ideas that often have more specific intent than broad terms.
- Ubersuggest (free tier): Neil Patel's tool provides keyword suggestions, volume, competition scores, and SERP analysis. The free tier is limited to 3 searches per day but sufficient for initial research. Shows keyword ideas, related keywords, and a basic competitor analysis.
- AlsoAsked.com: Shows the "People Also Ask" ecosystem around any keyword — visualising how related questions branch from your primary term. Extremely useful for understanding topical depth and planning content that covers a full subject comprehensively (which Google rewards).
Paid Tools — When and Why to Invest
Free tools have significant limitations in data accuracy, keyword volume, and especially competitor analysis. Once you are investing seriously in SEO — meaning you're publishing 4+ pieces of content per month and have a real budget for rankings — paid tools pay for themselves many times over. The two I recommend without hesitation:
Ahrefs (from $99/month): The gold standard for keyword research and competitor analysis. Ahrefs' keyword database is the largest in the industry. The "Keywords Explorer" tool provides accurate volume data, keyword difficulty, click distribution, and SERP overview. The "Site Explorer" lets you see every keyword a competitor ranks for and every page's estimated traffic. The "Content Gap" tool is the most powerful feature for finding keywords you're missing that competitors are winning. If you had to choose one paid SEO tool, it would be Ahrefs.
SEMrush (from $119/month): Stronger than Ahrefs for PPC keyword research and broader competitive intelligence. The "Keyword Magic Tool" generates comprehensive keyword universes from seed terms. The "Keyword Gap" tool is excellent. SEMrush also provides topic clustering features and a content template tool that analyses top-ranking content for any keyword and suggests what your page should include to compete. Better for agencies managing multiple clients because of its reporting features.
Competitor Gap Analysis — The Fastest Path to Ranking
Competitor gap analysis is the most efficient keyword research method because you are targeting proven demand. Here is the exact process:
- Identify your top 5 organic competitors — not your business competitors, but the websites ranking for your target keywords. Often these are informational sites, industry publications, or other service providers.
- In Ahrefs: Site Explorer → enter competitor domain → Organic Keywords → filter position 1–10 → export to CSV. Do this for all 5 competitors.
- Combine all competitor keyword lists and remove any you are already ranking for in positions 1–5 (use GSC or Ahrefs to check your own rankings).
- Filter for commercial and transactional intent keywords (indicated by high CPC and commercial language in the keyword itself).
- Sort by traffic potential and keyword difficulty relative to your domain authority. The "opportunity zone" is KD under your DA ceiling with traffic potential above 100 monthly visits.
- Prioritise the top 20 keywords from this filtered list as your immediate content targets.
Keyword Mapping — Connecting Keywords to Pages
Keyword mapping is the process of assigning specific keywords to specific pages on your website. Without mapping, multiple pages end up targeting the same keyword (keyword cannibilisation), competing with each other and confusing Google about which page is most relevant. Good keyword mapping prevents this and ensures every important keyword has one clear owner page.
The mapping rules:
- One primary keyword per page. Each page should have one main keyword it is primarily optimised for.
- Group semantically related keywords as secondary targets for the same page. "IELTS coaching Chandigarh" and "best IELTS institute Chandigarh" and "IELTS classes near me" can all target the same service page.
- Separate pages for separate intent. "IELTS coaching" (commercial) and "how to prepare for IELTS" (informational) need separate pages — different intent requires different content types.
- Document your keyword map in a Google Sheet: URL | Primary Keyword | Secondary Keywords | Search Volume | KD | Current Ranking | Target Ranking | Content Owner. Review and update this quarterly.
Content Gap Analysis — Finding Missing Opportunities
A content gap is a topic that your audience searches for that you haven't yet published content about. These are missed ranking opportunities that competitors are likely capturing. Systematic content gap analysis reveals your publishing roadmap for the next 6–12 months.
Beyond competitor gap analysis, use these methods: (1) Review your GSC data for queries where you appear in impressions but have zero or near-zero clicks — your page is being shown but is too far down to click; these need content improvement or new dedicated pages. (2) Survey your existing customers and students — ask "What did you search for before finding us?" The answers reveal keyword opportunities you might not have thought to research. (3) Use AlsoAsked and AnswerThePublic on your core topic keywords to find questions you haven't answered. (4) Review your competitor's blog archives chronologically — what content are they publishing recently that you don't have?