The AI-powered Entity Audit

2.2 Entity Extraction with the Google NLP API

You don’t have access to this lesson

Please purchase this course, or sign in if you’re already enrolled, to access the course content.

Lesson overview

This lesson puts the Google Natural Language API to work through the first of the course’s browser tools. It starts with one page, adds the single input that turns the tool from descriptive to diagnostic, and then scales to the whole corpus built in the previous lesson.

What this lesson covers

  • The Extractor’s six steps from a pasted page to two exported files
  • The intended-entity field and why it has to come first
  • How to read the entity table and the page-profile verdict
  • Running a full corpus within the free tier
  • Recovering from the common API failures
  • What raw API output does and does not tell you

The lesson opens with a result from the demo site: on a page about entity strategy, the top entity was the word “entities”. It then works through the Entity Extractor & Salience Profiler step by step. You paste one page first, so a few units of free allowance confirm the extraction is sane before hundreds of calls are made. Before pressing the button you write down what the page is meant to be about — a commitment that has to come before the output, because once you have seen the machine’s answer it is very hard not to be influenced by it.

The intended entity is what makes the verdict possible: a red mismatch means a page is about something other than what you intended, which is a finding a stakeholder can act on immediately. Scaling up, the full demo-site corpus of 637 documents ran inside the free tier at a cost of $0.00 and produced two exports — every entity on every page, and one profile row per URL — that the rest of the course reads. The lesson also covers the five errors that stop a run, the reason version 2 of the API cannot be used for prominence, and why raw output is not yet an audit.

This lesson continues Module 2, Diagnostics: Extracting the Truth About Your Site, in The AI-powered Entity Audit, and leads into page profiles and prominence scoring. It suits anyone running entity extraction for the first time, including those who have only used entity tools that hide the underlying API response.

In this lesson you’ll cover:

  • The Entity Extractor & Salience Profiler: what it does, what it needs and what it costs
  • Why you run one page you know well before uploading a whole corpus
  • Committing to an intended entity before you see any output
  • Reading the entity table: salience, type, mentions and the MID column
  • The intended-versus-detected verdict, and why a mismatch is the course’s most useful single diagnostic
  • Scaling to the full corpus, checking the estimate and exporting both files
  • Five things that stop a run, and how to recover from each
  • Why the course pins version 1 of the NLP API, and what a real 637-page run returns
Length: 12 minutes|Difficulty: Easy
0 of 48 lessons complete (0%)