Duplicate Page Content

Find pages on a website that have duplicate or near-duplicate content. Call the Duplicate Page Content API via REST or MCP to automate SEO research.

CostEstimated 10 credits / call

Try online

POST · https://api.nexscope.ai/seo/duplicatePageContentMCP · nexscope_duplicate_page_content

What this API does

Find pages on a website that have duplicate or near-duplicate content. The request accepts limit, offset, pageUrl, similarity, task_id. Its documented result includes similarity, sourceUrl, statusCode, url, missingFields.field, warnings.

Duplicate Page Content API use cases

Investigate a website quality issue

To investigate a website quality issue, a search marketer submits limit and offset to Duplicate Page Content. The returned similarity, sourceUrl, statusCode help locate the pages or resources behind the reported issue.

Prioritize pages for technical review

A search marketer uses Duplicate Page Content with limit and offset to prioritize pages for technical review. The returned similarity, sourceUrl, statusCode help choose affected pages for the next technical investigation.

Record evidence before a site change

For this workflow, a search marketer calls Duplicate Page Content with limit and offset to record evidence before a site change. The result helps compare saved evidence before and after a site correction.

Duplicate Page Content API FAQ

What does the Duplicate Page Content API return?

Find pages on a website that have duplicate or near-duplicate content. The documented output includes similarity, sourceUrl, statusCode, url, missingFields.field, warnings. It corresponds to the supplied limit, offset, pageUrl, similarity, task_id. Optional fields can be absent; a missing value should not be interpreted as a measured zero. Example values illustrate the response shape, rather than live account results.

How many credits does the Duplicate Page Content API cost?

The current documented cost is Estimated 10 credits / call. This is the same cost shown at the top of this page. If a range or estimate is displayed, the final charge depends on the request. Review your available credits and the pricing page before calling the API, and check API usage records for the actual charge.

How do I call the Duplicate Page Content API from my app or an MCP client?

Send a POST request to https://api.nexscope.ai/seo/duplicatePageContent with your API key as a Bearer token and the JSON inputs shown in API integration. In a compatible MCP client such as Claude or Cursor, connect Nexscope and call nexscope_duplicate_page_content. Use the MCP arguments shown in the MCP guide, or switch Online test to MCP to review its request before adding it to your app.

View plans and credits Connect this API with MCP

Try this API

Endpoint

https://api.nexscope.ai/seo/duplicatePageContent

MCP method

nexscope_duplicate_page_content

Step 1 of 3 · Authenticate

Authentication

All run endpoints require a user API key. Send it as a bearer token in the Authorization header.

Authorization: Bearer nk-xxxxxxxxxxxxxxxxx

Missing or invalid API keys return an authentication error. Manage keys from .

Step 2 of 3 · Send a request

POSThttps://api.nexscope.ai/seo/duplicatePageContent

Run an API

Send a JSON request body using the parameters described below.

Example request

Replace YOUR_API_KEY, then run this command in your terminal.

curl -X POST 'https://api.nexscope.ai/seo/duplicatePageContent' \
  -H "Authorization: Bearer YOUR_API_KEY" \
  -H "Content-Type: application/json" \
  -d '{
  "limit": 20,
  "offset": 0,
  "pageUrl": "https://www.nexscope.ai/",
  "similarity": 6,
  "task_id": ""
}'

Code example

{
  "limit": 20,
  "offset": 0,
  "pageUrl": "https://www.nexscope.ai/",
  "similarity": 6,
  "task_id": ""
}

Step 3 of 3 · Inspect the result

Check the response

Read code for the request status and data for the result. Open the parameter and response reference for the full field definitions.

HTTP status codes

Code	Description
200	Default HTTP response for both success and many business errors. Only outer JSON code 0 indicates success or asynchronous acceptance; inspect data for the result.
429	Execution admission rate limit; honor Retry-After when present.
503	Execution admission is temporarily unavailable; honor Retry-After when present.
Opt-in	X-Nexscope-Http-Status: semantic maps controller-handled business errors to HTTP status on run and task routes. Pre-authentication failures, such as a missing or invalid API key (code 11209, including an incomplete or corrupted copy) or an expired website login session (code 12001), may still return HTTP 200 before this mapping. Always check the outer JSON code; malformed requests and infrastructure failures may also return non-200 HTTP responses.

View parameters & response Try online

All categories/ Website & On-Page SEO

POSThttps://api.nexscope.ai/seo/duplicatePageContent

Run this API

Send a JSON request to execute this API and receive the documented response payload.

Open tester

Endpoint

Method	`POST`
Path	`https://api.nexscope.ai/seo/duplicatePageContent`
Auth	`Bearer API key`
Content-Type	`application/json`

Request parameters

Name	Type	Required	Description
`limit`	`integer`	optional	Limit value used by this API operation. Default: 20 Minimum: 1 Maximum: 100
`offset`	`integer`	optional	Offset value used by this API operation. Default: 0 Minimum: 0 Maximum: 1000
`pageUrl`	`string`	required	Page url value used by this API operation. Format: uri Maximum length: 2048
`similarity`	`integer`	optional	Similarity value used by this API operation. Default: 6 Minimum: 0 Maximum: 10
`task_id`	`string`	required	Task id value used by this API operation. Minimum length: 1 Maximum length: 64

Response example

Example response envelope from the documented SEO API contract.

{
  "code": 0,
  "cost": "-1",
  "data": {
    "callId": "synthetic-call",
    "completedAt": null,
    "coverage": {
      "missing": [
        {
          "field": "synthetic",
          "reason": "UPSTREAM_FIELD_MISSING"
        }
      ],
      "status": "PARTIAL"
    },
    "requestedAt": "123",
    "result": {
      "coverage": {
        "invalidItemCount": 1,
        "limit": 1,
        "maxCrawlPages": 9007199254740992,
        "offset": 1,
        "pagesCrawled": 9007199254740992,
        "providerTotal": 9007199254740992,
        "returnedCount": 1,
        "sampled": false,
        "stopReason": "synthetic",
        "truncated": false
      },
      "items": [
        {
          "similarity": 1.25,
          "sourceUrl": "synthetic",
          "statusCode": 9007199254740992,
          "url": "synthetic"
        }
      ],
      "missingFields": [
        {
          "field": "synthetic",
          "reason": "synthetic"
        }
      ],
      "source": {
        "candidateId": "synthetic",
        "collectedAt": 9007199254740992,
        "observationKind": "synthetic",
        "product": "synthetic",
        "provider": "synthetic",
        "queriedAt": 9007199254740992,
        "sourceCallId": "synthetic",
        "sourcePlanVersion": "synthetic",
        "sourceSchemaVersion": "synthetic"
      },
      "warnings": [
        "synthetic"
      ]
    },
    "schemaVersion": "synthetic",
    "source": "synthetic",
    "status": "PARTIAL",
    "usage": {
      "billingStatus": "UNAPPROVED",
      "chargedCredits": "0"
    }
  },
  "msg": null,
  "time": "2026-01-01 00:00:00",
  "traceId": "synthetic-trace",
  "ts": "9007199254740993"
}

Response fields

Name	Type	Required	Description
`code`	`integer`	required	0 is a successful envelope; inspect data.status separately. Allowed: 0, 42008, 42009
`cost`	`string`	required	Elapsed processing milliseconds; not price. -1 for non-web context.
`data`	`object`	required	Data value used by this API operation.
`data.callId`	`string \| null`	optional	Call id value used by this API operation.
`data.completedAt`	`string \| integer \| null`	optional	Completed at value used by this API operation.
`data.coverage`	`object`	optional	Coverage value used by this API operation.
`data.coverage.missing`	`array`	optional	Missing value used by this API operation.
`data.coverage.missing[]`	`object`	required	Item in data coverage missing.
`data.coverage.missing[].field`	`string`	optional	Field value used by this API operation.
`data.coverage.missing[].reason`	`string`	optional	Reason value used by this API operation.
`data.coverage.status`	`string`	optional	Status value used by this API operation.
`data.requestedAt`	`string \| integer \| null`	optional	Requested at value used by this API operation.
`data.result`	`object \| null`	required	Result value used by this API operation.
`data.result.coverage`	`object`	required	Coverage value used by this API operation.
`data.result.coverage.invalidItemCount`	`integer`	required	Invalid item count value used by this API operation. Minimum: 0
`data.result.coverage.limit`	`integer`	required	Limit value used by this API operation. Minimum: 0
`data.result.coverage.maxCrawlPages`	`integer \| null`	required	Max crawl pages value used by this API operation. Minimum: 0
`data.result.coverage.offset`	`integer`	required	Offset value used by this API operation. Minimum: 0
`data.result.coverage.pagesCrawled`	`integer \| null`	required	Pages crawled value used by this API operation. Minimum: 0
`data.result.coverage.providerTotal`	`integer \| null`	required	Provider total value used by this API operation. Minimum: 0
`data.result.coverage.returnedCount`	`integer`	required	Returned count value used by this API operation. Minimum: 0
`data.result.coverage.sampled`	`boolean`	required	Sampled value used by this API operation. Constant: true
`data.result.coverage.stopReason`	`string \| null`	required	Stop reason value used by this API operation.
`data.result.coverage.truncated`	`boolean`	required	Truncated value used by this API operation.
`data.result.items`	`array`	required	Items value used by this API operation. Maximum items: 100
`data.result.items[]`	`object`	required	Item in data result items.
`data.result.items[].similarity`	`number \| null`	required	Similarity value used by this API operation. Minimum: 0 Maximum: 10
`data.result.items[].sourceUrl`	`string`	required	Source url value used by this API operation. Maximum length: 2048
`data.result.items[].statusCode`	`integer \| null`	required	Status code value used by this API operation. Minimum: 100 Maximum: 599
`data.result.items[].url`	`string`	required	Url value used by this API operation. Maximum length: 2048
`data.result.missingFields`	`array`	required	Missing fields value used by this API operation. Maximum items: 10000
`data.result.missingFields[]`	`object`	required	Item in data result missingFields.
`data.result.missingFields[].field`	`string`	required	Field value used by this API operation.
`data.result.missingFields[].reason`	`string`	required	Reason value used by this API operation.
`data.result.source`	`object`	required	Source value used by this API operation.
`data.result.source.candidateId`	`string`	required	Candidate id value used by this API operation. Constant: MD-PW-07
`data.result.source.collectedAt`	`integer \| null`	required	Collected at value used by this API operation. Minimum: 0 Maximum: 9007199254740991
`data.result.source.observationKind`	`string`	required	Observation kind value used by this API operation. Constant: CRAWL_SAMPLE
`data.result.source.product`	`string`	required	Product value used by this API operation. Constant: on_page
`data.result.source.provider`	`string`	required	Provider value used by this API operation. Constant: DATAFORSEO
`data.result.source.queriedAt`	`integer`	required	Queried at value used by this API operation. Minimum: 0 Maximum: 9007199254740991
`data.result.source.sourceCallId`	`string \| null`	required	Source call id value used by this API operation.
`data.result.source.sourcePlanVersion`	`string \| null`	required	Source plan version value used by this API operation.
`data.result.source.sourceSchemaVersion`	`string \| null`	required	Source schema version value used by this API operation.
`data.result.warnings`	`array`	required	Warnings value used by this API operation. Maximum items: 1000
`data.result.warnings[]`	`string`	required	Item in data result warnings.
`data.schemaVersion`	`string \| null`	optional	Schema version value used by this API operation.
`data.source`	`string \| null`	optional	Source value used by this API operation.
`data.status`	`string`	optional	Status value used by this API operation. Allowed: SUCCESS, PARTIAL, EMPTY, PROCESSING, UNKNOWN, FAILED
`data.usage`	`object \| null`	optional	Usage value used by this API operation.
`data.usage.billingStatus`	`string \| null`	optional	Billing status value used by this API operation.
`data.usage.chargedCredits`	`string \| integer \| null`	optional	Charged credits value used by this API operation.
`msg`	`string \| null`	required	Available upstream msg/errmsg/message is preferred for success and failure; Chinese is translated to English. Missing successful message is null. Platform-only errors and task states use platform English. Message text never determines success or retry.
`time`	`string`	required	yyyy-MM-dd HH:mm:ss
`traceId`	`string \| null`	required	Trace id value used by this API operation.
`ts`	`string`	required	Epoch milliseconds; global long serializer.

Accepted processing response

code 0 confirms acceptance. Use data.callId to query the same request; processing is not completion.

Name	Type	Required	Description
`code`	`integer`	required	0 is a successful envelope; inspect data.status separately. Constant: 0
`cost`	`string`	required	Elapsed processing milliseconds; not price. -1 for non-web context.
`data`	`object`	required	Data value used by this API operation.
`data.callId`	`string \| null`	required	Call id value used by this API operation.
`data.reason`	`string`	required	Reason value used by this API operation. Constant: IN_PROGRESS
`data.retryable`	`boolean`	optional	Retryable value used by this API operation.
`data.status`	`string`	required	Status value used by this API operation. Constant: PROCESSING
`data.taskId`	`string \| null`	optional	Task id value used by this API operation.
`msg`	`string \| null`	required	Available upstream msg/errmsg/message is preferred for success and failure; Chinese is translated to English. Missing successful message is null. Platform-only errors and task states use platform English. Message text never determines success or retry.
`time`	`string`	required	yyyy-MM-dd HH:mm:ss
`traceId`	`string \| null`	required	Trace id value used by this API operation.
`ts`	`string`	required	Epoch milliseconds; global long serializer.

Error response

Name	Type	Required	Description
`code`	`integer`	required	0 is a successful envelope; inspect data.status separately.
`cost`	`string`	required	Elapsed processing milliseconds; not price. -1 for non-web context.
`data`	`object`	required	Data value used by this API operation.
`data.callId`	`string \| null`	required	Call id value used by this API operation.
`data.reason`	`string \| null`	required	Reason value used by this API operation.
`data.retryable`	`boolean`	optional	Retryable value used by this API operation.
`data.status`	`string \| null`	required	Status value used by this API operation.
`data.taskId`	`string \| null`	optional	Task id value used by this API operation.
`msg`	`string \| null`	required	Available upstream msg/errmsg/message is preferred for success and failure; Chinese is translated to English. Missing successful message is null. Platform-only errors and task states use platform English. Message text never determines success or retry.
`time`	`string`	required	yyyy-MM-dd HH:mm:ss
`traceId`	`string \| null`	required	Trace id value used by this API operation.
`ts`	`string`	required	Epoch milliseconds; global long serializer.

Retrieve a processing result

A response withPROCESSING and a callIdmeans the result is still being prepared. Use the result query below with the returned identifier. This lookup reads the stored result and does not spend credits.

curl -X GET https://api.nexscope.ai/seo/duplicatePageContent/calls/{callId} \
  -H "Authorization: Bearer nk-xxxxxxxxxxxxxxxxx"

Responses

Code	Description
200	Default HTTP response for both success and many business errors. Only outer JSON code 0 indicates success or asynchronous acceptance; inspect data for the result.
429	Execution admission rate limit; honor Retry-After when present.
503	Execution admission is temporarily unavailable; honor Retry-After when present.
Opt-in	X-Nexscope-Http-Status: semantic maps controller-handled business errors to HTTP status on run and task routes. Pre-authentication failures, such as a missing or invalid API key (code 11209, including an incomplete or corrupted copy) or an expired website login session (code 12001), may still return HTTP 200 before this mapping. Always check the outer JSON code; malformed requests and infrastructure failures may also return non-200 HTTP responses.

Data source, freshness, and limitations

Source, freshness, coverage, rate limits, and estimation notes are not specified in this API definition unless they appear in the request or response field documentation above. Do not assume official marketplace data or real-time freshness when it is not explicitly documented.

Step 1 of 2 · Connect your MCP client

MCP

V2 recommended

Connect remote agents through the standard MCP 2025-11-25 Streamable HTTP endpoint. Use OAuth 2.1 Authorization Code with PKCE, or an API key for compatibility.

POST https://api.nexscope.ai/mcp
MCP-Protocol-Version: 2025-11-25
Content-Type: application/json

Authentication

OAuth clients request the mcp:tools scope. The endpoint's 401 response advertises protected-resource metadata for authorization discovery.

Step 2 of 2 · Call the tool

Call a tool

{
  "jsonrpc": "2.0",
  "id": "tool-call-1",
  "method": "tools/call",
  "params": {
    "name": "nexscope_duplicate_page_content",
    "arguments": {
      "limit": 20,
      "offset": 0,
      "pageUrl": "https://www.nexscope.ai/",
      "similarity": 6,
      "task_id": ""
    }
  }
}

Legacy MCP v1

Existing API-key clients can continue using the compatibility endpoint. New integrations should use MCP v2.

GET / POST /mcp/legacy

What can you do with this API?

Data explained and practical use cases

AI Guide

Question

What data can Duplicate Page Content provide, and how might I use it?

AI answer

This API reports duplicate or near-duplicate page pairs found in a website crawl sample. A completed result can identify pages to inspect and show how much of the crawl was represented.

Data category	Documented fields	What the values mean
Page pair	`data.result.items[].sourceUrl`, `data.result.items[].url`	The two page URLs associated with a reported content-similarity item.
Similarity	`data.result.items[].similarity`	A nullable reported similarity value on the documented 0–10 scale.
Page response	`data.result.items[].statusCode`	The reported HTTP status for the listed page, when available.
Sample coverage	`data.result.coverage.pagesCrawled`, `data.result.coverage.returnedCount`, `data.result.coverage.sampled`, `data.result.coverage.truncated`	Shows crawl size when known, number of returned items, that results are sampled, and whether the result was truncated.
Gaps and warnings	`data.result.missingFields[].field`, `data.result.missingFields[].reason`, `data.result.warnings`	Identifies unavailable fields and other cautions affecting interpretation.

Find pairs of product or article pages whose content may need a closer editorial review.
- Prompt example: “I am reviewing an ecommerce website. Could you find pairs of product or article pages whose content may need a closer editorial review? Show matching records and source links where the API provides them; ask me for any required identifier or filter.”
Use pageUrl to investigate reported similarity involving a particular page.
- Prompt example: “I am reviewing an ecommerce website. Could you use pageUrl to investigate reported similarity involving a particular page? Show the relevant returned evidence and tell me what input you need from me.”
Prioritize URL pairs by their reported similarity value, then inspect the pages themselves.
- Prompt example: “I am reviewing an ecommerce website. Could you prioritize URL pairs by their reported similarity value, then inspect the pages themselves? Show the returned values behind the comparison, and mark missing data.”
Check crawl counts and truncation before treating a small result set as representative of a site.
- Prompt example: “I am reviewing an ecommerce website. Could you check crawl counts and truncation before treating a small result set as representative of a site? Show the relevant returned evidence and tell me what input you need from me.”

The supplied example is still PROCESSING, so it contains no page pairs. Even a completed result is a crawl sample, not proof that every duplicate page on the site was found.

Related APIs

Duplicate Page Tags

Find pages on a website with duplicate title tags and meta descriptions.

Page Keyword Density

Measure how often keywords appear on a page to check on-page optimization.

Page Lighthouse Audit

Run a Lighthouse audit on a page to get performance, accessibility and SEO scores.

Page Loading Waterfall

See how each resource on a page loads, in order, to find slow requests.