@codebolt/codeboltjs
Interface: CrawlerOptions
Defined in: packages/codeboltjs/src/types/libFunctionTypes.ts:1614
Properties
| Property | Type | Description | Defined in |
|---|
followExternal? | boolean | Follow external links | packages/codeboltjs/src/types/libFunctionTypes.ts:1620 |
headers? | Record<string, string> | Custom headers | packages/codeboltjs/src/types/libFunctionTypes.ts:1622 |
maxDepth? | number | Maximum depth | packages/codeboltjs/src/types/libFunctionTypes.ts:1618 |
timeout? | number | Request timeout | packages/codeboltjs/src/types/libFunctionTypes.ts:1624 |
url | string | URL to crawl | packages/codeboltjs/src/types/libFunctionTypes.ts:1616 |