Conversation
This reverts commit 3e993b3.
️✅ There are no secrets present in this pull request anymore.If these secrets were true positive and are still valid, we highly recommend you to revoke them. 🦉 GitGuardian detects secrets in your source code to help developers and security teams secure the modern development process. You are seeing this because you or someone else with access to this repository has authorized GitGuardian to scan your pull request. |
Dependency ReviewThe following issues were found:
|
scrapegraph-js/examples/agenticscraper/agenticScraper_advanced_example.js
Outdated
Show resolved
Hide resolved
scrapegraph-js/examples/agenticscraper/agenticScraper_advanced_example.js
Outdated
Show resolved
Hide resolved
scrapegraph-js/examples/agenticscraper/agenticScraper_complete_example.js
Outdated
Show resolved
Hide resolved
…tic scraper examples to use repeat method
| } | ||
|
|
||
| try { | ||
| const response = await axios.post(endpoint, payload, { headers }); |
There was a problem hiding this comment.
Bug: Crawl: Extraction mode option is non-functional.
The crawl function accepts an extractionMode option according to the JSDoc comments and is used in multiple examples, but this parameter is never destructured from the options object or added to the API payload. The documentation and examples show extractionMode controlling whether AI extraction (true) or markdown conversion (false) is used, but this setting is never actually sent to the API, causing the function to ignore this important configuration option.
|
🎉 This PR is included in version 1.41.1 🎉 The release is available on:
Your semantic-release bot 📦🚀 |
Restore the javascript sdk
This reverts commit 3e993b3.
Note
Adds a full JavaScript SDK (scrapegraph-js) with core APIs, mock tooling, examples, tests, and config; includes new features like pagination, cookies, renderHeavyJs/stealth, and HTML/Markdown inputs.
scrapegraph-js/with packaging, lint/format config, and documentation.package.json,eslint.config.js, Prettier config, README and feature docs (pagination, agentic scraper).smartScraper(paginationtotalPages, cookies,renderHeavyJs,stealth, HTML/Markdown inputs) and status getter.searchScraper(AI extraction or markdown mode viaextractionMode,renderHeavyJs,stealth) and status getter.scrape+ request getter;markdownify+ request getter;sitemap;crawl(AI/markdown modes, sitemap, depth) + getter.agenticScraper+ request getter;healthz;scheduledJobsCRUD/trigger/executions.index.js.utils/mockConfig.js,mockResponse.js) and shared error handler..gitignore; addsexamples/.env.example.Written by Cursor Bugbot for commit 997ae16. This will update automatically on new commits. Configure here.