Skip to content

Conversation

@dependabot
Copy link

@dependabot dependabot bot commented on behalf of github Nov 7, 2025

Bumps scrapy from 2.6.2 to 2.13.3.

Release notes

Sourced from scrapy's releases.

2.13.3

  • Changed the values for DOWNLOAD_DELAY (from 0 to 1) and CONCURRENT_REQUESTS_PER_DOMAIN (from 8 to 1) in the default project template.
  • Fixed several bugs in the engine initialization and exception handling logic.
  • Allowed running tests with Twisted 25.5.0+ again and fixed test failures with lxml 6.0.0.

See the full changelog

2.13.2

  • Fixed a bug introduced in Scrapy 2.13.0 that caused results of request errbacks to be ignored when the errback was called because of a downloader error.
  • Docs and error messages improvements related to the Scrapy 2.13.0 default reactor change.

See the full changelog

2.13.1

  • Give callback requests precedence over start requests when priority values are the same.

See the full changelog

2.13.0

  • The asyncio reactor is now enabled by default
  • Replaced start_requests() (sync) with start() (async) and changed how it is iterated.
  • Added the allow_offsite request meta key
  • Spider middlewares that don't support asynchronous spider output are deprecated
  • Added a base class for universal spider middlewares

See the full changelog

2.12.0

  • Dropped support for Python 3.8, added support for Python 3.13
  • start_requests can now yield items
  • Added scrapy.http.JsonResponse
  • Added the CLOSESPIDER_PAGECOUNT_NO_ITEM setting

See the full changelog.

2.11.2

Mostly bug fixes, including security bug fixes.

See the full changelog.

2.11.1

  • Security bug fixes.
  • Support for Twisted >= 23.8.0.
  • Documentation improvements.

See the full changelog.

2.11.0

  • Spiders can now modify settings in their from_crawler methods, e.g. based on spider arguments.
  • Periodic logging of stats.

... (truncated)

Changelog

Sourced from scrapy's changelog.

Scrapy 2.13.3 (2025-07-02)

  • Changed the values for :setting:DOWNLOAD_DELAY (from 0 to 1) and :setting:CONCURRENT_REQUESTS_PER_DOMAIN (from 8 to 1) in the default project template. (:issue:6597, :issue:6918, :issue:6923)

  • Improved :class:scrapy.core.engine.ExecutionEngine logic related to initialization and exception handling, fixing several cases where the spider would crash, hang or log an unhandled exception. (:issue:6783, :issue:6784, :issue:6900, :issue:6908, :issue:6910, :issue:6911)

  • Fixed a Windows issue with :ref:feed exports <topics-feed-exports> using :class:scrapy.extensions.feedexport.FileFeedStorage that caused the file to be created on the wrong drive. (:issue:6894, :issue:6897)

  • Allowed running tests with Twisted 25.5.0+ again. Pytest 8.4.1+ is now required for running tests in non-pinned envs as support for the new Twisted version was added in that version. (:issue:6893)

  • Fixed running tests with lxml 6.0.0+. (:issue:6919)

  • Added a deprecation notice for scrapy.spidermiddlewares.offsite.OffsiteMiddleware to :ref:the Scrapy 2.11.2 release notes <release-2.11.2>. (:issue:6926)

  • Updated :ref:contribution docs <topics-contributing> to refer to ruff_ instead of black_. (:issue:6903)

  • Added .venv/ and .vscode/ to .gitignore. (:issue:6901, :issue:6907)

.. _release-2.13.2:

Scrapy 2.13.2 (2025-06-09)

  • Fixed a bug introduced in Scrapy 2.13.0 that caused results of request errbacks to be ignored when the errback was called because of a downloader error. (:issue:6861, :issue:6863)

... (truncated)

Commits
  • 155a504 Bump version: 2.13.2 → 2.13.3
  • cf465bf Release notes for 2.13.3. (#6934)
  • c9cdf0a Narrow down TestEngine::test_short_timeout() expectations. (#6911)
  • 03fe7a6 Add a deprecation notice for the offsite spider middleware.
  • ba1cede Document the new defaults of throttling settings (#6923)
  • 076c011 Lower the concurrency settings in the default project template. (#6918)
  • 5fbab84 Fix invalid XML samples in tests that break with lxml 6. (#6919)
  • ef01a95 Fix setting ExecutionEngine._slot to None on close. (#6910)
  • 7fbd56b Handle exceptions in _start_request_processing(), cancel it on engine stop (#...
  • b53faac Add .vscode to .gitignore. (#6907)
  • Additional commits viewable in compare view

Dependabot compatibility score

Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting @dependabot rebase.


Dependabot commands and options

You can trigger Dependabot actions by commenting on this PR:

  • @dependabot rebase will rebase this PR
  • @dependabot recreate will recreate this PR, overwriting any edits that have been made to it
  • @dependabot merge will merge this PR after your CI passes on it
  • @dependabot squash and merge will squash and merge this PR after your CI passes on it
  • @dependabot cancel merge will cancel a previously requested merge and block automerging
  • @dependabot reopen will reopen this PR if it is closed
  • @dependabot close will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually
  • @dependabot show <dependency name> ignore conditions will show all of the ignore conditions of the specified dependency
  • @dependabot ignore this major version will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself)
  • @dependabot ignore this minor version will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself)
  • @dependabot ignore this dependency will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)
    You can disable automated security fix PRs for this repo from the Security Alerts page.

Bumps [scrapy](https://github.com/scrapy/scrapy) from 2.6.2 to 2.13.3.
- [Release notes](https://github.com/scrapy/scrapy/releases)
- [Changelog](https://github.com/scrapy/scrapy/blob/master/docs/news.rst)
- [Commits](scrapy/scrapy@2.6.2...2.13.3)

---
updated-dependencies:
- dependency-name: scrapy
  dependency-version: 2.13.3
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <[email protected]>
@dependabot dependabot bot added dependencies Pull requests that update a dependency file python Pull requests that update python code labels Nov 7, 2025
@github-actions
Copy link

github-actions bot commented Nov 7, 2025

Test Results

202 tests   200 ✅  1m 28s ⏱️
 16 suites    0 💤
 16 files      0 ❌  2 🔥

For more details on these errors, see this check.

Results for commit 34cfd22.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

dependencies Pull requests that update a dependency file python Pull requests that update python code

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant