Skip to content

A retry policy question. #943

@matecsaj

Description

@matecsaj

When a URL request fails, is the retry count for it always decremented?

I can think of a few cases where the URL is not the problem:

  • A bad proxy.
  • Target server overload.
  • Transient resource exhaustion on the local machine.

Could you clarify how Crawlee handles these situations?

Metadata

Metadata

Assignees

No one assigned

    Labels

    t-toolingIssues with this label are in the ownership of the tooling team.

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions