[Question] Fetch request url from redis fail about scrapy-redis

[GeorgeA92]

It looks like pull request #286 that fix this already exist from Aug.
This can be easily applied for app with current scrapy-redis version by.. overriding schedule_next_request method.

class SomeSpider(RedisSpider):
    ## vvv _add this to spider code
    def schedule_next_requests(self):
        """Schedules a request if available"""
        # TODO: While there is capacity, schedule a batch of redis requests.
        for req in self.next_requests():
            self.crawler.engine.crawl(req, spider=self)
            # see https://github.com/scrapy/scrapy/issues/5994
            if scrapy_version >= (2, 6):
                self.crawler.engine.crawl(req)
            else:
                self.crawler.engine.crawl(req, spider=self)

[gc1423]

Passing a spider argument to the crawl() methods of scrapy.core.engine.ExecutionEngine is no longer supported in scrapy v2.10.0. release notes

Try scrapy 2.9.0.

[xuexingdong]

hope the fixed version quickly release

[Shleif91]

Same error... Found a solution?

[jordinl]

@rmax would it be possible to release a fix for this? I'm also encountering this issue