no way to change default read_timeout value about s3fs

[martindurant]

Currently, the two timeouts are class attributes only. You could set them on the class:

s3fs.S3FileSystem.read_timeout = 3600

or on an instance

 s3 = s3fs.S3FileSystem(...)
 s3.read_timeout = 3600

It would be reasonable to accept these timeouts as keywords to __init__ or as keys in config_kwargs.

[Vslira]

Just mentioning if someone else has this problem: following martindurant's answer I could fix it, but only by changing the class attribute before instantiating a S3FileSystem object. Trying to set read_timeout = 3600 to an already created object didn't work

[kinzleb]

Also as I mention in the comments of the code I tried above, I also tried setting the read_timeout like follows but it resulted in a different error:

import s3fs
fs = s3fs.S3FileSystem(config_kwargs={'read_timeout':3600})

Error:

---------------------------------------------------------------------------
TypeError                                 Traceback (most recent call last)
<ipython-input-1-c9fe9ad1bb2a> in <module>()
      1 # show the files (requires credentials file for aws access)
      2 import s3fs
----> 3 fs = s3fs.S3FileSystem(config_kwargs={'read_timeout':3600})

~/notebook-env/lib/python3.6/site-packages/s3fs/core.py in __init__(self, anon, key, secret, token, use_ssl, client_kwargs, requester_pays, default_block_size, default_fill_cache, config_kwargs, s3_additional_kwargs, **kwargs)
    153         self.s3_additional_kwargs = s3_additional_kwargs or {}
    154         self.use_ssl = use_ssl
--> 155         self.s3 = self.connect()
    156         self._kwargs_helper = ParamKwargsHelper(self.s3)
    157         self._singleton[0] = self

~/notebook-env/lib/python3.6/site-packages/s3fs/core.py in connect(self, refresh)
    209                 conf = Config(connect_timeout=self.connect_timeout,
    210                               read_timeout=self.read_timeout,
--> 211                               **self.config_kwargs)
    212                 self.session = boto3.Session(self.key, self.secret, self.token,
    213                                              **self.kwargs)

TypeError: type object got multiple values for keyword argument 'read_timeout'

[kinzleb]

Oh gotcha, I didn't realize I could just set those using the class attributes. That will work for me, thanks for the time!

[Chrisjw42]

I have now ustilised the method above, but initially when looking at the docs, I had tried to pass these as keys in config_kwargs, but that actually throws an error. If you pass these, the boto3 client (I think) tried to set the value twice. It's not really an issue for me but I thought you might want to hear about it.