Frequent ConnectionResetErrors and EOFErrors about tardis-python

[thaaddeus]

Hi, I'm not sure, is there a chance you could share code snippet that is causing this issue? Then I'd be able to investigate Thanks!

[shahp98]

Sorry for the delayed response:
Here's a snippet of the code:

async def replay(from_date: str, to_date: str):
    tardis_client = TardisClient(api_key="API KEY HERE", cache_dir="/data/backups/tardis-cache-dir", http_timeout=360)
    messages = tardis_client.replay(
        exchange="deribit",
        from_date=from_date,
        to_date=to_date,
        filters=[
            Channel(name="trades", symbols=[]),
            Channel(name="book", symbols=[]),
        ],
    )
# Some file operations happen here
    async for local_timestamp, message in messages:
        f.write(f"{int(local_timestamp.timestamp() * 10**9)}," + json.dumps(message).replace(' ', '') + '\n')
    f.close()

[thaaddeus]

Can you try replacing file operations with async versions, for example https://github.com/Tinche/aiofiles ? It could be that writing to files is blocking Python's event loop that is used under the hood to get the data for replay and that is causing connection errors (as CPU is busy writing to file so data from network is not read, causing connection reset).
Please also clear local .tardis-cache just in case.