baldnate / src-pbs-to-csv

Export your PBs from SRC to a handy offline csv file.

src-pbs-to-csv

Export your PBs from SRC to a handy offline csv file.

If it is missing a column you'd expect, let me know.

How to Run

Run this: python src-pbs-to-csv.py <your username> <csv output file name>

If it complains about missing dependencies, run this to install them: pip install -r requirements.txt

If it complains about missing python, install python.

src-pbs-to-csv's Issues

TypeError: argument of type 'NoneType' is not iterable

D:\Downloads\src-pbs-to-csv-main\src-pbs-to-csv-main>python src-pbs-to-csv.py doicm output.csv
Traceback (most recent call last):
  File "D:\Downloads\src-pbs-to-csv-main\src-pbs-to-csv-main\src-pbs-to-csv.py", line 102, in <module>
    runsdf['video'] = rawdf.apply(lambda x: getVideo(x['videos']), axis=1)
  File "C:\Users\User\AppData\Local\Packages\PythonSoftwareFoundation.Python.3.9_qbz5n2kfra8p0\LocalCache\local-packages\Python39\site-packages\pandas\core\frame.py", line 8740, in apply
    return op.apply()
  File "C:\Users\User\AppData\Local\Packages\PythonSoftwareFoundation.Python.3.9_qbz5n2kfra8p0\LocalCache\local-packages\Python39\site-packages\pandas\core\apply.py", line 688, in apply
    return self.apply_standard()
  File "C:\Users\User\AppData\Local\Packages\PythonSoftwareFoundation.Python.3.9_qbz5n2kfra8p0\LocalCache\local-packages\Python39\site-packages\pandas\core\apply.py", line 812, in apply_standard
    results, res_index = self.apply_series_generator()
  File "C:\Users\User\AppData\Local\Packages\PythonSoftwareFoundation.Python.3.9_qbz5n2kfra8p0\LocalCache\local-packages\Python39\site-packages\pandas\core\apply.py", line 828, in apply_series_generator
    results[i] = self.f(v)
  File "D:\Downloads\src-pbs-to-csv-main\src-pbs-to-csv-main\src-pbs-to-csv.py", line 102, in <lambda>
    runsdf['video'] = rawdf.apply(lambda x: getVideo(x['videos']), axis=1)
  File "D:\Downloads\src-pbs-to-csv-main\src-pbs-to-csv-main\src-pbs-to-csv.py", line 75, in getVideo
    if 'links' in x and len(x['links']) > 0:
TypeError: argument of type 'NoneType' is not iterable

I'm guessing that if no video is attached to the record, then the pull fails?

'NoneType' object is not subscriptable

Traceback (most recent call last):
  File "src-pbs-to-csv.py", line 131, in <module>
    runsdf['video'] = rawdf.apply(lambda x: getVideo(x['videos']), axis=1)
  File "C:\Users\User\AppData\Local\Programs\Python\Python37-32\lib\site-packages\pandas\core\frame.py", line 8740, in apply
    return op.apply()
  File "C:\Users\User\AppData\Local\Programs\Python\Python37-32\lib\site-packages\pandas\core\apply.py", line 688, in apply
    return self.apply_standard()
  File "C:\Users\User\AppData\Local\Programs\Python\Python37-32\lib\site-packages\pandas\core\apply.py", line 812, in apply_standard
    results, res_index = self.apply_series_generator()
  File "C:\Users\User\AppData\Local\Programs\Python\Python37-32\lib\site-packages\pandas\core\apply.py", line 828, in apply_series_generator
    results[i] = self.f(v)
  File "src-pbs-to-csv.py", line 131, in <lambda>
    runsdf['video'] = rawdf.apply(lambda x: getVideo(x['videos']), axis=1)
  File "src-pbs-to-csv.py", line 104, in getVideo
    vids = [y['uri'] for y in x['links']]
TypeError: 'NoneType' object is not subscriptable

Seems very similar to an earlier issue, but it seems to be a different thing going wrong?

Other player for coop

Would it be possible to scrape the players for co-op runs?

Overwritten run vod link

seems that if the src run has a link in the description, in my case it was a twitch clip, it'll overwrite the vod link with the description link. i manually changed it myself afterwards since it only affected one or two but i'd imagine it'd be quite bad for anyone with a lot of runs in this situation.

Searching for username returning more than 1 result

PS D:\New folder\src-pbs-to-csv-main> python src-pbs-to-csv.py Wolfheart output.csv
Traceback (most recent call last):
  File "src-pbs-to-csv.py", line 69, in <module>
    userid = getUserId(username)
  File "src-pbs-to-csv.py", line 13, in getUserId
    raise Exception('Searched for ' + username + ', got back ' + str(len(data)) + ' entries (expected 1)')
Exception: Searched for Wolfheart, got back 7 entries (expected 1)

Apparently when I check my user out for exporting it's not returning the name properly. Should properly hit https://www.speedrun.com/user/Wolfheart correctly.