Investigate poor s3 performance on gcp about icedb

[danthegoodman1]

Write performance is as expected

[danthegoodman1]

Cloud run 16GB 8vCPU

{
    "FilesMerged": 3,
    "PartitionsMerged": null,
    "PostMergeBytes": 348283,
    "RowsMerged": 981,
    "TimeMS": 2521
}

My laptop

{
  "FilesMerged": 3,
  "RowsMerged": 981,
  "PostMergeBytes": 348282,
  "TimeMS": 889,
  "PartitionsMerged": null
}

[danthegoodman1]

Seems like cloud run networking is just terrible to GCS

[danthegoodman1]

WELL THEN southamerica-east1

[danthegoodman1]

MUCH BETTER

{
    "FilesMerged": 3,
    "PartitionsMerged": null,
    "PostMergeBytes": 348304,
    "RowsMerged": 981,
    "TimeMS": 282
}

[danthegoodman1]

performance is still not amazing but it's acceptable

[danthegoodman1]

for reference

{
    "FilesMerged": 3,
    "PartitionsMerged": null,
    "PostMergeBytes": 75198664,
    "RowsMerged": 206010,
    "TimeMS": 19258
}

[danthegoodman1]

[danthegoodman1]

much of it is probably both the upload and all of the processing for the many columns