utahplt / gtp-benchmarks Goto Github PK

View Code? Open in Web Editor NEW

4.0 4.0 10.0 15.15 MB

Gradual Typing Performance benchmarks

License: Other

Racket 99.89% TeX 0.11%

gtp-benchmarks's People

Contributors

Stargazers

Watchers

Forkers

llazarek gradual-typing tuesday0928 bennn ndh4

gtp-benchmarks's Issues

add gtp logo

Add the GTP logos to the docs here. No sense using them only for the grant website.

https://github.com/nuprl/gtp

PillWars

possible benchmark: https://github.com/mfelleisen/PillWars

TWC more tech{}s

Add @tech{} around every use of TWC.

Just now I jumped to a section that used the acronym, and wasn't sure myself where the explanation would be.

rebuild for 7.0 etc

The tables in the documentation might change between Racket versions.

It should be (made) easy to:

get a new release
get a count-chaperones version of the release
rebuild the caches for the docs

report all boundary types in docs

The docs section on boundary types seems to show data only for the first require/typed/check in a module. Show them all!

take5: remove `module+ main`

Remove module+ main

No other benchmarks use it, and it makes profilers harder to run (raco profile, raco contract-profile)

JPEG types for bytevectors-6

The JPEG benchmark includes a require/typed/provide for rnrs/bytevectors-6

https://github.com/bennn/gtp-benchmarks/blob/master/benchmarks/jpeg/base/bytevectors-6-typed.rkt

Should these types ship with TR? Or go in a package?

pkg-build fail 2024-02-07

https://pkg-build.racket-lang.org/server/built/fail/gtp-benchmarks.txt

why?!

The time is now Wednesday, February 7th, 2024 2:05:36pm
(/usr/bin/env DISPLAY=:1 PLT_PKG_BUILD_SERVICE=1 PLTUSERHOME=/home/root//user PLT_PKG_BUILD_SERVICE=1 CI=true PLTSTDERR=debug@pkg error PLT_INFO_ALLOW_VARS=;PLT_PKG_BUILD_SERVICE PLTCOMPILEDROOTS=/home/root//zo: /usr/bin/xvfb-run -n 1 /bin/sh -c cd "/home/root/"/racket && bin/racket -MCR "/home/root/"/zo: -l- raco pkg install --jobs 4 -u --auto pyffi)
Resolved "pyffi" via file:///home/root//catalogs/archive/catalog
pkg: catalog response: #hash((author . "[email protected]") (checksum . "55109297065e51b9832d9acb62fe9aab6b7e60ba") (dependencies . ()) (description . "Use Python from Racket.") (modules . ((lib "pyffi/pyffi-tests/tests/test-dict.rkt") (lib "pyffi/pyffi-tests/tests/test-signature.rkt") (lib "pyffi/pyffi-lib/pyffi/libpython.rkt") (lib "pyffi/pyffi-lib/pyffi/python-generator.rkt") (lib "pyffi/pyffi-lib/pyffi/python-more-builtins.rkt") (lib "pyffi/pyffi-lib/pyffi/structs.rkt") (lib "pyffi/pyffi-lib/pyffi/numpy-core.rkt") (lib "pyffi/pyffi-tests/tests/test-has-module.rkt") (lib "pyffi/pyffi-tests/tests/test-special.rkt") (lib "pyffi/pyffi-tutorials/test-pillow.rkt") (lib "pyffi/pyffi-lib/pyffi/python-builtins.rkt") (lib "pyffi/pyffi-tests/tests/test-attributes.rkt") (lib "pyffi/pyffi-lib/pyffi/python-list.rkt") (lib "pyffi/pyffi-tests/tests/test-string.rkt") (lib "pyffi/pyffi-tests/tests/test-slice.rkt") (lib "pyffi/pyffi-lib/pyffi/python-constants.rkt") (lib "pyffi/pyffi-lib/pyffi/python-initialization.rkt") (lib "pyffi/pyffi-lib/pyffi/python-object.rkt") (lib "pyffi/pyffi-lib/pyffi/python-bytes.rkt") (lib "pyffi/pyffi-lib/pyffi/parameters.rkt") (lib "pyffi/pyffi-lib/pyffi/main.rkt") (lib "pyffi/pyffi-tutorials/tutorial-pygments.rkt") (lib "pyffi/pyffi-lib/pyffi/python-import.rkt") (lib "pyffi/pyffi-tutorials/tutorial-skia.rkt") (lib "pyffi/pyffi/main.rkt") (lib "pyffi/pyffi-tests/tests/test-builtins.rkt") (lib "pyffi/pyffi-lib/pyffi/python-slice.rkt") (lib "pyffi/pyffi-lib/pyffi/numpy.rkt") (lib "pyffi/pyffi-lib/pyffi/python-operators.rkt") (lib "pyffi/pyffi-tests/tests/test-python-c-api.rkt") (lib "pyffi/pyffi-lib/pyffi/python-c-api.rkt") (lib "pyffi/pyffi-lib/pyffi/configure-pyffi.rkt") (lib "pyffi/pyffi-tutorials/pygments/sxml-renderer.rkt") (lib "pyffi/pyffi-tutorials/pygments/test-scribble-with-pygments.rkt") (lib "pyffi/pyffi-tests/tests/test-function.rkt") (lib "pyffi/pyffi-tests/tests/test-numpy-misc.rkt") (lib "pyffi/pyffi-tests/tests/test-numpy-game-of-life.rkt") (lib "pyffi/pyffi-tests/tests/test-numpy.rkt") (lib "pyffi/pyffi-lib/pyffi/python-define-delayed.rkt") (lib "pyffi/pyffi-tests/tests/test-generator.rkt") (lib "pyffi/pyffi-lib/pyffi/python.rkt") (lib "pyffi/pyffi-tutorials/tutorial-mix-racket-and-python.rkt") (lib "pyffi/pyffi-lib/pyffi/python-types.rkt") (lib "pyffi/pyffi-lib/pyffi/python-module.rkt") (lib "pyffi/pyffi-lib/pyffi/prefix-in.rkt") (lib "pyffi/pyffi-lib/pyffi/python-functions.rkt") (lib "pyffi/pyffi-tutorials/example-pygame-bouncing-ball.rkt") (lib "pyffi/pyffi-tests/tests/test-pyautogui.rkt") (lib "pyffi/pyffi-lib/pyffi/python-class.rkt") (lib "pyffi/pyffi-tests/tests/test-reference-counting.rkt") (lib "pyffi/pyffi-tests/tests/test-write-and-display.rkt") (lib "pyffi/pyffi-tests/tests/test-auto-numpy.rkt") (lib "pyffi/pyffi-tests/tests/test-exn.rkt") (lib "pyffi/pyffi-lib/pyffi/python-attributes.rkt") (lib "pyffi/pyffi-lib/pyffi/python-delayed.rkt") (lib "pyffi/pyffi-tests/tests/test-app.rkt") (lib "pyffi/pyffi-tests/tests/test-module.rkt") (lib "pyffi/pyffi-tests/tests/test-special2.rkt") (lib "pyffi/pyffi-tutorials/test-numpy.rkt") (lib "pyffi/pyffi-tutorials/tutorial-numpy-fish-market.rkt") (lib "pyffi/pyffi-lib/pyffi/python-string.rkt") (lib "pyffi/pyffi-tests/tests/test-exceptions.rkt") (lib "pyffi/pyffi-doc/pyffi/scribblings/manual-pyffi.scrbl") (lib "pyffi/pyffi-lib/pyffi/python-evaluation.rkt") (lib "pyffi/pyffi-lib/pyffi/python-environment.rkt") (lib "pyffi/pyffi-lib/pyffi/python-tuple.rkt") (lib "pyffi/pyffi-lib/pyffi/python-dict.rkt") (lib "pyffi/pyffi-tests/tests/test-list.rkt"))) (name . "pyffi") (ring . 1) (source . "file:///home/root/catalogs/archive/pkgs/pyffi.zip") (tags . ("ffi" "python")))
00: Resolved "pyffi-doc" via file:///home/root//catalogs/archive/catalog
Resolved "pyffi-lib" via file:///home/root//catalogs/archive/catalog
pkg: catalog response: #hash((author . "[email protected]") (checksum . "b675f8e4a2fa08fd66f4fd4fee6efd25ca77ba55") (dependencies . (("scribble-lib") ("pyffi-lib") ("base") ("sandbox-lib") ("gui-doc") ("pict-doc") ("at-exp-lib") ("base") ("pict-lib") ("scribble-lib") ("racket-doc") ("pyffi-lib") ("rackunit-lib"))) (description . "Use Python from Racket.") (modules . ((lib "pyffi/scribblings/manual-pyffi.scrbl"))) (name . "pyffi-doc") (ring . 1) (source . "file:///home/root/catalogs/archive/pkgs/pyffi-doc.zip") (tags . ("ffi" "python")))
pkg: catalog response: #hash((author . "[email protected]") (checksum . "150dd98ab5e21df899991b903e3bd81829e4d4db") (dependencies . (("base") ("at-exp-lib") ("base") ("at-exp-lib"))) (description . "Use Python from Racket.") (modules . ((lib "pyffi/python-import.rkt") (lib "pyffi/numpy-core.rkt") (lib "pyffi/python-c-api.rkt") (lib "pyffi/python-environment.rkt") (lib "pyffi/prefix-in.rkt") (lib "pyffi/python-attributes.rkt") (lib "pyffi/python-generator.rkt") (lib "pyffi/python-dict.rkt") (lib "pyffi/python-builtins.rkt") (lib "pyffi/python-list.rkt") (lib "pyffi/python-tuple.rkt") (lib "pyffi/parameters.rkt") (lib "pyffi/main.rkt") (lib "pyffi/python-bytes.rkt") (lib "pyffi/libpython.rkt") (lib "pyffi/python-module.rkt") (lib "pyffi/python.rkt") (lib "pyffi/structs.rkt") (lib "pyffi/python-slice.rkt") (lib "pyffi/python-constants.rkt") (lib "pyffi/python-functions.rkt") (lib "pyffi/python-evaluation.rkt") (lib "pyffi/python-initialization.rkt") (lib "pyffi/python-string.rkt") (lib "pyffi/python-more-builtins.rkt") (lib "pyffi/python-types.rkt") (lib "pyffi/python-delayed.rkt") (lib "pyffi/numpy.rkt") (lib "pyffi/python-object.rkt") (lib "pyffi/python-define-delayed.rkt") (lib "pyffi/python-operators.rkt") (lib "pyffi/python-class.rkt") (lib "pyffi/configure-pyffi.rkt"))) (name . "pyffi-lib") (ring . 1) (source . "file:///home/root/catalogs/archive/pkgs/pyffi-lib.zip") (tags . ("ffi" "python")))
pkg: creating link to #<path:/home/root//user/.local/share/racket/8.12/pkgs/pyffi-doc>
pkg: updating db with "pyffi-doc" to '#s(pkg-info (catalog "pyffi-doc") "b675f8e4a2fa08fd66f4fd4fee6efd25ca77ba55" #t)
pkg: creating link to #<path:/home/root//user/.local/share/racket/8.12/pkgs/pyffi-lib>
pkg: updating db with "pyffi-lib" to '#s(pkg-info (catalog "pyffi-lib") "150dd98ab5e21df899991b903e3bd81829e4d4db" #t)
pkg: creating link to #<path:/home/root//user/.local/share/racket/8.12/pkgs/pyffi>
pkg: updating db with "pyffi" to '#s(pkg-info (catalog "pyffi") "55109297065e51b9832d9acb62fe9aab6b7e60ba" #f)
The following uninstalled packages were listed as dependencies
and they were automatically installed:
 dependencies of pyffi:
   pyffi-doc
   pyffi-lib
   pyffi-doc
raco setup: version: 8.12
raco setup: platform: x86_64-linux-natipkg [cs]
raco setup: target machine: any
raco setup: cross-installation: yes
raco setup: installation name: 8.12
raco setup: variants: cs
raco setup: main collects: /home/root/racket/collects/
raco setup: collects paths: 
raco setup:   /home/root/user/.local/share/racket/8.12/collects
raco setup:   /home/root/racket/collects/
raco setup: main pkgs: /home/root/racket/share/pkgs
raco setup: pkgs paths: 
raco setup:   /home/root/racket/share/pkgs
raco setup:   /home/root//user/.local/share/racket/8.12/pkgs
raco setup: links files: 
raco setup:   /home/root/racket/share/links.rktd
raco setup:   /home/root//user/.local/share/racket/8.12/links.rktd
raco setup: compiled-file roots: 
raco setup:   /home/root//zo
raco setup:   same
raco setup: main docs: /home/root/racket/doc
raco setup: --- updating info-domain tables ---                    [19:05:37]
raco setup: updating: /home/root/user/.local/share/racket/8.12/share/info-cache.rktd
raco setup: --- pre-installing collections ---                     [19:05:37]
raco setup: --- installing foreign libraries ---                   [19:05:37]
raco setup: --- installing shared files ---                        [19:05:37]
raco setup: --- compiling collections ---                          [19:05:37]
raco setup: --- parallel build using 4 jobs ---                    [19:05:37]
raco setup: 3 making: <pkgs>/pyffi-doc/pyffi
raco setup: 2 making: <pkgs>/pyffi-lib/pyffi
raco setup: 3 making: <pkgs>/pyffi-doc/pyffi/scribblings
ffi-lib: could not load foreign library
  path: libpython3.10.so
  system error: libpython3.10.so: cannot open shared object file: No such file or directory
  context...:
   /home/root/racket/collects/ffi/unsafe.rkt:134:0: get-ffi-lib
   body of "/home/root/user/.local/share/racket/8.12/pkgs/pyffi-lib/pyffi/libpython.rkt"
   /home/root/racket/collects/compiler/private/cm-minimal.rkt:696:0: compile-zo*
   /home/root/racket/collects/compiler/private/cm-minimal.rkt:637:0: compile-zo*/cross-compile
   /home/root/racket/collects/compiler/private/cm-minimal.rkt:452:15
   /home/root/racket/collects/compiler/private/cm-minimal.rkt:441:12: build
   /home/root/racket/collects/compiler/private/cm-minimal.rkt:412:0: maybe-compile-zo
   /home/root/racket/collects/compiler/private/cm-minimal.rkt:210:0: compile-root
   /home/root/racket/collects/compiler/private/cm-minimal.rkt:145:4: compilation-manager-load-handler
   /home/root/racket/collects/compiler/private/cm-minimal.rkt:696:0: compile-zo*
   /home/root/racket/collects/compiler/private/cm-minimal.rkt:637:0: compile-zo*/cross-compile
   /home/root/racket/collects/compiler/private/cm-minimal.rkt:452:15
   /home/root/racket/collects/compiler/private/cm-minimal.rkt:441:12: build
   /home/root/racket/collects/compiler/private/cm-minimal.rkt:412:0: maybe-compile-zo
   /home/root/racket/collects/compiler/private/cm-minimal.rkt:210:0: compile-root
   /home/root/racket/collects/compiler/private/cm-minimal.rkt:145:4: compilation-manager-load-handler
   ...
ffi-lib: could not load foreign library
  path: libpython3.10.so
  system error: libpython3.10.so: cannot open shared object file: No such file or directory
  context...:
   /home/root/racket/collects/ffi/unsafe.rkt:134:0: get-ffi-lib
   body of "/home/root/user/.local/share/racket/8.12/pkgs/pyffi-lib/pyffi/libpython.rkt"
   /home/root/racket/collects/compiler/private/cm-minimal.rkt:696:0: compile-zo*
   /home/root/racket/collects/compiler/private/cm-minimal.rkt:637:0: compile-zo*/cross-compile
   /home/root/racket/collects/compiler/private/cm-minimal.rkt:452:15
   /home/root/racket/collects/compiler/private/cm-minimal.rkt:441:12: build
   /home/root/racket/collects/compiler/private/cm-minimal.rkt:412:0: maybe-compile-zo
   /home/root/racket/collects/compiler/private/cm-minimal.rkt:210:0: compile-root
   /home/root/racket/collects/compiler/private/cm-minimal.rkt:105:4
   /home/root/racket/collects/setup/parallel-build.rkt:332:9
   /home/root/racket/collects/setup/parallel-do.rkt:465:25
   /home/root/racket/collects/setup/parallel-do.rkt:451:20: loop
raco setup: --- creating launchers ---                             [19:05:44]
raco setup: --- installing man pages ---                           [19:05:44]
raco setup: --- building documentation ---                         [19:05:44]
raco setup: 3 running: <pkgs>/racket-index/scribblings/main/user/local-redirect.scrbl
raco setup: 1 running: <pkgs>/pyffi-doc/pyffi/scribblings/manual-pyffi.scrbl
raco setup: 0 running: <pkgs>/racket-index/scribblings/main/user/release.scrbl
raco setup: 3 running: <pkgs>/racket-index/scribblings/main/user/search.scrbl
ffi-lib: could not load foreign library
  path: libpython3.10.so
  system error: libpython3.10.so: cannot open shared object file: No such file or directory
  context...:
   /home/root/racket/collects/ffi/unsafe.rkt:134:0: get-ffi-lib
   body of "/home/root/user/.local/share/racket/8.12/pkgs/pyffi-lib/pyffi/libpython.rkt"
   /home/root/racket/share/pkgs/racket-index/setup/scribble.rkt:1567:27

  context...:
   /home/root/racket/collects/setup/parallel-do.rkt:342:4: work-done method in list-queue%
   /home/root/racket/collects/setup/parallel-do.rkt:292:17
   /home/root/racket/collects/setup/parallel-do.rkt:246:4
   /home/root/racket/share/pkgs/racket-index/setup/scribble.rkt:139:0: setup-scribblings
   /home/root/racket/collects/setup/setup.rkt:78:3
   /home/root/racket/collects/pkg/main.rkt:18:0: setup
   body of (submod "/home/root/racket/collects/pkg/main.rkt" main)
   /home/root/racket/collects/raco/raco.rkt:41:0
   body of "/home/root/racket/collects/raco/raco.rkt"
   body of "/home/root/racket/collects/raco/main.rkt"
raco setup: 1 running: <pkgs>/racket-index/scribblings/main/user/start.scrbl
raco setup: 3 rendering: <pkgs>/racket-index/scribblings/main/user/local-redirect.scrbl
raco setup: 2 rendering: <pkgs>/racket-index/scribblings/main/user/release.scrbl
raco setup: 1 rendering: <pkgs>/racket-index/scribblings/main/user/search.scrbl
raco setup: 0 rendering: <pkgs>/racket-index/scribblings/main/user/start.scrbl
raco setup: --- installing collections ---                         [19:05:51]
raco setup: --- post-installing collections ---                    [19:05:51]
raco setup: --- summary of errors ---                              [19:05:51]
raco setup: error: during making for <pkgs>/pyffi-lib/pyffi
raco setup:   ffi-lib: could not load foreign library
raco setup:     path: libpython3.10.so
raco setup:     system error: libpython3.10.so: cannot open shared object file: No such file or directory
raco setup: error: during making for <pkgs>/pyffi-doc/pyffi
raco setup:   ffi-lib: could not load foreign library
raco setup:     path: libpython3.10.so
raco setup:     system error: libpython3.10.so: cannot open shared object file: No such file or directory
raco setup: error: during building docs for <pkgs>/pyffi-doc/pyffi/scribblings/manual-pyffi.scrbl
raco setup:   ffi-lib: could not load foreign library
raco setup:     path: libpython3.10.so
raco setup:     system error: libpython3.10.so: cannot open shared object file: No such file or directory
raco setup:     context...:
raco setup:      /home/root/racket/collects/ffi/unsafe.rkt:134:0: get-ffi-lib
raco setup:      body of "/home/root/user/.local/share/racket/8.12/pkgs/pyffi-lib/pyffi/libpython.rkt"
raco setup:      /home/root/racket/share/pkgs/racket-index/setup/scribble.rkt:1567:27
raco setup:   
racket pkg install: packages installed, although setup reported errors
The time is now Wednesday, February 7th, 2024 2:05:51pm

lnm typed/untyped difference

@LLazarek found a diff between the typed and untyped lnm code:

lnm modulegraph.rkt: ensure-tikz returns port in untyped but void in typed

Please change untyped to return void and create a new release.

Qs about chaperones tables

Rebuild the chaperone tables: proc struct and vec (#12 )

Then answer these questions:

Why is struct makes = 38 in so many benchmarks? Is that the "zero" here? (morsecode, sieve, synth, tetris)
How can depth ever be 0? Does 0 mean 1 and all values should be +1'd?
What are the 150 proc makes in morsecode, how so many?
Are the old numbers post-collapsible and if so why so high: fsm = 2k vec depth, synth = 15 vec depth, forth = 42 proc depth, zombie = 749 proc depth
Why are the fsmoo numbers so low? Isn't depth an issue there?

lnm: plot with contracts

Does lnm depend on the plot library, and does the plot library use typed/racket/no-check?

If so, how about changing lnm to use normal typed racket?

That'd be much more interesting for gradual typing performance.

remove sandbox

acquire depends on racket/sandbox for a call-with-limits. Thats slow! It affects all configurations --- maybe so much that it overshadows the cost of types.

Remove the sandboxes or explain why they have to stay.

Make a new benchmark version.

for/array for/array:

Turns out, for/array is for untyped code and for/array: is for typed code. The difference matters (example needed ... discovered while working with Transient).

are there other math functions like this, with typed & untyped versions?
update the benchmarks to use the right functions

doc: show adaptors in modulegraph

Find a way to represent adaptor modules in the graphs.

To do this, we'll need a map from module to adaptor. (Will need that anyway for other experiments.)

One idea is different arrowheads:

new version for zordoz

@camoy found a bug in zordoz, see #15

Need to:

merge that PR
rerun versions 6.2 6.3 and 6.4 to check the JFP results (also check the collapsible results)
create new version, add history note to the docs
fix the gtp-checkup package (bennn/gtp-checkup@ba71c68)

take5: ignoring players

Is take5 ignoring client players and using its own base players? It should not ignore clients.

quick summary table

At the top of the docs, count the total # of benchmarks and list their names.

Better gtp-measure instructions in README

Add a sample manifest file that works "out of the box".

Add a document / table / folder that describes these programs in useful ways. The descriptions should be auto-generated (maybe by a tool in another repo? but not if the tool is really specialized to the format here).

problem size
lines of code, type annotation lines of code
boundary types, their contracts
module dependence graph
flow-of-values graph

EDIT: before merging, double-check module graphs --- might be an issue with gregor

TWC without optimizer

Make TR stop optimizing contracts
Rerun all the TWC configurations, to get the full cost of contracts

high-rank boundaries

Our rational programmer experiment for deep/shallow has some GREAT info that should be part of the docs.
(All hidden in a private repo for now.)

add a boundary-profile script (modified ctc-profile)
add a bnd-prf runner, for every point in the lattice
rank IDs from the proflie; for each ID how often does it appear in any profile? what ID takes the most time?
(optional) print top boundaries ... this is hard because the benchmarks need modification to avoid blaming the adaptor for everything

For example, take5 sends lots of IDs across boundaries but only a handful ever show up in the boundary profile:

--face
>-face
card3
configuration
create-card-pool
create-dealer
create-deck
create-player
player%

pull benchmark from olde RacketCons?

Are there benchmarks to be had from either Marc Burns or Rodrigo Setti's RacketCon codebases?

Marc's would be using OO types. Rodrigo's is the stamps library ... and may not have types.

Replace quadMB

In the beginning, Matthew Butterick sent us two programs:

an untyped quad
a typed quad

The quadMB benchmark mixes these two programs.

The quadBG benchmark is more systematic --- it starts from the untyped quad and adds types with minimal changes to the code.

Please remove quadMB and add a version that removes types from the typed quad with minimal changes to the code.

Duplicate type annotation, often quadT not always!

Running quadT on cloudlab we've seen LOTS of intermittent errors.

Example below.

Out of 4.7 million configs, 1.5 thousand had errors like this.

Rerunning the 1.5 thousand led to 1 error. The rest succeeded.

The final one succeeded with one more rerun.

("20000200202122" ("hyphenate.rkt:5132:5: Type Checker: Duplicate type annotation of (-> (Listof Index) (Listof Integer)) for add-no-hyphen-zone, previous was (-> (Listof Index) (Listof Integer))
in: add-no-hyphen-zone
compilation context...:
 /users/ben_g/rds-cloudlab/output/1/0-run-info.rkt/17-quadT/configuration/hyphenate.rkt
 /users/ben_g/rds-cloudlab/output/1/0-run-info.rkt/17-quadT/configuration/utils.rkt
 /users/ben_g/rds-cloudlab/output/1/0-run-info.rkt/17-quadT/configuration/wrap.rkt
 /users/ben_g/rds-cloudlab/output/1/0-run-info.rkt/17-quadT/configuration/quad-main.rkt
 /users/ben_g/rds-cloudlab/output/1/0-run-info.rkt/17-quadT/configuration/main.rkt
location...:
 hyphenate.rkt:5132:5
context...:
 /users/ben_g/rds-cloudlab/typed-racket/typed-racket-lib/typed-racket/typecheck/tc-toplevel.rkt:481:0: type-check
 /users/ben_g/rds-cloudlab/typed-racket/typed-racket-lib/typed-racket/typecheck/tc-toplevel.rkt:711:0: tc-module
 /users/ben_g/rds-cloudlab/typed-racket/typed-racket-lib/typed-racket/tc-setup.rkt:115:12
 /users/ben_g/rds-cloudlab/typed-racket/typed-racket-lib/typed-racket/typed-racket.rkt:22:4
 /users/ben_g/rds-cloudlab/racket-8.6.0.2/collects/compiler/private/cm-minimal.rkt:685:0: compile-zo*
 /users/ben_g/rds-cloudlab/racket-8.6.0.2/collects/compiler/private/cm-minimal.rkt:451:15
 /users/ben_g/rds-cloudlab/racket-8.6.0.2/collects/compiler/private/cm-minimal.rkt:440:12: build
 /users/ben_g/rds-cloudlab/racket-8.6.0.2/collects/compiler/private/cm-minimal.rkt:411:0: maybe-compile-zo
 /users/ben_g/rds-cloudlab/racket-8.6.0.2/collects/compiler/private/cm-minimal.rkt:209:0: compile-root
 /users/ben_g/rds-cloudlab/racket-8.6.0.2/collects/compiler/private/cm-minimal.rkt:145:4: compilation-manager-load-handler
 /users/ben_g/rds-cloudlab/require-typed-check/private/require-typed-check.rkt:43:10
 /users/ben_g/rds-cloudlab/racket-8.6.0.2/collects/racket/private/more-scheme.rkt:377:2: hash-ref!
 /users/ben_g/rds-cloudlab/require-typed-check/private/require-typed-check.rkt:159:0
 /users/ben_g/rds-cloudlab/typed-racket/typed-racket-lib/typed-racket/tc-setup.rkt:71:0: tc-setup
 /users/ben_g/rds-cloudlab/typed-racket/typed-racket-lib/typed-racket/typed-racket.rkt:22:4
 /users/ben_g/rds-cloudlab/racket-8.6.0.2/collects/compiler/private/cm-minimal.rkt:685:0: compile-zo*
 ... "))

dual license

Switch from LGPL (old Racket) to MIT2/Apache (current Racket). Make sure to get permission from contributors.

Confirm docs build

Make sure the docs build successfully.

I think they won't because the cache will be considered invalid (md5sum is a bad key?)

acquire: all players get kicked

Looks like the ordered strategy & random strategy in acquire both produce players that break the rules.

Find or make a strategy for acquire that can finish a game.

did the type for random change?

Check take5 on the latest typed racket.

Did the type for random change to cause a type error? Does that affect other benchmarks?

doc: report migration issues

Explain all the migration issues that we faced in developing these benchmarks:

remove polymorphism
add adaptor modules
move macros
combine small modules
parallelize casts + asserts
... ANY MORE?

There may be notes in the old nuprl/gradual-typing-performance repo

gregor : why is fully-typed slower?

Why is the fully-typed configuration slower than untyped?

Is this a bug to fix?

Or is it from casts?

define-struct unsoundness

Constructors from define-struct are not protected with contracts. This is a problem in suffixtree, and maybe other benchmarks.

TR issue: racket/typed-racket#601

Either fix the issue, or change the benchmarks to avoid define-struct. Thanks.

Explain `--bin` folder

Pycket runs Racket programs differently than via raco and racket

Add enough detail about the --bin flag so that people can realize they can make a fake bin folder with a fake raco and racket that extract the right command-line arguments and start pycket

zordoz: error running Shallow

Trouble with modern TR and zordoz's base libraries:

$ racket --version
Welcome to Racket v8.8.0.7 [cs].
$ cd zordoz/shallow
$ racket main.rkt
any-wrap/c: contract violation
  expected: acyclic value
  given: #0='#s((closure expr 0 form 0 zo 0) #s((lam expr 0 form 0 zo 0) #(for-loop #<path:/home/ben/code/blame-trail/rds/rational-deep-shallow/code/gtp-bench/zordoz/cfg/zo-find.rkt> 92 21 3289 129 #f) (preserves-marks single-result) 2 (val val) #f #() () #f 19 ...

Recommend Projects

React

A declarative, efficient, and flexible JavaScript library for building user interfaces.
Vue.js

🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
Typescript

TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
TensorFlow

An Open Source Machine Learning Framework for Everyone
Django

The Web framework for perfectionists with deadlines.
Laravel

A PHP framework for web artisans
D3

Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

javascript

JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
web

Some thing interesting about web. New door for the world.
server

A server is a program made to process requests and deliver data to clients.
Machine learning

Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Visualization

Some thing interesting about visualization, use data art
Game

Some thing interesting about game, make everyone happy.

Recommend Org

Facebook

We are working to build community through open source technology. NB: members must have two-factor auth.
Microsoft

Open source projects and samples from Microsoft.
Google

Google ❤️ Open Source for everyone.
Alibaba

Alibaba Open Source for everyone
D3

Data-Driven Documents codes.
Tencent

China tencent open source team.

Jobs

Jooble