ocaml / camlp-streams

The Stream and Genlex libraries for use with Camlp4 and Camlp5

The Stream and Genlex libraries for use with Camlp4 and Camlp5

The camlp-streams package provides two library modules:

• Stream: imperative streams, with in-place update and memoization of the latest element produced.
• Genlex: a small parameterized lexical analyzer producing streams of tokens from streams of characters.

The two modules are designed for use with Camlp4 and Camlp5:

• The stream patterns and stream expressions of Camlp4/Camlp5 consume and produce data of type 'a Stream.t.
• The Genlex tokenizer can be used as a simple lexical analyzer for Camlp4/Camlp5-generated parsers.

The Stream module can also be used by hand-written recursive-descent parsers, but is not very convenient for this purpose.

The Stream and Genlex modules have been part of the OCaml standard library for a long time, and have been distributed as part of the core OCaml system. They will be removed from the OCaml standard library at some future point, but will be maintained and distributed separately in this camlp-streams package.

camlp-streams's Issues

Installation fails with `ar: no archive members specified`on MacOS with OCaml 4.04.2

We are hitting an installation failure in the omd CI when trying to install a package that depends on this one: https://github.com/ocaml/omd/runs/7490933831?check_suite_focus=true#step:4:4649

Seems like some other packages have hit his before, e.g.,: ocsigen/lwt#91

build results vary from parallelism

While working on reproducible builds for openSUSE, I found that
our ocaml-camlp-streams-5.0.1 package varied randomly unless we build with -j1 or with taskset 1 dune or in a 1-core-VM.
This indicates that a race-condition happens.

To reproduce:

cd ~/rpmbuild/BUILD/ocaml-camlp-streams-5.0.1/ && for i in $(seq 100); do rm -rf _build ; "dune" "build" "--verbose" "--for-release-of-packages=camlp-streams" "-j4" "@install" >/dev/null 2>&1 ; md5sum _build/default/.camlp_streams.objs/byte/genlex.cmti ; done |sort|uniq -c
     87 a5a708508e5844516c0252cbe4061dad  _build/default/.camlp_streams.objs/byte/genlex.cmti
     13 fcd764146f8d5cb31dccafdcf4dc77c1  _build/default/.camlp_streams.objs/byte/genlex.cmti

On another machine, I got a 99:1 distribution, so it might be tricky to reproduce.

stream.cmti is another output file that varies.

Please make build output deterministic.

Cannot link with Base on OCaml 4.06

On OCaml < 4.06 it seems not possible to link both ocamlp-streams and the stdlib's Stream modules at the same time. The stdlib's module can often be a transitive dependency, for example of base.

A small ocaml program that links to both this library and base:

let () = Stream.(empty (Stream.of_list (Base.List.join [])))

(executable
 (name test)
 (libraries base camlp-streams))

The error looks like this:

File "test.ml", line 1:
Error: The files /home/jules/.opam/4.06.1/lib/camlp-streams/stream.cmi
       and /home/jules/.opam/4.06.1/lib/base/base.cmi
       make inconsistent assumptions over interface Stream

This happens in odoc-parser: ocaml-doc/odoc-parser#6

empty documentation

https://ocaml.org/p/camlp-streams/latest/doc/index.html#camlp-streams shows empty documentation. I don't understand how ocaml.org/p/ is generated, but I would hazard the guess that the programming Dune file may be causing the absence of documentation. I would expect the documentation of the modules in src/ to be shown. Does some Dune wizard know how to get this?

(I came to this question from an end-user request at ocaml/ocaml#5211 (comment) )