CHANGES 19.7 KB
Newer Older
POTTIER Francois's avatar
POTTIER Francois committed
1 2 3
2017/03/24:
Changed Menhir's license from QPL to GPLv2. MenhirLib remains under LGPLv2.

4 5 6 7 8
2017/01/20:
Fix a bug where the module name "Basics" was shadowed (that is, if the user's
project happened to contain a toplevel module by this name, then it could not
be referred to from an .mly file). (Reported by François Thiré.)

POTTIER Francois's avatar
POTTIER Francois committed
9 10 11 12 13 14
2017/01/01:
Add $MENHIR_STDLIB as a way of controlling where Menhir looks for the file
standard.mly. This environment variable overrides the installation-time
default setting, and is itself overridden by the --stdlib command line
switch. (Requested by Jonathan Protzenko.)

15 16 17 18 19
2017/01/01:
Makefile fix: filter out '\r' in the output of menhir --suggest-ocamlfind,
so that the Makefile works when Menhir is compiled as a Windows executable.
(Suggested by Jonathan Protzenko.)

POTTIER Francois's avatar
POTTIER Francois committed
20 21 22 23
2016/12/01:
Updated the Coq back-end for compatibility with Coq 8.6.
(Jacques-Henri Jourdan.)

24 25 26 27
2016/11/15:
Fix in --only-preprocess-for-ocamlyacc mode: avoid printing newline characters
inside a %type declaration, as this is forbidden by ocamlyacc. (Reported by
Kenji Maillard.)
28 29
Fix in --only-preprocess-for-ocamlyacc mode: avoid variable capture caused by
ocamlyacc internally translating $i to _i. (Reported by Kenji Maillard.)
30

POTTIER Francois's avatar
POTTIER Francois committed
31
2016/09/01:
POTTIER Francois's avatar
POTTIER Francois committed
32 33 34 35
New command line switch --only-preprocess-for-ocamlyacc, supposed to print the
grammar in a form that ocamlyacc can accept. As of now, this feature is
incomplete (in particular, support for Menhir's position keywords is missing),
untested, and undocumented. It could be removed in the future.
POTTIER Francois's avatar
POTTIER Francois committed
36

37 38
2016/08/26:
Fixes in the output of --only-preprocess:
39 40 41 42
  The order of productions is now preserved.
    (It was not. This matters if there are reduce/reduce conflicts.)
  %parameter directives are now printed. (They were not).
  %on_error_reduce directives are now printed. (They were not.)
43

44 45 46 47 48
2016/08/25:
Makefile fix, undoing a change made on 2016/03/03, which caused installation
to fail under (some versions of?) Windows where dynamic linking is not
supported. (Reported by Andrew Appel.)

POTTIER Francois's avatar
POTTIER Francois committed
49 50 51 52 53 54
2016/08/05:
%on_error_reduce declarations now have implicit priority levels, so as to
tell Menhir what to do when two such declarations are applicable.
Also, the well-formedness checks on %type and %on_error_reduce declarations
have been reinforced.

55 56 57 58 59 60 61
2016/06/23:
A small change in the generated code (both in the code and table back-ends) so
as to avoid OCaml's warning 41. The warning would arise (when compiling a
generated parser with OCaml 4.03) because Menhir's exception [Error] has the
same name as the data constructor [Error] in OCaml's pervasive library.
(Reported by Bernhard Schommer.)

62 63
2016/05/18:
Anonymous rules now work also when used inside a parameterized rule.
64 65 66
(This did not work until now.) When an anonymous rule is hoisted out
of a parameterized rule, it may itself become parameterized. Menhir
parameterizes it only over the parameters that it actually needs.
67

POTTIER Francois's avatar
POTTIER Francois committed
68 69
2016/05/04:
In the Coq backend, split the largest definitions into smaller
POTTIER Francois's avatar
POTTIER Francois committed
70
ones. This circumvents a limitation of vm_compute on 32 bit
POTTIER Francois's avatar
POTTIER Francois committed
71
machines. This also enables us to perform sharing between
Jacques-Henri Jourdan's avatar
Jacques-Henri Jourdan committed
72 73
definitions, so that the generated files are much smaller.

POTTIER Francois's avatar
POTTIER Francois committed
74 75 76 77
2016/04/10:
When printing a grammar (which is done by the --only-preprocess options),
remove the leading bar '|', for compatibility with yacc and bison.

78 79 80 81 82 83
2016/03/11:
In the code back-end, generate type annotations when extracting a semantic
value out of the stack. When working with a semantic value of some function
type, OCaml would incorrectly warn that this function does not use its
argument. This warning should now be gone.

POTTIER Francois's avatar
POTTIER Francois committed
84 85 86 87
2016/03/03:
Makefile changes, so as to support ocamlbuild 4.03, which seems to have
stricter hygiene rules than previous versions.

88 89 90 91 92
2015/12/30:
Prevented an incorrect installation that would take place if USE_OCAMLFIND
was given during "make all" but not during "make install". Added a command
line directive --suggest-ocamlfind.

POTTIER Francois's avatar
POTTIER Francois committed
93 94 95 96 97
2015/11/11:
Fixed a severe bug in Menhir 20151110 which (when using the code back-end)
could cause a generated parser to crash. Thanks to ygrek for reporting the
bug.

98 99 100 101 102 103
2015/11/11:
The code produced by version XXXXXXXX of menhir --table can now be linked only
against a matching version of MenhirLib. If an incorrect version of MenhirLib
is installed, the OCaml compiler should complain that
[MenhirLib.StaticVersion.require_XXXXXXXX] is undefined.

POTTIER Francois's avatar
POTTIER Francois committed
104
2015/11/10:
POTTIER Francois's avatar
POTTIER Francois committed
105
Optimized the computation of $symbolstartpos, based on a couple of assumptions
POTTIER Francois's avatar
POTTIER Francois committed
106 107
about the lexer. (See the manual.)

POTTIER Francois's avatar
POTTIER Francois committed
108 109 110 111 112 113
2015/11/04:
Modified the treatment of %inline so that the positions that are computed are
the same, regardless of whether %inline is used. This property did not hold
until now. It now does. Of course, this means that the positions computed by
the new Menhir are not the same as those computed by older versions of Menhir.

POTTIER Francois's avatar
POTTIER Francois committed
114 115 116 117 118 119
2015/11/04:
Fixed a bug in the treatment of %inline that would lead to an incorrect
position being computed when the caller and callee had a variable by the
same name.

2015/11/04:
POTTIER Francois's avatar
POTTIER Francois committed
120 121 122
Modified Menhir so as to compute the start and end positions in the exact same
way as ocamlyacc. (There used to be a difference in the treatment of epsilon
productions.) Of course, this means that the positions computed by the new
POTTIER Francois's avatar
POTTIER Francois committed
123 124 125 126 127
Menhir are not the same as those computed by older versions of Menhir. Added
the keyword $symbolstartpos so as to simulate Parsing.symbol_start_pos()
in the ocamlyacc world. The keyword $startpos sometimes produces a position
that is too far off to the left; $symbolstartpos produces a more accurate
position.
POTTIER Francois's avatar
POTTIER Francois committed
128

129 130
2015/11/04:
Incompatible change of the incremental API: instead of a unit argument, the
POTTIER Francois's avatar
POTTIER Francois committed
131
entry points (which are named after the start symbols) now require an initial
132 133
position, which typically should be [lexbuf.lex_curr_p].

POTTIER Francois's avatar
POTTIER Francois committed
134
2015/11/03:
135
Fix-fix-and-re-fix the Makefile in an attempt to allow installation under
POTTIER Francois's avatar
POTTIER Francois committed
136
opam/Windows. Thanks to Daniel Weil for patient explanations and testing.
137

138 139 140 141 142 143 144
2015/10/29:
MenhirLib is now installed in both binary and source forms.
"menhir --suggest-menhirLib" reports where MenhirLib is installed.
This can be used to retrieve a snapshot of MenhirLib in source form
and include it in your project (if you wish to use --table mode, yet
do not wish to have a dependency on MenhirLib).

145
2015/10/26:
POTTIER Francois's avatar
POTTIER Francois committed
146 147 148
Allow --list-errors to work on 32-bit machines (with low hard limits).
This should fix a problem whereby the 2015/10/23 release could not
bootstrap on a 32-bit machine.
149

POTTIER Francois's avatar
POTTIER Francois committed
150 151 152 153 154 155 156 157 158 159 160
2015/10/23:
New declaration "%on_error_reduce foo", where foo is a nonterminal symbol.
This modifies the automaton as follows. In every state where a production of
the form "foo -> ..." is ready to be reduced, every error action is replaced
with a reduction of this production. (If there is a conflict between several
productions that could be reduced in this manner, nothing is done.) This does
not affect the language that is accepted by the automaton, but delays the
detection of an error: more reductions take place before the error is
detected.

2015/10/23:
161 162 163 164 165
Fixed a bug whereby Menhir would warn about a useless %prec declaration,
even though it was useful. This would happen when the declaration was
duplicated (by inlining or by macro-expansion) and some but not all of
the copies were useful.

POTTIER Francois's avatar
POTTIER Francois committed
166
2015/10/23:
167 168
Added [has_default_reduction] to the incremental API.

POTTIER Francois's avatar
POTTIER Francois committed
169
2015/10/23:
170
Modified the meaning of --canonical to allow default reductions to take
POTTIER Francois's avatar
POTTIER Francois committed
171
place. This implies no loss of precision in terms of lookahead sets,
172 173 174
and should allow gaining more contextual information when a syntax
error is encountered. (It should also lead to a smaller automaton.)

POTTIER Francois's avatar
POTTIER Francois committed
175 176 177
2015/10/23:
A brand new set of tools to work on syntax errors.
New command --list-errors, which produces a list of input sentences which
POTTIER Francois's avatar
POTTIER Francois committed
178
are representative of all possible syntax errors. (Costly.)
POTTIER Francois's avatar
POTTIER Francois committed
179
New command --interpret-error, which confirms that one particular input
POTTIER Francois's avatar
POTTIER Francois committed
180 181
sentence ends in a syntax error, and prints the number of the state in
which this error occurs.
POTTIER Francois's avatar
POTTIER Francois committed
182 183 184 185 186 187 188 189
New command --compile-errors, which compiles a list of erroneous sentences
(together with error messages) to OCaml code.
New command --compare-errors, which compares two lists of erroneous sentences
to check if they cover the same error states.
New command --update-errors, which updates the auto-generated comments in
a list of erroneous sentences.
New command --echo-errors, which removes all comments and messages from
a list of erroneous sentences, and echoes just the sentences.
POTTIER Francois's avatar
POTTIER Francois committed
190

POTTIER Francois's avatar
POTTIER Francois committed
191 192 193 194 195
2015/10/16:
Additions to the incremental API.
A [supplier] is a function that produces tokens on demand.
[lexer_lexbuf_to_supplier] turns a lexer and a lexbuf into a supplier.
[loop] is a ready-made made main parsing loop.
POTTIER Francois's avatar
POTTIER Francois committed
196 197 198
[loop_handle] is a variant that lets the user do her own error handling.
[loop_handle_undo] is a variant that additionally allows undoing the last
  few "spurious" reductions.
199
[number] maps a state of the LR(1) automaton to its number.
POTTIER Francois's avatar
POTTIER Francois committed
200

201 202 203 204 205
2015/10/16:
Incompatible change of the incremental API: renamed the type ['a result]
to ['a checkpoint]. This is a better name anyway, and should help avoid
confusion with the type ['a result] introduced in OCaml 4.03.

206 207 208
2015/10/12:
Avoid using $(shell pwd) in Makefile, for better Windows compatibility.

209 210 211 212
2015/10/05:
Fixed a bug where inconsistent OCaml code was generated when --table
and --external-tokens were used together. (Reported by Darin Morrison.)

213 214 215 216
2015/10/05:
In --infer mode, leave the .ml file around (instead of removing it) if
ocamlc fails, so we have a chance to understand what's wrong.

POTTIER Francois's avatar
POTTIER Francois committed
217 218 219 220
2015/09/21:
Re-established some error messages concerning the mis-use of $i which
had disappeared on 2015/06/29.

221 222 223 224 225 226
2015/09/11:
Fixed the mysterious message that would appear when a nonterminal symbol
begins with an uppercase letter and --infer is turned on. Clarified the
documentation to indicate that a (non-start) nonterminal symbol can begin
with an uppercase letter, but this is not recommended.

227 228 229 230 231 232 233
2015/08/27:
New option --inspection (added last January, documented only now). This
generates an inspection API which allows inspecting the automaton's stack,
among other things. This API can in principle be used to write custom code
for error reporting, error recovery, etc. It is not yet mature and may
change in the future.

234 235 236
2015/07/20:
Added the command line options --unused-token <symbol> and --unused-tokens.

Yann Régis-Gianas's avatar
Yann Régis-Gianas committed
237
2015/06/29:
238 239 240 241
Changed the treatment of the positional keywords $i. They are now
rewritten into variables of the form '_i' where 'i' is an integer.
Users are advised not to use variables of this form inside semantic
actions.
Yann Régis-Gianas's avatar
Yann Régis-Gianas committed
242

243 244 245 246 247 248
2015/02/11:
Added support for anonymous rules. This allows writing, e.g.,
list(e = expression SEMI { e })
whereas previously one should have written
list(terminated(e, SEMI)).

249 250 251
2015/02/09:
Moved all of the demos to ocamlbuild (instead of make).

252 253 254 255
2015/01/18:
Incompatible change of the incremental API.
The incremental API now exposes shift events too.

256
2015/01/16:
POTTIER Francois's avatar
POTTIER Francois committed
257 258 259
Fixed a couple bugs in Makefile and src/Makefile which would cause
compilation and installation to fail with "TARGET=byte". (Reported
by Jérémie Courrèges-Anglas and Daniel Dickman.)
260

261 262 263 264
2015/01/01:
Incompatible change of the incremental API.
The entry point main_incremental is now named Incremental.main.

265 266 267 268 269 270 271 272
2014/12/29:
Incompatible change of the incremental API.
The API now exposes reduction events.
The type 'a result is now private.
The type env is no longer parameterized.
[handle] is renamed to [resume].
[offer] and [resume] now expect a result, not an environment.

273 274 275
2014/12/22:
Documented the Coq back-end (designed and implemented by Jacques-Henri Jourdan).

POTTIER Francois's avatar
POTTIER Francois committed
276 277 278
2014/12/15:
New incremental API (in --table mode only), inspired by Frédéric Bour.

279 280 281 282 283 284 285 286 287
2014/12/11:
Menhir now reports an error if one of the start symbols produces
either the empty language or the singleton language {epsilon}.

Although some people out there actually define a start symbol that recognizes
{epsilon} (and use it as a way of initializing or re-initializing some global
state), this is considered bad style. Furthermore, by ruling out this case, we
are able to simplify the table back-end a little bit.

POTTIER Francois's avatar
POTTIER Francois committed
288 289 290
2014/12/12:
A speed improvement in the code back-end.

291 292 293
2014/12/08:
Menhir now requires OCaml 4.02 (instead of 3.09).

294 295
2014/12/02:
Removed support for the $previouserror keyword.
296
Removed support for --error-recovery mode.
297

298 299 300 301 302
2014/02/18:
In the Coq backend, use ' instead of _ as separator in identifiers.
Also, correct a serious bug that was inadvertently introduced on
2013/03/01 (r319).

303 304 305 306
2014/02/14
Lexer fix so as to support an open variant type [> ...] within
a %type<...> declaration.

fpottier's avatar
fpottier committed
307 308 309 310 311
2013/12/16
Updated the Makefile so that install no longer depends on all.
Updated the demos so that the lexer does not invoke "exit 0"
when encoutering eof. (This should be more intuitive.)

312 313 314 315
2013/09/11:
Fixed a newline conversion problem that would prevent Menhir from
building on Windows when using ocaml 4.01.

fpottier's avatar
fpottier committed
316 317 318 319
2013/03/02:
Switched to ocamlbuild. Many thanks to Daniel Weil for offering
very useful guidance.

320 321 322 323 324 325 326 327 328 329 330 331 332 333 334 335 336 337 338 339 340 341 342 343 344 345 346 347 348 349 350 351 352 353 354 355 356 357 358 359 360 361 362 363 364 365 366 367 368 369 370 371 372 373 374 375 376 377 378 379 380 381 382 383 384 385 386 387 388 389 390 391 392 393 394 395 396 397 398 399 400 401 402 403 404 405 406 407 408 409 410 411 412 413 414 415 416 417 418 419 420 421 422 423 424 425 426 427 428 429 430 431 432 433 434 435 436 437 438 439 440 441 442 443 444 445 446 447 448 449 450 451 452 453 454 455 456 457 458 459 460 461 462 463 464 465 466 467 468 469 470 471 472 473 474 475 476 477 478 479 480 481 482 483 484 485 486 487 488 489 490 491 492 493 494 495 496 497 498 499 500 501 502 503 504 505 506 507 508 509 510 511 512 513
2013/01/16:
"menhir --depend" was broken since someone added new whitespace in the output
of ocamldep. Fixed.

2012/12/19:
Fixed a compilation problem that would arise when a file produced
by Menhir on a 64-bit platform was compiled by ocaml on a 32-bit
platform.

2012/08/25:
Performance improvements in the computation of various information
about the automaton (module [Invariant]). The improvements will be
noticeable only for very large automata.

2012/06/07:
The option --log-grammar 3 (and above) now causes the FOLLOW sets for
*terminal* symbols to be computed and displayed.

2012/05/25:
Added the flag --canonical, which causes Menhir to produce a canonical LR(1)
automaton in the style of Knuth. This means that no merging of states takes
place during the construction of the automaton, and that no default reductions
are allowed.

2012/01/23:
Fixed a bug whereby a %nonassoc declaration was not respected. This
declaration requests that a shift/reduce conflict be reduced in favor of
neither shifting nor reducing, that is, a syntax error must occur. However,
due to an unforeseen interaction with the "default reduction" mechanism, this
declaration was sometimes ignored and reduction would take place.

2012/01/09:
Changes in the (undocumented) Coq back-end so as to match the ESOP 2012
paper.

2011/10/19:
The Makefile now tests whether Unix or Windows is used (the test is performed
by evaluating Sys.os_type under ocaml) and changes a couple settings accordingly:
- the executable file name is either menhir or menhir.exe
- the object file suffix is either .o or .obj

2011/10/19:
Added --strict, which causes many warnings about the grammar and about the
automaton to be considered errors.

2011/10/19:
The # annotations that are inserted in the generated .ml file now retain their
full path. (That is, we no longer use [Filename.basename].) This implies that
the # annotations depend on how menhir is invoked -- e.g.  "menhir
foo/bar.mly" and "cd foo && menhir bar.mly" will produce different
results. Nevertheless, this seems reasonable and useful (e.g. in conjunction
with ocamlbuild and a hierarchy of files). Thanks to Daniel Weil.

2011/10/06:
With the -lg 1 switch, Menhir now indicates whether the grammar is SLR(1).

2011/05/24:
Removed the lock in ocamldep.wrapper. It is the responsibility of the user
to avoid interferences with other processes (or other instances of the script)
that create and/or remove files.

2011/04/28:
The (internal) computation of the automaton's invariant was broken and has
been fixed. Surprisingly, this does not seem to affect the generated code,
(which was correct,) so no observable bug is fixed. Hopefully no bug is
introduced!

2011/04/07:
The grammar description files (.mly) are now read in up front and stored in
memory while they are parsed. This allows us to avoid the use of pos_in and
seek_in, which do not work correctly when CRLF conversion is being performed.

2011/04/05:
Fixed a bug in the type inference module (for parameterized non-terminals)
which would cause an infinite loop.

2011/01/24:
Fixed a bug that would cause an assertion failure in the generated parser
in some situations where the input stream was incorrect and the grammar
involved the error token. The fix might cause grammars that use the error
token to behave differently (hopefully more accurately) as of now.

2009/06/18:
Makefile changes: build and install only the bytecode version of menhirLib
when TARGET=byte is set.

2009/02/06:
Fixed ocamldep.wrapper to avoid quoting the name of the ocaml command.
This is hoped to fix a compilation problem under MinGW.

2009/02/04:
A Makefile fix to avoid a problem under Windows/Cygwin.
Renamed the ocaml-check-version script so as to avoid a warning.

2008/09/05:
Ocaml summer project: added --interpret, --table, and --suggest-*.

2008/08/06:
Fixed a problem that would cause the code inliner to abort when a semantic
value and a non-terminal symbol happened to have the same name.

2008/08/06:
Removed code sharing.

2008/06/20:
Removed an incorrect assertion that caused failures (lr1.ml, line 134).

2007/12/05:
Disabled code sharing by default, as it is currently broken. (See Yann's
message; assertion failure at runtime.)

2007/12/01:
Added an optimization to share code among states that have identical
outgoing transition tables.

2007/08/30:
Small Makefile change: create an executable file for check-ocaml-version in
order to work around the absence of dynamic loading on some platforms.

2007/05/20:
Made a fundamental change in the construction of the LR(1) automaton
in order to eliminate a bug that could lead to spurious conflicts --
thanks to Ketti for submitting a bug report.

2007/05/18:
Added --follow-construction to help understand the construction of the
LR(1) automaton (very verbose).

2007/05/11:
Code generation: more explicit qualifications with Pervasives so as
to avoid capture when the user redefines some of the built-in operators,
such as (+).
Added a new demo (calc-param) that shows how to use %parameter.

2007/03/22:
Makefile improvements (check for PREFIX; bootstrap in bytecode now
also available). Slight changes to OMakefile.shared.

2007/02/15:
Portability fix in Makefile and Makefile.shared (avoided "which").

2006/12/15:
Portability fix in Makefile.shared (replaced "&>" with "2>&1 >").

2006/06/23:
Made a slight restriction to Pager's criterion so as to never introduce
fake conflict tokens (see Lr0.compatible). This might help make conflict
explanations more accurate in the future.

2006/06/16:
Fixed bug that would cause positions to become invalid after %inlining.

2006/06/15:
Fixed --depend to be more lenient when analyzing ocamldep's output.
Added --raw-depend which transmits ocamldep's output unchanged (for
use in conjunction with omake).

2006/06/12:
Fixed bug that would cause --only-preprocess to print %token declarations
also for pseudo-tokens.
Fixed bug that caused some precedence declarations to be incorrectly
reported as useless.
Improved things so that useless pseudo-tokens now also cause warnings.
Fixed bug that would cause %type directives for terminal symbols to
be incorrectly accepted.
Fixed bug that would occur when a semantic action containing $i keywords
was %inlined.

2006/05/05:
Fixed problem that caused some end-of-stream conflicts not to be reported.
Fixed Pager's compatibility criterion to avoid creating end-of-stream conflicts.

2006/04/21:
Fixed problem that allowed generating incorrect but apparently well-typed
Objective Caml code when a semantic action was ill-typed and --infer was
omitted.

2006/03/29:
Improved conflict reports by factoring out maximal common derivation contexts.

2006/03/28:
Fixed bug that could arise when explaining a conflict in a non-LALR(1) grammar.

2006/03/27:
Changed count of reduce/reduce conflicts to allow a comparison with ocamlyacc's diagnostics.
When refusing to resolve a conflict, report all diagnostics before dying.

2006/03/18:
Added display of FOLLOW sets when using --log-grammar 2.
Added --graph option.
Fixed behavior of --depend option.

2006/01/06:
Removed reversed lists from the standard library.