[Mumps2Py:] token analysis of fm22.rsa

[Patrick Gallot <pgallot@xxxxxxxxxxxx>]

I've been using fm22.rsa as an input corpus for developing the parsing 
side of Mumps2Py.
I can only parse this file up until it gets to the 'zc' command . (z* 
commands are implementation specific, and I haven't figured out how 
this  command should be handled).  But I added a 'Parse->Parse until 
Module', which allowed me to parse  until Mumps2Py reached module 
'DINVDTM', and below is the token frequency analysis of fm22.rsa up 
until module 'DINVDTM':

Local Var: 108110
Expression: 38459
;: 36069
Number: 33526
String: 32456
SET: 18016
Entry Reference: 10155
QUIT: 10023
_: 9708
DO: 9260
IF: 7460
Label: 6372
': 6069
$PIECE: 5865
=: 5249
+: 4524
$DATA: 4258
Global Variable: 4128
$GET: 3931
-: 2871
[: 2750
NEW: 2704
Indirection Expression: 2701
GOTO: 2419
FOR: 2332
KILL: 2294
$EXTRACT: 1998
WRITE: 1989
$ORDER: 1772
!: 1729
^(: 1718
>: 1486
Pattern Atom: 1242
OR: 1228
User Function: 1224
?: 1187
$SELECT: 1178
$JOB: 1139
$LENGTH: 1023
]]: 968
ELSE: 780
<: 699
: 664
$CHAR: 583
XECUTE: 500
$TEXT: 499
#: 483
AND: 326
$ASCII: 224
MERGE: 218
$NAME: 215
$TRANSLATE: 169
$JUSTIFY: 159
\: 156
$TEST: 142
READ: 104
$FIND: 97
*: 89
$Y: 83
$X: 65
LOCK: 56
/: 39
$HOROLOG: 39
USE: 37
HANG: 31
asc: 28
$QUERY: 23
$VIEW: 21
$QLENGTH: 10
$QSUBSCRIPT: 9
Unknown Intrinsic function: 8
$IO: 4
Unknown Intrinsic variable: 3
$RANDOM: 2
Unknown command: 1
OPEN: 1
CLOSE: 1
$ZTRAP: 1
$ZERROR: 1
$REVERSE: 1


-Patrick


---