Updating README's.
This commit is contained in:
Rob Greene
parent
cff367ca35
commit
6eecf14289
28
README.md
28
README.md
|
|
@ -1,26 +1,10 @@
|
|||
# BASIC Tokenizer
|
||||
|
||||
This project is an offshoot of AppleCommander's import of a BASIC program. The tooling will have more capabilities than what is available in AppleCommander.
|
||||
|
||||
Metadata (v1)
|
||||
========
|
||||
# Subprojects
|
||||
|
||||
Program
|
||||
- Lines
|
||||
- Line number
|
||||
- Statements
|
||||
- Tokens (AppleSoft "token", strings, syntax, etc)
|
||||
This project is split into two sub-projects:
|
||||
|
||||
|
||||
Metadata (v2)
|
||||
========
|
||||
|
||||
Program
|
||||
- Routines
|
||||
- Label (default = "__main__" or something)
|
||||
- Statements
|
||||
- Distinct statements with expression trees
|
||||
- LET
|
||||
- FOR
|
||||
- CALL
|
||||
- POKE
|
||||
- PRINT
|
||||
- etc
|
||||
* [api](api) is the Java API
|
||||
* [bt](tools/bt) is a command-line tool for tokenizing AppleSoft BASIC programs.
|
||||
|
|
|
|||
|
|
@ -33,7 +33,40 @@ Program program = parser.parse();
|
|||
|
||||
The `Program` is now the parsed version of the BASIC program. Various `Visitor`s may be used to report, gather information, or manipulate the tree in various ways.
|
||||
|
||||
## Directives
|
||||
|
||||
The framework allows embedding of directives.
|
||||
|
||||
### `$embed`
|
||||
|
||||
`$embed` will allow a binary to be embedded within the resulting application. Please note that once the application is loaeded on the Apple II, the program cannot be altered as the computer will crash. Usage example:
|
||||
|
||||
```
|
||||
5 $embed "read.time.bin", "0x0260"
|
||||
```
|
||||
|
||||
The `$embed` directive _must_ be last on the line (if there are comments, be sure to use the `REMOVE_REM_STATEMENTS` optimization. It takes two parameters: file name and target address, both are strings.
|
||||
|
||||
From the `circles-timing.bas` sample, this is the beginning of the program:
|
||||
|
||||
```
|
||||
0801:9A 09 00 00 8C 32 30 36 32 3A AB 31 00 A9 2B 85
|
||||
\___/ \___/ \____________/ \___/ \_______...
|
||||
Ptr, Line 0, CALL 3062, :, GOTO 1, Assembly code...
|
||||
```
|
||||
|
||||
## Optimizations
|
||||
|
||||
## Visitors
|
||||
Optimizations are mechanisms to rewrite the `Program`, typically making the program smaller. `Optimization` itself is an enum which has a `create` method to setup the `Visitor`.
|
||||
|
||||
Current optimizations are:
|
||||
* _Remove empty statements_ will remove all extra colons. For example, if the application in question used `:` to indicate nesting. Or just accidents!
|
||||
* _Remove REM statements_ will remove all comments.
|
||||
* _Merge lines_ will identify all lines that are not a target of `GOTO`/`GOSUB`-type action and rewrite the line by merging it with others. The concept involved is that the BASIC program is just a linked list and shortening the list will shorten the search path. The default *max length* in bytes is set to `255`.
|
||||
* _Renumber_ will renumber the application, beginning with line `0`. This makes the decoding a tiny bit more efficient in that the number to decode will be smaller in the token stream.
|
||||
|
||||
Sample use:
|
||||
|
||||
```java
|
||||
program = program.accept(Optimization.REMOVE_REM_STATEMENTS.create(config));
|
||||
```
|
||||
|
|
|
|||
|
|
@ -7,7 +7,9 @@ import java.util.TreeMap;
|
|||
|
||||
import io.github.applecommander.bastokenizer.api.directives.EmbeddedBinaryDirective;
|
||||
|
||||
public abstract class Directives {
|
||||
public class Directives {
|
||||
private Directives() { /* Prevent construction. */ }
|
||||
|
||||
private static Map<String,Class<? extends Directive>> DIRECTIVES =
|
||||
new TreeMap<String,Class<? extends Directive>>(String.CASE_INSENSITIVE_ORDER) {
|
||||
private static final long serialVersionUID = -8111460701487331592L;
|
||||
|
|
|
|||
|
|
@ -0,0 +1,142 @@
|
|||
## Usage
|
||||
|
||||
```shell
|
||||
$ bt
|
||||
Missing required parameter: <sourceFile>
|
||||
Usage: bt [-chOVx] [--addresses] [--applesingle] [--debug] [--list] [--pretty]
|
||||
[--stdout] [--tokens] [--variables]
|
||||
[--max-line-length=<maxLineLength>] [-a=<address>] [-o=<outputFile>]
|
||||
[-f=<optimizations>[,<optimizations>...]]... <sourceFile>
|
||||
|
||||
Transforms an AppleSoft program from text back to its tokenized state.
|
||||
<sourceFile> AppleSoft BASIC program to process.
|
||||
|
||||
Options:
|
||||
--addresses Dump line number addresses out.
|
||||
--applesingle Write output in AppleSingle format
|
||||
--debug Print debug output.
|
||||
--list List structure as bastokenizer understands it.
|
||||
--max-line-length=<maxLineLength>
|
||||
Maximum line length for generated lines.
|
||||
Default: 255
|
||||
--pretty Pretty print structure as bastokenizer understands it.
|
||||
--stdout Send binary output to stdout.
|
||||
--tokens Dump token list to stdout for debugging.
|
||||
--variables Generate a variable report
|
||||
-a, --address=<address> Base address for program
|
||||
Default: 2049
|
||||
-c, --copy Generate a copy/paste form of output for testing in an
|
||||
emulator.
|
||||
-f= <optimizations>[,<optimizations>...]
|
||||
Enable specific optimizations.
|
||||
* remove-empty-statements - Strip out all '::'-like
|
||||
statements.
|
||||
* remove-rem-statements - Remove all REM statements.
|
||||
* merge-lines - Merge lines.
|
||||
* renumber - Renumber program.
|
||||
-h, --help Show this help message and exit.
|
||||
-o, --output=<outputFile> Write binary output to file.
|
||||
-O, --optimize Apply all optimizations.
|
||||
-V, --version Print version information and exit.
|
||||
-x, --hex Generate a binary hex dump for debugging.
|
||||
```
|
||||
|
||||
## Using copy and paste
|
||||
|
||||
If your Apple emulator supports copy and paste (not all do!), this is handy when experimenting.
|
||||
|
||||
```shell
|
||||
$ bt --copy tools/bt/src/test/resources/circles.bas
|
||||
0067:01 08 E1 09
|
||||
0800:00
|
||||
0801:0A 08 0A 00 AB 31 30 30 00 23 08 14 00 B2 64 72
|
||||
0811:61 77 20 63 69 72 63 6C 65 20 72 6F 75 74 69 6E
|
||||
0821:65 00 2F 08 1E 00 81 41 D0 30 C1 50 54 00 47 08
|
||||
0831:28 00 58 D0 58 28 41 29 CA 53 5A 3A 59 D0 59 28
|
||||
0841:41 29 CA 53 5A 00 56 08 32 00 93 58 4F C8 58 2C
|
||||
0851:59 4F C8 59 00 65 08 3C 00 93 58 4F C9 58 2C 59
|
||||
0861:4F C8 59 00 74 08 46 00 93 58 4F C8 58 2C 59 4F
|
||||
0871:C9 59 00 83 08 50 00 93 58 4F C9 58 2C 59 4F C9
|
||||
0881:59 00 8A 08 5A 00 82 41 00 90 08 5F 00 B1 00 A2
|
||||
0891:08 64 00 B2 6D 61 69 6E 20 70 72 6F 67 72 61 6D
|
||||
08A1:00 A8 08 6E 00 91 00 D6 08 73 00 43 28 30 29 D0
|
||||
08B1:31 3A 43 28 31 29 D0 32 3A 43 28 32 29 D0 33 3A
|
||||
08C1:43 28 33 29 D0 35 3A 43 28 34 29 D0 36 3A 43 28
|
||||
08D1:35 29 D0 37 00 F5 08 78 00 97 3A A2 32 31 3A 9E
|
||||
08E1:3A BA 22 4A 55 53 54 20 41 20 4D 4F 4D 45 4E 54
|
||||
08F1:22 3A 9D 00 04 09 82 00 50 49 D0 33 2E 31 34 31
|
||||
0901:35 39 00 1B 09 8C 00 50 54 D0 33 30 3A 86 58 28
|
||||
0911:50 54 29 2C 59 28 50 54 29 00 27 09 96 00 81 41
|
||||
0921:D0 30 C1 50 54 00 3B 09 A0 00 42 D0 50 49 CA 28
|
||||
0931:41 CB 28 50 54 CA 32 29 29 00 49 09 AA 00 58 28
|
||||
0941:41 29 D0 DF 28 42 29 00 57 09 B4 00 59 28 41 29
|
||||
0951:D0 DE 28 42 29 00 5E 09 BE 00 82 41 00 68 09 C8
|
||||
0961:00 97 3A A2 32 31 00 75 09 D2 00 81 51 D0 31 C1
|
||||
0971:31 30 30 00 88 09 D7 00 43 D0 36 CA DB 28 31 29
|
||||
0981:3A 92 43 28 43 29 00 9C 09 DC 00 53 5A D0 31 30
|
||||
0991:C8 28 34 30 CA DB 28 31 29 29 00 B6 09 E6 00 58
|
||||
09A1:4F D0 28 32 37 39 C9 53 5A CA 32 29 CA DB 28 31
|
||||
09B1:29 C8 53 5A 00 D0 09 F0 00 59 4F D0 28 31 35 39
|
||||
09C1:C9 53 5A CA 32 29 CA DB 28 31 29 C8 53 5A 00 D8
|
||||
09D1:09 FA 00 B0 33 30 00 DF 09 04 01 82 51 00 00 00
|
||||
```
|
||||
|
||||
## Listing / Optimization
|
||||
|
||||
Listing is handy when tinkering with what the tool does. Before optimization...
|
||||
|
||||
```shell
|
||||
$ bt --list tools/bt/src/test/resources/circles.bas
|
||||
10 GOTO 100
|
||||
20 REM draw circle routine
|
||||
30 FOR A = 0 TO PT
|
||||
40 X = X(A) * SZ:Y = Y(A) * SZ
|
||||
50 HPLOT XO + X,YO + Y
|
||||
60 HPLOT XO - X,YO + Y
|
||||
70 HPLOT XO + X,YO - Y
|
||||
80 HPLOT XO - X,YO - Y
|
||||
90 NEXT A
|
||||
95 RETURN
|
||||
100 REM main program
|
||||
110 HGR
|
||||
115 C(0) = 1:C(1) = 2:C(2) = 3:C(3) = 5:C(4) = 6:C(5) = 7
|
||||
120 HOME : VTAB 21: INVERSE : PRINT "JUST A MOMENT": NORMAL
|
||||
130 PI = 3.14159
|
||||
140 PT = 30: DIM X(PT),Y(PT)
|
||||
150 FOR A = 0 TO PT
|
||||
160 B = PI * (A / (PT * 2))
|
||||
170 X(A) = SIN (B)
|
||||
180 Y(A) = COS (B)
|
||||
190 NEXT A
|
||||
200 HOME : VTAB 21
|
||||
210 FOR Q = 1 TO 100
|
||||
215 C = 6 * RND (1): HCOLOR= C(C)
|
||||
220 SZ = 10 + (40 * RND (1))
|
||||
230 XO = (279 - SZ * 2) * RND (1) + SZ
|
||||
240 YO = (159 - SZ * 2) * RND (1) + SZ
|
||||
250 GOSUB 30
|
||||
260 NEXT Q
|
||||
```
|
||||
|
||||
... and after optimization ...
|
||||
|
||||
```shell
|
||||
$ bt --optimize --list tools/bt/src/test/resources/circles.bas
|
||||
0 GOTO 2
|
||||
1 FOR A = 0 TO PT:X = X(A) * SZ:Y = Y(A) * SZ: HPLOT XO + X,YO + Y: HPLOT XO - X,YO + Y: HPLOT XO + X,YO - Y: HPLOT XO - X,YO - Y: NEXT A: RETURN
|
||||
2 HGR :C(0) = 1:C(1) = 2:C(2) = 3:C(3) = 5:C(4) = 6:C(5) = 7: HOME : VTAB 21: INVERSE : PRINT "JUST A MOMENT": NORMAL :PI = 3.14159:PT = 30: DIM X(PT),Y(PT): FOR A = 0 TO PT:B = PI * (A / (PT * 2)):X(A) = SIN (B):Y(A) = COS (B): NEXT A: HOME : VTAB 21: FOR Q = 1 TO 100:C = 6 * RND (1): HCOLOR= C(C):SZ = 10 + (40 * RND (1)):XO = (279 - SZ * 2) * RND (1) + SZ:YO = (159 - SZ * 2) * RND (1) + SZ: GOSUB 1: NEXT Q
|
||||
```
|
||||
|
||||
## Piping to stdout
|
||||
|
||||
`bt` can also pipe an AppleSingle file to stdout, which can then be read in for AppleCommander 1.5 or later. Note that file type, address, and name is set automatically.
|
||||
|
||||
```shell
|
||||
$ ac -pro140 demo.dsk demo
|
||||
$ bt --optimize --applesingle --stdout tools/bt/src/test/resources/circles.bas | ac -as demo.dsk
|
||||
$ ac -l demo.dsk
|
||||
demo.dsk /DEMO/
|
||||
CIRCLES BAS 001 05/29/2018 05/29/2018 338 A=$0801
|
||||
ProDOS format; 139,264 bytes free; 4,096 bytes used.
|
||||
|
||||
```
|
||||
Loading…
Reference in New Issue