Apple-2-SW/ii-vision
1
0
Fork 0
mirror of https://github.com/KrisKennaway/ii-vision.git synced 2024-09-29 18:59:05 +00:00
Code Issues Projects Releases Wiki Activity
6b969476a0
ii-vision/main.py

29 lines
548 B
Python
Raw Normal View History

Refactor the various representations of screen memory (bitmap, (x,y) bytemap, (page,offset) memory map) - add a FlatMemoryMap that is a linear 8K array - add converter methods and default constructors that allow converting between them - use MemoryMap as the central representation used by the video encoder
2019-03-03 22:21:28 +00:00
import frame_grabber
Integrated audio + video player! - Introduce a new Movie() class that multiplexes audio and video. - Every N audio frames we grab a new video frame and begin pulling opcodes from the audio and video streams - Grab frames from the input video using bmp2dhr if the .BIN file does not already exist. Run bmp2dhr in a background thread to not block encoding - move the output byte streaming from Video to Movie - For now, manually clip updates to pages > 56 since the client doesn't support them yet The way we encode video is now: - iterate in descending order over update_priority - begin a new (page, content) opcode - for all of the other offset bytes in that page, compute the error between the candidate content byte and the target content byte - iterate over offsets in order of increasing error and decreasing update_priority to fill out the remaining opcode
2019-03-07 23:07:24 +00:00
import movie
Refactor the world
2019-01-05 23:31:56 +00:00
import opcodes
Initial working version of image encoder. This tries to optimize the bytestream by prioritizing bytes to be XOR'ed that have the highest hamming weight, i.e. will result in the largest number of pixel transitions on the screen. Not especially optimized yet (either runtime, or byte stream)
2019-01-01 21:50:01 +00:00
import screen
Refactor the world
2019-01-05 23:31:56 +00:00
import video
Initial working version of image encoder. This tries to optimize the bytestream by prioritizing bytes to be XOR'ed that have the highest hamming weight, i.e. will result in the largest number of pixel transitions on the screen. Not especially optimized yet (either runtime, or byte stream)
2019-01-01 21:50:01 +00:00
Integrated audio + video player! - Introduce a new Movie() class that multiplexes audio and video. - Every N audio frames we grab a new video frame and begin pulling opcodes from the audio and video streams - Grab frames from the input video using bmp2dhr if the .BIN file does not already exist. Run bmp2dhr in a background thread to not block encoding - move the output byte streaming from Video to Movie - For now, manually clip updates to pages > 56 since the client doesn't support them yet The way we encode video is now: - iterate in descending order over update_priority - begin a new (page, content) opcode - for all of the other offset bytes in that page, compute the error between the candidate content byte and the target content byte - iterate over offsets in order of increasing error and decreasing update_priority to fill out the remaining opcode
2019-03-07 23:07:24 +00:00
MAX_OUT = 10 * 1024 * 1024
Initial working version of image encoder. This tries to optimize the bytestream by prioritizing bytes to be XOR'ed that have the highest hamming weight, i.e. will result in the largest number of pixel transitions on the screen. Not especially optimized yet (either runtime, or byte stream)
2019-01-01 21:50:01 +00:00
VIDEO_FPS = 30
Integrated audio + video player! - Introduce a new Movie() class that multiplexes audio and video. - Every N audio frames we grab a new video frame and begin pulling opcodes from the audio and video streams - Grab frames from the input video using bmp2dhr if the .BIN file does not already exist. Run bmp2dhr in a background thread to not block encoding - move the output byte streaming from Video to Movie - For now, manually clip updates to pages > 56 since the client doesn't support them yet The way we encode video is now: - iterate in descending order over update_priority - begin a new (page, content) opcode - for all of the other offset bytes in that page, compute the error between the candidate content byte and the target content byte - iterate over offsets in order of increasing error and decreasing update_priority to fill out the remaining opcode
2019-03-07 23:07:24 +00:00
APPLE_FPS = 30
Reimplement opcode scheduler to one that is ~as fast as before. As a bonus we now maintain much better tracking of our target frame rate. Maintain a running estimate of the opcode scheduling overhead, i.e. how many opcodes we end up scheduling for each content byte written. Use this to select an estimated number of screen changes to fill the cycle budget, ordered by hamming weight of the delta. Group these by content byte and then page as before.
2019-01-02 22:16:54 +00:00
Refactor opcode schedulers and implement one based on the ortools TSP solver to minimize the cycle cost to visit all changes in our estimated list. This is fortunately a tractable (though slow) computation that does give improvements on the previous heuristic at the level of ~6% better throughput. This opcode schedule prefers to group by page and vary over content, so implement a fast heuristic that does that. This scheduler is within 2% of the TSP solution.
2019-01-02 23:10:03 +00:00
Initial working version of image encoder. This tries to optimize the bytestream by prioritizing bytes to be XOR'ed that have the highest hamming weight, i.e. will result in the largest number of pixel transitions on the screen. Not especially optimized yet (either runtime, or byte stream)
2019-01-01 21:50:01 +00:00
def main():
Integrated audio + video player! - Introduce a new Movie() class that multiplexes audio and video. - Every N audio frames we grab a new video frame and begin pulling opcodes from the audio and video streams - Grab frames from the input video using bmp2dhr if the .BIN file does not already exist. Run bmp2dhr in a background thread to not block encoding - move the output byte streaming from Video to Movie - For now, manually clip updates to pages > 56 since the client doesn't support them yet The way we encode video is now: - iterate in descending order over update_priority - begin a new (page, content) opcode - for all of the other offset bytes in that page, compute the error between the candidate content byte and the target content byte - iterate over offsets in order of increasing error and decreasing update_priority to fill out the remaining opcode
2019-03-07 23:07:24 +00:00
filename = "Computer Chronicles - 06x05 - The Apple II.mp4"
Refactor the various representations of screen memory (bitmap, (x,y) bytemap, (page,offset) memory map) - add a FlatMemoryMap that is a linear 8K array - add converter methods and default constructors that allow converting between them - use MemoryMap as the central representation used by the video encoder
2019-03-03 22:21:28 +00:00
Integrated audio + video player! - Introduce a new Movie() class that multiplexes audio and video. - Every N audio frames we grab a new video frame and begin pulling opcodes from the audio and video streams - Grab frames from the input video using bmp2dhr if the .BIN file does not already exist. Run bmp2dhr in a background thread to not block encoding - move the output byte streaming from Video to Movie - For now, manually clip updates to pages > 56 since the client doesn't support them yet The way we encode video is now: - iterate in descending order over update_priority - begin a new (page, content) opcode - for all of the other offset bytes in that page, compute the error between the candidate content byte and the target content byte - iterate over offsets in order of increasing error and decreasing update_priority to fill out the remaining opcode
2019-03-07 23:07:24 +00:00
m = movie.Movie(filename, audio_normalization=3.0)
Refactor the world
2019-01-05 23:31:56 +00:00
Extract out input video decoding into separate module. Prototype a threaded version of the decoder but this doesn't seem to be necessary as it's not the bottleneck. Opcode stream is now aware of frame cycle budget and will keep emitting until budget runs out -- so no need for fullness estimate.
2019-02-23 23:32:07 +00:00
with open("out.bin", "wb") as out:
Integrated audio + video player! - Introduce a new Movie() class that multiplexes audio and video. - Every N audio frames we grab a new video frame and begin pulling opcodes from the audio and video streams - Grab frames from the input video using bmp2dhr if the .BIN file does not already exist. Run bmp2dhr in a background thread to not block encoding - move the output byte streaming from Video to Movie - For now, manually clip updates to pages > 56 since the client doesn't support them yet The way we encode video is now: - iterate in descending order over update_priority - begin a new (page, content) opcode - for all of the other offset bytes in that page, compute the error between the candidate content byte and the target content byte - iterate over offsets in order of increasing error and decreasing update_priority to fill out the remaining opcode
2019-03-07 23:07:24 +00:00
for bytes_out, b in enumerate(m.emit_stream(m.encode())):
out.write(bytearray([b]))
if bytes_out >= MAX_OUT:
Extract out input video decoding into separate module. Prototype a threaded version of the decoder but this doesn't seem to be necessary as it's not the bottleneck. Opcode stream is now aware of frame cycle budget and will keep emitting until budget runs out -- so no need for fullness estimate.
2019-02-23 23:32:07 +00:00
break
Initial working version of image encoder. This tries to optimize the bytestream by prioritizing bytes to be XOR'ed that have the highest hamming weight, i.e. will result in the largest number of pixel transitions on the screen. Not especially optimized yet (either runtime, or byte stream)
2019-01-01 21:50:01 +00:00
Integrated audio + video player! - Introduce a new Movie() class that multiplexes audio and video. - Every N audio frames we grab a new video frame and begin pulling opcodes from the audio and video streams - Grab frames from the input video using bmp2dhr if the .BIN file does not already exist. Run bmp2dhr in a background thread to not block encoding - move the output byte streaming from Video to Movie - For now, manually clip updates to pages > 56 since the client doesn't support them yet The way we encode video is now: - iterate in descending order over update_priority - begin a new (page, content) opcode - for all of the other offset bytes in that page, compute the error between the candidate content byte and the target content byte - iterate over offsets in order of increasing error and decreasing update_priority to fill out the remaining opcode
2019-03-07 23:07:24 +00:00
out.write(bytes(m.done()))
Initial working version of image encoder. This tries to optimize the bytestream by prioritizing bytes to be XOR'ed that have the highest hamming weight, i.e. will result in the largest number of pixel transitions on the screen. Not especially optimized yet (either runtime, or byte stream)
2019-01-01 21:50:01 +00:00
if __name__ == "__main__":
main()
Reference in New Issue Copy Permalink