OKCompute Analysis Framework
As part of my work at Swift Navigation I’ve done a lot of work analyzing the results of test runs and building CI frameworks to generate metrics or raise alarms based on the results. One of the challenges is that since the analysis is being performed on devices that are under development, they often create results that violate assumptions made by the analysis code. It can also be hard to trace through the analysis code and come up with the initial failure that led to a missing downstream result.
I made a generic framework to try to help with this sort of analysis.
Here’s the presentation I gave originally within the company (Note some of this may be out of date from the actual documentation):
To see the code for yourself here:
This was the most effort I’ve spent in documenting a piece of code. I use Sphinx to generate the static HTML pages, which I then host from an S3 bucket (See https://docs.aws.amazon.com/AmazonS3/latest/dev/WebsiteHosting.html ).