mega65 / mega65-test-procedures Goto Github PK
View Code? Open in Web Editor NEWScripts and utilities for generating regression test procedures for the MEGA65
License: GNU General Public License v3.0
mega65-test-procedures's People
Contributors
Stargazers
Watchers
mega65-test-procedures's Issues
declutter project directory
want to keep src/tools/<project_name> as clean as possible
cannot create file when dir does not exist
files are downoaded to ./issues/issueX.txt but subdir issues does not exist.
either put in a check and create if nessessary, or add the dir.
need to check if downloading of issues.txt is required
also seems duplicate information in issues.txt and in issues/issue1xx.txt
Housekeeping - sticky
This issue is for commits not relating to an issue.
no Makefile exists, create one
review the github-API and see if this can be better used
seems the github-api is already being used, but need to determine if it can be used better.
consider:
- download format ie JSON (see #5) opposed to the default
- authentication to avoid rate limiting (see #6)
- download only if modified (see #12)
Refer to:
https://docs.github.com/en/github/extending-github/getting-started-with-the-api
https://docs.github.com/en/rest/reference/issues
https://developer.github.com/v3/
https://api.github.com/repos/mega65/mega65-core/issues
https://api.github.com/repos/mega65/mega65-core/issues/215
https://api.github.com/repos/mega65/mega65-core/issues/206
https://api.github.com/repos/mega65/mega65-core/issues/206/events
comment/format
rate limiting, cannot download all issues from github-api, OAUTH
as the following link shows,
https://developer.github.com/v3/#rate-limiting
unauthenticated users are allowed to make 60 requests per hour.
As we have over 100 issues, we are not entitled to download all issues individually as we hit the rate-limit.
This is seen by the headers in many of the issues/issueX.txt files:
HTTP/1.1 403 rate limit exceeded
Date: Thu, 09 Jul 2020 05:56:11 GMT
Server: Varnish
Strict-Transport-Security: max-age=31536000; includeSubdomains; preload
X-Content-Type-Options: nosniff
X-Frame-Options: deny
X-XSS-Protection: 1; mode=block
Content-Security-Policy: default-src 'none'; style-src 'unsafe-inline'
Access-Control-Allow-Origin: *
Access-Control-Expose-Headers: ETag, Link, Location, Retry-After, X-GitHub-OTP, X-RateLimit-Limit, X-RateLimit-Remaining, X-RateLimit-Reset, X-OAuth-Scopes, X-Accepted-OAuth-Scopes, X-Poll-Interval, X-GitHub-Media-Type, Deprecation, Sunset
Content-Type: application/json; charset=utf-8
Referrer-Policy: origin-when-cross-origin, strict-origin-when-cross-origin
X-Github-Media-Type: github.v3; format=json
X-Ratelimit-Limit: 60
X-Ratelimit-Remaining: 0
X-Ratelimit-Reset: 1594277709
Content-Length: 250
X-GitHub-Request-Id: B348:5190:28B0E9:2FF505:5F06B17B
{"message":"API rate limit exceeded for 203.177.723.108. (But here's the good news: Authenticated requests get a higher rate limit. Check out the documentation for more details.)","documentation_url":"https://developer.github.com/v3/#rate-limiting"}
Ahh, that is why paul is checking for "HTTP/1.1 200 OK""
CR/LF \r\n\r\n linefeed not removed/parsed
The "body" often contains CR/LF and these remain (or undergo a transformation) when the string when collected.
The transformation is done in the "parse_string" function.
When printing the collected string it seems the CR/LF is not displayed properly and some text is overwritten. This is shown in the example below.
getting TITLE from '"title": "Consider including an OPL3 FM sound chip in the ME
GA65",' 0..9
getting BODY from '"body": "A number of people have asked about this. There is a
n open-source verilog implementation that we\r\ncan make use of.",' 0..8
Issue #232:
title = Consider including an OPL3 FM sound chip in the MEGA65",
body = A number of people have asked about this. There is an open-source verilog
can make use of.",at we
So, need to see if this can be fixed, or see if the JSON version (or other format) displays better.
issue242 in mega65-core has unknown escape sequence
may need to add entry to the "parse_string" function
Can't open 'issues/issue242.txt' -- refetching.
curl -i https://api.github.com/repos/mega65/mega65-core/issues/242 > issues/issue242.txt
% Total % Received % Xferd Average Speed Time Time Time Current
Dload Upload Total Spent Left Speed
100 12316 0 12316 0 0 29820 0 --:--:-- --:--:-- --:--:-- 29748
WARNING: Unknown \ escape \\
WARNING: Unknown \ escape \\
WARNING: Unknown \ escape \\
WARNING: Unknown \ escape \[
WARNING: Unknown \ escape \\
WARNING: Unknown \ escape \]
WARNING: Unknown \ escape \\
WARNING: Unknown \ escape \[
WARNING: Unknown \ escape \\
WARNING: Unknown \ escape \]
WARNING: Unknown \ escape \\
WARNING: Unknown \ escape \[
WARNING: Unknown \ escape \\
WARNING: Unknown \ escape \]
WARNING: Unknown \ escape \\
WARNING: Unknown \ escape \\
WARNING: Unknown \ escape \[
WARNING: Unknown \ escape \\
WARNING: Unknown \ escape \]
WARNING: Unknown \ escape \\
WARNING: Unknown \ escape \\
WARNING: Unknown \ escape \\
WARNING: Unknown \ escape \\
WARNING: Unknown \ escape \\
WARNING: Unknown \ escape \\
WARNING: Unknown \ escape \\
WARNING: Unknown \ escape \\
WARNING: Unknown \ escape \\
WARNING: Unknown \ escape \\
WARNING: Unknown \ escape \[
WARNING: Unknown \ escape \\
WARNING: Unknown \ escape \]
WARNING: Unknown \ escape \\
WARNING: Unknown \ escape \\
WARNING: Unknown \ escape \[
WARNING: Unknown \ escape \\
WARNING: Unknown \ escape \]
WARNING: Unknown \ escape \\
WARNING: Unknown \ escape \\
WARNING: Unknown \ escape \\
WARNING: Unknown \ escape \\
WARNING: Unknown \ escape \\
WARNING: Unknown \ escape \[
WARNING: Unknown \ escape \\
WARNING: Unknown \ escape \]
WARNING: Unknown \ escape \\
WARNING: Unknown \ escape \[
WARNING: Unknown \ escape \\
WARNING: Unknown \ escape \]
WARNING: Unknown \ escape \\
WARNING: Unknown \ escape \[
WARNING: Unknown \ escape \\
WARNING: Unknown \ escape \]
WARNING: Unknown \ escape \\
WARNING: Unknown \ escape \\
WARNING: Unknown \ escape \[
WARNING: Unknown \ escape \\
WARNING: Unknown \ escape \]
Registering problem: #242 : 'Unspecified problem. Please add \#\#BREAKS tags via github issue'
implement CLI option to just downoad a range of issues, (or dont check for updates at all)
It takes about 2 mins to check for updates.
This runs every time the program is started.
If there was a CLI option to just use the local-files, it will save much time.
i suggest "$ test_procedure_format USE_LOCAL" to disable checking for updates.
download/update issue from github-api only if modified since date
When downloading issues from github api,
An improvement is to only download if the file has been modified.
We can query the api by asking the server if the file has been modified since .
The response from server will either be:
- not modified since that date, or
- has been modified, here is the newer file.
Implementing this will allow us to avoid downloading issue-files that we already have, and have not been modified.
A second benefit of this is that the query will not result in a "cost" of one of our "60/5000" quota, if the file has not been modified.
import existing files from mega65-core
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.