David Wendt
3294ef17e4
scanner: Break the scanner up into multiple modules
2021-09-11 09:52:40 -07:00
David Wendt
7a71cce028
scanner: Break each movie out into a separate process.
...
Since forking isn't an option in Rust (and is generally unsafe, incompatible with threads, and more or less not UNIX's best design idea) we instead grab the current binary path and run it again with a different subcommand.
This should allow us to grab all the panics, including uncatchable ones.
Note: this also requires that we introduce an IPC mechanism. I currently decided to have it spit out CSV rows, same as the main `scan` command. This also makes the psuedo-fork subcommand arguably useful on it's own as it will dump timing metrics for each step.
2021-09-11 09:52:40 -07:00
David Wendt
263c1133c8
scanner: Add a `scan` subcommand
2021-09-11 09:52:40 -07:00
David Wendt
75f1b40925
scanner: Deduplicate repeated log messages
2021-09-11 09:52:40 -07:00
David Wendt
a284d5d13b
scanner: Record test duration (in milliseconds)
2021-09-11 09:52:40 -07:00
David Wendt
a18d13833c
scanner: Print partial results as they come out of the parallel iterator.
...
This relies on a proposed serial bridge as per https://github.com/rayon-rs/rayon/issues/858 . As that project is licensed the same as Ruffle itself and the submitter intended it to be included in Rayon, I believe it's legal to copy this code.
2021-09-11 09:52:40 -07:00
David Wendt
46638b1be8
scanner: Set the default scanner thread size to 16MB.
...
Rayon's default of 2MB is about half of what the AVM1 recursion limit requires, and I have plenty of memory, so I might as well add some padding for long runs.
2021-09-11 09:52:40 -07:00
David Wendt
b49ae66ff3
scanner: Run the first frame of every movie we scan.
...
This currently fails to scan the entire Flashpoint `localflash` directory because Rust considers stack overflow to be an immediate program termination, no ifs, ands, or buts about it.
2021-09-11 09:52:40 -07:00
David Wendt
2b061cdba6
scanner: Report what stage of the scan got to before any errors happened
2021-09-11 09:52:40 -07:00
David Wendt
1d0e418c5c
scanner: Parallelize the scan process
2021-09-11 09:52:40 -07:00
David Wendt
f9c646e51f
scanner: Report decompression failures as errors instead of panicking.
2021-09-11 09:52:40 -07:00
David Wendt
074cc4bc8e
scanner: Report the AVM version of every scanned file
2021-09-11 09:52:40 -07:00
dependabot[bot]
cb2f1b6488
chore: Bump clap from 3.0.0-beta.2 to 3.0.0-beta.4
...
Bumps [clap](https://github.com/clap-rs/clap ) from 3.0.0-beta.2 to 3.0.0-beta.4.
- [Release notes](https://github.com/clap-rs/clap/releases )
- [Changelog](https://github.com/clap-rs/clap/blob/master/CHANGELOG.md )
- [Commits](https://github.com/clap-rs/clap/compare/v3.0.0-beta.2...v3.0.0-beta.4 )
---
updated-dependencies:
- dependency-name: clap
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
2021-08-18 09:13:25 +03:00
dependabot[bot]
ca2d17ade6
chore: Bump env_logger from 0.8.4 to 0.9.0
...
Bumps [env_logger](https://github.com/env-logger-rs/env_logger ) from 0.8.4 to 0.9.0.
- [Release notes](https://github.com/env-logger-rs/env_logger/releases )
- [Changelog](https://github.com/env-logger-rs/env_logger/blob/main/CHANGELOG.md )
- [Commits](https://github.com/env-logger-rs/env_logger/compare/v0.8.4...v0.9.0 )
---
updated-dependencies:
- dependency-name: env_logger
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
2021-07-19 23:49:40 +03:00
dependabot[bot]
cf4a1136c5
chore: Bump env_logger from 0.8.3 to 0.8.4
...
Bumps [env_logger](https://github.com/env-logger-rs/env_logger ) from 0.8.3 to 0.8.4.
- [Release notes](https://github.com/env-logger-rs/env_logger/releases )
- [Changelog](https://github.com/env-logger-rs/env_logger/blob/main/CHANGELOG.md )
- [Commits](https://github.com/env-logger-rs/env_logger/compare/v0.8.3...v0.8.4 )
---
updated-dependencies:
- dependency-name: env_logger
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
2021-06-14 00:47:57 -07:00
dependabot[bot]
860f26ef7d
chore: Bump indicatif from 0.15.0 to 0.16.0
...
Bumps [indicatif](https://github.com/mitsuhiko/indicatif ) from 0.15.0 to 0.16.0.
- [Release notes](https://github.com/mitsuhiko/indicatif/releases )
- [Commits](https://github.com/mitsuhiko/indicatif/commits )
Signed-off-by: dependabot[bot] <support@github.com>
2021-05-03 15:37:40 -07:00
dependabot-preview[bot]
2f949d9826
build(deps): bump walkdir from 2.3.1 to 2.3.2
...
Bumps [walkdir](https://github.com/BurntSushi/walkdir ) from 2.3.1 to 2.3.2.
- [Release notes](https://github.com/BurntSushi/walkdir/releases )
- [Commits](https://github.com/BurntSushi/walkdir/compare/2.3.1...2.3.2 )
Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2021-03-23 10:03:36 -07:00
dependabot-preview[bot]
b3fdd50bd0
build(deps): bump env_logger from 0.8.2 to 0.8.3
...
Bumps [env_logger](https://github.com/env-logger-rs/env_logger ) from 0.8.2 to 0.8.3.
- [Release notes](https://github.com/env-logger-rs/env_logger/releases )
- [Changelog](https://github.com/env-logger-rs/env_logger/blob/master/CHANGELOG.md )
- [Commits](https://github.com/env-logger-rs/env_logger/compare/v0.8.2...v0.8.3 )
Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2021-02-11 11:38:29 -08:00
Mike Welsh
61628a74fc
swf: Rename and organize some util methods
...
* SwfRead -> SwfReadExt
* SwfWrite -> SwfWriteExt
* read_swf_header -> decompress_swf
* read_swf -> parse_swf
2021-01-20 15:02:31 -08:00
Mike Welsh
19034b76e4
swf: Return slices in swf::Reader
...
Avoid copies by returning slices of the decompressed input.
2021-01-20 15:02:31 -08:00
dependabot-preview[bot]
7f3d8faeb3
build(deps): bump path-slash from 0.1.3 to 0.1.4
...
Bumps [path-slash](https://github.com/rhysd/path-slash ) from 0.1.3 to 0.1.4.
- [Release notes](https://github.com/rhysd/path-slash/releases )
- [Changelog](https://github.com/rhysd/path-slash/blob/master/CHANGELOG.md )
- [Commits](https://github.com/rhysd/path-slash/compare/v0.1.3...v0.1.4 )
Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2021-01-18 22:33:48 -08:00
dependabot-preview[bot]
633bddfd72
build(deps): bump env_logger from 0.8.1 to 0.8.2
...
Bumps [env_logger](https://github.com/env-logger-rs/env_logger ) from 0.8.1 to 0.8.2.
- [Release notes](https://github.com/env-logger-rs/env_logger/releases )
- [Changelog](https://github.com/env-logger-rs/env_logger/blob/master/CHANGELOG.md )
- [Commits](https://github.com/env-logger-rs/env_logger/compare/v0.8.1...v0.8.2 )
Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2020-11-18 16:26:21 -08:00
dependabot-preview[bot]
8ba5dbfa49
build(deps): bump env_logger from 0.7.1 to 0.8.1
...
Bumps [env_logger](https://github.com/env-logger-rs/env_logger ) from 0.7.1 to 0.8.1.
- [Release notes](https://github.com/env-logger-rs/env_logger/releases )
- [Changelog](https://github.com/env-logger-rs/env_logger/blob/master/CHANGELOG.md )
- [Commits](https://github.com/env-logger-rs/env_logger/commits )
Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2020-10-17 02:33:11 -07:00
Mike Welsh
a59f211ae8
chore: Bump clap to 3.0-beta.2
2020-09-21 18:56:46 -07:00
Mike Welsh
b99b9efe5d
scanner: Switch to clap 3.0
2020-08-14 14:12:08 -07:00
dependabot-preview[bot]
f35f65bd4c
build(deps): bump path-slash from 0.1.2 to 0.1.3
...
Bumps [path-slash](https://github.com/rhysd/path-slash ) from 0.1.2 to 0.1.3.
- [Release notes](https://github.com/rhysd/path-slash/releases )
- [Changelog](https://github.com/rhysd/path-slash/blob/master/CHANGELOG.md )
- [Commits](https://github.com/rhysd/path-slash/compare/v0.1.2...v0.1.3 )
Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2020-06-30 18:39:45 -07:00
dependabot-preview[bot]
da17d8f2e4
build(deps): bump path-slash from 0.1.1 to 0.1.2
...
Bumps [path-slash](https://github.com/rhysd/path-slash ) from 0.1.1 to 0.1.2.
- [Release notes](https://github.com/rhysd/path-slash/releases )
- [Changelog](https://github.com/rhysd/path-slash/blob/master/CHANGELOG.md )
- [Commits](https://github.com/rhysd/path-slash/compare/0.1.1...v0.1.2 )
Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2020-06-16 11:56:54 -07:00
dependabot-preview[bot]
cb33ecc14f
build(deps): bump structopt from 0.3.14 to 0.3.15
...
Bumps [structopt](https://github.com/TeXitoi/structopt ) from 0.3.14 to 0.3.15.
- [Release notes](https://github.com/TeXitoi/structopt/releases )
- [Changelog](https://github.com/TeXitoi/structopt/blob/master/CHANGELOG.md )
- [Commits](https://github.com/TeXitoi/structopt/compare/v0.3.14...v0.3.15 )
Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2020-06-16 10:06:32 -07:00
dependabot-preview[bot]
ea86739a48
build(deps): bump indicatif from 0.14.0 to 0.15.0
...
Bumps [indicatif](https://github.com/mitsuhiko/indicatif ) from 0.14.0 to 0.15.0.
- [Release notes](https://github.com/mitsuhiko/indicatif/releases )
- [Commits](https://github.com/mitsuhiko/indicatif/compare/0.14.0...0.15.0 )
Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2020-06-14 19:42:39 -07:00
Nathan Adams
df6764a69c
chore: Add license metadata to all packages & crates
2020-05-27 00:11:02 -07:00
dependabot-preview[bot]
c08a55c7fc
build(deps): bump structopt from 0.3.13 to 0.3.14
...
Bumps [structopt](https://github.com/TeXitoi/structopt ) from 0.3.13 to 0.3.14.
- [Release notes](https://github.com/TeXitoi/structopt/releases )
- [Changelog](https://github.com/TeXitoi/structopt/blob/master/CHANGELOG.md )
- [Commits](https://github.com/TeXitoi/structopt/compare/v0.3.13...v0.3.14 )
Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2020-04-22 19:25:07 +00:00
dependabot-preview[bot]
ecb15eac04
build(deps): bump structopt from 0.3.12 to 0.3.13
...
Bumps [structopt](https://github.com/TeXitoi/structopt ) from 0.3.12 to 0.3.13.
- [Release notes](https://github.com/TeXitoi/structopt/releases )
- [Changelog](https://github.com/TeXitoi/structopt/blob/master/CHANGELOG.md )
- [Commits](https://github.com/TeXitoi/structopt/commits )
Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2020-04-09 23:49:59 +00:00
dependabot-preview[bot]
265197b475
build(deps): bump structopt from 0.3.11 to 0.3.12
...
Bumps [structopt](https://github.com/TeXitoi/structopt ) from 0.3.11 to 0.3.12.
- [Release notes](https://github.com/TeXitoi/structopt/releases )
- [Changelog](https://github.com/TeXitoi/structopt/blob/master/CHANGELOG.md )
- [Commits](https://github.com/TeXitoi/structopt/compare/v0.3.11...v0.3.12 )
Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2020-03-18 20:35:34 +00:00
dependabot-preview[bot]
f215458501
build(deps): bump structopt from 0.3.9 to 0.3.11
...
Bumps [structopt](https://github.com/TeXitoi/structopt ) from 0.3.9 to 0.3.11.
- [Release notes](https://github.com/TeXitoi/structopt/releases )
- [Changelog](https://github.com/TeXitoi/structopt/blob/master/CHANGELOG.md )
- [Commits](https://github.com/TeXitoi/structopt/commits )
Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2020-03-03 00:01:14 +00:00
dependabot-preview[bot]
580144d57b
build(deps): bump structopt from 0.3.8 to 0.3.9
...
Bumps [structopt](https://github.com/TeXitoi/structopt ) from 0.3.8 to 0.3.9.
- [Release notes](https://github.com/TeXitoi/structopt/releases )
- [Changelog](https://github.com/TeXitoi/structopt/blob/master/CHANGELOG.md )
- [Commits](https://github.com/TeXitoi/structopt/compare/v0.3.8...v0.3.9 )
Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2020-02-01 11:05:33 +00:00
dependabot-preview[bot]
cf2d29f65a
build(deps): bump indicatif from 0.13.0 to 0.14.0
...
Bumps [indicatif](https://github.com/mitsuhiko/indicatif ) from 0.13.0 to 0.14.0.
- [Release notes](https://github.com/mitsuhiko/indicatif/releases )
- [Commits](https://github.com/mitsuhiko/indicatif/commits )
Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2020-01-30 17:42:12 +00:00
dependabot-preview[bot]
fdc37ec44f
build(deps): bump structopt from 0.3.7 to 0.3.8
...
Bumps [structopt](https://github.com/TeXitoi/structopt ) from 0.3.7 to 0.3.8.
- [Release notes](https://github.com/TeXitoi/structopt/releases )
- [Changelog](https://github.com/TeXitoi/structopt/blob/master/CHANGELOG.md )
- [Commits](https://github.com/TeXitoi/structopt/commits )
Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2020-01-20 07:24:58 +00:00
dependabot-preview[bot]
ec0599913d
build(deps): bump walkdir from 2.2.9 to 2.3.1
...
Bumps [walkdir](https://github.com/BurntSushi/walkdir ) from 2.2.9 to 2.3.1.
- [Release notes](https://github.com/BurntSushi/walkdir/releases )
- [Commits](https://github.com/BurntSushi/walkdir/compare/2.2.9...2.3.1 )
Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2020-01-13 18:37:55 +00:00
dependabot-preview[bot]
861a4484a5
build(deps): bump structopt from 0.3.6 to 0.3.7
...
Bumps [structopt](https://github.com/TeXitoi/structopt ) from 0.3.6 to 0.3.7.
- [Release notes](https://github.com/TeXitoi/structopt/releases )
- [Changelog](https://github.com/TeXitoi/structopt/blob/master/CHANGELOG.md )
- [Commits](https://github.com/TeXitoi/structopt/compare/v0.3.6...v0.3.7 )
Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2019-12-29 23:10:17 +00:00
dependabot-preview[bot]
9211c7ac05
build(deps): bump structopt from 0.3.5 to 0.3.6
...
Bumps [structopt](https://github.com/TeXitoi/structopt ) from 0.3.5 to 0.3.6.
- [Release notes](https://github.com/TeXitoi/structopt/releases )
- [Changelog](https://github.com/TeXitoi/structopt/blob/master/CHANGELOG.md )
- [Commits](https://github.com/TeXitoi/structopt/compare/v0.3.5...v0.3.6 )
Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2019-12-22 22:54:14 +00:00
dependabot-preview[bot]
112411aa7a
build(deps): bump structopt from 0.3.4 to 0.3.5
...
Bumps [structopt](https://github.com/TeXitoi/structopt ) from 0.3.4 to 0.3.5.
- [Release notes](https://github.com/TeXitoi/structopt/releases )
- [Changelog](https://github.com/TeXitoi/structopt/blob/master/CHANGELOG.md )
- [Commits](https://github.com/TeXitoi/structopt/compare/v0.3.4...v0.3.5 )
Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2019-11-25 10:53:04 +00:00
dependabot-preview[bot]
7fae0eb2d0
build(deps): bump indicatif from 0.12.0 to 0.13.0
...
Bumps [indicatif](https://github.com/mitsuhiko/indicatif ) from 0.12.0 to 0.13.0.
- [Release notes](https://github.com/mitsuhiko/indicatif/releases )
- [Commits](https://github.com/mitsuhiko/indicatif/compare/0.12.0...0.13.0 )
Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2019-11-22 17:43:19 +00:00
dependabot-preview[bot]
24009d4f4a
build(deps): bump structopt from 0.2.18 to 0.3.4
...
Bumps [structopt](https://github.com/TeXitoi/structopt ) from 0.2.18 to 0.3.4.
- [Release notes](https://github.com/TeXitoi/structopt/releases )
- [Changelog](https://github.com/TeXitoi/structopt/blob/master/CHANGELOG.md )
- [Commits](https://github.com/TeXitoi/structopt/compare/v0.2.18...v0.3.4 )
Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2019-11-20 19:01:18 +00:00
dependabot-preview[bot]
0e8d86a419
build(deps): bump env_logger from 0.6.2 to 0.7.1
...
Bumps [env_logger](https://github.com/sebasmagri/env_logger ) from 0.6.2 to 0.7.1.
- [Release notes](https://github.com/sebasmagri/env_logger/releases )
- [Changelog](https://github.com/sebasmagri/env_logger/blob/master/CHANGELOG.md )
- [Commits](https://github.com/sebasmagri/env_logger/compare/v0.6.2...v0.7.1 )
Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2019-11-20 18:49:16 +00:00
Nathan Adams
59d39d6572
Added a bulk swf scanning tool
2019-10-11 16:37:15 -07:00