Commit graph

28 commits

Author SHA1 Message Date
Daniel Osvaldo Rahmanto
a9fd667cf6
chore(test): add reason field to node compat test config (#30469)
Some checks are pending
ci / pre-build (push) Waiting to run
ci / test debug linux-aarch64 (push) Blocked by required conditions
ci / test release linux-aarch64 (push) Blocked by required conditions
ci / test debug macos-aarch64 (push) Blocked by required conditions
ci / test release macos-aarch64 (push) Blocked by required conditions
ci / bench release linux-x86_64 (push) Blocked by required conditions
ci / lint debug linux-x86_64 (push) Blocked by required conditions
ci / lint debug macos-x86_64 (push) Blocked by required conditions
ci / lint debug windows-x86_64 (push) Blocked by required conditions
ci / test debug linux-x86_64 (push) Blocked by required conditions
ci / test release linux-x86_64 (push) Blocked by required conditions
ci / test debug macos-x86_64 (push) Blocked by required conditions
ci / test release macos-x86_64 (push) Blocked by required conditions
ci / test debug windows-x86_64 (push) Blocked by required conditions
ci / test release windows-x86_64 (push) Blocked by required conditions
ci / build libs (push) Blocked by required conditions
ci / publish canary (push) Blocked by required conditions
This was done so we can show it later on `node-test-viewer`.

Other notable changes:
- Move ignored test list from `run_all_test_unmodified.ts` to
`config.toml`
- Add `parallel/test-os-checked-function.js` to the ignore list
- Adjust the `README.md`
2025-09-01 23:44:11 +02:00
Daniel Osvaldo R
5c30409a42
fix(test): set cwd when running node compatibility tests (#30422)
Allows tests to resolve path correctly, such as this one
591ba692bf/test/parallel/test-fs-cp.mjs (L35)
2025-08-16 11:36:20 +00:00
David Sherret
01bbe9c66a
fix(check): do not surface code resolution errors in declaration file dependencies (#30296) 2025-08-05 08:35:20 +00:00
Daniel Osvaldo R
d66b1cb89b
test: avoid race condition on node compat test runner (#30201) 2025-07-25 15:31:31 +09:00
Bartek Iwańczuk
6390c8a13b
test: add ability to mark Node compat tests as flaky (#30158)
This commit updates test harness for Node.js compat tests to
allow marking certain tests as flaky. 

This is done by adding `flaky = true` to dict entries in
the `tests/node_compat/config.toml` file.
2025-07-21 14:24:57 +00:00
David Sherret
11f4109344
ci: try to make running node compat tests a little more reliable on CI (#29957) 2025-07-01 19:04:14 +00:00
Yoshiya Hinosawa
c73b91318b
chore(ext/node): reorg node compat test CI check (#29893)
This PR reorganizes the node compat test CI check.

Now we don't copy (or modify) tests from the vendored dir
(`tests/node_compat/runner/suite`), instead run them directly.

There seem currently 1.4K test cases which pass without modification in
all OSes. The list of such test files are now stored in
`tests/node_compat/config.toml`, and `tests/node_compat/test.ts` run
them as `Deno.test` cases.

(Note: `config.toml` is created by this script:
https://github.com/denoland/node_test_viewer/blob/main/get_consistently_passing_test_names_as_toml.ts.
It checks the daily node compat test runs for the last 10 days, and
retrieves consistently passing test cases.)

closes #29857
2025-06-27 21:06:18 +09:00
Yoshiya Hinosawa
b6d09f65b1
chore(ext/node): exclude known_issues dir from test targets (#29859) 2025-06-25 10:25:27 +09:00
Divy Srivastava
fca2c56df3
fix(ext/node): disable parallel/test-crypto-secure-heap.js test (#29658) 2025-06-08 22:45:06 -07:00
Yoshiya Hinosawa
d0910c463d
chore: record whether node test uses node:test to report.json (#29633)
Some checks are pending
ci / pre-build (push) Waiting to run
ci / test debug linux-aarch64 (push) Blocked by required conditions
ci / test release linux-aarch64 (push) Blocked by required conditions
ci / test debug macos-aarch64 (push) Blocked by required conditions
ci / test release macos-aarch64 (push) Blocked by required conditions
ci / bench release linux-x86_64 (push) Blocked by required conditions
ci / lint debug linux-x86_64 (push) Blocked by required conditions
ci / lint debug macos-x86_64 (push) Blocked by required conditions
ci / lint debug windows-x86_64 (push) Blocked by required conditions
ci / test debug linux-x86_64 (push) Blocked by required conditions
ci / test release linux-x86_64 (push) Blocked by required conditions
ci / test debug macos-x86_64 (push) Blocked by required conditions
ci / test release macos-x86_64 (push) Blocked by required conditions
ci / test debug windows-x86_64 (push) Blocked by required conditions
ci / test release windows-x86_64 (push) Blocked by required conditions
ci / build wasm32 (push) Blocked by required conditions
ci / publish canary (push) Blocked by required conditions
This PR adds the info about whether each test case uses `node:test` or
not to daily node compat test report.

This info is useful for displaying more correct command for executing a
single test case in Tooltip UI in test viewer web page.
2025-06-06 21:44:42 +09:00
Divy Srivastava
22a615c7eb
fix(ext/node): ignore parallel/test-eventsource-disabled.js test (#29618)
Some checks are pending
ci / pre-build (push) Waiting to run
ci / test debug linux-aarch64 (push) Blocked by required conditions
ci / test release linux-aarch64 (push) Blocked by required conditions
ci / test debug macos-aarch64 (push) Blocked by required conditions
ci / test release macos-aarch64 (push) Blocked by required conditions
ci / bench release linux-x86_64 (push) Blocked by required conditions
ci / lint debug linux-x86_64 (push) Blocked by required conditions
ci / lint debug macos-x86_64 (push) Blocked by required conditions
ci / lint debug windows-x86_64 (push) Blocked by required conditions
ci / test debug linux-x86_64 (push) Blocked by required conditions
ci / test release linux-x86_64 (push) Blocked by required conditions
ci / test debug macos-x86_64 (push) Blocked by required conditions
ci / test release macos-x86_64 (push) Blocked by required conditions
ci / test debug windows-x86_64 (push) Blocked by required conditions
ci / test release windows-x86_64 (push) Blocked by required conditions
ci / build wasm32 (push) Blocked by required conditions
ci / publish canary (push) Blocked by required conditions
EventSource web API is always available in Deno

Towards https://github.com/denoland/deno/issues/29595
2025-06-05 12:06:59 +00:00
Yoshiya Hinosawa
ff8160b594
fix(ext/node): support DEP0005 deprecation warning (#29530)
Some checks are pending
ci / test release linux-aarch64 (push) Blocked by required conditions
ci / test debug macos-aarch64 (push) Blocked by required conditions
ci / test release macos-aarch64 (push) Blocked by required conditions
ci / bench release linux-x86_64 (push) Blocked by required conditions
ci / lint debug linux-x86_64 (push) Blocked by required conditions
ci / lint debug macos-x86_64 (push) Blocked by required conditions
ci / lint debug windows-x86_64 (push) Blocked by required conditions
ci / test debug linux-x86_64 (push) Blocked by required conditions
ci / test release linux-x86_64 (push) Blocked by required conditions
ci / test debug macos-x86_64 (push) Blocked by required conditions
ci / test release macos-x86_64 (push) Blocked by required conditions
ci / test debug windows-x86_64 (push) Blocked by required conditions
ci / test release windows-x86_64 (push) Blocked by required conditions
ci / pre-build (push) Waiting to run
ci / test debug linux-aarch64 (push) Blocked by required conditions
ci / build wasm32 (push) Blocked by required conditions
ci / publish canary (push) Blocked by required conditions
This commit adds support of `DEP0005` warning which is emitted when the user
calls `Buffer` as constructor.
2025-06-04 12:25:32 +09:00
Yoshiya Hinosawa
01a6379505
fix(ext/node): print warnings to stderr (#29527)
Some checks are pending
ci / bench release linux-x86_64 (push) Blocked by required conditions
ci / lint debug linux-x86_64 (push) Blocked by required conditions
ci / test release macos-x86_64 (push) Blocked by required conditions
ci / test debug windows-x86_64 (push) Blocked by required conditions
ci / test release windows-x86_64 (push) Blocked by required conditions
ci / pre-build (push) Waiting to run
ci / test debug linux-aarch64 (push) Blocked by required conditions
ci / test release linux-aarch64 (push) Blocked by required conditions
ci / test debug macos-aarch64 (push) Blocked by required conditions
ci / test release macos-aarch64 (push) Blocked by required conditions
ci / lint debug macos-x86_64 (push) Blocked by required conditions
ci / lint debug windows-x86_64 (push) Blocked by required conditions
ci / test debug linux-x86_64 (push) Blocked by required conditions
ci / test release linux-x86_64 (push) Blocked by required conditions
ci / test debug macos-x86_64 (push) Blocked by required conditions
ci / build wasm32 (push) Blocked by required conditions
ci / publish canary (push) Blocked by required conditions
2025-06-02 11:36:47 +09:00
Yoshiya Hinosawa
32234e8815
test(ext/node): respect --allow-natives-syntax v8 flag in compat test runner (#29529)
Some checks failed
ci / pre-build (push) Has been cancelled
ci / test debug macos-x86_64 (push) Has been cancelled
ci / test release macos-x86_64 (push) Has been cancelled
ci / test debug windows-x86_64 (push) Has been cancelled
ci / test release windows-x86_64 (push) Has been cancelled
ci / test debug linux-aarch64 (push) Has been cancelled
ci / test release linux-aarch64 (push) Has been cancelled
ci / test debug macos-aarch64 (push) Has been cancelled
ci / test release macos-aarch64 (push) Has been cancelled
ci / bench release linux-x86_64 (push) Has been cancelled
ci / lint debug linux-x86_64 (push) Has been cancelled
ci / lint debug macos-x86_64 (push) Has been cancelled
ci / lint debug windows-x86_64 (push) Has been cancelled
ci / test debug linux-x86_64 (push) Has been cancelled
ci / test release linux-x86_64 (push) Has been cancelled
ci / build wasm32 (push) Has been cancelled
ci / publish canary (push) Has been cancelled
2025-05-31 22:41:02 +09:00
Yoshiya Hinosawa
3930dc112c
chore(ext/node): ignore parallel/test-buffer-backing-arraybuffer.js (#29505) 2025-05-30 11:38:02 +09:00
Yoshiya Hinosawa
4823f2b9e8
chore(ext/node): ignore some node test cases (#29462)
Some checks are pending
ci / pre-build (push) Waiting to run
ci / test debug linux-aarch64 (push) Blocked by required conditions
ci / test debug macos-aarch64 (push) Blocked by required conditions
ci / test release macos-aarch64 (push) Blocked by required conditions
ci / build wasm32 (push) Blocked by required conditions
ci / test release windows-x86_64 (push) Blocked by required conditions
ci / bench release linux-x86_64 (push) Blocked by required conditions
ci / lint debug linux-x86_64 (push) Blocked by required conditions
ci / lint debug macos-x86_64 (push) Blocked by required conditions
ci / lint debug windows-x86_64 (push) Blocked by required conditions
ci / test debug linux-x86_64 (push) Blocked by required conditions
ci / test release linux-x86_64 (push) Blocked by required conditions
ci / test debug macos-x86_64 (push) Blocked by required conditions
ci / test release macos-x86_64 (push) Blocked by required conditions
ci / test debug windows-x86_64 (push) Blocked by required conditions
ci / test release linux-aarch64 (push) Blocked by required conditions
ci / publish canary (push) Blocked by required conditions
2025-05-28 14:19:42 +09:00
Yoshiya Hinosawa
d8879ee3fd
chore: simplify node test script (#29459) 2025-05-28 11:18:22 +09:00
Yoshiya Hinosawa
721a8ad8a2
test(ext/node): run .mjs test files (#29384)
Some checks are pending
ci / pre-build (push) Waiting to run
ci / test debug linux-aarch64 (push) Blocked by required conditions
ci / test release linux-aarch64 (push) Blocked by required conditions
ci / test debug macos-aarch64 (push) Blocked by required conditions
ci / test release macos-aarch64 (push) Blocked by required conditions
ci / bench release linux-x86_64 (push) Blocked by required conditions
ci / lint debug linux-x86_64 (push) Blocked by required conditions
ci / lint debug macos-x86_64 (push) Blocked by required conditions
ci / lint debug windows-x86_64 (push) Blocked by required conditions
ci / test debug linux-x86_64 (push) Blocked by required conditions
ci / test release linux-x86_64 (push) Blocked by required conditions
ci / test debug macos-x86_64 (push) Blocked by required conditions
ci / test release macos-x86_64 (push) Blocked by required conditions
ci / test debug windows-x86_64 (push) Blocked by required conditions
ci / test release windows-x86_64 (push) Blocked by required conditions
ci / build wasm32 (push) Blocked by required conditions
ci / publish canary (push) Blocked by required conditions
2025-05-20 16:24:43 +09:00
Bartek Iwańczuk
46ec01374e
test: add shorthand script to run all Node test and filtering to it (#29224)
Some checks are pending
ci / pre-build (push) Waiting to run
ci / test debug linux-aarch64 (push) Blocked by required conditions
ci / test release linux-aarch64 (push) Blocked by required conditions
ci / test debug macos-aarch64 (push) Blocked by required conditions
ci / test release macos-aarch64 (push) Blocked by required conditions
ci / bench release linux-x86_64 (push) Blocked by required conditions
ci / lint debug linux-x86_64 (push) Blocked by required conditions
ci / lint debug macos-x86_64 (push) Blocked by required conditions
ci / lint debug windows-x86_64 (push) Blocked by required conditions
ci / test debug linux-x86_64 (push) Blocked by required conditions
ci / test release linux-x86_64 (push) Blocked by required conditions
ci / test debug macos-x86_64 (push) Blocked by required conditions
ci / test release macos-x86_64 (push) Blocked by required conditions
ci / test debug windows-x86_64 (push) Blocked by required conditions
ci / test release windows-x86_64 (push) Blocked by required conditions
ci / build wasm32 (push) Blocked by required conditions
ci / publish canary (push) Blocked by required conditions
This commit adds a new "tools/node_compat_tests.js" script that runs
"tests/node_compat/node_compat_test.ts" file.

Additionally ability to filter tests has been added (that only works
if we're not running in CI), that can be enabled like so:
```
$ tools/node_compat_tests.js --filter timers-unref-active
```
2025-05-17 02:08:21 +02:00
Bartek Iwańczuk
784be1511b
test: Capture output of failing node compat tests (#29227)
Will actually show test error instead of "error: Test failed"
2025-05-09 16:16:25 +02:00
Yoshiya Hinosawa
a44ed9bbe4
chore(ext/node): pass v8 flags (--expose-gc and --expose-externalize-string) to node test script (#29046) 2025-04-25 21:22:25 +09:00
Yoshiya Hinosawa
8908ec31bf
chore: use 'deno test' command when 'node:test' is imported in run_node_test script (#28885) 2025-04-15 09:54:25 +09:00
Yoshiya Hinosawa
3a6cdc2516
chore(ext/node): fix run_all_test script for windows (#28883) 2025-04-14 15:46:26 +09:00
Yoshiya Hinosawa
9bc3b07819
chore: create monthly summary of node test runs (#28778) 2025-04-08 12:12:27 +09:00
Yoshiya Hinosawa
e94066ff32
chore: add metadata to node compat test report (#28719) 2025-04-03 14:04:31 +09:00
Yoshiya Hinosawa
f42b39d2cf
ci: set NODE_SKIP_FLAG_CHECK=1 in node_compat_test workflow (#28642) 2025-03-28 12:22:41 +09:00
Yoshiya Hinosawa
2b4de21ea0
ci: reduce the concurrency number of parallel runs to navigator.hardwareConcurrency (#28639) 2025-03-27 13:47:47 +09:00
Yoshiya Hinosawa
460e511e59
test(ext/node): run all node tests (unchanged) daily, upload reports to dl.deno.land (#28629) 2025-03-27 09:53:38 +09:00