Files
bun.sh/src/linux_c.zig
Jarred Sumner c9fe57fa63 wip use wrapper for managing process (#8456)
* WIP sync close (shows ref count bug in stream)

* fix closing on PipeWriter and PipeReader

* remove old todos

* join

* Some shell changes

at least it compiles

* fix some compile errors

* fix ref/unref server on windows

* actually use the ref count in this places

* make windows compile again

* more tests passing

* Make shell compile again

* Slowly remove some `@panic("TODO SHELL")`

* Eliminate `@panic("TODO SHELL")` for BufferedWriter

* Holy cleansing of `@panic("TODO SHELL")`

at least it compiles now

* Okay now the shell compiles, but segfaults

* Fix compiler errors

* more stable stream and now Content-Range pass

* make windows compile again

* revert stuff until the fix is actually ready

* revert onDone thing

* Fix buffered writer for shell

* Fix buffered writer + shell/subproc.zig and windows build

* Fix for #8982 got lost in the merge

* Actually buffer subproc output

* Fix some stuff shell

* oops

* fix context deinit

* fix renderMissing

* shell: Fix array buffer

* more stable streams (#9053)

fix stream ref counting

* wip

* Remove `@panic("TODO")` on shell event loop tasks and Redirect  open flags got lost in merge

* Support redirects

* fixes

cc @cirospaciari

* Update ReadableStreamInternals.ts

* Fix spurious error

* Update stream.js

* leak

* Fix UAF

cc @cirospaciari

* Fix memory leaks

* HOLY FUCK big refactor

* misc cleanup

* shell: Fix a bunch of tests

* clean up

* gitignore: fix ending newline

* get windows compiling again

* tidy

* hide linker warn with icu

* closeIfPossible

* Better leak test

* Fix forgetting to decrement reference count

* Update stdio.zig

* Fix shell windows build

* Stupid unreachable

* Woops

* basic echo hi works on windows

* Fix flaky test on Windows

* Fix windows regression in Bun.main (#9156)

* Fix windows regression in Bun.main

* Handle invalid handles

* Fix flaky test

* Better launch config

* Fixup

* Make this test less flaky on Windows

* Fixup

* Cygwin

* Support signal codes in subprocess.kill(), resolve file path

* Treat null as ignore

* Ignore carriage returns

* Fixup

* shell: Fix IOWriter bug

* shell: Use custom `open()`/`openat()`

* windows shell subproc works

* zack commit

* I think I understand WindowsStreamingWriter

* fix thing

* why were we doing this in tests

* shell: Fix rm

* shell: Add rm -rf node_modules/ test

* shell: use `.runAsTest()` in some places to make it easier to determine which test failed

* [autofix.ci] apply automated fixes

* woopsie

* Various changes

* Fix

* shell: abstract output task logic

* shell: mkdir builtin

* fixup

* stuff

* shell: Make writing length of 0 in IOWriter immediately resolve

* shell: Implement `touch`

* shell: basic `cat` working

* Make it compile on windows

* shell: Fix IOReader bug

* [autofix.ci] apply automated fixes

* fix windows kill on subprocess/process

* fix dns tests to match behavior on windows (same as nodejs)

* fix windows ci

* again

* move `close_handle` to flags in `PipeWriter` and fix shell hanging

* Fix `ls` not giving non-zero exit code on error

* Handle edgecase in is_atty

* Fix writer.flush() when there's no data

* Fix some tests

* Disable uv_unref on uv_process_t on Windows, for now.

* fix writer.end

* fix stdout.write

* fix child-process on win32

* Make this test less flaky on Windows

* Add assertion

* Make these the same

* Make it pass on windows

* Don't commit

* Log the test name

* Make this test less flaky on windows

* Make this test less flaky on windows

* Print which test is taking awhile in the runner

* fixups

* Fixups

* Add some assertions

* Bring back test concurrency

* shell: bring back redirect stdin

* make it compile again cc @zackradisic

* initialize env map with capacity

* some fixes

* cleanup

* oops

* fix leak, fix done

* fix unconsumedPromises on events

* always run expect

* Update child_process.test.ts

* fix reading special files

* Fix a test

* Deflake this test

* Make these comparisons easier

* Won't really fix it but slightly cleaner

* Update serve.test.ts

* Make the checks for if the body is already used more resilient

* Move this to the harness

* Make this test not hang in development

* Fix this test

* Make the logs better

* zero init some things

* Make this test better

* Fix readSocket

* Parallelize this test

* Handle EPipe and avoid big data

* This was a mistake

* Fix a bunch of things

* Fix memory leak

* Avoid sigpipe + optimize + delete dead code

* Make this take less time

* Make it bigger

* Remove some redundant code

* Update process.zig

* Merge and hopefully don't breka things along teh way

* Silence build warning

* Uncomment on posix

* Skip test on windows

* windows

* Cleanup test

* Update

* Deflake

* always

* less flaky test

* [autofix.ci] apply automated fixes

* logs

* fix uaf on shell IOReader

* stuff to make it work with mini event loop

* fix 2 double free scenarios, support redirections on windows

* shell: Make `1>&2` and `2>&1` work with libuv

* yoops

* Partial fix

* Partial fix

* fix build

* fix build

* ok

* Make a couple shell tests pass

* More logging

* fix

* fix

* Fix build issue

* more tests pass

* Deflake

* Deflake

* Use Output.panic instead of garbled text

* Formatting

* Introduce `bun.sys.File`, use it for `Output.Source.StreamType`, fix nested Output.scoped() calls, use Win32 `ReadFile` API for reading when it's not a libuv file descriptor.

This lets us avoid the subtle usages of `unreachable` in std.os when writing to stdout/stderr.

Previously, we were initializing the libuv loop immediately at launch due to checking for the existence of a bun build --compile'd executable. When the file descriptor is not from libuv, it's just overhead to use libuv

cc @paperdave, please tell me if Iany of that is incorrect or if you think this is a bad idea.

* Fix closing undefined memory file descriptors in spawn

cc @zackradisic

* pause instead of close

* Fix poorly-written test

* We don't need big numbers for this test

* sad workaround

* fixup

* Clearer error handling for this test

* Fix incorrect test

@electroid when ReadableStream isn't closed, hanging is the correct behavior when consuming buffered data. We cannot know if the buffered data is finished if the stream never closes.

* Fix build

* Remove known failing on windows

* Deflake

* Mark no longer failing

* show all the failing tests

* Sort the list of tests

* fix argument handling

* dont show "posix_spawn" as an error code on windows

* make bun-upgrade.test.ts pass on windows

* fix bunx and bun create again sorry

* a

* fix invalidexe because we should not be running javascript files as if they were exes

* Concurrency in test runner + better logging

* Revert "fix invalidexe because we should not be running javascript files as if they were exes"

This reverts commit da47cf8247.

* WIP: Unix fixes (#9322)

* wip

* [autofix.ci] apply automated fixes

* wip 2

* [autofix.ci] apply automated fixes

---------

Co-authored-by: autofix-ci[bot] <114827586+autofix-ci[bot]@users.noreply.github.com>
Co-authored-by: Jarred Sumner <jarred@jarredsumner.com>

* Update runner.node.mjs

* Update runner.node.mjs

* Document some environment variables

* shell: Make `Response` work with builtins

* Make it compile

* make pwd test pass

* [autofix.ci] apply automated fixes

* Fix printing garbage for source code previews

* Update javascript.zig

* Fix posix test failures

* Fix signal dispatch

cc @paperdave. Signals can be run from any thread. This causes an assertion failure when the receiving thread happens to not be the main thread. Easiest to reproduce on linux when you spawn 100 short-lived processes at once.

* windows

---------

Co-authored-by: cirospaciari <ciro.spaciari@gmail.com>
Co-authored-by: Zack Radisic <56137411+zackradisic@users.noreply.github.com>
Co-authored-by: Zack Radisic <zackradisic@Zacks-MBP-2.attlocal.net>
Co-authored-by: Jarred Sumner <709451+Jarred-Sumner@users.noreply.github.com>
Co-authored-by: Meghan Denny <meghan@bun.sh>
Co-authored-by: Zack Radisic <zack@theradisic.com>
Co-authored-by: autofix-ci[bot] <114827586+autofix-ci[bot]@users.noreply.github.com>
Co-authored-by: dave caruso <me@paperdave.net>
Co-authored-by: Dylan Conway <dylan.conway567@gmail.com>
2024-03-11 08:24:30 -07:00

669 lines
25 KiB
Zig
Raw Blame History

This file contains ambiguous Unicode characters
This file contains Unicode characters that might be confused with other characters. If you think that this is intentional, you can safely ignore this warning. Use the Escape button to reveal them.
const std = @import("std");
const bun = @import("root").bun;
pub const SystemErrno = enum(u8) {
SUCCESS = 0,
EPERM = 1,
ENOENT = 2,
ESRCH = 3,
EINTR = 4,
EIO = 5,
ENXIO = 6,
E2BIG = 7,
ENOEXEC = 8,
EBADF = 9,
ECHILD = 10,
EAGAIN = 11,
ENOMEM = 12,
EACCES = 13,
EFAULT = 14,
ENOTBLK = 15,
EBUSY = 16,
EEXIST = 17,
EXDEV = 18,
ENODEV = 19,
ENOTDIR = 20,
EISDIR = 21,
EINVAL = 22,
ENFILE = 23,
EMFILE = 24,
ENOTTY = 25,
ETXTBSY = 26,
EFBIG = 27,
ENOSPC = 28,
ESPIPE = 29,
EROFS = 30,
EMLINK = 31,
EPIPE = 32,
EDOM = 33,
ERANGE = 34,
EDEADLK = 35,
ENAMETOOLONG = 36,
ENOLCK = 37,
ENOSYS = 38,
ENOTEMPTY = 39,
ELOOP = 40,
EWOULDBLOCK = 41,
ENOMSG = 42,
EIDRM = 43,
ECHRNG = 44,
EL2NSYNC = 45,
EL3HLT = 46,
EL3RST = 47,
ELNRNG = 48,
EUNATCH = 49,
ENOCSI = 50,
EL2HLT = 51,
EBADE = 52,
EBADR = 53,
EXFULL = 54,
ENOANO = 55,
EBADRQC = 56,
EBADSLT = 57,
EDEADLOCK = 58,
EBFONT = 59,
ENOSTR = 60,
ENODATA = 61,
ETIME = 62,
ENOSR = 63,
ENONET = 64,
ENOPKG = 65,
EREMOTE = 66,
ENOLINK = 67,
EADV = 68,
ESRMNT = 69,
ECOMM = 70,
EPROTO = 71,
EMULTIHOP = 72,
EDOTDOT = 73,
EBADMSG = 74,
EOVERFLOW = 75,
ENOTUNIQ = 76,
EBADFD = 77,
EREMCHG = 78,
ELIBACC = 79,
ELIBBAD = 80,
ELIBSCN = 81,
ELIBMAX = 82,
ELIBEXEC = 83,
EILSEQ = 84,
ERESTART = 85,
ESTRPIPE = 86,
EUSERS = 87,
ENOTSOCK = 88,
EDESTADDRREQ = 89,
EMSGSIZE = 90,
EPROTOTYPE = 91,
ENOPROTOOPT = 92,
EPROTONOSUPPORT = 93,
ESOCKTNOSUPPORT = 94,
/// For Linux, EOPNOTSUPP is the real value
/// but it's ~the same and is incompatible across operating systems
/// https://lists.gnu.org/archive/html/bug-glibc/2002-08/msg00017.html
ENOTSUP = 95,
EPFNOSUPPORT = 96,
EAFNOSUPPORT = 97,
EADDRINUSE = 98,
EADDRNOTAVAIL = 99,
ENETDOWN = 100,
ENETUNREACH = 101,
ENETRESET = 102,
ECONNABORTED = 103,
ECONNRESET = 104,
ENOBUFS = 105,
EISCONN = 106,
ENOTCONN = 107,
ESHUTDOWN = 108,
ETOOMANYREFS = 109,
ETIMEDOUT = 110,
ECONNREFUSED = 111,
EHOSTDOWN = 112,
EHOSTUNREACH = 113,
EALREADY = 114,
EINPROGRESS = 115,
ESTALE = 116,
EUCLEAN = 117,
ENOTNAM = 118,
ENAVAIL = 119,
EISNAM = 120,
EREMOTEIO = 121,
EDQUOT = 122,
ENOMEDIUM = 123,
EMEDIUMTYPE = 124,
ECANCELED = 125,
ENOKEY = 126,
EKEYEXPIRED = 127,
EKEYREVOKED = 128,
EKEYREJECTED = 129,
EOWNERDEAD = 130,
ENOTRECOVERABLE = 131,
ERFKILL = 132,
EHWPOISON = 133,
pub const max = 134;
pub fn init(code: anytype) ?SystemErrno {
if (code < 0) {
if (code <= -max) {
return null;
}
return @enumFromInt(-code);
}
if (code >= max) return null;
return @enumFromInt(code);
}
pub fn label(this: SystemErrno) ?[]const u8 {
return labels.get(this) orelse null;
}
const LabelMap = std.EnumMap(SystemErrno, []const u8);
pub const labels: LabelMap = brk: {
var map: LabelMap = LabelMap.initFull("");
map.put(.EPERM, "Operation not permitted");
map.put(.ENOENT, "No such file or directory");
map.put(.ESRCH, "No such process");
map.put(.EINTR, "Interrupted system call");
map.put(.EIO, "I/O error");
map.put(.ENXIO, "No such device or address");
map.put(.E2BIG, "Argument list too long");
map.put(.ENOEXEC, "Exec format error");
map.put(.EBADF, "Bad file descriptor");
map.put(.ECHILD, "No child processes");
map.put(.EAGAIN, "Try again");
map.put(.ENOMEM, "Out of memory");
map.put(.EACCES, "Permission denied");
map.put(.EFAULT, "Bad address");
map.put(.ENOTBLK, "Block device required");
map.put(.EBUSY, "Device or resource busy");
map.put(.EEXIST, "File or folder exists");
map.put(.EXDEV, "Cross-device link");
map.put(.ENODEV, "No such device");
map.put(.ENOTDIR, "Not a directory");
map.put(.EISDIR, "Is a directory");
map.put(.EINVAL, "Invalid argument");
map.put(.ENFILE, "File table overflow");
map.put(.EMFILE, "Too many open files");
map.put(.ENOTTY, "Not a typewriter");
map.put(.ETXTBSY, "Text file busy");
map.put(.EFBIG, "File too large");
map.put(.ENOSPC, "No space left on device");
map.put(.ESPIPE, "Illegal seek");
map.put(.EROFS, "Read-only file system");
map.put(.EMLINK, "Too many links");
map.put(.EPIPE, "Broken pipe");
map.put(.EDOM, "Math argument out of domain of func");
map.put(.ERANGE, "Math result not representable");
map.put(.EDEADLK, "Resource deadlock would occur");
map.put(.ENAMETOOLONG, "File name too long");
map.put(.ENOLCK, "No record locks available");
map.put(.ENOSYS, "Function not implemented");
map.put(.ENOTEMPTY, "Directory not empty");
map.put(.ELOOP, "Too many symbolic links encountered");
map.put(.ENOMSG, "No message of desired type");
map.put(.EIDRM, "Identifier removed");
map.put(.ECHRNG, "Channel number out of range");
map.put(.EL2NSYNC, "Level 2 not synchronized");
map.put(.EL3HLT, "Level 3 halted");
map.put(.EL3RST, "Level 3 reset");
map.put(.ELNRNG, "Link number out of range");
map.put(.EUNATCH, "Protocol driver not attached");
map.put(.ENOCSI, "No CSI structure available");
map.put(.EL2HLT, "Level 2 halted");
map.put(.EBADE, "Invalid exchange");
map.put(.EBADR, "Invalid request descriptor");
map.put(.EXFULL, "Exchange full");
map.put(.ENOANO, "No anode");
map.put(.EBADRQC, "Invalid request code");
map.put(.EBADSLT, "Invalid slot");
map.put(.EBFONT, "Bad font file format");
map.put(.ENOSTR, "Device not a stream");
map.put(.ENODATA, "No data available");
map.put(.ETIME, "Timer expired");
map.put(.ENOSR, "Out of streams resources");
map.put(.ENONET, "Machine is not on the network");
map.put(.ENOPKG, "Package not installed");
map.put(.EREMOTE, "Object is remote");
map.put(.ENOLINK, "Link has been severed");
map.put(.EADV, "Advertise error");
map.put(.ESRMNT, "Srmount error");
map.put(.ECOMM, "Communication error on send");
map.put(.EPROTO, "Protocol error");
map.put(.EMULTIHOP, "Multihop attempted");
map.put(.EDOTDOT, "RFS specific error");
map.put(.EBADMSG, "Not a data message");
map.put(.EOVERFLOW, "Value too large for defined data type");
map.put(.ENOTUNIQ, "Name not unique on network");
map.put(.EBADFD, "File descriptor in bad state");
map.put(.EREMCHG, "Remote address changed");
map.put(.ELIBACC, "Can not access a needed shared library");
map.put(.ELIBBAD, "Accessing a corrupted shared library");
map.put(.ELIBSCN, "lib section in a.out corrupted");
map.put(.ELIBMAX, "Attempting to link in too many shared libraries");
map.put(.ELIBEXEC, "Cannot exec a shared library directly");
map.put(.EILSEQ, "Illegal byte sequence");
map.put(.ERESTART, "Interrupted system call should be restarted");
map.put(.ESTRPIPE, "Streams pipe error");
map.put(.EUSERS, "Too many users");
map.put(.ENOTSOCK, "Socket operation on non-socket");
map.put(.EDESTADDRREQ, "Destination address required");
map.put(.EMSGSIZE, "Message too long");
map.put(.EPROTOTYPE, "Protocol wrong type for socket");
map.put(.ENOPROTOOPT, "Protocol not available");
map.put(.EPROTONOSUPPORT, "Protocol not supported");
map.put(.ESOCKTNOSUPPORT, "Socket type not supported");
map.put(.ENOTSUP, "Operation not supported on transport endpoint");
map.put(.EPFNOSUPPORT, "Protocol family not supported");
map.put(.EAFNOSUPPORT, "Address family not supported by protocol");
map.put(.EADDRINUSE, "Address already in use");
map.put(.EADDRNOTAVAIL, "Cannot assign requested address");
map.put(.ENETDOWN, "Network is down");
map.put(.ENETUNREACH, "Network is unreachable");
map.put(.ENETRESET, "Network dropped connection because of reset");
map.put(.ECONNABORTED, "Software caused connection abort");
map.put(.ECONNRESET, "Connection reset by peer");
map.put(.ENOBUFS, "No buffer space available");
map.put(.EISCONN, "Transport endpoint is already connected");
map.put(.ENOTCONN, "Transport endpoint is not connected");
map.put(.ESHUTDOWN, "Cannot send after transport endpoint shutdown");
map.put(.ETOOMANYREFS, "Too many references: cannot splice");
map.put(.ETIMEDOUT, "Connection timed out");
map.put(.ECONNREFUSED, "Connection refused");
map.put(.EHOSTDOWN, "Host is down");
map.put(.EHOSTUNREACH, "No route to host");
map.put(.EALREADY, "Operation already in progress");
map.put(.EINPROGRESS, "Operation now in progress");
map.put(.ESTALE, "Stale NFS file handle");
map.put(.EUCLEAN, "Structure needs cleaning");
map.put(.ENOTNAM, "Not a XENIX named type file");
map.put(.ENAVAIL, "No XENIX semaphores available");
map.put(.EISNAM, "Is a named type file");
map.put(.EREMOTEIO, "Remote I/O error");
map.put(.EDQUOT, "Quota exceeded");
map.put(.ENOMEDIUM, "No medium found");
map.put(.EMEDIUMTYPE, "Wrong medium type");
map.put(.ECANCELED, "Operation Canceled");
map.put(.ENOKEY, "Required key not available");
map.put(.EKEYEXPIRED, "Key has expired");
map.put(.EKEYREVOKED, "Key has been revoked");
map.put(.EKEYREJECTED, "Key was rejected by service");
map.put(.EOWNERDEAD, "Owner died");
map.put(.ENOTRECOVERABLE, "State not recoverable");
break :brk map;
};
};
pub const preallocate_length = 2048 * 1024;
pub fn preallocate_file(fd: std.os.fd_t, offset: std.os.off_t, len: std.os.off_t) anyerror!void {
// https://gist.github.com/Jarred-Sumner/b37b93399b63cbfd86e908c59a0a37df
// ext4 NVME Linux kernel 5.17.0-1016-oem x86_64
//
// hyperfine "./micro 1024 temp" "./micro 1024 temp --preallocate" --prepare="rm -rf temp && free && sync && echo 3 > /proc/sys/vm/drop_caches && free"
// Benchmark 1: ./micro 1024 temp
// Time (mean ± σ): 1.8 ms ± 0.2 ms [User: 0.6 ms, System: 0.1 ms]
// Range (min … max): 1.2 ms … 2.3 ms 67 runs
// Benchmark 2: ./micro 1024 temp --preallocate
// Time (mean ± σ): 1.8 ms ± 0.1 ms [User: 0.6 ms, System: 0.1 ms]
// Range (min … max): 1.4 ms … 2.2 ms 121 runs
// Summary
// './micro 1024 temp --preallocate' ran
// 1.01 ± 0.13 times faster than './micro 1024 temp'
// hyperfine "./micro 65432 temp" "./micro 65432 temp --preallocate" --prepare="rm -rf temp && free && sync && echo 3 > /proc/sys/vm/drop_caches && free"
// Benchmark 1: ./micro 65432 temp
// Time (mean ± σ): 1.8 ms ± 0.2 ms [User: 0.7 ms, System: 0.1 ms]
// Range (min … max): 1.2 ms … 2.3 ms 94 runs
// Benchmark 2: ./micro 65432 temp --preallocate
// Time (mean ± σ): 2.0 ms ± 0.1 ms [User: 0.6 ms, System: 0.1 ms]
// Range (min … max): 1.7 ms … 2.3 ms 108 runs
// Summary
// './micro 65432 temp' ran
// 1.08 ± 0.12 times faster than './micro 65432 temp --preallocate'
// hyperfine "./micro 654320 temp" "./micro 654320 temp --preallocate" --prepare="rm -rf temp && free && sync && echo 3 > /proc/sys/vm/drop_caches && free"
// Benchmark 1: ./micro 654320 temp
// Time (mean ± σ): 2.3 ms ± 0.2 ms [User: 0.9 ms, System: 0.3 ms]
// Range (min … max): 1.9 ms … 2.9 ms 96 runs
// Benchmark 2: ./micro 654320 temp --preallocate
// Time (mean ± σ): 2.2 ms ± 0.1 ms [User: 0.9 ms, System: 0.2 ms]
// Range (min … max): 1.9 ms … 2.7 ms 115 runs
// Warning: Command took less than 5 ms to complete. Results might be inaccurate.
// Summary
// './micro 654320 temp --preallocate' ran
// 1.04 ± 0.10 times faster than './micro 654320 temp'
// hyperfine "./micro 6543200 temp" "./micro 6543200 temp --preallocate" --prepare="rm -rf temp && free && sync && echo 3 > /proc/sys/vm/drop_caches && free"
// Benchmark 1: ./micro 6543200 temp
// Time (mean ± σ): 6.3 ms ± 0.4 ms [User: 0.4 ms, System: 4.9 ms]
// Range (min … max): 5.8 ms … 8.6 ms 84 runs
// Benchmark 2: ./micro 6543200 temp --preallocate
// Time (mean ± σ): 5.5 ms ± 0.3 ms [User: 0.5 ms, System: 3.9 ms]
// Range (min … max): 5.1 ms … 7.1 ms 93 runs
// Summary
// './micro 6543200 temp --preallocate' ran
// 1.14 ± 0.09 times faster than './micro 6543200 temp'
// hyperfine "./micro 65432000 temp" "./micro 65432000 temp --preallocate" --prepare="rm -rf temp && free && sync && echo 3 > /proc/sys/vm/drop_caches && free"
// Benchmark 1: ./micro 65432000 temp
// Time (mean ± σ): 52.9 ms ± 0.4 ms [User: 3.1 ms, System: 48.7 ms]
// Range (min … max): 52.4 ms … 54.4 ms 36 runs
// Benchmark 2: ./micro 65432000 temp --preallocate
// Time (mean ± σ): 44.6 ms ± 0.8 ms [User: 2.3 ms, System: 41.2 ms]
// Range (min … max): 44.0 ms … 47.3 ms 37 runs
// Summary
// './micro 65432000 temp --preallocate' ran
// 1.19 ± 0.02 times faster than './micro 65432000 temp'
// hyperfine "./micro 65432000 temp" "./micro 65432000 temp --preallocate" --prepare="rm -rf temp"
// Benchmark 1: ./micro 65432000 temp
// Time (mean ± σ): 51.7 ms ± 0.9 ms [User: 2.1 ms, System: 49.6 ms]
// Range (min … max): 50.7 ms … 54.1 ms 49 runs
// Benchmark 2: ./micro 65432000 temp --preallocate
// Time (mean ± σ): 43.8 ms ± 2.3 ms [User: 2.2 ms, System: 41.4 ms]
// Range (min … max): 42.7 ms … 54.7 ms 56 runs
// Summary
// './micro 65432000 temp --preallocate' ran
// 1.18 ± 0.06 times faster than './micro 65432000 temp'
//
_ = std.os.linux.fallocate(fd, 0, @as(i64, @intCast(offset)), len);
}
/// splice() moves data between two file descriptors without copying
/// between kernel address space and user address space. It
/// transfers up to len bytes of data from the file descriptor fd_in
/// to the file descriptor fd_out, where one of the file descriptors
/// must refer to a pipe.
pub fn splice(fd_in: std.os.fd_t, off_in: ?*i64, fd_out: std.os.fd_t, off_out: ?*i64, len: usize, flags: u32) usize {
return std.os.linux.syscall6(
.splice,
@as(usize, @bitCast(@as(isize, fd_in))),
@intFromPtr(off_in),
@as(usize, @bitCast(@as(isize, fd_out))),
@intFromPtr(off_out),
len,
flags,
);
}
// System related
pub const struct_sysinfo = extern struct {
uptime: c_long align(8),
loads: [3]c_ulong,
totalram: c_ulong,
freeram: c_ulong,
sharedram: c_ulong,
bufferram: c_ulong,
totalswap: c_ulong,
freeswap: c_ulong,
procs: u16,
pad: u16,
totalhigh: c_ulong,
freehigh: c_ulong,
mem_unit: u32,
pub fn _f(self: anytype) @import("std").zig.c_translation.FlexibleArrayType(@TypeOf(self), u8) {
const Intermediate = @import("std").zig.c_translation.FlexibleArrayType(@TypeOf(self), u8);
const ReturnType = @import("std").zig.c_translation.FlexibleArrayType(@TypeOf(self), u8);
return @as(ReturnType, @ptrCast(@alignCast(@as(Intermediate, @ptrCast(self)) + 108)));
}
};
pub extern fn sysinfo(__info: [*c]struct_sysinfo) c_int;
pub fn getFreeMemory() u64 {
var info: struct_sysinfo = undefined;
if (sysinfo(&info) == @as(c_int, 0)) return @as(u64, @bitCast(info.freeram)) *% @as(c_ulong, @bitCast(@as(c_ulong, info.mem_unit)));
return 0;
}
pub fn getTotalMemory() u64 {
var info: struct_sysinfo = undefined;
if (sysinfo(&info) == @as(c_int, 0)) return @as(u64, @bitCast(info.totalram)) *% @as(c_ulong, @bitCast(@as(c_ulong, info.mem_unit)));
return 0;
}
pub fn getSystemUptime() u64 {
var info: struct_sysinfo = undefined;
if (sysinfo(&info) == @as(c_int, 0)) return @as(u64, @bitCast(info.uptime));
return 0;
}
pub fn getSystemLoadavg() [3]f64 {
var info: struct_sysinfo = undefined;
if (sysinfo(&info) == @as(c_int, 0)) {
return [3]f64{
std.math.ceil((@as(f64, @floatFromInt(info.loads[0])) / 65536.0) * 100.0) / 100.0,
std.math.ceil((@as(f64, @floatFromInt(info.loads[1])) / 65536.0) * 100.0) / 100.0,
std.math.ceil((@as(f64, @floatFromInt(info.loads[2])) / 65536.0) * 100.0) / 100.0,
};
}
return [3]f64{ 0, 0, 0 };
}
pub fn get_version(name_buffer: *[bun.HOST_NAME_MAX]u8) []const u8 {
const uts = std.os.uname();
const result = bun.sliceTo(&uts.version, 0);
bun.copy(u8, name_buffer, result);
return name_buffer[0..result.len];
}
pub fn get_release(name_buffer: *[bun.HOST_NAME_MAX]u8) []const u8 {
const uts = std.os.uname();
const result = bun.sliceTo(&uts.release, 0);
bun.copy(u8, name_buffer, result);
return name_buffer[0..result.len];
}
// Taken from spawn.h header
pub const POSIX_SPAWN = struct {
pub const RESETIDS = 0x01;
pub const SETPGROUP = 0x02;
pub const SETSIGDEF = 0x04;
pub const SETSIGMASK = 0x08;
pub const SETSCHEDPARAM = 0x10;
pub const SETSCHEDULER = 0x20;
pub const USEVFORK = 0x40;
pub const SETSID = 0x80;
};
const fd_t = std.os.fd_t;
const pid_t = std.os.pid_t;
const mode_t = std.os.mode_t;
const sigset_t = std.c.sigset_t;
const sched_param = std.os.sched_param;
pub const posix_spawnattr_t = extern struct {
__flags: c_short,
__pgrp: pid_t,
__sd: sigset_t,
__ss: sigset_t,
__sp: struct_sched_param,
__policy: c_int,
__pad: [16]c_int,
};
pub const struct_sched_param = extern struct {
sched_priority: c_int,
};
pub const struct___spawn_action = opaque {};
pub const posix_spawn_file_actions_t = extern struct {
__allocated: c_int,
__used: c_int,
__actions: ?*struct___spawn_action,
__pad: [16]c_int,
};
pub extern "c" fn posix_spawn(
pid: *pid_t,
path: [*:0]const u8,
actions: ?*const posix_spawn_file_actions_t,
attr: ?*const posix_spawnattr_t,
argv: [*:null]?[*:0]const u8,
env: [*:null]?[*:0]const u8,
) c_int;
pub extern "c" fn posix_spawnp(
pid: *pid_t,
path: [*:0]const u8,
actions: ?*const posix_spawn_file_actions_t,
attr: ?*const posix_spawnattr_t,
argv: [*:null]?[*:0]const u8,
env: [*:null]?[*:0]const u8,
) c_int;
pub extern fn posix_spawnattr_init(__attr: *posix_spawnattr_t) c_int;
pub extern fn posix_spawnattr_destroy(__attr: *posix_spawnattr_t) c_int;
pub extern fn posix_spawnattr_getsigdefault(noalias __attr: [*c]const posix_spawnattr_t, noalias __sigdefault: [*c]sigset_t) c_int;
pub extern fn posix_spawnattr_setsigdefault(noalias __attr: [*c]posix_spawnattr_t, noalias __sigdefault: [*c]const sigset_t) c_int;
pub extern fn posix_spawnattr_getsigmask(noalias __attr: [*c]const posix_spawnattr_t, noalias __sigmask: [*c]sigset_t) c_int;
pub extern fn posix_spawnattr_setsigmask(noalias __attr: [*c]posix_spawnattr_t, noalias __sigmask: [*c]const sigset_t) c_int;
pub extern fn posix_spawnattr_getflags(noalias __attr: [*c]const posix_spawnattr_t, noalias __flags: [*c]c_short) c_int;
pub extern fn posix_spawnattr_setflags(_attr: [*c]posix_spawnattr_t, __flags: c_short) c_int;
pub extern fn posix_spawnattr_getpgroup(noalias __attr: [*c]const posix_spawnattr_t, noalias __pgroup: [*c]pid_t) c_int;
pub extern fn posix_spawnattr_setpgroup(__attr: [*c]posix_spawnattr_t, __pgroup: pid_t) c_int;
pub extern fn posix_spawnattr_getschedpolicy(noalias __attr: [*c]const posix_spawnattr_t, noalias __schedpolicy: [*c]c_int) c_int;
pub extern fn posix_spawnattr_setschedpolicy(__attr: [*c]posix_spawnattr_t, __schedpolicy: c_int) c_int;
pub extern fn posix_spawnattr_getschedparam(noalias __attr: [*c]const posix_spawnattr_t, noalias __schedparam: [*c]struct_sched_param) c_int;
pub extern fn posix_spawnattr_setschedparam(noalias __attr: [*c]posix_spawnattr_t, noalias __schedparam: [*c]const struct_sched_param) c_int;
pub extern fn posix_spawn_file_actions_init(__file_actions: *posix_spawn_file_actions_t) c_int;
pub extern fn posix_spawn_file_actions_destroy(__file_actions: *posix_spawn_file_actions_t) c_int;
pub extern fn posix_spawn_file_actions_addopen(noalias __file_actions: *posix_spawn_file_actions_t, __fd: c_int, noalias __path: [*:0]const u8, __oflag: c_int, __mode: mode_t) c_int;
pub extern fn posix_spawn_file_actions_addclose(__file_actions: *posix_spawn_file_actions_t, __fd: c_int) c_int;
pub extern fn posix_spawn_file_actions_adddup2(__file_actions: *posix_spawn_file_actions_t, __fd: c_int, __newfd: c_int) c_int;
pub const POSIX_SPAWN_RESETIDS = @as(c_int, 0x01);
pub const POSIX_SPAWN_SETPGROUP = @as(c_int, 0x02);
pub const POSIX_SPAWN_SETSIGDEF = @as(c_int, 0x04);
pub const POSIX_SPAWN_SETSIGMASK = @as(c_int, 0x08);
pub const POSIX_SPAWN_SETSCHEDPARAM = @as(c_int, 0x10);
pub const POSIX_SPAWN_SETSCHEDULER = @as(c_int, 0x20);
pub const POSIX_SPAWN_SETSID = @as(c_int, 0x80);
const posix_spawn_file_actions_addfchdir_np_type = *const fn (actions: *posix_spawn_file_actions_t, filedes: fd_t) c_int;
const posix_spawn_file_actions_addchdir_np_type = *const fn (actions: *posix_spawn_file_actions_t, path: [*:0]const u8) c_int;
/// When not available, these functions will return 0.
pub fn posix_spawn_file_actions_addfchdir_np(actions: *posix_spawn_file_actions_t, filedes: std.os.fd_t) c_int {
const function = bun.C.dlsym(posix_spawn_file_actions_addfchdir_np_type, "posix_spawn_file_actions_addfchdir_np") orelse
return 0;
return function(actions, filedes);
}
/// When not available, these functions will return 0.
pub fn posix_spawn_file_actions_addchdir_np(actions: *posix_spawn_file_actions_t, path: [*:0]const u8) c_int {
const function = bun.C.dlsym(posix_spawn_file_actions_addchdir_np_type, "posix_spawn_file_actions_addchdir_np") orelse
return 0;
return function(actions, path);
}
pub extern fn vmsplice(fd: c_int, iovec: [*]const std.os.iovec, iovec_count: usize, flags: u32) isize;
const net_c = @cImport({
@cInclude("ifaddrs.h"); // getifaddrs, freeifaddrs
@cInclude("net/if.h"); // IFF_RUNNING, IFF_UP
@cInclude("fcntl.h"); // F_DUPFD_CLOEXEC
@cInclude("sys/socket.h");
});
pub const FD_CLOEXEC = net_c.FD_CLOEXEC;
pub const freeifaddrs = net_c.freeifaddrs;
pub const getifaddrs = net_c.getifaddrs;
pub const ifaddrs = net_c.ifaddrs;
pub const IFF_LOOPBACK = net_c.IFF_LOOPBACK;
pub const IFF_RUNNING = net_c.IFF_RUNNING;
pub const IFF_UP = net_c.IFF_UP;
pub const MSG_DONTWAIT = net_c.MSG_DONTWAIT;
pub const MSG_NOSIGNAL = net_c.MSG_NOSIGNAL;
pub const F = struct {
pub const DUPFD_CLOEXEC = net_c.F_DUPFD_CLOEXEC;
pub const DUPFD = net_c.F_DUPFD;
};
pub const Mode = u32;
pub const E = std.os.E;
pub const S = std.os.S;
pub extern "c" fn umask(Mode) Mode;
pub fn getErrno(rc: anytype) E {
return std.c.getErrno(rc);
}
pub const getuid = std.os.linux.getuid;
pub const getgid = std.os.linux.getgid;
pub const linux_fs = if (bun.Environment.isLinux) @cImport({
@cInclude("linux/fs.h");
}) else struct {};
/// https://man7.org/linux/man-pages/man2/ioctl_ficlone.2.html
///
/// Support for FICLONE is dependent on the filesystem driver.
pub fn ioctl_ficlone(dest_fd: bun.FileDescriptor, srcfd: bun.FileDescriptor) usize {
return std.os.linux.ioctl(dest_fd.cast(), linux_fs.FICLONE, @intCast(srcfd.int()));
}
pub const RWFFlagSupport = enum(u8) {
unknown = 0,
unsupported = 2,
supported = 1,
var rwf_bool = std.atomic.Value(RWFFlagSupport).init(RWFFlagSupport.unknown);
pub fn isLinuxKernelVersionWithBuggyRWF_NONBLOCK() bool {
return bun.linuxKernelVersion().major == 5 and switch (bun.linuxKernelVersion().minor) {
9, 10 => true,
else => false,
};
}
pub fn disable() void {
rwf_bool.store(.unsupported, .Monotonic);
}
/// Workaround for https://github.com/google/gvisor/issues/2601
pub fn isMaybeSupported() bool {
if (comptime !bun.Environment.isLinux) return false;
switch (rwf_bool.load(.Monotonic)) {
.unknown => {
if (isLinuxKernelVersionWithBuggyRWF_NONBLOCK()) {
rwf_bool.store(.unsupported, .Monotonic);
return false;
}
rwf_bool.store(.supported, .Monotonic);
return true;
},
.supported => {
return true;
},
else => {
return false;
},
}
unreachable;
}
};
pub extern "C" fn sys_preadv2(
fd: c_int,
iov: [*]const std.os.iovec,
iovcnt: c_int,
offset: std.os.off_t,
flags: c_uint,
) isize;
pub extern "C" fn sys_pwritev2(
fd: c_int,
iov: [*]const std.os.iovec_const,
iovcnt: c_int,
offset: std.os.off_t,
flags: c_uint,
) isize;