GithubHelp home page GithubHelp logo

ma's People

Contributors

bzimmer avatar

Stargazers

 avatar  avatar  avatar

Watchers

 avatar

ma's Issues

fatal error: all goroutines are asleep - deadlock!

Ingesting a large number of files:


goroutine 1 [semacquire, 1 minutes]:
sync.runtime_Semacquire(0x14000167718?)
	/opt/hostedtoolcache/go/1.20.4/x64/src/runtime/sema.go:62 +0x2c
sync.(*WaitGroup).Wait(0x1400010eb48)
	/opt/hostedtoolcache/go/1.20.4/x64/src/sync/waitgroup.go:116 +0x78
golang.org/x/sync/errgroup.(*Group).Wait(0x1400010eb40)
	/home/runner/go/pkg/mod/golang.org/x/[email protected]/errgroup/errgroup.go:53 +0x2c
github.com/bzimmer/ma.(*entangler).cp(0x140000345a0, {0x1007fbe98, 0x140000280b0}, {0x140000712e0, 0x1, 0x2}, {0x16faf356d, 0x18})
	/home/runner/work/ma/ma/cp.go:111 +0x1a8
github.com/bzimmer/ma.cp(0x1400010e900)
	/home/runner/work/ma/ma/cp.go:257 +0x344
github.com/urfave/cli/v2.(*Command).Run(0x140001a6000, 0x1400010e900, {0x14000034550, 0x5, 0x5})
	/home/runner/go/pkg/mod/github.com/urfave/cli/[email protected]/command.go:274 +0x75c
github.com/urfave/cli/v2.(*Command).Run(0x140001a82c0, 0x1400010e600, {0x1400001e1e0, 0x6, 0x6})
	/home/runner/go/pkg/mod/github.com/urfave/cli/[email protected]/command.go:267 +0x97c
github.com/urfave/cli/v2.(*App).RunContext(0x140001aa000, {0x1007fbe98?, 0x140000280b0}, {0x1400001e1e0, 0x6, 0x6})
	/home/runner/go/pkg/mod/github.com/urfave/cli/[email protected]/app.go:332 +0x604
main.main()
	/home/runner/work/ma/ma/cmd/ma/main.go:194 +0x1188

goroutine 6 [select]:
github.com/bzimmer/ma.(*entangler).cp.func1()
	/home/runner/work/ma/ma/cp.go:99 +0x340
golang.org/x/sync/errgroup.(*Group).Go.func1()
	/home/runner/go/pkg/mod/golang.org/x/[email protected]/errgroup/errgroup.go:75 +0x5c
created by golang.org/x/sync/errgroup.(*Group).Go
	/home/runner/go/pkg/mod/golang.org/x/[email protected]/errgroup/errgroup.go:72 +0xa0

gracefully handle permission denied

If a directory results in a "permission denied" error ma fails:

/tmp > ls -lRt foo
total 0
drwxr-xr-x  6 bzimmer  wheel   192B Nov  1 10:17 bar

foo/bar:
total 0
drwxr-xr-x  2 bzimmer  wheel    64B Nov  1 10:17 too
d---------  2 bzimmer  wheel    64B Nov  1 10:17 moo
drwxr-xr-x  2 bzimmer  wheel    64B Nov  1 10:17 boo
drwxr-xr-x  2 bzimmer  wheel    64B Nov  1 10:17 baz

foo/bar/too:

foo/bar/moo:
ls: moo: Permission denied

foo/bar/boo:

foo/bar/baz:
/tmp > ma cp -c 3 ./foo ./bar
2021-11-01T10:24:06-07:00 ERR ma error="open foo/bar/moo: permission denied"
2021-11-01T10:24:06-07:00 INF counters count=5 metric=ma.cp.visited.directories
2021-11-01T10:24:06-07:00 INF samples count=1 max=0.0006629310082644224 mean=0.0006629310082644224 metric=ma.cp.elapsed min=0.0006629310082644224 stddev=0

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.