Panic under high load #472

New issue

Closed

opened 2025-12-28 17:37:31 +00:00 by sami · 3 comments

sami commented

2025-12-28 17:37:31 +00:00

Owner

Originally created by @EESergey on GitHub (Nov 27, 2024).

Originally assigned to: @smallhive on GitHub.

This problem is reproduced in 100% of cases, with 50 PUT threads per node (12core, 24GB RAM).

Originally created by @EESergey on GitHub (Nov 27, 2024). Originally assigned to: @smallhive on GitHub. This problem is reproduced in 100% of cases, with 50 PUT threads per node (12core, 24GB RAM).

sami

2025-12-28 17:37:31 +00:00

closed this issue
added the
bug

S4

I4

U1
labels

sami commented

2025-12-28 17:37:32 +00:00

Author

Owner

@roman-khimov commented on GitHub (Nov 27, 2024):

We need the panic output here.

@roman-khimov commented on GitHub (Nov 27, 2024): We need the panic output here.

sami commented

2025-12-28 17:37:32 +00:00

Author

Owner

@roman-khimov commented on GitHub (Dec 2, 2024):

panic: runtime error: slice bounds out of range [:8192] with capacity 4096

goroutine 1300612 [running]:
bufio.(*Reader).ReadSlice(0xc004d97020, 0xa)
	bufio/bufio.go:351 +0x22e
github.com/nspcc-dev/neofs-s3-gw/api/auth/signer/v4.readChunkLine(0xc00212de90?)
	github.com/nspcc-dev/neofs-s3-gw/api/auth/signer/v4/chunked_reader.go:191 +0x1c
github.com/nspcc-dev/neofs-s3-gw/api/auth/signer/v4.(*chunkedReader).beginChunk(0xc004d97080)
	github.com/nspcc-dev/neofs-s3-gw/api/auth/signer/v4/chunked_reader.go:67 +0x25
github.com/nspcc-dev/neofs-s3-gw/api/auth/signer/v4.(*chunkedReader).Read(0xc004d97080, {0xc00964c000?, 0xff5d60?, 0x1?})
	github.com/nspcc-dev/neofs-s3-gw/api/auth/signer/v4/chunked_reader.go:153 +0x134
github.com/nspcc-dev/neofs-s3-gw/api/metrics.(*readCounter).Read(0xc00aea0378, {0xc00964c000?, 0xc006a3c2c0?, 0x0?})
	github.com/nspcc-dev/neofs-s3-gw/api/metrics/api.go:226 +0x28
github.com/nspcc-dev/neofs-s3-gw/api/layer.wrapReader.func1()
	github.com/nspcc-dev/neofs-s3-gw/api/layer/object.go:904 +0x75
created by github.com/nspcc-dev/neofs-s3-gw/api/layer.wrapReader in goroutine 1293869
	github.com/nspcc-dev/neofs-s3-gw/api/layer/object.go:901 +0x145

@roman-khimov commented on GitHub (Dec 2, 2024): ``` panic: runtime error: slice bounds out of range [:8192] with capacity 4096 goroutine 1300612 [running]: bufio.(*Reader).ReadSlice(0xc004d97020, 0xa) bufio/bufio.go:351 +0x22e github.com/nspcc-dev/neofs-s3-gw/api/auth/signer/v4.readChunkLine(0xc00212de90?) github.com/nspcc-dev/neofs-s3-gw/api/auth/signer/v4/chunked_reader.go:191 +0x1c github.com/nspcc-dev/neofs-s3-gw/api/auth/signer/v4.(*chunkedReader).beginChunk(0xc004d97080) github.com/nspcc-dev/neofs-s3-gw/api/auth/signer/v4/chunked_reader.go:67 +0x25 github.com/nspcc-dev/neofs-s3-gw/api/auth/signer/v4.(*chunkedReader).Read(0xc004d97080, {0xc00964c000?, 0xff5d60?, 0x1?}) github.com/nspcc-dev/neofs-s3-gw/api/auth/signer/v4/chunked_reader.go:153 +0x134 github.com/nspcc-dev/neofs-s3-gw/api/metrics.(*readCounter).Read(0xc00aea0378, {0xc00964c000?, 0xc006a3c2c0?, 0x0?}) github.com/nspcc-dev/neofs-s3-gw/api/metrics/api.go:226 +0x28 github.com/nspcc-dev/neofs-s3-gw/api/layer.wrapReader.func1() github.com/nspcc-dev/neofs-s3-gw/api/layer/object.go:904 +0x75 created by github.com/nspcc-dev/neofs-s3-gw/api/layer.wrapReader in goroutine 1293869 github.com/nspcc-dev/neofs-s3-gw/api/layer/object.go:901 +0x145 ```

sami commented

2025-12-28 17:37:32 +00:00

Author

Owner

@roman-khimov commented on GitHub (Dec 4, 2024):

Refs. https://docs.aws.amazon.com/AmazonS3/latest/API/sigv4-streaming.html.

@roman-khimov commented on GitHub (Dec 4, 2024): Refs. https://docs.aws.amazon.com/AmazonS3/latest/API/sigv4-streaming.html.