s3 pagination failures #523

New issue

Closed

opened 2025-12-28 17:37:41 +00:00 by sami · 0 comments

sami commented

2025-12-28 17:37:41 +00:00

Owner

Originally created by @evgeniiz321 on GitHub (May 21, 2025).

Originally assigned to: @smallhive on GitHub.

https://github.com/nspcc-dev/neofs-testcases/pull/1066 - tests are here

using cli (test_s3_pagination_in_objects_versions_listing_via_cli) - aws --no-verify-ssl --profile profile__FoMEOq5RS9 s3api list-object-versions --bucket 4823586c-cbcb-45f8-9a2b-21a4e0ea7457 --endpoint https://localhost:50071 --page-size 5
hangs infinitely, but should return first 5 elements
using boto3 (test_s3_pagination_in_objects_versions_listing_via_boto3):

            paginator = self.s3_client.get_paginator("list_object_versions")
            pages = paginator.paginate(Bucket=bucket, PaginationConfig={"PageSize": 5, "MaxItems": objects_count})
            results = []
>           for page in pages:

fails with:

E                   botocore.exceptions.PaginationError: Error during pagination: The same next token was received twice: {'KeyMarker': 'temp_file_453b5a6b-dda3-45ef-bdd0-815c2004038b', 'VersionIdMarker': 'DF99d361CQXNa8PBCwurpYuv36MGMe1ATJXGVjgtYCUo'}

Originally created by @evgeniiz321 on GitHub (May 21, 2025). Originally assigned to: @smallhive on GitHub. https://github.com/nspcc-dev/neofs-testcases/pull/1066 - tests are here 1. using cli (test_s3_pagination_in_objects_versions_listing_via_cli) - ```aws --no-verify-ssl --profile profile__FoMEOq5RS9 s3api list-object-versions --bucket 4823586c-cbcb-45f8-9a2b-21a4e0ea7457 --endpoint https://localhost:50071 --page-size 5``` hangs infinitely, but should return first 5 elements 2. using boto3 (test_s3_pagination_in_objects_versions_listing_via_boto3): ``` paginator = self.s3_client.get_paginator("list_object_versions") pages = paginator.paginate(Bucket=bucket, PaginationConfig={"PageSize": 5, "MaxItems": objects_count}) results = [] > for page in pages: ``` fails with: ``` E botocore.exceptions.PaginationError: Error during pagination: The same next token was received twice: {'KeyMarker': 'temp_file_453b5a6b-dda3-45ef-bdd0-815c2004038b', 'VersionIdMarker': 'DF99d361CQXNa8PBCwurpYuv36MGMe1ATJXGVjgtYCUo'} ```