The downloaded from HTTP-gate binary file does not match the original #3

Closed
opened 2025-12-28 17:35:43 +00:00 by sami · 2 comments
Owner

Originally created by @anatoly-bogatyrev on GitHub (Dec 4, 2020).

versions:
nspccdev/neofs-http-gate:0.12.1
neofs-storage:0.12.1-9-g6cddc91

The downloaded from HTTP-gate binary file does not match the original.

  1. Generate a binary file

  2. Put the object to NeoFS

  3. Get the object from NeoFS by neofs-cli and check binary diff - files are equal

  4. Get the object from HTTP-gate and check binary diff - binary file does not match the original

diff -y <(xxd GK8367sGYkhWZdiVDQhcpTqSNPzEWRyfVTvKJW7QgcmN_2ZQ4eQvPVBJ16paqV75Z3gVXeudhL91FBgKFSYX82gL9) <(xxd s_file_read)
00000000: c2a1 4936 0629 c2b9 3ec3 9fc3 bfc2 b749  ..I6.)..>. |	00000000: a149 3606 29b9 3edf ffb7 494c b1bb ddc3  .I6.).>...
00000010: 4cc2 b1c2 bbc3 9dc3 83                   L........  |	00000010: f491 57a0 775c beaf fa6e f5c2 6962 6964  ..W.w\...n
							      >	00000020: dba7 5701 445f 71cb 6d4d 55b4 1018 df28  ..W.D_q.mM
							      >	00000030: 69f7 8d27 caa7 a10e eb11 ddbf b9fd 8d4b  i..'......
							      >	00000040: 52cf 26bd 35ad 0e44 3b09 b73e aab4 ae72  R.&.5..D;.
							      >	00000050: 2c36 fda5 eac9 f6f8 8534 352f d471 96dc  ,6.......4
							      >	00000060: 799a 2023 15c0 7e83 0651 a20b 2db3 1719  y. #..~..Q
							      >	00000070: 3c73 9526 de1c 7380 c6ca 0e61 3fda d212  <s.&..s...
							      >	00000080: ace8 0478 8100 58a2 35b9 0caa ba98 71ea  ...x..X.5.
							      >	00000090: 8ce9 3753 74dc 401c f36a 53f9 e9d8 0a3e  ..7St.@..j
							      >	000000a0: 1bb2 a5b4 58fe 6203 eb22 8bf9 2b0c a50b  ....X.b.."
							      >	000000b0: 5133 01c1 4626 fb47 08d8 277f 32a0 1bce  Q3..F&.G..
							      >	000000c0: 88b9 8cdd c2f7 398a ccc9 9947 08d5 b023  ......9...
							      >	000000d0: 44d6 5bd2 361d fa8e 0edb a4a1 dfe0 564d  D.[.6.....
							      >	000000e0: 9a1a 2e1e 2f60 df04 10e5 5f4d a6b3 ad3f  ..../`....
							      >	000000f0: 89d1 fd47 1415 ffce 5cf5 bb37 97dd 3709  ...G....\.
							      >	00000100: d2df f10a 704c 3174 b2ae 6bbf 7a2b b6ec  ....pL1t..
							      >	00000110: 48a6 355c 448f a986 cb53 48a6 4fbd 38ce  H.5\D....S
							      >	00000120: b603 068b a6a8 6bf8 ebd1 6f9a fc62 1ef6  ......k...
							      >	00000130: 32dd 0948 ef91 704a 74d8 9505 c29a f29c  2..H..pJt.
							      >	00000140: bb86 fe96 7877 9c1c 2e9c 1181 b299 e993  ....xw....
							      >	00000150: 9185 752f 5b2a f8ae 58a8 adcb 14a2 26d6  ..u/[*..X.
							      >	00000160: ba00 f60c 3df6 4bfa f76d 1acd a0cc b9ea  ....=.K..m
							      >	00000170: 040a 2eda 0af7 0448 9495 7c98 4f2f 0300  .......H..
							      >	00000180: d7e0 a0f8 5ae3 727b 688a f87b 21bc 9601  ....Z.r{h.
							      >	00000190: e66d 55ab bef3 8139 b508 df1f fd61 d53f  .mU....9..
							      >	000001a0: 02f5 731a d207 b0da 117d 07dd 4e98 d10e  ..s......}
							      >	000001b0: 92ec 7255 af58 5ec3 2bae ce1d 3429 a023  ..rU.X^.+.
							      >	000001c0: 875c a2a4 e1ea 152d 83ba b28e 6e5c c5cb  .\.....-..
							      >	000001d0: 68ec fdfd a68c 5d8d 8bfa 75c7 1f33 44fe  h.....]...
							      >	000001e0: 38b5 cdf3 73cd 6090 f11b f56f 6d30 96fa  8...s.`...
							      >	000001f0: 306c b43f 8e48 636b 9406 cf36 c9d7 75f7  0l.?.Hck..
							      >	00000200: ecf1 0434 4338 88d7 bb32 949e 49dd 4f24  ...4C8...2
							      >	00000210: 8d3f 0cbb 3eef 00e2 ef59 4416 074a 91e8  .?..>....Y
							      >	00000220: 63b1 bfa1 46c7 744a aa3a 96b3 fb82 4730  c...F.tJ.:
							      >	00000230: 2d50 153d d90a a4e4 c2bc 7f66 d067 3679  -P.=......
							      >	00000240: 5321 add0 2ce3 984e a03a 88d7 f2c2 fc98  S!..,..N.:
							      >	00000250: f984 f806 4a0b 1d15 c096 a0ea 6a1d 6964  ....J.....
							      >	00000260: ac50 343e aba8 af4c a3ae d8b1 f0b5 815b  .P4>...L..
							      >	00000270: 93c8 6ca8 20ef 0f27 c510 4673 dec9 7cf8  ..l. ..'..
							      >	00000280: 4ad1 18e5 47de 5287 a62b 99f5 cfe4 1a65  J...G.R..+
							      >	00000290: 7a79 4c7f 9743 8620 4d13 79a8 8805 4384  zyL..C. M.
							      >	000002a0: edc0 f50e 7f9a 4b30 3487 9f69 a320 2ebd  ......K04.
							      >	000002b0: 2538 6455 1c4b 7574 e960 0dfa 588c ec5a  %8dU.Kut.`
							      >	000002c0: 2442 07ee ae8a 3cd5 2644 7ddc af8a 414c  $B....<.&D
							      >	000002d0: 78ba f211 20e5 d4b9 c044 42cb 49f8 1e04  x... ....D
							      >	000002e0: 1079 e4fc 4f6a bda2 78b3 01c3 eda4 4a3e  .y..Oj..x.
							      >	000002f0: fbdb 48a0 e0c6 95bf 6c5c 6ac4 d092 97ad  ..H.....l\
							      >	00000300: 7fc2 35ef d17a 6a69 8da1 685a 0022 a215  ..5..zji..
							      >	00000310: 4220 3486 112c f444 c392 d392 f51f 5545  B 4..,.D..
							      >	00000320: a969 b53b e3db 510c 245c ff72 f806 1b63  .i.;..Q.$\
							      >	00000330: 6c07 1e1c 5d8c b18d 74e2 e2b3 fd88 23e0  l...]...t.
							      >	00000340: b0ba 5ebc 9827 07a3 287a 1f16 98a7 39af  ..^..'..(z
							      >	00000350: 785c 7e90 c7e9 2da9 6379 e2c3 e41f 8a59  x\~...-.cy
							      >	00000360: d411 6409 6776 f361 fe08 c7b0 9379 1966  ..d.gv.a..
							      >	00000370: 94a1 aba3 e987 18fd eae9 c8e6 c230 da2d  ..........
							      >	00000380: a74e 0e7a 5f60 a4e4 2153 1e3a 5bf8 bd6c  .N.z_`..!S
							      >	00000390: b90a 1519 a316 5ff7 9275 25af 7764 6e51  ......_..u
							      >	000003a0: 0276 a776 a927 66dc 373d dfb7 b683 c8fb  .v.v.'f.7=
							      >	000003b0: 4981 918d 7587 81fa dfff 24c6 694e ed31  I...u.....
							      >	000003c0: 77ce 397d d583 7e94 6c70 9dcd 4361 06f9  w.9}..~.lp
							      >	000003d0: cd11 16cd cbbd 37c1 68af 03d5 70cc d81c  ......7.h.
							      >	000003e0: 3b44 58eb 71e9 4f13 f9cf 73bc 46d0 ddd4  ;DX.q.O...
							      >	000003f0: acea 7010 57b8 847a cb2f 3b09 3ad0 17bb  ..p.W..z./

Originally created by @anatoly-bogatyrev on GitHub (Dec 4, 2020). versions: nspccdev/neofs-http-gate:0.12.1 neofs-storage:0.12.1-9-g6cddc91 The downloaded from HTTP-gate binary file does not match the original. 1. Generate a binary file 2. Put the object to NeoFS 3. Get the object from NeoFS by neofs-cli and check binary diff - files are equal 4. Get the object from HTTP-gate and check binary diff - binary file does not match the original ``` diff -y <(xxd GK8367sGYkhWZdiVDQhcpTqSNPzEWRyfVTvKJW7QgcmN_2ZQ4eQvPVBJ16paqV75Z3gVXeudhL91FBgKFSYX82gL9) <(xxd s_file_read) 00000000: c2a1 4936 0629 c2b9 3ec3 9fc3 bfc2 b749 ..I6.)..>. | 00000000: a149 3606 29b9 3edf ffb7 494c b1bb ddc3 .I6.).>... 00000010: 4cc2 b1c2 bbc3 9dc3 83 L........ | 00000010: f491 57a0 775c beaf fa6e f5c2 6962 6964 ..W.w\...n > 00000020: dba7 5701 445f 71cb 6d4d 55b4 1018 df28 ..W.D_q.mM > 00000030: 69f7 8d27 caa7 a10e eb11 ddbf b9fd 8d4b i..'...... > 00000040: 52cf 26bd 35ad 0e44 3b09 b73e aab4 ae72 R.&.5..D;. > 00000050: 2c36 fda5 eac9 f6f8 8534 352f d471 96dc ,6.......4 > 00000060: 799a 2023 15c0 7e83 0651 a20b 2db3 1719 y. #..~..Q > 00000070: 3c73 9526 de1c 7380 c6ca 0e61 3fda d212 <s.&..s... > 00000080: ace8 0478 8100 58a2 35b9 0caa ba98 71ea ...x..X.5. > 00000090: 8ce9 3753 74dc 401c f36a 53f9 e9d8 0a3e ..7St.@..j > 000000a0: 1bb2 a5b4 58fe 6203 eb22 8bf9 2b0c a50b ....X.b.." > 000000b0: 5133 01c1 4626 fb47 08d8 277f 32a0 1bce Q3..F&.G.. > 000000c0: 88b9 8cdd c2f7 398a ccc9 9947 08d5 b023 ......9... > 000000d0: 44d6 5bd2 361d fa8e 0edb a4a1 dfe0 564d D.[.6..... > 000000e0: 9a1a 2e1e 2f60 df04 10e5 5f4d a6b3 ad3f ..../`.... > 000000f0: 89d1 fd47 1415 ffce 5cf5 bb37 97dd 3709 ...G....\. > 00000100: d2df f10a 704c 3174 b2ae 6bbf 7a2b b6ec ....pL1t.. > 00000110: 48a6 355c 448f a986 cb53 48a6 4fbd 38ce H.5\D....S > 00000120: b603 068b a6a8 6bf8 ebd1 6f9a fc62 1ef6 ......k... > 00000130: 32dd 0948 ef91 704a 74d8 9505 c29a f29c 2..H..pJt. > 00000140: bb86 fe96 7877 9c1c 2e9c 1181 b299 e993 ....xw.... > 00000150: 9185 752f 5b2a f8ae 58a8 adcb 14a2 26d6 ..u/[*..X. > 00000160: ba00 f60c 3df6 4bfa f76d 1acd a0cc b9ea ....=.K..m > 00000170: 040a 2eda 0af7 0448 9495 7c98 4f2f 0300 .......H.. > 00000180: d7e0 a0f8 5ae3 727b 688a f87b 21bc 9601 ....Z.r{h. > 00000190: e66d 55ab bef3 8139 b508 df1f fd61 d53f .mU....9.. > 000001a0: 02f5 731a d207 b0da 117d 07dd 4e98 d10e ..s......} > 000001b0: 92ec 7255 af58 5ec3 2bae ce1d 3429 a023 ..rU.X^.+. > 000001c0: 875c a2a4 e1ea 152d 83ba b28e 6e5c c5cb .\.....-.. > 000001d0: 68ec fdfd a68c 5d8d 8bfa 75c7 1f33 44fe h.....]... > 000001e0: 38b5 cdf3 73cd 6090 f11b f56f 6d30 96fa 8...s.`... > 000001f0: 306c b43f 8e48 636b 9406 cf36 c9d7 75f7 0l.?.Hck.. > 00000200: ecf1 0434 4338 88d7 bb32 949e 49dd 4f24 ...4C8...2 > 00000210: 8d3f 0cbb 3eef 00e2 ef59 4416 074a 91e8 .?..>....Y > 00000220: 63b1 bfa1 46c7 744a aa3a 96b3 fb82 4730 c...F.tJ.: > 00000230: 2d50 153d d90a a4e4 c2bc 7f66 d067 3679 -P.=...... > 00000240: 5321 add0 2ce3 984e a03a 88d7 f2c2 fc98 S!..,..N.: > 00000250: f984 f806 4a0b 1d15 c096 a0ea 6a1d 6964 ....J..... > 00000260: ac50 343e aba8 af4c a3ae d8b1 f0b5 815b .P4>...L.. > 00000270: 93c8 6ca8 20ef 0f27 c510 4673 dec9 7cf8 ..l. ..'.. > 00000280: 4ad1 18e5 47de 5287 a62b 99f5 cfe4 1a65 J...G.R..+ > 00000290: 7a79 4c7f 9743 8620 4d13 79a8 8805 4384 zyL..C. M. > 000002a0: edc0 f50e 7f9a 4b30 3487 9f69 a320 2ebd ......K04. > 000002b0: 2538 6455 1c4b 7574 e960 0dfa 588c ec5a %8dU.Kut.` > 000002c0: 2442 07ee ae8a 3cd5 2644 7ddc af8a 414c $B....<.&D > 000002d0: 78ba f211 20e5 d4b9 c044 42cb 49f8 1e04 x... ....D > 000002e0: 1079 e4fc 4f6a bda2 78b3 01c3 eda4 4a3e .y..Oj..x. > 000002f0: fbdb 48a0 e0c6 95bf 6c5c 6ac4 d092 97ad ..H.....l\ > 00000300: 7fc2 35ef d17a 6a69 8da1 685a 0022 a215 ..5..zji.. > 00000310: 4220 3486 112c f444 c392 d392 f51f 5545 B 4..,.D.. > 00000320: a969 b53b e3db 510c 245c ff72 f806 1b63 .i.;..Q.$\ > 00000330: 6c07 1e1c 5d8c b18d 74e2 e2b3 fd88 23e0 l...]...t. > 00000340: b0ba 5ebc 9827 07a3 287a 1f16 98a7 39af ..^..'..(z > 00000350: 785c 7e90 c7e9 2da9 6379 e2c3 e41f 8a59 x\~...-.cy > 00000360: d411 6409 6776 f361 fe08 c7b0 9379 1966 ..d.gv.a.. > 00000370: 94a1 aba3 e987 18fd eae9 c8e6 c230 da2d .......... > 00000380: a74e 0e7a 5f60 a4e4 2153 1e3a 5bf8 bd6c .N.z_`..!S > 00000390: b90a 1519 a316 5ff7 9275 25af 7764 6e51 ......_..u > 000003a0: 0276 a776 a927 66dc 373d dfb7 b683 c8fb .v.v.'f.7= > 000003b0: 4981 918d 7587 81fa dfff 24c6 694e ed31 I...u..... > 000003c0: 77ce 397d d583 7e94 6c70 9dcd 4361 06f9 w.9}..~.lp > 000003d0: cd11 16cd cbbd 37c1 68af 03d5 70cc d81c ......7.h. > 000003e0: 3b44 58eb 71e9 4f13 f9cf 73bc 46d0 ddd4 ;DX.q.O... > 000003f0: acea 7010 57b8 847a cb2f 3b09 3ad0 17bb ..p.W..z./ ```
sami 2025-12-28 17:35:43 +00:00
  • closed this issue
  • added the
    bug
    label
Author
Owner

@im-kulikov commented on GitHub (Dec 4, 2020):

Can't reproduce

1-3 OK
4.

# Download object
→ curl -sS http://http.neofs.devenv/get/<cid>/<oid> -o ./2.jpeg

# Check current folder
→ ls
1.jpeg 2.jpeg

# 1.jpeg - original file
# 2.jpeg - downloaded file

→ diff -y 1.jpeg 2.jpeg

# empty output == files equal
@im-kulikov commented on GitHub (Dec 4, 2020): Can't reproduce 1-3 OK 4. ``` # Download object → curl -sS http://http.neofs.devenv/get/<cid>/<oid> -o ./2.jpeg # Check current folder → ls 1.jpeg 2.jpeg # 1.jpeg - original file # 2.jpeg - downloaded file → diff -y 1.jpeg 2.jpeg # empty output == files equal ```
Author
Owner

@anatoly-bogatyrev commented on GitHub (Dec 4, 2020):

The issue is not on the side of http-gate.

@anatoly-bogatyrev commented on GitHub (Dec 4, 2020): The issue is not on the side of http-gate.
Sign in to join this conversation.
No milestone
No project
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference
nspcc-dev/neofs-http-gw#3
No description provided.