question

dalzzun avatar image
dalzzun asked

File Upload Fails repeatedly at some point.

We are developing PC client for Amazon Cloud Drive and we experience error when uploading large files. Server returns 400 Bad Request at some point and we want to know what is the problem and how can we fix the issue. Test file size is 4.60GB and it's a video file. We think that server kills the connection so libcurl returns error "HTTP error before end of send, stop sending" Is there limit in file size when the client app is under development rate limit? [2015/04/13 16:26:20.566] [NETWORK ] [DEBUG ] [ 6636] [HEADER >>] HTTP/1.1 400 Bad Request [2015/04/13 16:26:20.566] [NETWORK ] [DEBUG ] [ 6636] [HEADER >>] Content-Type: application/vnd.error+json [2015/04/13 16:26:20.566] [NETWORK ] [DEBUG ] [ 6636] [HEADER >>] Date: Mon, 13 Apr 2015 14:26:22 GMT [2015/04/13 16:26:20.566] [NETWORK ] [DEBUG ] [ 6636] [HEADER >>] Server: Amazon-Cloud-Drive [2015/04/13 16:26:20.566] [NETWORK ] [DEBUG ] [ 6636] [HEADER >>] x-amzn-RequestId: 4b00cc5c-8c3e-42a9-aadf-d405f3900e85 [2015/04/13 16:26:20.566] [NETWORK ] [DEBUG ] [ 6636] [HEADER >>] Content-Length: 39 [2015/04/13 16:26:20.566] [NETWORK ] [DEBUG ] [ 6636] [HEADER >>] Connection: keep-alive [2015/04/13 16:26:20.566] [NETWORK ] [MESSAGE ] [ 6636] [INFORMATION] HTTP error before end of send, stop sending [2015/04/13 16:26:20.566] [NETWORK ] [MESSAGE ] [ 6636] [INFORMATION] Excess found in a non pipelined read: excess = 66, size = 39, maxdownload = 39, bytecount = 0 [2015/04/13 16:26:20.566] [NETWORK ] [MESSAGE ] [ 6636] [INFORMATION] Closing connection 2
amazon drive
10 |5000

Up to 2 attachments (including images) can be used with a maximum of 512.0 KiB each and 1.0 MiB total.

Jamie Grossman avatar image
Jamie Grossman answered
This should now be resolved. Regards, Jamie
10 |5000

Up to 2 attachments (including images) can be used with a maximum of 512.0 KiB each and 1.0 MiB total.

Jamie Grossman avatar image
Jamie Grossman answered
Hi there, We are currently investigating this issue, but please feel free to contact us at clouddrive-api-support@amazon.com directly where we may be able to assist further. Regards, Jamie
10 |5000

Up to 2 attachments (including images) can be used with a maximum of 512.0 KiB each and 1.0 MiB total.

likenun avatar image
likenun answered
I have the same problem. A certain file I'm uploading always fails with 0.97 megabytes left (after the other 17811.01 megabytes have been uploaded), though the file size reported by Cloud Drive suggests otherwise. The uploaded file though, has been irretrievable by any means—even on Amazon.com. I've repeated the process at least 6 times with no success. The log entries I checked look like this for these failures: [2015/05/06 01:21:48.293] [PROTOCOL ] [ERROR ] [ 1272] AmazonCloudDrive::Upload failed(Operation too slow. Less than 1 bytes/sec transferred the last 20 seconds) : https://content-na.drive.amazonaws.com/cdproxy/nodes?suppress=deduplication&suppress=deduplication [2015/05/06 01:21:48.308] [FILESYSTEM] [ERROR ] [ 1136] File::WriteFile : FILE_WRITE_FAILED [2015/05/06 01:21:48.308] [FILESYSTEM] [ERROR ] [ 1136] [X:PID 4] FileSystem::FUSE_write => FILE_WRITE_FAILED : [b]\**********\**********.***[/b] [2015/05/06 09:44:10.673] [PROTOCOL ] [ERROR ] [ 2184] AmazonCloudDrive::Read failed(Failed writing body (0 != 16384)) : https://content-na.drive.amazonaws.com/cdproxy/nodes/[b]**********[/b]/content?alt=media I've been testing with NetDrive since the official Amazon desktop app is unable to upload the file at all (always stuck at 0 bytes with no network activity on my system monitor). Maybe once I've written a basic GUI client with the API I can probe further.
10 |5000

Up to 2 attachments (including images) can be used with a maximum of 512.0 KiB each and 1.0 MiB total.

likenun avatar image
likenun answered
Here's an image for those who want to see what it looks like: [img] http://i58.tinypic.com/5dmgxc.png[/img] http://i58.tinypic.com/5dmgxc.jpg The results have been identical every time even after clearing caches, cookies, logins, the trash and such.
10 |5000

Up to 2 attachments (including images) can be used with a maximum of 512.0 KiB each and 1.0 MiB total.

likenun avatar image
likenun answered
So I’ve finally managed to get a large file uploaded with the official desktop app. It seems the problem was just time. The upload [i]begins[/i] after a few minutes (which few people have the patience for). However, that success was only with a 12 GB file. A 200 GB file that I tried later never went through. I thought the desktop app was slow at first when I came back to check on the progress, but it appears that the upload fails at some point and restarts from the beginning (likely after reaching a few megabytes shy of 200 GB). I watched it hit 193 GB just an hour ago, and now it’s back on 0. Given that it’s been 2 days, it’s been wasting bandwidth by repeatedly retrying at least 6 times. I’m running a workstation with ECC RAM and the btrfs file system, so the chances of corruption on my end is extremely low. Either the network packets are being corrupted, or the problem still exists on Amazon’s end.
10 |5000

Up to 2 attachments (including images) can be used with a maximum of 512.0 KiB each and 1.0 MiB total.

Jamie Grossman avatar image
Jamie Grossman answered
Hi there, Thanks for posting! I have passed this information to the relevant team, and I'll get back to you as soon as I have more information. Regards, Jamie
10 |5000

Up to 2 attachments (including images) can be used with a maximum of 512.0 KiB each and 1.0 MiB total.

Amazon Customer avatar image
Amazon Customer answered
I am getting fails on all uploads from the web based interface. Uploaded 0 items. Upload completed. Failed to upload 1 file. Upload failed
10 |5000

Up to 2 attachments (including images) can be used with a maximum of 512.0 KiB each and 1.0 MiB total.

Jamie Grossman avatar image
Jamie Grossman answered
Hi there, Thanks for posting. This forum is for developers of cloud drive, and your request sounds customer service related. I'd suggest getting in touch with the team directly here for further assistance: https://www.amazon.com/gp/help/customer/display.html?ie=UTF8&nodeId=201376330 Regards, Jamie
10 |5000

Up to 2 attachments (including images) can be used with a maximum of 512.0 KiB each and 1.0 MiB total.