Questions tagged [amazon-s3]
Amazon S3 (simple storage service) is an online object storage service from Amazon Web Services. QUESTIONS MUST BE ABOUT PROGRAMMING. Questions about general S3 support, functionality, configuration, etc. are OFF-TOPIC.
amazon-s3
50,996
questions
4
votes
4
answers
8k
views
CloudFront - How to upload images
I have 3 questions related to Amazon CloudFront.
How do I upload images?
Can I use FTP?
Does Amazon allow me to rsynch a local directory to CloudFront so that I have a replica directory and hierarchy ...
5
votes
1
answer
4k
views
s3 cloudfront listing all contents in bucket to anonymous users
Anonymous Users can browse to our public distributions or s3 folders and view a list (xml) of all files.
We have set read permissions. Can anyone recommend how to prevent users from viewing the list ...
2
votes
3
answers
923
views
How to calculate the transfer bandwidth consumption of a file stored in Amazon S3?
I'm developing a file hosting service in ASP.Net where the users will have a certain amount of storage and transfer bandwidth according to the plan they purchased.
Considering the fact that I will be ...
-3
votes
1
answer
3k
views
Amazon S3 Python Bulk File Transfer through Python [closed]
I want to tranfer files in around 1000 directories to an Amazon S3 bucket using Pythons S3 package.
How could I do it ?
5
votes
1
answer
1k
views
How can I zip/tar files on S3 without first copying them to the server?
I have a Rails app that archives high-res images (and thumbs) on S3 (via the Paperclip plugin).
I would love to allow users to download multiple high-res files with a single download. Is it possible ...
2
votes
2
answers
3k
views
Listing buckets with AWS::S3 in Sinatra
I'm trying to access my Amazon S3 account using the aws-s3 gem, but no matter what I do, I can't even print a bucket list.
Error:
undefined method `bytesize' for #<AWS::S3::Bucket:0x1b9e488>
...
5
votes
1
answer
3k
views
PHP/Amazon S3: Query string authentication
I have been using the Zend_Service_Amazon_S3 library to access Amazon S3, but have been unable to find anything that correctly deals with generating the secure access URLs.
My issue is that I have ...
2
votes
4
answers
587
views
What is involved with changing attachment_fu's storage scheme?
I have a rails application that is using attachment_fu. Currently, it is using :file_system for storage, but I want to change it to :s3, to allow for better scaling as more files get uploaded.
What ...
5
votes
4
answers
4k
views
Paperclip, large file uploads, and AWS
So, I'm using Paperclip and AWS-S3, which is awesome. And it works great. Just one problem, though: I need to upload really large files. As in over 50 Megabytes. And so, nginx dies. So apparently ...
12
votes
2
answers
5k
views
is is possible to move/copy an s3 bucket to a different account?
Does Amazon provide a way to copy a bucket from one account to a different account? I am uploading several gb of files to my own bucket for a client app for development purposes, but when handing off ...
4
votes
2
answers
6k
views
Listing directories at a given level in Amazon S3
I am storing two million files in an amazon S3 bucket. There is a given root (l1) below, a list of directories under l1 and then each directory contains files. So my bucket will look something like ...
10
votes
4
answers
7k
views
Browser Based Uploads to Amazon S3?
Amazon has instructions on how to write a form that posts directly to Amazon's S3 service via HTML POST.
However, they are not very clear on how to create a simple form to upload directly to an S3 ...
2
votes
3
answers
475
views
Amazon S3 for Social Networks?
http://www.s3fm.com/ is really useful for uploading/viewing files for personal viewing.
I was wondering if there was something good for social networks (using Amazon s3 or something similar),
where ...
4
votes
1
answer
3k
views
Amazon S3 client based on SOAP
I need a Win client for Amazon S3 that utilizes SOAP protocol for all transactions. As far as I see most solutions are REST based rather than SOAP. Any ideas?
EDIT:
Just want to clarify: please do ...
0
votes
1
answer
1k
views
Hadoop Input Files
Is there a difference between having say n files with 1 line each in the input folder and having 1 file with n lines in the input folder when running hadoop?
If there are n files, does the "...