Skip to main content
The 2024 Developer Survey results are live! See the results

Questions tagged [amazon-s3]

Amazon S3 (simple storage service) is an online object storage service from Amazon Web Services. QUESTIONS MUST BE ABOUT PROGRAMMING. Questions about general S3 support, functionality, configuration, etc. are OFF-TOPIC.

amazon-s3
4 votes
4 answers
8k views

CloudFront - How to upload images

I have 3 questions related to Amazon CloudFront. How do I upload images? Can I use FTP? Does Amazon allow me to rsynch a local directory to CloudFront so that I have a replica directory and hierarchy ...
user avatar
5 votes
1 answer
4k views

s3 cloudfront listing all contents in bucket to anonymous users

Anonymous Users can browse to our public distributions or s3 folders and view a list (xml) of all files. We have set read permissions. Can anyone recommend how to prevent users from viewing the list ...
Dom's user avatar
  • 1,486
2 votes
3 answers
923 views

How to calculate the transfer bandwidth consumption of a file stored in Amazon S3?

I'm developing a file hosting service in ASP.Net where the users will have a certain amount of storage and transfer bandwidth according to the plan they purchased. Considering the fact that I will be ...
holiveira's user avatar
  • 4,495
-3 votes
1 answer
3k views

Amazon S3 Python Bulk File Transfer through Python [closed]

I want to tranfer files in around 1000 directories to an Amazon S3 bucket using Pythons S3 package. How could I do it ?
crashekar's user avatar
  • 283
5 votes
1 answer
1k views

How can I zip/tar files on S3 without first copying them to the server?

I have a Rails app that archives high-res images (and thumbs) on S3 (via the Paperclip plugin). I would love to allow users to download multiple high-res files with a single download. Is it possible ...
Callmeed's user avatar
  • 4,992
2 votes
2 answers
3k views

Listing buckets with AWS::S3 in Sinatra

I'm trying to access my Amazon S3 account using the aws-s3 gem, but no matter what I do, I can't even print a bucket list. Error: undefined method `bytesize' for #<AWS::S3::Bucket:0x1b9e488> ...
arbales's user avatar
  • 5,536
5 votes
1 answer
3k views

PHP/Amazon S3: Query string authentication

I have been using the Zend_Service_Amazon_S3 library to access Amazon S3, but have been unable to find anything that correctly deals with generating the secure access URLs. My issue is that I have ...
tombazza's user avatar
  • 656
2 votes
4 answers
587 views

What is involved with changing attachment_fu's storage scheme?

I have a rails application that is using attachment_fu. Currently, it is using :file_system for storage, but I want to change it to :s3, to allow for better scaling as more files get uploaded. What ...
pkaeding's user avatar
  • 37.3k
5 votes
4 answers
4k views

Paperclip, large file uploads, and AWS

So, I'm using Paperclip and AWS-S3, which is awesome. And it works great. Just one problem, though: I need to upload really large files. As in over 50 Megabytes. And so, nginx dies. So apparently ...
Steve Klabnik's user avatar
12 votes
2 answers
5k views

is is possible to move/copy an s3 bucket to a different account?

Does Amazon provide a way to copy a bucket from one account to a different account? I am uploading several gb of files to my own bucket for a client app for development purposes, but when handing off ...
bantic's user avatar
  • 4,954
4 votes
2 answers
6k views

Listing directories at a given level in Amazon S3

I am storing two million files in an amazon S3 bucket. There is a given root (l1) below, a list of directories under l1 and then each directory contains files. So my bucket will look something like ...
Marius Seritan's user avatar
10 votes
4 answers
7k views

Browser Based Uploads to Amazon S3?

Amazon has instructions on how to write a form that posts directly to Amazon's S3 service via HTML POST. However, they are not very clear on how to create a simple form to upload directly to an S3 ...
chris's user avatar
  • 21.1k
2 votes
3 answers
475 views

Amazon S3 for Social Networks?

http://www.s3fm.com/ is really useful for uploading/viewing files for personal viewing. I was wondering if there was something good for social networks (using Amazon s3 or something similar), where ...
chris's user avatar
  • 21.1k
4 votes
1 answer
3k views

Amazon S3 client based on SOAP

I need a Win client for Amazon S3 that utilizes SOAP protocol for all transactions. As far as I see most solutions are REST based rather than SOAP. Any ideas? EDIT: Just want to clarify: please do ...
Nick's user avatar
  • 79
0 votes
1 answer
1k views

Hadoop Input Files

Is there a difference between having say n files with 1 line each in the input folder and having 1 file with n lines in the input folder when running hadoop? If there are n files, does the "...
Verhogen's user avatar
  • 28.1k

15 30 50 per page