Using S3 with Laravel | Laravel News
AWS S3 provides a place for us to store files off of our servers. There are some big benefits to this:
- Backup/redundancy – S3 and similar have built-in backups and redundancy
- Scaling – Savings files off-server becomes necessary in modern hosting, such as serverless or containerized environments, as well as in traditional load-balanced environments
- Disk usage – You won’t need as much disk space when storing files in the cloud
- Features – S3 (and other clouds) have some great features, such as versioning support for files, lifecycle rules for deleting old files (or storing them in a cheaper way), deletion protection, and more
Using S3 now (even in single-server setups) can reduce headaches in the long run. Here’s what you should know!
There’s two places to configure things for S3:
- Within Laravel – usually via
.envbut potentially also within
- Within your AWS account
If you check your
config/filesystem.php file, you’ll see that
s3 is an option already. It’s setup to use environment variables from your
Unless you need to customize this, then you can likely leave it alone and just set values in the
1# Optionally Set the default filesystem driver to S3
4# Add items needed for S3-based filesystem to work
config/filesystem.php file contains options like the following:
2 'disks' => [
3 // 'local' and 'public' ommitted...
5 's3' => [
6 'driver' => 's3',
7 'key' => env('AWS_ACCESS_KEY_ID'),
8 'secret' => env('AWS_SECRET_ACCESS_KEY'),
9 'region' => env('AWS_DEFAULT_REGION'),
10 'bucket' => env('AWS_BUCKET'),
11 'url' => env('AWS_URL'),
12 'endpoint' => env('AWS_ENDPOINT'),
13 'use_path_style_endpoint' => env('AWS_USE_PATH_STYLE_ENDPOINT', false),
There’s a few options there we didn’t use in the
.env file. For example, the
AWS_URL can be set, which is useful for using other file storage clouds that have an S3 compatible API such as CloudFlare’s R2 or Digital Ocean’s Spaces.
Within AWS, you need to do 2 things:
- Create a bucket within the S3 service
- Create an IAM User to get a Key/Secret Key, and then attach a Policy to that user that allows access to the S3 API.
Like anything in AWS, creating a bucket in S3 involves looking at a ton of configuration options and wondering if you need any of them. For most use cases, you don’t!
Head to the S3 console, create a bucket name (it has to be globally unique, not just unique to your AWS account), choose the region you operate in, and leave all the defaults (including the ones that labeled “Block Public Access settings for this bucket”).
Yes, some of these options are ones you may want to use, but you can choose them later.
After creating a bucket, we need permission to do things to it. Let’s pretend we created a bucket named “my-awesome-bucket“.
We can create an IAM User, select “programmatic access”, but don’t attach any policies or setup anything else. Make sure to record the secret access key, as they’ll only show it once.
I’ve created a video showing the process of creating a bucket and setting up IAM permissions here: https://www.youtube.com/watch?v=FLIp6BLtwjk
The Access Key and Secret Access Key should be put into your
Next, click into the IAM User and add an Inline Policy. Edit it using the JSON editor, and add the following (straight from the Flysystem docs):
2 "Version": "2012-10-17",
3 "Statement": [
5 "Sid": "Stmt1420044805001",
6 "Effect": "Allow",
7 "Action": [
16 "Resource": [
This allows us to perform the needed S3 API actions on our new bucket.
Within Laravel, you can use the file storage like so:
1# If you set S3 as your default:
2$contents = Storage::get('path/to/file.ext');
5# If you do not have S3 as your default:
6$contents = Storage::disk('s3')->get('path/to/file.ext');
The path to the file (within S3) gets appended to the bucket name, so a file named
path/to/file.ext will exist in
Directories technically do not exist within S3. Within S3, a file is called an “object” and the file path + name is the “object key”. So, within bucket
my-awesome-bucket, we just created an object with key
Be sure to check out the Storage area of the Laravel docs to find more useful ways to use Storage, including file streaming and temporary URL’s.
S3 is fairly cheap – most of us will spend pennies to a few dollars a month. This is especially true if you delete files from S3 after you’re done with them, or setup Lifecycle rules to delete files after a set period of time.
The pricing is (mostly) driven by 3 dimensions. The prices vary by region and usage. Here’s an example based on usage for a real application in a given month for Chipper CI (my CI for Laravel application), which stores a lot of data in S3:
- Storage: $0.023 per GB, ~992GB ~= $22.82
- Number of API Calls: ~7 million requests ~= $12
- Bandwidth usage: This is super imprecise. Data transfer for this was about $23, but this excludes EC2 based bandwidth charges.
Useful Bits about S3
- If your AWS setup has servers in a private network, and uses NAT Gateways, be sure to create an S3 Endpoint (type of Gateway). This is done within the Endpoints section in the VPC service. This allows calls to/from S3 to bypass the NAT Gateway and thus get around extra bandwidth charges. It doesn’t cost extra to use this.
- Considering enabling Versioning in your S3 bucket if you’re worried about files being overwritten or deleted
- Consider enabling Intelligent Tiering in your S3 bucket to help save on storage costs of files you likely won’t interact with again after they are old
- Be aware that deleting large buckets (lots of files) can cost money! This is due to the number of API calls you’d have to make to delete files.
Credit: Source link