Here’s how you upload a file into S3 using Python and Boto3. If you wanted to upload a whole folder, specify the path and loop through each file. Set the key to the the name of the file etc.
|
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 |
#run aws configure to then setup keys and default region/outputs. #Import boto3 import boto3 #set a boto3 resource to s3 and assign it to a s3 variablle s3 = boto3.resource('s3') #loop through all s3 buckets and print their names for bucket in s3.buckets.all(): print(bucket.name) #Open a document and assign it to a vairiable #'r' means to just read the file. #'rb' (read binary) #'w' (write) #'a' (append) #'wb'(write binary). #Note that if you use either 'w' or 'wb' #Python will overwrite the file, if it exists already or create it if the file doesn’t exist. data = open('PATH\Doc2.docx', 'rb') #write to S3, key is whatever you want the file to be named and the body is defined above. s3.Bucket('bucketname').put_object(Key='Test.docx', Body=data) |
So after a bit of the gym and thinking about how poor the above code is.. I modified it slightly..
|
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 |
#run aws configure to then setup keys and default region/outputs. #Import resources import boto3 import os #set a boto3 resource to s3 and assign it to a s3 variablle s3 = boto3.resource('s3') bucketName = 'bucket' putMethod = 'rb' docPath = 'PATH\\Doc2.docx' base = os.path.basename(docPath) #loop through all s3 buckets and print their names for bucket in s3.buckets.all(): print(bucket.name) #Open a document and assign it to a vairiable #'r' means to just read the file. #'rb' (read binary) #'w' (write) #'a' (append) #'wb'(write binary). #Note that if you use either 'w' or 'wb' #Python will overwrite the file, if it exists already or create it if the file doesn’t exist. data = open(docPath, putMethod) #write to S3, key is whatever you want the file to be named and the body is defined above. s3.Bucket(bucketName).put_object(Key=base, Body=data) |