ó ¸9—^c@sîdZddlZddlZddlZddlZddlZddlZddlmZddl m Z ddl m Z m Z ddlmZddlmZyddlZWnek rÍeZnXeZde fd „ƒYZdS( s Sync Media to S3 ================ Django command that scans all files in your settings.MEDIA_ROOT and settings.STATIC_ROOT folders and uploads them to S3 with the same directory structure. This command can optionally do the following but it is off by default: * gzip compress any CSS and Javascript files it finds and adds the appropriate 'Content-Encoding' header. * set a far future 'Expires' header for optimal caching. * upload only media or static files. * use any other provider compatible with Amazon S3. * set other than 'public-read' ACL. Note: This script requires the Python boto library and valid Amazon Web Services API keys. Required settings.py variables: AWS_ACCESS_KEY_ID = '' AWS_SECRET_ACCESS_KEY = '' AWS_BUCKET_NAME = '' When you call this command with the `--renamegzip` param, it will add the '.gz' extension to the file name. But Safari just doesn't recognize '.gz' files and your site won't work on it! To fix this problem, you can set any other extension (like .jgz) in the `SYNC_S3_RENAME_GZIP_EXT` variable. Command options are: -p PREFIX, --prefix=PREFIX The prefix to prepend to the path on S3. --gzip Enables gzipping CSS and Javascript files. --expires Enables setting a far future expires header. --force Skip the file mtime check to force upload of all files. --filter-list Override default directory and file exclusion filters. (enter as comma separated line) --renamegzip Enables renaming of gzipped files by appending '.gz'. to the original file name. This way your original assets will not be replaced by the gzipped ones. You can change the extension setting the `SYNC_S3_RENAME_GZIP_EXT` var in your settings.py file. --invalidate Invalidates the objects in CloudFront after uploading stuff to s3. --media-only Only MEDIA_ROOT files will be uploaded to S3. --static-only Only STATIC_ROOT files will be uploaded to S3. --s3host Override default s3 host. --acl Override default ACL settings ('public-read' if settings.AWS_DEFAULT_ACL is not defined). TODO: * Use fnmatch (or regex) to allow more complex FILTER_LIST rules. iÿÿÿÿN(tList(tsettings(t BaseCommandt CommandError(tStringIO(t signalcommandtCommandcBsÂeZdZdZdZdZdZdZdddddgZdZ gZ d Z d Z d Z d ZeZd „Zed„ƒZd„Zd„Zd„Zd„Zd„Zd„Zd„ZRS(ts .DS_Stores.svns.hgs.gits Thumbs.dbstext/csssapplication/javascriptsapplication/x-javascriptstext/javascriptisSSyncs the complete MEDIA_ROOT structure and files to S3 into the given bucket name.t bucket_namec Csâtt|ƒj|ƒ|jdddddttddƒdd ƒ|jd d dd dd ƒ|jddddttddƒddƒ|jddddttddƒddƒ|jddddddtddƒ|jddddddtddƒ|jddddd dtdd!ƒ|jd"dddd#dtdd$ƒ|jd%dd&dd'dddd(ƒ|jd)dd*dtdddd+ƒ|jd,dd-dddddd.ƒ|jd/dd0dddddd1ƒdS(2Ns-ps--prefixtdesttprefixtdefaulttSYNC_S3_PREFIXRthelps(The prefix to prepend to the path on S3.s-ds--dirtdirs#Custom static root directory to uses--s3hostts3hostt AWS_S3_HOSTs;The s3 host (enables connecting to other providers/regions)s--acltacltAWS_DEFAULT_ACLs public-reads.Enables to override default acl (public-read).s--gziptactiont store_truetgzips*Enables gzipping CSS and Javascript files.s --renamegzipt renamegzipsJEnables renaming of gzipped assets to have '.gz' appended to the filename.s --expirestexpiress,Enables setting a far future expires header.s--forcetforces7Skip the file mtime check to force upload of all files.s --filter-listt filter_listtstoresVOverride default directory and file exclusion filters. (enter as comma seperated line)s --invalidatet invalidates0Invalidates the associated objects in CloudFronts --media-onlyt media_onlys,Only MEDIA_ROOT files will be uploaded to S3s --static-onlyt static_onlys-Only STATIC_ROOT files will be uploaded to S3(tsuperRt add_argumentst add_argumenttgetattrRtFalse(tselftparser((sO/tmp/pip-unpacked-wheel-a0M10Y/django_extensions/management/commands/sync_s3.pyRlsh    cOsŸtstdƒ‚nttdƒ s5ttdƒ rDtdƒ‚ntj|_tj|_ttdƒsztdƒ‚ntjs’tdƒ‚ntj|_ttdƒs¼td ƒ‚ntjsÔtd ƒ‚nttd d ƒ|_ ttd d ƒ|_ |d|_ |d|_ |d|_ |d|_|d|_|d|_|d|_|d|_|d|_|d|_ttd|jƒ|_|d}|r½|jdƒ|_n|d|_|d|_|jrø|jrøtdƒ‚nf|jrtjg|_nK|jr.tjg|_n0|jrI|jg|_ntjtjg|_|jƒ|jr~|jƒnd GHd|jGHd|jGHdS( Ns>Please install the 'boto' Python library. ($ pip install boto)tAWS_ACCESS_KEY_IDtAWS_SECRET_ACCESS_KEYseMissing AWS keys from settings file. Please supply both AWS_ACCESS_KEY_ID and AWS_SECRET_ACCESS_KEY.tAWS_BUCKET_NAMEs]Missing bucket name from settings file. Please add the AWS_BUCKET_NAME to your settings file.s AWS_BUCKET_NAME cannot be empty.t MEDIA_ROOTs(MEDIA_ROOT must be set in your settings.tAWS_CLOUDFRONT_DISTRIBUTIONRtSYNC_S3_RENAME_GZIP_EXTs.gzt verbosityR RRRRRRRRt FILTER_LISTRt,RRsMCan't use --media-only and --static-only together. Better not use anything...s%d files uploaded.s%d files skipped.(tHAS_BOTORthasattrRR%R&R'R(R!R)R*R+R tdo_gzipt rename_gzipt do_expirestdo_forceRt DIRECTORIESRt default_aclR,tsplitRRt STATIC_ROOTtsync_s3tinvalidate_objects_cft upload_countt skip_count(R#targstoptionsR((sO/tmp/pip-unpacked-wheel-a0M10Y/django_extensions/management/commands/sync_s3.pythandle®s`                          cCstj|j|jƒS(s'Return an open connection to CloudFront(tbototconnect_cloudfrontR%R&(R#((sO/tmp/pip-unpacked-wheel-a0M10Y/django_extensions/management/commands/sync_s3.pytopen_cføscCs‘|jstdƒ‚nd}|jƒ}|j}gtdt|ƒ|ƒD]}||||!^qL}x!|D]}|j|j|ƒqpWdS(s8Split the invalidation request in groups of 1000 objectssrAn object invalidation was requested but the variable AWS_CLOUDFRONT_DISTRIBUTION is not present in your settings.ièiN(R)RRAtuploaded_filestrangetlentcreate_invalidation_request(R#tchunktconntobjstitchunkstpaths((sO/tmp/pip-unpacked-wheel-a0M10Y/django_extensions/management/commands/sync_s3.pyR9ýs    6 cCsr|jƒ\}}xY|jD]N}xEtj|ƒD]4\}}}|j|||j|f|||ƒq2WqWdS(s7Walk the media/static directories and syncs files to S3N(topen_s3R4tostwalkt upload_s3R'(R#tbuckettkeyt directorytroottdirstfiles((sO/tmp/pip-unpacked-wheel-a0M10Y/django_extensions/management/commands/sync_s3.pyR8scCsHtƒ}tjddddd|ƒ}|j|ƒ|jƒ|jƒS(sGzip a given string.tmodetwbt compresslevelitfileobj(RRtGzipFiletwritetclosetgetvalue(R#tstzbuftzfile((sO/tmp/pip-unpacked-wheel-a0M10Y/django_extensions/management/commands/sync_s3.pytcompress_strings    cCs#i}|jr|j|dRAR9R8RaRdRLRO(((sO/tmp/pip-unpacked-wheel-a0M10Y/django_extensions/management/commands/sync_s3.pyRRs4 BJ      (t__doc__RyRˆRR€RMRzttypingRt django.confRtdjango.core.management.baseRRtsixRt"django_extensions.management.utilsRR?t ImportErrorR"R.R‘R(((sO/tmp/pip-unpacked-wheel-a0M10Y/django_extensions/management/commands/sync_s3.pyt:s"