Hosting Photo Files On Amazon S3 Now Available For Testing

I have an update ready for those who are interested in trying out hosting photo files on Amazon S3 services.

This Sytist version is 0.8.0. You can download the upgrade files here. This does not include the installation files, just the upgrade files.

You can only download these upgrade files here and not from your account as you normally would.

How to upgrade.

How to set up and use the Amazon S3 feature

Please post if you have success using this feature and if you have any issues using this feature.

Additional changes in this version (0.8.0)

• Added the option to menu links if using a drop down menu to make the main menu link not clickable.


• Sub galleries now auto populate 20 at a time in admin and front end to prevent the page locking or loading slow when there are lots of sub galleries


• New way to rearrange sub galleries (Rearrange sub gallery button when viewing in the admin)


• Added country name / abbreviation to Authorize.net AIM payment.


• Fixed page search not posting to the correct URL when Sytist is installed in a sub folder.


• Fixed page search results not displaying photo and incorrect link when Sytist is installed in a sub folder.


• Fixed time zone warning in some installations when exporting people from the people section


• Fixed temporary free download files that are resized not getting deleted when completed.


• Added a check for = sign in photo keywords that can cause a MySQL error

Edited Tue Oct 14, 14 10:07 AM by Tim - PicturesPro.com

Guess I'll give it a shot. I'm going to need extra storage

Edited by

Very Interested

Edited by

@Tim. I would be happy the help you test this project. Please let me know if you still need anymore people.

Happy developing!

Edited by

Looks interesting. Let me know when your ready to do some testing and what you would need on my end, Glad to give it a go.

Andy

Edited by

I'll throw my hat in the ring

Edited by

Looking very interesting to me too.

Edited by

This is now available ... information in the first post.

Edited by

I just upgraded to 0.8.0. - Im going to sign up for Amazon S3 and try it out- - I have unlimited storage on my host but a 250,000 inode limit - I need this to work

Edited by

I tried this with one gallery below. Pictures were successfully moved to the S3 hosting and everything went smoothly.

When I look at the photos now under the gallery, they show that they are being hosted on the S3 however when I view the link below, it's not finding the images from the new s3 hosting. Just show broken links even when trying on different pc's internet providers.


https://ryanleafgreen.com/clientphotos/clients/jonathan-jackies-family-session/


Also my site is full HTTPS, and I see a mismatch with having client photos on my https site, and pulling photos from amazon services. Not sure if this has anything to do with it. But so far, it has great potential.

I would love to cut my hosting cost down and store most of my images on amazon's S3 service!


Ryan

Edited by

I think you just have the endpoint wrong in the Amazon S3 settings in Settings -> Photo Settings.

Change the endpoint to: s3.amazonaws.com

For the httpS .... the photo files are coded just using // instead of http:// ... and doing this makes it serve using either http:// or https:// depending on the page.

Edited by

Yep, that was it. Working great now!!!

Love being able to choose between storage for photos. This could very well save me $10/month in hosting.

I'll start using this new option and testing for speed, etc. compared to my servers now.

Thanks for offering this new option!!! Great work Tim
Ryan

Edited by

I've transfered about 4 gigs of pictures and 20 some galleries without a single issue. Everything still seems just as snappy when viewing images from the S3 host. Great work on this Tim!

Edited by

Im transfering around 1800 photos to amazon s3 - > http://www.convenientphoto.com/surfing/surf-photos-july-2-el-porto/index.php?page=1

I don't see them yet - im using: s3-us-west-1.amazonaws.com for the end point

is this right ??

Edited Sat Oct 18, 14 6:12 PM by Paul DiGiaimo

I moved images that were uploaded my standard ftp via sy-uploads folder then selecting to move the images to S3. The images on the admin side show as broken links. on the customer side the images thumbnails are blank I'm using (s3.amazonaws.com) in my settings. In the S3 folder on my amazon account the ( lg, orig, mini, small & thumbnail ) images seem to be there?

its a locked gallery http://www.abdigitalphotography.com/abdsytist/event-galleries/portraits/grabenhorst/
PW: mark

Andy

Edited Sun Oct 19, 14 10:34 PM by andrew bershaw

I got it working - I signed up for amazon and got a account - I than transferred photos that were already on my site, I have no idea where they went - Than I realized that I had to complete my account with a credit card - after I entered my credit card info I was able to set up my bucket folder and transfer photos.

im now in process of uploading a soccer game I shot yesterday -

http://www.convenientphoto.com/soccer/sand-and-surf-vs-cypress-fc-u15-oct-19-2014/ PASSWORD IS: 101914 if you want to take a look

uploading to amazon is much slower but it will hopefull be worth it.

Edited by

Andrew, what region did you select for your bucket? I don't think the endpoint is correct.

http://docs.aws.amazon.com/general/latest/gr/rande.html#s3_region

Glad you got it working Paul. Does make the upload time a little slower because it has to move the files to the Amazon servers.

Edited Mon Oct 20, 14 7:48 AM by Tim - PicturesPro.com

I chose (us standard)

Andy

Edited by

@Andrew ... Looks like you got it working because now I see the photos serving from Amazon.

Edited by

yes thank you for checking, I just switched the end point to (s3-us-west-2.amazonaws.com) from (s3.amazonaws.com) and the images appeared correctly.

mini crisis everted!

Thank you !

Andy

Edited by

Hi Tim,

Just had my first order for photos hosted on S3. Photos are showing fine on the website, order generated fine. Client zip file download come sup with error and individual file downloads show as blank screen. Any ideas?

Thanks.

Edited by

I am having an issue that the uploaded images are accessed by https but links on site are http

Any ideas?

Mike

Edited by

Glen, what is the error message from the zip file? I have tested that and does work in my testings.

Mike, it is coded to automatically detect if the pages are over http or https . Is it causing a warning or anything?

Edited by

Tim,

there are just no images visible but the link for the image is just http

Mike

Edited by

The error message is:

"Sorry, there has been an error"

Edited by

Not to interrupt this thread but could someone explain how amazon s3 works? It is really confusing on the website. the pricing structure looks like another language to me. I also have unlimited storage but a 250,000 inode limit. I got about 128 Gb on my site right now with 155 thousand Inodes. but if the amazon is cheap enough i could get myself off this shared server and still have it be cost effective.

Edited by

@Glenn, you may need to email me a link to your admin with the username and password (or the login for a customer account with an order for downloads) and also FTP access so I can take a look.

@Tim ... I really can't answer that because the pricing confuses me too. But from what I understand, it is really cheap. I am hosting the video tutorials with Amazon S3 and also been doing a lot of testing on dev sites moving files to S3 (not much viewing on those though), and my bill right now for October is $.02 (2 cents)

Edited by

I'll have to do some more research, because it may be a lot easier to host the images there and move my web hosting to a different plan and save money

Edited by

Yet again Tim resolved the problem, not a Sytist issue but a user setup issue.

Customer service second to none.

Many thanks Tim

Edited by

Images seem to be going up quite slowly for me. I have been reading that this is something that can happen with S3 (I am uploading older jobs already on Sytist) with large jbs running in to many thousands of images it would be great to have a pause feature.

Mike

Edited by

Just to add a bit more info;

I size my images to 800px longest side before ftp to Sytist (Ihave the larg image size set at 800px when importing)

I have uploaded some galleries and am now transferring these to S3 and this is what I am seeing;

For each image this gives approx

large image 120 K
mini image 2k
Original 120K
small 7.5K
th 14K

an average equestrian job will be about 3000 images and without thinking I clicked to upload the complete gallery instead of doing it on a sub gallery basis
I am seeing the server transfer approx 100 images an hour

The issue, the web server is running at about 630MB main memory utilisation of about 1GB available

Unlike the import processing it uploads all images without pausing

Should I be expecting such server load and if so can we build pauses in to the process

Other than that it appears to be running OK

Edited by

I wouldn't think moving the photos over to Amazon would cause much server load. Are you sure it is from that process?

And is it slowing down the longer it runs or starting off slow?

Edited by

Things have been going smooth for me after moving my pics to S3. It does appear my Stats info pictures when clicking on the stats tab of a gallery are not loading. They appear to be still pointing to my main hosting site.

This is true for galleries which were first uploaded to my main hosting and later galleries which were uploaded with the check to move to S3 hosting while uploading.

Not Found

The requested URL /clientphotos/sy-photos/2014/10/25/19/mini_5f4_RLP_9326.jpg was not found on this server.

Additionally, a 404 Not Found error was encountered while trying to use an ErrorDocument to handle the request.

Edited by

Hi Tim,

Can the cloud connector be configured to use Rackspace services as an alternative to S3?

Edited by

@Ryan, fixed for the next update.

@Glenn ... S3 is the only option at this time.

Edited by

Tim,

So far so good. Thanks for all your hard work!!

Edited by

Tim,

Just an update working well on both my Sytist sites

Thanks

Edited by

Thanks for letting me know Alan. Seems like it is going well all around.

Edited by

Hi Tim

I can't make this work.
I have an Amazon account so no problem setting up bucket etc. I'm certain I have the endpoint correct (but how do I tell?).
Images upload normally but disappear someplace leaving a broken thumbnail.
I've checked the bucket and images are not getting there.
Repeated several times, seems I am missing something critical. Where to start?

Thanks
Andrew

Edited by

Can you right click on a broken thumbnail and do view image and post or email me that link?

Edited Wed Nov 19, 14 1:21 PM by Tim - PicturesPro.com

Hi Tim

I can't get past the admin window as I get stalled on a loading widow trying to view a preview.
Path of admin thumbnail is - --- removed by tim ----

Thanks
Andrew

Edited Wed Nov 19, 14 1:51 PM by Tim - PicturesPro.com

You would probably need to use Firefox so you can right click on the broken thumbnail and select "View Image". Maybe just email me your admin username and password so I can take a look?

Edited by

Same problem as Andrew with some Region.

I am in France, if i use region name Ireland that work, if i use Frankfurt that don't work. I have check, my bucket in Frankfurt and it is empty.

I don't know if we need to be in specific location for use some Amazon datacenter, it is perhaps a limitation from Amazon.

I want trying Frankfurt for my bucket because i think it was normally more quick for me but perhaps amazon don't think that ;)

Edit of my post : i have create bucket in oregon and tokyo, both work, so no location restriction, the problem come specifically from Frankfurt.

Edited Sat Nov 22, 14 3:10 AM by Yann Queniart

Hi Tim

I still have Amazon issues since Stylist 0.8.3.
I get consistent IO upload errors and it seems only a few images are actually transferring to Amazon (as indicated by the 'Hosted on Amazon S3' icon.
Using 'Move photos to S3' does nothing.

If I turn off Amazon, upload is fast and faultless!

Thanks for ideas.
Andrew

Edited Wed Jan 28, 15 1:16 PM by Andrew Spencer

Send me an email so I can send you a file that will probably fix this.

Edited by

Hi Tim,can you send me the same fix file, as i too are experiencing this exact issue with S3. I check my S3 links and they are all fine see sample:-

https://s3-eu-west-1.amazonaws.com/paulfoxphotography/2015-10-05_00-21-31/large_2d82b009f_PF18352320150704DJ%2BCHRISSY%2BB%2BJuly%2B2015.jpg

But the internal GUI admin show no image or thumbnail...

Edited by

I am thinking about doing this Tim.

1. After I upload my current galleries, what happens if at that point I want to change the host of my site? I am currently using Hostmonster. I want to change hosts because I am not really able to offer a Download All product without setting the number of files to be zipped to something to low.

2. How will hosting on Amazon effect offering a Download All product?

Thank you.

Edited by

1) If the photos are hosted on Amazon, nothing really, they will still be there.

2) For any downloads, the photos have to be copied from Amazon to the server for download. So with the download all, it may take a little more time, but I have not done any experimenting with that.

Edited by