As I have documented extensively over the last three days, cncpics.com has been causing me a lot of grief.  To re-cap, the mega post of photo’s combined with a failed cron job several weeks ago combined in a ‘perfect storm’ to seriously annoy the godaddy network admins.

I had three choices.

1 – find a new and inexpensive host and hope that they would be able to deal with the traffic that came their way.

2 – give up and walk away from something that I have put serious time/effort and passion into for many years

3 – do it correctly and get a (virtual) dedicated server to handle the load and fix the issues.

Obviously I chose to walk away from it. NOT.

Initially, because it was cheap and had a good reputation, I  created a domain on a basic hosting platform using Siteground, they are a lot more techno than GoDaddy and I thought that it might me a risk going to them, but for under $20 it was worth a shot. Initially it seemed that this may just be the right host, PHP5 support would allow me to move to Gallery 3 and the control panel is full of cool stuff.

Problems with the database restore should have told me that I was wrong, but the curve-ball of getting an old backup from godaddy threw me and I pretty much worked through the night last night.

When I finally got the site up with the last two weeks of images loaded, the impact of the viewers from around the world simply swamped the poor host and they throttled the scripts.

In short they are a great host, but not tough enough, I will be using the hosting space for this blog and my personal sites once I have got my new host up and running.

So, my new host…..

Following some advice on fatwallet.com I am now the proprietor of an extremely cool Virtual Dedicated Server. I am not going to say where just yet as I want them to prove that they can handle the traffic before I give them a shout out, but I certainly got a ‘deal’.

Initial impressions are very, very very good indeed.

The MYSQL database that took ‘all night’ to create last night on siteground took 4 minutes and 15 seconds here.

Approximately 120 times faster.

FTP is uploaded at a solid 1.4MB vs 240KB on the old host.

But the best part is that we are no longer worried too much about processor and memory use unless we try to exceed the apportioned amounts.

So, the new URL that I am building on is cncpicsarchive.com all other domains point here.

As I intimated with the title of this post, I have learnt a lot during this fiasco. Continue reading “Learning through adversity” »

 

It has been a long night.

As I write this it is close to 5am – I left the mysql upload running at 11pm last night and a couple of hours ago dragged myself out of bed to see what was happening. It is mostly good news, but it is also a little too early to celebrate.

The database is uploaded

The site actually works

FTP is running and uploading the pictures.

The bad news is that the FTP Process is going to take some time, some considerable time. As yet I have not ‘done the math’ but I would estimate that the upload is going to take a couple of days at least.

Secondly (more bad news) the image builds are taking longer than the page is permitting, therefore the first view of any image gives a blank, this has happened before, but I am not sure what the solution was at the time so I need to research it a little. It may be related to the stress that I am putting the server under by uploading images etc. But it also may be that the server is simply not up to the task in hand. There is only one way to find out I suppose.

Looking at the resource usage it shows that FTP is really consuming a lot of CPU – so maybe this is it. I am not sure.

I am going to let it upload for a while and sleep a little.

Check out the potential new site

http://mehpics.com

 

*sigh

Where to begin ?

Because I was in a catch-22 with Go-Daddy, I found a new fast, friendly host and created a new domain. Purely for testing purposes. The idea was that I could setup a clone of cncpics.com and then once it was all working, simply make some dns changes and all would be good.

Behind the scenes of cncpics.com there is a heavily customized version of an off-the-shelf gallery product which uses a mysql database to store data. It is not enough to simply grab a copy of the photographs and install a nice shiney new copy of gallery, because they I would need to add 45,000 photographs to the gallery and this is a heck of a task.

So the three components are the code, the photo’s and the database.

The code and the database are fairly easy to FTP from my old host, but because I am in ‘violation’ I was unable to get to the control panel to backup the databases.

So at 10AM I asked godaddy for a backup of the databases. The third person I spoke to told me that they where doing the job and that they were no ‘all there’. So I FTP’d them to my windows box and tried to upload them to the new host. Sadly there are a few hundred thousand records in some of the tables and the restore failed. So I jumped over to Linux land and found a tool that will no only connect to the remote database, but it will also load the data in much smaller chunks.

The downside is that this takes a long time and if there is any other traffic on the internet it is slower too.

Many hours later the database restore has finished and after a few minor tweeks to a configuration file the site worked.

Except the galleries ended in the middle of November 2009.

The database backup was several months old.

Somehow I was calm when I called godaddy, somehow I persuaded the support rep to snag a new backup and somehow it looks like he did a good job.

I am obviously now a long way behind, I need to leave the database upload running overnight and then most of tomorrow will be taken up with allowing the photographs to upload too.

Then it will be more configuration changes and more tweeking,

Hopefully on Friday I will be able to tell Godaddy that I no longer need their services….

 

Due to inclement weather yesterday, Cars and Coffee was ‘rained out’, or at least we all assumed it was.

Baby Enzo

When I grow up....

So, in order to get my weekly fix of automotive eye candy I decided to attend ‘Supercar Sunday’ in Woodland Hills. Despite looking up the directions, I did not really comprehend just how far away it actually is. When I looked I noticed the estimated time, rather than the mileage. The estimate was something over an hour and the event is scheduled to run from 7AM to 10AM.

No Problem I thought, on a Sunday morning the traffic will be light, I can leave home at 6:45 and probably be there not much after 7:30.

Continue reading “Supercar Sunday” »

 

I think it rained all night last night. When I looked out of the window at 4AM it was torrential and I figured that there would be no Cars and Coffee event this morning. so I went back to sleep.

At 6AM though I was wide awake and it had stopped raining.

By 6:40 I had left the house and emerged into a cloudy but drying morning on my way to Cars and Coffee

Continue reading “Damp Morning” »

 

Once more, cardomain are covering our coverage of Cars and Coffee !

Check out their coverage here

or go to our gallery here

Visitor numbers for our site have been growing month on month for a long time, but each time the photo’s are covered like this we get a visitor ‘spike’ of incredible proportions. Visits are up 278.31% today and up 45% for the week.

Due to a couple of groups of photograph sales, the hosting fees are now paid for the next few months, so for once we are ‘in the black’. Now lets hope that the traffic brings customers and the hosting is paid for a few more months.

One of these days I am sure that the site will cover the costs of the coffee we drink along with the hosting fee’s :)

 

Seal At OC Fair

My faithful old Canon G7  died an unspectacular death recently. The poor thing died in its sleep one day, I assume it was a painless death. It was heavily used, but still in very nice condition.

The great thing about the G7 was always its speed and ability, with results that were virtually indistinguishable from a DSLR and really great image stabilization it was pretty much perfect for ‘better than casual’ photography where the bulk and ‘look at me factor’ of a DSLR was simply not an option.

The later G9 was barely an upgrade, but the G10 and then subsequent G11 are much better in all regards.  Selling a number of photographs, a couple of which were taken with the G7, this week tipped my decision. Rather than replace it with a smaller Canon, I would get it fixed.

So this morning I went to the Canon service center in Irvine, CA to see if it could be resurrected.

Continue reading “Canon – Fantastic Customer Service” »

© 2010 Max's Blog Suffusion theme by Sayontan Sinha