UKTW Weblog

October 17, 2011

Panda Pain and Anguish

Filed under: Panda, SeatChoice — Tags: — uktw @ 11:36 am

Ahh well, looks like I spoke too soon.

October 14th saw another run of Panda, as far as anyone can tell, and there’s a lot of screaming and running around like headless chickens happening of the Webmaster Forum … seems like it hit a number of people hard

Like us

Yep, after a few months of slow growth we were kicked in the teeth … dropped 35% on one site overnight, dropped probably 50% across all sites … not sure how much longer I can keep this up

October 10, 2011

Google Swings and Roundabouts

Filed under: Panda — Tags: — uktw @ 2:06 pm

Well, as suspected, its a bit of swings and roundabouts when it comes to search engine traffic and changes recently.

In fairness, I’d say that Panda is not currently an issue for us, but in making the Panda smile we have (a) lost our position for certain keywords and (b) made our site convert fewer visitors!

So, now for the next round of tuning aimed at doing these two things

1) regain the ground lost for certain important key phrases

2) improve our conversion rate

Whilst not bring back the Panda frown. Tricky one, made even trickier when you consider that our updates, Google’s scan and the Panda runs all happen asynchronously … and we have monthly and annual changes in traffic anyway. This means that seeing if something has worked is a near impossible thing .. it used to be a little easier s the world stayed roughly the same for long enough to see things stabilise, now this no longer seems to be true.

The shock today was to lose our position in Google for “dirty dancing tickets” and “tickets for dirty dancing” where we have always (for a few years) been in the top half of the first page, not even the Panda upset that. Today, all of a sudden, we are not in the first 10 PAGES of results! This fact was made even more curious when I noticed that in Yahoo we went from nowhere to number 7 and in Bing we went from nowhere to number 1!

 

 

October 4, 2011

A more mellow Panda?

Filed under: Panda — Tags: — uktw @ 6:20 pm

Looks like the Panda got a bit of a make-over, or, as Google always put it, was subject to the 500 or so algorithmic changes that they make each year. A recent post or two has made it clear that they have been monitoring the reactions on the Webmaster Forum (where I can be found lurking from time to time) and, despite the fact that most of the Bionic Posters seem to think the problem is 99% the fault of webmasters, Google has clearly made some changes. Good for them.

Of course, it is hard to know what actual effect the Panda changes had this time as my sites have undergone quite massive rebuilds, redesigns and checks since the last time the Panda strolled by but it would seem that we might be on its good side now … depends if its just run or just about to run!

Mind you, though traffic has grown very recently (fingers crossed it keep growing) its still much less than it was and, worse still, the changes in traffic and in the website content that I have had to create to keep the Panda’s interest mean  that this traffic is not anywhere near so lucrative …. Still, if I can get good traffic because its a good site I should, hopefully, be able to monetise that again … we shall see

September 27, 2011

Waiting for the Panda

Filed under: Panda, SeatChoice — Tags: — uktw @ 1:29 pm

Ok, lots of changes made and now to wait …

Changes made to the website might affect the SERPs reasonably quickly … the Googlebot spider is forever trawling across websites looking for new and changed materials so new items on the site can be indexed pretty quickly … by which I mean the pages will be shoved into the Google database

The Panda, however, does not run all the time. Every now and then (cycle to be determined, somewhere in the 6-8 week frame) Panda comes along and goes through the Google database weeding out what it sees as low quality sites … having done this, it goes to sleep again until the next time.

So in theory you could see a sawtooth waveform on your traffic, slow build up between Panda runs with large drops immediately after a Panda run – if this is the case then you have not yet solved the Panda problem because the best scenario is that you go UP after a Panda run and your competitors (or at least the spammers in your market segment) are the ones going down.

But to know this, you have to wait …..

Meanwhile, our good news is that our Reconsideration Request has been handled and no manual penalties were found on our site …

September 20, 2011

The Great Content Gathers Links Myth

Filed under: Panda — Tags: — uktw @ 5:20 pm

I have been answering some more questions on Webmaster Forum, and asking a few … I keep seeing people say that links to your site are important (perhaps less than they were) and that if you create great content people will link to it – no, they wont!

Actually, having great content doesn’t mean you will get good links and lots of shares – I know Google thinks it does but its not universally true, it depends on the topic area – if people wont need to come back often then they’re unlikely to link and they wont share unless they want to keep up with your news and think they’re friends might want to keep in touch with you. I shall not be sharing links to recently used funeral services, great sites for those with exotic diseases or indeed a million and one other things. I search for, find and use hundreds of sites each week, the vast majority of them are informative and useful AT THE TIME … I have been doing this pretty well every working day since 1994 … I have actually created public links to, perhaps, a couple of dozen sites in that time … and compared to all the users I know, I’m prolific!

Panda fightback stage 2

Filed under: Panda — Tags: — uktw @ 1:13 pm

Time for an update. Back in April, when Panda hit non-US English language sites our traffic fell around 86% – hard to give an exact figure as we were just having our best months ever. Over the next few months we saw a very small recovery followed by another drop and then we hit August, traditionally our worst month and, true to form, traffic started declining again.

Our traffic has always fluctuated, that is the nature of tickets/listings websites … it depends on what’s happening, a celeb appearing here, a new concert there, a new tour announced – all these things change our world naturally, spotting underlying trends is therefore pretty tricky.

During all that time we were not idle of course, as you may have read in our other posts. We are now a lot cleaner as far as SEO and robots are concerned, this may be somewhat more confusing for users but that’s the price they have to pay I’m afraid – no point in having the best organised site in the world if no one finds it because Google doesn’t rate it.

I have continued to take part on Google Webmaster Forum, am now a Level 2 (not very impressive really) and have received my first “Best Answer” – an answer based on things I have learned here. The Post.

Basically we have been making sure that we find and fix problems such as

  • Unnecessary secondary domains that will appear as duplicates (remove and 301 them)
  • Possible url mismatches that can give the same content (rel=canonical them)
  • Really lightweight pages (noindex them)
  • Content duplication (move content, combine content or rel=canonical)
  • External links to our site from toxic neighbours (ask them to remove links, confess to Google as part of a reconsideration request)
  • Poor meta descriptions that will fail to get users to click-through

We are still looking at things such as a large scale url re-write project to fix some url issues – meantime we have created our own url shortener to help in the management of archive links

Its a slow process but it seems to be working … there’s a long way to go till we get back to previous traffic and conversion levels but we seem to be moving in the right direction …

The other big change, however is that we try now to not get excited about traffic gains, nor depressed at traffic loses …. traffic has a habit of coming and going organically anyway and changes we make could take weeks to have an effect on our position … no need to overact!

September 14, 2011

The Generic Search Engine Myth

Filed under: Panda — Tags: — uktw @ 6:49 pm

I’m just wondering whether Google’s goal of being able to answer all questions for all people is really either achievable or desirable. I mean I know its desirable to Google but what about the rest of us?

Recent updates to Google’s searches have made it clear that sites providing search or linking are “no longer acceptable”. The declared aim, very laudable it is too, is to remove all of those horrible thin link sites from the results to give cleaner, clearer responses. Indeed, a common phrase now is “why would I want to link to you if you just link elsewhere, why not just go straight ‘elsewhere’ myself” ….

But the question in my head is, can a generic search engine with limited semantic capability really answer topic specific questions? If the answer is “yes” then I suggest that imdb, Wikipedia and a whole range of other sites need to pack up and go home as all of their internal links and all of their data expertise will soon be replaced with simple google search links ;-)

The simple answer, of course, is that Google can never answer all the questions because they don’t know what is inside the users head when they asked it …. I suspect that there are more people searching “panda death” at the moment than ever before but is this concern for our endangered wildlife or worry about Google’s own algorithm updates? Google can not know that, indeed the same person may well mean both things in separate searches on the same day! Of course, the user can expect to get somewhat off-beam results if they use only a few keywords in their search but I would argue that that may well be what we want to be able to do.

If I were standing in a library and I was looking for “giraffe” I have several options ….probably the most likely are

1) Pick up Encyclopedia Britannica (volume “ganges to hyena” or whatever) and get some basic information

2) Pick up a book on animals and get more specific information

3) Select a nice hefty book on African Mammals and get quite detailed information

4) Pick up a book on Wild Animal Veterinary Practices and … well, you get the idea

In search engine terms, (1) is like looking things up on Google, the editor of the encyclopedia didn’t know what context I was looking for (what the heck is a giraffe?, where do giraffes live?, how long do giraffes live? …) so will have filtered all the world’s giraffe knowledge based on what most people are likely to find interesting – just as Google does.

What this “library analogy” shows though is that, depending on what I want, I will select a “search context” before doing the actual search – I do not expect generic tools to do a specific job, I expect them to do the generic job well … as Google increasingly does. But, and its a huge Panda Butt (!) if I want more specific information then I will use a more specific book … in this argument for ‘book’ read ‘search tool’ …

So to answer situation (4) above I need a Veterinary site with a wildlife section where I can search or use the expertly gathered and annotated links that the site author has put together to help me go to http://www.fixing-your-giraffe.com whilst avoiding http://www.giraffe-quackery.com…; However, a general Veterinary site with those characteristics would fall foul of Google’s view of a “good site” as they don’t themselves have the Giraffe articles on!

In other words, it is very important to me to have a search engine (Google) which will actually find other search engines and indeed even high quality link sites!

Google  has mistakenly assumed that if I type a question into it then the ONLY good answer is the final answer … this is simply not true … if  Google tells me who knows the right answer then that is also a good outcome … unless you are Google and feel that the whole world of human knowledge should be yours to filter as you see fit.

Google has recognised some of this, of course, as they now geo-code results so that you can find things in specific areas and they also have a QDF function that changes how they view the “age” of an article – for some things they think that oldest is best and for others they think that freshest is best – what you think is neither here nor there ;-)

By the way, if you type “search engine” into Google then Google only comes fourth ;-)

September 13, 2011

Panda – Step 1

Filed under: Panda — Tags: — uktw @ 9:57 am

Step 1 of our attempts to recover from Panda was undertaken a little while ago, just after it hit the non-US English language searches with the consequent drop in over 85% of our traffic and our virtual disappearance from the SERPs (Search Engine Results Pages).

Our first action was to try and get over the shock, to realise that there was no point in bleating or howling at the moon and to start thinking about a long term strategy to recover.

Initially we thought this might be a ban. Why? Well, our SEO company had failed to warn us about the Panda under the bed so it came as a surprise. Lesson 1, SEO companies may not be all they claim to be (more of that later!). To check all this we tried the following

  • Did a Google search for site:seatchoice.com to see if we were still in the results … we were
  • Did a check on some of our key-phrases … things we used to be on page 1 for … you have to be persistent here, we eventually found ourselves on pages >25 … not where you want to be but we were at least still in the results!
  • Did a check on a range of obvious penalty issues; site speed, malware (see Google’s Webmaster Tools), stupid htaccess errors, 404 errors, code errors …. none of these seemed to apply
  • Put in a reconsideration request – unusually this was answered (a) quickly and (b) with the helpful phrase “no problems were found with your site”
  • Decided it wasn’t a penalty ….

And breathe ….. Next step was to search and read … a lot. Doing a basic search on “loss of google position” revealed a flurry of posts from around the English Speaking World, it was from this that we learned about “Panda” which meant we could read up on it, assess that this was a very likely cause of our problem, work out that this was not going to be a quick fix and inform our SEO company (yep, we had to tell them!). I cannot emphasies too strongly how important this background reading is, really, everything you need to know is already out there if you take the time to look – and if you’ve just been Panda slapped then you do have the time, nothing will be happening to your site’s position until you read, understand and fix things!

Given that the SEO Company couldn’t come up with a co-herent strategy for recovery and seemed like it might have been at least part of the cause of the problem (bad links from bad articles placed in bad neighbourhoods) we fired them. As mentioned before, we got ourselves a more professional (expensive)  SEO Company but, after a few months, they too went as their strategy seemed to be a secret known only to themselves. It was then that I came across the advice “The best thing to do with your SEO Company is push them under a bus” – well worth considering. Oh, and while we’re on the subject … all those emails you get promising Google Page 1, bin them, now!

Having armed myself with a good deal of background material (save links to good articles, you may need to re-read them later once you understand a bit more about the situation and your site) I went hunting more specific guidance on the Google Webmaster Forum. This forum is manned largely by volunteers but with the occasional Google Employee lurking there too. It is a place to raise questions and receive the combined wisdom of good people who give up their time for free. A few quick pieces of advice if you’re new to it

  • Read for a while before posting, both to check that you don’t have a standard question and also to get a feel for what the current topics and responses are
  • Try to ask a clear question – put in enough information to help those helping you but not so much that they’re bored by the time they’ve finished reading it
  • Don’t argue with people, they are giving you advice, either take it or leave it but respect their opinions, they probably actually do have more experience than you
  • Be a bit humble about your site – they will see it for the first time and so are like users, you know, those mythical visitors who earn your keep?! If they say “on first impressions this is rubbish” don’t dismiss them as idiots, they are not, what they mean to say is “on first impressions this is rubbish”! This is valuable feedback and should make you look at your site again!
  • Personally, I find it easier to ask a few specific questions rather than one huge “why is my traffic crap” one … read a few posts from other people, they think their sites are wonderful and have been unfairly treated .. so do you … why should an outsider agree?
  • READ THE ANSWERS .. if someone takes the time to look at your site (and some people will spend a good half hour researching duplication, backlink history, code anomalies etc for you!) then the very least you can do is spend a few minutes reading and trying to understand what they say!

My first couple of questions on this forum had me told a few things that smarted

  • Site was too slow …. turns out from Webmaster Tools it was slower than 70% of other sites
  • Couldn’t see the point of the site … well ok, its a particularly British issue to have a mass/mess of suppliers and prices for theatre but the fault remains mine for not making the aim of my site clear as a bell on page 1!
  • Just a thin affiliate site – well, the definition of this is that your site adds no value (content or service) to a set of affiliate links … this hurt, but it was the perception of new users (those on the forum) so it was probably the perception of Google … I needed to work on that
  • Thin content … could be true in some areas, wasn’t sure what I could do about that given the size of the problem, but I put it at the top of my issues list
  • Duplication – so many sites with similar content, content coming up under multiple urls, my own sites duplicating content

This gave me my first round of changes, and some of these were hard to get my head around as they went against things I had been doing, and been sure of, for 16 years … but basically

  • Speed: I minified the js/css, removed some junk, increased cache times and got it to be faster than 52% of sites … I also now monitor this criteria regularly
  • What’s the point: Increased visibility/explanation of “the point” .. still working on making it clearer!
  • Affiliate site: Made sure that affiliate links were noindex,nofollow, tried to make sure that they were not seen as part of the main site
  • Thin content: added a new blog on-site (as opposed to this one which is separate), added in user reviews, moved editorial from a secondary site to this one, increased ‘created’ content for otherwise thin pages (in our case this would be shows for which we have no available synopsis)
  • Duplication: Really hard, closed down some sites with duplicate content and 301 redirected them to the main site, made sure I used rel=canonical links to help Google to understand which pages were which, re-checked sitemap, re-design pages so that not all pages for a show/tour carry all of the information in the same format ;-)

I also worked on Google analytics to make sure it recognised our iframe and ajax codes and went through and checked all our meta titles and descriptions ….

Phase 1 complete, took a few weeks but then all indications I had had were that the recovery from Panda could take months and all changes could take weeks and weeks to actually have an effect.

So after that lot the time had come to make sure I had good monitoring habits and I went looking for any deeper causes and issues that could be addressed … oh, and meantime, I kept the company going on our reduced income!

September 9, 2011

Panda – the fight back is underway

Filed under: Panda, SeatChoice — Tags: — uktw @ 6:28 pm

The Google Panda update is still causing us here at SeatChoice/UK Theatre web a mass of headache but we’re fighting back slowly.

The Panda isn’t actually, as we understand it, a direct part of the Google search but it is run from time to time to “weed out” sites that are deemed to be useless – basically all those rotten sites that you used to see in Google search results (SERPs) are now history. Unfortunately, some good sites are being caught in the net too – a bit like dolphins are killed as by-catch when netting for tuna (see Hugh’s Fish Fight for details!) … and yes, we’re part of that collateral damage.

UKTW/SeatChoice has been providing on-line what’s on services since 1995 (1994 if you count Gopher services!) and has been used, over the years, by SeatChoice, the BBC, Whatsonstage, London Dance, the eTelegraph, the New York Times (digital) and more. The services have been discussed on radio, including Front Row and are seen as a significant national resource by the Theatre Museum (V&A) as part of their on-going project to develop a national performing arts archive. Our listings are gathered in from a whole range of sources and are hand entered into our custom database … we then link tickets from over 20 suppliers to the individual shows so that our specialist live ticket search capabilities can find real live ticket availability and price – across the whole UK (not just the lucrative West End).

A labour of love but one that does need to earn enough to keep us doing it!

That was fine, we were doing ok, in fact things were getting better all the time, lots of people turning up at the site and using our unique functionality to find tickets and save money … lots of spend, lots of saved money, we were doing a worthwhile job that was appreciated … then the Panda arrived on the English speaking shores of Google … traffic for SeatChoice fell by over 80% overnight and then continued to slide down …. income went with it … wow …

So now the trick is to unpick why we have been slapped so hard, pick up the pieces, learn the lessons, rebuild and wait! No point in complaining, Google is what Google is and we all benefit from cleaner results. So here’s the first of some blogging about what we’re going to do about it all ;-)

First things first, we checked that the site stayed low in the traffic, checked that it was still being spidered, looked for errors in the code and basically checked around; nothing obvious, we still turned up somewhere in the results just not anywhere useful … we did, however, put in a reconsideration request and were informed that we didn’t break any guidelines. Good. That’s a start.

Next thing was to get advice from our SEO company .. well, actually, first step was to fire our SEO company, get a new one and ask for advice. To be honest, what the old company was doing was fine for the pre-Panda Google, but they should have known Panda was coming (it hit the USA before the rest of the world) and they should have warned us, or at least given us a strategy … we got silence so they got fired. The new SEO company was more business-like .. but in the end didn’t really have strong ideas, or if they did they failed to communicate them ;-) So, we appeared to be spending a lot of money on … well, they never told us what.

We did start to move up for the selected key phrases but to be honest had we been number 1 for all of them we still would not have replaced our original traffic – why? Well, we cover the whole UK, we have an enormous “long tail” response and if those minor pages do well then we do well … just picking off a few key phrases doesn’t really help. So that SEO company has also now gone. We’re on our own, but we’re happier (and richer) that way!

What I (re)discovered was the Google Webmaster Forums (Fora!) … volunteers (and the odd Google employee) who will answer your questions, look at your site, tell you things you don’t want to hear (but need to) and basically try to help. Wonderful people. Reminded me of the early days when everyone was a volunteer and free help was always the order of the day on-line … but then it was 1984 (no, not that 1984) and we were all sharing 64K of bandwidth and singing the praises of the VT100. Happy, heady, days when we argued about Green Book, worried that Janet was big-endian (I still say that’s more logical) and DARPA was little-endian (they won, it was their ball after all), wehn compuserve still had user id’s like 154562.88724 and when I had to login via Oxford University then Goonhilly to read my mail account in Argonne!

The other great discovery was the wonderful Matt Cutts on You Tube – the real word from Google!

Anyway, the lessons learned are that SeatChoice has fallen foul of one or more of the following no-nos

  1. Thin Content – having pages with little content on is a bad thing
  2. Internally Duplicated Content – should be avoided if possible
  3. Externally Duplicated Content – a real turn-off for Google
  4. Affiliate Page – if you’re seen as a not very interesting site with lots of paid links or links to afiliate systems then you’re a prime candidate for being killed by the Panda
  5. External Links – the more you have the better you are!
  6. Quality Content – that’s what you need!
  7. Quality Links – those external links mentioned above? Well, they need to come from quality sites .. if they come from “publish your own press release” sites where all the press releases were written in India and mechanically-mis-translated then you will get negative points not positive ones
  8. Compelling Meta: No point in getting on page 1 of Google results if your title and meta description are so poor that no one chooses to click through!

So, why were we hit so hard ….

  1. Thin Content: we have a lot of pages, one per “listing”, i.e. one per show at a venue … sometimes there’s not much to say about that show, sometimes the pages are indeed thin, sometimes the show doesn’t warrant much ;-)
  2. Internally Duplicated Content: Yes, we have this …  if Lee Evans does 75 dates on a tour, each of those 75 pages on our site would have a copy of the synopsis on
  3. Externally Duplicated Content: if a show’s press officer sends out a press release describing that show then you’re going to see that text a lot … press release sites, theatre/concert sites, newspaper sites, listings sites, venue sites … and then, of course, our listings can be found on other people’s sites … duplication
  4. Affiliate Page: Often leveled at us, but actually unfair – we may be thin sometimes but the functionality we provide is unique, its just that function is not measurable whereas content is
  5. External Links: if a show is only on for a couple of nights you’re going to have trouble getting links …
  6. Quality Content: We have people generating new content all day every day, uniqueness is hard to come by when we’re listing what’s on but we centralise and manually check every thing we get -and quality now means good spelling, grammar and punctuation …
  7. Quality Links: ok, so our previous SEO company was based in India .. but what they did then was not black hat, shame its being so penalised now
  8. Compelling Meta: Probably wasn’t our strong point

Having looked over the SeatChoice site in great detail and having listened to the Webmaster Forum, our SEO company and the monkey on my shoulder I think that the pain has been caused very largely by (7) and made worse by (3), a misinterpretation that we fall foul of (4) and a lack of sufficient (5) … sounds like an order at a Chinese Restaurant ….

To be honest, however, I think Google has missed something here

  • Google are forever talking about “articles” .. publish good ones and you’ll do well. But not every good site is article (as in large scale textual content) driven and adding articles just to get Google’s attention seems wrong – what if your website is driven by functionality? What if the users want a clean page with no extraneous text on it … the man from Google he say no!
  • Google always says “build good content for the user, don’t worry about the search engines”, really? They’re joking right …
  • Google also says “build good content and the links will follow”, for articles this is true, for ephemeral content such as “what’s on” listings this probably isn’t true …. a show may be advertised only a month or so before its on and may be on for one night only …
  • Google has a QDF check in which it tries to decide whether a query demands freshness (QDF) or not, i.e. should the answer be based on the oldest content on the web (presumably the most authoritative) or the newest (fresh news) .. I think it may have this wrong for the keyword “tickets”, why else would a search for “ruby wax tickets” return (admittedly at position 187) a link to my websites Warwick Arts Centre page (which hasn’t mentioned Ruby Wax for a very long time) before it returns a link (40 positions later) to my Ruby Wax Tour of 2000 page (11 years out of date and with no mention of “tickets” in the past 11 years!)  and finally (a further 40 positions later) a link to my current Ruby Wax at the Duchess Theatre page! The user wants 11 year old information more than current information?
  • Google hates sites where the user finds one page then clicks away … but wait, isn’t that the idea? You want “We Will Rock You” tickets so type in “we will rock you tickets” to Google, select the SeatChoice page, look at what’s on offer, click to a supplier and bang, you’re done – best possible user experience, worst possible Google impact! But wait, isn’t that what Google does? Perhaps that’s why google doesn’t come out top when you type in “search engine” ;-)

Ok, so the problem is defined, the solutions need to follow … further blog entries will look at what we have done (and its effects) and what remains to be done (and our hopes for it)

August 30, 2011

Being Killed by the Panda Slap

Filed under: Panda, SeatChoice — Tags: — uktw @ 1:33 pm

There are a growing number of small, legitimate, websites reporting that they are going to have to give up as they can not recover from a fatal Panda Slap – and we are suffering badly too.

A good article, which tries to help explain it; Why Google Panda slapped quality sites.

« Newer PostsOlder Posts »

Theme: Silver is the New Black. Blog at WordPress.com.

Follow

Get every new post delivered to your Inbox.

Join 712 other followers