Blog

Is Marissa Mayer Restarting Yahoo Search?

In July, Yahoo announced that they had hired Google famed Marissa Mayer as their new CEO. Unlike everyone else in the tech sector, I was disappointed. My disappointment stemmed from the fact that for the last several years Yahoo has been the surefire place where things go to die. This made me sad because Mayer has always been at the center of innovation as Google’s Vice President of Search Products and User Experience during the company’s most radical growth period. Yahoo seemed like a step down. But at the same time I have been hopeful that she could turn Yahoo around and build something amazing. Then this weekend something weird happened…

Over the weekend I was checking the traffic stats for one of my less serious projects with Statcounter and saw something odd in the visitor report:

When I saw “Yahoo! Slurp 3.0” I was shocked and confused. Slurp is the name of Yahoo’s web crawler. Version 3.0 launched in April of 2008. However, almost a year later Yahoo quit crawling the web and replaced their results with Bing.  Because of this I was almost certain that someone was spoofing their user agent to hide their identity. In fact many of the commercial scrappers on the market allow you the ability to change your user agent to what ever you want. There is even a handy little browser plugin that does this as well.

I posted a status on Facebook and soon learned that my buddy Meg Geddes has been seeing the same thing in Statcounter.

A buttload?? This got me thinking….so I went back to my Statcounter login and drilled down a bit further and this is what I found:

From the above we can see that the request is absolutely coming from Yahoo, that the client has Javascript enabled, and that a screen resolution is recorded. At first glance this looks like a typical request from a browser such as Chrome or Firefox. But why wouldn’t they just disclose that in the user agent? Because maybe this is a browser/crawler hybrid?

So this morning I wake up and can’t stop thinking about Meg’s buttload…Its one thing to see this type of behavior in random intervals, its another to have a buttload. (Also, I like repeating the term “buttload”, I am so sorry.) So, to get further to the bottum of this, I sent Meg an email with some questions:

JH: When did you first start seeing Slurp in your reports this year?

MEG: I don’t know when they started, but I probably first noticed around late spring.

JH: Is there ever any Referring URLs?

MEG: No there are never any referring URLs.

JH: How many pages per domain does it typically visit?

MEG: Probably around 50-100 per day across many sites. Interestingly, I don’t think they’re showing up in Google Analytics, so it may well just be a Statcounter thing.

JH: Do your server logs show the same type of data that Statcounter does?

MEG: Yep.

JH: Peanut butter: crunchy or creamy?

MEG: Dude. Extra Crunchy Jif. Sometimes I add MORE peanuts. I’m hardcore like that.

Meg also shared with us this forum posting where Statcounter moderators point out that these might be image crawling bots which are indexing the 1 pixel image Statcounter uses to send visitor data back to their servers. However, last time I checked (just now), Yahoo’s image search still says, “Powered by Bing™” at the bottom.

Yahoo’s alliance with Bing is supposed to continue til 2019, but that doesn’t impede on Yahoo to continue developing their own internal search products. In fact, they could be developing something that integrates with a future product set that is not search related at all.

Either way its fun to think that maybe somewhere on the horizon there is the possibility of a more competitive search landscape with Mayer commanding a serious competitor. If that is ever the case, then shes already got a new fanboy!

SEO “Outing” Is Immoral

nullWhen I first started working in the SEO industry I couldn’t understand why “outing” was such a big deal. In fact (like others in the industry) I felt the inability to talk openly prohibited our industry from growing and handling our reputation. However, back then I was naive and inexperienced. I have now seen the damage that “outing” can leave. And because of that I can’t keep my opinion on this issue quiet while having a clear conscious at the same time.

Before we get dirty with the details, I want to add a disclaimer: I have absolutely no relationship to any of the entities mentioned in this post. I do not have any relationship to any blog/link network or organized spammer.

By now I am sure that most of you have read about the demise of Build My Rank. When I first read that article, I felt sick (that is not a hyperbole). As an entrepreneur I can’t imagine what it must feel like to realize that in a matter of days your company is finished. I don’t want to get into the specifics over this incident, but it appears that Google’s moves against them were a result of a blog post and ensuing public debate that outed them as a link spammer.

Link spamming is not a viable strategy for SEO. Yes, you can see short term results, but by and large, these services aren’t for long term growth. Even though I think these services are a waste of money, I could care less if others use them, as long as they know the full risk involved. Many rave about lobster, but I like crab more, and that won’t stop me from having dinner with them.

But the problem with SEO outing isn’t just a difference of opinion on strategy. The problem with SEO outing is that no one assumes the full consequences of their actions. Let’s take the BMR incident as an example. How much money did they lose as a result of being outed? Do their employees have families? How many of their clients are now seeing revenue lost? How many SEO agencies contracted with them? And how many of their clients are affected? How many innocent business owners that don’t know the risk involved with these networks are now suffering? How many people are now on unemployment?

I mentioned in the beginning that I use to not understand why outing was so wrong. What changed my mind, is meeting client after client that has suffered bad SEO advice and has seen a substantial loss. Outing, only exacerbates this process by raising the level of risk.

When people engage in questionable SEO practices they are taking a risk. Many of them know the risk they are taking, but many of them don’t. Either way, it’s no one’s place to make that risk even greater. If your paycheck doesn’t say “Google” on it, it’s not your job to police the web.

So then what is your job? Your job is to keep a high standard for yourself. Your job is to keep a high standard for those you do business with. Your job is to continue educating the public on what good SEO looks like. That is how we build a better industry. That is how we build a better community. That is how we build a better web. Outing does none of that. What outing does do is create dramatic blog post that allows for the author to take a moral high ground while potentially ruining innocent people’s livelihoods. It makes me sick.

[photo credit]

Dear SEOs, Please Shut Up

Ok, so this post will probably make me the odd man out. But honestly I am having a hard time staying quiet any longer.

I have noticed a recent trend with in the SEO community to push Google to take action in several areas that I believe have an adverse effect on SEO. In many cases I see very well respected SEOs pushing Google to in effect make their jobs (and everyone else’s) harder. Here are two examples:

Exact Match Domains So you are upset that some domain that has exact match, ranks higher than you. I get that. What I don’t get is pushing Google to do something about it. Buying exact match domains has to be one of the best ways to aggressively take over a niche. But guess what? If you keep complaining about it, they will do something about it! So shut up already and buy your own!

Content Farms This one completely boggles my mind. Content farms exist because they are highly lucrative. I know that you are tired of seeing them out rank you at every turn. But how about instead of complaining publicly about it, you build your own! I am not saying that you need to spam the results with low quality content. But you can learn a lot about content development, content monetization, and syndication by mimicking content farms. And the greatest thing is that they are cheap to get started, and maintain. Google will even help you monetize them!

There are a whole host of other things SEOs complain publicly about that I wish they would just shut up about. I understand the desire to hold Google to a higher standard, and make sure they deliver on what they promise. But why do that at the expense of making your job/income harder to achieve?? Just shut up already!

The Joe Hall Story

Hello there, my name is Joe Hall. My work has begun to gain more attention and momentum, and the company I founded a few years ago is building a strong brand with in its industry. I live an increasingly public life on-line, and I have a disability.

For the last several years I haven’t felt that my disability isn’t relevant to many of the things I do on the internet. Because of that I have tried to steer the dialog away from it. In short, I want folks to talk about me because of the code that I write, the brands that I build, and the stories that I tell. Not because of the 200 pounds of steel strapped to my ass.

Because of this I have been apprehensive about talking publicly about my disability in the last several years. Which quite honestly has been really hard and strange for me. You see, I used to do nothing but talk about my disability (more on that later). But now its time that I let the cat out of the bag and start talking honestly about my life with a disability. I hope by doing this I can share a different perspective on the things I do.

A long time ago in a galaxy far far away…

On January 22nd 1982 my twin sister, Rachel, and I were born. Weighing in at 6lb 6ozs Rachel was perfect in every way. However, I had a different agenda. Sporting an authentic South Carolina mullet (seriously, it was weird) that went half way down my back, I came into this world blazing! To start things off, I had 22 broken bones during child birth. With the medical staff not really sure what to do with me, they decided to call in an expert. Soon, Dr. Richard M Davis diagnosed me with a rare bone disorder called Osteogenesis Imperfecta (OI).

Osteogenesis Imperfecta is a genetic disorder characterized by bones that break easily, often from little or no apparent cause. If you really want to geek out on OI, read up on genetic collagen deformities.

So in short, OI causes my bones to break easily. I have had some where in the ball park of a few hundred fractures so far. OI is also defined by the LPA as one of the most common types of dwarfism.

As a result of having OI I am three feet tall and use an electric wheelchair. I am also partially deaf as a result of OI affecting the bones in my ears.

The birth of a hacker.

So having a brittle bone disorder as a kid means not playing sports, riding a bike, or taking part in many of the physical activities that most children enjoy. Because of this I think most people with OI develop a creative personality at a very young age, from the need to entertain themselves. While many of my friends were playing school sports or exploring the neighborhood, I was in my room taking things apart.

Joe Hall – Age 10 – Family Vacation

Yep, that’s right I said taking things apart. You see from as far back as I can remember I have always had a very curious obsession with learning how things work. I love to look inside something and trace the steps and parts to see how it functions. Which is what ultimately led me to teach myself to program using reverse engineering. Taking things apart was so much of an obsession that as a kid I started taking apart anything I could get my hands on. I have taken apart, TVs, telephones, radios, clocks, watches, remote controls, cameras, fans, VCR’s, camcorders, computers, lamps, doorbells, door locks, and much more. My favorite thing to take apart is a hair dryer, because when you remove the outer shell it looks like a ray gun.

Eventually, my parents got a bit tired of me taking apart all of the appliances in the house and started taking me to garage sales on Saturday mornings to find new things to take apart. The rest of the weekend was devoted to hacking my new prize! I remember visiting my friends houses and they would have shoe boxes of baseball cards. When they visited my house they would see my shoe boxes of electric motors, LEDs, circuit boards, and battery assemblies.

As I got older I taught myself how to write HTML using Angelfire and Geocities to experiment with. Web development back then was different mostly because WYSIWYG editors weren’t widely available like they are now, and as a result folks that built web sites actually understood the code.

Joe goes to Washington

During my senior year of high school I remember a lot of folks telling me that I should study computer science in college. A few folks told me that working with computers would be the best choice for me because of my disability. After I heard that I knew I would never study computer science! The absolute worst thing you can tell a young person with a disability is, you should do this or that because of your disability.

So, I did what any idealistic energized young person would do, I studied politics! During my study of political science I quickly became involved in the disability rights movement. I joined the National Disabled Students Union two weeks after it was founded. And, several years later became their executive director. My time at NDSU was one of the most important parts of my life. I can accredit most of my marketing and PR skills to working along side some of the most amazing public policy and political minds in the disability policy sphere. It was during this time that I started to learn about marketing. Although at the time we called it grass roots political action, but in the end it was marketing none the less. In both marketing and grass roots advocacy, we promote ideas, organize people around information, and sell hope.

Back to Binary

While I was deep in the political world, I never stopped writing code. In the little bit of spare time I had in 2002 I created Sivle. And I often did small web sites for the organizations I was working with. After college I kept volunteering for many of the organizations that I was active with in college. But then discovered the hard truth that there isn’t much money in changing the world. In fact many of the jobs that I was most passionate about back then didn’t pay a dime.

So, I naturally started building web sites and custom web applications for anyone that needed it. Eventually, I took a job as an in house IT specialist at a local real estate company. While there I convinced the broker in charge to let me build a web site and start an internet marketing campaign. With in several months our leads from the internet went from 0% to 90%. Despite the influx of leads the company still had a hard time in a terrible market. As a result, slowly every member of the staff was laid off, except me. As my broker put it, I was the only one that produced results. However, even my internet marketing magic couldn’t stand up against one of the worst housing markets in history, and soon I was let go as well.

For the last several years I have put my heart, soul, money, and lack of sleep into building a business on the internet, and, I can honestly say that I am more excited about the future than I ever have been. I have no idea where I will be next year, but I can’t wait to get there.

If you have never talked to me online or met me in person, make sure you reach out on Twitter or with the links to the right. Or email me anytime at joe [at] jozsoft [dot] com