Talk Directories - Directory Discussion Forums  

Welcome to Talk Directories forums.

You are currently viewing our boards as a guest which gives you limited access to view most discussions and access our other features. By joining our free community you will have access to post topics, communicate privately with other members (PM), respond to polls, upload content and access many other special features. Registration is fast, simple and absolutely free so please, join our community today!

Go Back   Talk Directories - Directory Discussion Forums > Web Directories > General Directory Discussion

General Directory Discussion All general directory discussion belongs here such. Directories as a method of link building, directory submissions, submission services, directory editing, directory ethics are examples of topics that belong here.

Reply
 
LinkBack Thread Tools Display Modes
Old 09-08-2007, 12:44 AM   #1
 
rtchar's Avatar
 
Status: Pagerank 1
Join Date: Jun 2007
Posts: 61
rtchar is on a distinguished road
IM:
Default Analysis - Directory Indexing Problem

First to explain the issue facing some directories ...

When we search for a directory on Google's site using www.domain.com most directories will come up as the first search result.

However if enclosed in quotes "www.domain.com" many directories are NOT in the first result. Often these directories do not appear for targetted keywords in the first 30 or 40 results. Some people are also noting a drop in the number of indexed pages.

This has led some people to speculate there is a error in Google's reults OR there has been a penalty applied.

The sites are NOT banned since they appear in the index when searching for their domain name. For the most part page rank has remained unchanged, where a banned site will usually show a gray bar.

So the big question --- "what is going on here?"
rtchar is offline  
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
Old 09-08-2007, 01:27 AM   #2
 
rtchar's Avatar
 
Status: Pagerank 1
Join Date: Jun 2007
Posts: 61
rtchar is on a distinguished road
IM:
Default The Analysis

We are currently studying over 300 bid directories to see how they have been affected, in what numbers, and with any kind of luck ... why!

So far we have looked at 274 directories and the problem is both worse than expected and yet encouraging.

The worst part is that many forums and blogs are stating only 60 directories were affected, but of the 274 bid directories examined, 91 are experiencing this problem. Remember we are only looking at BID DIRECTORIES! Paid directories and I expect free directories are probably also having the same issues. (I'll leave that up to someone else to prove).

The good news is that ALL bid directories are NOT being singled out.

A number of factors have been looked at and we can't say why these 91 were singled out yet. But we can eliminate some of the factors we did look into ....

1. SITE WIDE LINKS
Many of the sites still in the SERPs have site wides on their pages and have also purchased site wide links for their bid directories.

2. PAID LINKS
The distibution of back links is relatively similar for both classes of bid directories. There does not appear to be any significant difference in the numbers or types of links employed. Each appears to have significant numbers of forum links, site wides and paid links.

3. SELLING PAGE RANK
Again there does not appear to be any difference in the distribution of PR. Some sites with high rank have been spared while others have problems ranking for searches of any kind. There are also many sites that have PR0 or N/A that have also been affected.

4. ADULT LINKS
We checked to see if sites that allowed gambling, lingerie, or adult links showed any difference --- no!

5. SITE AGE
There was some speculation that maybe Google just had not gotten around to some of the newer directories. There are still two sites in search results that were indexed at the beginning of January. In addition some sites are so new they only have 4-5 links pointing to their sites --- none paid by the way!

Last edited by rtchar; 09-08-2007 at 01:29 AM.
rtchar is offline  
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
Old 09-09-2007, 01:23 AM   #3
 
rtchar's Avatar
 
Status: Pagerank 1
Join Date: Jun 2007
Posts: 61
rtchar is on a distinguished road
IM:
Default Continuing Analysis

We have taken a slightly different tact in looking at the problem and are now assuming that the indexing issue is internal to the websites. Google has always said there is almost nothing another webmaster can do to hurt your site ...

6. EMPTY CATEGORIES
We are seeing many websites that have a huge number of empty categories .... if you don't have listings on a page you should nofollow these empty pages. Like charities are ever going to bid for position.

7. DUPLICATE CONTENT
Now here is an issue that looks like it is causing our problem .... large numbers of sites are showing duplicate content AND having indexing problems. Also many sites that are not having issues show very little duplication in content.

At first glance I was thrown off due to several sites having a large amount of duplicate text but no problems. However after checking again we are seeing that this is mostly template duplication --- must not draw a penalty?

I strongly suggest you run your entire sites through Copyscape --- it now looks like we created this problem ourselves!!!!

SO MUCH TIME WASTED LISTENING TO SEO EXPERTS, GOOGLE BASHERS AND DIRECTORY HATERS!!!!

Last edited by rtchar; 09-09-2007 at 03:53 PM.
rtchar is offline  
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
Old 09-09-2007, 02:29 AM   #4
 
rtchar's Avatar
 
Status: Pagerank 1
Join Date: Jun 2007
Posts: 61
rtchar is on a distinguished road
IM:
Default

Here are some of the numbers we found .... just looking at the home pages!

Showing PR, Duplication, and Links

Top 10 Sites NO Indexing Problem

PR4 - 19 words matching 228,017
PR7 - No copies found 89,531
PR4 - 94 words matching 56,417
PR4 - 81 words matching 36,359
PR3 - 42 words matching 24,878
PR0 - 35 words matching 19,590
PR0 - 58 words matching 19,297
PR2 - 18 words matching 18,746
PR0 - 97 words matching 16,704
PR2 - 49 words matching 15,661

Top 10 Sites WITH Indexing Problem

PR7 - 627 words matching 1,203,902
PR4 - 513 words matching 159,792
PR5 - 19 words matching 58,461
PR0 - 61 words matching 45,839
PR6 - 239 words matching 27,572
PR4 - 188 words matching 17,387
PR3 - 171 words matching 17,231
PR0 - 746 words matching 13,421
PR0 - 116 words matching 12,769
PR0 - 174 words matching 10,290

Google may have made some improvements to their duplication filter ...

This may not be the only change! Google is notorious for making multiple revisions to their algorithm to hide the filters being implemented.

Got to go work on my own site now (125 words matching)

Last edited by rtchar; 09-09-2007 at 02:37 AM.
rtchar is offline  
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
Old 09-09-2007, 02:17 PM   #5
 
mikey1090's Avatar
 
Status: Talk Directories - Admin
Join Date: Apr 2007
Posts: 579
mikey1090 is on a distinguished road
IM:
Default

Nice research rtchar!
__________________
Welcome to TalkDirectories - a great place to discuss Search Engines, Web Directories and other webmaster issues. Fell free to join our community today and start talking!
Turnkey Websites | Turnkey Websites
mikey1090 is offline  
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
Old 09-09-2007, 04:23 PM   #6
 
rtchar's Avatar
 
Status: Pagerank 1
Join Date: Jun 2007
Posts: 61
rtchar is on a distinguished road
IM:
Default

Thanks!

It makes sense when you see dozens of sites using the same templates, with the same categories (mostly empty) and all of them featuring the same links from the same bidders.

We are verifying from the bottom up and the theory still holds.

PR0 - 54 words matching with 5 in bound links. This site has sold a grand total of 4 links.

Does it make sense that Google would penalize this site by hand?

I am not sure if we need to file a reinclusion request after all the duplicate content has been removed ...

Last edited by rtchar; 09-09-2007 at 04:26 PM.
rtchar is offline  
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
Old 09-09-2007, 11:15 PM   #7
 
mikey1090's Avatar
 
Status: Talk Directories - Admin
Join Date: Apr 2007
Posts: 579
mikey1090 is on a distinguished road
IM:
Default

Quote:
Originally Posted by rtchar View Post
Does it make sense that Google would penalize this site by hand?
With the weird things that are going on right now with Google, who knows...
__________________
Welcome to TalkDirectories - a great place to discuss Search Engines, Web Directories and other webmaster issues. Fell free to join our community today and start talking!
Turnkey Websites | Turnkey Websites
mikey1090 is offline  
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
Old 09-09-2007, 11:45 PM   #8
 
rtchar's Avatar
 
Status: Pagerank 1
Join Date: Jun 2007
Posts: 61
rtchar is on a distinguished road
IM:
Default

It almost looks like there was an exception to the duplicate content filter if directory links were involved.

Looks to me like Google is simply applying the same standard to directories as they do on every other site that has faced a duplicate content penalty.

They must be able to tweak it by industry?
The exact same thing has happened to affiliate sites, and in the real estate industry last year.

Strangely we have not seen it happen to books, shareware and music sites ... yet!
rtchar is offline  
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
Old 09-11-2007, 01:25 PM   #9
 
LanceT's Avatar
 
Status: Pagerank 0
Join Date: Sep 2007
Location: www.beacon-directory.com
Posts: 39
LanceT is on a distinguished road
IM:
Default

RTChar! Excellent!!! That's all can say, Excellent! thanks so much for your well thought out posts!

Lance
LanceT is offline  
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
Old 09-11-2007, 02:23 PM   #10
 
rtchar's Avatar
 
Status: Pagerank 1
Join Date: Jun 2007
Posts: 61
rtchar is on a distinguished road
IM:
Default

I see Google is starting to de-index some sites ...

Maybe somebody should point this thread out to Mikey!

I checked his home page on Copyscape ...

Quote:
This page has 755 words matching your text
The theory is still holding up.
rtchar is offline  
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
Old 09-11-2007, 03:05 PM   #11
 
LanceT's Avatar
 
Status: Pagerank 0
Join Date: Sep 2007
Location: www.beacon-directory.com
Posts: 39
LanceT is on a distinguished road
IM:
Default

rtchar... How often is copyscape updated? I have tried changing some of my text but it keeps showing up... I am sure it isn't real-time, but I was curious if you knew.

Lance
LanceT is offline  
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
Old 09-11-2007, 04:08 PM   #12
 
rtchar's Avatar
 
Status: Pagerank 1
Join Date: Jun 2007
Posts: 61
rtchar is on a distinguished road
IM:
Default

Quote:
Originally Posted by LanceT View Post
rtchar... How often is copyscape updated? I have tried changing some of my text but it keeps showing up... I am sure it isn't real-time, but I was curious if you knew.

Lance
Hmmm ... it updates in real time for me?

As soon as I upload the changes I recheck the page ... they only show the top ten with each search and there is more than that sometimes.
rtchar is offline  
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
Old 09-12-2007, 04:02 PM   #13
 
mikey1090's Avatar
 
Status: Talk Directories - Admin
Join Date: Apr 2007
Posts: 579
mikey1090 is on a distinguished road
IM:
Default

I tried to use it on these forums and it returned too many erroneous results. I wonder if it's bread and butter is less script driven sites that have more content.
__________________
Welcome to TalkDirectories - a great place to discuss Search Engines, Web Directories and other webmaster issues. Fell free to join our community today and start talking!
Turnkey Websites | Turnkey Websites
mikey1090 is offline  
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
Old 09-12-2007, 06:00 PM   #14
 
rtchar's Avatar
 
Status: Pagerank 1
Join Date: Jun 2007
Posts: 61
rtchar is on a distinguished road
IM:
Default

Copyscape is far from a perfect tool ... it simply searches for blocks of matching text. There is not a lot of intelligence behind it, you still have to determine if the level of duplication is acceptable or not.

That said it is the best/only tool available for free online that does this efficiently.

You can accomplish the same task manually by searching for quoted sentences in Google and then look for progessively smaller phrases until you are satisfied that duplication does not exist.
rtchar is offline  
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
Reply



Currently Active Users Viewing This Thread: 1 (0 members and 1 guests)
 
Thread Tools
Display Modes


Similar Threads
Thread Thread Starter Forum Replies Last Post
How does your directory template affect SEO/Search Engine Indexing? mikey1090 Directory Design & Templates 2 02-03-2008 10:34 AM
Radeon X1950 Pro problem gury Support, Suggestions and Feedback 0 12-06-2007 01:21 AM



Copyright © 2007 - 2010 iTalkWebs Network - .Ad Management by RedTyger

LinkBacks Enabled by vBSEO 3.1.0

1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25