23 replies to this topic

[beke]

Googlebot crawling but not indexing

I really don't understand... Googlebot began to crawl this website ( www.inflorence.com) in April.

It visited at least 4 pages, but today, september 26th it have indexed just the default.htm

Why is Googlebot respidering only the home page?

I'm sure that all pages are pretty correctly linked, I tried to explore the site with "Linx" also and everithing worked fine...

Any Idea?

Here is th list of the Googlebots visits:


26/04/2003 16.00.00 crawl1.googlebot.com /robots.txt

26/04/2003 16.00.00 crawl1.googlebot.com /Default.htm

26/04/2003 17.00.00 crawl7.googlebot.com /sito/mappa-sito.htm

26/04/2003 19.00.00 crawl3.googlebot.com /sito/contatti.htm

26/04/2003 19.00.00 crawl2.googlebot.com /sito-uk/default.htm

26/04/2003 21.00.00 crawl2.googlebot.com /sito-uk/motion-prodotti.swf

26/04/2003 21.00.00 crawl7.googlebot.com /motion-prodotti.swf

26/04/2003 21.00.00 crawl2.googlebot.com /inflorence-top-default.swf

31/05/2003 crawler11.googlebot.com /robots.txt

31/05/2003 crawler11.googlebot.com /Default.htm

31/05/2003 6.00.00 crawler11.googlebot.com /robots.txt

31/05/2003 6.00.00 crawler11.googlebot.com /Default.htm

11/06/2003 13.00.00 crawler12.googlebot.com /robots.txt

11/06/2003 13.00.00 crawler12.googlebot.com /Default.htm

29/06/2003 5.00.00 crawler11.googlebot.com /robots.txt

29/06/2003 5.00.00 crawler11.googlebot.com /Default.htm

03/07/2003 22.00.00 crawl36.googlebot.com /robots.txt

03/07/2003 22.00.00 crawl36.googlebot.com /sito-uk/default.htm

21/07/2003 crawler14.googlebot.com /robots.txt

21/07/2003 crawler14.googlebot.com /Default.htm

30/07/2003 9.00.00 crawler10.googlebot.com /robots.txt

30/07/2003 9.00.00 crawler10.googlebot.com /Default.htm

11/08/2003 6.00.00 crawler13.googlebot.com /robots.txt

11/08/2003 6.00.00 crawler13.googlebot.com /Default.htm

20/08/2003 22.00.00 crawler13.googlebot.com /robots.txt

20/08/2003 22.00.00 crawler13.googlebot.com /Default.htm

24/08/2003 22.00.00 crawler14.googlebot.com /robots.txt

24/08/2003 22.00.00 crawler14.googlebot.com /Default.htm

02/09/2003 18.00.00 crawler11.googlebot.com /robots.txt

02/09/2003 18.00.00 crawler11.googlebot.com /Default.htm

04/09/2003 2.00.00 crawl31.googlebot.com /robots.txt

04/09/2003 2.00.00 crawl31.googlebot.com /sito-uk/default.htm

13/09/2003 2.00.00 crawler10.googlebot.com /robots.txt

13/09/2003 2.00.00 crawler10.googlebot.com /Default.htm

Edited by Jill, 28 September 2003 - 09:54 AM.

[bwelford]

At least, Googlebot looks at your home page as well as the robots.txt file each time it visits.

I have the Inktomi robot (Slurp) visiting me frequently and each time it looks at only one page or file. Over three quarters of the visits look only at the robots.txt file. Can anyone explain that? It hardly needs to check 20 times a day that my website continues to exist!

Barry Welford

[powerofeyes]

Hello Friend.
I just saw your site. It has lot of problems for a good search engine navigation. First thing it is in frames Since your site is hidden inside frames it reduces your page rank considerably. And the second most important thing you site doesn't seem to have good textual contents.
As you will be aware of search engines need lots of textual contents to judge your site. And you seem to have lots of images without any ALT TAG in it. This is again a major problem. Please add sufficient ALT tags for these images and improve your textual contents. Try to bring your site out of frames. Develop good link exchanges you will see good results i guarantee you. Till then no search engine will be impressed by your site even though they visit them often,

vijay

[Scottie]

Hi Vijay-

Alt attributes are for describing images. Not for search engine optimization.

The only time an alt attribute figures in to the on-page criteria is when it is decribing an image that is a link.

[powerofeyes]

Hello,
Scottie do you think alt tags wont help for search engine optimization. This is really surprising the three most important tags for search engines are TITLE TAG, META DESCRIPTION TAG AND ALT TAG.
Even google gives lot of importance to alt tags. They are very useful for text only browsers that is why google rates it so high. I have couple of sites that have no contents but just by adding a good alt tag google listed my site in top rankings so I consider ALT TAGS VERY IMPORTANT.
And it is not just for links but also helps in optimization. That is what I feel and have experienced,
thanks,
vijay.

[Scottie]

Hi vijay.

I completely disagree with you on the Meta Description and Alt tags. They have little to no effect in Google or any of the other engines.

You seem to have a lot of outdated information and myths that used to be prevalent but have since changed or been disproved. Spend some time reading Jill's newsletters to get up to date on how things really work or spend more time reading the threads here. I think it would help clear up a lot of your misconceptions!

[powerofeyes]

Hello Scottie,
I didnt say meta tags on a whole but only Meta description tags. Even though body contents are the most important ones. meta description tags are used by all search engines to describe a site,
VIJAY

[SearchRank]

meta description tags are used by all search engines to describe a site

Actually Google ignores the meta description tag and rather forms the description from the content of your site. Teoma is hit and miss on this as well.

[Scottie]

I didn't say meta tags as a whole either, I was specifically referring to the meta description tag. It is not used as part of the ranking.

Some engines do display it as a description of the site but Google actually pulls a snippet of text to use instead of the description meta tag. If there is nothing else in the page, I have seen Google occasionally show the meta description.

It is definitely not one of the 3 most important tags for SEO.

[powerofeyes]

Hello Scottie,
I accept google will ignore the description tag if there is no genuine contents in the page related to the tag. But can you tell me the most important tags. You said Meta title tag is very important if that is the case i didnt find any results adding it in my clients page. i get results only by geniuine keyword density and textual contents, Can you tell me how it is considered by google,
thanks,
VIJAY

[Jill]

Vijay,

The Title tag is not a Meta tag, and it IS one of the most important tags for helping to obtain high rankings.

Alt Tags and Meta description tags have very, very little power to help your page's rankings in the search engines, therefore I would definitely not call them the most important tags.

Tags in general are not important. The Title tag and the copy on the page, and the links to your site. Those make up the 3 things that have much bearing on your rankings. The rest help only a tiny bit, and only if the other things are missing.

Jill

[powerofeyes]

Hello Jill,
I am an SEO with good results and i am well aware that tags are considered very low by search engines. But to test the relevancy of the site it is important am i right. I have experienced this a lot a good written title and meta description tag with relevant body contents have given be rankings,
thanks,
VIJAY.

[Jill]

I have experienced this a lot a good written title and meta description tag with relevant body contents have given be rankings,

Vijay, how were you able to isolate that the Meta Description tag had anything to do with the site's high rankings. I'd be interested in your testing and study methods.

Jill

[powerofeyes]

Hello Jill,
I am reluctant to give any sample of my client sites here. But still I feel may be i am wrong META description tag is important and well appreciated by all search engines. And one other meta tag which was working for me is the robot meta tag all the other meta information was not at all considered,
thanks,
VIJAY

[polarmate]

how were you able to isolate that the Meta Description tag had anything to do with the site's high rankings.  I'd be interested in your testing and study methods.
Jill

I have no test. I only have a result that shows that Google decided to use the meta description instead of a snippet on the page. See #1.
http://www.google.co...asters children

Any clues why Google decided the snippet should be picked up from the description and not from the content on the page? The word children does not exist on the page. The site's content is not properly optimized yet.