Thats a great questions.
My First Site Map Consist of just about 425 categories but only 412 were indexed. There is no tool that I have been able to find that monitors the exact URL and checks it against what has been indexed.
I spent literately 1 Full Day tracking each link. to Find Which one was not indexed.
Technically none of the links are duplicates. There maybe some that are close but that shouldn't really make a difference. Even if duplicate it still should at least be indexed.
Since we deal with electronics so I wanted to compare
I understand duplicate content which we are working on to minimize. But..
Amazon 156million pages indexed in google
Digi-key 19million pages indexed in google
Ebay 19million pages indexed in google
Allied Electronic 6million pages indexed in google
Newark Electronics 3milion pages indexed in google
Each of these site have a similar setup like ours who also sell multiple like products with content that is similar or even duplicate
In addition in Google WMT
Duplicate meta descriptions 15
Long meta descriptions 1
Short meta descriptions 42
Duplicate title tags 2
Non-indexable content Pages
We didn't detect any issues with non-indexable content on your site. <<<<<<----------- See????? WHat Gives
Edited by Jill, 02 January 2016 - 09:33 AM.