I’m creating a workspace (site collection) for a department in my organization, their workspace has one document library which contain 39000+ files, I’m facing a a problem with indexing the list items ,
As I have created test workspace (site collection) then i have created test document library with some test documents,
When i run incremental crawl the index was successful and i was able to search the new added test docs, and after that i have imported the big document library into that test workspace (site collection) and did the same incremental crawl but the problem still exist and nothing changed the same problem happen the crawler refuses to crawl the big document library, I’m really confused why this happen, anyone can help me with this. !!
A work around I have done which solved my problem but I do not want to consider that as a solution for the problem.
My work around solution.
When I have created new crawl rule
And I have checked
- Crawl complex URL
- Crawl Sharepoint content as http pages
And then run the incremental crawl. It started to index the document library items and is taking too much time more than 24 hours. And my other question
“is that normal ?”
The above solution did not work when I changed the crawl rule to be like this
and those three rules have the below settings.
- Crawl complex URL
- Crawl Sharepoint content as http pages
Karim El Zarka, MCTS Sharepoint 2010 , MCITP SharePoint Administrator 2010