Page 1 of 1

Upper limit for v.8

PostPosted: Sat Jul 20, 2013 12:16 am
by edsager
Hello All,

I will be upgrading to v.8 from v.6.7 some time in the next 30-45 days or so and I wanted to be prepared for any upper limits to the index.

I tested X1 v.7 for awhile and found that it handled the large number of files it indexed better than 6.7, but still not very well. X1 would hang for anywhere from a few seconds to so long that I had to End Process on it to get to other work.

FYI: I have nearly 3 million files listed as having been indexed.

1. What is the upper limit of files which X1 can index?

2. What is the recommended upper limit?

Thanks,
edsager

Computer specs:
Windows 7 Pro 64-bit
16GB DDR3-1866
Total HDD memory: 2 TB
OS HDD: Enterprise Level WD 500GB 7200 rpm

Re: Upper limit for v.8

PostPosted: Sat Aug 17, 2013 2:25 pm
by Coast
Well that's sort of exactly my question that I posted in a new topic. I hadn't seen yours. Sorry.

I have 4 GB of web files which generate 4,000,000 documents. I was up to 1,500,000 but had some problems. It may or may not have been the cause for X1 to pause for a long time. I decided to repair the problem and start over. I'm at 125,000 files now.

Re: Upper limit for v.8

PostPosted: Sun Aug 18, 2013 8:25 am
by Kenward
I currently index 123GB GB of PDF files and web pages, including nearly 9GB of web pages, without any problems when it comes to performance.

Re: Upper limit for v.8

PostPosted: Sun Aug 18, 2013 8:27 am
by Coast
Yea sorry, I meant 400 GB of files.

AMD 8 core 3.1 Ghz 16 GB RAM Wndows 7 Pro

Re: Upper limit for v.8

PostPosted: Sun Aug 18, 2013 11:31 pm
by edsager
Thank you for your replies.

Nice to know others' experiences with large numbers of items indexed.

I would love to hear more from anyone.

Thanks,
edsager

Re: Upper limit for v.8

PostPosted: Mon Aug 19, 2013 4:42 am
by Kenward
My experience is that while X1 can happily index a mountain of files, it is not as swift as it could be when you want to search through a large number of small files, web pages for example.

While it can quickly find things in a load of PDF files, searching in a much smaller (by size) set of many more (by number) web documents is slow and flaky.

I have a saved search of web pages, it is slow to load and is less stable than other document types.

And this is on a PC that many people would consider overpowered.

Re: Upper limit for v.8

PostPosted: Wed Sep 14, 2016 2:23 pm
by renatosobral
Hi All,

I'm experiencing some problems while indexing 1,25TB of files, of many extensions.
Several errors are registred at X1ContentExtraction.log file and if I stop X1 Search, it doesn't save the last index. Last time, I lost 700.000 files!

Does anyone knows something about this behavior ?

Thanks

Renato

Re: Upper limit for v.8

PostPosted: Fri Sep 16, 2016 6:10 am
by poy
Hi Renato,
your experience matches mine.
If you index Millions of items, X1 becomes pretty unpredictable.
Today I am at 5.3Mio items. Whenever I start my notebook, X1 reports to do an initial scan.
The info box reports "last indexed" from about a month ago.
Best,