How to speed up filtering

  • Thread starter Thread starter Gec
  • Start date Start date
G

Gec

I have database with 10.000 records. I would like to filter them by one
field and show them in the DataGrid.
As far as I know the fastest way is using DataView.RowFilter.
Filtering with DataView.RowFilter takes me about 14 seconds in the test
application
and 24 seconds in the more complex application.

I really don't know why so big difference?
Does CompactFramework perform some other operations on the background?
Do I need to configure something?

For me would be acceptable 8 seconds.
How could I speed up filtering? ( configure garbage collector, DataTable or
.... )

Thank you
Gec
 
I have the same problem with my contact list :)
I have 2,000+ records on my pocket pc and if I want to
filter out by group it takes 5 to 10 sec to do that.
with 10,000 :) it would take a while
I guess it is not framework its just processing power of
the device.

I would sure would like to hear a solution to this problem
as well.
 
Gec,

This particular operation was somewhat improved in SP2.
Try it and see if it works fast enough.

Also, index might be created internally as you use filter for the first
time.
It takes a while to create an index, but speeds up filtering a lot for
consequential runs.

If it takes 24 seconds on a first run, it's pretty normal.
If it takes this amount of time on consequential runs (with the same
filtering field), please let me know.

Best regards,

Ilya

This posting is provided "AS IS" with no warranties, and confers no rights.

--------------------
 
Thank you for information about SP2.
I installed it and tried filtering once again.
The results are quite similar. Maybe it is faster for one second.

Filtering more times on the same field takes always the same time.

If you have any other idea I will be very grateful.

Best regards,
Gec


"Ilya Tumanov [MS]" said:
Gec,

This particular operation was somewhat improved in SP2.
Try it and see if it works fast enough.

Also, index might be created internally as you use filter for the first
time.
It takes a while to create an index, but speeds up filtering a lot for
consequential runs.

If it takes 24 seconds on a first run, it's pretty normal.
If it takes this amount of time on consequential runs (with the same
filtering field), please let me know.

Best regards,

Ilya

This posting is provided "AS IS" with no warranties, and confers no rights.
--------------------
From: "Gec" <[email protected]>
Subject: How to speed up filtering
Date: Wed, 31 Dec 2003 14:28:15 +0100
Lines: 22
X-Priority: 3
X-MSMail-Priority: Normal
X-Newsreader: Microsoft Outlook Express 6.00.2800.1158
X-MimeOLE: Produced By Microsoft MimeOLE V6.00.2800.1165
Message-ID: <[email protected]>
Newsgroups: microsoft.public.dotnet.framework.compactframework
NNTP-Posting-Host: 193.77.74.222
Path:
Click to expand...
cpmsftngxa07.phx.gbl!cpmsftngxa06.phx.gbl!TK2MSFTNGP08.phx.gbl!TK2MSFTNGP12.
phx.gbl
Xref: cpmsftngxa07.phx.gbl microsoft.public.dotnet.framework.compactframework:41936
X-Tomcat-NG: microsoft.public.dotnet.framework.compactframework


I have database with 10.000 records. I would like to filter them by one
field and show them in the DataGrid.
As far as I know the fastest way is using DataView.RowFilter.
Filtering with DataView.RowFilter takes me about 14 seconds in the test
application
and 24 seconds in the more complex application.

I really don't know why so big difference?
Does CompactFramework perform some other operations on the background?
Do I need to configure something?

For me would be acceptable 8 seconds.
How could I speed up filtering? ( configure garbage collector, DataTable or
... )

Thank you
Gec
Click to expand...
Click to expand...
 
Gec,

Apparently index is not used/created on filtering, so it won't help.
Could you reduce amount of data by filtering it before you load it into the
DataTable?
Or, perhaps, you can filter it in background?

Best regards,

Ilya

This posting is provided "AS IS" with no warranties, and confers no rights.
--------------------
From: "Gec" <[email protected]>
References: <[email protected]>
Click to expand...
Subject: Re: How to speed up filtering
Date: Mon, 5 Jan 2004 13:16:38 +0100
Lines: 83
X-Priority: 3
X-MSMail-Priority: Normal
X-Newsreader: Microsoft Outlook Express 6.00.2800.1158
X-MimeOLE: Produced By Microsoft MimeOLE V6.00.2800.1165
Message-ID: <[email protected]>
Newsgroups: microsoft.public.dotnet.framework.compactframework
NNTP-Posting-Host: 193.77.74.222
Path: cpmsftngxa07.phx.gbl!cpmsftngxa10.phx.gbl!TK2MSFTNGXA05.phx.gbl!TK2MSFTNGP08
.phx.gbl!TK2MSFTNGP12.phx.gbl
Xref: cpmsftngxa07.phx.gbl microsoft.public.dotnet.framework.compactframework:42144
X-Tomcat-NG: microsoft.public.dotnet.framework.compactframework


Thank you for information about SP2.
I installed it and tried filtering once again.
The results are quite similar. Maybe it is faster for one second.

Filtering more times on the same field takes always the same time.

If you have any other idea I will be very grateful.

Best regards,
Gec


"Ilya Tumanov [MS]" said:
Gec,

This particular operation was somewhat improved in SP2.
Try it and see if it works fast enough.

Also, index might be created internally as you use filter for the first
time.
It takes a while to create an index, but speeds up filtering a lot for
consequential runs.

If it takes 24 seconds on a first run, it's pretty normal.
If it takes this amount of time on consequential runs (with the same
filtering field), please let me know.

Best regards,

Ilya

This posting is provided "AS IS" with no warranties, and confers no rights.
--------------------
From: "Gec" <[email protected]>
Subject: How to speed up filtering
Date: Wed, 31 Dec 2003 14:28:15 +0100
Lines: 22
X-Priority: 3
X-MSMail-Priority: Normal
X-Newsreader: Microsoft Outlook Express 6.00.2800.1158
X-MimeOLE: Produced By Microsoft MimeOLE V6.00.2800.1165
Message-ID: <[email protected]>
Newsgroups: microsoft.public.dotnet.framework.compactframework
NNTP-Posting-Host: 193.77.74.222
Path:
Click to expand...
Click to expand...
cpmsftngxa07.phx.gbl!cpmsftngxa06.phx.gbl!TK2MSFTNGP08.phx.gbl!TK2MSFTNGP12.
DataTable
or
Click to expand...
Click to expand...
 
Ilya,
thank you for help.

I find out where was the main problem.
Like you said SP2 should be installed AND
the program should work on PPC 2003 ( VERY IMPORTANT !!! ).

After that the program was six times faster.

Best regards,
Gec


"Ilya Tumanov [MS]" said:
Gec,

Apparently index is not used/created on filtering, so it won't help.
Could you reduce amount of data by filtering it before you load it into the
DataTable?
Or, perhaps, you can filter it in background?

Best regards,

Ilya

This posting is provided "AS IS" with no warranties, and confers no rights.
Subject: Re: How to speed up filtering
Date: Mon, 5 Jan 2004 13:16:38 +0100
Lines: 83
X-Priority: 3
X-MSMail-Priority: Normal
X-Newsreader: Microsoft Outlook Express 6.00.2800.1158
X-MimeOLE: Produced By Microsoft MimeOLE V6.00.2800.1165
Message-ID: <[email protected]>
Newsgroups: microsoft.public.dotnet.framework.compactframework
NNTP-Posting-Host: 193.77.74.222
Path:
Click to expand...
cpmsftngxa07.phx.gbl!cpmsftngxa10.phx.gbl!TK2MSFTNGXA05.phx.gbl!TK2MSFTNGP08
phx.gbl!TK2MSFTNGP12.phx.gbl
Xref: cpmsftngxa07.phx.gbl microsoft.public.dotnet.framework.compactframework:42144
X-Tomcat-NG: microsoft.public.dotnet.framework.compactframework


Thank you for information about SP2.
I installed it and tried filtering once again.
The results are quite similar. Maybe it is faster for one second.

Filtering more times on the same field takes always the same time.

If you have any other idea I will be very grateful.

Best regards,
Gec


"Ilya Tumanov [MS]" said:
Gec,

This particular operation was somewhat improved in SP2.
Try it and see if it works fast enough.

Also, index might be created internally as you use filter for the first
time.
It takes a while to create an index, but speeds up filtering a lot for
consequential runs.

If it takes 24 seconds on a first run, it's pretty normal.
If it takes this amount of time on consequential runs (with the same
filtering field), please let me know.

Best regards,

Ilya

This posting is provided "AS IS" with no warranties, and confers no rights.

--------------------
From: "Gec" <[email protected]>
Subject: How to speed up filtering
Date: Wed, 31 Dec 2003 14:28:15 +0100
Lines: 22
X-Priority: 3
X-MSMail-Priority: Normal
X-Newsreader: Microsoft Outlook Express 6.00.2800.1158
X-MimeOLE: Produced By Microsoft MimeOLE V6.00.2800.1165
Message-ID: <[email protected]>
Newsgroups: microsoft.public.dotnet.framework.compactframework
NNTP-Posting-Host: 193.77.74.222
Path:
Click to expand...
Click to expand...
cpmsftngxa07.phx.gbl!cpmsftngxa06.phx.gbl!TK2MSFTNGP08.phx.gbl!TK2MSFTNGP12.
Click to expand...
 
Back
Top