Very slow to serialize Xml file

[Guest]

Hello everyone

I use OpenNETCF.XML.XmlSerializer to serialize a DataSet object into my CF card. Although the file is not large (about 6k), the store progress is very slow. It takes me at least 10 mins and still it does finish

And second question how to delete the serialized file? It will create itself after I delete it each time

 

[Alex Feinman [MVP]]

Why are you "serializing" DataSet? DataSet supports WriteXml and ReadXml
methods that persist it to file and reads it from the file.

Hello everyone!

I use OpenNETCF.XML.XmlSerializer to serialize a DataSet object into my CF

card. Although the file is not large (about 6k), the store progress is very
slow. It takes me at least 10 mins and still it does finish.

And second question how to delete the serialized file? It will create

itself after I delete it each time.

 

[Charles Wang]

Hello Alex!

I used to save DataSet as you said. But sometimes DataSet.ReadXml() can not
get out data correctly, and sometimes it could. And sometimes it will occor
a IOException whild saving the DataSet to CF card. I can not debug the
reason cause such exception.

 

[Ilya Tumanov [MS]]

Charles,

First of all, DataSet.ReadXml() can successfully load only limited subset
of XML files, specifically files created by serializing DataSet (i.e.
DataSet.WriteXml()).
Same is true for serializing/deserializing pretty much anything. Say, you
can use EXE file at bitmap constructor, but chances are: you won't get a
picture out of it.

DataSet.ReadXml() will try to load any XML files in inference mode, but
results are unpredictable.
It might be OK, or it might be way off, it depends on your file.

If you're using schema and your XML produced by serializing DataSet, it
might be a bug.
Please post your schema and data with a description of a failure so I can
investigate it.

If your XML is hand crafted, consider changing it so it would better map to
DataSet's relational data model.

Now, to the exception you're getting...
DataSet serialization does not produce IO exceptions, underlying stream
does.
It means it can not open the file or write to it.
There might be a number of reasons (to name a few):

1. Not enough space on a card - check available space.
2. Faulty card - use another card.
3. Card is read only - check read only switch on a card if any.
4. File is open by another application (or your application opened file
before, but never closed it) - close all running applications, make sure
you're closing all files even in case of exceptions.
5. File is read only - make sure it's not. If you're using source control
and deploying the file via VS, it's probably read only.
6. File path is incorrect - make sure path is correct.

As to the file, recreating itself - you probably have an application
running which creates the file.

Best regards,

Ilya

This posting is provided "AS IS" with no warranties, and confers no rights.

--------------------

From: "Charles Wang" <[email protected]>
References: <[email protected]>

 

[Lloyd Dupont]

anyway myDataSet.ReadXml()/WriteXml() is slow anyway ...
I went to (home made) binary serialisation.
much better ...
and much more work too

 

[Charles Wang]

Thank you very much Ilya!

My DataSet contain schema, it owns many tables.
The attachment contains two xml schema file, Setting.xsd is the original
file, SettingE.xsd is the its english ranslation.

The exception while DataSet.ReadXml is something like "Line 1 48856( an
integer I do not remember, maybe means a position) error".

I open the incorrect xml file with notepad and find that there is nothing
difference from correct xml file.
I think maybe the exception occur whild ReadXml method infering the schema
of the DataSet.
But why sometimes it can not infer correct schema? Does it because I use
Chinese charactor as column name?

I do not meet IOException whild serialize because I only test the serialize
method once.

The IOException do not often occur when I use WriteXml method.
The card is not read only, same as the file, and file path is correct.

Originally I open file, create a file stream and use
DataSet.WriteXml(XmlTextWriter, WriteSchema).
Recently I change my way as msdn's article "Storing application data...",
written by Andy Sjostrom, mentioned.
But also sometimes it can not read DataSet out using DataSet.ReadXml method.

I am sure that is not the cause of store space.

Charles,

First of all, DataSet.ReadXml() can successfully load only limited subset
of XML files, specifically files created by serializing DataSet (i.e.
DataSet.WriteXml()).
Same is true for serializing/deserializing pretty much anything. Say, you
can use EXE file at bitmap constructor, but chances are: you won't get a
picture out of it.

DataSet.ReadXml() will try to load any XML files in inference mode, but
results are unpredictable.
It might be OK, or it might be way off, it depends on your file.

If you're using schema and your XML produced by serializing DataSet, it
might be a bug.
Please post your schema and data with a description of a failure so I can
investigate it.

If your XML is hand crafted, consider changing it so it would better map to
DataSet's relational data model.

Now, to the exception you're getting...
DataSet serialization does not produce IO exceptions, underlying stream
does.
It means it can not open the file or write to it.
There might be a number of reasons (to name a few):

1. Not enough space on a card - check available space.
2. Faulty card - use another card.
3. Card is read only - check read only switch on a card if any.
4. File is open by another application (or your application opened file
before, but never closed it) - close all running applications, make sure
you're closing all files even in case of exceptions.
5. File is read only - make sure it's not. If you're using source control
and deploying the file via VS, it's probably read only.
6. File path is incorrect - make sure path is correct.

As to the file, recreating itself - you probably have an application
running which creates the file.

Best regards,

Ilya

This posting is provided "AS IS" with no warranties, and confers no rights.

Subject: Re: Very slow to serialize Xml file
Date: Sun, 14 Mar 2004 19:13:50 +0800
Lines: 29
X-Priority: 3
X-MSMail-Priority: Normal
X-Newsreader: Microsoft Outlook Express 6.00.2800.1106
X-MimeOLE: Produced By Microsoft MimeOLE V6.00.2800.1106
Message-ID: <[email protected]>
Newsgroups: microsoft.public.dotnet.framework.compactframework
NNTP-Posting-Host: 221.216.254.20
Path: cpmsftngxa06.phx.gbl!TK2MSFTNGP08.phx.gbl!TK2MSFTNGP09.phx.gbl
Xref: cpmsftngxa06.phx.gbl microsoft.public.dotnet.framework.compactframework:48510
X-Tomcat-NG: microsoft.public.dotnet.framework.compactframework

Hello Alex!

I used to save DataSet as you said. But sometimes DataSet.ReadXml() can not
get out data correctly, and sometimes it could. And sometimes it will occor
a IOException whild saving the DataSet to CF card. I can not debug the
reason cause such exception.

my

 

[Ilya Tumanov [MS]]

Charles,

If you using schema, inference is not involved.

Could you please answer the following questions to clarify the situation?

1. Are you getting an exception on attempt to load data or loading
completed normally, but data loaded is incorrect (missing tables, rows,
etc.)?
2. If it's an exception, what is the _exact_ exception type, message and a
line of your code it was thrown from?
3. Could you load "correct" XML all the time or just from time to time?
4. Is loading "incorrect" XML failing all the time or just from time to
time?
5. Which version of CF are you running?

Could you please post a portion of code you're using to load schema and
data along with "correct" and "incorrect" XML file? Thanks.

As to Chinese column names, it's OK. I was able to load both schemas you
sent normally.

Best regards,

Ilya

This posting is provided "AS IS" with no warranties, and confers no rights.

--------------------

From: "Charles Wang" <[email protected]>
References: <[email protected]>

<[email protected]>

Subject: Re: Very slow to serialize Xml file
Date: Mon, 15 Mar 2004 23:10:05 +0800
Lines: 247
X-Priority: 3
X-MSMail-Priority: Normal
X-Newsreader: Microsoft Outlook Express 6.00.2800.1106
X-MimeOLE: Produced By Microsoft MimeOLE V6.00.2800.1106
Message-ID: <eoGOc#[email protected]>
Newsgroups: microsoft.public.dotnet.framework.compactframework
NNTP-Posting-Host: 61.49.145.8
Path: cpmsftngxa06.phx.gbl!TK2MSFTNGP08.phx.gbl!tk2msftngp13.phx.gbl
Xref: cpmsftngxa06.phx.gbl microsoft.public.dotnet.framework.compactframework:48581
X-Tomcat-NG: microsoft.public.dotnet.framework.compactframework

Thank you very much Ilya!

My DataSet contain schema, it owns many tables.
The attachment contains two xml schema file, Setting.xsd is the original
file, SettingE.xsd is the its english ranslation.

The exception while DataSet.ReadXml is something like "Line 1 48856( an
integer I do not remember, maybe means a position) error".

I open the incorrect xml file with notepad and find that there is nothing
difference from correct xml file.
I think maybe the exception occur whild ReadXml method infering the schema
of the DataSet.
But why sometimes it can not infer correct schema? Does it because I use
Chinese charactor as column name?

I do not meet IOException whild serialize because I only test the serialize
method once.

The IOException do not often occur when I use WriteXml method.
The card is not read only, same as the file, and file path is correct.

Originally I open file, create a file stream and use
DataSet.WriteXml(XmlTextWriter, WriteSchema).
Recently I change my way as msdn's article "Storing application data...",
written by Andy Sjostrom, mentioned.
But also sometimes it can not read DataSet out using DataSet.ReadXml method.

I am sure that is not the cause of store space.

Charles,

First of all, DataSet.ReadXml() can successfully load only limited subset
of XML files, specifically files created by serializing DataSet (i.e.
DataSet.WriteXml()).
Same is true for serializing/deserializing pretty much anything. Say, you
can use EXE file at bitmap constructor, but chances are: you won't get a
picture out of it.

DataSet.ReadXml() will try to load any XML files in inference mode, but
results are unpredictable.
It might be OK, or it might be way off, it depends on your file.

If you're using schema and your XML produced by serializing DataSet, it
might be a bug.
Please post your schema and data with a description of a failure so I can
investigate it.

If your XML is hand crafted, consider changing it so it would better map to
DataSet's relational data model.

Now, to the exception you're getting...
DataSet serialization does not produce IO exceptions, underlying stream
does.
It means it can not open the file or write to it.
There might be a number of reasons (to name a few):

1. Not enough space on a card - check available space.
2. Faulty card - use another card.
3. Card is read only - check read only switch on a card if any.
4. File is open by another application (or your application opened file
before, but never closed it) - close all running applications, make sure
you're closing all files even in case of exceptions.
5. File is read only - make sure it's not. If you're using source control
and deploying the file via VS, it's probably read only.
6. File path is incorrect - make sure path is correct.

As to the file, recreating itself - you probably have an application
running which creates the file.

Best regards,

Ilya

This posting is provided "AS IS" with no warranties, and confers no rights.

Subject: Re: Very slow to serialize Xml file
Date: Sun, 14 Mar 2004 19:13:50 +0800
Lines: 29
X-Priority: 3
X-MSMail-Priority: Normal
X-Newsreader: Microsoft Outlook Express 6.00.2800.1106
X-MimeOLE: Produced By Microsoft MimeOLE V6.00.2800.1106
Message-ID: <[email protected]>
Newsgroups: microsoft.public.dotnet.framework.compactframework
NNTP-Posting-Host: 221.216.254.20
Path: cpmsftngxa06.phx.gbl!TK2MSFTNGP08.phx.gbl!TK2MSFTNGP09.phx.gbl
Xref: cpmsftngxa06.phx.gbl microsoft.public.dotnet.framework.compactframework:48510
X-Tomcat-NG: microsoft.public.dotnet.framework.compactframework

Hello Alex!

I used to save DataSet as you said. But sometimes DataSet.ReadXml()

can
not

get out data correctly, and sometimes it could. And sometimes it will occor
a IOException whild saving the DataSet to CF card. I can not debug the
reason cause such exception.

"Alex Feinman [MVP]" <[email protected]> дÈëÏûÏ¢ÐÂÎÅ
:[email protected]...
Why are you "serializing" DataSet? DataSet supports WriteXml and ReadXml
methods that persist it to file and reads it from the file.

Hello everyone!

I use OpenNETCF.XML.XmlSerializer to serialize a DataSet object

into
my

CF
card. Although the file is not large (about 6k), the store progress is
very
slow. It takes me at least 10 mins and still it does finish.

And second question how to delete the serialized file? It will create
itself after I delete it each time.

 

[Charles Wang]

OK.
1. No data will read if exception occur. If it can infer the DataSet's
schema, all the data is correct.

2. I do not remember the exception's type, and my device has lent to my
classmate now. If you do not mind my contacting with you I will send my
retest result after several days.

3. 4. I did not do a fully test. In my program, the data will saved in
Setting.xsd file if some setting is changed and user press the save button.
My program read the setting from Setting.xsd file when its starting. So the
exception will not occur until next system's startup. When it can not load
the settings I always delete the stored file.

5. I use WinCE4.2 with latest QFE, so the CF version should be 1.0.3316.0.

The schema could be always loaded correct, but if I save some data in it,
sometimes it will failed.
If you want to test yourself, please leave my your email address, I will
send you my program's source code and needed dll files. I use x86 cpu and CF
card as system's hard disk. So you could do a fully test about this problem.

Thank you very much.

Charles,

If you using schema, inference is not involved.

Could you please answer the following questions to clarify the situation?

1. Are you getting an exception on attempt to load data or loading
completed normally, but data loaded is incorrect (missing tables, rows,
etc.)?
2. If it's an exception, what is the _exact_ exception type, message and a
line of your code it was thrown from?
3. Could you load "correct" XML all the time or just from time to time?
4. Is loading "incorrect" XML failing all the time or just from time to
time?
5. Which version of CF are you running?

Could you please post a portion of code you're using to load schema and
data along with "correct" and "incorrect" XML file? Thanks.

As to Chinese column names, it's OK. I was able to load both schemas you
sent normally.

Best regards,

Ilya

This posting is provided "AS IS" with no warranties, and confers no rights.<[email protected]>

Subject: Re: Very slow to serialize Xml file
Date: Mon, 15 Mar 2004 23:10:05 +0800
Lines: 247
X-Priority: 3
X-MSMail-Priority: Normal
X-Newsreader: Microsoft Outlook Express 6.00.2800.1106
X-MimeOLE: Produced By Microsoft MimeOLE V6.00.2800.1106
Message-ID: <eoGOc#[email protected]>
Newsgroups: microsoft.public.dotnet.framework.compactframework
NNTP-Posting-Host: 61.49.145.8
Path: cpmsftngxa06.phx.gbl!TK2MSFTNGP08.phx.gbl!tk2msftngp13.phx.gbl
Xref: cpmsftngxa06.phx.gbl microsoft.public.dotnet.framework.compactframework:48581
X-Tomcat-NG: microsoft.public.dotnet.framework.compactframework

Thank you very much Ilya!

My DataSet contain schema, it owns many tables.
The attachment contains two xml schema file, Setting.xsd is the original
file, SettingE.xsd is the its english ranslation.

The exception while DataSet.ReadXml is something like "Line 1 48856( an
integer I do not remember, maybe means a position) error".

I open the incorrect xml file with notepad and find that there is nothing
difference from correct xml file.
I think maybe the exception occur whild ReadXml method infering the schema
of the DataSet.
But why sometimes it can not infer correct schema? Does it because I use
Chinese charactor as column name?

I do not meet IOException whild serialize because I only test the serialize
method once.

The IOException do not often occur when I use WriteXml method.
The card is not read only, same as the file, and file path is correct.

Originally I open file, create a file stream and use
DataSet.WriteXml(XmlTextWriter, WriteSchema).
Recently I change my way as msdn's article "Storing application data...",
written by Andy Sjostrom, mentioned.
But also sometimes it can not read DataSet out using DataSet.ReadXml method.

I am sure that is not the cause of store space.

Charles,

First of all, DataSet.ReadXml() can successfully load only limited subset
of XML files, specifically files created by serializing DataSet (i.e.
DataSet.WriteXml()).
Same is true for serializing/deserializing pretty much anything. Say, you
can use EXE file at bitmap constructor, but chances are: you won't get a
picture out of it.

DataSet.ReadXml() will try to load any XML files in inference mode, but
results are unpredictable.
It might be OK, or it might be way off, it depends on your file.

If you're using schema and your XML produced by serializing DataSet, it
might be a bug.
Please post your schema and data with a description of a failure so I can
investigate it.

If your XML is hand crafted, consider changing it so it would better

map
to

DataSet's relational data model.

Now, to the exception you're getting...
DataSet serialization does not produce IO exceptions, underlying stream
does.
It means it can not open the file or write to it.
There might be a number of reasons (to name a few):

1. Not enough space on a card - check available space.
2. Faulty card - use another card.
3. Card is read only - check read only switch on a card if any.
4. File is open by another application (or your application opened file
before, but never closed it) - close all running applications, make sure
you're closing all files even in case of exceptions.
5. File is read only - make sure it's not. If you're using source control
and deploying the file via VS, it's probably read only.
6. File path is incorrect - make sure path is correct.

As to the file, recreating itself - you probably have an application
running which creates the file.

Best regards,

Ilya

This posting is provided "AS IS" with no warranties, and confers no rights.

--------------------
From: "Charles Wang" <[email protected]>
References: <[email protected]>
<[email protected]>
Subject: Re: Very slow to serialize Xml file
Date: Sun, 14 Mar 2004 19:13:50 +0800
Lines: 29
X-Priority: 3
X-MSMail-Priority: Normal
X-Newsreader: Microsoft Outlook Express 6.00.2800.1106
X-MimeOLE: Produced By Microsoft MimeOLE V6.00.2800.1106
Message-ID: <[email protected]>
Newsgroups: microsoft.public.dotnet.framework.compactframework
NNTP-Posting-Host: 221.216.254.20
Path: cpmsftngxa06.phx.gbl!TK2MSFTNGP08.phx.gbl!TK2MSFTNGP09.phx.gbl
Xref: cpmsftngxa06.phx.gbl
microsoft.public.dotnet.framework.compactframework:48510
X-Tomcat-NG: microsoft.public.dotnet.framework.compactframework

Hello Alex!

I used to save DataSet as you said. But sometimes DataSet.ReadXml() can
not
get out data correctly, and sometimes it could. And sometimes it will
occor
a IOException whild saving the DataSet to CF card. I can not debug the
reason cause such exception.

"Alex Feinman [MVP]" <[email protected]> дÈëÏûÏ¢ÐÂÎÅ
:[email protected]...
Why are you "serializing" DataSet? DataSet supports WriteXml and ReadXml
methods that persist it to file and reads it from the file.

Hello everyone!

I use OpenNETCF.XML.XmlSerializer to serialize a DataSet object into
my
CF
card. Although the file is not large (about 6k), the store

progress

is

 

[Ilya Tumanov [MS]]

Please see inline...

Best regards,

Ilya

This posting is provided "AS IS" with no warranties, and confers no rights.
--------------------

From: "Charles Wang" <[email protected]>
References: <[email protected]>

<[email protected]>
<[email protected]>
<[email protected]>

Subject: Re: Very slow to serialize Xml file
Date: Wed, 17 Mar 2004 20:29:03 +0800
Lines: 239
X-Priority: 3
X-MSMail-Priority: Normal
X-Newsreader: Microsoft Outlook Express 6.00.2800.1106
X-MimeOLE: Produced By Microsoft MimeOLE V6.00.2800.1106
Message-ID: <[email protected]>
Newsgroups: microsoft.public.dotnet.framework.compactframework
NNTP-Posting-Host: 61.149.37.62
Path: cpmsftngxa06.phx.gbl!TK2MSFTNGXS01.phx.gbl!TK2MSFTNGXA05.phx.gbl!TK2MSFTNGP0
8.phx.gbl!TK2MSFTNGP10.phx.gbl
Xref: cpmsftngxa06.phx.gbl microsoft.public.dotnet.framework.compactframework:48755
X-Tomcat-NG: microsoft.public.dotnet.framework.compactframework

OK.
1. No data will read if exception occur. If it can infer the DataSet's
schema, all the data is correct.

So, you do have an exception.

2. I do not remember the exception's type, and my device has lent to my
classmate now. If you do not mind my contacting with you I will send my
retest result after several days.

Sure, I'll wait. I do need an exact exception to figure out the problem.

3. 4. I did not do a fully test. In my program, the data will saved in
Setting.xsd file if some setting is changed and user press the save button.
My program read the setting from Setting.xsd file when its starting. So the
exception will not occur until next system's startup. When it can not load
the settings I always delete the stored file.

You're using the same file to store both data and schema, and initially it
contains schema only?
Is that correct? If so, I would propose changing it.
You should either have a separate schema/data files or a single data file
with embedded schema.

5. I use WinCE4.2 with latest QFE, so the CF version should be 1.0.3316.0.

The schema could be always loaded correct, but if I save some data in it,
sometimes it will failed.

So, you overwrite the file and it's broken after that... Could you please
change your code as follows?

On startup:

try {
ds.ReadXmlSchema ("Full Path To XDS file"); // Never overwrite schema,
just load it. This will close the file even in case of exception.

try {
ds.ReadXml("Full path to XML data file"); // Configuration is
stored in a separate file. Will be closed even in case of exception.
}
catch (System.IO.FileNotFoundException e ) {
// No data file, load default configuration to the DataSet here
}
}
catch (Exception e) {
// Error loading scema/data. Process error here.
MessageBox.Show (String.Format ("Exception: {0}", e), "Configuration
load error");
}

On saving configuration:

try {
ds.WriteXml("Full path to XML data file");
}
catch (Exception e) {
// Can not save configuration. Process error.
MessageBox.Show (String.Format ("Exception: {0}", e), "Configuration
save error");
}

If you're using VB, please remove semicolons and use Try/Catch/End Try
blocks.
Also make sure you're not opening data and schema files in other parts of
your application.
If you do, make sure you're closing them correctly by adding try/finally
blocks.

I'm pretty sure this will fix your problems. If not, message boxes will
show the exact problem so I can investigate.

If you want to test yourself, please leave my your email address, I will
send you my program's source code and needed dll files. I use x86 cpu and CF
card as system's hard disk. So you could do a fully test about this

problem.

Just remove "online" from e-mail address I'm using in this group.
It would be the best if you can provide me with a small repro (5-10 lines
of code) which demonstrates the problem, not with the full application.

Thank you very much.

Charles,

If you using schema, inference is not involved.

Could you please answer the following questions to clarify the situation?

1. Are you getting an exception on attempt to load data or loading
completed normally, but data loaded is incorrect (missing tables, rows,
etc.)?
2. If it's an exception, what is the _exact_ exception type, message and a
line of your code it was thrown from?
3. Could you load "correct" XML all the time or just from time to time?
4. Is loading "incorrect" XML failing all the time or just from time to
time?
5. Which version of CF are you running?

Could you please post a portion of code you're using to load schema and
data along with "correct" and "incorrect" XML file? Thanks.

As to Chinese column names, it's OK. I was able to load both schemas you
sent normally.

Best regards,

Ilya

This posting is provided "AS IS" with no warranties, and confers no rights.<[email protected]>

Subject: Re: Very slow to serialize Xml file
Date: Mon, 15 Mar 2004 23:10:05 +0800
Lines: 247
X-Priority: 3
X-MSMail-Priority: Normal
X-Newsreader: Microsoft Outlook Express 6.00.2800.1106
X-MimeOLE: Produced By Microsoft MimeOLE V6.00.2800.1106
Message-ID: <eoGOc#[email protected]>
Newsgroups: microsoft.public.dotnet.framework.compactframework
NNTP-Posting-Host: 61.49.145.8
Path: cpmsftngxa06.phx.gbl!TK2MSFTNGP08.phx.gbl!tk2msftngp13.phx.gbl
Xref: cpmsftngxa06.phx.gbl microsoft.public.dotnet.framework.compactframework:48581
X-Tomcat-NG: microsoft.public.dotnet.framework.compactframework

Thank you very much Ilya!

My DataSet contain schema, it owns many tables.
The attachment contains two xml schema file, Setting.xsd is the original
file, SettingE.xsd is the its english ranslation.

The exception while DataSet.ReadXml is something like "Line 1 48856( an
integer I do not remember, maybe means a position) error".

I open the incorrect xml file with notepad and find that there is nothing
difference from correct xml file.
I think maybe the exception occur whild ReadXml method infering the schema
of the DataSet.
But why sometimes it can not infer correct schema? Does it because I use
Chinese charactor as column name?

I do not meet IOException whild serialize because I only test the serialize
method once.

The IOException do not often occur when I use WriteXml method.
The card is not read only, same as the file, and file path is correct.

Originally I open file, create a file stream and use
DataSet.WriteXml(XmlTextWriter, WriteSchema).
Recently I change my way as msdn's article "Storing application data...",
written by Andy Sjostrom, mentioned.
But also sometimes it can not read DataSet out using DataSet.ReadXml method.

I am sure that is not the cause of store space.

""Ilya Tumanov [MS]"" <[email protected]> дÈëÏûÏ¢ÐÂÎÅ
:[email protected]...
Charles,

First of all, DataSet.ReadXml() can successfully load only limited subset
of XML files, specifically files created by serializing DataSet (i.e.
DataSet.WriteXml()).
Same is true for serializing/deserializing pretty much anything.

Say,
you

can use EXE file at bitmap constructor, but chances are: you won't

get

a I
can DataSet.ReadXml()
can object
into progress