Performance issues reading large XML files into a DataSet

  • Thread starter Thread starter Dev
  • Start date Start date
D

Dev

Good Morning to all,

I have a bunch of XML files that need to be readed inside the same DataSet
(each XML represent a single table).

In the event of a large (some megabytes) file, what is the best practice to
read them into the DataSet via the ReadXML() method?

Thanks, sorry for my newbie-hood

Dev
 
hi,

if you load large amount of data in your dataset,
it will definitely have performance hit.
if there's really no need to do that, try using xmlreader.

HTH
 
This isn't a 'fast' mechanism by any means and it gets slower the larger the
file is. All of the tags need to be reconciled and the table constructed so
it's not a real fast mechanism. If it's going to be really large and you
need to get it from file, .csv isn't a bad way to go (although I agree, it's
nowhere near as elegant as XML). I do a lot of compact framework work and
resources are pretty constrained so XML was just too slow in many instances.

As far as best practices, not sure what to tell you there b/c you don't have
a lot of control over the reads but if you have any specific questions let
me know and i'll see what I can do.

HTH,

Bill

--

W.G. Ryan, eMVP

http://forums.devbuzz.com/
http://www.knowdotnet.com/williamryan.html
http://www.msmvps.com/WilliamRyan/
 
I need to read an already formed XML file, borne from a DataSet.
I simply need to iterate thru the various row...how is possible without
reading all the xml?

SG
 
Back
Top