Text parser

[CoRrRan]

I am trying to write a parser for textfiles that can be very, very
large. What would be the best solution to do this? Would it be better to
store the entire textfile into an array and work with the array, or
would it be better to just loop through the file using the StreamReader?

I'm not experienced with VB.NET at all, but have extensive knowledge of
VBA. I already got one of my applications ported from VBA to VB.NET and
this works (almost) fine, but the next project requires me to read very
large textfiles. (They can become >100MB.)

The idea behind the file is to split it into .csv-files for various
sections contained in the master file. I also want to create a summary
textfile containing maximums, minimums and various averages/calculations.

*************

Another question: I've created and build a test-application, but when I
try to run this program on a network-path, the application crashes with
the following error:

EventType : clr20r3
P1: test.exe P2: 1.0.0.0 P3: 461e3ed7
P4: test P5: 1.0.0.0 P6: 461e3ed7
P7: d P8: c6 P9: system.invalidoperationexception

I think this has something to do with the way Visual Basic 2005 Express'
ClickOnce works, and that I'm not using the correct settings. These are
my settings on the Security-tab of the Project, with which my
application fails to run from network-paths:

Enabled "Enable ClickOnce Security Settings"-checkbox
Selected "This is a full trust application"-radiobutton

Is there a way to set my application so that it will work from network
paths as well as local drives?

(The working folder for Visual Basic 2005 Express is also located on a
network location. Can this also be a part of the problem?)

Regards, CoRrRan

 

[Cor Ligthert [MVP]]

CoRrRan,

If you can use CSV files you can use SQL SeverExpress in my idea as well.

http://msdn.microsoft.com/vstudio/express/sql/

CorNotRunning

 

[Jay Parzych]

here is a nice class i have used:

An enumerable class to read large text files in a For Each loop:

http://www.dotnet2themax.com/ShowContent.aspx?ID=4ee44d6c-79a9-466d-ab47-56bba526534f

some interesting comments between the code snippets, a 2.0 version at the
bottom

 

[CoRrRan]

Hmm, I think you're right that putting it all in a database would be
better, but unfortunately I have got zero knowledge on database
design/implementation and just starting to get a bit comfortable with
programming in VB 2005. I guess I'll have to get myself up to speed with
databases too one day.

Thanks for answering Cor.

CoRrRan

 

[CoRrRan]

Ah, this looks indeed promising. Thanks for pointing me in that
direction Jay!

Regards, CoRrRan