Copy with verify per block

  • Thread starter Thread starter Richard Foersom
  • Start date Start date
R

Richard Foersom

With Windows (2000 or XP) is there a way to perform verify and rewrite
as part of copy operations?

What I am looking for is some option where for each e.g. 1MB written it
is check read and rewritten in case of error.

On command line I have tried copy with option /v. This seems to verify
after complete copy. Errors are reported but there are no retry of
writing the blocks found to be wrong.

If not part of Windows is there some utility with copy operation like
that I can use?

This is to debug an unreliable interface not a faulty drive.

TIA, Richard
 
Previously Richard Foersom said:
With Windows (2000 or XP) is there a way to perform verify and rewrite
as part of copy operations?
What I am looking for is some option where for each e.g. 1MB written it
is check read and rewritten in case of error.
On command line I have tried copy with option /v. This seems to verify
after complete copy. Errors are reported but there are no retry of
writing the blocks found to be wrong.
If not part of Windows is there some utility with copy operation like
that I can use?
This is to debug an unreliable interface not a faulty drive.
TIA, Richard

One thing is that this would have to be implemented on a very
low level, maybe the hardware driver. Otherwise it will just
get the date from the buffer-cache and not the device in the
verify. Come to think of it, the /v may very well also get
the copy from the buffer-cache unless the file is larger than
avaliable memory.

As to rewrite on error, I don't think this is available anywhere,
except maybe space-probes and some archiving storage
solutions. Ordinarily write errors are so rare, that typically they do
not call for rewite, but for unit replacement. Also there are many
reasons why a re-write is not a good error recovery strategy. One
exception is some tape technologies, that will verify-read written
blocks with a second head and write again to a different place on the
tape. An other one is MOD drives, were again, the drive does verify
each write and does reallocation and re-write in case of a marginal
read signal. These technologies are designed for long-term storage (I
have an MOD drive) and the error-resilience is implemented in the
drive. The OS never gets to see it, as it typically cannot do this.

As to your problem, I think you may have to disable or bypass the
buffer cache. I am not even sure that is possible. There may be
some option to use a ''raw'' device. An alternative is
to write files so large that they do not fit into memory and then
re-read them.

Arno
 
Richard Foersom wrote in news:[email protected]
With Windows (2000 or XP) is there a way to perform verify and rewrite
as part of copy operations?

What I am looking for is some option where for each e.g. 1MB written it
is check read and rewritten in case of error.

On command line I have tried copy with option /v. This seems to verify
after complete copy. Errors are reported but there are no retry of
writing the blocks found to be wrong.

If not part of Windows is there some utility with copy operation like
that I can use?
This is to debug an unreliable interface not a faulty drive.

Assuming IDE, make sure it runs in UDMA mode.
The interface will not be allowed to corrupt the data.
 
Richard Foersom said:
With Windows (2000 or XP) is there a way to perform verify and rewrite
as part of copy operations?

What I am looking for is some option where for each e.g. 1MB written it
is check read and rewritten in case of error.

On command line I have tried copy with option /v. This seems to verify
after complete copy. Errors are reported but there are no retry of
writing the blocks found to be wrong.

If not part of Windows is there some utility with copy operation like
that I can use?

This is to debug an unreliable interface not a faulty drive.

TIA, Richard

Why don't you write your own copy program that
1) copies 1MB of data
2) flushes the I/O
3) reads the 1MB from the destination file and compares it
4) repeats until all data is copied?

Regards,
Alvin.
 
Why don't you write your own copy program that
1) copies 1MB of data
2) flushes the I/O
3) reads the 1MB from the destination file and compares it
4) repeats until all data is copied?

This will still read from cache.

Arno
 
Arno Wagner said:
This will still read from cache.

Arno

Can't you flush the cache like "sync" under UNIX? I think I recall a command
to do this for removable storage.

Alvin.
 
Alvin Andries said:
Arnie is a certified moron.
In Windows, use FILE_FLAG_NO_BUFFERING to bypass the OS cache.
However, the disk can still read from the cache (several MB now),
and only SCSI has an option to bypass the cache on reads. Does SATA2?
Can't you flush the cache like "sync" under UNIX? I think I recall a command
to do this for removable storage.

Safe Removal, or SysInternal's sync.
 
Can't you flush the cache like "sync" under UNIX? I think I recall a
command to do this for removable storage.

This does flush the buffer to disk, but does not clear the read cache.
I am not aware of eny command that emties the read cache.

Arno
 
That's nicer words for you being clueless, babblebot.
The system cache is not the problem as long you can bypass it.

Dear Folkert,

Although your claim is quite true its allso quite worthless to the
poster(s), in more ways than one :

Apart from making it look like you know something the poster(s) do(es) not,
*but not posting that information*, you allso use a condition in your
statement that could, for all we know, evaluate to "false".

You seem to have no problem with defining the a poster as "clueless". But
than how should we define you ? Especially when seeing that your
bad-mouthing is your *only* response in this thread.

Regards,
R.Wieser
 
Previously R.Wieser said:
Folkert Rienstra <[email protected]> schreef in berichtnieuws
[email protected]...
Dear Folkert,
Although your claim is quite true its allso quite worthless to the
poster(s), in more ways than one :
Apart from making it look like you know something the poster(s)
do(es) not, *but not posting that information*, you allso use a
condition in your statement that could, for all we know, evaluate to
"false".
You seem to have no problem with defining the a poster as
"clueless". But than how should we define you ? Especially when
seeing that your bad-mouthing is your *only* response in this
thread.

It is even more funny: Folkert is not even creative enough to do his
own insults: "babblebot" is stolen from me. It amuses me no end
whenever I see him using it on me.

And the "as long as you can evade the problem, the problem is not an
issue" is typical for him. It allows him to claim superiority without
ever having to give any information that could expose his utter and
complete incompetence.

Just add him to your killfile. I did so a long time ago.

Arno
 
R.Wieser wrote in news:[email protected]
Folkert Rienstra schreef in berichtnieuws [email protected]...
Dear Folkert,

Aah yes, a "Dear Folkert" post. How refreshing.
Although your claim is quite true its allso quite worthless to the
poster(s), in more ways than one :

Apart from making it look like you know something the poster(s) do(es)
not, *but not posting that information*, you allso use a condition in your
statement that could, for all we know, evaluate to "false".

You seem to have no problem with defining the a poster as "clueless".
But than how should we define you ?
Especially when seeing that your bad-mouthing is your *only* response
in this thread.

Apart from that being a blatant lie, now see how that makes you soo very
much different from me.

Since Eric Gisin already gave the same answer, which you well know,
it's rather blatantly obvious what you are trying to do here, Troll.

Btw, you make the same spelling mistakes as the Wagner Troll.
Now why is that.
 
Previously ByPass said:
Just so this message bypasses Arnies killfile and make him curl-up and die.

I find it fascinating that you consider me important enough
to go to all this trouble just to get a simple message to me.

May I suggest that ignoring me would probably be more healthy
for you?

Arno
 
Apart from that being a blatant lie,

Really ? From your own message (the one I responded to) :
-----
Arno Wagner wrote in news:[email protected]
Previously Alvin Andries (e-mail address removed) wrote:
-----
Can you point me where you name is in there ? I thought so.
now see how that makes you soo very
much different from me.

If it where true we could have discussed a bit about it. But as it does not
seem to be ...
Since Eric Gisin already gave the same answer, which you well know,

Oh my, you can *mindread* ? Can you tell me how you do that, as I hear
lots of people can, like you, but I still have not learned that trick.
it's rather blatantly obvious what you are trying to do here, Troll.

Really ? But if my actions (as you percieve them anyway) are so
"blatantly obvious", what do you call your own ?

You know, I find it quite remarkable that people who claim that they can
peer into the souls and thoughts of people they just met and know virtually
*nothing* about are mostly not able (or willing) to look into their own.

First get your facts straight, and only than try to conclude on them.
Currently you're not even on quicksand, but in pure water.

Ofcourse, if you think that only truth in this world are the thoughts that
bounce between your ears you must either be the happiest, or the saddest
person on this world. But for some reason I don't think you're not happy
....
Btw, you make the same spelling mistakes as the Wagner Troll.
Now why is that.

I don't know ? I'm a two-finger typer, and have a small dislexia problem.
How many people on this earth could do & have the same ? And you base
your "you must be the same person" on *that* ?

You know, you made me smile ...

Regards,
R.Wieser
 
Previously R.Wieser said:
Folkert Rienstra <[email protected]> schreef in berichtnieuws
[email protected]... [...]
Btw, you make the same spelling mistakes as the Wagner Troll.
Now why is that.
I don't know ? I'm a two-finger typer, and have a small dislexia problem.
How many people on this earth could do & have the same ? And you base
your "you must be the same person" on *that* ?

I guess Folkert still has faint hopes that I actually attribute any
kind of importance to him. So inventing a new personality to answer to
his portings would just be the thing for him. Unfortunately I am quite
content to post under my own name.

Arno
 
Previously R.Wieser said:
Folkert Rienstra <[email protected]> schreef in berichtnieuws
[email protected]... [...]
Btw, you make the same spelling mistakes as the Wagner Troll.
Now why is that.
I don't know ? I'm a two-finger typer, and have a small dislexia
problem. How many people on this earth could do & have the
same ? And you base your "you must be the same person"
on *that* ?

I guess Folkert still has faint hopes that I actually attribute any
kind of importance to him. So inventing a new personality to
answer to his portings would just be the thing for him.
Unfortunately I am quite content to post under my own name.

Its also much easier for a person to believe that just *one* person is not
content with his/her behaviour (easier to ignore as a fluke or "a single
a**hole attacking me" incident) than to realize that there are more than one
person with the same discontent.

Such a situation would mostly mean that the one person *has* to look at his
own behaviour too (herd behaviour : make sure you're acting pretty-much the
same as the rest), and thats dangerous ...

Regards,
R.Wieser
 
Previously R.Wieser said:
Arno Wagner <[email protected]> schreef in berichtnieuws
(e-mail address removed)...
Previously R.Wieser said:
Folkert Rienstra <[email protected]> schreef in berichtnieuws
[email protected]... [...]
Btw, you make the same spelling mistakes as the Wagner Troll.
Now why is that.
I don't know ? I'm a two-finger typer, and have a small dislexia
problem. How many people on this earth could do & have the
same ? And you base your "you must be the same person"
on *that* ?

I guess Folkert still has faint hopes that I actually attribute any
kind of importance to him. So inventing a new personality to
answer to his portings would just be the thing for him.
Unfortunately I am quite content to post under my own name.
Its also much easier for a person to believe that just *one* person
is not content with his/her behaviour (easier to ignore as a fluke
or "a single a**hole attacking me" incident) than to realize that
there are more than one person with the same discontent.
Indeed.

Such a situation would mostly mean that the one person *has* to look
at his own behaviour too (herd behaviour : make sure you're acting
pretty-much the same as the rest), and thats dangerous ...

Hehe.

Arno
 
Arno Wagner schreef in bericht news:[email protected]
It is even more funny: Folkert is not even creative enough to do his
own insults: "babblebot" is stolen from me. It amuses me no end
whenever I see him using it on me.

Stupid dutch bastard. All dutch are bastarts.
Arno, could you please show us what post he stole your word bablebot
from? i can't seem to find it.

The closest thing i could find was this:
http://groups.google.com/group/comp.sys.ibm.pc.hardware.storage/msg/d9197c317dd26c00
And the "as long as you can evade the problem, the problem is not an
issue" is typical for him. It allows him to claim superiority without
ever having to give any information that could expose his utter and
complete incompetence.

Yes, Arno, you are quit right.
That's something he obviously stole from you too, the rat bastart.
So very uncreative.
Just add him to your killfile. I did so a long time ago.

Good for you, Arno.
 
Rudi W. <[email protected]> schreef in berichtnieuws
[email protected]...

Rofl !! Someone (lets guess who ...) seems to be doing an half-assed
attempt to imitate *me*.

Someone once said that (trying) to imitate someone, even when negative, is
the most sincere form of flattery. As such I thank you, you've made my
day. :-)
 
Back
Top