EPSON Scan wouldn't make large files (>1000 MB)

  • Thread starter Thread starter Mark Fineman
  • Start date Start date
M

Mark Fineman

I cannot make scans that would produce files larger than
about 1000 MB.

Is this solely a software problem?

I have a newly installed Epson Perfection 3200 Pro
scanner that was purchased in 2003 June, so it might
not be the latest model, but I downloaded the latest
software today.

I am running Windows X Professional.
My system has 512 MB of memory plus about
180 GB on the NTFS disk. The paging file
has more than 3 GB available before the
scan starts.

I using EPSON Scan Ver 1.25A.

Specifically with Mode Professional Mode
and:
Configuration... tab Color set to No Color Correction.
Original Document Type: Transparency
Film Type: Positive
Auto Exposure Type: Photo
Destination
Image Type: 48-bit color
Resolution: 6400 dpi

Target Size: Original

Output file is BMP.

The error message is in a popup window with the title:
EPSON Scan
There is a "!" in a yellow triangle and the text of
the message is:
Selected area is too large for this resolution.
Reduce the Resolution or Scale setting, or decrease the size of the
selected area.


The error message is dismissed by clicking "OK", which
lets you try scanning again.

I tried many combinations of settings, but I am including
this information so others can reproduce the problem if they
desire. The problem happens with reflective also, but I
am giving the setup for transparency in case there is
a limit associated with the part of the Document Table
that is being used.

The same problem happened with the 2450 a few years
ago, but the software was different at that time and
I only had Windows 98 Second Edition with FAT32 on the
machine that I had then. The text of the message at
that time indicated that there was not enough memory,
whereas the current error message
 
Resolution: 6400 dpi

3200 is the highest optical rez of your scanner.
You're not gaining anything you can't do after the fact in image editor
by going higher.

Scan your origs at 1:1 size at 3200.

Mac
 
Mac McDougald said:
3200 is the highest optical rez of your scanner.
You're not gaining anything you can't do after the fact in image editor
by going higher.
Not strictly true Mac - he is gaining twice as many real samples. It
won't yield any increase in resolution in the axis of the CCD, and
marginal increase in the axis of the scan, because the CCD is already
oversampled by design, but he does get a noise reduction equivalent to
2x multiscanning.

As for the original question, I would guess it is a software limit. Most
image processing applications, including Photoshop itself, are limited
to a maximum 8-bit image of the same size (32,000 pixels in each axis)
so it may have been programmed in as a hard limit to prevent handing and
unworkable image across to the application.
 
Not strictly true Mac - he is gaining twice as many real samples. It
won't yield any increase in resolution in the axis of the CCD, and
marginal increase in the axis of the scan, because the CCD is already
oversampled by design, but he does get a noise reduction equivalent to
2x multiscanning.

As for the original question, I would guess it is a software limit. Most
image processing applications, including Photoshop itself, are limited
to a maximum 8-bit image of the same size (32,000 pixels in each axis)
so it may have been programmed in as a hard limit to prevent handing and
unworkable image across to the application.

Well, that's always a real debate, never seen any visual proof that
anything over optical on these flatbeds really helps.

BUT, as you further suggest, it's almost certainly why he can't make his
scan.

Mac
 
Mac McDougald said:
Well, that's always a real debate, never seen any visual proof that
anything over optical on these flatbeds really helps.
You are right about resolution, even the theoretical resolution gain is
marginal and almost certainly well below the sample to sample production
variation. But I don't think there has ever been any question about the
noise reduction aspect - if you resample the image back to 3200ppi using
nearest neighbour resizing it is mathematically exactly the same as 2x
multiscanning. That yields exactly 1.414x noise reduction - and all in
a single pass with a scanner which formally doesn't provide
multisampling at all. With no significant resolution gain, the noise
reduction is just there in the image without resampling.

So it is not true to say that he is not gaining anything, even if the
gain isn't in the dimension Mark expected it to be.
 
So it is not true to say that he is not gaining anything, even if the
gain isn't in the dimension Mark expected it to be.

Okey dokey, I'll give in to that.

Mac
 
Not strictly true Mac - he is gaining twice as many real samples. It
won't yield any increase in resolution in the axis of the CCD, and
marginal increase in the axis of the scan, because the CCD is already
oversampled by design, but he does get a noise reduction equivalent to
2x multiscanning.

That's very interesting! I always assumed any interpolation above
optical resolution was done in software. In other words (in the above
case) I thought the same result would be achieved by scanning at 3200
and then using PS, for example, to upsample to 6400.

But, if I understand your explanation correctly, (in the above case)
each line is sampled twice and both samples are then saved to produce
the 6400 dpi. Due to stepper motor jitter (and other inaccuracies)
this may result in the second sample not being perfectly aligned with
the first, which then accounts for the marginal increase in the axis
of the scan, right?

Although, wouldn't the same stepper motor jitter (and other
inaccuracies) produce some lateral movement too, marginally increasing
resolution in the axis of the CCD as well? I mean, even though the CCD
array is nominally "fixed" laterally, at this order of magnification
some lateral movement must also be perceivable.

Does this apply to all flatbed scanners (or only to the Epson)?

If it does, that implies that scanning at maximum interpolated
resolution is actually useful and, for example, scanning at 19200 -
even though my own flatbed is rated at 4800 optical - is equivalent to
4x multiscanning? Downsampling to 600 or 1200 from there would then
increase the multiscanning effect/equivalent even more. Correct?

And while am at it, I recently read (don't remember where) that
maximum CCD density is (currently) fixed at 2400 dpi due to the size
of each CCD using the current manufacturing process. According to this
article scanners, like mine, rated at 4800 actually have two CCD
arrays offset by half a dot to produce the optical equivalent of 4800.
Is this correct?

If yes, what about overlap? If individual CCD elements are too big to
fit on a single array wouldn't then there be lateral overlap between
neighboring CCDs on the two arrays, in effect, limiting the claimed
optical resolution?

Don.
 
Don said:
That's very interesting! I always assumed any interpolation above
optical resolution was done in software. In other words (in the above
case) I thought the same result would be achieved by scanning at 3200
and then using PS, for example, to upsample to 6400.
Not always. Some, indeed most flatbeds these days, exploit what is
known as "half stepping" of the stepper motor drive. These half steps
are less precise than the full step and less robust because only half
the holding force is produced by the motor coils, however it effectively
doubles the precision of the stepper motor at no cost - albeit with
reductions in other parameters. Even so, in a normal stepper motor,
only a single doubling of precision is possible.

When used in a scanner, this permits the scan head to be moved at twice
the precision that it was originally designed. Usually, the minimum
step the scanner is designed for moves the scan head by the same
distance as the CCD elements are separated. This means that the sample
pitch in the x and y axes are the same, which fits directly with the
square aspect ratio pixels in most displays and image formats. However,
if the scanner motor is half stepped then the y sample pitch is halved
relative to the x sample pitch (which is fixed by the CCD design). This
doesn't match well with standard display and image formats, so the
pixels in the x axis are interpolated to simulate the intermediate data.
The interpolation can be simple pixel doubling or linear or even cubic
interpolation, depending on the complexity of the software, but it is
only applied along the axis of the CCD - the new data in the orthogonal
axis is real, coming from true image samples, albeit with the same MTF
as the original native optical resolution, since neither optic nor CCD
element dimensions have changed.

This is very different from the full interpolation that you get in
Photoshop or other image processing packages where the data in both axes
is interpolated - hence the terms *bi*-linear and *bi*-cubic
interpolation. In that case, no new real data is available and the only
change in the noise characteristics of the image is a direct function of
the noise shaping of the interpolation algorithm.

In principle, there is nothing to prevent a scanner manufacturer
designing their stepper motor to move the scan head by small fractions
of the CCD element pitch, thus enabling even more than a doubling of the
sampling density on one axis relative to the other. However this would
have little benefit in true resolution terms because of the finite size
of the CCD element and the lens resolution limits. Assuming an
unachievable in practice 100% fill factor, the MTF of the CCD itself is
63% at the Nyquist limit of its native sampling density, and falls to
zero at twice that limit - although it then increases again with a phase
inversion. Taking account of the lens resolution, this subsequent
increase in MTF is very marginal. In the case of a modern flatbed CCD,
most of which now use the HyperCCD approach first implemented on flatbed
scanners by Epson, the CCD is already oversampled in its own axis - so
even in that axis the MTF at the Nyquist limit is already very low
indeed. Thus the half stepping technology, which did provide a
significant resolution increase in one axis with linear CCD based
scanners, produces only a very marginal resolution increase with
HyperCCD based scanners and may, depending on the interpolation
algorithm used, actually produce a net reduction in overall resolution!

Since it offers so little in terms of the parameter they are selling it
on, which must be balanced against the cost of higher precision
mechanics and longer scan times, it is not a marketable option and I am
not aware of any scanner manufacturers which do this. Consequently, the
limit for the sample density is a doubling of the native CCD sample
density in the orthogonal axis due to half-stepping the motor drive,
since that can be offered at no cost to the manufacturer.

Any scan at more than twice the native optical resolution uses
interpolation in both axes, albeit with twice as much real data in one
axis as the other.
But, if I understand your explanation correctly, (in the above case)
each line is sampled twice and both samples are then saved to produce
the 6400 dpi.

Yes, but only up to double the CCDs sampling density because of the
half-stepping motor option.
Due to stepper motor jitter (and other inaccuracies)
this may result in the second sample not being perfectly aligned with
the first, which then accounts for the marginal increase in the axis
of the scan, right?
Yes, but even though the alignment will be worse than a full step, it is
still a small fraction of the instantaneous field of view (IFOV) of each
CCD element, and is consequently irrelevant to all intents and purposes.
Although, wouldn't the same stepper motor jitter (and other
inaccuracies) produce some lateral movement too, marginally increasing
resolution in the axis of the CCD as well?

Yes, but with the same caveat - it is irrelevant.
Does this apply to all flatbed scanners (or only to the Epson)?
Most modern flatbeds use half stepping to double the resolution in one
axis. Normally these are obvious from the asymmetric resolution
'specification' (eg. "Incredible 600x1200dpi!" or "Exceptional
1200x2400dpi!" or "Amazing 3200x6400dpi").

In addition though, most modern high resolution flatbeds use the
HyperCCD design, where each colour is actually produced from two rows of
CCD elements at half the sampling density but staggered by half a sample
pitch. This results in a sampling density which is virtually equal to
the optical resolution limit of the system - so aliasing is virtually
eliminated. However it also means that the resolution advantage of half
stepping in the orthogonal axis is also dramatically reduced too - if
not reversed as explained above.
If it does, that implies that scanning at maximum interpolated
resolution is actually useful and, for example, scanning at 19200 -
even though my own flatbed is rated at 4800 optical - is equivalent to
4x multiscanning?

No - it is only true up to twice the CCD sampling density. Some older
scanners were marketed with claims of resolution which were actually the
result of interpolation, but that has since been made illegal. However
since half stepping resolution is real, it is still legal to claim it
(even if it is marginal at best with a HyperCCD). If your scanner is
indeed a true 4800ppi (which significantly limits the options as to
which it is - somewhat contradicting your reasons for persevering with a
Nikon LS-30 ;-) ) then this double data gathering would only be
applicable to a 9600ppi resolution - again yielding a noise benefit
equivalent to 2x multiscanning. If, as is more likely, the 4800ppi
limit is the upper figure of the resolution specification of your
scanner then it is already taking the half stepping into account and the
real optical resolution is only 1200ppi with 2x multiscan performance
achieved at 4800ppi.
Downsampling to 600 or 1200 from there would then
increase the multiscanning effect/equivalent even more. Correct?
Usually, but it depends on how the scanner captures the lower
resolutions. Some scanners, eg. more recent Nikon film scanners,
produce low resolutions by downsampling the full optical resolution
themselves, so no further advantage is possible. Most, however, scan
low resolutions by multistepping the motor and dropping pixels. In
those cases the downsampling approach in the final application will
yield a noise improvement equivalent to the scale. So a 1200ppi
original rescaled to 600ppi will give the equivalent of 4x multiscan, or
2x noise improvement, assuming that the bit depth of the image is
sufficient to realise it.
And while am at it, I recently read (don't remember where) that
maximum CCD density is (currently) fixed at 2400 dpi due to the size
of each CCD using the current manufacturing process. According to this
article scanners, like mine, rated at 4800 actually have two CCD
arrays offset by half a dot to produce the optical equivalent of 4800.
Is this correct?

Partially. This is actually a very old technique which has been
deployed on military surveillance systems for years. The size is not
limited to 2400ppi, that is just a design criteria for that particular
CCD. Practically speaking, the size of the CCD element is only limited
by the storage capacity required to achieve a useful signal to noise
ratio and the resolution limits of the optical system it is designed to
operate with. Typically that is around the 2-3um region but it can be
higher or lower depending on the design criteria.

The only flatbed scanner I am aware of with 4800ppi optical resolution
though is the recently introduced Epson 4870. If this is not the
scanner in question then it might be worth checking your specification
again to be sure that this is not the half stepping resolution and you
really have a 2400x4800ppi scanner.
If yes, what about overlap? If individual CCD elements are too big to
fit on a single array wouldn't then there be lateral overlap between
neighboring CCDs on the two arrays, in effect, limiting the claimed
optical resolution?
Again, partially true. The resolution is obtained by staggered pixels
to produce double the sampling density but with a Point Spread Function
(PSF) and (Modulation Transfer Function) MTF of the single, larger, CCD
element. As mentioned above, this prevents aliasing by conforming to
the Nyquist criteria, but a consequence of doing this is that the
contrast at the limiting resolution is reduced to near zero. Unlike in
electronics, where a flat passband and brick wall cut-off are practical,
this is not the case in optics - so eliminating response above the
Nyquist limit comes at the expense of reduced MTF below it. However,
since the pixels have 4x the area of an equivalent full resolution
single line solution, they have much less noise - less than half the
noise - so their output can be sharpened considerably more before noise
becomes objectionable. Unlike a conventional linear CCD, unsharp
masking is an integral part of the HyperCCD operating principle. You
will see a lot of comparisons on the net of various scanners where any
USM is turned off - ostensibly to provide an equivalent comparison on a
flat playing field. Unfortunately this does exactly the opposite of
what the reviewers actually intended. :-(
 
Not always. Some, indeed most flatbeds these days, exploit what is
known as "half stepping" of the stepper motor drive. ....
Any scan at more than twice the native optical resolution uses
interpolation in both axes, albeit with twice as much real data in one
axis as the other.

That explains it. I wasn't aware of half-stepping at all, although I
was always a bit puzzled that quoted maximum flatbed resolutions were
often asymmetrical. I attributed that to the ability of a stepper
motor to move smaller distances than the available CCD densities. But
it was only a speculation on my part without any factual basis.
Yes, but even though the alignment will be worse than a full step, it is
still a small fraction of the instantaneous field of view (IFOV) of each
CCD element, and is consequently irrelevant to all intents and purposes.

That's also good to know. I was not aware of the scale.
In addition though, most modern high resolution flatbeds use the
HyperCCD design, where each colour is actually produced from two rows of
CCD elements at half the sampling density but staggered by half a sample
pitch. This results in a sampling density which is virtually equal to
the optical resolution limit of the system - so aliasing is virtually
eliminated. However it also means that the resolution advantage of half
stepping in the orthogonal axis is also dramatically reduced too - if
not reversed as explained above.

That's probably what was in that article I was referring to about twin
CCD arrays to boost resolution.
If your scanner is
indeed a true 4800ppi (which significantly limits the options as to
which it is - somewhat contradicting your reasons for persevering with a
Nikon LS-30 ;-) ) then this double data gathering would only be
applicable to a 9600ppi resolution - again yielding a noise benefit
equivalent to 2x multiscanning. If, as is more likely, the 4800ppi
limit is the upper figure of the resolution specification of your
scanner then it is already taking the half stepping into account and the
real optical resolution is only 1200ppi with 2x multiscan performance
achieved at 4800ppi.

The scanner in question is Mustek BearPaw 4800TA Pro. I bought it
about a year or year-and-half ago. Not exactly a top notch
manufacturer so I remember one reviewer (like you) disbelieving the
4800 optical resolution claim and calling Mustek to explicitly confirm
it, which they did. So, I bought it - it both senses of the word...
;-)

I also have an ancient ScanMaker E6 which (like the LS30) stayed
unopened in its box for years. But flatbeds have moved so far over the
last few years (both in terms of specs as well as a massive drop in
price) that I decided to get the BearPaw and use it instead of the E6.

Now, even though the maximum optical resolution of the flatbed is
claimed to be 2400x4800 the maximum symmetrical resolution is still
2400 ppi which is why I stick with LS30 as its 2700 is nominally
higher. Also, the sharpness is considerably better on the LS30 which
is another reason to continue wrestling with it... albeit I pay for it
with more grain, not to mention all the other torture it inflicts on
me perennially, as you know... ;-).

Don.
 
Don said:
The scanner in question is Mustek BearPaw 4800TA Pro. I bought it
about a year or year-and-half ago. Not exactly a top notch
manufacturer so I remember one reviewer (like you) disbelieving the
4800 optical resolution claim and calling Mustek to explicitly confirm
it, which they did. So, I bought it - it both senses of the word...
;-)
The Mustek web site shows this scanner to be 2400ppi optical:
http://www.mustek.com/html/prod_scan/BearPawVIP/bp_4800TA.html
(its in a little circle at the bottom of the page).
I also have an ancient ScanMaker E6 which (like the LS30) stayed
unopened in its box for years. But flatbeds have moved so far over the
last few years (both in terms of specs as well as a massive drop in
price) that I decided to get the BearPaw and use it instead of the E6.

Now, even though the maximum optical resolution of the flatbed is
claimed to be 2400x4800 the maximum symmetrical resolution is still
2400 ppi which is why I stick with LS30 as its 2700 is nominally
higher. Also, the sharpness is considerably better on the LS30 which
is another reason to continue wrestling with it... albeit I pay for it
with more grain, not to mention all the other torture it inflicts on
me perennially, as you know... ;-).
A clear demonstration of the 1st Law of Capitalism: You don't always get
what you pay for but if you don't pay you don't get. ;-)
 
The Mustek web site shows this scanner to be 2400ppi optical:
http://www.mustek.com/html/prod_scan/BearPawVIP/bp_4800TA.html
(its in a little circle at the bottom of the page).

I haven't been to the site in a while but they used to boast 4800 in
the scanner's tech specs and in comparison charts of different models.
I guess Better Business Bureau caught up with them for false
advertising...
A clear demonstration of the 1st Law of Capitalism: You don't always get
what you pay for but if you don't pay you don't get. ;-)

You probably never get what you pay for because of the profit
margin... ;-)

And speaking of capitalism, I overheard on the news the other day that
Nikon stock dropped 10% due to poor sales of their digital cameras.

Don.
 
Back
Top