M
Martin Ho
I've got this problem, where I need to extract an articles from many
different news sources (webpages).
I need to write some logic which would know how to extract the text
only and not a garbage around.
I am able to parse the text from html and all I get now is the text
from the site. But there is lot of short text, lot of advertising
text and garbage all around. In the middle is the article I need. I
was wondering on writing some program which would be smart enough to
figure out where article starts and ends... but apparently it's not
as easy as I thought. I could somehow depending on spaces and dots
make some fairly workable way of doing it. But I am not even sure how
I would go about that.
So when you look at this text in quotes, you'll see the article in the
middle. I will get these articles from many different sources so
wording will be always different, but it would generaly look
something like this:
technicians that will be voted on over the next several weeks.
significant enough under CEP rules to warrant a vote by workers.
While he didn't discuss details, he said in general the offer is
“very much improved” from Bell's June offer,
which was rejected by 62 per cent of those that cast ballots.
final offer late yesterday, and local union leaders from across
Ontario and Quebec meet tomorrow morning in Toronto to issue a
recommendation to workers. Pensions are the No. 1 issue.
Malcolmson, senior vice-president of operations at Bell, said in a
statement.
for job security, and the resulting contract expired last November.
There can be no strike while the workers vote on the new offer.
Shares of BCE were up 25 cents or 1 per cent to $26.36 at midday on
the Toronto Stock Exchange.
Bell, is the dominant phone company in Atlantic Canada and 4,300 of
its workers — two-thirds of the work force — have
been on the picket lines since April 23.
planned.
All I need is the way to figure out that article starts at from "A
strike at Bell Canada has been " and ends at "and no other meetings
are planned.", and that way it would be easy to extract important
text, but how to write this logic???
Uff...
Does anyone have any idea or can give me some help on how to write
some smart text extractor from the page?
Thanks a lot.
Martin Ho
Copy of this problem at:
http://www.groupsrv.com/dotnet/viewtopic.php?t=57362
different news sources (webpages).
I need to write some logic which would know how to extract the text
only and not a garbage around.
I am able to parse the text from html and all I get now is the text
from the site. But there is lot of short text, lot of advertising
text and garbage all around. In the middle is the article I need. I
was wondering on writing some program which would be smart enough to
figure out where article starts and ends... but apparently it's not
as easy as I thought. I could somehow depending on spaces and dots
make some fairly workable way of doing it. But I am not even sure how
I would go about that.
So when you look at this text in quotes, you'll see the article in the
middle. I will get these articles from many different sources so
wording will be always different, but it would generaly look
something like this:
the country's largest phone company made a new offer to 7,000
technicians that will be voted on over the next several weeks.
Canada, which represents the technicians, said the offer is
significant enough under CEP rules to warrant a vote by workers.
While he didn't discuss details, he said in general the offer is
“very much improved” from Bell's June offer,
which was rejected by 62 per cent of those that cast ballots.
been on the pickets Thursday afternoon. Bell made what it called its
final offer late yesterday, and local union leaders from across
Ontario and Quebec meet tomorrow morning in Toronto to issue a
recommendation to workers. Pensions are the No. 1 issue.
meeting the priorities of the union and its members,” Ellen
Malcolmson, senior vice-president of operations at Bell, said in a
statement.
42,500. The workers went on strike for five weeks in 1999, fighting
for job security, and the resulting contract expired last November.
There can be no strike while the workers vote on the new offer.
Bell Globemedia, owner of The Globe and Mail and CTV television.
Shares of BCE were up 25 cents or 1 per cent to $26.36 at midday on
the Toronto Stock Exchange.
Aliant Telecom Inc. is nearly 13 weeks old. Aliant, majority owned by
Bell, is the dominant phone company in Atlantic Canada and 4,300 of
its workers — two-thirds of the work force — have
been on the picket lines since April 23.
the strike began, but no progress was made and no other meetings are
planned.
parent.mt_8734802b;} else {var mt_8734802b=false;}}
parent.mt_8734802c;} else {var mt_8734802c=false;}}
All I need is the way to figure out that article starts at from "A
strike at Bell Canada has been " and ends at "and no other meetings
are planned.", and that way it would be easy to extract important
text, but how to write this logic???
Uff...
Does anyone have any idea or can give me some help on how to write
some smart text extractor from the page?
Thanks a lot.
Martin Ho
Copy of this problem at:
http://www.groupsrv.com/dotnet/viewtopic.php?t=57362