473,395 Members | 1,530 Online
Bytes | Software Development & Data Engineering Community
Post Job

Home Posts Topics Members FAQ

Join Bytes to post your question to a community of 473,395 software developers and data experts.

problem

hi friends,

I am anil. I have begining level experience of c++ so I need ur advice.
I have a problem for all think tanks in the group. what i want is

1. Access a web page (html) say ebay's page for particular item (I need
to access different pages for several items approx. 1500)
2. Save that page in comp memory or on disk for processing
3. I am not sure if I can process that html in c++ or need to convert
to txt first
4. Extract specific information with date time n store them on disk for
further processing
5. I need to repeat above process for 1500 items with no time gap
(means i want to check web page again within seconds to check any
update n capture that update)
6. I need further calculation on that data stored from above process
7. First priority is data accuracy
8. Second is minimum time gap

things i stated above is possible with c++ or vb ?

thanx n regards

@nil

Jan 1 '07 #1
5 1091
Jupiter,

Very easy

http://www.vb-tips.com/dbpages.aspx?...f-56dbb63fdf1c

be aware that our website is in a big reconstruction so they can be
sometimes out of the air.

Cor

"jupiter" <an***********@gmail.comschreef in bericht
news:11**********************@i12g2000cwa.googlegr oups.com...
hi friends,

I am anil. I have begining level experience of c++ so I need ur advice.
I have a problem for all think tanks in the group. what i want is

1. Access a web page (html) say ebay's page for particular item (I need
to access different pages for several items approx. 1500)
2. Save that page in comp memory or on disk for processing
3. I am not sure if I can process that html in c++ or need to convert
to txt first
4. Extract specific information with date time n store them on disk for
further processing
5. I need to repeat above process for 1500 items with no time gap
(means i want to check web page again within seconds to check any
update n capture that update)
6. I need further calculation on that data stored from above process
7. First priority is data accuracy
8. Second is minimum time gap

things i stated above is possible with c++ or vb ?

thanx n regards

@nil

Jan 1 '07 #2

Cor Ligthert [MVP] wrote:
Jupiter,

Very easy

http://www.vb-tips.com/dbpages.aspx?...f-56dbb63fdf1c

be aware that our website is in a big reconstruction so they can be
sometimes out of the air.

Cor

"jupiter" <an***********@gmail.comschreef in bericht
news:11**********************@i12g2000cwa.googlegr oups.com...
hi friends,

I am anil. I have begining level experience of c++ so I need ur advice.
I have a problem for all think tanks in the group. what i want is

1. Access a web page (html) say ebay's page for particular item (I need
to access different pages for several items approx. 1500)
2. Save that page in comp memory or on disk for processing
3. I am not sure if I can process that html in c++ or need to convert
to txt first
4. Extract specific information with date time n store them on disk for
further processing
5. I need to repeat above process for 1500 items with no time gap
(means i want to check web page again within seconds to check any
update n capture that update)
6. I need further calculation on that data stored from above process
7. First priority is data accuracy
8. Second is minimum time gap

things i stated above is possible with c++ or vb ?

thanx n regards

@nil

Hi

Thanx for quick n easy reply.

What I have in my mind is I want to extract some(sssshhhhh secret :) )
information from web pages n then distribute that data to people who
may subscribe to my service altho' about the data I am talking there
are some data vendor but its not organize so far so I can catch early
move to set myself there. problems ahead me is I am not ready to spend
big amount I can make moderate investments second is I cant spend full
time as I am working but if i be successful we are talking big with
moderate investment. would you like to help me with ur knowledge if u
have spare time we can form business relationship as well.

If you agree contact me at an***********@gmail.com or 919910998008 n we
can discuss further

thanx

@nil
Mobile # 919910998008
an***********@gmail.com

Jan 2 '07 #3
Anil

A word of caution is called for here in that you need to be aware that
you will probably be infringing on copyright by grabbing data from
other peoples web sites unless they specifically grant you permission
to do so.

You could end up in a lot more trouble than you bargained for if you
haven't checked out the legal implications of doing what you're trying
to do so I'd suggest you look at that side of things before investing
your time and efforts into the mechanics of how you can do it.

Martin

jupiter wrote:
Cor Ligthert [MVP] wrote:
Jupiter,

Very easy

http://www.vb-tips.com/dbpages.aspx?...f-56dbb63fdf1c

be aware that our website is in a big reconstruction so they can be
sometimes out of the air.

Cor

"jupiter" <an***********@gmail.comschreef in bericht
news:11**********************@i12g2000cwa.googlegr oups.com...
hi friends,
>
I am anil. I have begining level experience of c++ so I need ur advice.
I have a problem for all think tanks in the group. what i want is
>
1. Access a web page (html) say ebay's page for particular item (I need
to access different pages for several items approx. 1500)
2. Save that page in comp memory or on disk for processing
3. I am not sure if I can process that html in c++ or need to convert
to txt first
4. Extract specific information with date time n store them on disk for
further processing
5. I need to repeat above process for 1500 items with no time gap
(means i want to check web page again within seconds to check any
update n capture that update)
6. I need further calculation on that data stored from above process
7. First priority is data accuracy
8. Second is minimum time gap
>
things i stated above is possible with c++ or vb ?
>
thanx n regards
>
@nil
>


Hi

Thanx for quick n easy reply.

What I have in my mind is I want to extract some(sssshhhhh secret :) )
information from web pages n then distribute that data to people who
may subscribe to my service altho' about the data I am talking there
are some data vendor but its not organize so far so I can catch early
move to set myself there. problems ahead me is I am not ready to spend
big amount I can make moderate investments second is I cant spend full
time as I am working but if i be successful we are talking big with
moderate investment. would you like to help me with ur knowledge if u
have spare time we can form business relationship as well.

If you agree contact me at an***********@gmail.com or 919910998008 n we
can discuss further

thanx

@nil
Mobile # 919910998008
an***********@gmail.com
Jan 2 '07 #4

Pritcham wrote:
Anil

A word of caution is called for here in that you need to be aware that
you will probably be infringing on copyright by grabbing data from
other peoples web sites unless they specifically grant you permission
to do so.

You could end up in a lot more trouble than you bargained for if you
haven't checked out the legal implications of doing what you're trying
to do so I'd suggest you look at that side of things before investing
your time and efforts into the mechanics of how you can do it.

Martin

jupiter wrote:
Cor Ligthert [MVP] wrote:
Jupiter,
>
Very easy
>
http://www.vb-tips.com/dbpages.aspx?...f-56dbb63fdf1c
>
be aware that our website is in a big reconstruction so they can be
sometimes out of the air.
>
Cor
>
"jupiter" <an***********@gmail.comschreef in bericht
news:11**********************@i12g2000cwa.googlegr oups.com...
hi friends,

I am anil. I have begining level experience of c++ so I need ur advice.
I have a problem for all think tanks in the group. what i want is

1. Access a web page (html) say ebay's page for particular item (I need
to access different pages for several items approx. 1500)
2. Save that page in comp memory or on disk for processing
3. I am not sure if I can process that html in c++ or need to convert
to txt first
4. Extract specific information with date time n store them on disk for
further processing
5. I need to repeat above process for 1500 items with no time gap
(means i want to check web page again within seconds to check any
update n capture that update)
6. I need further calculation on that data stored from above process
7. First priority is data accuracy
8. Second is minimum time gap

things i stated above is possible with c++ or vb ?

thanx n regards

@nil

Hi

Thanx for quick n easy reply.

What I have in my mind is I want to extract some(sssshhhhh secret :) )
information from web pages n then distribute that data to people who
may subscribe to my service altho' about the data I am talking there
are some data vendor but its not organize so far so I can catch early
move to set myself there. problems ahead me is I am not ready to spend
big amount I can make moderate investments second is I cant spend full
time as I am working but if i be successful we are talking big with
moderate investment. would you like to help me with ur knowledge if u
have spare time we can form business relationship as well.

If you agree contact me at an***********@gmail.com or 919910998008 n we
can discuss further

thanx

@nil
Mobile # 919910998008
an***********@gmail.com

Hi,

Thanx for the concern. :) However The site I want to access or the
information can be access by anyone its totally transparent. Just like
microsoft, people who control information either dont want others to
know or they dont know how to use it. I want to use this information
for my own system. I can get this information later in time but i want
quick n effective way to capture data then perform my calculation
(means automated) also make that data available to others who share my
interest. In this era u will agree with me that its not time but
information on time is money.
Anil

Jan 2 '07 #5

jupiter wrote:
Pritcham wrote:
Anil

A word of caution is called for here in that you need to be aware that
you will probably be infringing on copyright by grabbing data from
other peoples web sites unless they specifically grant you permission
to do so.

You could end up in a lot more trouble than you bargained for if you
haven't checked out the legal implications of doing what you're trying
to do so I'd suggest you look at that side of things before investing
your time and efforts into the mechanics of how you can do it.

Martin

jupiter wrote:
Cor Ligthert [MVP] wrote:
Jupiter,

Very easy

http://www.vb-tips.com/dbpages.aspx?...f-56dbb63fdf1c

be aware that our website is in a big reconstruction so they can be
sometimes out of the air.

Cor

"jupiter" <an***********@gmail.comschreef in bericht
news:11**********************@i12g2000cwa.googlegr oups.com...
hi friends,
>
I am anil. I have begining level experience of c++ so I need ur advice.
I have a problem for all think tanks in the group. what i want is
>
1. Access a web page (html) say ebay's page for particular item (I need
to access different pages for several items approx. 1500)
2. Save that page in comp memory or on disk for processing
3. I am not sure if I can process that html in c++ or need to convert
to txt first
4. Extract specific information with date time n store them on disk for
further processing
5. I need to repeat above process for 1500 items with no time gap
(means i want to check web page again within seconds to check any
update n capture that update)
6. I need further calculation on that data stored from above process
7. First priority is data accuracy
8. Second is minimum time gap
>
things i stated above is possible with c++ or vb ?
>
thanx n regards
>
@nil
>
>
>
Hi
>
Thanx for quick n easy reply.
>
What I have in my mind is I want to extract some(sssshhhhh secret :) )
information from web pages n then distribute that data to people who
may subscribe to my service altho' about the data I am talking there
are some data vendor but its not organize so far so I can catch early
move to set myself there. problems ahead me is I am not ready to spend
big amount I can make moderate investments second is I cant spend full
time as I am working but if i be successful we are talking big with
moderate investment. would you like to help me with ur knowledge if u
have spare time we can form business relationship as well.
>
If you agree contact me at an***********@gmail.com or 919910998008 n we
can discuss further
>
thanx
>
@nil
Mobile # 919910998008
an***********@gmail.com


Hi,

Thanx for the concern. :) However The site I want to access or the
information can be access by anyone its totally transparent. Just like
microsoft, people who control information either dont want others to
know or they dont know how to use it. I want to use this information
for my own system. I can get this information later in time but i want
quick n effective way to capture data then perform my calculation
(means automated) also make that data available to others who share my
interest. In this era u will agree with me that its not time but
information on time is money.
Anil
First problem is to download webpage from website continously (means
within few second) for approx. 1500 items. extract specific data n copy
that data to file then delete that webpage

I can handle calculation part myself

2nd problem is to send that extracted data to users who may want this
data (saving their computing power to extract data)

all this within shortest possible span of time

Jan 2 '07 #6

This thread has been closed and replies have been disabled. Please start a new discussion.

Similar topics

11
by: Kostatus | last post by:
I have a virtual function in a base class, which is then overwritten by a function of the same name in a publically derived class. When I call the function using a pointer to the derived class...
117
by: Peter Olcott | last post by:
www.halting-problem.com
18
by: Ian Stanley | last post by:
Hi, Continuing my strcat segmentation fault posting- I have a problem which occurs when appending two sting literals using strcat. I have tried to fix it by writing my own function that does the...
28
by: Jon Davis | last post by:
If I have a class with a virtual method, and a child class that overrides the virtual method, and then I create an instance of the child class AS A base class... BaseClass bc = new ChildClass();...
6
by: Ammar | last post by:
Dear All, I'm facing a small problem. I have a portal web site, that contains articles, for each article, the end user can send a comment about the article. The problem is: I the comment length...
16
by: Dany | last post by:
Our web service was working fine until we installed .net Framework 1.1 service pack 1. Uninstalling SP1 is not an option because our largest customer says service packs marked as "critical" by...
2
by: Mike Collins | last post by:
I cannot get the correct drop down list value from a drop down I have on my web form. I get the initial value that was loaded in the list. It was asked by someone else what the autopostback was...
0
by: =?Utf-8?B?am8uZWw=?= | last post by:
Hello All, I am developing an Input Methop (IM) for PocketPC / Windows Mobile (PPC/WM). On some devices the IM will not start. The IM appears in the IM-List but when it is selected from the...
1
by: sherifbk | last post by:
Problem description ============== - I have 4 clients and 1 server (SQL server) - 3 clients are Monitoring console 1 client is operation console - Monitoring console collects some data from...
9
by: AceKnocks | last post by:
I am working on a framework design problem in which I have to design a C++ based framework capable of solving three puzzles for now but actually it should work with a general puzzle of any kind and I...
0
by: Charles Arthur | last post by:
How do i turn on java script on a villaon, callus and itel keypad mobile phone
0
by: ryjfgjl | last post by:
In our work, we often receive Excel tables with data in the same format. If we want to analyze these data, it can be difficult to analyze them because the data is spread across multiple Excel files...
0
by: Hystou | last post by:
There are some requirements for setting up RAID: 1. The motherboard and BIOS support RAID configuration. 2. The motherboard has 2 or more available SATA protocol SSD/HDD slots (including MSATA, M.2...
0
marktang
by: marktang | last post by:
ONU (Optical Network Unit) is one of the key components for providing high-speed Internet services. Its primary function is to act as an endpoint device located at the user's premises. However,...
0
Oralloy
by: Oralloy | last post by:
Hello folks, I am unable to find appropriate documentation on the type promotion of bit-fields when using the generalised comparison operator "<=>". The problem is that using the GNU compilers,...
0
jinu1996
by: jinu1996 | last post by:
In today's digital age, having a compelling online presence is paramount for businesses aiming to thrive in a competitive landscape. At the heart of this digital strategy lies an intricately woven...
0
by: Hystou | last post by:
Overview: Windows 11 and 10 have less user interface control over operating system update behaviour than previous versions of Windows. In Windows 11 and 10, there is no way to turn off the Windows...
0
tracyyun
by: tracyyun | last post by:
Dear forum friends, With the development of smart home technology, a variety of wireless communication protocols have appeared on the market, such as Zigbee, Z-Wave, Wi-Fi, Bluetooth, etc. Each...
0
agi2029
by: agi2029 | last post by:
Let's talk about the concept of autonomous AI software engineers and no-code agents. These AIs are designed to manage the entire lifecycle of a software development project—planning, coding, testing,...

By using Bytes.com and it's services, you agree to our Privacy Policy and Terms of Use.

To disable or enable advertisements and analytics tracking please visit the manage ads & tracking page.