473,405 Members | 2,154 Online
Bytes | Software Development & Data Engineering Community
Post Job

Home Posts Topics Members FAQ

Join Bytes to post your question to a community of 473,405 software developers and data experts.

Grabbing data files from a website via C/C++/C#

3
I'm trying to set up a program to automatically grab a few data files from a data provider on a daily basis. There are however, several obstacles to this:

1) The site requires a login / password, so it's not just a simple grab a page and parse it.
2) There's a lot of javascript involved, and in multiple frames on the page.
3) It doesn't simply just display the data on the page either. There's 2 options to retrieve the data that I can possibly use.
a) It will pop up a window displaying the data
b) (preferred method if possible to automate) It will start a file download for a .csv file containing the data.

On the off chance that someone has experience with this particular site, it's jpmorgan's dataquery service. Is there any way for me to hold a session and issue javascript commands and accept downloads, etc within a C#, C++, or C program just like internet explorer can (also note that this site doesn't work right in firefox, because it's a piece of crap). My preferred language would be C#, then C++, then C. If there's libraries out there for any of these, that'd be great, and if there's libraries out there for ANY language that can do something like this, I'll take what I can get.

I can provide copies of the site's javascript on request.
Aug 8 '07 #1
4 2047
drhowarddrfine
7,435 Expert 4TB
this site doesn't work right in firefox, because it's a piece of crap
To the contrary, Firefox is the most standards compliant browser available while IE6/7 is nine years behind web standards. In particular, if you are using the DOM.

If it doesn't work in FF, then there is most likely something wrong with your code. Always use Firefox or Opera or Safari as your initial reference. Never, ever use IE as your initial test.
Aug 8 '07 #2
sgjwm
3
To the contrary, Firefox is the most standards compliant browser available while IE6/7 is nine years behind web standards. In particular, if you are using the DOM.

If it doesn't work in FF, then there is most likely something wrong with your code. Always use Firefox or Opera or Safari as your initial reference. Never, ever use IE as your initial test.
No, I was saying the site is a piece of crap (which is why it's so hard to work with it).

It's not my site, I need to pull data FROM the site.
Aug 8 '07 #3
drhowarddrfine
7,435 Expert 4TB
Heh. That is kind of funny.
Aug 9 '07 #4
sgjwm
3
Wasn't my idea to use this data provider.. Just doing what I'm told to...
Aug 9 '07 #5

Sign in to post your reply or Sign up for a free account.

Similar topics

5
by: Joe | last post by:
I need to connect to 10 web sites to grab content from them. I would like to connect to each site simultaneously so that I can obtain the data as fast as possible. I am familar doing this with...
1
by: Aliza Klein | last post by:
Hi. A client of mine has a website with a standard "Contact Us" form page with name, address etc. The information is currently sent via email to the client and is then data entered into their...
6
by: Jesse Engle | last post by:
i'm working on two client and server programs that send and recieve files using sockets. i saw a c++ example using csockets, and thought i could use the basic idea of what the code was doing to...
4
by: bwalke | last post by:
Help Needed Please!!! With a VB.NET web application, I am trying to save pictures and files to a directory on the web server. However, the web server is not grabbing the Posted Files. For...
2
by: Jonathan Wood | last post by:
Hi, I'd like to build a .NET Website that has any number of documents that visitors can read. In addition to the documents, I may have one or two downloads associated with each document. I'm...
4
by: Sarah Marriott | last post by:
Our website contains session variables that are used to validate if a user is logged in etc. We have found that these variables are randomly lost while navigating the website. We set up some...
5
by: Chris | last post by:
I have a meetings section I'm developing on our intranet. Using PHP/MySQL. Meeting info and Meeting docs reside on 2 related tables in the db. Users may want to upload anywhere from 1 to 10 or...
29
by: Amer Neely | last post by:
I've got a dynamically built form with checkboxes for each element ( a list of file names in a directory). I need to grab only those checkboxes that are checked, so I can then delete those files. ...
8
by: darrel | last post by:
I've decided that instead of doing an XSLT transformation on a file, I might be better off bringing it in as a dataset and having a bit more direct control over it at that point. The question I...
0
by: Charles Arthur | last post by:
How do i turn on java script on a villaon, callus and itel keypad mobile phone
0
by: emmanuelkatto | last post by:
Hi All, I am Emmanuel katto from Uganda. I want to ask what challenges you've faced while migrating a website to cloud. Please let me know. Thanks! Emmanuel
0
BarryA
by: BarryA | last post by:
What are the essential steps and strategies outlined in the Data Structures and Algorithms (DSA) roadmap for aspiring data scientists? How can individuals effectively utilize this roadmap to progress...
1
by: nemocccc | last post by:
hello, everyone, I want to develop a software for my android phone for daily needs, any suggestions?
0
by: Hystou | last post by:
There are some requirements for setting up RAID: 1. The motherboard and BIOS support RAID configuration. 2. The motherboard has 2 or more available SATA protocol SSD/HDD slots (including MSATA, M.2...
0
jinu1996
by: jinu1996 | last post by:
In today's digital age, having a compelling online presence is paramount for businesses aiming to thrive in a competitive landscape. At the heart of this digital strategy lies an intricately woven...
0
by: Hystou | last post by:
Overview: Windows 11 and 10 have less user interface control over operating system update behaviour than previous versions of Windows. In Windows 11 and 10, there is no way to turn off the Windows...
0
tracyyun
by: tracyyun | last post by:
Dear forum friends, With the development of smart home technology, a variety of wireless communication protocols have appeared on the market, such as Zigbee, Z-Wave, Wi-Fi, Bluetooth, etc. Each...
0
agi2029
by: agi2029 | last post by:
Let's talk about the concept of autonomous AI software engineers and no-code agents. These AIs are designed to manage the entire lifecycle of a software development project—planning, coding, testing,...

By using Bytes.com and it's services, you agree to our Privacy Policy and Terms of Use.

To disable or enable advertisements and analytics tracking please visit the manage ads & tracking page.