473,378 Members | 1,447 Online
Bytes | Software Development & Data Engineering Community
Post Job

Home Posts Topics Members FAQ

Join Bytes to post your question to a community of 473,378 software developers and data experts.

what is the best way to determine numeric patterns within a dataset

D
I have normalized data in sql server in a table like (testset, testnumber,
result) . There can be 5-10 tests in a testset and anywhere from 1500 rows
to 100000 rows of testsets. I need to start searching for patterns within
the data such as the total number of times 15,16 & 17 occurred. My first
thoughts were to write a stored procedure but that hasn't proved to be the
best as I am still trying to get that to work.

In the essence of speed would it be better to do this analysis on the c#
side or continue within my efforts of using stored procedures? I have even
considered a third party library as more indepth analysis may be required.

Your thoughts on the matter are truly appreciated.

Regards
Dave
Nov 17 '05 #1
2 1152
Hi,

Use a Stored procedure to make the calculations, if you have to do in c# you
have to load data in memory or using a datareader, at the end you r adding
more unnecessary layers.

regards
Salva
"D" wrote:
I have normalized data in sql server in a table like (testset, testnumber,
result) . There can be 5-10 tests in a testset and anywhere from 1500 rows
to 100000 rows of testsets. I need to start searching for patterns within
the data such as the total number of times 15,16 & 17 occurred. My first
thoughts were to write a stored procedure but that hasn't proved to be the
best as I am still trying to get that to work.

In the essence of speed would it be better to do this analysis on the c#
side or continue within my efforts of using stored procedures? I have even
considered a third party library as more indepth analysis may be required.

Your thoughts on the matter are truly appreciated.

Regards
Dave

Nov 17 '05 #2
D
ok, I had initially thought that too but with the pattern searching I've
been trying to accomplish in t-sql I was starting to think that it might be
done faster in somewhere else. Speed is of the essence and some of these
queries don't seem that fast.
"Salvador" <Sa******@discussions.microsoft.com> wrote in message
news:1C**********************************@microsof t.com...
Hi,

Use a Stored procedure to make the calculations, if you have to do in c#
you
have to load data in memory or using a datareader, at the end you r adding
more unnecessary layers.

regards
Salva
"D" wrote:
I have normalized data in sql server in a table like (testset,
testnumber,
result) . There can be 5-10 tests in a testset and anywhere from 1500
rows
to 100000 rows of testsets. I need to start searching for patterns within
the data such as the total number of times 15,16 & 17 occurred. My first
thoughts were to write a stored procedure but that hasn't proved to be
the
best as I am still trying to get that to work.

In the essence of speed would it be better to do this analysis on the c#
side or continue within my efforts of using stored procedures? I have
even
considered a third party library as more indepth analysis may be
required.

Your thoughts on the matter are truly appreciated.

Regards
Dave

Nov 17 '05 #3

This thread has been closed and replies have been disabled. Please start a new discussion.

Similar topics

226
by: Stephen C. Waterbury | last post by:
This seems like it ought to work, according to the description of reduce(), but it doesn't. Is this a bug, or am I missing something? Python 2.3.2 (#1, Oct 20 2003, 01:04:35) on linux2 Type...
13
by: Walter Kalata | last post by:
I'd consider myself something of a c++ hobbyist. Rather, I program mainly at a personal project level. I started learning when I was about twelve years old (currently eighteen), reading various...
1
by: Jim Shank | last post by:
I am adding support to my application for Oracle 10g and using Enterprise Library Data Access Application Blocks and trying to determine the best way to convert the GUID's which are stored as...
3
by: Ben Becker | last post by:
I am trying to build a custom crosstab type of grid where I take some items in a data grid and based on the content of the current item compared to the previous item, determine if a new row in a...
3
by: Rob | last post by:
Rather new to vb.net... I am wondering if the following is possible and sounds reasonable... Can connection objects and datasets be defined once (at program load) and be available for the life...
16
by: SLIMSHIM | last post by:
Hi, I"m new to c# and .net. I wrote a small program to add rows to an access table. the program goes thru the motions but the data never gets there. here is my code. I am intentionaly not using...
11
by: Michael | last post by:
I'm new to PHP, I already learned the basics of the language and built some little app's for practice. I have a critical dilemma, soon enough, I probably start to develop real-world...
1
by: Erik Nodland | last post by:
Hi Everyone, Just after some ideas and suggestions on how to do this. I have a large amount of numeric data which I would like to group given a distance as a parameter. IE. If my dataset was...
8
by: Slaunger | last post by:
Hi all, I am a Python novice, and I have run into a problem in a project I am working on, which boils down to identifying the patterns in a sequence of integers, for example ..... 1 6 6 1 6 6...
1
by: CloudSolutions | last post by:
Introduction: For many beginners and individual users, requiring a credit card and email registration may pose a barrier when starting to use cloud servers. However, some cloud server providers now...
0
by: Faith0G | last post by:
I am starting a new it consulting business and it's been a while since I setup a new website. Is wordpress still the best web based software for hosting a 5 page website? The webpages will be...
0
by: ryjfgjl | last post by:
In our work, we often need to import Excel data into databases (such as MySQL, SQL Server, Oracle) for data analysis and processing. Usually, we use database tools like Navicat or the Excel import...
0
by: taylorcarr | last post by:
A Canon printer is a smart device known for being advanced, efficient, and reliable. It is designed for home, office, and hybrid workspace use and can also be used for a variety of purposes. However,...
0
by: Charles Arthur | last post by:
How do i turn on java script on a villaon, callus and itel keypad mobile phone
0
by: ryjfgjl | last post by:
If we have dozens or hundreds of excel to import into the database, if we use the excel import function provided by database editors such as navicat, it will be extremely tedious and time-consuming...
0
by: ryjfgjl | last post by:
In our work, we often receive Excel tables with data in the same format. If we want to analyze these data, it can be difficult to analyze them because the data is spread across multiple Excel files...
0
by: emmanuelkatto | last post by:
Hi All, I am Emmanuel katto from Uganda. I want to ask what challenges you've faced while migrating a website to cloud. Please let me know. Thanks! Emmanuel
0
by: Hystou | last post by:
There are some requirements for setting up RAID: 1. The motherboard and BIOS support RAID configuration. 2. The motherboard has 2 or more available SATA protocol SSD/HDD slots (including MSATA, M.2...

By using Bytes.com and it's services, you agree to our Privacy Policy and Terms of Use.

To disable or enable advertisements and analytics tracking please visit the manage ads & tracking page.