Hi,
I was just helping a coworker optimize a query. He had two versions:
one which used UNION for each value for which he was tallying results
and another query which used GROUP BY. Here is an aproximation of what
they were:
Query #1:
---------
SELECT 12 AS [Row],
ISNULL(SUM(CASE WHEN T.my_date BETWEEN @week_start_dat e AND
DATEADD(d, 1, @week_start_dat e) THEN 1 ELSE 0 END), 0) AS [Monday],
ISNULL(SUM(CASE WHEN T.my_date BETWEEN DATEADD(d, 1,
@week_start_dat e) AND DATEADD(d, 2, @week_start_dat e) THEN 1 ELSE 0
END), 0) AS [Tuesday]
FROM My_Table T
INNER JOIN Another_Table T2 ON T2.col1 = T.col1
WHERE T.my_date BETWEEN @week_start_dat e AND @week_end_date
AND T.col2 = 5
UNION
SELECT 13 AS [Row],
ISNULL(SUM(CASE WHEN T.my_date BETWEEN @week_start_dat e AND
DATEADD(d, 1, @week_start_dat e) THEN 1 ELSE 0 END), 0) AS [Monday],
ISNULL(SUM(CASE WHEN T.my_date BETWEEN DATEADD(d, 1,
@week_start_dat e) AND DATEADD(d, 2, @week_start_dat e) THEN 1 ELSE 0
END), 0) AS [Tuesday]
FROM My_Table T
INNER JOIN Another_Table T2 ON T2.col1 = T.col1
WHERE T.my_date BETWEEN @week_start_dat e AND @week_end_date
AND T.col2 = 6
Query #2:
---------
SELECT R.row_num AS [Row],
ISNULL(SUM(CASE WHEN T.my_date BETWEEN @week_start_dat e AND
DATEADD(d, 1, @week_start_dat e) THEN 1 ELSE 0 END), 0) AS [Monday],
ISNULL(SUM(CASE WHEN T.my_date BETWEEN DATEADD(d, 1,
@week_start_dat e) AND DATEADD(d, 2, @week_start_dat e) THEN 1 ELSE 0
END), 0) AS [Tuesday]
FROM My_Table T
INNER JOIN Another_Table T2 ON T2.col1 = T.col1
INNER JOIN Report_Rows R ON R.col2 = T.col2
WHERE T.my_date BETWEEN @week_start_dat e AND @week_end_date
GROUP BY ALL R.row_num
ORDER BY R.row_num
The Report_Rows table in this case would have had two rows mapping row
12 to a column value of 5 and row 13 to a column value of 6. The
second query was performing horribly until I noticed the ALL keyword
in the GROUP BY, which I didn't think was necessary. When I removed
that it performed more like I expected it to perform.
Before I had noticed that I was scouring over the query plans and
couldn't figure out why in one instance the query optimizer chose to
join My_Table and Another_Table, yet when the ALL keyword was there it
chose to return all of the records from Another_Table (a rather large
table) and join it to the Report_Rows table before then joining to
My_Table, which had the date criteria in the WHERE clause.
So, if you've read this far without giving up...
1. Why would the ALL keyword cause this? I understand the
functionality of ALL, but I still don't see why that caused the
reordering of the joins.
2. (more importantly) Are there any good resources that you know of
that explain how the query optimizer choices its query paths? Do the
"Inside SQL Server" books go into that much detail? Any good online
resources?
Thanks!
-Tom. 3 2442
"Thomas R. Hummel" <to********@hot mail.com> wrote in message
news:a2******** *************** *@posting.googl e.com... Hi,
I was just helping a coworker optimize a query. He had two versions: one which used UNION for each value for which he was tallying results and another query which used GROUP BY. Here is an aproximation of what they were:
Query #1: --------- SELECT 12 AS [Row], ISNULL(SUM(CASE WHEN T.my_date BETWEEN @week_start_dat e AND DATEADD(d, 1, @week_start_dat e) THEN 1 ELSE 0 END), 0) AS [Monday], ISNULL(SUM(CASE WHEN T.my_date BETWEEN DATEADD(d, 1, @week_start_dat e) AND DATEADD(d, 2, @week_start_dat e) THEN 1 ELSE 0 END), 0) AS [Tuesday] FROM My_Table T INNER JOIN Another_Table T2 ON T2.col1 = T.col1 WHERE T.my_date BETWEEN @week_start_dat e AND @week_end_date AND T.col2 = 5 UNION SELECT 13 AS [Row], ISNULL(SUM(CASE WHEN T.my_date BETWEEN @week_start_dat e AND DATEADD(d, 1, @week_start_dat e) THEN 1 ELSE 0 END), 0) AS [Monday], ISNULL(SUM(CASE WHEN T.my_date BETWEEN DATEADD(d, 1, @week_start_dat e) AND DATEADD(d, 2, @week_start_dat e) THEN 1 ELSE 0 END), 0) AS [Tuesday] FROM My_Table T INNER JOIN Another_Table T2 ON T2.col1 = T.col1 WHERE T.my_date BETWEEN @week_start_dat e AND @week_end_date AND T.col2 = 6
Query #2: --------- SELECT R.row_num AS [Row], ISNULL(SUM(CASE WHEN T.my_date BETWEEN @week_start_dat e AND DATEADD(d, 1, @week_start_dat e) THEN 1 ELSE 0 END), 0) AS [Monday], ISNULL(SUM(CASE WHEN T.my_date BETWEEN DATEADD(d, 1, @week_start_dat e) AND DATEADD(d, 2, @week_start_dat e) THEN 1 ELSE 0 END), 0) AS [Tuesday] FROM My_Table T INNER JOIN Another_Table T2 ON T2.col1 = T.col1 INNER JOIN Report_Rows R ON R.col2 = T.col2 WHERE T.my_date BETWEEN @week_start_dat e AND @week_end_date GROUP BY ALL R.row_num ORDER BY R.row_num
The Report_Rows table in this case would have had two rows mapping row 12 to a column value of 5 and row 13 to a column value of 6. The second query was performing horribly until I noticed the ALL keyword in the GROUP BY, which I didn't think was necessary. When I removed that it performed more like I expected it to perform.
Before I had noticed that I was scouring over the query plans and couldn't figure out why in one instance the query optimizer chose to join My_Table and Another_Table, yet when the ALL keyword was there it chose to return all of the records from Another_Table (a rather large table) and join it to the Report_Rows table before then joining to My_Table, which had the date criteria in the WHERE clause.
So, if you've read this far without giving up...
1. Why would the ALL keyword cause this? I understand the functionality of ALL, but I still don't see why that caused the reordering of the joins.
2. (more importantly) Are there any good resources that you know of that explain how the query optimizer choices its query paths? Do the "Inside SQL Server" books go into that much detail? Any good online resources?
Thanks! -Tom.
It's almost impossible (at least for me) to know why the optimizer chose a
particular plan without knowing the table structures, indexes and amount of
data, and even with that knowledge, it may not be clear at all. So I can't
say much about your first question, but I can definitely recommend Inside
SQL Server 2000 for a great explanation of what the optimizer considers when
it produces a query plan. There's a lot of detail, including how to go about
using query plans to tune individual queries. Another useful book is
Advanced Transact SQL for SQL Server 2000, which also explains many of the
examples with reference to their query plans.
Simon
Thomas R. Hummel (to********@hot mail.com) writes: Before I had noticed that I was scouring over the query plans and couldn't figure out why in one instance the query optimizer chose to join My_Table and Another_Table, yet when the ALL keyword was there it chose to return all of the records from Another_Table (a rather large table) and join it to the Report_Rows table before then joining to My_Table, which had the date criteria in the WHERE clause.
I can only echo Simon's reply that without table definitions etc, this
is difficult to tell. In fact, even with all information available,
this might be difficult to tell. Understanding the output of a cost-
based optimizer is by no means an easy task.
2. (more importantly) Are there any good resources that you know of that explain how the query optimizer choices its query paths? Do the "Inside SQL Server" books go into that much detail? Any good online resources?
Certainly, you learn a great deal from Kalen's book. But I also like to
add that that experience counts a lot too. And some creative thinking.
The basic thing to understand is why a table scan may be better than
an index seek. This is something which also can be extended to joins.
That is a scan + merge/hash join may be faser than seek + loop join.
But then there are all such wild things which includes parallelism that
I find myself understanding only fragments of.
--
Erland Sommarskog, SQL Server MVP, so****@algonet. se
Books Online for SQL Server SP3 at http://www.microsoft.com/sql/techinf...2000/books.asp
Thank you both for the input. I had tried to duplicate the effect with
test tables, but as you know, the query optimizer takes a lot into
account and I couldn't find an example that would be practical for
posting here.
I will give the two books that Simon suggested a more thorough read.
I've seen adverts for Kalen's online webinars as well, so perhaps I'll
look into those. But then there are all such wild things which includes parallelism that I find myself understanding only fragments of.
I hate to think of something that is complex enough that you have
trouble understanding it Erland... ;-)
Thanks again!
-Tom. This thread has been closed and replies have been disabled. Please start a new discussion. Similar topics |
by: Paul Mateer |
last post by:
Hi,
I have been running some queries against a table in a my database and
have noted an odd (at least it seems odd to me) performance issue.
The table has approximately 5 million rows and includes the following
columns:
DocID (INTEGER, PRIMARY KEY, CLUSTERED)
IsRecord (INTEGER, NONCLUSTERED)
|
by: Alex Satrapa |
last post by:
I have a table from which I'm trying to extract certain information. For
historical reasons, we archive every action on a particular thing
('thing' is identified, funnily enough, by 'id'). So the only way to
find out the current state of a particular combination of attributes is
to "select distinct on (id, ...) ... order by date desc".
In the examples below, I've taken real output from psql and done a
global search/replace on various...
|
by: sql-db2-dba |
last post by:
We have DB2 UDB v8.1 fixpak3 on AIX 5. Production and Development
configuarations (at least for DB2) are identical albeit production is
a 2-way server while development has only one processor. Tables and
indexes have the same schema. In fact, the dev database was taken from
a prod backup recently. Size of the tables differ slightly. Yet, on a
given query (with 4 tables joined), it took 30-50 times longer to run
in prod than on development....
|
by: Ryan |
last post by:
I came across a situation that I've been unable to explain and was
hoping somebody had an answer:
I had written an update query which was taking about 8 seconds to run
and considered it too slow. I copied the SQL statement from the query
and tried executing it from code which then ran in 1 second. To make
sure that I didn't miss anything, I copied the SQL statement back into
a query and tried running it again. It now also only took 1...
|
by: stig |
last post by:
hi.
coming from postgresql, i am used to textual references to most of the
things i do with the database. i feel a little lost with all the graphical.
i have few questions regarding MS SQL 2000
1. what is the best (or easiest) way of getting a table definition in text?
it could be either a CREATE TABLE sql-query or a just a definition,
something like:
TABLE thisTable
id integer
| |
by: walterbyrd |
last post by:
Way back when, I got a lot of training and experience in highly
structued software development. These days, I dabble with
web-development, but I may become more serious.
I consider php to be an abombination, the backward compatibility issues
alone are reason enough to make me hate it. Rail looks promising, but
it's difficult to find inexpensive hosting that supports rails.
I like python much better, but I'm not certain it's as well...
|
by: Hemant Shah |
last post by:
Folks,
I am having problem with an application that uses static SQL,
the application basically browses through the table given start and
end key most of the time it is processed from begining to end.
The db2expln tells me that there is no Data or Index prefetch.
I am running DB2 UDB 8 on AIX 5.3, and I am using DMS tablespace on
raw logical volumes on a SAN.
|
by: uwcssa |
last post by:
i have two questions:
1. A query plan only shows estimated cost and size at each operator.
is it possible to show the actual cost/cardinality of each plan
operator after running the query?
2. I created user-defined MQT with "enable optimization" option, and
bring it out of integrity pending state, however, I found the query
optimizer will never use this MQT for query processing. Is there any
reason for it? (how shall i debug)?
|
by: menkenk |
last post by:
Hello,
I have a query that I used to calculate the monthly, quarterly, semi-annual, annual commissions by agent. Below is the SQL view of this Query.
SELECT ., .Plan, .Placed, .Monthly, (-7.65)* AS , .Quarterly, (-22.53)* AS , ., (-44.2)* AS , .Annual, (-85)* AS , .CTP, (*) AS
FROM INNER JOIN ON .AgentID = .Agent
WHERE (((Format())=) AND ((Format(,"mm/yyyy")) Between And ));
The issue I have is that under the PLAN field, we have a UL...
|
by: marktang |
last post by:
ONU (Optical Network Unit) is one of the key components for providing high-speed Internet services. Its primary function is to act as an endpoint device located at the user's premises. However, people are often confused as to whether an ONU can Work As a Router. In this blog post, we’ll explore What is ONU, What Is Router, ONU & Router’s main usage, and What is the difference between ONU and Router. Let’s take a closer look !
Part I. Meaning of...
|
by: Hystou |
last post by:
Most computers default to English, but sometimes we require a different language, especially when relocating. Forgot to request a specific language before your computer shipped? No problem! You can effortlessly switch the default language on Windows 10 without reinstalling. I'll walk you through it.
First, let's disable language synchronization. With a Microsoft account, language settings sync across devices. To prevent any complications,...
| |
by: jinu1996 |
last post by:
In today's digital age, having a compelling online presence is paramount for businesses aiming to thrive in a competitive landscape. At the heart of this digital strategy lies an intricately woven tapestry of website design and digital marketing. It's not merely about having a website; it's about crafting an immersive digital experience that captivates audiences and drives business growth.
The Art of Business Website Design
Your website is...
|
by: Hystou |
last post by:
Overview:
Windows 11 and 10 have less user interface control over operating system update behaviour than previous versions of Windows. In Windows 11 and 10, there is no way to turn off the Windows Update option using the Control Panel or Settings app; it automatically checks for updates and installs any it finds, whether you like it or not. For most users, this new feature is actually very convenient. If you want to control the update process,...
|
by: tracyyun |
last post by:
Dear forum friends,
With the development of smart home technology, a variety of wireless communication protocols have appeared on the market, such as Zigbee, Z-Wave, Wi-Fi, Bluetooth, etc. Each protocol has its own unique characteristics and advantages, but as a user who is planning to build a smart home system, I am a bit confused by the choice of these technologies. I'm particularly interested in Zigbee because I've heard it does some...
|
by: agi2029 |
last post by:
Let's talk about the concept of autonomous AI software engineers and no-code agents. These AIs are designed to manage the entire lifecycle of a software development project—planning, coding, testing, and deployment—without human intervention. Imagine an AI that can take a project description, break it down, write the code, debug it, and then launch it, all on its own....
Now, this would greatly impact the work of software developers. The idea...
|
by: isladogs |
last post by:
The next Access Europe User Group meeting will be on Wednesday 1 May 2024 starting at 18:00 UK time (6PM UTC+1) and finishing by 19:30 (7.30PM).
In this session, we are pleased to welcome a new presenter, Adolph Dupré who will be discussing some powerful techniques for using class modules.
He will explain when you may want to use classes instead of User Defined Types (UDT). For example, to manage the data in unbound forms.
Adolph will...
|
by: TSSRALBI |
last post by:
Hello
I'm a network technician in training and I need your help.
I am currently learning how to create and manage the different types of VPNs and I have a question about LAN-to-LAN VPNs.
The last exercise I practiced was to create a LAN-to-LAN VPN between two Pfsense firewalls, by using IPSEC protocols.
I succeeded, with both firewalls in the same network. But I'm wondering if it's possible to do the same thing, with 2 Pfsense firewalls...
| |
by: muto222 |
last post by:
How can i add a mobile payment intergratation into php mysql website.
| |