More SQL - wmich.edu · More SQL Extended Relational Algebra Outerjoins, Grouping/Aggregation ......

18
7/30/18 1 1 More SQL Extended Relational Algebra Outerjoins, Grouping/Aggregation Database Modifications: Insert/Delete/Update Constraints, Triggers 2 The Extended Algebra δ = eliminate duplicates from bags. τ = sort tuples. γ = grouping and aggregation. Outerjoin : avoids “dangling tuples” = tuples that do not join with anything. 3 Duplicate Elimination § R1 := δ(R2). § R1 consists of one copy of each tuple that appears in R2 one or more times.

Transcript of More SQL - wmich.edu · More SQL Extended Relational Algebra Outerjoins, Grouping/Aggregation ......

Page 1: More SQL - wmich.edu · More SQL Extended Relational Algebra Outerjoins, Grouping/Aggregation ... oLis a list of some of the attributes of R2. §R1 is the list of tuples of R2 sorted

7/30/18

1

1

More SQL

Extended Relational AlgebraOuterjoins, Grouping/Aggregation

Database Modifications: Insert/Delete/UpdateConstraints, Triggers

2

The Extended Algebra

δ = eliminate duplicates from bags.τ = sort tuples.γ = grouping and aggregation.Outerjoin : avoids “dangling tuples” = tuples

that do not join with anything.

3

Duplicate Elimination

§ R1 := δ(R2).§ R1 consists of one copy of each tuple

that appears in R2 one or more times.

Page 2: More SQL - wmich.edu · More SQL Extended Relational Algebra Outerjoins, Grouping/Aggregation ... oLis a list of some of the attributes of R2. §R1 is the list of tuples of R2 sorted

7/30/18

2

4

Sorting§ R1 := τL (R2).

o L is a list of some of the attributes of R2.§ R1 is the list of tuples of R2 sorted first on

the value of the first attribute on L, then on the second attribute of L, and so on.o Break ties arbitrarily.

§ τ is the only operator whose result is neither a set nor a bag.

5

Aggregation Operators

§ Aggregation operators are not operators of relational algebra.

§ Rather, they apply to entire columns of a table and produce a single result.

§ The most important examples: SUM, AVG, COUNT, MIN, and MAX.

6

Example: Aggregation

R = ( A B )1 33 43 2

SUM(A) = 7COUNT(A) = 3MAX(B) = 4AVG(B) = 3

Page 3: More SQL - wmich.edu · More SQL Extended Relational Algebra Outerjoins, Grouping/Aggregation ... oLis a list of some of the attributes of R2. §R1 is the list of tuples of R2 sorted

7/30/18

3

7

Grouping Operator

§ R1 := γL (R2). L is a list of elements that are either:

1. Individual (grouping ) attributes.2. AGG(A ), where AGG is one of the

aggregation operators and A is an attribute.• An arrow and a new attribute name renames

the component.

8

Applying γL(R)§ Group R according to all the grouping

attributes on list L.o That is: form one group for each distinct list

of values for those attributes in R.§ Within each group, compute AGG(A ) for

each aggregation on list L.§ Result has one tuple for each group:

1. The grouping attributes and2. Their group’s aggregations.

9

Example: Grouping/Aggregation

R = ( A B C )1 2 34 5 61 2 5

γA,B,AVG(C)->X (R) = ??First, group R by A and B :

A B C1 2 31 2 54 5 6

Then, average Cwithin groups:

A B X1 2 44 5 6

Page 4: More SQL - wmich.edu · More SQL Extended Relational Algebra Outerjoins, Grouping/Aggregation ... oLis a list of some of the attributes of R2. §R1 is the list of tuples of R2 sorted

7/30/18

4

10

Outerjoin

§ Suppose we join R⋈C S.§ A tuple of R that has no tuple of S with

which it joins is said to be dangling.o Similarly for a tuple of S.

§ Outerjoin preserves dangling tuples by padding them NULL.

11

Example: Outerjoin

R = ( A B ) S = ( B C )

1 2 2 3

4 5 6 7

(1,2) joins with (2,3), but the other two tuples

are dangling.

R OUTERJOIN S = A B C

1 2 3

4 5 NULL

NULL 6 7

12

Now --- Back to SQL

Each Operation Has a SQL Equivalent

Page 5: More SQL - wmich.edu · More SQL Extended Relational Algebra Outerjoins, Grouping/Aggregation ... oLis a list of some of the attributes of R2. §R1 is the list of tuples of R2 sorted

7/30/18

5

13

Outerjoins§ R OUTER JOIN S is the core of an

outerjoin expression. It is modified by:1. Optional NATURAL in front of OUTER.2. Optional ON <condition> after JOIN.3. Optional LEFT, RIGHT, or FULL before

OUTER.◆ LEFT = pad dangling tuples of R only.◆ RIGHT = pad dangling tuples of S only.◆ FULL = pad both; this choice is the default.

Only oneof these

14

Aggregations

§ SUM, AVG, COUNT, MIN, and MAX can be applied to a column in a SELECT clause to produce that aggregation on the column.

§ Also, COUNT(*) counts the number of tuples.

15

Example: Aggregation

§ From Sells(bar, beer, price), find the average price of Bud:

SELECT AVG(price)FROM Sells

WHERE beer = ’Bud’;

Page 6: More SQL - wmich.edu · More SQL Extended Relational Algebra Outerjoins, Grouping/Aggregation ... oLis a list of some of the attributes of R2. §R1 is the list of tuples of R2 sorted

7/30/18

6

16

Eliminating Duplicates in an Aggregation

§ Use DISTINCT inside an aggregation.§ Example: find the number of different

prices charged for Bud:SELECT COUNT(DISTINCT price)FROM Sells

WHERE beer = ’Bud’;

17

NULL’s Ignored in Aggregation

§ NULL never contributes to a sum, average, or count, and can never be the minimum or maximum of a column.

§ But if there are no non-NULL values in a column, then the result of the aggregation is NULL.o Exception: COUNT of an empty set is 0.

18

Example: Effect of NULL’s

SELECT count(*)FROM SellsWHERE beer = ’Bud’;

SELECT count(price)FROM SellsWHERE beer = ’Bud’;

The number of barsthat sell Bud.

The number of barsthat sell Bud at aknown price.

Sells(bar, beer, price)

Page 7: More SQL - wmich.edu · More SQL Extended Relational Algebra Outerjoins, Grouping/Aggregation ... oLis a list of some of the attributes of R2. §R1 is the list of tuples of R2 sorted

7/30/18

7

19

Grouping

§ We may follow a SELECT-FROM-WHERE expression by GROUP BY and a list of attributes.

§ The relation that results from the SELECT-FROM-WHERE is grouped according to the values of all those attributes, and any aggregation is applied only within each group.

20

Example: Grouping

§ From Sells(bar, beer, price), find the average price for each beer:

SELECT beer, AVG(price)FROM SellsGROUP BY beer;

beer AVG(price)Bud 2.33… …

21

Example: Grouping§ From Sells(bar, beer, price) and

Frequents(drinker, bar), find for each drinker the average price of Bud at the bars they frequent:

SELECT drinker, AVG(price)FROM Frequents, SellsWHERE beer = ’Bud’ AND

Frequents.bar = Sells.barGROUP BY drinker;

Compute alldrinker-bar-price triplesfor Bud.Then groupthem bydrinker.

Page 8: More SQL - wmich.edu · More SQL Extended Relational Algebra Outerjoins, Grouping/Aggregation ... oLis a list of some of the attributes of R2. §R1 is the list of tuples of R2 sorted

7/30/18

8

22

Restriction on SELECT Lists With Aggregation

§ If any aggregation is used, then each element of the SELECT list must be either:

1. Aggregated, or2. An attribute on the GROUP BY list.

23

Illegal Query Example

§ You might think you could find the bar

that sells Bud the cheapest by:

SELECT bar, MIN(price)

FROM Sells

WHERE beer = ’Bud’;

§ But this query is illegal in SQL.

24

HAVING Clauses

§ HAVING <condition> may follow a GROUP BY clause.

§ If so, the condition applies to each group, and groups not satisfying the condition are eliminated.

Page 9: More SQL - wmich.edu · More SQL Extended Relational Algebra Outerjoins, Grouping/Aggregation ... oLis a list of some of the attributes of R2. §R1 is the list of tuples of R2 sorted

7/30/18

9

25

Example: HAVING

§ From Sells(bar, beer, price) and Beers(name, manf), find the average price of those beers that are either served in at least three bars or are manufactured by Pete’s.

26

Solution

SELECT beer, AVG(price)

FROM Sells

GROUP BY beer

HAVING COUNT(bar) >= 3 OR

beer IN (SELECT name

FROM Beers

WHERE manf = ’Pete’’s’);

Beers manu-factured byPete’s.

Beer groups with at least3 non-NULL bars and alsobeer groups where themanufacturer is Pete’s.

find the average price of those beers that are either served in at least three bars or are manufactured by Pete’s.

27

Requirements on HAVING Conditions

§ Anything goes in a subquery.§ Outside subqueries, they may refer to

attributes only if they are either:1. A grouping attribute, or2. Aggregated(same condition as for SELECT clauses with aggregation).

Page 10: More SQL - wmich.edu · More SQL Extended Relational Algebra Outerjoins, Grouping/Aggregation ... oLis a list of some of the attributes of R2. §R1 is the list of tuples of R2 sorted

7/30/18

10

28

Database Modifications

§ A modification command does not return a result (as a query does), but changes the database in some way.

§ Three kinds of modifications:1. Insert a tuple or tuples.2. Delete a tuple or tuples.3. Update the value(s) of an existing tuple

or tuples.

29

Insertion

§ To insert a single tuple:INSERT INTO <relation>VALUES ( <list of values> );

§ Example: add to Likes(drinker, beer)the fact that Sally likes Bud.

INSERT INTO LikesVALUES(’Sally’, ’Bud’);

30

Specifying Attributes in INSERT

§ We may add to the relation name a list of attributes.

§ Two reasons to do so:1. We forget the standard order of attributes for

the relation.2. We don’t have values for all attributes, and

we want the system to fill in missing components with NULL or a default value.

Page 11: More SQL - wmich.edu · More SQL Extended Relational Algebra Outerjoins, Grouping/Aggregation ... oLis a list of some of the attributes of R2. §R1 is the list of tuples of R2 sorted

7/30/18

11

31

Example: Specifying Attributes

§ Another way to add the fact that Sally likes Bud to Likes(drinker, beer):

INSERT INTO Likes(beer, drinker)VALUES(’Bud’, ’Sally’);

32

Adding Default Values

§ In a CREATE TABLE statement, we can follow an attribute by DEFAULT and a value.

§ When an inserted tuple has no value for that attribute, the default will be used.

33

Example: Default ValuesCREATE TABLE Drinkers (

name CHAR(30) PRIMARY KEY,addr CHAR(50)

DEFAULT ’123 Sesame St.’,phone CHAR(16)

);

Page 12: More SQL - wmich.edu · More SQL Extended Relational Algebra Outerjoins, Grouping/Aggregation ... oLis a list of some of the attributes of R2. §R1 is the list of tuples of R2 sorted

7/30/18

12

34

Example: Default ValuesINSERT INTO Drinkers(name)VALUES(’Sally’);

Resulting tuple:

Sally 123 Sesame St NULLname address phone

35

Inserting Many Tuples

§ We may insert the entire result of a query into a relation, using the form:

INSERT INTO <relation>( <subquery> );

36

Example: Insert a Subquery

§ Using Frequents(drinker, bar), enter into the new relation PotBuddies(name)all of Sally’s “potential buddies,” i.e., those drinkers who frequent at least one bar that Sally also frequents.

Page 13: More SQL - wmich.edu · More SQL Extended Relational Algebra Outerjoins, Grouping/Aggregation ... oLis a list of some of the attributes of R2. §R1 is the list of tuples of R2 sorted

7/30/18

13

37

Solution

INSERT INTO PotBuddies(SELECT d2.drinker

FROM Frequents d1, Frequents d2

WHERE d1.drinker = ’Sally’ AND

d2.drinker <> ’Sally’ AND

d1.bar = d2.bar);

Pairs of Drinkertuples where thefirst is for Sally,the second is forsomeone else,and the bars arethe same.

The otherdrinker

Using Frequents(drinker, bar), enter into the new relation PotBuddies(name) all of Sally’s “potential buddies,” i.e., those drinkers who frequent at least one bar that Sally also frequents.

38

Deletion

§ To delete tuples satisfying a condition from some relation:

DELETE FROM <relation>WHERE <condition>;

39

Example: Deletion

§ Delete from Likes(drinker, beer) the fact that Sally likes Bud:

DELETE FROM LikesWHERE drinker = ’Sally’ AND

beer = ’Bud’;

Page 14: More SQL - wmich.edu · More SQL Extended Relational Algebra Outerjoins, Grouping/Aggregation ... oLis a list of some of the attributes of R2. §R1 is the list of tuples of R2 sorted

7/30/18

14

40

Example: Delete all Tuples

§ Make the relation Likes empty:

DELETE FROM Likes;

§ Note no WHERE clause needed.

41

Example: Delete Some Tuples§ Delete from Beers(name, manf) all

beers for which there is another beer by the same manufacturer.

DELETE FROM Beers bWHERE EXISTS (

SELECT name FROM BeersWHERE manf = b.manf AND

name <> b.name);

Beers with the samemanufacturer anda different namefrom the name ofthe beer representedby tuple b.

42

Semantics of Deletion --- (1)

§ Suppose Anheuser-Busch makes only Bud and Bud Lite.

§ Suppose we come to the tuple b for Bud first.

§ The subquery is nonempty, because of the Bud Lite tuple, so we delete Bud.

§ Now, when b is the tuple for Bud Lite, do we delete that tuple too?

Page 15: More SQL - wmich.edu · More SQL Extended Relational Algebra Outerjoins, Grouping/Aggregation ... oLis a list of some of the attributes of R2. §R1 is the list of tuples of R2 sorted

7/30/18

15

43

Semantics of Deletion --- (2)

§ Answer: we do delete Bud Lite as well.§ The reason is that deletion proceeds

in two stages:1. Mark all tuples for which the WHERE

condition is satisfied.2. Delete the marked tuples.

44

Updates

§ To change certain attributes in certain tuples of a relation:

UPDATE <relation>SET <list of attribute assignments>WHERE <condition on tuples>;

45

Example: Update

§ Change drinker Fred’s phone number to 555-1212:

UPDATE DrinkersSET phone = ’555-1212’WHERE name = ’Fred’;

Page 16: More SQL - wmich.edu · More SQL Extended Relational Algebra Outerjoins, Grouping/Aggregation ... oLis a list of some of the attributes of R2. §R1 is the list of tuples of R2 sorted

7/30/18

16

46

Example: Update Several Tuples

§ Make $4 the maximum price for beer:

UPDATE SellsSET price = 4.00WHERE price > 4.00;

Integrity Constraints: IC (Review)

§ An IC describes conditions that every legal instance of a relation must satisfy.o Inserts/deletes/updates that violate IC’s are

disallowed.o Can be used to ensure application semantics

(e.g., sid is a key), or prevent inconsistencies (e.g., sname has to be a string, age must be < 200)

§ Types of IC’s: Domain constraints, primary key constraints, foreign key constraints, general constraints.

General Constraints

◆ Useful when more general ICs than keys are involved.

◆ Can use queries to express constraint.

◆ Constraints can be named.

CREATE TABLE Sailors( sid INTEGER,sname CHAR(10),rating INTEGER,age REAL,PRIMARY KEY (sid),CHECK ( rating >= 1

AND rating <= 10 )CREATE TABLE Reserves

( sname CHAR(10),bid INTEGER,day DATE,PRIMARY KEY (bid,day),CONSTRAINT noInterlakeResCHECK (`Interlake’ <>

( SELECT B.bnameFROM Boats BWHERE B.bid=bid)))

Page 17: More SQL - wmich.edu · More SQL Extended Relational Algebra Outerjoins, Grouping/Aggregation ... oLis a list of some of the attributes of R2. §R1 is the list of tuples of R2 sorted

7/30/18

17

Constraints Over Multiple RelationsCREATE TABLE Sailors

( sid INTEGER,sname CHAR(10),rating INTEGER,age REAL,PRIMARY KEY (sid),CHECK( (SELECT COUNT (S.sid) FROM Sailors S)+ (SELECT COUNT (B.bid) FROM Boats B) < 100 )

◆ Awkward and wrong!

◆ If Sailors is empty, the number of Boats tuples can be anything!

◆ ASSERTION is the right solution; not associated with either table.

CREATE ASSERTION smallClubCHECK( (SELECT COUNT (S.sid) FROM Sailors S)+ (SELECT COUNT (B.bid) FROM Boats B) < 100 )

Number of boatsplus number of sailors is < 100

Triggers

§ Trigger: procedure that starts automatically if specified changes occur to the DBMS

§ Three parts:o Event (activates the trigger)o Condition (tests whether the triggers

should run)o Action (what happens if the trigger runs)

Triggers: Example (SQL:1999)CREATE TRIGGER youngSailorUpdate

AFTER INSERT ON SAILORSREFERENCING NEW TABLE NewSailorsFOR EACH STATEMENT

INSERTINTO YoungSailors(sid, name, age, rating)SELECT sid, name, age, ratingFROM NewSailors NWHERE N.age <= 18

Page 18: More SQL - wmich.edu · More SQL Extended Relational Algebra Outerjoins, Grouping/Aggregation ... oLis a list of some of the attributes of R2. §R1 is the list of tuples of R2 sorted

7/30/18

18

Summary§ SQL was an important factor in the early acceptance

of the relational model; more natural than earlier, procedural query languages.

§ Relationally complete; in fact, significantly more expressive power than relational algebra.

§ Even queries that can be expressed in RA can often be expressed more naturally in SQL.

§ Many alternative ways to write a query; optimizer should look for most efficient evaluation plan.o In practice, users need to be aware of how

queries are optimized and evaluated for best results.

Summary (Contd.)§ NULL for unknown field values brings

many complications§ SQL allows specification of rich integrity

constraints§ Triggers respond to changes in the

database