Copyright © 2002 W3C® (MIT, INRIA, Keio), All Rights Reserved. W3C liability, trademark, document use, and software licensing rules apply.
XML is a versatile markup language, capable of labeling the information content of diverse data sources including structured and semi-structured documents, relational databases, and object repositories. A query language that uses the structure of XML intelligently can express queries across all these kinds of data, whether physically stored in XML or viewed as XML via middleware. This specification describes a query language called XQuery, which is designed to be broadly applicable across many types of XML data sources.
This is a public W3C Working Draft for review by W3C Members and other interested parties. This section describes the status of this document at the time of its publication. It is a draft document and may be updated, replaced, or made obsolete by other documents at any time. It is inappropriate to use W3C Working Drafts as reference material or to cite them as other than "work in progress." A list of current public W3C technical reports can be found at http://www.w3.org/TR/.
Much of this document is the result of joint work by the XML Query and XSL Working Groups, which are jointly responsible for XPath 2.0, a language derived from both XPath 1.0 and XQuery. The XPath 2.0 and XQuery 1.0 Working Drafts are generated from a common source. These languages are closely related, sharing much of the same expression syntax and semantics, and much of the text found in the two Working Drafts is identical.
This version of the document contains a new approach to backward compatibility with XPath Version 1.0, and new, more liberal rules for casting values to target types. Rules for matching values to types are now based strictly on type and element names rather than on structural subsumption. The sort by
expression has been eliminated and in its place a new order by
clause has been added to the FLWR expression (and public feedback on this change is invited). Several small changes have been made to the grammar in order to eliminate the need for reserved keywords. More detailed material has been included on error handling and optimization. A complete list of changes can be found in F Revision
Log. Public feedback is invited on the open issues listed in this document, in particular on Issues 327 and 335.
Under consideration for a future version of this document is a proposal for XQuery to support default validation of element constructors. It is also proposed that users should be able to specify, for any expression, whether all occurrences of validation (either explicit or implicit) within that expression should be interpreted as referring to lax
, strict
, or skip
validation.
This document is a work in progress. It contains many open issues, and should not be considered to be fully stable. Vendors who wish to create preview implementations based on this document do so at their own risk. While this document reflects the general consensus of the working groups, there are still controversial areas that may be subject to change.
Public comments on this document and its open issues are welcome. Comments should be sent to the W3C XPath/XQuery mailing list, public-qt-comments@w3.org (archived at http://lists.w3.org/Archives/Public/public-qt-comments/).
XQuery 1.0 has been defined jointly by the XML Query Working Group (part of the XML Activity) and the XSL Working Group (part of the Style Activity).
Patent disclosures relevant to this specification may be found on the XML Query Working Group's patent disclosure page at http://www.w3.org/2002/08/xmlquery-IPR-statements and the XSL Working Group's patent disclosure page at http://www.w3.org/Style/XSL/Disclosures.
1 Introduction
2 Basics
2.1 Expression Context
2.1.1 Static Context
2.1.2 Evaluation Context
2.2 Input Functions
2.3 Expression Processing
2.3.1 Document Order
2.3.2 Typed Value and String Value
2.4 Types
2.4.1 Type Checking
2.4.2 SequenceType
2.4.2.1 SequenceType Matching
2.4.3 Type Conversions
2.4.3.1 Atomization
2.4.3.2 Effective Boolean Value
2.5 Variable Bindings
2.6 Errors and Conformance
2.6.1 Errors
2.6.2 Conformance
2.6.2.1 Basic XQuery
2.6.2.2 Schema Import Feature
2.6.2.3 Static Typing Feature
2.6.3 Handling Dynamic Errors
2.6.4 Errors and Optimization
3 Expressions
3.1 Primary Expressions
3.1.1 Literals
3.1.2 Variables
3.1.3 Parenthesized Expressions
3.1.4 Function Calls
3.1.5 Comments
3.2 Path Expressions
3.2.1 Steps
3.2.1.1 Axes
3.2.1.2 Node Tests
3.2.2 Predicates
3.2.3 Unabbreviated Syntax
3.2.4 Abbreviated Syntax
3.3 Sequence Expressions
3.3.1 Constructing Sequences
3.3.2 Combining Sequences
3.4 Arithmetic Expressions
3.5 Comparison Expressions
3.5.1 Value Comparisons
3.5.2 General Comparisons
3.5.3 Node Comparisons
3.5.4 Order Comparisons
3.6 Logical Expressions
3.7 Constructors
3.7.1 Element Constructors
3.7.2 Computed Constructors
3.7.3 Whitespace in Constructors
3.7.4 Data Model Representation
3.7.4.1 Constructed Element Nodes
3.7.4.2 Constructed Attribute Nodes
3.7.4.3 Constructed Document Nodes
3.7.4.4 Constructed Text Nodes
3.7.5 Other Constructors and Comments
3.8 FLWOR Expressions
3.8.1 For and Let Clauses
3.8.2 Where Clause
3.8.3 Order By and Return Clauses
3.8.4 Example
3.9 Unordered Expressions
3.10 Conditional Expressions
3.11 Quantified Expressions
3.12 Expressions on SequenceTypes
3.12.1 Instance Of
3.12.2 Typeswitch
3.12.3 Cast
3.12.4 Castable
3.12.5 Constructor Functions
3.12.6 Treat
3.13 Validate Expressions
4 The Query Prolog
4.1 Namespace Declarations
4.2 Schema Imports
4.3 Xmlspace Declaration
4.4 Default Collation
4.5 Function Definitions
5 Example Applications
5.1 Joins
5.2 Grouping
5.3 Queries on Sequence
5.4 Recursive Transformations
A Grammar
A.1 Lexical structure
A.1.1 Syntactic Constructs
A.1.2 Lexical Rules
A.2 BNF
A.3 Reserved Function Names
A.4 Precedence Order
B Type Promotion and Operator Mapping
B.1 Type Promotion
B.2 Operator Mapping
C References
C.1 Normative References
C.2 Non-normative References
C.3 Background References
C.4 Informative Material
D Glossary
E XPath 2.0 and XQuery 1.0
Issues (Non-Normative)
F Revision
Log (Non-Normative)
F.1 15 Nov 2002
As increasing amounts of information are stored, exchanged, and presented using XML, the ability to intelligently query XML data sources becomes increasingly important. One of the great strengths of XML is its flexibility in representing many different kinds of information from diverse sources. To exploit this flexibility, an XML query language must provide features for retrieving and interpreting information from these diverse sources.
XQuery is designed to meet the requirements identified by the W3C XML Query Working Group [XML Query 1.0 Requirements] and the use cases in [XML Query Use Cases]. It is designed to be a language in which queries are concise and easily understood. It is also flexible enough to query a broad spectrum of XML information sources, including both databases and documents. The Query Working Group has identified a requirement for both a human-readable query syntax and an XML-based query syntax. XQuery is designed to meet the first of these requirements. XQuery is derived from an XML query language called Quilt [Quilt], which in turn borrowed features from several other languages, including XPath 1.0 [XPath 1.0], XQL [XQL], XML-QL [XML-QL], SQL [SQL], and OQL [ODMG].
XQuery Version 1.0 is an extension of XPath Version 2.0. Any expression that is syntactically valid and executes successfully in both XPath 2.0 and XQuery 1.0 will return the same result in both languages. Since these languages are so closely related, their grammars and language descriptions are generated from a common source to ensure consistency, and the editors of these specifications work together closely.
XQuery also depends on and is closely related to the following specifications:
The XQuery data model defines the information in an XML document that is available to an XQuery processor. The data model is defined in [XQuery 1.0 and XPath 2.0 Data Model].
The static and dynamic semantics of XQuery are formally defined in [XQuery 1.0 Formal Semantics]. This is done by mapping the full XQuery language into a "core" subset for which the semantics is defined. This document is useful for implementors and others who require a rigorous definition of XQuery.
XQuery's type system is based on [XML Schema]. Work is in progress to ensure that the type systems of XQuery, the XQuery Core, and XML Schema are completely aligned.
The library of functions and operators supported by XQuery is defined in [XQuery 1.0 and XPath 2.0 Functions and Operators].
One requirement in [XML Query 1.0 Requirements] is that an XML query language have both a human-readable syntax and an XML-based syntax. The XML-based syntax for XQuery is described in [XQueryX 1.0]. [Ed. Note: The current edition of [XQueryX 1.0] has not incorporated recent language changes; it will be made consistent with this document in its next edition.]
This document specifies a grammar for XQuery, using the same Basic EBNF notation used in [XML], except that grammar symbols always have initial capital letters. Unless otherwise noted (see A.1 Lexical structure), whitespace is not significant in the grammar. Grammar productions are introduced together with the features that they describe, and a complete grammar is also presented in the appendix [A Grammar].
In the grammar productions in this document, nonterminal symbols are underlined and literal text is enclosed in double quotes. Angle brackets are used to enclose tokens that must be recognized by using lexical look-ahead, as described in A.1 Lexical structure. For example, the following production describes the syntax of a function call:
[81] | FunctionCall | ::= | <QName "("> (Expr ("," Expr)*)? ")" |
The production should be read as follows: A function call consists of a QName followed by an open-parenthesis (these tokens must be recognized together using lexical lookahead.) The open-parenthesis is followed by an optional argument list. The argument list (if present) consists of one or more expressions, separated by commas. The optional argument list is followed by a close-parenthesis.
[Ed. Note: A future version of this document will include links between terms (in bold font) and their definitions.]
The basic building block of XQuery is the expression. The language provides several kinds of expressions which may be constructed from keywords, symbols, and operands. In general, the operands of an expression are other expressions. XQuery is a functional language which allows various kinds of expressions to be nested with full generality. It is also a strongly-typed language in which the operands of various expressions, operators, and functions must conform to designated types.
Like XML, XQuery is a case-sensitive language. All keywords in XQuery use lower-case characters.
The value of an expression is always a sequence, which is an ordered collection of zero or more items. An
item is either an atomic value or a node. An atomic
value is a value in the value space of an XML Schema atomic
type, as defined in [XML Schema] (that is, a simple type that is
not a list type or a union type). A node conforms to one of the
seven node kinds described in [XQuery 1.0 and XPath 2.0 Data Model]. Each node has a unique node identity. Some
kinds of nodes have typed values, string values, and names, which can be
extracted from the node. The typed value of a node is a sequence
of zero or more atomic values. The string value of a node is a
value of type xs:string
. The name of a node is a value of type xs:QName
.
A sequence containing exactly one item is called a singleton sequence. An item is identical to a singleton sequence containing that item. Sequences are never nested--for example, combining the values 1, (2, 3), and ( ) into a single sequence results in the sequence (1, 2, 3). A sequence containing zero items is called an empty sequence.
In this document, the namespace prefixes xs:
and xsi:
are considered to be bound to the XML Schema namespaces http://www.w3.org/2001/XMLSchema
and http://www.w3.org/2001/XMLSchema-instance
, respectively (as described in [XML Schema]), and the prefix fn:
is considered to be bound to the namespace of XPath/XQuery functions, http://www.w3.org/2002/11/xquery-functions
(described in [XQuery 1.0 and XPath 2.0 Functions and Operators]). In some cases, where the meaning is clear and namespaces are not important to the discussion, built-in XML Schema typenames such as integer
and string
are used without a namespace prefix. Also, this document assumes that the default function namespace (see 4.1 Namespace Declarations) is set to the namespace of XPath/XQuery functions, so function names appearing without a namespace prefix can be assumed to be in this namespace.
The expression context for a given expression consists of all the information that can affect the result of the expression. This information is organized into two categories called the static context and the evaluation context.
This section describes the context information used by XQuery expressions, including the functions in the core function library. Other functions, outside the core function library, may require additional context information.
The static context of an expression is the information that is available during static analysis of the expression, prior to its evaluation. This information can be used to decide whether the expression contains a static error.
In XQuery, the information in the static context is provided by declarations in the Query Prolog (except as noted below). Static context consists of the following components:
In-scope namespaces. This is a set of (prefix, URI) pairs. The in-scope namespaces are used for resolving prefixes used in QNames within the expression.
Default namespace for element and type names. This is a namespace URI. This namespace is used for any unprefixed QName appearing in a position where an element or type name is expected.
Default namespace for function names. This is a namespace URI. This namespace is used for any unprefixed QName appearing as the function name in a function call.
In-scope schema definitions. This is a set of (QName, type definition) pairs. It defines the set of types that are available for reference within the expression. It includes the built-in schema types and all globally-declared types in imported schemas. It may also include types declared in schemas associated with documents retrieved by input functions, as described in 2.2 Input Functions.
Ed. Note: The importing of type definitions from input documents is still under discussion. The idea that the static context should be affected by run-time functions in an implementation-defined way remains controversial (see Issue 307.)
In-scope variables. This is a set of (QName, type) pairs. It defines the set of variables that have been declared and are available for reference within the expression. The QName represents the name of the variable, and the type represents its static data type.
Unlike the other parts of the static context, variable types are not declared in the Query Prolog. Instead, they are derived from static analysis of the expressions in which the variables are bound. In-scope variable definitions may also be provided by the environment external to a query. (See Issue 307.)
In-scope functions. This part of the static context defines the set of functions that are available to be called from within an expression. Each function is uniquely identified by its QName and its arity (number of parameters). The static context maps QName and arity into a function signature, which specifies the static types of the function parameters and function result.
For each atomic type in the in-scope schema definitions, there is a constructor function in the in-scope functions. Constructor functions are discussed in 3.12.5 Constructor Functions.
In-scope collations. This is a set of (URI, collation) pairs. It defines the names of the collations that are available for use in function calls that take a collation name as an argument. A collation may be regarded as an object that supports two functions: a function that given a set of strings, returns a sequence containing those strings in sorted order; and a function that given two strings, returns true if they are considered equal, and false if not.
Default collation. This is a collation. This collation is used by string comparison functions when no explicit collation is specified.
Base URI. This is an absolute URI, used by the fn:document
function when resolving the relative URI of a document to be loaded, if
no explicit base URI is supplied in the function call.
XQuery Version 1.0 includes XPath Version 2.0 as a subset. In addition to the static context items listed above, XPath 2.0 requires a static context item named XPath 1.0 compatibility mode. Since XQuery does not support this mode, it always sets this context item to false
when evaluating an XPath expression.
The evaluation context of an expression is defined as information that is available at the time the expression is evaluated. The evaluation context consists of all the components of the static context, and the additional components listed below.
The first three components of the dynamic context (context item, context position, and context size) are called the focus of the expression. The focus enables the processor to keep track of which nodes are being processed by the expression.
The focus for the outermost expression is supplied by the
environment in which the expression is evaluated. Certain language constructs,
notably the path expression E1/E2
and the predicate expression E1[E2]
, create a new focus for the evaluation of a sub-expression. In these constructs, E2
is evaluated once for each item in the sequence that results from
evaluating E1
. Each time E2
is evaluated, it is evaluated with a different focus. The focus for
evaluating E2
is referred to below as the inner focus, while the focus
for evaluating E1
is referred to as the outer focus. The inner focus exists
only while E2
is being evaluated. When this evaluation is complete, evaluation of the
containing expression continues with its original focus unchanged.
The context item is the item currently being
processed. An item is either an atomic value or a node. When the context item
is a node, it can also be referred to as the context node. The
context item is returned by the expression ".
". When an expression E1/E2
or E1[E2]
is evaluated, each item in the sequence obtained by evaluating E1
becomes the context item in the inner focus for an evaluation of E2
.
The context position is the position of the context
item within the sequence of items currently being processed. It changes
whenever the context item changes. Its value is always an integer greater than
zero. The context position is returned by the expression fn:position()
. When an expression E1/E2
or E1[E2]
is evaluated, the context position in the inner focus for an
evaluation of E2
is the position of the context item in the sequence obtained by
evaluating E1
. The position of the first item in a sequence is always 1 (one). The
context position is always less than or equal to the context size.
The context size is the number of items in the
sequence of items currently being processed. Its value is always an integer
greater than zero. The context size is returned by the expression last()
. When an expression E1/E2
or E1[E2]
is evaluated, the context size in the inner focus for an
evaluation of E2
is the number of items in the sequence obtained by evaluating E1
.
Dynamic variables. This is a set of (QName, type, value) triples. It contains the same QNames as the in-scope variables in the static context for the expression. Each QName is associated with the dynamic type and value of the corresponding variable. The dynamic type associated with the value of a variable may be more specific than the static type associated with the same variable. The value of a variable is, in general, a sequence.
The dynamic types and values of variables are provided by execution of the XQuery expressions in which the variables are bound. Variable types and values may also be provided by the environment external to the query. (See Issue 307.)
Current date and time. This information represents
an implementation-defined point in time during processing of a query or transformation. It can be retrieved by the fn:current-date
, fn:current-time
, and fn:current-dateTime
functions. If invoked multiple times during the execution of a query or transformation,
these functions always returns a consistent result.
Implicit timezone. This is the timezone to be used when a date, time, or dateTime value that does not have a timezone is used in a comparison or in any other operation. This value is an instance of dayTimeDuration that is implementation-defined. See [ISO 8601] for the range of legal values of a timezone.
Input sequence. The input sequence is sequence of nodes that can be accessed by the input
function. It might be thought of as an "implicit input". The content of the input sequence is determined in an implementation-defined way.
XQuery has a set of functions that provide access to input data. These functions are of particular importance because they provide a way in which an expression can reference a document or a collection of documents. The input functions are described informally here, and in more detail in [XQuery 1.0 and XPath 2.0 Functions and Operators].
The input sequence is a part of the evaluation context for an expression. The way in which nodes are assigned to the input sequence is implementation-defined. For example, one implementation might provide a fixed mapping from a directory system to the input sequence, another implementation might provide a graphical user interface that allows users to choose a data source for the input sequence, and a third implementation might support UNIX-style pipes, allowing the output of one query to become the input sequence for another query.
The input functions supported by XQuery are as follows:
The fn:input
function, which takes no parameters, returns the input
sequence. For example, the expression
fn:input()//customer
returns
all the customer
elements that are descendants of
nodes in the input sequence. If no input sequence has been bound,
the fn:input
function raises a dynamic error.
The fn:collection
function returns the nodes
found in a collection. A collection may be any sequence of nodes. A collection is identified by a
string, which must be a valid URI. For example, the expression
fn:collection("http://example.org")//customer
identifies all the customer
elements that are
descendants of nodes found in the collection whose URI is
http://example.org
.
The fn:document
function, when its first argument
is a string containing a single URI that refers to an
XML document, converts that document to a Data Model representation and returns its document node. The
fn:document
function can also be used to address
multiple documents or document fragments; see
[XQuery 1.0 and XPath 2.0 Functions and Operators] for details.
If a given input function is invoked repeatedly with the same arguments during the scope of a single query or transformation, each invocation returns the same result.
The input functions described in this section provide access to input documents or document fragments. If these documents or document fragments are associated with schemas, the type definitions contained in these schemas may be added to the in-scope schema definitions, in an implementation-defined way.
Ed. Note: The importing of type definitions from input documents is still under discussion. The idea that the static context should be affected by run-time functions in an implementation-defined way remains controversial (see Issue 307).
XQuery is defined in terms of the [XQuery 1.0 and XPath 2.0 Data Model] (referred to in this document simply as the Data Model), which represents information in the form of nodes and atomic values. Before an XQuery expression can be processed, the input documents to be operated on by the expression must be represented in the Data Model. For example, an XML document can be converted to the Data Model by the following steps:
The document can be parsed using an XML parser.
The parsed document can be validated against one or more schemas. This process, which is described in [XML Schema], results in an abstract information structure called the Post-Schema Validation Infoset (PSVI). If a document has no associated schema, it can be validated against a permissive default schema that accepts any well-formed document.
The PSVI can be transformed into the Data Model by a process described in [XQuery 1.0 and XPath 2.0 Data Model].
The above steps provide an example of how a Data Model instance might be constructed. A Data Model instance might also be synthesized directly from a relational database, or constructed in some other way. XQuery is defined in terms of operations on the Data Model, but it does not place any constraints on how the input Data Model instance is constructed.
Each element or attribute node in the Data Model has an annotation that indicates its dynamic type. If the Data Model was derived from an input XML document, the dynamic types of the elements and attributes are derived from schema validation. A newly constructed element node has the dynamic type xs:anyType
, and a newly constructed attribute node has the dynamic type xs:anySimpleType
. Constructed element and attribute nodes may be given a more specific type annotation by a validate
expression. The dynamic type of an element or attribute indicates its range of values--for example, an attribute named version
might have the dynamic type xs:decimal
, indicating that it contains a decimal value.
The value of an attribute is represented directly within the attribute node. An attribute node whose type is unknown (such as might occur in a schemaless document) is annotated with the dynamic type xs:anySimpleType
.
The value of an element is represented by the children of the element node, which may include text nodes and other element nodes. The dynamic type of an element node indicates how the values in its child text nodes are to be interpreted. An element whose type is unknown (such as might occur in a schemaless document) is annotated with the type xs:anyType
.
Atomic values in the Data Model also carry dynamic type annotations. An atomic value of unknown type is annotated with the type xs:anySimpleType
. Under certain circumstances (such as during processing of an arithmetic operator), an atomic value of xs:anySimpleType
may be cast into a more specific type (such as xs:double
).
This document provides a description of how each kind of expression is processed. For each expression, the operands and result are instances of the Data Model. The details of transforming XML documents into the Data Model are described in [XQuery 1.0 and XPath 2.0 Data Model]. Rules for serialization of a Data Model instance in the form of an XML document remain to be specified.
The terms document order, typed value, and string value are described here because they are of particular importance for the processing of expressions.
Document order defines a total ordering among all the nodes seen by the language processor. Informally, document order corresponds to a depth-first, left-to-right traversal of the nodes in the Data Model.
Within a given document, the document node is the first node, followed by element nodes, text nodes, comment nodes, and processing instruction nodes in the order of their representation in the XML form of the document (after expansion of entities). Element nodes occur before their children, and the children of an element node occur before its following siblings. The namespace nodes of an element immediately follow the element node, in implementation-defined order. The attribute nodes of an element immediately follow its namespace nodes, and are also in implementation-defined order.
The relative order of nodes in distinct documents is implementation-defined but stable within a given query or transformation. In other words, given two distinct documents A and B, if a node in document A is before a node in document B, then every node in document A is before every node in document B. The relative order among free-floating nodes (those not in a document) is implementation-defined.
Element, attribute, and text nodes have a typed value and a string value that can be extracted by calling the data
function and the string
function, respectively. The typed value of a node is a sequence of atomic values, and the string value of a node is a string. Element and attribute nodes also have a type annotation, which is a QName that is defined in the in-scope schema definitions. The type annotation of a node is assigned when the node is constructed, and can be changed by validating the node (see 3.13 Validate Expressions).
The typed value and string value for each kind of node are defined by the dm:typed-value
and dm:string-value
accessors in [XQuery 1.0 and XPath 2.0 Data Model]. Specifically:
The typed value of a text node is the same as its string value, as an instance of xs:anySimpleType
.
If the type annotation of an attribute node is xs:anySimpleType
, its typed value is equal to its string value, as an instance of xs:anySimpleType
. Otherwise, its typed value is derived from its string value and type annotation in a way that is consistent with schema validation, as described in [XQuery 1.0 and XPath 2.0 Data Model].
Example: A1 is an unvalidated attribute whose content is defined by the expression {2 + 2}
. The type annotation of A1 is xs:anySimpleType
. The string value of A1 is "4
". The typed value of A1 is "4
" as an instance of xs:anySimpleType
. If A1 is later validated and found to have the type hatsize
, its string value is still "4
", but its typed value is 4
as an instance of hatsize
.
Example: A2 is a validated attribute with type annotation IDREFS
, which is a list type derived from IDREF
. Its string value is "bar baz faz
". The typed value of A2 is a sequence of three atomic values ("bar
", "baz
", "faz
"), each of type IDREF
.
If the type annotation of an element node is xs:anyType
, its typed value is equal to its string value, as an instance of xs:anySimpleType
. Otherwise, its typed value is derived from its string value and type annotation in a way that is consistent with schema validation, as described in [XQuery 1.0 and XPath 2.0 Data Model]. If the type annotation of an element denotes a type with complex content (i.e., a type that permits subelements), its typed value is undefined, and the data
function raises an error when applied to such an element.
Example: E1 is an unvalidated element node whose content is defined by the expression {1, 2, 3}
. The type annotation of E1 is xs:anyType
. The string value of E1 is the string "1 2 3
". The typed value of E1 is "1 2 3
" as an instance of xs:anySimpleType
.
Example: E2 is a validated element node with the type annotation hatsizelist
, which is a type whose content is defined as a sequence of items of type hatsize
, which in turn is derived from xs:integer
. The string value of E2 is "7 8 9
". The typed value of E2 is a sequence of three values (7
, 8
, 9
), each of type hatsize
.
Example: E3 is a validated element node with the type annotation weather
, which is a complex type that permits subelements. The string value of E3 is "hot
". Even though E3 does not happen to contain any subelements, its typed value is undefined because its type permits subelements.
XQuery is a strongly typed language with a type system based on
[XML Schema]. The built-in types of XQuery include the built-in atomic types of [XML Schema] (such as xs:integer
and xs:string
), and the following special derived types: fn:dayTimeDuration
and fn:yearMonthDuration
(described in [XQuery 1.0 and XPath 2.0 Functions and Operators]). Additional types may be defined in schemas and imported into a query by means of a schema import, as discussed in
4.2 Schema Imports.
When the type of a value is not appropriate for the context in which it is used, a type error is raised. A type error may be detected and reported during the analysis phase or during the evaluation phase, as described in 2.4.1 Type Checking.
The XQuery type system is formally defined in [XQuery 1.0 Formal Semantics]. This section presents a summary of types from a user's perspective.
XQuery defines two phases of processing called the analysis phase and the evaluation phase.
The analysis phase depends on the query expression itself and on the static context. The analysis phase does not depend on any input data. The purpose of type-checking during the analysis phase is to provide early detection of type errors and to compute the type of a query result.
During the analysis phase, each expression is assigned a static type. In some cases, the static type is derived from the lexical form of the expression; for example, the static type of the literal 5
is xs:integer
. In other cases, the static type of an expression is inferred according to rules based on the static types of its operands; for example, the static type of the expression size < 5
is xs:boolean
. The static type of an expression may be either a named type or a structural description--for example, xs:boolean?
denotes an optional occurrence of the xs:boolean
type. The rules for inferring the static types of various expressions are described in [XQuery 1.0 Formal Semantics]. During the analysis phase, if an operand of an expression is found to have a static type that is not appropriate for that operand, a type error is raised. If static type checking raises no errors and assigns a static type T to an expression, then execution of the expression on valid input data is guaranteed either to produce a value of type T or to raise a dynamic error.
The evaluation phase is performed only after successful completion of the analysis phase. The evaluation phase depends on input data, on the expression being evaluated, and on the evaluation context. During the evaluation phase, a dynamic type is associated with each value as it is computed. The dynamic type of a value may be either a structural type (such as "sequence of integers") or a named type. The dynamic type of a value may be more specific than the static type of the expression that computed it (for example, the static type of an expression might be "zero or more integers or strings," but at run time its value may have the dynamic type "integer.") If an operand of an expression is found to have a dynamic type that is not appropriate for that operand, a type error is raised.
It is possible for static analysis of an expression to raise a type error, even though the expression might evaluate successfully on some valid input data. For example, an expression might contain a function that requires an element as its parameter, and the analysis phase might infer the static type of the function parameter to be an optional element. In this case, a type error would result, even though the function call would be successful for input data in which the optional element is present.
It is also possible for an expression to raise a dynamic error, even though analysis of the expression raised no static error. For example, an expression may contain a cast of a string into an integer, which is statically valid. However, if the actual value of the string at run time cannot be cast into an integer, a dynamic error will result. Similarly, an expression may apply an arithmetic operator to a value extracted from a schemaless document. This is not a static error, but at run time, if the value cannot be successfully cast to a numeric type, a dynamic error will be raised.
During the analysis phase, it may be desirable for an implementation to issue a warning if the static type assigned to an expression other than ()
is empty
, indicating that the expression can never return a nonempty value. This can catch cases in which a query references an element or attribute that is not present, possibly due to a misspelling or misunderstanding. We suggest a warning rather than requiring an error because there are some situations in which a correct expression may have the type empty
.
When it is necessary to refer to a type in an XQuery expression, the syntax shown below is used. This syntax production is called "SequenceType", since it describes the type of an XQuery value, which is a sequence.
[88] | SequenceType | ::= | (ItemType OccurrenceIndicator) | "empty" |
[89] | ItemType | ::= | (("element" | "attribute") ElemOrAttrType?) |
[90] | ElemOrAttrType | ::= | (QName (SchemaType | SchemaContext?)) | SchemaType |
[91] | SchemaType | ::= | <"of" "type"> QName |
[83] | SchemaContext | ::= | "context" SchemaGlobalContext ("/" SchemaContextStep)* |
[84] | SchemaGlobalContext | ::= | QName | <"type" QName> |
[85] | SchemaContextStep | ::= | QName |
[92] | AtomicType | ::= | QName |
[93] | OccurrenceIndicator | ::= | ("*" | "+" | "?")? |
Here are some examples of SequenceTypes that might be used in XQuery expressions or function parameters:
xs:date
refers to the built-in Schema type date
attribute?
refers to an optional attribute
element
refers to any element
element office:letter
refers to an element that has a specific name and that has been validated as conforming to the schema definition for that name
element of type
po:address+
refers to one or more elements that have been validated as conforming to the schema definition of the given type
node*
refers to a sequence of zero or more nodes of any type
item*
refers to a sequence of zero or more nodes or atomic values
During processing of a query, it is sometimes necessary to determine whether a given value matches a type that was declared using the SequenceType syntax. This process is known as SequenceType matching. For example, an instance of
expression returns true
if a given value matches a given type, or false
if
it does not.
SequenceType matching between a given value and a given SequenceType is performed as follows:
If the SequenceType is empty
, the match succeeds only if the value is an empty sequence. If the
SequenceType is an ItemType with no OccurrenceIndicator, the match succeeds only if the value contains precisely one item and that item matches the ItemType (see below).
If the SequenceType contains an ItemType and an OccurrenceIndicator, the match succeeds only if the number of items in the value matches the OccurrenceIndicator and each
of these items matches the ItemType. As a consequence of these rules, a value that is an empty sequence matches any SequenceType whose occurrence indicator is *
or ?
.
An OccurrenceIndicator indicates the number of items in a sequence, as follows:
?
indicates zero or one items
*
indicates zero or more items
+
indicates one or more items
The process of matching a given item against a given ItemType is performed as follows (remember that an item may be a node or an atomic value):
The ItemType item
matches any item. For example, item
matches the atomic value 1
or the element <a/>
.
The following ItemTypes match atomic values:
atomic value
matches any atomic value.
A named atomic type matches a value if the dynamic type of the value is the same as the named atomic type or is derived from the named atomic type by restriction. For example, the ItemType xs:decimal
matches the value 12.34
(a decimal literal); it also matches a value whose dynamic type is shoesize
, if shoesize
is an atomic type derived from xs:decimal
.
untyped
matches an atomic value whose
most specific type is xs:anySimpleType
.
The following ItemTypes match nodes:
node
matches any node.
text
matches any text node.
processing-instruction
matches any processing instruction node.
comment
matches any comment node.
document
matches any document node.
element
matches an element node. Optionally, element
may be followed by ElemOrAttrType, which places further constraints on the node (see below).
attribute
matches an attribute node. Optionally, attribute
may be followed by ElemOrAttrType, which places further constraints on the node (see below).
An ElemOrAttrType may be used to place a constraint on the name or type of an element or attribute, as follows:
One form of ElemOrAttrType, denoted by the phrase "of type
", specifies the required type of the element or attribute node. The required type must be the QName of a simple or complex type that is found in the in-scope schema definitions. The match is successful only if the given element or attribute has a type annotation that is the same as the required type or is known (in the in-scope schema definitions) to be derived from the required type. For example, element of type Employee
matches an element node that has been validated and has received the type annotation Employee
. Similarly, attribute of type xs:integer
matches an attribute node that has been validated and has received the type annotation xs:integer
.
Another form of ElemOrAttrType is simply a QName, which is interpreted as the required name of the element or attribute. The QName must be an element or attribute name that is found in the in-scope schema definitions. The match is successful only if the name of the given element or attribute is equal to the required name or is known (in the in-scope schema definitions) to be derived from the required name, and if the element or attribute has been validated.
The constraint that an element must have a required name is considered to be satisfied if the element has been validated and found to be a member of a substitution group whose head element has the required name. Substitution groups are described in [XML Schema].
The above two forms of ElemOrAttrType may be combined to specify both the required name and the required type of an element or attribute node, as in element person of type Employee
or attribute color of type xs:integer
. This form might be used, for example, to specify a required type that is more specific than the schema type associated with the required name.
In some cases, the required name of an element or attribute node may be locally declared (that is, declared inside a complex type in some schema.) In this case, the ElemOrAttrType may specify the SchemaContext in which the required name is to be interpreted. For example, element shippingAddress in invoice/customer
matches an element node that conforms to the schema definition of the element name shippingAddress
, as it would be interpreted inside a customer
element that is inside an invoice
element. The first QName in the SchemaContext must be found in the in-scope schema definitions.
Some expressions do not require their operands to exactly match the expected type. For example, function parameters and returns expect a value of a particular type, but automatically perform certain type conversions, such as extraction of atomic values from nodes, promotion of numeric values, and implicit casting of untyped values. The conversion rules for function parameters and returns are discussed in 3.1.4 Function Calls. Other operators that provide special conversion rules include arithmetic operators, which are discussed in 3.4 Arithmetic Expressions, and value comparisons, which are discussed in 3.5.1 Value Comparisons.
Type conversions sometimes depend on a process called atomization, which is used when a sequence of atomic values is required. The result of atomization is either a sequence of atomic values or a type error. Atomization of a sequence is defined as follows:
If every item in the input sequence is either an atomic value or a node whose typed value is a sequence of atomic values, then the result of atomization is the concatenated sequence of these atomic values.
Otherwise, atomization raises a type error.
Atomization may be used in processing the following types of expressions:
Arithmetic expressions
Comparison expressions
Function calls and returns
Cast expressions
If a sequence of items is encountered where a boolean value is expected, it is necessary to find its effective boolean value. The effective boolean value of a sequence is defined as the result of invoking the fn:boolean
function on the sequence, as defined in [XQuery 1.0 and XPath 2.0 Functions and Operators].
The semantics of fn:boolean
are repeated here for convenience. fn:boolean
returns false
if its operand is any of the following:
An empty sequence.
The boolean value false
.
An empty string (""
).
A numeric value that is equal to zero.
The double
or float
value NaN
.
Otherwise, fn:boolean
returns true
.
The effective boolean value of a sequence may be computed during processing of the following types of expressions:
Logical expressions (and
, or
)
The fn:not
function
The where
clause of a FLWOR expression
Conditional expressions (if
)
Quantified expressions (some
, every
)
Ed. Note: This section is still under review by the working group.
Certain kinds of expressions introduce named variables and bind them to values. For example, the following expression binds the variable $i
successively to the values 1
, 2
, and 3
, and uses each of these bindings to evaluate the nested expression $i * 2
:
for $i in (1, 2, 3) return $i * 2
In XQuery, the kinds of expressions that can bind variables are FLWOR expressions (3.8 FLWOR Expressions), quantified expressions (3.11 Quantified Expressions), and typeswitch
expressions (3.12.2 Typeswitch).
Expressions that bind variables can be nested, and an inner expression can contain references to variables bound in an outer expression. More formally, the rules for binding variables and for referring to bound variables in XQuery are as follows:
The innermost expression that contains the defining occurrence of a variable name is called the containing expression for that variable. The expression that establishes the value to which a variable is bound is called the binding expression for that variable. A variable is in scope (and may thus be referenced) within any subexpression of its containing expression, with the following exceptions:
Its binding expression
Any expression that textually precedes its binding expression
Variables that share the same containing expression must have different names.
If two or more variables with the same name are in scope within the same expression, any variable reference with that name is interpreted as a reference to the variable that has the smallest containing expression.
The name of a variable is a QName, and variable names match if their expanded-QNames are the same--that is, if they have the same namespace and the same local name.
As described in 2.4.1 Type Checking, XQuery defines an analysis phase, which does not depend on input data, and an evaluation phase, which does depend on input data.
The result of the analysis phase is either success or one or more type errors and/or static errors. Type errors reported by the analysis phase occur when the static type of an expression is not correct for the context in which it appears. Static errors are non-type-related errors such as syntax errors. The means by which errors are reported during the analysis phase is implementation-defined.
The result of the evaluation phase is either a result value, a type error, or a dynamic error. Type errors are raised during the evaluation phase when the dynamic type of an expression is not correct for the context in which it appears. Dynamic errors are non-type-related errors such as numeric overflow. If evaluation of an expression yields a value (that is, it does not raise an error), the value must be the value specified by the dynamic semantics defined in [XQuery 1.0 Formal Semantics].
If an implementation can determine by static analysis that an expression will necessarily raise a dynamic error (for example, because it attempts to construct a decimal value from a constrant string that is not in the lexical space of xs:decimal
), the implementation is allowed to report this error during the analysis phase (as well as during the evaluation phase).
[XQuery 1.0 Formal Semantics] defines the set of static, dynamic, and type errors. In addition to these errors, an XQuery implementation may raise implementation-defined warnings, either during the analysis phase or the evaluation phase. The way in which warnings are raised and handled is implementation-defined.
In addition to the errors defined in this specification, an implementation may specify a list of resource-related limitations, such as maximum numbers or sizes of various objects. These limitations, and the consequences of exceeding them, are implementation-defined.
XQuery defines a basic conformance level named Basic XQuery, and two optional features called the Schema Import Feature and the Static Typing Feature. A conforming implementation must satisfy the requirements of Basic XQuery, and may also provide either or both of the optional features.
A conforming Basic XQuery implementation must implement the full XQuery language, subject to the following limitations:
If a QueryProlog contains a SchemaImport, a Basic XQuery implementation raises a static error.
In a Basic XQuery
implementation, the in-scope schema
definitions consist of a fixed set of 48 predefined type definitions. These
include the 44 built-in datatypes defined in [XML Schema], plus four
additional types: fn:yearMonthDuration
,
fn:dayTimeDuration
,
xs:anySimpleType
, and xs:anyType
.
A mapping from a Post-Schema Validation Infoset (PSVI) to the Data Model is specified in [XQuery 1.0 and XPath 2.0 Data Model]. In a Basic XQuery implementation, this mapping maps each datatype that is not one of the 48 predefined types listed above into its nearest supertype that belongs to this list. As a result of this mapping, all complex types are mapped into xs:anyType
. (Of course, mapping from a PSVI is only one way in which a Data Model instance might be constructed--other ways are also possible.)
If any SequenceType contains an AtomicType that is not one of the 48 predefined types listed above, a Basic XQuery implementation raises a static error.
If any SequenceType contains an ElemOrAttrType, a Basic XQuery implementation raises a static error.
If the processing of an expression depends on the type of some value, and that type is not one of the 48 predefined types listed above, a Basic XQuery implementation raises a dynamic error.
A Basic XQuery implementation is not required to raise type errors during the analysis phase. If an expression contains one or more non-type-related static errors, then a Basic XQuery implementation must raise at least one of these static errors during the analysis phase. If the analysis phase is successful but one or more dynamic errors are encountered during the evaluation phase, then a Basic XQuery implementation must raise at least one of these dynamic errors.
The Schema Import Feature removes the limitations specified by Rules 1 through 6 of Basic XQuery.
During the analysis phase, in-scope schema definitions are derived from schemas named in Schema Import clauses. If more than one schema is imported, the definitions contained in these schemas are collected into a single pool of definitions. This pool of definitions must satisfy the conditions for schema validity set out in Sections 3 and 5 of [XML Schema] Part 1. In brief, the definitions must be valid, they must be complete and they must be unique--that is, the pool of definitions must not contain two or more schema components with the same name and target namespace. If any of these conditions is violated, a static error must be raised.
The Static Typing Feature removes the limitation specified by Rule 7 of Basic XQuery. An implementation that includes this feature is required to detect type errors during the analysis phase. If an expression contains one or more static errors or type errors, then a Static Typing implementation must raise at least one of these errors during the analysis phase.
Ed. Note: The Working Group is currently discussing the relationships among the various XQuery features (for example, if an expression executes successfully on an implementation with Feature A, will it also execute successfully on an implementation with Feature B?). The Working Group is also discussing the issue of "type soundness" (that is, if the Static Typing Feature is implemented and a given expression raises no type errors during the analysis phase, what guarantees can be made about its behavior during the evaluation phase?). The editors expect to include more material on these issues in a future version of this document. (See Issue 308.)
Except as noted in this document, if any operand of an expression
raises a dynamic error, the expression also raises a dynamic error.
If an expression can validly return a value or raise a dynamic
error, the implementation may choose to return the value or raise
the dynamic error. For example, the logical expression
expr1 and expr2
may return the value false
if either operand returns false
,
or may raise a dynamic error if either operand raises a dynamic
error.
If more than one operand of an expression may raise an error, the implementation may choose which error is raised by the expression. For example, in this expression:
($x div $y) + xs:decimal($z)
both ($x div $y)
and xs:decimal($z)
may
raise an error. The
implementation may choose which error is raised by the "+
"
expression. Once one operand raises an error, the implementation is
not required, but is permitted, to evaluate any other operands.
A dynamic error carries an error value, which may be a single item or an empty sequence. For example, an error value might be an integer, a string, a QName, or an element. An implementation may provide a mechanism whereby an application-defined error handler can process error values and produce diagnostics; in the absence of such an error handler, the string-value of the error value may be used directly as an error message.
A dynamic error may be raised by a built-in
function or operator. For example,
the input
function raises an error if the input
sequence is not
defined in the evaluation context.
An error can be raised explicitly by calling the
fn:error
function,
which only raises an error and never returns a value.
The fn:error
function takes an optional item as its parameter, which is used as the error value. For example, the following function call raises a dynamic error
whose error value is a string:
fn:error(fn:concat("Unexpected value ", $v))
Because different implementations may choose to evaluate or optimize an expression in different ways, the detection and reporting of dynamic errors is implementation dependent.
When an implementation is able to evaluate an expression without evaluating some subexpression, the implementation is never required to evaluate that subexpression solely to determine whether it raises a dynamic error. For example, if a function parameter is never used in the body of the function, an implementation may choose whether to evaluate the expression bound to that parameter in a function call.
In some cases, an optimizer may be able to achieve substantial performance improvements by rearranging an expression so that the underlying operations such as projection, restriction, and sorting are performed in a different order than that specified in [XQuery 1.0 Formal Semantics]. In such cases, dynamic errors may occur that could not have occurred if the expression were evaluated as written. For example, consider the following expression:
$N[@x castable as xs:date] [xs:date(@x) gt xs:date("2000-01-01")]
This expression cannot fail with a casting error if it is evaluated exactly as written. An implementation is permitted, however, to reorder the predicates to achieve better performance (for example, by taking advantage of an index). This reordering could cause the above expression to fail. However, an expression must not be rearranged in a way that causes it to return a non-error result that is different from the result defined by [XQuery 1.0 Formal Semantics].
To avoid unexpected errors caused by reordering of expressions, tests that are designed to prevent dynamic errors should be expressed using conditional expressions, as in the following example:
$N[if (@x castable as xs:date) then xs:date(@x) gt xs:date("2000-01-01") else false()]
In the case of a conditional expression, the implementation is required not to evaluate the then
branch if the condition is false, and not to evaluate the else
branch if the condition is true. Conditional and typeswitch
expressions are the only kinds of expressions that provide guaranteed conditions under which a particular subexpression will not be evaluated.
This section introduces each of the basic kinds of XQuery expression. Each kind of expression has a name such as PathExpr
, which is introduced on the left side of the grammar production that defines the expression. Since XQuery is a composable language, each kind of expression is defined in terms of other expressions whose operators have a higher precedence. In this way, the precedence of operators is represented explicitly in the grammar.
The simplest kinds of expressions are introduced first, followed by more complex expressions. This order of presentation does not conform to the order of operator precedence. The complete grammar is presented in the appendix [A Grammar].
The highest-level kind of expression (that is, the kind of expression whose operators have lowest precedence) is OrExpr
.
[25] | Expr | ::= | OrExpr |
Primary expressions are the basic primitives of the language. They include literals, variables, function calls, and the use of parentheses to control precedence of operators.
[62] | PrimaryExpr | ::= | Literal | FunctionCall | ("$" VarName) | ParenthesizedExpr |
[13] | VarName | ::= | QName |
A literal is a direct syntactic representation of an atomic value. XQuery supports two kinds of literals: string literals and numeric literals.
[79] | Literal | ::= | NumericLiteral | StringLiteral |
[78] | NumericLiteral | ::= | IntegerLiteral | DecimalLiteral | DoubleLiteral |
[1] | IntegerLiteral | ::= | Digits |
[2] | DecimalLiteral | ::= | ("." Digits) | (Digits "." [0-9]*) |
[3] | DoubleLiteral | ::= | (("." Digits) | (Digits ("." [0-9]*)?)) ("e" | "E") ("+" | "-")? Digits |
[4] | StringLiteral
(ws: significant) | ::= | ('"' (('"' '"') | [^"])* '"') | ("'" (("'" "'") | [^'])* "'") |
[5] | URLLiteral
(ws: significant) | ::= | ('"' (('"' '"') | [^"])* '"') | ("'" (("'" "'") | [^'])* "'") |
The value of a string literal is a singleton sequence
containing an item whose primitive type is xs:string
and whose value is the string denoted by the characters between the
delimiting quotation marks. If the literal is delimited by single quotes, two adjacent single quote characters within the literal are interpreted as one single quote character. Similarly, if the literal is delimited by double quotes, two adjacent double quote characters within the literal are interpreted as one double quote character.
A URL Literal is defined equivalently to a string literal.
The value of a numeric literal containing no ".
" and no e
or E
character is a singleton sequence containing an item whose type is xs:integer
and whose value is obtained by parsing the numeric literal according to
the rules of the xs:integer
datatype. The value of a numeric literal containing ".
" but no e
or E
character is a singleton sequence containing an item whose primitive
type is xs:decimal
and whose value is obtained by parsing the numeric literal according to
the rules of the xs:decimal
datatype. The value of a numeric literal containing an e
or E
character is a singleton sequence containing an item whose primitive
type is xs:double
and whose value is obtained by parsing the numeric literal according to
the rules of the xs:double
datatype.
Here are some examples of literal expressions:
"12.5"
denotes the string containing the characters '1', '2', '.', and
'5'.
12
denotes the integer value twelve.
12.5
denotes the decimal value twelve and one half.
125E2
denotes the double value twelve thousand, five hundred.
The boolean values true
and false
can be represented by calls to the built-in functions fn:true()
and fn:false()
, respectively.
Values of other XML Schema built-in types can be constructed by calling the constructor for the given type. The constructors for XML Schema built-in types are defined in [XQuery 1.0 and XPath 2.0 Functions and Operators]. In general, the name of a constructor function for a given type is the same as the name of the type (including its namespace). For example:
xs:integer("12")
returns the integer value twelve.
xs:date("2001-08-25")
returns an item whose type is xs:date
and whose value represents the date 25th August 2001.
fn:dayTimeDuration("PT5H")
returns an item whose type is fn:dayTimeDuration
and whose value represents a duration of five hours.
It is also possible to construct values of various types by using a cast
expression. For example:
cast as
hatsize(9)
returns an item whose primitive value is the integer 9 and
whose type is the user-defined type hatsize
, derived from xs:integer
.
A variable evaluates to the value to which its name is bound in the evaluation context. An expression containing an unbound variable raises a static error.
In XQuery, the kinds of expressions that can bind variables are FLWOR expressions (3.8 FLWOR Expressions), quantified expressions (3.11 Quantified Expressions), and typeswitch
expressions (3.12.2 Typeswitch). Function calls also bind values to the formal parameters of functions before executing the function body. Variables can also be bound in the external environment, outside the scope of a query.
[80] | ParenthesizedExpr | ::= | "(" ExprSequence? ")" |
Parentheses may be used to enforce a particular evaluation order in
expressions that contain multiple operators. For example, the expression (2 + 4)
* 5
evaluates to thirty, since the parenthesized expression (2 + 4)
is evaluated first and its result is multiplied by five. Without
parentheses, the expression 2 + 4 * 5
evaluates to twenty-two, because the multiplication operator has higher
precedence than the addition operator.
Empty parentheses are used to denote an empty sequence, as described in 3.3.1 Constructing Sequences.
A function call consists of a QName followed by a parenthesized list of zero or more expressions, called arguments. The QName and number of arguments must match the name and arity of an in-scope function in the static context (see 2.1 Expression Context); otherwise, a static error is raised.
[81] | FunctionCall | ::= | <QName "("> (Expr ("," Expr)*)? ")" |
A function call is evaluated as follows:
Each argument expression is evaluated, producing an argument value.
Each argument value is converted by applying the function conversion rules listed below.
If the function is a built-in function, it is executed using the converted argument values. The result is a value of the function's declared return type.
If the function is a user-defined function, the converted argument values are bound to the formal parameters of the function, and the function body is evaluated. The value returned by the function body is then converted to the declared return type of the function by applying the function conversion rules.
When a converted argument value is bound to a function parameter, the argument value retains its most specific type, even though this may be a subtype of the type of the formal parameter. For example, a function with a parameter $p
of type xs:decimal
can be invoked with an argument of type xs:integer
, which is derived from xs:decimal
. During the processing of this function invocation, the dynamic type of $p
inside the body of the function is considered to be xs:integer
.
A function does not inherit a focus (context item, context position, and context size) from the environment of the function call. During evaluation of a function body, the focus is undefined, except where it is defined by the action of some expression inside the function body. Use of an expression that depends on the focus when the focus is undefined raises a static error.
The function conversion rules are used to convert an argument value or a return value to its expected type; that is, to the declared type of the function parameter or return. The expected type is expressed as a SequenceType. The function conversion rules are applied to a given value as follows:
If the expected type is a sequence of an atomic type (possibly with an occurrence indicator *
, +
, or ?
), the following conversions are applied:
Atomization is applied to the given value, resulting in a sequence of atomic values.
Each item in the atomic sequence that is of type xs:anySimpleType
is cast to the required atomic type.
For each numeric item in the atomic sequence that can be promoted to the expected atomic type using the promotion rules in B.1 Type Promotion, the promotion is done.
If, after the above conversions, the resulting value does not match the expected type according to the rules for SequenceType Matching, a type error is raised. Note that the rules for SequenceType Matching permit a value of a derived type to be substituted for a value of its base type.
A core library of functions is defined in [XQuery 1.0 and XPath 2.0 Functions and Operators]. Functions in this library may be invoked without a namespace prefix by assigning the default function namespace to the namespace of the function library.
The comma operator in XQuery serves two purposes: it separates the arguments in a function call, and it separates items in an expression that constructs a sequence (see 3.3.1 Constructing Sequences). To distinguish these two uses, parentheses can be used to delimit the individual arguments of a function call. Here are some illustrative examples of function calls:
three-argument-function(1,
2, 3)
denotes a function call with three arguments.
two-argument-function((1,
2), 3)
denotes a function call with two arguments, the first of which is a
sequence of two values.
two-argument-function(1,
())
denotes a function call with two arguments, the second of which is an
empty sequence.
one-argument-function((1, 2,
3))
denotes a function call with one argument that is a sequence of three
values.
one-argument-function(( ))
denotes a function call with one argument that is an empty sequence.
zero-argument-function( )
denotes a function call with zero arguments.
XQuery comments can be used to provide informative annotation. These comments are lexical constructs only, and do not affect the processing of an expression.
[6] | ExprComment | ::= | "{--" [^}]* "--}" |
Comments may be used anywhere that ignorable whitespace is allowed, and within element content. See A.1 Lexical structure for the exact lexical states where comments are recognized.
The following is an example of a comment:
{-- Houston, we have a problem --}
Ed. Note: The EBNF should disallow "--}" within the comment, rather than "}". Also, within an enclosed expression, a comment immediately after the opening "{" will cause the "{{" to be mistaken for an escaped "{". Thus,
<a>{{--comment--}foo}</a>
will be processed as element content.
A path expression can be used to locate nodes within a tree. Because the XQuery grammar is organized around the precedence of operators, the syntax for PathExpr also includes PrimaryExpr. In common usage, the term path expression denotes a PathExpr that is not simply a PrimaryExpr.
[42] | PathExpr | ::= | ("/" RelativePathExpr?) | ("//" RelativePathExpr) | RelativePathExpr |
[43] | RelativePathExpr | ::= | StepExpr (("/" | "//") StepExpr)* |
A path expression consists of a series of one or more steps, separated by "/
", and optionally beginning with "/
" or "//
". An initial "/
" or "//
" is an abbreviation for one or more initial steps that are implicitly added to the beginning of the path expression, as described below.
A path expression consisting of a single step is evaluated as described in 3.2.1 Steps.
In a path expression consisting of two or more steps, each occurrence of //
is expanded as described in 3.2.4 Abbreviated Syntax, leaving a sequence of steps separated by /
. This sequence of steps is then evaluated from left to right. Each operation E1/E2
is evaluated as follows: Expression E1
is evaluated, and if the result is not a sequence of nodes, a dynamic error is raised. The resulting sequence of nodes is sorted in document order, and duplicates are eliminated based on node identity. Each node resulting from the evaluation of E1
then serves in turn to provide an inner focus for an evaluation of E2
, as described in 2.1.2 Evaluation Context. Each evaluation of E2
must result in a sequence of nodes; otherwise, a dynamic error is raised. The sequences of nodes resulting from all the evaluations of E2
are merged, eliminating duplicate nodes based on node identity and sorting the results in document
order.
As an example of a path expression, child::div1/child::para
selects the para
element children of the div1
element children of the context node, or, in other words, the para
element grandchildren of the context node that have div1
parents.
A "/
" at the beginning of a path expression is an abbreviation for the initial step fn:root(self::node())
. The effect of this initial step is to begin the path at the root node that contains the context node. If the context item is not a node, a dynamic error is raised.
A "//
" at the beginning of a path expression is an abbreviation for the initial steps fn:root(self::node())/descendant-or-self::node()
. The effect of these initial steps is to establish an initial node sequence that contains all nodes in the same hierarchy as the context node. This node sequence is then filtered by subsequent steps in the path expression. If the context item is not a node, a dynamic error is raised.
A step generates a sequence of items and then filters the sequence by zero or more predicates. The value of the step consists of those items that satisfy the predicates. Predicates are described in 3.2.2 Predicates.
A step may consist of a primary expression (described in 3.1 Primary Expressions), a forward step, or a reverse step. A forward or reverse step always returns a sequence of nodes. A forward or reverse step might be thought of as beginning at the context node and navigating to those nodes that are reachable from the context node via a specified axis. Such a step has two parts: an axis, which defines the "direction of movement" for the step, and a node test, which specifies the node kind and/or name of the nodes to be selected by the step.
In the abbreviated syntax for a step, the axis can be omitted and other shorthand notations can be used as described in 3.2.4 Abbreviated Syntax.
The unabbreviated syntax for a forward or reverse step consists of the axis name
and node test separated by a double colon. The result of the step consists of the nodes
reachable from the context node via the specified axis that have the node kind
and/or name specified by the node test. For example, the
step child::para
selects the para
element children of the context node: child
is the name of the axis, and para
is the name of the element nodes to be selected on this axis. The available axes are described in 3.2.1.1 Axes. The
available node tests are described in 3.2.1.2 Node Tests. Examples of
steps are provided in 3.2.3 Unabbreviated Syntax and 3.2.4 Abbreviated Syntax.
[63] | ForwardAxis | ::= | <"child" "::"> |
[64] | ReverseAxis | ::= | <"parent" "::"> |
XQuery supports the following axes:
the child
axis contains the children of the context node
the descendant
axis contains the descendants of the context node; a descendant is a
child or a child of a child and so on; thus the descendant axis never contains
attribute or namespace nodes
the parent
axis contains the parent of the context node, if there is one
the attribute
axis contains the attributes of the context node; the axis will be
empty unless the context node is an element
the self
axis contains just the context node itself
the descendant-or-self
axis contains the context node and the descendants of the context
node
Axes can be categorized as forward axes and reverse axes. An axis that only ever contains the context node or nodes that are after the context node in document order is a forward axis. An axis that only ever contains the context node or nodes that are before the context node in document order is a reverse axis.
In XQuery, the parent
axis is a reverse axis; all other axes are forward axes. Since the self
axis always contains at most one node, it makes no difference whether
it is a forward or reverse axis.
A node test is a condition that must be true for each node selected by a step. The condition may be based on the kind of the node (element, attribute, text, document, comment, processing instruction, or namespace) or on the name of the node.
[65] | NodeTest | ::= | KindTest | NameTest |
[66] | NameTest | ::= | QName | Wildcard |
[67] | Wildcard | ::= | "*" | <NCName ":" "*"> | <"*" ":" NCName> |
[68] | KindTest | ::= | ProcessingInstructionTest
|
[69] | ProcessingInstructionTest | ::= | <"processing-instruction" "("> StringLiteral? ")" |
[70] | CommentTest | ::= | <"comment" "("> ")" |
[71] | TextTest | ::= | <"text" "("> ")" |
[72] | AnyKindTest | ::= | <"node" "("> ")" |
Every axis has a principal node kind. If an axis can contain elements, then the principal node kind is element; otherwise, it is the kind of nodes that the axis can contain. Thus:
For the attribute axis, the principal node kind is attribute.
For all other axes, the principal node kind is element.
A node test that consists of a QName is called a name test. A name test is true if and only if the
kind of the node is the principal
node kind and the expanded-QName of the node is equal to the expanded-QName
specified by the name test. For example, child::para
selects the para
element children of the context node; if the context node has no para
children, it selects an empty set of nodes. attribute::abc:href
selects the attribute of the context node with the QName abc:href
; if the context node has no such attribute, it selects an empty set of nodes.
A QName in a name test is expanded into an expanded-QName using the in-scope namespaces in the expression context. An unprefixed QName used as a name test has the namespaceURI associated with the default element namespace in the expression context. It is a static error if the QName has a prefix that does not correspond to any in-scope namespace.
A name test is not satisfied by an element node whose name does not match the QName of the name test, even if it is in a substitution group whose head is the named element.
A node test *
is true for any node of the principal node kind. For example, child::*
will select all element children of the context node, and attribute::*
will select all attributes of the context node.
A node test can have the form NCName:*
. In this case, the prefix is expanded in the same way as with a QName,
using the context namespace declarations. It is a static error if there is no
namespace declaration for the prefix in the expression context. The node test
will be true for any node of the principal node kind whose expanded-QName has the
namespace URI to which the prefix expands, regardless of the local part of the
name.
A node test can also have the form *:NCName
. In this case, the node test is true for any node of the principal node
kind whose local name matches the given NCName, regardless of its
namespace.
The node test text()
is true for any text node. For example, child::text()
will select the text node children of the context node. Similarly, the
node test comment()
is true for any comment node, and the node test processing-instruction()
is true for any processing instruction. The processing-instruction()
test may have an argument that is a StringLiteral; in this
case, it is true for any processing instruction whose target application is equal to the
value of the StringLiteral.
A node test node()
is true for any node whatsoever.
Note:
In order to be consistent with QName in XML, whitespace is not allowed in the Wildcard production. For instance "prefix:*" is allowed, but "prefix : *" is not allowed.
[77] | Predicates | ::= | ("[" Expr "]")* |
A predicate consists of an expression, called a predicate
expression, enclosed in square brackets. A predicate serves to filter a sequence, retaining some items and discarding others. For each item in the sequence to be filtered, the predicate expression is evaluated using an
inner focus derived from that item, as described in
2.1.2 Evaluation Context. The result of the predicate expression is
coerced to a Boolean value, called the predicate truth value, as
described below. Those items for which the predicate truth value is true
are retained, and those for which the predicate truth value is false
are discarded.
The predicate truth value is derived by applying the following rules, in order:
If the value of the predicate expression is an atomic value of a
numeric type, the predicate truth value is true
if and only if the value of the predicate expression is equal to the context position.
Otherwise, the predicate truth value is the Effective Boolean Value of the predicate expression.
Here are some examples of steps that contain predicates:
This example selects the second chapter
element that is a child
of the context node:
child::chapter[2]
This example selects all the descendants of the context node whose
name is "toy"
and whose color
attribute has the value "red"
:
descendant::toy[attribute::color = "red"]
This example selects all the employee
children of the context node
that have a secretary
subelement:
child::employee[secretary]
A predicate can also be used with a primary expression that is not a forward or reverse step, as illustrated in the following example:
List all the integers from 1 to 100 that are divisible by 5. (See 3.3.1 Constructing Sequences for an explanation of the to
operator.)
(1 to 100)[. mod 5 eq 0]
This section provides a number of examples of path expressions in which the axis is explicitly specified in each step. The syntax used in these examples is called the unabbreviated syntax. In many common cases, it is possible to write path expressions more concisely using an abbreviated syntax, as explained in 3.2.4 Abbreviated Syntax.
child::para
selects
the para
element children of the context node
child::*
selects all element children of the context node
child::text()
selects all text node children of the context node
child::node()
selects all the children of the context node, whatever their node
type
attribute::name
selects the name
attribute of the context node
attribute::*
selects all the attributes of the context node
descendant::para
selects the para
element descendants of the context node
descendant-or-self::para
selects the para
element descendants of the context node and, if the context node is a para
element, the context node as well
self::para
selects the context node if it is a para
element, and otherwise selects nothing
child::chapter/descendant::para
selects the para
element
descendants of the chapter
element children of the context node
child::*/child::para
selects all para
grandchildren of the context node
/
selects the root of the node hierarchy that contains the context node
/descendant::para
selects all the para
elements in the same document as the context node
/descendant::list/child::member
selects all
the member
elements that have a list
parent and that are in the same document as the context node
child::para[fn:position() = 1]
selects the first para
child of the context node
child::para[fn:position() = fn:last()]
selects the last para
child of the context node
child::para[fn:position() = fn:last()-1]
selects the last but one para
child of the context node
child::para[fn:position() > 1]
selects all the para
children of the context node other than the first para
child of the context node
/descendant::figure[fn:position() = 42]
selects the forty-second figure
element in the document
/child::doc/child::chapter[fn:position() = 5]/child::section[fn:position() = 2]
selects the
second section
of the fifth chapter
of the doc
document element
child::para[attribute::type="warning"]
selects
all para
children of the context node that have a type
attribute with value warning
child::para[attribute::type='warning'][fn:position() = 5]
selects the fifth para
child of the context node that has a type
attribute with value warning
child::para[fn:position() = 5][attribute::type="warning"]
selects the fifth para
child of the context node if that child has a type
attribute with value warning
child::chapter[child::title='Introduction']
selects the chapter
children of the context node that have one or more title
children with string-value equal to Introduction
child::chapter[child::title]
selects the chapter
children of the context node that have one or more title
children
child::*[self::chapter or self::appendix]
selects the chapter
and appendix
children of the context node
child::*[self::chapter or
self::appendix][fn:position() = fn:last()]
selects the
last chapter
or appendix
child of the context node
[75] | AbbreviatedForwardStep | ::= | "." | ("@" NameTest) | NodeTest |
[76] | AbbreviatedReverseStep | ::= | ".." |
The abbreviated syntax permits the following abbreviations:
The most important abbreviation is that child::
can be omitted from a step. In effect, child
is the default axis. For example, a path expression section/para
is short for child::section/child::para
.
There is also an abbreviation for
attributes: attribute::
can be
abbreviated by @
. For example, a path expression para[@type="warning"]
is short
for child::para[attribute::type="warning"]
and
so selects para
children with a type
attribute with value
equal to warning
.
//
is short
for /descendant-or-self::node()/
. For example, //para
is short for /descendant-or-self::node()/child::para
and so will select any para
element in the document (even a para
element that is a document element will be selected
by //para
since
the document element node is a child of the root node); div1//para
is
short for div1/descendant-or-self::node()/child::para
and so will select all para
descendants of div1
children.
Note that the path expression //para[1]
does not mean the same as the path
expression /descendant::para[1]
. The latter selects the first descendant para
element; the former
selects all descendant para
elements that are the first para
children of their parents.
A step consisting
of .
returns the context item. This is particularly useful in conjunction with //
. For example, the path
expression .//para
returns all para
descendant elements of the context node.
A step consisting
of ..
is short
for parent::node()
. For example, ../title
is short for parent::node()/child::title
and so will select the title
children of the parent of the context node.
Here are some examples of path expressions that use the abbreviated syntax:
para
selects the para
element children of the context node
*
selects all element children of the context node
text()
selects all text node children of the context node
@name
selects
the name
attribute of the context node
@*
selects all the attributes of the context node
para[1]
selects the first para
child of the context node
para[fn:last()]
selects the last para
child of the context node
*/para
selects
all para
grandchildren of the context node
/doc/chapter[5]/section[2]
selects the second section
of the fifth chapter
of the doc
chapter//para
selects the para
element descendants of the chapter
element children of the context node
//para
selects all
the para
descendants of the document root and thus selects all para
elements in the same document as the context node
//list/member
selects all the member
elements in the same document as the context node that have a list
parent
.
selects the context item
.//para
selects
the para
element descendants of the context node
..
selects the parent of the context node
../@lang
selects
the lang
attribute of the parent of the context node
para[@type="warning"]
selects all para
children of the context node that have a type
attribute with value warning
para[@type="warning"][5]
selects the fifth para
child of the context node that has a type
attribute with value warning
para[5][@type="warning"]
selects the fifth para
child of the context node if that child has a type
attribute with value warning
chapter[title="Introduction"]
selects the chapter
children of the context node that have one
or more title
children with string-value equal to Introduction
chapter[title]
selects the chapter
children of the context node that have one or more title
children
employee[@secretary and @assistant]
selects all
the employee
children of the context node that have both a secretary
attribute and
an assistant
attribute
book/(chapter|appendix)/section
selects
every section
element that has a parent that is either a chapter
or an appendix
element, that in turn is a child of a book
element that is a child of the context node.
book/fn:id(publisher)/name
returns the same result as fn:id(book/publisher)/name
.
XQuery supports operators to construct and combine sequences. A sequence is an ordered collection of zero or more items. An item may be an atomic value or a node. An item is identical to a sequence of length one containing that item. Sequences are never nested--for example, combining the values 1, (2, 3), and ( ) into a single sequence results in the sequence (1, 2, 3).
[24] | ExprSequence | ::= | Expr ("," Expr)* |
[35] | RangeExpr | ::= | AdditiveExpr ( "to" AdditiveExpr )? |
One way to construct a sequence is by using the comma operator, which evaluates each of its operands and concatenates the resulting values, in order, into a single result sequence.
An ExprSequence is not an expression in its own right, and in general it must be enclosed in parentheses when used in a context where an expression is expected. There are, however, some contexts where parentheses are not required. These include the top-level QueryBody, and the contents of an enclosed expression in an element, attribute, or document constructor (where an ExprSequence appears between curly braces). Empty parentheses can be used to denote an empty sequence.
A sequence may contain duplicate values or nodes, but a sequence is never an item in another sequence. When a new sequence is created by concatenating two or more input sequences, the new sequence contains all the items of the input sequences and its length is the sum of the lengths of the input sequences.
Here are some examples of expressions that construct sequences:
This expression is a sequence of five integers:
(10, 1, 2, 3, 4)
This expression constructs one sequence from the sequences 10, (1, 2), the empty sequence (), and (3, 4):
(10, (1, 2), (), (3, 4))
It evaluates to the sequence:
10, 1, 2, 3, 4
This expression contains
all salary
children of the context node followed by all bonus
children:
(salary, bonus)
Assuming that $price
is bound to
the value 10.50
, this expression:
($price, $price)
evaluates to the sequence
10.50, 10.50
A RangeExpr can be used to construct a sequence of consecutive
integers. The to
operator takes two operands, both of which have a required type of
integer. A sequence is constructed containing the two integer operands and
every integer between the two operands. If the first operand is less than the
second, the sequence is in increasing order, otherwise it is in decreasing
order.
This example uses a range expression as one operand in constructing a sequence:
(10, 1 to 4)
It evaluates to the sequence:
10, 1, 2, 3, 4
This example constructs a sequence of length one:
10 to 10
It evaluates to a sequence consisting of the single integer 10
.
[39] | UnionExpr | ::= | IntersectExceptExpr ( ("union" | "|") IntersectExceptExpr )* |
[40] | IntersectExceptExpr | ::= | ValueExpr ( ("intersect" | "except") ValueExpr )* |
XQuery provides several operators for combining sequences of
nodes. The union
and |
operators are equivalent. They take two node sequences as operands and
return a sequence containing all the nodes that occur in either of the
operands. The intersect
operator takes two node sequences as operands and returns a sequence
containing all the nodes that occur in both operands.
The except
operator takes two node sequences as operands and returns a sequence
containing all the nodes that occur in the first operand but not in the second
operand. All of these operators return their result sequences in document order
without duplicates based on node identity. If an operand
of union
, intersect
, or except
contains an item that is not a node, a dynamic error is raised.
Here are some examples of expressions that combine sequences. Assume the existence of three element nodes that we will refer to by symbolic names A, B, and C. Assume that $seq1
is bound to a sequence containing A and B, $seq2
is also bound to a sequence containing A and B, and $seq3
is bound to a sequence containing B and C. Then:
$seq1 union $seq1
evaluates to a sequence containing A and B.
$seq2 union $seq3
evaluates to a sequence containing A, B, and C.
$seq1 intersect $seq1
evaluates to a sequence containing A and B.
$seq2 intersect $seq3
evaluates to a sequence containing B only.
$seq1 except $seq2
evaluates to the empty sequence.
$seq2 except $seq3
evaluates to a sequence containing A only.
In addition to the sequence operators described here,[XQuery 1.0 and XPath 2.0 Functions and Operators] includes functions for indexed access to items or sub-sequences of a sequence, for indexed insertion or removal of items in a sequence, and for removing duplicate values or nodes from a sequence.
XQuery provides arithmetic operators for addition, subtraction, multiplication, division, and modulus, in their usual binary and unary forms.
[36] | AdditiveExpr | ::= | MultiplicativeExpr ( ("+" | "-") MultiplicativeExpr )* |
[37] | MultiplicativeExpr | ::= | UnaryExpr ( ("*" | "div" | "idiv" | "mod") UnaryExpr )* |
[38] | UnaryExpr | ::= | ("-" | "+")* UnionExpr |
[41] | ValueExpr | ::= | ValidateExpr | CastExpr | TreatExpr | Constructor | PathExpr |
The binary subtraction operator must be preceded by whitespace if it could otherwise be interpreted as part of the previous token. For example, a-b
will be interpreted as a name, but a - b
will be interpreted as an arithmetic operation.
An arithmetic expression is evaluated by applying the following rules, in order, until an error is raised or a value is computed:
Atomization is applied to each operand. If the resulting value is not an empty sequence or a single atomic value, then a type error is raised.
If either operand is an empty sequence, the result of the operation is an empty sequence.
If an operand has the most specific type xs:anySimpleType
, it is cast to xs:double
. If the cast fails, a type error is raised.
If the operand type(s) are valid for the given operator, the operator is applied to the operand(s), resulting in an atomic value or a dynamic error (for example, an error might result from dividing by zero.) The combinations of atomic types that are accepted by the various arithmetic operators, and their respective result types, are listed in B.2 Operator Mapping together with the functions in [XQuery 1.0 and XPath 2.0 Functions and Operators] that define the semantics of the operation for each type. If the operand type(s) are not valid for the given operator, a type error is raised.
XQuery supports two division operators named div
and idiv
. The div
operator accepts operands of any numeric types. The result of the div
operator is the least common type of its operands; however, if both operands are of type xs:integer
, div
returns a result of type xs:double
. The idiv
operator, on the other hand, requires its operands to be of type xs:integer
and returns a result of type xs:integer
, rounded toward zero.
Here are some examples of arithmetic expressions:
The first expression below returns -1.5E0
, and the second expressions returns -1
:
-3 div 2 -3 idiv 2
Subtraction of two date values results in a value of type fn:dayTimeDuration
:
$emp/hiredate - $emp/birthdate
This example illustrates the difference between a subtraction operator and a hyphen:
$unit-price - $unit-discount
Unary operators have higher precedence than binary operators, subject of course to the use of parentheses:
-($bellcost + $whistlecost)
Comparison expressions allow two values to be compared. XQuery provides four kinds of comparison expressions, called value comparisons, general comparisons, node comparisons, and order comparisons.
[34] | ComparisonExpr | ::= | RangeExpr ( (ValueComp
|
[54] | ValueComp | ::= | "eq" | "ne" | "lt" | "le" | "gt" | "ge" |
[53] | GeneralComp | ::= | "=" | "!=" | "<" | "<=" | ">" | ">=" |
[55] | NodeComp | ::= | "is" | "isnot" |
[56] | OrderComp | ::= | "<<" | ">>" |
The "<" comparison operator must be followed by white space in order to distinguish it from a tag-open character. [Ed. Note: This rule may be relaxed, pending resolution of some general grammar issues.]
Value comparisons are intended for comparing single values. The result of a value comparison is defined by applying the following rules, in order:
Atomization is applied to each operand. If the result is not an empty sequence or a single atomic value, a type error is raised.
If either operand is an empty sequence, the result is an empty sequence.
If either operand has the most specific type xs:anySimpleType
, that operand is cast to a required type,
which is determined as follows:
If the type of the other operand is numeric, the required type is
xs:double
.
If the most specific type of the other operand is xs:anySimpleType
, the required type is xs:string
.
Otherwise, the required type is the type of the other operand.
If the cast fails, a dynamic error is raised.
The result of the comparison is true
if the value of the first operand is (equal, not equal, less than, less
than or equal, greater than, greater than or equal) to the value of the second
operand; otherwise the result of the comparison is false
. B.2 Operator Mapping describes which combinations of atomic types
are comparable, and how comparisons are performed on values of various types.
If the value of the first operand is not comparable with the value of the
second operand, a type error is raised.
Here are some examples of value comparisons:
The following comparison is true only if $book1
has a single author
subelement and its value is "Kennedy":
$book1/author eq "Kennedy"
The following comparison is true because the two constructed nodes have the same value, even though they have different identities:
<a>5</a> eq <a>5</a>
The following comparison is true if hatsize
and shoesize
are both user-defined types that are derived by restriction from a primitive numeric type:
hatsize(5) eq shoesize(5)
Ed. Note: The current definitions of the value comparison operators are not transitive. For example,
anySimpleType('1') lt integer(2)
is true andinteger(2) lt anySimpleType('03')
is true, butanySimpleType('1') lt anySimpleType('03')
is false. It is not possible to preserve all of the following properties: (a)age > 21
is compared in the numeric domain whenage
is untyped; (b)city = county
is compared in the string domain when both sides are untyped; (c) value comparisons are transitive; and (d) general comparisons are defined by adding existential quantifiers to value comparisons. The current design gives up property (c). This issue is still under discussion.
Each of the value comparison operators has a corresponding general comparison operator that is defined by adding existential semantics to the value comparison operator. The operands of a general comparison may be sequences of any
length. The result of a general comparison is
always true
or false
.
The correspondence between value comparison and general comparison operators is shown in the following table:
Value Comparison | General Comparison |
eq | = |
ne | != |
lt | < |
le | <= |
gt | > |
ge | >= |
For each value comparison operator VC
, the corresponding general comparison operator GC
is defined as follows:
A GC B
is true
for sequences A
and B
if the value comparison a VC b
is true
for some item a
in A
and some item b
in B
.
a
is numeric, and a VC fn:number(b)
is true
b
is numeric, and fn:number(a) VC b
is true
Otherwise, A GC B
is false
.
When evaluating a general comparison in which either operand is a sequence of items, an implementation may return true
as soon as it finds an item in the first operand and an item in the second operand for which the underlying value comparison is true
. Similarly, a general comparison may raise a dynamic error as soon as it encounters an item in either operand that raises an error. As a result of these rules, the result of a general comparison is not deterministic in the presence of errors.
Here is an example of a general comparison:
The following comparison is true if the value of any author
subelement of $book1
has the string value "Kennedy":
$book1/author = "Kennedy"
The result of a node comparison is defined by applying the following rules, in order:
Each operand must be either a single node or an empty sequence; otherwise a type error is raised.
If either operand is an empty sequence, the result of the comparison is an empty sequence.
A comparison with the is
operator is true
if the two operands are nodes that have the same identity; otherwise it
is false
. A comparison with the isnot
operator is true
if the two operands are nodes that have different identities; otherwise
it is false
. See [XQuery 1.0 and XPath 2.0 Data Model] for a discussion of node identity.
Use of the is
operator is illustrated below.
The following comparison is true only if the left and right sides each evaluate to exactly the same single node:
//book[isbn="1558604820"] is //book[call="QA76.9 C3845"]
The following comparison is false because each constructed node has its own identity:
<a>5</a> is <a>5</a>
The result of an order comparison is defined by applying the following rules, in order:
Both operands must be either a single node or an empty sequence; otherwise a type error is raised.
If either operand is an empty sequence, the result of the comparison is an empty sequence.
A comparison with the <<
operator returns true
if the first operand node is earlier than the second operand node in
document order; otherwise it returns false
.
A comparison with the >>
operator returns true
if the first operand node is later than the second operand node in
document order; otherwise it returns false
.
Here is an example of an order comparison:
The following comparison is true only if the node identified by the left side occurs before the node identified by the right side in document order:
//purchase[parcel="28-451"] << //sale[parcel="33-870"]
A logical expression is either an and-expression or
an or-expression. If a logical expression does not raise an error, its value is always one
of the boolean values true
or false
.
[26] | OrExpr | ::= | AndExpr ( "or" AndExpr )* |
[27] | AndExpr | ::= | FLWRExpr ( "and" FLWRExpr )* |
The first step in evaluating a logical expression is to find the effective boolean value of each of its operands (see 2.4.3.2 Effective Boolean Value).
The value of an and-expression is determined by the effective boolean values (EBV's) of its operands. If an error is raised during computation of one of the effective boolean values, an and-expression may raise a dynamic error, as shown in the following table:
AND: | EBV2 = true | EBV2 = false | error in EBV2 |
EBV1 = true | true | false | error |
EBV1 = false | false | false | false or error |
error in EBV1 | error | false or error | error |
The value of an or-expression is determined by the effective boolean values (EBV's) of its operands. If an error is raised during computation of one of the effective boolean values, an or-expression may raise a dynamic error, as shown in the following table:
OR: | EBV2 = true | EBV2 = false | error in EBV2 |
EBV1 = true | true | true | true or error |
EBV1 = false | true | false | error |
error in EBV1 | true or error | error | error |
The order in which the operands of a logical expression are evaluated is implementation-dependent. The tables above are defined in such a way that an or-expression can return true
if the first expression evaluated is true, and it can raise an error if evaluation of the first expression raises an error. Similarly, an and-expression can return false
if the first expression evaluated is false, and it can raise an error if evaluation of the first expression raises an error. As a result of these rules, a logical expression is not deterministic in the presence of errors, as illustrated in the examples below.
Here are some examples of logical expressions:
The following expressions return true
:
1 eq 1 and 2 eq 2
1 eq 1 or 2 eq 3
The following expression may return either false
or raise a dynamic error:
1 eq 2 and 3 idiv 0 = 1
The following expression may return either true
or raise a dynamic error:
1 eq 1 or 3 idiv 0 = 1
The following expression must raise a dynamic error:
1 eq 1 and 3 idiv 0 = 1
In addition to and- and or-expressions, XQuery provides a function named not
that takes a general sequence as parameter and returns a boolean value.
The not
function reduces its parameter to an effective boolean value. It then
returns true
if the effective boolean value of its parameter is false
, and false
if the effective boolean value of its parameter
is true
. If an error is encountered in finding the effective boolean value of its operand, not
raises a dynamic error. The not
function is described in [XQuery 1.0 and XPath 2.0 Functions and Operators].
XQuery provides constructors that can create XML structures within a query. Constructors are provided for every kind of node in the Data Model ([XQuery 1.0 and XPath 2.0 Data Model]) except namespace nodes. A special form of constructor called a computed constructor can be used to create an element or attribute with a computed name or to create a document node or a text node.
[52] | Constructor | ::= | ElementConstructor
|
[94] | ElementConstructor
(ws: explicit) | ::= | "<" QName AttributeList ("/>" | (">" ElementContent* "</" QName S? ">")) |
[102] | ElementContent
(ws: significant) | ::= | Char
|
[103] | AttributeList
(ws: explicit) | ::= | (S (QName S? "=" S? AttributeValue)?)* |
[104] | AttributeValue
(ws: significant) | ::= | ('"' (EscapeQuot | AttributeValueContent)* '"') |
[105] | AttributeValueContent
(ws: significant) | ::= | Char
|
[106] | EnclosedExpr | ::= | "{" ExprSequence "}" |
An element constructor creates an XML element. If the name,
attributes, and content of the element are all constants, the element
constructor is based on standard XML notation. For example, the following expression
creates a book
element that contains attributes, subelements, and text:
<book isbn="isbn-0060229357"> <title>Harold and the Purple Crayon</title> <author> <first>Crockett</first> <last>Johnson</last> </author> </book>
In an element constructor, the name used in an end tag must match the name of the corresponding start tag.
In an element constructor, curly braces { } delimit enclosed expressions, distinguishing them from literal text. Enclosed expressions are evaluated and replaced by their value, whereas material outside curly braces is simply treated as literal text, as illustrated by the following example:
<example> <p> Here is a query. </p> <eg> $i//title </eg> <p> Here is the result of the above query. </p> <eg>{ $i//title }</eg> </example>
The above query might generate the following result (whitespace has been added for readability to this result and other result examples in this document):
<example> <p> Here is a query. </p> <eg> $i//title </eg> <p> Here is the result of the above query. </p> <eg><title>Harold and the Purple Crayon</title></eg> </example>
In general, the value of an enclosed expression may be any sequence of nodes and/or atomic values. Enclosed expressions can be used inside constructors to compute the content of the constructed node (and, in the case of an element constructor, its attributes as well). The details of how enclosed expressions are handled inside various kinds of constructors are given in 3.7.4 Data Model Representation.
Since XQuery uses curly braces to denote enclosed expressions, some convention is needed to denote a curly brace used as an ordinary character. For this purpose, two adjacent curly brace characters occurring within the content of an element or attribute are interpreted by XQuery as a single curly brace character.
The names used in an element constructor may be qualified names that include namespace prefixes. Namespace prefixes can be bound to namespaces in the Query Prolog or in namespace declaration attributes. It is a static error to use a namespace prefix that has not been bound to a namespace.
A namespace declaration attribute serves to define a namespace prefix for use within the scope of an element constructor. A namespace declaration attribute always has the name xmlns
or a QName with the prefix xmlns
. If the value of a namespace declaration attribute is not a literal string, a static error is raised. Namespace declaration attributes are discussed further in 4.1 Namespace Declarations and [XML Names]. The following element constructor illustrates the use of namespace declaration attributes that define the namespace prefixes metric
and english
:
<box xmlns:metric = "http://example.org/metric/units" xmlns:english = "http://example.org/english/units"> <height> <metric:meters>3</metric:meters> </height> <width> <english:feet>6</english:feet> </width> <depth> <english:inches>18</english:inches> </depth> </box>
An alternative way to create nodes is by using a computed constructor. A computed constructor begins with a keyword that identifies the type of node to be created: element
, attribute
, document
, or text
. The keyword element
or attribute
is followed by the name of the node to be created (document and text nodes have no name). The name of an element or attribute may be specified either by a QName or by an expression, enclosed
in braces, that returns a QName. The final part of a computed constructor is a sequence of expressions, enclosed in braces, that generates the content of the node.
[96] | ComputedElementConstructor | ::= | (<"element" QName "{"> | (<"element" "{"> Expr "}" "{")) ExprSequence? "}" |
[97] | ComputedAttributeConstructor | ::= | (<"attribute" QName "{"> | (<"attribute" "{"> Expr "}" "{")) ExprSequence? "}" |
[95] | ComputedDocumentConstructor | ::= | <"document" "{"> ExprSequence "}" |
[98] | ComputedTextConstructor | ::= | <"text" "{"> ExprSequence? "}" |
The sequence of expressions that generates the content of a computed element is called the content sequence. If the content sequence contains an attribute node following an item that is not an attribute node, an error is raised. The attribute nodes generated by the content sequence become attributes of the constructed element. All other items returned by the content sequence, in order, become the content of the constructed element.
The following example illustrates the use of computed element and attribute constructors in a simple case where the names of the constructed nodes are constants. This example generates exactly the same result as the first example in this section:
element book { attribute isbn { "isbn-0060229357" }, element title { "Harold and the Purple Crayon" }, element author { element first { "Crockett" }, element last { "Johnson" } } }
A computed element constructor might be used to make a modified copy of an existing element. For example, if the variable $e
is bound to an element with numeric content, the following constructor might be used to create a new element with the same name as $e
and with numeric content equal to twice the value of $e
:
element {node-name($e)} {2 * data($e)}
One important purpose of computed element and attribute
constructors is to allow the name of the constructed node to be computed. We
will illustrate this feature by an expression that translates the name of an
element from one language to another. Suppose that the variable $dict
is bound to a sequence of entries in a translation dictionary. Here is
an example entry:
<entry word="address"> <variant lang="German">Adresse</variant> <variant lang="Italian">indirizzo</variant> </entry>
Suppose further that the variable $e
is bound to the following element:
<address>123 Roosevelt Ave. Flushing, NY 11368</address>
Then the following expression generates a new element in which the name of $e
has been translated into Italian and the content of $e
(including its attributes, if any) has been preserved. The first enclosed expression after the element
keyword generates the name of the element, and the second enclosed
expression generates the content and attributes:
element {expanded-QName("", data($dict/entry[word=name($e)]/variant[lang="Italian"]))} {$e/node()}
The result of this expression is as follows:
<indirizzo>123 Roosevelt Ave. Flushing, NY 11368</indirizzo>
An attribute generated by a computed element or attribute constructor may not be a namespace declaration attribute--that is, its name may not be xmlns
or a QName with prefix xmlns
; otherwise, a dynamic error is raised.
Additional examples of computed element constructors can be found in 5.4 Recursive Transformations.
A computed document constructor is useful when the result of a query is to be a document in its own right. The following example illustrates a query that returns an XML document containing a root element is named author-list
:
document { <author-list> document("bib.xml")//book/author </author-list> }
As shown in the above examples, element and attribute constructors may contain literal
characters interleaved with enclosed expressions and nested elements. In some cases, enclosed expressions and/or nested elements may be separated only by whitespace characters. For
example, in the expression below, the end-tag
</title>
and the start-tag <author>
are separated by a newline character and four space
characters:
<book isbn="isbn-0060229357"> <title>Harold and the Purple Crayon</title> <author> <first>Crockett</first> <last>Johnson</last> </author> </book>
We will refer to whitespace characters that occur by themselves in the boundaries between tags and/or enclosed expressions, as in the above example, as boundary whitespace. Boundary whitespace never occurs in a computed constructor, since the content of a computed constructor consists only of a single enclosed expression. The Query Prolog contains a declaration called xmlspace
that controls whether boundary whitespace is preserved by constructors. If xmlspace
is not declared in the prolog or is declared as xmlspace = strip
, boundary whitespace is not considered significant and is not preserved. On the other hand, if xmlspace = preserve
is declared in the prolog, boundary whitespace is considered significant and is preserved.
Example:
<a> {"abc"} </a>
If xmlspace
is not declared or is declared as xmlspace = strip
, this example is equivalent to <a>abc</a>
. However, if xmlspace = preserve
is declared, this example is equivalent
to <a> abc </a>
.
Example:
<a> z {"abc"}</a>
Since the whitespace surrounding the z
is not boundary whitespace, it is always preserved. This example is equivalent to <a> z abc </a>
.
For the purpose of the above rule, whitespace characters generated by character references such as  
are not considered to be boundary whitespace, and are always preserved.
Example:
<a> {"abc"}</a>
This example is equivalent
to <a> abc</a>
, regardless of the declaration of xmlspace
.
It is important to remember that whitespace generated by an enclosed expression is never considered to be boundary whitespace, and is always preserved.
Example:
<a>{" "}</a>
This example is equivalent
to <a> </a>
, regardless of the declaration of xmlspace
.
Constructors can best be understood by examining how their constructed nodes are represented in the Data Model. The descriptions in this section apply to both the computed and non-computed forms of constructors. An XQuery implementation is free to use any implementation technique that produces the same result as the processing steps described in this section.
The result of an element constructor is a new element node, with its own node identity. All the attribute and descendant nodes of the new element node are also new nodes with their own identities, even though they may be copies of existing nodes. The element node created by an element constructor always has a type annotation of xs:anyType
. The element node may be given a more specific type by means of a validate
expression.
Conceptually, an element constructor is processed by the following steps:
The content of the element constructor is evaluated to produce a sequence of nodes called the content sequence, as follows:
Each consecutive sequence of literal characters in the content of the element constructor evaluates to a single text node containing the characters. However, if the sequence consists entirely of boundary whitespace as defined in 3.7.3 Whitespace in Constructors and the Query Prolog does not specify xmlspace = preserve
, then no text node is generated.
Enclosed expressions are evaluated as follows: For each node returned by an enclosed expression, a new copy of the node is constructed, with a new node identity but retaining its original type annotation. For each adjacent sequence of one or more atomic values returned by an enclosed expression, a new text node is constructed, containing the result of casting each atomic value to a string, with a single blank character inserted between adjacent values.
Nested constructors are evaluated by recursively applying the rules in this section.
If the content sequence contains a document node, an error is raised.
If the content sequence contains an attribute node following a node that is not an attribute node, an error is raised. Attribute nodes occurring at the beginning of the content sequence become attributes of the new element node.
Adjacent text nodes in the content sequence are coalesced into a single text node by concatenating their contents, with no intervening blanks.
The resulting sequence of nodes becomes the children of the new element node in the Data Model representation. Since the new element node has a type annotation of xs:anyType
, its typed value is defined to be the same as its string value (the concatenated contents of all its text node descendants), as an instance of xs:anySimpleType
. The value of the element may be given a more specific type by a cast
expression, or by validating the element before extracting its typed value.
Example:
<a>{1}</a>
The constructed element node has one child, a text node containing the value "1
".
Example:
<a>{1, 2, 3}</a>
The constructed element node has one child, a text node containing the value "1 2 3
".
Example:
<c>{1}{2}{3}</c>
The constructed element node has one child, a text node containing the value "123
".
Example:
<b>{1, "2", "3"}</b>
The constructed element node has one child, a text node containing the value "1 2 3
".
Example:
<fact>I saw 8 cats.</fact>
The constructed element node has one child, a text node containing the value "I saw 8 cats.
".
Example:
<fact>I saw {5 + 3} cats.</fact>
The constructed element node has one child, a text node containing the value "I saw 8 cats.
".
Example:
<fact>I saw <howmany>{5 + 3}</howmany> cats.</fact>
The constructed element node has three children: a text node containing "I saw
", a child element node, and a text node containing " cats.
". The child element node in turn has a single text node child containing the value "8
".
Example:
<cat> <breed>{$b}</breed> <color>{$c}</color> </cat>
The constructed <cat>
element node has two children: a constructed element node for the <breed>
element, and a constructed element node for the <color>
element. Whitespace surrounding the child elements has been stripped away by the element constructor (assuming that the Query Prolog did not specify xmlspace = preserve
.)
Example:
element {node-name($e)} {$e/@*, 2 * data($e)}
This constructor creates a new element node that has the same name and attributes as the node bound to $e
. The new node has one child text node whose value is computed by extracting the typed value of $e
, multiplying it by 2, and casting the resulting value to a string. For example, if $e
is bound by the expression let $e := <length units="inches">{5}</length>
, then the result of the example expression is the element <length units="inches">10</length>
.
Note that it is possible to construct an element that has an attribute named xsi:type
. The existence of this attribute does not affect the type of the constructed node (but it may affect the validation process if the constructed node is later validated.)
The result of an attribute constructor is a new attribute node, with its own node identity. Attribute nodes have no children. Attribute nodes created by an element or attribute constructor always have a type annotation of xs:anySimpleType
. An attribute node may be given a more specific type by validating the element to which it is attached (if any).
Conceptually, an attribute constructor is processed by the following steps:
The content of the attribute constructor is evaluated to produce a sequence of strings, as follows:
Each consecutive sequence of literal characters in the content of the attribute constructor evaluates to a string containing the characters. However, if the sequence consists entirely of boundary whitespace as defined in 3.7.3 Whitespace in Constructors and the Query Prolog does not specify xmlspace = preserve
, then the boundary whitespace is discarded.
Enclosed expressions are evaluated as follows: Each node returned by an enclosed expression is replaced by its string value. For each adjacent sequence of one or more atomic values returned by an enclosed expression, a string is constructed, containing the canonical lexical representation of all the atomic values, with a single blank character inserted between adjacent values.
Nested constructors are evaluated by recursively applying the rules in this section and replacing the resulting nodes with their string values.
Adjacent strings are concatenated with no intervening blanks. The resulting string, as an instance of xs:anySimpleType
, becomes the value of the attribute.
Example:
<shoe size="{7}"/>
The value of the size
attribute is "7
".
Example:
<shoe size="7"/>
The value of the size
attribute is "7
".
Example:
<shoe size="As big as {$hat/@size}"/>
The value of the size
attribute is the
string "As big as
", concatenated with the string value of the
node denoted by the expression $hat/@size
.
Example:
attribute size {4 + 3}
The value of the size
attribute is "7
".
All document constructors are computed constructors. The result of a document constructor is a new document node, with its own node identity. [XML] has rules that govern the structure of an XML document (for example, a document must contain exactly one top-level element node which serves as the root of the document); however, these rules are not enforced by XQuery document constructors. Document constructors never contain boundary whitespace because their contents consist only of computed expressions.
Conceptually, a computed document constructor is processed by the following steps:
The result of evaluating the expressions inside the document constructor is called the content sequence. For each node in the content sequence, a new copy of the node is constructed, with a new node identity but retaining its original type annotation. For each adjacent sequence of one or more atomic values in the content sequence, a new text node is constructed, containing the result of casting each atomic value to a string, with a single blank character inserted between adjacent values.
Adjacent text nodes are coalesced into a single text node by concatenating their contents, with no intervening blanks.
If the resulting node sequence contains any document or attribute nodes, a dynamic error is raised. Otherwise, this node sequence becomes the content of the new document node.
All text node constructors are computed constructors. The result of a text node constructor is a new text node, with its own node identity. Text node constructors never contain boundary whitespace because their contents consist only of computed expressions.
Conceptually, a computed text node constructor is processed by the following steps:
The result of evaluating the expressions inside the text node constructor is called the content sequence. Each node in the content sequence is replaced by its string value. For each adjacent sequence of one or more atomic values in the content sequence, a string is constructed, containing the canonical lexical representation of all the atomic values, with a single blank character inserted between adjacent values.
Adjacent strings are concatenated with no intervening blanks. The resulting string becomes the value of the new text node.
The syntax for a CDATA section constructor, a processing instruction constructor, or an XML comment constructor is the same as the syntax of the equivalent XML construct.
[99] | CdataSection
(ws: significant) | ::= | "<![CDATA[" Char* "]]>" |
[100] | XmlProcessingInstruction
(ws: significant) | ::= | "<?" PITarget Char* "?>" |
[101] | XmlComment
(ws: significant) | ::= | "<!--" Char* "-->" |
The following examples illustrate constructors for processing instructions, comments, and CDATA sections.
<?format role="output" ?>
<!-- Tags are ignored in the following section -->
<![CDATA[ <address>123 Roosevelt Ave. Flushing, NY 11368</address> ]]>
Ed. Note: The Data Model cannot currently represent a CDATA section (see Issue 293).
Note that an XML comment actually constructs an XML comment node. An XQuery comment (see 3.1.5 Comments) is simply a comment used in documenting a query, and is not evaluated. Consider the following example.
{-- This is an XQuery comment --} <!-- This is an XML comment -->
The result of evaluating the above expression is as follows.
<!-- This is an XML comment -->
XQuery provides a feature called a FLWOR expression that supports iteration and binding of variables to intermediate results. This
kind of expression is often useful for computing joins between two or more
documents and for restructuring data. The name FLWOR,
pronounced "flower", is suggested by the keywords for
, let
, where
, order by
, and return
.
[28] | FLWRExpr | ::= | ((ForClause | LetClause)+ WhereClause? OrderByClause? "return")* QuantifiedExpr |
[45] | ForClause | ::= | <"for" "$"> VarName TypeDeclaration? PositionalVar? "in" Expr ("," "$" VarName TypeDeclaration? PositionalVar? "in" Expr)* |
[46] | LetClause | ::= | <"let" "$"> VarName TypeDeclaration? ":=" Expr ("," "$" VarName TypeDeclaration? ":=" Expr)* |
[86] | TypeDeclaration | ::= | "as" SequenceType |
[48] | PositionalVar | ::= | "at" "$" VarName |
[47] | WhereClause | ::= | "where" Expr |
[57] | OrderByClause | ::= | (<"order" "by"> | <"stable" "order" "by">) OrderSpecList |
[58] | OrderSpecList | ::= | OrderSpec ("," OrderSpec)* |
[59] | OrderSpec | ::= | Expr OrderModifier |
[60] | OrderModifier | ::= | ("ascending" | "descending")? (<"empty" "greatest"> | <"empty" "least">)? ("collation" StringLiteral)? |
The for
and let
clauses in a FLWOR expression generate a sequence of tuples of bound variables, called the tuple stream. The where
clause serves to filter the tuple stream, retaining some tuples and discarding others. The order by
clause imposes an ordering on the tuple stream. The return
clause constructs the result of the FLWOR expression. The return
clause is evaluated once for every tuple in the tuple stream, after filtering by the where
clause, using the variable bindings in the respective tuples. The result of the FLWOR
expression is an ordered sequence containing the concatenated results of these
evaluations.
The following example of a FLWOR expression includes all of the possible clauses. The for
clause iterates over all the departments in an input document, binding the variable $d
to each department number in turn. For each binding of $d
, the let
clause binds variable $e
to all the employees in the given department, selected from another input document. The result of the for
and let
clauses is a tuple stream in which each tuple contains a pair of bindings for $d
and $e
($d
is bound to a department number and $e
is bound to a set of employees in that department). The where
clause filters the tuple stream by keeping only those binding-pairs that represent departments having at least ten employees. The order by
clause orders the surviving tuples in descending order by the average salary of the employees in the department. The return
clause constructs a new big-dept
element for each surviving tuple, containing the department number, headcount, and average salary.
for $d in document("depts.xml")//deptno let $e := document("emps.xml")//emp[deptno = $d] where count($e) >= 10 order by avg($e/salary) descending return <big-dept> { $d, <headcount>{count($e)}</headcount>, <avgsal>{avg($e/salary)}</avgsal> } </big-dept>
The clauses in a FLWOR expression are described in more detail below.
The purpose of the for
and let
clauses in a FLWR expression is to produce a tuple stream in which each tuple consists of one or more bound variables.
The simplest example of a for
clause contains one variable and an associated expression. It evaluates the expression and iterates over the items in the resulting sequence, binding the variable to each item in turn.
A for
clause may also contain multiple variables, each with an associated expression. In this case, the for
clause iterates each variable over the items that result from evaluating its expression. The resulting tuple stream contains one tuple for each combination of values in the Cartesian product of the sequences resulting from evaluating the given expressions. The order of the tuples in the tuple stream is determined by the order of the given expressions, as illustrated in the examples below.
A let
clause may also contain one or more variables, each with an associated expression. Unlike a for
clause, however, a let
clause binds each variable to the result of its associated expression, without iteration. The variable bindings generated by let
clauses are added to the binding tuples generated by the for
clauses. If there are no for
clauses, the let
clauses generate one tuple containing all the variable bindings.
Although for
and let
clauses both bind variables, the manner in which variables are bound is quite
different, as illustrated by the following examples. The first example uses a let
clause:
let $s := (<one/>, <two/>, <three/>) return <out>{$s}</out>
The variable $s
is bound to the result of the expression (<one/>,
<two/>, <three/>)
. Since there are no for
clauses, the let
clause generates one tuple that contains the binding of $s
.
The return
clause is invoked for this tuple, creating the following output:
<out> <one/> <two/> <three/> </out>
The next example is a similar query that contains a for
clause instead of a let
clause:
for $s in (<one/>, <two/>, <three/>) return <out>{$s}</out>
In this example, the variable $s
iterates over the given expression; first it is bound to <one/>
, then to <two/>
, and finally to <three/>
. One tuple is generated for each of these bindings, and the return
clause is invoked for each tuple, creating the following output:
<out> <one/> </out> <out> <two/> </out> <out> <three/> </out>
The following example illustrates how binding tuples are generated by a for
clause that contains multiple variables. Note that the order of the tuple stream is determined primarily by the order of the sequence bound to the leftmost variable, and secondarily by sequences bound to other variables, working from left to right.
for $i in (1, 2), $j in (3, 4)
The tuple stream generated by the above for
clause is as follows (the order is
significant):
($i = 1, $j = 3) ($i = 1, $j = 4) ($i = 2, $j = 3) ($i = 2, $j = 4)
A FLWR expression may have multiple for
clauses and multiple let
clauses. The expressions in each of these clauses may refer to variables that were bound in earlier clauses, as illustrated by the following example in which the functions f
, g
, and h
represent arbitrary expressions that refer to the given variables:
for $x in input() let $y := f($x) for $z in g($x, $y) return h($x, $y, $z)
Each variable bound in a for
or let
clause may have an optional type declaration, which is a type declared using the syntax in 2.4.2 SequenceType. If the type of a value bound to the variable does not match the declared type according to the rules for SequenceType Matching, a type error is raised. For example, the following expression raises a type error because the variable $salary
has a type declaration that is not satisfied by the value that is bound to the variable:
let $salary as xs:decimal := "cat" return $salary * 2
Each variable bound in a for
clause may have an associated positional variable that is bound at the same time. The name of the positional variable is preceded by the keyword at
. The positional variable always has an implied type of xs:integer
. As a variable iterates over the items in a sequence, its positional variable iterates over the ordinal numbers of these items, starting with 1. Positional variables are illustrated by the following for
clause:
for $car at $i in ("Ford", "Chevy"), $pet at $j in ("Cat", "Dog")
The tuple stream generated by the above for
clause is as follows (the order is significant):
($i = 1, $car = "Ford", $j = 1, $pet = "Cat") ($i = 1, $car = "Ford", $j = 2, $pet = "Dog") ($i = 2, $car = "Chevy", $j = 1, $pet = "Cat") ($i = 2, $car = "Chevy", $j = 2, $pet = "Dog")
The optional where
clause serves as a filter for the tuples of variable bindings
generated by the for
and let
clauses. The expression in the where
clause, called the where-expression, is evaluated once for
each of these tuples. If the effective boolean value of the
where-expression is true
, the tuple is retained and its variable bindings are used in an
execution of the return
clause. If the effective boolean value of the where-expression is false
, the tuple is discarded. The effective boolean value of an expression is defined in 2.4.3.2 Effective Boolean Value.
The following expression illustrates how a where
clause might be applied to a positional variable in order to perform sampling on an input sequence. This expression approximates the average value in a sequence by sampling one value out of each one hundred input values.
avg(for $x at $i in input() where $i mod 100 = 0 return $x)
The return
clause of a FLWOR expression is evaluated once for each tuple in the tuple stream, and the results of these evaluations are concatenated to form the result of the FLWOR expression. If no order by
clause is present, the order of the tuple stream is determined by the orderings of the sequences returned by the expressions in the for
clauses. If an order by
clause is present, it determines the order of the tuple stream. The order of the tuple stream, in turn, determines the order in which the return clause is evaluated using the variable bindings in the respective tuples.
An order by
clause contains one or more ordering specifications, called orderspecs, as shown in the grammar above. For each tuple in the tuple stream, the orderspecs are evaluated, using the variable bindings in that tuple. The relative order of two tuples is determined by comparing the values of their orderspecs, working from left to right until a pair of unequal values is encountered. If the values to be compared are strings, the orderspec may indicate the collation to be used (if no collation is specified, the default collation is used.)
The process of evaluating and comparing the orderspecs is based on the following rules:
Atomization is applied to the result of the expression in each orderspec. If the result of atomization is neither a single atomic value nor an empty sequence, a type error is raised.
If the value of an orderspec has the type xs:anySimpleType
(such as character
data in a schemaless document), it is cast to the type xs:string
.
Each orderspec must return values of the same type for all tuples in the tuple stream, and this type must be a (possibly optional) atomic type for which the gt
operator is defined--otherwise, a dynamic error is raised.
When two orderspec values are compared to determine their relative position in the ordering sequence, the greater-than relationship is defined as follows:
When the orderspec specifies empty least
, a value W is considered to be greater than a value V if one of the following is true:
V is an empty sequence and W is not an empty sequence.
V is NaN
, and W is neither NaN
nor an empty sequence.
No collation is specified, and W gt
V is true.
A specific collation C is specified, and fn:compare(V, W, C)
is less than zero.
When the orderspec specifies empty greatest
, a value W is considered to be greater than a value V if one of the following is true:
W is an empty sequence and V is not an empty sequence.
W is NaN
, and V is neither NaN
nor an empty sequence.
No collation is specified, and W gt
V is true.
A specific collation C is specified, and fn:compare(V, W, C)
is less than zero.
When the orderspec specifies neither empty least
nor empty greatest
, it is implementation-defined whether the rules for empty least
or empty greatest
are used.
If T1 and T2 are two tuples in the tuple stream, and V1 and V2 are the first pair of values encountered when evaluating their orderspecs from left to right for which one value is greater than the other (as defined above), then:
If V1 is greater than V2: If the orderspec specifies descending
, then T1 precedes T2 in the tuple stream; otherwise, T2 precedes T1 in the tuple stream.
If V2 is greater than V1: If the orderspec specifies descending
, then T2 precedes T1 in the tuple stream; otherwise, T1 precedes T2 in the tuple stream.
If neither V1 nor V2 is greater than the other for any pair of orderspecs for tuples T1 and T2, then:
If stable
is specified, the original order of T1 and T2 is preserved in the tuple stream.
If stable
is not specified, the order of T1 and T2 in the tuple stream is implementation-defined.
An order by
clause makes it easy to sort the result of a FLWOR expression, even if the sort key is not included in the result of the expression. For example, the following expression returns employee names in descending order by salary, without returning the actual salaries:
for $e in input() order by $e/salary return $e/name
The order by
clause is the only facility provided by XQuery for specifying an order other than document order. Therefore, every query in which an order other than document order is required must contain a FLWOR expression, even though iteration would not otherwise be necessary. For example, a list of books with price less than 100 might be obtained by a simple path expression such as input()//book[price < 100]
. But if these books are to be returned in alphabetic order by title, the query must be expressed as follows:
for $b in input()//book[price < 100] order by $b/title return $b
The following example illustrates an order by
clause that uses several options. It causes a collection of books to be sorted in primary order by title, and in secondary descending order by price. A specific collation is specified for the title ordering, and in the ordering by price, books with no price are specified to occur last (as though they have the least possible price). Whenever two books with the same title and price occur, the keyword stable
indicates that their input order is preserved.
for $b in input()//book stable order by $b/title collation "eng-us", $b/price descending empty least return $b
The following example illustrates how FLWOR expressions can be nested, and how ordering can be specified at multiple levels of an element hierarchy. The example query inverts a document hierarchy to transform a bibliography into an author list. The input bibliography is a list of books in which each book contains a list of authors. The example is based on the following input:
<bib> <book> <title>TCP/IP Illustrated</title> <author>Stevens</author> <publisher>Addison-Wesley</publisher> </book> <book> <title>Advanced Unix Programming</title> <author>Stevens</author> <publisher>Addison-Wesley</publisher> </book> <book> <title>Data on the Web</title> <author>Abiteboul</author> <author>Buneman</author> <author>Suciu</author> </book> </bib>
The following query transforms the input document into a list in which each author's name appears only once, followed by a list of titles of books written by that author. The distinct-values
function is used to eliminate duplicates (by value) from a list of author nodes. The author list, and the lists of books published by each author, are returned in alphabetic order using the default collation.
<authlist> { for $a in distinct-values(input()//author) order by $a return <author> <name> { $a/text() } </name> <books> { for $b in input()//book[author = $a] order by $b/title return $b/title } </books> </author> } </authlist>
The result of the above expression is as follows:
<authlist> <author> <name>Abiteboul</name> <books> <title>Data on the Web</title> </books> </author> <author> <name>Buneman</name> <books> <title>Data on the Web</title> </books> </author> <author> <name>Stevens</name> <books> <title>TCP/IP Illustrated</title> <title>Advanced Unix Programming</title> </books> </author> <author> <name>Suciu</name> <books> <title>Data on the Web</title> </books> </author> </authlist>
In general, XQuery expressions return sequences that have a well-defined order. The result of a path expression is always returned in document order, and the result of a FLWOR expression is determined by its order by
clause and/or the expressions in its for
clauses. However, in some expressions, the order of the result may not be significant. In such an expression, one ordering may be much more efficient to materialize than another, and a significant performance advantage may be realized by allowing the system to materialize the results of the expression in the order it finds most efficient. XQuery provides a function named unordered
for this purpose.
The unordered
function takes any sequence of items as its argument, and returns the same sequence of items in a nondeterministic order. A call to the unordered
function may be thought of as giving permission for the argument expression to be materialized in whatever order the system finds most efficient. The unordered
function may be applied to the result of a query or to a subexpression inside a query.
The use of the unordered
function is illustrated by the following example, which joins together two documents named parts.xml
and suppliers.xml
. The example returns the part numbers of red parts, paired with the supplier numbers of suppliers who supply these parts. If the unordered
function were not used, the resulting list of (part number, supplier number) pairs would be required to have an ordering that is controlled primarily by the document order of parts.xml
and secondarily by the document order of suppliers.xml
. However, this might not be the most efficient way to process the query if the ordering of the result is not important. An XQuery implementation might be able to process the query more efficiently by using an index to find the red parts, or by using suppliers.xml
rather than parts.xml
to control the primary ordering of the result. The unordered
keyword gives the query evaluator freedom to make these kinds of optimizations.
unordered( for $p in document("parts.xml")//part[color = "Red"], $s in document("suppliers.xml")//supplier where $p/suppno = $s/suppno return <ps> { $p/partno, $s/suppno } </ps> )
XQuery supports a conditional expression based on the keywords if
, then
, and else
.
[31] | IfExpr | ::= | (<"if" "("> Expr ")" "then" Expr "else")* InstanceofExpr |
The expression following the if
keyword is called the test expression, and the expressions
following the then
and else
keywords are called the then-expression and else-expression, respectively.
The first step in processing a conditional expression is to find the effective boolean value of the test expression, as defined in 2.4.3.2 Effective Boolean Value.
The value of a conditional expression is defined as follows: If the
effective boolean value of the test expression is true
, the value of the then-expression is returned. If the
effective boolean value of the test expression is false
, the value of the else-expression is returned.
Conditional expressions have a special rule for propagating dynamic errors. If the effective value of the test expression is true
, the conditional expression ignores (does not raise) any dynamic errors encountered in the else-expression. In this case, since the else-expression can have no observable effect, it need not be evaluated. Similarly, if the effective value of the test expression is false
, the conditional expression ignores any dynamic errors encountered in the then-expression, and the then-expression need not be evaluated.
Here are some examples of conditional expressions:
In this example, the test expression is a comparison expression:
if ($widget1/unit-cost < $widget2/unit-cost) then $widget1 else $widget2
In this example, the test expression tests for the existence of an attribute
named discounted
, independently of its value:
if ($part/@discounted) then $part/wholesale else $part/retail
Quantified expressions support existential and universal quantification. The
value of a quantified expression is always true
or false
.
[29] | QuantifiedExpr | ::= | ((<"some" "$"> | <"every" "$">) VarName TypeDeclaration? "in" Expr ("," "$" VarName TypeDeclaration? "in" Expr)* "satisfies")* TypeswitchExpr |
A quantified expression begins with
a quantifier, which is the keyword some
or every
, followed by one or more in-clauses that are used to bind variables,
followed by the keyword satisfies
and a test expression. Each in-clause associates a variable with an
expression that returns a sequence of values. As in the case of a for-clause in
a FLWR expression, the in-clauses generate tuples of variable bindings, using
values drawn from the Cartesian product of the sequences returned by the
binding expressions. Conceptually, the test expression is evaluated for each
tuple of variable bindings. Results depend on the effective boolean values of the test expressions, as defined in 2.4.3.2 Effective Boolean Value. The value of the quantified expression is defined
by the following rules:
If the quantifier is some
, the quantified expression is true
if at least one evaluation of the test expression has the effective
boolean value true
; otherwise the quantified expression is false
. This rule implies that, if the in-clauses generate zero binding
tuples, the value of the quantified expression is false
.
If the quantifier is every
, the quantified expression is true
if every evaluation of the test expression has the effective
boolean value true
; otherwise the quantified expression is false
. This rule implies that, if the in-clauses generate zero binding
tuples, the value of the quantified
expression is true
.
Each variable bound in an in-clause of a quantified expression may have an optional type declaration, which is a datatype declared using the syntax in 2.4.2 SequenceType. If the type of a value bound to the variable does not match the declared type according to the rules for SequenceType Matching, a type error is raised.
The order in which test expressions are evaluated for the various binding
tuples is implementation-defined. If the quantifier
is some
, an implementation may
return true
as soon as it finds one binding tuple for which the test expression has
an effective Boolean value of true
, and it may raise a dynamic error as soon as it finds one binding tuple for
which the test expression raises an error. Similarly, if the quantifier is every
, an implementation may return false
as soon as it finds one binding tuple for which the test expression has
an effective Boolean value of false
, and it may raise a dynamic error as soon as it finds one binding tuple for
which the test expression raises an error. As a result of these rules, the
value of a quantified expression is not deterministic in the presence of
errors, as illustrated in the examples below.
Here are some examples of quantified expressions:
This expression is true
if every part
element has a discounted
attribute (regardless of the values of these attributes):
every $part in //part satisfies $part/@discounted
This expression is true
if at least
one employee
element satisfies the given comparison expression:
some $emp in //employee satisfies ($emp/bonus > 0.25 * $emp/salary)
In the following examples, each quantified expression evaluates its test
expression over nine tuples of variable bindings, formed from the Cartesian
product of the sequences (1, 2, 3)
and (2, 3, 4)
. The expression beginning with some
evaluates to true
, and the expression beginning with every
evaluates to false
.
some $x in (1, 2, 3), $y in (2, 3, 4) satisfies $x + $y = 4
every $x in (1, 2, 3), $y in (2, 3, 4) satisfies $x + $y = 4
This quantified expression may either return true
or raise a dynamic error, since its test expression returns true
for one variable binding
and raises an error for another:
some $x in (1, 2, "cat") satisfies $x * 2 = 4
This quantified expression may either return false
or raise a dynamic error, since its test expression returns false
for one variable binding and raises an error for another:
every $x in (1, 2, "cat") satisfies $x * 2 = 4
This quantified expression raises a type error, since it contains a type declaration that is not satisfied by every item in the test expression. In this example, it is important to realize that the type declaration does not act as a filter on the items in the test expression, but instead acts as an assertion about the type of every item:
some $x as xs:integer in (1, 2, "cat") satisfies $x * 2 = 4
In addition to their use in function parameters, SequenceTypes occur explicitly in instance of
, typeswitch
, cast
, castable
, and treat
expressions.
[32] | InstanceofExpr | ::= | CastableExpr ( <"instance" "of"> SequenceType )? |
The boolean
operator instance of
returns true
if the value of its first operand matches the type named in its second
operand, according to the rules for SequenceType Matching; otherwise it returns false
. For example:
5 instance of xs:integer
This example returns true
because the given value is an instance of the given type.
5 instance of xs:decimal
This example returns true
because the given value is an integer literal, and xs:integer
is derived by restriction from xs:decimal
.
<a>{5}</a> instance of xs:integer
This example returns false
because the given value is not an integer; instead, it is an element whose typed value is an integer.
<a>{5}</a> instance of element of type xs:integer
This example returns false
because a constructed but unvalidated element always has a type annotation of xs:anyType
.
validate {<a>{5}</a>} instance of element of type xs:integer
This example returns true
if the validation process is successful and the schema definition for element a
calls for content of type xs:integer
.
. instance of element
This example returns true
if the context item is an element node.
[30] | TypeswitchExpr | ::= | (<"typeswitch" "("> Expr ")" CaseClause+ "default" ("$" VarName)? "return")* IfExpr |
[61] | CaseClause | ::= | "case" ("$" VarName "as")? SequenceType "return" Expr |
The typeswitch expression chooses one of several expressions to evaluate based on the dynamic type of an input value.
In a typeswitch
expression, the typeswitch
keyword is followed by an expression enclosed in parentheses, called
the operand expression. This is the expression whose type is being
tested. The
remainder of the typeswitch
expression consists of one or more case
clauses and a default
clause.
Each case
clause specifies a SequenceType followed by a return
expression. The effective case is the first case
clause such that the value of the operand expression matches the SequenceType in the case
clause, using the rules of SequenceType Matching. The value of the typeswitch
expression is the value of the return
expression in the effective case. If the value of the operand
expression is not a value of any type named in a case
clause, the value of the typeswitch
expression is the value of the return
expression in the default
clause.
A case
or default
clause may optionally specify a variable name. Within the return
expression of the case
or default
clause, this variable name is bound to the value of the operand expression, and its static type is considered to be the SequenceType named in the case
or default
clause. If the return
expression does not depend on the value of the operand expression, the variable may be omitted from the case
or default
clause.
The following example shows how a typeswitch
expression might
be used to process an expression in a way that depends on its dynamic type.
typeswitch($customer/billing-address) case $a as element of type USAddress return $a/state case $a as element of type CanadaAddress return $a/province case $a as element of type JapanAddress return $a/prefecture default return "unknown"
[50] | CastExpr | ::= | <"cast" "as"> SingleType ParenthesizedExpr |
[87] | SingleType | ::= | AtomicType "?"? |
Occasionally it is necessary to convert a value to a specific datatype. For this purpose, XQuery provides a cast
expression that creates a new value of a specific type based on an existing value. A cast
expression takes two operands: an input expression and a target type. The type of the input expression is called the input type. The target type must be a named atomic type, represented by a QName, optionally followed by the occurrence indicator ?
if an empty sequence is permitted. The semantics of the cast
expression are as follows:
Atomization is performed on the input expression.
If the result of atomization is a sequence of more than one atomic value, a type error is raised.
If the result of atomization is an empty sequence:
If ?
is specified after the target type, the result of the cast
expression is an empty sequence.
If ?
is not specified after the target type, a type error is raised.
If the result of atomization is a single atomic value, the result of the cast expression depends on the input type and the target type. In general, the cast expression attempts to create a new value of the target type based on the input value. Only certain combinations of input type and target type are supported. The rules are listed below. For the purpose of these rules, we use the terms subtype and supertype in the following sense: if type B is derived from type A by restriction, then B is a subtype of A, and A is a supertype of B.
cast
is supported for the combinations of input type and target type listed in [XQuery 1.0 and XPath 2.0 Functions and Operators]. For each of these combinations, both the input type and the target type are built-in schema types. For example, a value of type xs:string
can be cast into the type xs:decimal
. For each of these built-in combinations, the semantics of casting are specified in [XQuery 1.0 and XPath 2.0 Functions and Operators].
cast
is supported if the input type is a derived atomic type and the target type is a supertype of the input type. In this case, the input value is mapped unchanged into the value space of the target type. For example, if shoesize
is derived by restriction from xs:integer
, a value of type shoesize
can be cast into the type xs:integer
.
cast
is supported if the target type is a derived atomic type and the input type is xs:string
, xs:anySimpleType
, or a supertype of the target type. If the input type is xs:string
or xs:anySimpleType
, its string value must be in the lexical space of the target type, and it is converted to the target type using the schema-defined rules for the target type. If the input type is a supertype of the target type, its value is mapped unchanged into the value space of the target type, and it is checked for conformance to all the facets of the target type (checking of a "pattern" facet may require generating a canonical lexical representation of the input value.)
If a primitive type P1 can be cast into a primitive type P2, then any subtype of P1 can be cast into any subtype of P2, provided that the facets of the target type are satisfied. First the input value is cast to P1 using rule (b) above. Next, the value of type P1 is cast to the type P2, using rule (a) above. Finally, the value of type P2 is cast to the target type, using rule (c) above.
For any combination of input type and target type that is not in the above list, a cast
expression raises a static error.
If casting from the input type to the target type is supported but nevertheless it is not possible to cast the input value into the value space of the target type, a dynamic error is raised. This includes the case when any facet of the target type is not satisfied. For example, cast as xs:integer($x)
raises a dynamic error if the type of $x
is xs:decimal
and its value is 4.99
because this value cannot be represented with zero fractional digits.
[33] | CastableExpr | ::= | ComparisonExpr ( <"castable" "as"> SingleType )? |
XQuery provides a form of a predicate that tests whether a given value is castable into a given target type. The expression V castable as T
returns true
if the value V
can be successfully cast into the target type T
; otherwise it returns false
. The castable
predicate can be used to avoid errors at evaluation time. It can also be used to select an appropriate type for processing of a given value, as illustrated in the following example:
if ($x castable as hatsize) then cast as hatsize($x) else if ($x castable as IQ) then cast as IQ($x) else cast as string($x)
Constructor functions provide an alternative syntax for casting.
For every built-in type T that is defined in [XML Schema], as well as the duration subtypes fn:dayTimeDuration
and fn:yearMonthDuration
, a built-in constructor function is provided. The signature of the built-in constructor function for type T is as follows:
T($x as item) as T
The constructor function for type T accepts any single item (either a node or an atomic value) as input, and returns a value of type T (or raises a dynamic error). Its semantics are exactly the same as a cast
expression with target type T. The built-in constructor functions are described in more detail in [XQuery 1.0 and XPath 2.0 Functions and Operators]. The following are examples of built-in constructor functions:
This example is equivalent to cast as xs:date("2000-01-01")
.
xs:date("2000-01-01")
This example is equivalent to cast as xs:decimal($floatvalue * 0.2E-5)
.
xs:decimal($floatvalue * 0.2E-5)
This example returns a dayTimeDuration
value equal to 21 days. It is equivalent to cast as fn:dayTimeDuration("P21D")
.
fn:dayTimeDuration("P21D")
For each user-defined atomic type T in the in-scope schema definitions, a constructor function is effectively defined. Like the built-in constructor functions, the constructor functions for user-defined types have the same name as the type, accept any item as input, and have semantics identical to a cast
expression with the user-defined type as target type. For example, if usa:zipcode
is a user-defined atomic type in the in-scope schema definitions, then the expression usa:zipcode("12345")
is equivalent to the expression cast as usa:zipcode("12345")
.
If the argument to any constructor function is a literal value, the result of the function may be computed statically, and an error encountered in this process may be reported as a static error.
[51] | TreatExpr | ::= | <"treat" "as"> SequenceType ParenthesizedExpr |
XQuery provides an expression called treat
that can be used to modify the static type of its operand.
Like cast
, the treat
expression takes two operands: an expression and a SequenceType. Unlike cast
, however, treat
does not change the dynamic type or value of its operand. Instead, the purpose of treat
is to ensure that an expression has an expected type at evaluation time.
The semantics of treat as type1 (expr2)
are as follows:
During static analysis (if the Static Typing Feature is implemented):
type1
must be a subtype of the static type of expr2
, using the definition of subtype in [XQuery 1.0 Formal Semantics]--otherwise, a type error is raised. The static type of the treat
expression is type1
. This enables the expression to be used as an argument of a function that
requires a parameter of type1
.
During expression evaluation (at "run-time"):
If expr2
matches type1
, using the SequenceType Matching rules in 2.4.2 SequenceType, the treat
expression returns the value of expr2
; otherwise, it raises a dynamic error. If the value of expr2
is returned, its identity is preserved. The treat
expression ensures that the value of its expression operand conforms to the expected type at run-time.
Example:
treat as element of type USAddress ($myaddress)
The static type of $myaddress
may be element of type Address
, a less specific type than element of type USAddress
. However, at run-time, the value of $myaddress
must match the type element of type USAddress
using SequenceType Matching rules; otherwise a dynamic error is raised.
[49] | ValidateExpr | ::= | (<"validate" "{"> | (<"validate" "context"> SchemaGlobalContext ("/" SchemaContextStep)* "{")) Expr "}" |
Ed. Note: Curly braces in this syntax may cause problems if this expression is embedded in XSLT--see Issue 267.)
A validate
expression validates its argument with respect to the in-scope schema definitions, using the schema validation process described in [XML Schema]. The argument of a validate
expression may be any sequence of elements. Validation replaces element and attribute nodes with new nodes that have their own identity and that contain type
annotations and defaults created by the validation process. If a hierarchy of nodes is validated by a validate
expression, the hierarchical relationship among these nodes will be preserved among the nodes created by the validation process.
The following example
creates and validates a globally-declared person
element:
validate { <person> <name> <first>Elvira</first> <last>Fischbein</last> </name> </person> }
The validate
expression invokes the full schema validation process, except that identity
constraints, as defined in section 3.11.4 of [XML Schema]
Part 1, are not applied. All facets of simple types are checked, and
default values are supplied as defined in the XML Schema
specification.
Validating an expression is equivalent to the following steps:
The value of the expression is converted from the Data Model to an XML Information Set (see [XML Infoset].) This step is equivalent to serializing the value of the expression in XML form and then parsing it to produce an Information Set.
The Information Set produced in the previous step is validated according to the rules in [XML Schema], using the in-scope schema definitions. The result of this step is a Post-Schema Validation Infoset (PSVI). If the validation process is not successful, a type error is raised.
The PSVI produced in the previous step is converted back into the Data Model by the mapping described in [XQuery 1.0 and XPath 2.0 Data Model]. If the Schema Import Feature is not implemented, this mapping maps each user-defined type onto its nearest predefined supertype, as described in 2.6.2 Conformance.
A validate
expression may contain a SchemaContext that is used in validating locally declared elements and attributes. When
a schema context is supplied, all element QNames are interpreted as they
would be if found in that context in an XML document. If the schema context begins with a QName, the QName is interpreted as the name of a globally
declared element; however, if the schema context begins with the keyword type
, the first QName is interpreted as the name of a globally declared type. The steps inside the schema context trace a path relative to the globally declared element or type, as illustrated in the following examples, which are based on schemas defined in [XML Schema], Part 0:
Suppose that $x
is bound to a shipTo
element. Then validate context po:purchaseOrder {$x}
validates the value of $x
in the context of the global element declaration po:purchaseOrder
.
Suppose that $y
is bound to a productName
element. Then validate context po:purchaseOrder/items/item {$y}
validates the value of $y
in the context of an item
element, inside an items
element, inside the global element declaration po:purchaseOrder
.
Suppose that $z
is bound to a zip
element. Then validate context type po:USAddress {$z}
validates the value of $z
in the context of the global type declaration po:USAddress
.
If no context is specified, all top-level names in the material to be validated are treated as global names.
A query consists of a Query Prolog, followed by a Query Body.
The Query Prolog is a series of declarations and definitions
that create the environment for query processing. The Query Prolog may contain namespace declarations, schema imports, an xmlspace
declaration, a default collation, and some function definitions.
The Query Body consists of a sequence of expressions that define the result of the query.
[21] | Query | ::= | QueryProlog QueryBody |
[22] | QueryProlog | ::= | (NamespaceDecl
|
[23] | QueryBody | ::= | ExprSequence? |
[109] | NamespaceDecl | ::= | <"declare" "namespace"> NCNameForPrefix "=" URLLiteral |
[111] | DefaultNamespaceDecl | ::= | (<"default" "element"> | <"default" "function">) "namespace" "=" URLLiteral |
A Namespace Declaration defines a namespace prefix and associates it with a namespace URI, adding the (prefix, URI) pair to the set of in-scope namespaces. The namespace URI must be a valid URI, and may not be a zero-length string. The namespace declaration is in scope throughout the query in which it is declared, unless it is overridden by a namespace declaration attribute in an element constructor.
The following query illustrates a namespace declaration:
declare namespace foo = "http://example.org" <foo:bar> Lentils </foo:bar>
In the query result, the newly created node is in the namespace
associated with the namespace URI http://example.org
.
Multiple declarations of the same namespace prefix in the Query Prolog result in a static error.
{-- Error: multiple declarations of namespace 'xx' --} declare namespace xx = "http://example.org/foo" declare namespace xx = "http://example.org/bar" //xx:bing
It is also a static error to use a QName with a namespace prefix that has not been declared, as in the following example:
{-- Error: use of undeclared namespace prefix --} //xx:bing
In an element constructor, a namespace declaration attribute can be used to bind a prefix to
a namespace, adding a (prefix, URI) pair to the set of in-scope
namespaces. The binding of a prefix by a namespace declaration attribute is effective for the scope of the element in which it occurs, overriding any binding of the same prefix by a higher-level element or by the Query Prolog. If the value of a namespace declaration attribute is not a literal string, a static error is raised. In the data model, a namespace declaration is not an attribute, and
it will not be retrieved by queries that return the attributes of an element.
The
following query illustrates a namespace declaration attribute that binds the prefix foo
within the scope of a constructed element:
<foo:bar xmlns:foo="http://example.org">{ //foo:bing }</foo:bar>
When element or attribute names are compared, they are considered identical if the local part and namespace URI match. Namespace prefixes need not be identical for two names to match, as illustrated by the following example:
declare namespace xx = "http://example.org" let $i := <foo:bar xmlns:foo = "http://example.org"> <foo:bing> Lentils </foo:bing> </foo:bar> return $i/xx:bing
Although the namespace prefixes xx
and foo
differ, both are bound to the namespace URI "http://example.org"
. Since xx:bing
and foo:bing
have the same local name and the same namespace URI, they match. The
output of the above query is as follows.
<foo:bing> Lentils </foo:bing>
Default Namespace Declarations can be used to define namespace URIs to be associated with unprefixed names. The following kinds of default namespace declarations are supported:
default element namespace
defines a namespace URI that is associated with unprefixed names of elements and types.
default function namespace
defines a namespace URI that is associated with unprefixed names of functions.
If no default element namespace is declared, unqualified names of elements and types are in no namespace. If no default function namespace is in effect, unqualified function names are considered to be in the namespace of XPath/XQuery functions, http://www.w3.org/2002/11/xquery-functions
. Unqualified attribute names are never in a namespace,
since XQuery provides no way to declare a default namespace for attributes.
XQuery has four predefined namespace prefixes that are present in the in-scope namespaces before each query is processed. These prefixes may be used without an explicit declaration. Their definitions may be overridden by namespace declarations in the Query Prolog or by namespace declaration attributes on constructed elements. The four predefined namespace prefixes are as follows:
xml = http://www.w3.org/XML/1998/namespace
xs = http://www.w3.org/2001/XMLSchema
xsi = http://www.w3.org/2001/XMLSchema-instance
fn = http://www.w3.org/2002/11/xquery-functions
[114] | SchemaImport | ::= | <"import" "schema"> (StringLiteral | SubNamespaceDecl | DefaultNamespaceDecl) <"at" StringLiteral>? |
[110] | SubNamespaceDecl | ::= | "namespace" NCNameForPrefix "=" URLLiteral |
A Schema Import imports the element and attribute
declarations and type definitions from a schema, mapping them into the Query
Data Model using rules that will be specified in a future edition of
[XQuery 1.0 Formal Semantics]. The URI in a schema import specifies the
namespace to be imported, and optionally the location of the schema in which
the namespace is defined. Importing a schema has no effect on the in-scope
namespaces, since it does not associate a prefix with the namespace. When a
schema is imported, the query generally accompanies the schema import with
appropriate namespace
or default namespace
declarations to make it possible to refer to the names defined in the
schema.
The following query searches for table elements in an XHTML document, after declaring the namespace and schema location for XHTML.
import schema "http://www.w3.org/1999/xhtml" at "http://example.org/xhtml/xhtml.xsd" declare namespace xhtml = "http://www.w3.org/1999/xhtml" document("aspect.xhtml")//xhtml:table
A shorthand notation is provided to allow a schema to be imported, and a namespace prefix to be bound to the target namespace of the schema, in a single step. This shorthand notation is illustrated by the following example, which is equivalent to the previous example:
import schema namespace xhtml="http://www.w3.org/1999/xhtml" at "http://example.org/xhtml/xhtml.xsd" document("aspect.xhtml")//xhtml:table
The shorthand notation includes two URI's: the first one identifies a namespace and the second identifies a schema location. If the given namespace is not the target namespace of the schema at the given location, a static error is raised.
It is a static error to import two schemas that both define the same name in the same symbol space and in the same scope. For instance, a query may not import two schemas that provide global element declarations for two elements with the same expanded name.
[107] | XMLSpaceDecl | ::= | <"declare" "xmlspace"> "=" ("preserve" | "strip") |
The xmlspace declaration in a Query Prolog controls whether boundary whitespace is preserved by element and attribute constructors during execution of the query, as described in 3.7.3 Whitespace in Constructors. If xmlspace = preserve
is specified, boundary whitespace is preserved. If xmlspace = strip
is specified or if no xmlspace declaration is present, boundary whitespace is stripped (deleted).
The following example illustrates an xmlspace declaration:
declare xmlspace = preserve
[108] | DefaultCollationDecl | ::= | <"default" "collation" "="> URLLiteral |
A Query Prolog may declare a default collation, which is the name of the collation to be used by all functions and operators that require a collation if no other collation is specified. For example, the gt
operator on strings is defined by a call to the fn:compare
function, which takes an optional collation parameter. Since the gt
operator does not specify a collation, the fn:compare
function implements gt
by using the default collation specified in the Query Prolog. The default collation is identified by a literal string containing a URI.
The following example illustrates a declaration of a default collation:
default collation = "http://example.org/languages/Icelandic"
If a Query Prolog specifies no default collation, the Unicode codepoint collation (http://www.w3.org/2002/08/query-operators/collation/codepoint) is used. If a Query Prolog specifies more than one default collation, or if the value specified for a default collation is not a string literal, a static error is raised.
In addition to the built-in functions described in [XQuery 1.0 and XPath 2.0 Functions and Operators], XQuery allows users to define functions of their own. A function definition specifies the name of the function, the names and datatypes of the parameters, and the datatype of the result. All datatypes are specified using the syntax described in 2.4.2 SequenceType. A function definition also includes an expression called the function body that defines how the result of the function is computed from its parameters.
[112] | FunctionDefn | ::= | <"define" "function"> <QName "("> ParamList? (")" | (<")" "as"> SequenceType)) EnclosedExpr |
[113] | ParamList | ::= | Param ("," Param)* |
[82] | Param | ::= | "$" VarName TypeDeclaration? |
The name of a function may be qualified with a namespace. The default namespace for functions is the namespace of the XML Query 1.0 and XPath 2.0 Functions and Operators, so these functions can be used without prefixes. The default namespace for functions may be changed by a default namespace declaration, as in this example:
default function namespace = "www.mylib.com"
If a function parameter is declared using a name but no type, its default type is xs:anyType
. If the returns
clause is omitted from a function definition, its default return type is xs:anyType
.
The following example illustrates the definition and use of a function that
accepts a sequence of employee
elements, summarizes them by department, and returns a sequence of dept
elements.
Using a function, prepare a summary of employees that are located in Denver.
define function summary($emps as element employee*) as element dept* { for $d in distinct-values($emps/deptno) let $e := $emps[deptno = $d] return <dept> {$d} <headcount> {count($e)} </headcount> <payroll> {sum($e/salary)} </payroll> </dept> } summary(document("acme_corp.xml")//employee[location = "Denver"])
The type of a function parameter or result may be a global type (declared as a top-level typename in some schema) or a local type (declared at some level of nesting inside a schema). Function parameters and results of local type can be declared with the help of a SchemaContext, as in the following example:
define function price($p as element product in type catalog) as element USPrice in type catalog/product { $p/USPrice }
Rules for converting function arguments to their declared parameter types, and for converting the result of a function to its declared result type, are described in 3.1.4 Function Calls
A function may be defined recursively--that is, it may reference its own
definition. Mutually recursive functions, whose bodies reference each other,
are also allowed. The following example defines a recursive function that
computes the maximum depth of an element hierarchy, and calls the function to
find the maximum depth of a particular document. In its definition, the
user-defined function depth
calls the built-in functions empty
and max
.
Find the maximum depth of the document named partlist.xml
.
define function depth($e as element) as xs:integer { {-- An empty element has depth 1 --} {-- Otherwise, add 1 to max depth of children --} if (empty($e/*)) then 1 else max(for $c in $e/* return depth($c)) + 1 } depth(document("partlist.xml"))
In XQuery 1.0, user-defined functions may not be overloaded. Only one
function definition may have a given name. We consider function overloading to
be a useful and important feature that deserves further study in future
versions of XQuery. Although XQuery does not allow overloading of user-defined
functions, some of the built-in functions in the XQuery core library are
overloaded--for example, the string
function of XPath can convert an instance of almost any type into a
string.
Since a constructor function is effectively defined for every user-defined atomic type in the in-scope schema definitions, a static error is raised if the Query Prolog attempts to define a function with the same name as any of these types.
Note:
If a future version of XQuery supports function overloading, an ambiguity may arise between a function that takes a node as parameter and a function with the same name that takes an atomic value as parameter (since a function call automatically extracts the atomic value of a node when necessary). The designers of such a future version of XQuery can avoid this ambiguity by writing suitable rules to govern function overloading. Nevertheless, users who are concerned about this possibility may choose to explicitly extract atomic values from nodes when calling functions that expect atomic values.
In previous sections, we have focused on explaining the meaning of the syntactic constructs of XQuery. This section contains examples of several important classes of queries that can be expressed using the syntax described in earlier sections. In some cases we describe functions introduced to support specific usage scenarios. In others, we show particular ways to combine operators that have already been introduced. The applications described here include joins across multiple data sources, grouping and aggregates, queries based on sequential relationships, and recursive transformations.
Joins, which combine data from multiple sources into a single result, are a very important type of query. In this section we will illustrate how several types of joins can be expressed in XQuery. We will base our examples on the following three documents:
A document named
parts.xml
that
contains many
part
elements;
each part
element in turn
contains
partno
and
description
subelements.
A document named
suppliers.xml
that
contains many
supplier
elements; each
supplier
element in turn
contains
suppno
and
suppname
subelements.
A document named
catalog.xml
that
contains information
about the
relationships between
suppliers and
parts. The catalog
document contains many
item
elements,
each of which in turn
contains
partno
,
suppno
, and
price
subelements.
A conventional ("inner") join returns information from two or more related sources, as illustrated by the following example, which combines information from three documents. The example generates a "descriptive catalog" derived from the catalog document, but containing part descriptions instead of part numbers and supplier names instead of supplier numbers. The new catalog is ordered alphabetically by part description and secondarily by supplier name.
<descriptive-catalog> { for $i in document("catalog.xml")//item, $p in document("parts.xml")//part[partno = $i/partno], $s in document("suppliers.xml")//supplier[suppno = $i/suppno] order by $p/description, $s/suppname return <item> { $p/description, $s/suppname, $i/price } </item> } </descriptive-catalog>
The previous query returns information only about parts that have suppliers and suppliers that have parts. An outer join is a join that preserves information from one or more of the participating sources, including elements that have no matching element in the other source. For example, a left outer join between suppliers and parts might return information about suppliers that have no matching parts.
The following query demonstrates a left outer join. It returns names of all the suppliers in alphabetic order, including those that supply no parts. In the result, each supplier element contains the descriptions of all the parts it supplies, in alphabetic order.
for $s in document("suppliers.xml")//supplier order by $s/suppname return <supplier> { $s/suppname, for $i in document("catalog.xml")//item [suppno = $s/suppno], $p in document("parts.xml")//part [partno = $i/pno] order by $p/description return $p/description } </supplier>
The previous query preserves information about
suppliers that supply no parts. Another type of join,
called a full outer join, might be used
to preserve information about both suppliers that
supply no parts and parts that have no supplier. The
result of a full outer join can be structured in any
of several ways. The following query generates a list
of supplier
elements, each containing
nested part
elements for the parts that
it supplies (if any), followed by a list of
part
elements for the parts that have no
supplier. This might be thought of as a
"supplier-centered" full outer join. Other forms of
outer join queries are also possible.
<master-list> { for $s in document("suppliers.xml")//supplier order by $s/suppname return <supplier> { $s/suppname, for $i in document("catalog.xml")//item [suppno = $s/suppno], $p in document("parts.xml")//part [partno = $i/partno] order by $p/description return <part> { $p/description, $i/price } </part> } </supplier> , {-- parts that have no supplier --} <orphan-parts> { for $p in document("parts.xml")//part where empty(document("catalog.xml")//item [partno = $p/partno] ) order by $p/description return $p/description } </orphan-parts> } </master-list>
The previous query uses an element constructor to
enclose its output inside a master-list
element. The concatenation operator (",") is used to
combine the two main parts of the query. The result is
an ordered sequence of supplier
elements
followed by an orphan-parts
element that
contains descriptions of all the parts that have no
supplier.
Many queries
involve forming data into groups and
applying some aggregation function
such as count
or
avg
to each group. The
following example shows how such a
query might be expressed in XQuery,
using the catalog document defined in
the previous section.
This query finds the part number and average price for parts that have at least 3 suppliers.
for $pn in distinct-values(document("catalog.xml")//partno) let $i := document("catalog.xml")//item[partno = $pn] where count($i) >= 3 order by $pn return <well-supplied-item> {$pn} <avgprice> {avg($i/price)} </avgprice> </well-supplied-item>
The distinct-values
function
in this query eliminates duplicate
part numbers from the set of all part
numbers in the catalog document. The
result of distinct-values
is a
sequence in which order is not
significant.
Note that $pn
, bound by a
for clause, represents an individual
part number, whereas $i
, bound by a
let clause, represents a set of items
which serves as argument to the
aggregate functions
count($i)
and
avg($i/price)
. The query
uses an element constructor to enclose
each part number and average price in
a containing element called
well-supplied-item
.
XQuery uses the
<<
and >>
operators to compare nodes based on document
order. Although these operators are quite simple, they
can be used to express complex queries for XML
documents in which sequence is meaningful. The first
two queries in this section involve a surgical report
that contains procedure
,
incision
, instrument
,
action
, and anesthesia
elements.
The following query returns all the
action
elements that occur between the
first and second incision
elements inside
the first procedure. The original document order
among these nodes is preserved in the result of the
query.
let $proc := input()//procedure[1] for $i in $proc//action where $i >> ($proc//incision)[1] and $i << ($proc//incision)[2] return $i
It is worth noting here that document order is
defined in such a way that a node is considered to
precede its descendants in document order. In the
surgical report, an action
is never part
of an incision
, but an
instrument
is. Since the
>>
operator is based on document
order, the predicate $i >>
($proc//incision)[1]
is true for any
instrument
element that is a descendant
of the first incision
element in the
first procedure.
For some queries, it may be
helpful to define a function that can test whether a
node precedes another node without being its
ancestor. The following function returns
true
if its first operand precedes its
second operand but is not an ancestor of its second
operand; otherwise it returns false
:
define function precedes($a as node, $b as node) as boolean { $a << $b and empty($a//node() intersect $b) }
Similarly, a follows
function could be written:
define function follows($a as node, $b as node) as boolean { $a >> $b and empty($b//node() intersect $a) }
Using the precedes
function, we can write a
query that finds instrument
elements between the first
two incisions, excluding from the query result any
instrument
that is a descendant of the first
incision
:
let $proc := input()//procedure[1] for $i in $proc//instrument where precedes(($proc//incision)[1], $i) and precedes($i, ($proc//incision)[2]) return $i
The following query reports incisions for which no prior anesthesia
was recorded in the surgical report. Since an anesthesia
is never part of an incision
, we can use
<<
instead of the less-efficient
precedes
function:
for $p in input()//procedure where some $i in $proc//incision satisfies empty($proc//anesthesia[. << $i]) return $p
In some documents, particular sequences
of elements may indicate a logical hierarchy.
This is most commonly true of HTML. The following
query returns the introduction of an XHTML document,
wrapping it in a div
element. In this example, we
assume that an h2
element containing the text
"Introduction" marks the beginning of the introduction,
and the introduction continues until the next h2
or h1
element, or the end of the document, whichever
comes first.
let $intro := input()//h2[text()="Introduction"], $next-h := input()//(h1|h2)[. >> $intro][1] return <div> { $intro, if (empty($next-h)) then //node()[. >> $intro] else //node()[. >> $intro and . << $next-h] } </div>
Note that the above query makes explicit the hierarchy that was implicit in the
original document. In this example, we assume that the h2
element containing the text "Introduction" has no subelements.
Occasionally it is necessary to scan over a hierarchy of elements, applying some transformation at each level of the hierarchy. In XQuery this can be accomplished by defining a recursive function. In this section we will present two examples of such recursive functions.
Suppose that we need to compute a table of contents for a given document by scanning over the document, retaining only elements named section
or title
, and preserving the hierarchical relationships among these elements. For each section
, we retain subelements named section
or title
; but for each title
, we retain the full content of the element. This might be accomplished by the following recursive function:
define function sections-and-titles($n as node) as node? { if (local-name($n) = "section") then element { local-name($n) } { for $c in $n/* return sections-and-titles($c) } else if (local-name($n) = "title") then $n else ( ) }
The "skeleton" of a given document, containing only its sections and titles, can then be obtained by invoking the sections-and-titles
function on the root node of the document, as follows:
sections-and-titles(document("cookbook.xml"))
As another example of a recursive transform, suppose that we wish to scan over a document, transforming every attribute named color
to an element named color
, and every element named size
to an attribute named size
. This can be accomplished by the following recursive function:
define function swizzle($n as node) as node { if ($n instance of attribute and local-name($n) = "color") then element color { string($n) } else if ($n instance of element and local-name($n) = "size") then attribute size { string($n) } else if ($n instance of element) then element { local-name($n) } { for $c in $n/* return swizzle($c) } else $n }
The transformation can be applied to a whole document by invoking the swizzle
function on the root node of the document, as follows:
swizzle(document("plans.xml"))
A character is an atomic unit of text as specified by ISO/IEC 10646 [ISO/IEC 10646] (see also [ISO/IEC 10646-2000]). Legal characters are those allowed in the [XML] recommendation.
A lexical pattern is a rule that describes how a sequence of characters can match a grammar unit. A lexeme is the smallest meaningful unit in the grammar that has syntactic interpretation. A token is a symbol that matches lexemes, and is the output of the lexical analyzer. A token symbol is the symbolic name given to that token. A single token may be composed of one or more lexemes. If there is more than one lexeme, they may be separated by whitespace or punctuation. For instance, a token AxisDescendantOrSelf might have two lexemes, "descendant-or-self" and "::".
Pattern | Lexeme(s) | Token Names (for example) |
---|---|---|
"or" | "or" | Or |
"=" | "=" | Equals |
(Prefix ':')? LocalPart | "p" | QName |
":" | ||
"foo" | ||
<"descendant-or-self" "::"> | "descendant-or-self" | AxisDescendantOrSelf |
"::" |
When patterns are simple string matches, the strings are embedded directly into the BNF. In other cases, token symbols are used when the pattern is a more complex regular expression (the major cases of these are NCName, QName, and Number and String literals). It is up to an implementation to decide on the exact tokenization strategy, which may be different depending on the parser construction. For example, an implementation may decide that a token named For
is composed of only "for", or may decide that it is composed of ("for" "$"). In the first case the implementation may decide to use lexical lookahead to distinguish the "for" lexeme from a QName that has the lexeme "for". In the second case, the implementation may decide to combine the two lexemes into a single "long" token. In either case, the end grammatical result will be the same. In the
BNF, the notation "< ... >" is used to indicate and delimit a sequence
of lexemes that must be recognized using lexical lookahead or some
equivalent means.
This grammar implies lexical states, which are lexical constraints on the tokenization process based on grammatical positioning. The exact structure of these states is left to the implementation, but the normative rules for calculating these states are given in the A.1.2 Lexical Rules section.
When tokenizing, the longest possible match that is valid in the current lexical state is prefered .
For readability, Whitespace may be used in most expressions even though not explicitly notated in the BNF. Whitespace may be freely added between lexemes, except a few cases where whitespace is needed to disambiguate the token. For instance, in XML, "-" is a valid character in an element or attribute name. When used as an operator after the characters of a name, it must be separated from the name, e.g. by using whitespace or parentheses.
Special whitespace notation is specified with the BNF productions, when it is different from the default rules. "ws: explicit" means that where whitespace is allowed must be explicitly notated in the BNF. "ws: significant" means that whitespace is significant as value content.
For XQuery, Whitespace is not freely allowed in the non-computed Constructor productions, but is specified explicitly in the grammar, in order to be more consistent with XML. The lexical states where whitespace must have explicit specification are as follows: START_TAG, END_TAG, ELEMENT_CONTENT, XML_COMMENT, PROCESSING_INSTRUCTION, PROCESSING_INSTRUCTION_CONTENT, CDATA_SECTION, QUOT_ATTRIBUTE_CONTENT, and APOS_ATTRIBUTE_CONTENT.
All keywords are case sensitive.
Character Classes
The following basic tokens are defined in [XML].
Identifiers
The following identifier components are defined in [XML Names].
String Literals and Numbers
[1] | IntegerLiteral | ::= | Digits |
[2] | DecimalLiteral | ::= | ("." Digits) | (Digits "." [0-9]*) |
[3] | DoubleLiteral | ::= | (("." Digits) | (Digits ("." [0-9]*)?)) ("e" | "E") ("+" | "-")? Digits |
[4] | StringLiteral
(ws: significant) | ::= | ('"' (('"' '"') | [^"])* '"') | ("'" (("'" "'") | [^'])* "'") |
[5] | URLLiteral
(ws: significant) | ::= | ('"' (('"' '"') | [^"])* '"') | ("'" (("'" "'") | [^'])* "'") |
Comments
Comments are lexical constructs only, and do not affect the processing of an expression. They are allowed whereever whitespace is allowed, as long as the whitespace notation in not 'explicit' or 'significant'.
[6] | ExprComment | ::= | "{--" [^}]* "--}" |
Defined Tokens
The following is a list of defined tokens for the XQuery grammar.
[7] | S | ::= | WhitespaceChar+ |
[8] | Nmstart | ::= | Letter | "_" |
[9] | Nmchar | ::= | Letter | CombiningChar | Extender | Digit | "." | "-" | "_" |
[10] | Digits | ::= | [0-9]+ |
[11] | EscapeQuot | ::= | '"' '"' |
[12] | PITarget | ::= | NCName |
[13] | VarName | ::= | QName |
[14] | NCNameForPrefix | ::= | Nmstart Nmchar* |
[15] | PredefinedEntityRef | ::= | "&" ("lt" | "gt" | "amp" | "quot" | "apos") ";" |
[16] | HexDigits | ::= | ([0-9] | [a-f] | [A-F])+ |
[17] | CharRef | ::= | "&#" (Digits | ("x" HexDigits)) ";" |
[18] | EscapeApos | ::= | "''" |
[19] | Char | ::= | ([#x0009] | [#x000D] | [#x000A] | [#x0020-#xFFFD]) |
[20] | WhitespaceChar | ::= | ([#x0009] | [#x000D] | [#x000A] | [#x0020]) |
The lexical contexts and transitions between lexical contexts is described in terms of a series of states and transitions between those states.
As discussed above, there are various strategies that can be used by an implementation to disambiguate token symbol choices. Among the choices are lexical look-ahead and look-behind, a two-pass lexical evaluation, and a single recursive descent lexical evaluation and parse. This specification does not dictate what strategy to use. An implementation need not follow this approach in implementing lexer rules, but does need to conform to the results. For instance, instead of using a state automaton, an implementation might use lexical look-behind, or might use a full context-free-grammar parse, or it might make extensive use of parser lookahead (and use a more ambiguous token strategy).
The tables below define the complete lexical rules for XQuery. Each table corresponds to a lexical state in which the tokens listed are recognized only in that state. When a given token is recognized in the given state, the transition to the next state is given. In some cases, a transition will "push" the current state or a specific state onto an abstract stack, and will later restore that state by a "pop" when another lexical event occurs.
The lexical states have in many cases close connection to the parser productions. However, just because a token is recognized in a certain lexical state, does not mean it will be legal in the parser state.
This state is for patterns that can be recognized in any state.
Pattern | Transition To State |
---|---|
WhitespaceChar
Nmstart Nmchar Digits HexDigits | (maintain current state) |
This state is for patterns that occur at the beginning of an expression.
Pattern | Transition To State |
---|---|
"?" "[" "+" "-" "(" <"text" "("> <"comment" "("> <"node" "("> <"processing-instruction" "("> ";" <"if" "("> <QName "("> <"at" StringLiteral> <"validate" "context"> <"define" "function"> | DEFAULT |
"{" <"validate" "{"> | DEFAULT pushState(DEFAULT) |
<"attribute" QName "{"> <"element" QName "{"> <"element" "{"> <"document" "{"> <"attribute" "{"> <"text" "{"> | DEFAULT pushState(DEFAULT) |
"]" IntegerLiteral DecimalLiteral DoubleLiteral <"typeswitch" "("> <"stable" "order" "by"> <"type" QName> "*" <NCName ":" "*"> <"*" ":" NCName> "." ".." ")" StringLiteral | OPERATOR |
<"of" "type"> "/" "//" <"child" "::"> <"descendant" "::"> <"parent" "::"> <"attribute" "::"> <"self" "::"> <"descendant-or-self" "::"> "@" | QNAME |
<"default" "collation" "="> <"declare" "namespace"> | NAMESPACEDECL |
<"default" "element"> <"default" "function"> <"import" "schema"> | NAMESPACEKEYWORD |
<"declare" "xmlspace"> | XMLSPACE_DECL |
<"cast" "as"> <"treat" "as"> <")" "as"> | ITEMTYPE |
"$" <"for" "$"> <"let" "$"> <"some" "$"> <"every" "$"> | VARNAME |
| START_TAG pushState(OPERATOR) |
"<!--" | XML_COMMENT pushState() |
"<?" | PROCESSING_INSTRUCTION pushState() |
"<![CDATA[" | CDATA_SECTION pushState() |
S
| (maintain state) |
"," | resetParenStateOrSwitch(DEFAULT) |
ExprComment
| (maintain state) |
"}" | popState |
This state is for patterns that are defined for operators.
Pattern | Transition To State |
---|---|
"/" "//" "div" "idiv" "mod" "and" "or" "*" "return" "then" "else" "to" "union" "intersect" "except" "=" "is" "!=" "isnot" "<=" ">=" "<" ">" "|" "<<" ">>" "eq" "ne" "gt" "ge" "lt" "le" "in" "context" "where" <"order" "by"> "satisfies" "at" ":=" "?" "[" "+" "-" "(" ";" <"at" StringLiteral> "item" "node" "document" "comment" "text" <"define" "function"> | DEFAULT |
"{" <"validate" "{"> | DEFAULT pushState(DEFAULT) |
"]" IntegerLiteral DecimalLiteral DoubleLiteral <"typeswitch" "("> <"stable" "order" "by"> "collation" <NCName ":" "*"> <"*" ":" NCName> "." ".." ")" "ascending" "descending" <"empty" "greatest"> <"empty" "least"> StringLiteral "default" | OPERATOR |
<"of" "type"> | QNAME |
<"default" "collation" "="> <"declare" "namespace"> | NAMESPACEDECL |
<"default" "element"> <"default" "function"> <"import" "schema"> | NAMESPACEKEYWORD |
<"declare" "xmlspace"> | XMLSPACE_DECL |
<"instance" "of"> <"castable" "as"> "case" "as" <")" "as"> | ITEMTYPE |
"$" <"for" "$"> <"let" "$"> <"some" "$"> <"every" "$"> | VARNAME |
S
| (maintain state) |
"," | resetParenStateOrSwitch(DEFAULT) |
ExprComment
| (maintain state) |
"}" | popState |
When a qualified name is expected, and it is required to remove ambiguity from patterns that look like keywords, this state is used.
Pattern | Transition To State |
---|---|
"(" <"text" "("> <"comment" "("> <"node" "("> <"processing-instruction" "("> ";" | DEFAULT |
"*" <NCName ":" "*"> <"*" ":" NCName> "." ".." ")" | OPERATOR |
"/" "//" <"child" "::"> <"descendant" "::"> <"parent" "::"> <"attribute" "::"> <"self" "::"> <"descendant-or-self" "::"> "@" | QNAME |
<")" "as"> | ITEMTYPE |
"$" | VARNAME |
S
| (maintain state) |
"," | resetParenStateOrSwitch(DEFAULT) |
ExprComment
| (maintain state) |
This state occurs inside of a namespace declaration, and is needed to recognize a NCName that is to be used as the prefix, as opposed to allowing a QName to occur. (Otherwise, the difference between NCName and QName are ambiguous.)
Pattern | Transition To State |
---|---|
URLLiteral
| DEFAULT |
"=" NCNameForPrefix | NAMESPACEDECL |
S
| (maintain state) |
ExprComment
| (maintain state) |
This state occurs at places where the keyword "namespace" is expected, which would otherwise be ambiguous compared to a QName. QNames can not occur in this state.
Pattern | Transition To State |
---|---|
StringLiteral
| OPERATOR |
"namespace" | NAMESPACEDECL |
S
| (maintain state) |
ExprComment
| (maintain state) |
This state occurs at places where the keywords "preserve" and "strip" is expected to support "declare xmlspace". QNames can not occur in this state.
Pattern | Transition To State |
---|---|
"preserve" "strip" | DEFAULT |
"=" | (maintain state) |
ExprComment
| (maintain state) |
This state distinguishes tokens that can occur only inside the ItemType production.
Pattern | Transition To State |
---|---|
"attribute" "element" "node" "document" "comment" "text" "processing-instruction" "item" "untyped" <"atomic" "value"> AtomicType "empty" | DEFAULT |
"{" <"validate" "{"> | DEFAULT pushState(DEFAULT) |
<NCName ":" "*"> <"*" ":" NCName> "." ".." ")" | OPERATOR |
<")" "as"> | ITEMTYPE |
"$" | VARNAME |
S
| (maintain state) |
ExprComment
| (maintain state) |
This state differentiates variable names from qualified names. This allows only the pattern of a QName to be recognized when otherwise ambiguities could occur.
Pattern | Transition To State |
---|---|
VarName
| OPERATOR |
ExprComment
| (maintain state) |
This state allows attributes in the native XML syntax, and marks the beginning of an element construction. Element constructors also push the current state, popping it at the conclusion of an end tag. In the START_TAG state, the string ">" is recognized as a token which is associated with the transition to the original state.
Pattern | Transition To State |
---|---|
| DEFAULT pushState() |
">" | ELEMENT_CONTENT |
'"' | QUOT_ATTRIBUTE_CONTENT |
"'" | APOS_ATTRIBUTE_CONTENT |
S
| (maintain state) |
QName
| (maintain state) |
"=" | (maintain state) |
"/>" | popState |
This state allows XML-like content, without these characters being misinterpreted as expressions. The character "{" marks a transition to the DEFAULT state, i.e. the start of an embedded expression, and the "}" character pops back to the ELEMENT_CONTENT state. To allow curly braces to be used as character content, a double left or right curly brace is interpreted as a single curly brace character. The string "</" is interpreted as the beginning of an end tag, which is associated with a transition to the END_TAG state.
Pattern | Transition To State |
---|---|
| DEFAULT pushState() |
"<" | START_TAG pushState() |
"</" | END_TAG |
"<!--" | XML_COMMENT pushState() |
"<?" | PROCESSING_INSTRUCTION pushState() |
"<![CDATA[" | CDATA_SECTION pushState() |
"]]>" | popState |
ExprComment
| (maintain state) |
PredefinedEntityRef
CharRef | (maintain state) |
"{{" "}}" | (maintain state) |
Char
| (maintain state) |
When the end tag is terminated, the state is popped to the state that was pushed at the start of the corresponding start tag.
Pattern | Transition To State |
---|---|
| DEFAULT pushState() |
S
| (maintain state) |
QName
| (maintain state) |
">" | popState |
The "<--" token marks the beginning of an XML Comment, and the "-->" token marks the end. This allows no special interpretation of other characters in this state.
Pattern | Transition To State |
---|---|
Char
| (maintain state) |
"-->" | popState |
In this state, only lexemes that are legal in a processing instruction name are recognized.
Pattern | Transition To State |
---|---|
PITarget
| PROCESSING_INSTRUCTION_CONTENT |
In this state, only characters are that are legal in processing instruction content are recognized.
Pattern | Transition To State |
---|---|
Char
| (maintain state) |
"?>" | popState |
In this state, only lexemes that are legal in a CDATA section are recognized.
Pattern | Transition To State |
---|---|
"]]>" | popState |
Char
| (maintain state) |
This state allows content legal for attributes. The character "{" marks a transition to the DEFAULT state, i.e. the start of an embedded expression, and the "}" character pops back to the original state. To allow curly braces to be used as character content, a double left or right curly brace is interpreted as a single curly brace character. This state is the same as QUOT_ATTRIBUTE_CONTENT, except that apostrophes are allowed without escaping, and an unescaped quote marks the end of the state.
Pattern | Transition To State |
---|---|
| DEFAULT pushState() |
'"' | START_TAG |
EscapeQuot
| QUOT_ATTRIBUTE_CONTENT |
PredefinedEntityRef
CharRef | (maintain state) |
"{{" "}}" | (maintain state) |
Char
| (maintain state) |
"}" | popState |
This state is the same as QUOT_ATTRIBUTE_CONTENT, except that quotes are allowed, and an unescaped apostrophe marks the end of the state.
Pattern | Transition To State |
---|---|
| DEFAULT pushState() |
"'" | START_TAG |
EscapeApos
| APOS_ATTRIBUTE_CONTENT |
PredefinedEntityRef
CharRef | (maintain state) |
"{{" "}}" | (maintain state) |
Char
| (maintain state) |
The following grammar uses the same Basic EBNF notation as [XML], except that grammar symbols always have initial capital letters. The EBNF contains the lexemes embedded in the productions.
Note:
Note that the Semicolon character is reserved for future use.
Under certain circumstances, an atomic value can be promoted from one type to another. Type promotion is used in function calls (see 3.1.4 Function Calls) and in processing of operators that accept numeric operands (listed in the tables below). The following type promotions are permitted:
A value of type xs:float
(or any type derived by restriction from xs:float
) can be promoted to the
type xs:double
. The result is the xs:double
value that is the same as the original value.
A value of type xs:decimal
(or any type derived by restriction from xs:decimal
) can be
promoted to either of the types xs:float
or xs:double
. The result is the value of the target type that is closest to the original value.
Note that promotion is different from subtype substitution. For example:
A function that expects a parameter $p
of type xs:float
can be invoked with a value of type xs:decimal
. This is an example of promotion. The value is actually converted to the expected type. Within the body of the function, $p instance of xs:decimal
returns false
.
A function that expects a parameter $p
of type xs:decimal
can be invoked with a value of type xs:integer
. This is an example of subtype substitution. The value retains its original type. Within the body of the function, $p instance of xs:integer
returns true
.
The tables in this section list the combinations of types for which the various operators of XQuery are defined. For each valid combination of types, the table indicates the function(s) that are used to implement the operator and the type of the result. Definitions of the functions can be found in [XQuery 1.0 and XPath 2.0 Functions and Operators]. Note that in some cases the function does not implement the full semantics of the given operator. For a complete description of each operator (including its behavior for empty sequences or sequences of length greater than one), see the descriptive material in the main part of this document.
Operators listed in the tables may be validly applied to operands whose types are derived by restriction from the listed operand types. For example, a table entry indicates that the gt
operator may be applied to two xs:date
operands, returning xs:boolean
. Therefore, the gt
operator may also be applied to two (possibly different) subtypes of xs:date
, also returning xs:boolean
.
In the operator tables, the term numeric refers to
the types xs:integer
, xs:decimal
,
xs:float
, and xs:double
. An operator whose operands and result are designated as numeric might be thought of as representing four operators, one for each of the numeric types. For example, the numeric +
operator might be thought of as representing the following four operators:
Operator | First operand type | Second operand type | Result type |
+ | xs:integer | xs:integer | xs:integer |
+ | xs:decimal | xs:decimal | xs:decimal |
+ | xs:float | xs:float | xs:float |
+ | xs:double | xs:double | xs:double |
A numeric operator accepts operands of the four numeric types and any type that is derived by restriction from one of the four numeric types. If the result type of an operator is listed as numeric, it means "the first numeric type, in promotion order, into which all operands can be converted by subtype substitution and promotion." As an example, suppose that the type hatsize
is derived from xs:integer
and the type shoesize
is derived from xs:float
. Then if the +
operator is invoked with operands of type hatsize
and shoesize
, it returns a result of type xs:float
. Similarly, if +
is invoked with two operands of type shoesize
it returns a result of type xs:integer
.
In the following tables,
the term Gregorian refers to the types
xs:gYearMonth
, xs:gYear
,
xs:gMonthDay
, xs:gDay
, and
xs:gMonth
. For binary operators that accept two
Gregorian-type operands, both operands must have the same type (for
example, if one operand is of type xs:gDay
, the other
operand must be of type xs:gDay
.)
Operator | Type(A) | Type(B) | Function | Result type |
---|---|---|---|---|
A + B | numeric | numeric | op:numeric-add(A, B) | numeric |
A + B | xs:date | fn:yearMonthDuration | op:add-yearMonthDuration-to-date(A, B) | xs:date |
A + B | fn:yearMonthDuration | xs:date | op:add-yearMonthDuration-to-date(B, A) | xs:date |
A + B | xs:date | fn:dayTimeDuration | op:add-dayTimeDuration-to-date(A, B) | xs:date |
A + B | fn:dayTimeDuration | xs:date | op:add-dayTimeDuration-to-date(B, A) | xs:date |
A + B | xs:time | fn:dayTimeDuration | op:add-dayTimeDuration-to-time(A, B) | xs:time |
A + B | fn:dayTimeDuration | xs:time | op:add-dayTimeDuration-to-time(B, A) | xs:time |
A + B | xs:datetime | fn:yearMonthDuration | op:add-yearMonthDuration-to-dateTime(A, B) | xs:dateTime |
A + B | fn:yearMonthDuration | xs:datetime | op:add-yearMonthDuration-to-dateTime(B, A) | xs:dateTime |
A + B | xs:datetime | fn:dayTimeDuration | op:add-dayTimeDuration-to-dateTime(A, B) | xs:dateTime |
A + B | fn:dayTimeDuration | xs:datetime | op:add-dayTimeDuration-to-dateTime(B, A) | xs:dateTime |
A + B | fn:yearMonthDuration | fn:yearMonthDuration | op:add-yearMonthDurations(A, B) | fn:yearMonthDuration |
A + B | fn:dayTimeDuration | fn:dayTimeDuration | op:add-dayTimeDurations(A, B) | fn:dayTimeDuration |
A - B | numeric | numeric | op:numeric-subtract(A, B) | numeric |
A - B | xs:date | xs:date | op:subtract-dates(A, B) | fn:dayTimeDuration |
A - B | xs:date | fn:yearMonthDuration | op:subtract-yearMonthDuration-from-date(A, B) | xs:date |
A - B | xs:date | fn:dayTimeDuration | op:subtract-dayTimeDuration-from-date(A, B) | xs:date |
A - B | xs:time | xs:time | op:subtract-times(A, B) | fn:dayTimeDuration |
A - B | xs:time | fn:dayTimeDuration | op:subtract-dayTimeDuration-from-time(A, B) | xs:time |
A - B | xs:datetime | xs:datetime | fn:subtract-dateTimes-yielding-dayTimeDuration(A, B) | fn:dayTimeDuration |
A - B | xs:datetime | fn:yearMonthDuration | op:subtract-yearMonthDuration-from-dateTime(A, B) | xs:dateTime |
A - B | xs:datetime | fn:dayTimeDuration | op:subtract-dayTimeDuration-from-dateTime(A, B) | xs:dateTime |
A - B | fn:yearMonthDuration | fn:yearMonthDuration | op:subtract-yearMonthDurations(A, B) | fn:yearMonthDuration |
A - B | fn:dayTimeDuration | fn:dayTimeDuration | op:subtract-dayTimeDurations(A, B) | fn:dayTimeDuration |
A * B | numeric | numeric | op:numeric-multiply(A, B) | numeric |
A * B | fn:yearMonthDuration | xs:decimal | op:multiply-yearMonthDuration(A, B) | fn:yearMonthDuration |
A * B | xs:decimal | fn:yearMonthDuration | op:multiply-yearMonthDuration(B, A) | fn:yearMonthDuration |
A * B | fn:dayTimeDuration | xs:decimal | op:multiply-dayTimeDuration(A, B) | fn:dayTimeDuration |
A * B | xs:decimal | fn:dayTimeDuration | op:multiply-dayTimeDuration(B, A) | fn:dayTimeDuration |
A idiv B | xs:integer | xs:integer | op:integer-div(A, B) | xs:integer |
A div B | numeric | numeric | op:numeric-divide(A, B) | numeric; but xs:double if both operands are xs:integer |
A div B | fn:yearMonthDuration | xs:decimal | op:divide-yearMonthDuration(A, B) | fn:yearMonthDuration |
A div B | fn:dayTimeDuration | xs:decimal | op:divide-dayTimeDuration(A, B) | fn:dayTimeDuration |
A mod B | numeric | numeric | op:numeric-mod(A, B) | numeric |
A eq B | numeric | numeric | op:numeric-equal(A, B) | xs:boolean |
A eq B | xs:boolean | xs:boolean | op:boolean-equal(A, B) | xs:boolean |
A eq B | xs:string | xs:string | op:numeric-equal(fn:compare(A, B), 1) | xs:boolean |
A eq B | xs:date | xs:date | op:date-equal(A, B) | xs:boolean |
A eq B | xs:time | xs:time | op:time-equal(A, B) | xs:boolean |
A eq B | xs:dateTime | xs:dateTime | op:datetime-equal(A, B) | xs:boolean |
A eq B | fn:yearMonthDuration | fn:yearMonthDuration | op:yearMonthDuration-equal(A, B) | xs:boolean |
A eq B | fn:dayTimeDuration | fn:dayTimeDuration | op:dayTimeDuration-equal(A, B) | xs:boolean |
A eq B | Gregorian | Gregorian | op:gYear-equal(A, B) etc. | xs:boolean |
A eq B | xs:hexBinary | xs:hexBinary | op:hex-binary-equal(A, B) | xs:boolean |
A eq B | xs:base64Binary | xs:base64Binary | op:base64-binary-equal(A, B) | xs:boolean |
A eq B | xs:anyURI | xs:anyURI | op:anyURI-equal(A, B) | xs:boolean |
A eq B | xs:QName | xs:QName | op:QName-equal(A, B) | xs:boolean |
A eq B | xs:NOTATION | xs:NOTATION | op:NOTATION-equal(A, B) | xs:boolean |
A ne B | numeric | numeric | fn:not(op:numeric-equal(A, B)) | xs:boolean |
A ne B | xs:boolean | xs:boolean | fn:not(op:boolean-equal(A, B)) | xs:boolean |
A ne B | xs:string | xs:string | fn:not(op:numeric-equal(fn:compare(A, B), 1)) | xs:boolean |
A ne B | xs:date | xs:date | fn:not(op:date-equal(A, B)) | xs:boolean |
A ne B | xs:time | xs:time | fn:not(op:time-equal(A, B)) | xs:boolean |
A ne B | xs:dateTime | xs:dateTime | fn:not(op:datetime-equal(A, B)) | xs:boolean |
A ne B | fn:yearMonthDuration | fn:yearMonthDuration | fn:not(op:yearMonthDuration-equal(A, B)) | xs:boolean |
A ne B | fn:dayTimeDuration | fn:dayTimeDuration | fn:not(op:dayTimeDuration-equal(A, B) | xs:boolean |
A ne B | Gregorian | Gregorian | fn:not(op:gYear-equal(A, B)) etc. | xs:boolean |
A ne B | xs:hexBinary | xs:hexBinary | fn:not(op:hex-binary-equal(A, B)) | xs:boolean |
A ne B | xs:base64Binary | xs:base64Binary | fn:not(op:base64-binary-equal(A, B)) | xs:boolean |
A ne B | xs:anyURI | xs:anyURI | fn:not(op:anyURI-equal(A, B)) | xs:boolean |
A ne B | xs:QName | xs:QName | fn:not(op:QName-equal(A, B)) | xs:boolean |
A ne B | xs:NOTATION | xs:NOTATION | xs:not(op:NOTATION-equal(A, B)) | xs:boolean |
A gt B | numeric | numeric | op:numeric-greater-than(A, B) | xs:boolean |
A gt B | xs:boolean | xs:boolean | op:boolean-greater-than(A, B) | xs:boolean |
A gt B | xs:string | xs:string | op:numeric-greater-than(fn:compare(A, B), 0) | xs:boolean |
A gt B | xs:date | xs:date | op:date-greater-than(A, B) | xs:boolean |
A gt B | xs:time | xs:time | op:time-greater-than(A, B) | xs:boolean |
A gt B | xs:dateTime | xs:dateTime | op:datetime-greater-than(A, B) | xs:boolean |
A gt B | fn:yearMonthDuration | fn:yearMonthDuration | op:yearMonthDuration-greater-than(A, B) | xs:boolean |
A gt B | fn:dayTimeDuration | fn:dayTimeDuration | op:dayTimeDuration-greater-than(A, B) | xs:boolean |
A lt B | numeric | numeric | op:numeric-less-than(A, B) | xs:boolean |
A lt B | xs:boolean | xs:boolean | op:boolean-less-than(A, B) | xs:boolean |
A lt B | xs:string | xs:string | op:numeric-less-than(fn:compare(A, B), 0) | xs:boolean |
A lt B | xs:date | xs:date | op:date-less-than(A, B) | xs:boolean |
A lt B | xs:time | xs:time | op:time-less-than(A, B) | xs:boolean |
A lt B | xs:dateTime | xs:dateTime | op:datetime-less-than(A, B) | xs:boolean |
A lt B | fn:yearMonthDuration | fn:yearMonthDuration | op:yearMonthDuration-less-than(A, B) | xs:boolean |
A lt B | fn:dayTimeDuration | fn:dayTimeDuration | op:dayTimeDuration-less-than(A, B) | xs:boolean |
A ge B | numeric | numeric | op:numeric-less-than(B, A) | xs:boolean |
A ge B | xs:string | xs:string | op:numeric-greater-than(fn:compare(A, B), -1) | xs:boolean |
A ge B | xs:date | xs:date | op:date-less-than(B, A) | xs:boolean |
A ge B | xs:time | xs:time | op:time-less-than(B, A) | xs:boolean |
A ge B | xs:dateTime | xs:dateTime | op:datetime-less-than(B, A) | xs:boolean |
A ge B | fn:yearMonthDuration | fn:yearMonthDuration | op:yearMonthDuration-less-than(B, A) | xs:boolean |
A ge B | fn:dayTimeDuration | fn:dayTimeDuration | op:dayTimeDuration-less-than(B, A) | xs:boolean |
A le B | numeric | numeric | op:numeric-greater-than(B, A) | xs:boolean |
A le B | xs:string | xs:string | op:numeric-less-than(fn:compare(A, B), 1) | xs:boolean |
A le B | xs:date | xs:date | op:date-greater-than(B, A) | xs:boolean |
A le B | xs:time | xs:time | op:time-greater-than(B, A) | xs:boolean |
A le B | xs:dateTime | xs:dateTime | op:datetime-greater-than(B, A) | xs:boolean |
A le B | fn:yearMonthDuration | fn:yearMonthDuration | op:yearMonthDuration-greater-than(B, A) | xs:boolean |
A le B | fn:dayTimeDuration | fn:dayTimeDuration | op:dayTimeDuration-greater-than(B, A) | xs:boolean |
A is B | node | node | op:node-equal(A, B) | xs:boolean |
A isnot B | node | node | fn:not(op:node-equal(A, B)) | xs:boolean |
A << B | node | node | op:node-before(A, B) | xs:boolean |
A >> B | node | node | op:node-after(A, B) | xs:boolean |
A union B | node* | node* | op:union(A, B) | node* |
A | B | node* | node* | op:union(A, B) | node* |
A intersect B | node* | node* | op:intersect(A, B) | node* |
A except B | node* | node* | op:except(A, B) | node* |
A to B | xs:decimal | xs:decimal | op:to(A, B) | xs:integer+ |
A , B | item* | item* | op:concatenate(A, B) | item* |
Operator | Operand type | Function | Result type |
---|---|---|---|
+ A | numeric | op:numeric-unary-plus(A) | numeric |
- A | numeric | op:numeric-unary-minus(A) | numeric |
Values for Status has the following meaning:
resolved: a decision has been finalized and the document updated to reflect the decision.
decided: recommendations and decision(s) has been made by one or more of the following: a task-force, XPath WG, or XQuery WG.
draft: a proposal has been developed for possible future inclusion in a published document.
active: issue is actively being discussed.
unassigned: discussion of issue deferred.
subsumed: issue has been subsumed by another issue.
(parameters used: kwSort: cluster, kwFull: brief, kwDate: 00000000).
Num | Cl | Pr | Cluster | Status | Locus | Description | Responsible |
---|---|---|---|---|---|---|---|
293 | 1 | active | xquery | Cdata and CharRef Semantics | |||
323 | 1 | active | xpath | Should "unordered" be included in XPath? | |||
96 | o-1 | (in)equality-operators | decided | xpath | Normalized Equality | ||
328 | 1 | cdata section | active | xquery | What does CDATA section constructor construct? | ||
257 | D | 1 | collections | decided | xpath | Does collection() always return same result? | |
333 | 1 | conformance | active | xpath | Optional Features vs. Conformance Levels | ||
238 | o-1 | consistency | active | xpath | Consistency: tradeoff between interoperability and efficiency | ||
239 | o-1 | consistency | active | xpath | Consistency: bracketing of nested expressions | ||
240 | o-1 | consistency | active | xpath | Consistency: parenthesizing test expressions | ||
252 | 2 | consistency | active | xquery | "sort by" rather than "sortby" for consistency? | ||
288 | 1 | constructor-expr | active | xquery | Element Constructor Attribute Order | ||
289 | T | 1 | constructor-expr | active | xquery | Attribute Value Construction from Elements | |
290 | 1 | constructor-expr | active | xquery | Element Attribute Constructor Name Type | ||
291 | T | 1 | constructor-expr | active | xquery | Element Construction anySimpleType Sequence Content | |
292 | 1 | constructor-expr | active | xquery | Element Construction Sequence vs Multi-expr | ||
286 | 1 | constructor-expr | decided | xquery | Element Construction vs Streaming | ||
145 | o-1 | constructor-expr | unassigned | xquery | Copy and Reference Semantics | ||
329 | 1 | constructors | active | xquery | Duplicate attribute constructors | ||
258 | D | 2 | documents | decided | xpath | Identity of Document Nodes | |
336 | 1 | editorial | active | all | Markup in documents for errors | ||
337 | 1 | editorial | active | all | Add markup in documents for errors | ||
99 | o-1 | error | unassigned | xquery | TRY/CATCH and error() | Dana | |
339 | 2 | errors | active | xquery | Error type for attributes constructed too late | ||
340 | 1 | errors | active | xpath | How to identify errors? | ||
160 | o-2 | execution-model | active | xquery | Naive Implementation Strategy | ||
317 | 1 | extensions | active | xquery | XQuery Extension Mechanisms | ||
272 | 1 | external-functions | active | xpath | External Functions | ||
273 | 1 | external-objects | active | xpath | External Objects | ||
335 | 1 | formal-semantics | active | xpath | XPath/XQuery's current semantics greatly interferes with optimization | ||
265 | 2 | FTTF-xml:lang | active | xpath-fulltext | How do we determine the xml:lang for a node if it inherits xml:lang from a higher-level node? | ||
266 | 2 | FTTF-xml:lang | active | xpath-fulltext | Do we support the sublanguage portion of xml:lang? | ||
327 | 1 | functions | active | xpath | Evaluate unused function parameters? | ||
124 | o-1 | functions | unassigned | xquery | External Functions | ||
157 | o-1 | functions | unassigned | xquery | Function Libraries | ||
223 | o-1 | functions external | active | xquery | We need a way to declare external functions | ||
342 | o-1 | grammar | active | xquery | Prolog syntax | ||
168 | o-1 | groupby | unassigned | xquery | GROUPBY | ||
295 | 1 | lexical-representation | active | xquery | Lexical Representation of Atomic Values | ||
151 | o-1 | literal-XML | unassigned | xquery | Cutting and pasting XML into XQuery | ||
74 | o-1 | module-semantics | active | xquery | Module syntax | ||
75 | o-1 | module-semantics | unassigned | xquery | Importing Modules | ||
79 | o-1 | module-syntax | unassigned | xquery | Encoding | ||
228 | o-2 | namespace functions | active | xpath | Should we keep the default function namespace, and the xf: namespace? | ||
219 | o-1 | namespaces | active | xquery | Context: namespaces | ||
319 | 1 | namespaces | active | xquery | Namespace definitions and in-scope namespaces | ||
343 | 1 | namespaces | active | xpath | Do functions in the null namespace clash with functions in the default namespace? | ||
247 | 2 | namespaces | decided | xpath | What does default namespace(s) affect? | ||
187 | o-1 | operators | active | xfo | Operations supported on date/time types | ||
5 | o-2 | reserved-words | active | xpath | Reserved words | ||
123 | o-1 | serialization | active | xquery | Linearization/Serialization | ||
244 | 2 | serialization | active | xquery | CDATA sections and serialization | ||
242 | 3 | sort | active | xquery | Sortby on partially ordered values? | ||
300 | 1 | sort | active | xquery | Should sorting of untyped data be prohibited? | ||
155 | o-1 | sort | decided | xquery | Sorting by Non-exposed Data | ||
243 | 3 | sort | decided | xpath | Provide an example of sorting "disappearing" | ||
251 | 2 | sort | decided | xquery | Sorting "input to loop", not the result | ||
318 | 1 | sort | decided | xquery | Add 'order by' clause to FLWR? | ||
235 | o-1 | syntax | active | xpath | Need parenthesis in conditional expression? | ||
237 | o-1 | syntax | active | xquery | Need parenthesis in type switch expression? | ||
246 | 2 | syntax | active | xquery | Nested XQuery comments allowed? | ||
341 | 1 | syntax | active | xpath | Problems with SequenceType | ||
144 | o-1 | syntax | decided | xquery | Escaping Quotes and Apostrophes | ||
267 | 1 | syntax | decided | xpath | Syntax problems with "validate" | ||
208 | o-1 | syntax curly brace | active | xquery | Multiple curly braces allowed? | xquery | |
245 | 2 | syntax curly brace | active | xquery | Are {} in text evaluated? | ||
232 | o-1 | syntax operators date | active | xpath | Use "+" and "-" on dates and durations? | ||
213 | o-1 | syntax quotes | active | xpath | How to get quotes etc in string literals? | ||
261 | 2 | syntax quotes | active | xquery | Quoting rules in nested expressions in attribute value construction | ||
206 | T | 2 | types | active | xpath | Typing support in XPath | |
224 | T | 2 | types | active | xquery | Why do we want to allow optional returns and DataType? | |
297 | T | 1 | types | active | xpath | Should XPath have "type binding" in variable? | |
306 | T | 1 | types | active | xpath | PSVI to Data Model mapping part of normative text? | |
307 | T | 1 | types | active | xpath | Schema Types from input documents? | |
308 | T | 1 | types | active | xpath | Type Soundness | |
310 | T | 1 | types | active | xquery | Are the children of a newly constructed element typed? | |
312 | T | 1 | types | active | xquery | What to do about list types? | |
313 | T | 1 | types | active | xquery | What to do about union types? | |
314 | T | 1 | types | active | xquery | Partial support for SCHEMA IMPORT in Basic XQuery? | |
316 | T | 1 | types | active | xpath | Is AnySimpleType = AnySimpleType*? | |
320 | T | 1 | types | active | xquery | Should different conformance levels give the same result for the same query and data? | |
325 | T | 1 | types | active | xpath | Refering to element that is not in the in-scope schema def. | |
326 | T | 1 | types | active | xpath | Semantics of element foo of type T | |
330 | T | 1 | types | active | xquery | Should "some" do type filtering? | |
331 | T | 1 | types | active | xpath | Static vs. dynamic dispatch for arithmetics | |
332 | 1 | types | active | xpath | Schema Import, Static Typing: what is interoperable? | ||
43 | T | 1 | type-semantics | active | xquery | Defining Behavior for Well Formed, DTD, and Schema Documents | |
48 | T | 3 | type-semantics | active | algebra | CASE not a subtype | |
271 | T | 1 | type-semantics | active | xpath | Type compatibility of heterogeneous union types | |
284 | T | 1 | type-semantics | active | xpath | Static Named Typing | |
294 | T | 1 | type-semantics | active | xquery | Should all elements and attributes have type annotations? | |
334 | T | 1 | type-semantics | active | xpath | How are documents for which validation has failed processed? | |
47 | T | 2 | type-semantics | decided | xquery | Subtype Substitutability | |
279 | T | 1 | type-semantics | decided | xpath | Should there be a lightweight cast? | |
56 | T | 3 | type-syntax | active | xquery | Human-Readable Syntax for Types | |
164 | o-1 | updates | unassigned | xquery | Updates | Jonathan | |
321 | 1 | validate | active | xquery | Is validate strict or lax? | ||
322 | 1 | validate | active | xquery | "validate" strict/lax override? | ||
250 | 2 | variables | active | xquery | Declaring Variables in Prolog | ||
264 | 1 | variables | active | xpath | Shadowing of Variables | ||
324 | 1 | variables | active | xquery | How can variables be bound external to XQuery itself? | ||
299 | 1 | whitespace | active | xquery | Does character reference to whitespace change whitespace handling? | ||
311 | 1 | whitespace | active | xquery | Whitespace and Attribute Constructors | ||
338 | 1 | whitespace | active | xquery | Handling of whitespace and character references | ||
191 | o-1 | whitespace | decided | xquery | Whitespace handling in element constructors | ||
130 | o-1 | xquery-alignment | active | algebra | Algebra Mapping | Jerome | |
152 | o-1 | xqueryx | active | xqueryx | XML-based Syntax |
XPath 1.0 has no reserved words. The current XQuery spec attempts to avoid reserved words but the result is that the XQuery grammar relies heavily on lexing tricks that make it difficult to document and difficult to extend. There is currently a substantial feeling in the XQuery group that the language should have some reserved words, which would be an incompatible change from XPath 1.0.
XSL WG Position: Exceptionally strong feeling that requiring element names that match a reserved word to be escaped is utterly unacceptable. If reserved words are required they must start with an escape character so they cannot conflict with element names. Attempt to maintain grammar and revisit this issue as necessary. We recognize that there is a problem but solutions are all distasteful.
We should specify the behavior of XQuery for well formed XML, XML validated by a schema, and XML validated by a DTD.
The mapping of a DTD validated or well formed document still needs to be defined in the Data Model.
Should XQuery 1.0 support subtype substitutability for function parameters?
If subtype substitutability is not supported in XQuery Version 1, the motivation for TYPESWITCH is weakened and the decision to support TYPESWITCH should be revisited.
[link to member only information] Michael Rys:
I think this is still an open issue given some semantic issues that we found between named subtype substitutability and derivation by extension. I will send mail on this issue this week,
Addressed by the "Named Typing" proposal.
Decision by: xpath-tf on 2002-05-07 ([link to member only information] )
Decision by: xquery on 2002-05-22 ([link to member only information] )
Decision by: xsl on 2002-06-27 ([link to member only information] )
Accepting text in 2002-04-30 public draft.
If the types in the CASE branches are not subtypes of the TYPESWITCH, is this an error, or are these branches simply never executed? If the latter, should we require a warning?
The Algebra has a syntax for declaring types. Up to now, XQuery uses XML Schema for declaring types. Is this sufficient? Some important questions:
The definition and syntax of a query module are still under discussion in the working group. The specifications in this section are pending approval by the working group.
Future versions of the language may support other forms of query modules, such as update statements and view definitions.
The means by which a query module gains access to the functions defined an an external function library remains to be defined.
Should xmlns only be respected for construction, Xquery expressions but not functions, or also functions?
When elements are compared, are comments and PIs considered in the comparison? How is whitespace handled? Do we need to allow more than one way to handle these in comparisons?
Decision by: xquery on 2002-09-04 ([link to member only information] )
Decision by: xsl on 2002-10-03 ([link to member only information] )The XSL WG is not agreeable to blessing this.
"When elements are compared, are comments and PIs considered in the comparison?": NO
"How is whitespace handled?": This depends on the whitespace in the instance as per the data model.
"Do we need to allow more than one way to handle these in comparisons?": NO, not in XPath 2.0/XQuery 1.0.
We believe the following approach to error handling would be very useful - (1) introduce TRY <expression> CATCH <expression>, similar to try/catch in OO languages. Instead of having "throw" to throw objects, use error(<expression>), bind the result of the expression to the variable $err, and allow $err to be used in the CATCH clause.
Dana Florescu has been assigned the task of writing a proposal for this.
When an empty element is linearized, should it get xsi:nil="True"? Option 8A: Yes. Option 8B: No. Option 8C: Only if it is declared to have required content and to be "nilable".
An extensibility mechanism needs to be defined that permits XQuery to access a library of functions written in some other programming language such as Java.
Some sources of information: the definition of external functions in SQL, the implementation of external functions in Kweelt.
The algebra mapping is incomplete and out of date.
Jerome has created a new version of the mapping, with help from Mary, Dana and Mugur.
In attribute constructors and string constructors, XQuery uses quotes or apostrophes as delimiters. How are these characters escaped when they occur within strings that are created by one of these constructors?
[link to member only information] Michael Rys:
I asked a member of my team to check for a resolution that he can live with. He said he has not found it and currently works on constructing examples that shows the open issue.
I propose that we use double-delimiters within a string literal, e.g. 'I don''t', and unlike most of my syntactic ideas, this proposal seemed to recieve general support.
Decision by: xpath-tf on 2002-04-30 ([link to member only information] )
Decision by: xquery on 2002-05-22 ([link to member only information] )
Decision by: xsl on 2002-06-27 ([link to member only information] )
Syntax in current draft has this, but explanatory text need to be added.
A variety of XML constructs can not be cut and paste into XQuery, including the internal subset, entities, notations, etc. Should we attempt to ameliorate this?
Should we make it easier to sort by data that is not exposed in the result? Although the current language allows this, it is difficult to define complex sort orders in which some items are not exposed in the result and others are computed in the expression that is sorted. Is there a more convenient syntax for this that would be useful in XQuery?
Here is an example: FOR $e IN //employee WHERE ... RETURN <newe>$e/name</newe> SORTBY -- Now I would like to sort by salary but cannot. Instead, the query would have to be written as FOR $e IN (FOR $x IN //employee RETURN $x SORTBY employee/salary/data()) WHERE ... RETURN <newe>$e/name</newe> Which seems awkward. The question is of course how we can integrate the SORTBY in an other way. For example, could we say FOR $e IN //employee WHERE ... SORTBY $e/salary/data() RETURN <newe>$e/name</newe> ? Best regards Michael
Decision by: xquery on 2002-09-18 ([link to member only information] )
Decision by: xsl on 2002-10-10 ([link to member only information] )Confirming that there are no concerns for the resolution of this XQuery only issue.
Resolved by the adoption of the proposal to add "orderby" to the FLWR expression and to drop the previous "sortby" syntax/
XQuery needs a mechanism to allow function definitions to be shared by multiple queries. The XQuery grammar allows function definitions to occur without a query expression.
We must provide a way for queries to access functions in libraries. For instance, we might add an IMPORT statement to XQuery, with the URI of the functions to be imported. It must be possible to specify either that (1) local definitions replace the imported definitions, or (2) imported definitions replace the local ones.
Marton Nagy has suggested that it would be helpful to describe a naive implementation strategy for XQuery.
A naive XQuery implementation might parse the query, map it to Algebra syntax, and pass it to an Algebra implementation to request type checking from the algebra, returning an error if there were static type errors. A naive implementation might then request query execution from the algebra, get the results from the algebra and return it to the user.
Alternatively, the implementation might have its own algebra for execution, or it might generate statements in a specific implementation language such as XPath or SQL.We expect a wide variety of implementation approaches to be used in practice.
We believe that a syntax for update would be extremely useful, allowing inserts, updates, and deletion. This might best be added as a non-normative appendix to the syntax proposal, since the algebra is not designed for defining this portion of the language.
What arithmetic operations should be supported on date/time types?
Issue is for material in sec 2.5. in Working Draft 2001-11-28.
Decision by: xquery on 2002-02-06 ([link to member only information] )
Locus should be Functiond and Operators
How is whitespace handled in element constructors?
Issue is for material in sec 2.8. in Working Draft 2001-11-28.
[link to member only information] Michael Kay:
The XQuery WG requested information from XSL WG as to how we currently deal with whitespace, in the hope that we can provide an off-the-shelf solution to the problem. In response to the action, here's a description of what XSLT does. The stylesheet is an XML document. In constructing its infoset, all processing instructions, comments, and whitespace-only text nodes are discarded. (To be absolutely precise, PIs and comments are discarded; then adjacent text nodes are merged; then whitespace-only text nodes are removed from the tree). Whitespace text nodes are retained however, in two circumstances: (a) if the whitespace text node is a child of an <xsl:text> element, and (b) if an ancestor element specifies xml:space="preserve". Certain elements in the stylesheet (for example, xsl:element) contain a "content constructor". A content constructor is a sequence of XSLT instructions, literal result elements, and literal text nodes. In evaluating a content constructor, XSLT instructions do whatever the semantics of the particular instruction say, while literal result elements and literal text nodes are copied to the result tree. The effect of this is that a whitespace-only text node in the stylesheet is copied to the result tree only if either (a) it appears immediately inside <xsl:text>, or (b) it is within the scope of an xml:space="preserve" attribute. Whitespace that is adjacent to non-white text in a literal text node is copied to the result tree. The effect of these rules is as follows: ======================================= <a> </a> generates an empty element: <a/> ======================================= <a xml-space="preserve"> </a> generates: <a xml-space="preserve"> </a> ======================================= <a><xsl:text> </xsl:text></a> generates: <a> </a> ======================================= <a> <b/> <a> generates: <a><b/></a> ======================================= <a>Some text <b/> </a> generates: <a>Some text <b/></a> ======================================= There are other complications with whitespace. Whitespace in the result tree can come from the source document as well as from the stylesheet; XSLT provides control over whether whitespace-only text nodes in the source document are significant or not. Whitespace can also be generated in the output during serialization, if the xsl:output option indent="yes" is specified. Also of course the XSLT rules apply in addition to the XML rules. XML for example normalizes line endings and normalizes whitespace (but not character references) in attribute values. This happens outside XSLT's control. Whitespace character references such as are treated differently from literal whitespace by the XML processor, but are treated identically to literal whitespace by the XSLT processor. It's fair to say that these rules create a fair bit of confusion. It usually doesn't matter for generating HTML, because whitespace in HTML is rarely significant. For generating text files, it can be quite tricky. However, the rules are well-defined and a user who understands the rules can always get the required output. What should XQuery do? I'd suggest mimicking these rules as closely as possible, if only because users then only have to learn one set of confusing rules rather than two. I can't think of any obvious improvements that would make the system less confusing. Where the user wants to explicitly output whitespace, of course, <a>{' '}</a> provides a suitable alternative to XSLT's <xsl:text> instruction. This analogy would suggest that <a> {'x'} </a> should output <a>x</a>, while <a>z {'x'} y</a> should output <a>z x y</a>: that is, the characters between <a> and "{" are ignored if they consist entirely of whitespace, but are all significant if any of them is non-whitespace. <a> </a> should output <a/>, as should <a> </a>. This is only a suggestion, of course, the decision is entirely for XQuery to make. Mike Kay
Decision by: xquery on 2002-09-11 ([link to member only information] )
Decided: Resolve this by adopting the whitespace proposal.
Which of these type productions (CAST, TREAT, ASSERT, TYPESWITCH...) belong in XPath? (ie common to XQuery and XPath)
The list is now (2002-10): CAST, TREAT, VALIDATE, INSTANCE OF, types on variable bindings, TYPESWITCH.
Can you have multiple matching curly braces inside an attribute value? How is it evaluated? What is the associated typing? Note that the BNF permits this.
Decision by: xsl on 2002-10-18 ([link to member only information] )Joint f2f
Decision by: xquery on 2002-10-18 ([link to member only information] )Joint f2f
Can you have multiple matching curly braces inside an attribute value?
Braces for text must be escaped. <e a="{{{{}}"/>
Nesting is no problem:
<e a="{{{{{text{true()}}}}"/>
How is it evaluated?
With a parser.
What is the associated typing?
Not a syntax issue.
How do you get strings such as single and double quote to be allowed in character strings?
<name>Ben & Jerry's</name>
eg should doubling a quote escape it?
It would seem that we need to allow these CharRef's in string literals as well.
[link to member only information] Andrew Eisenberg:
XPath TF Meeting #91 suggested closing issue 213. Issue 213 has the title "syntax-special-characters: How to get quotes etc in string literals?" Perhaps we have focused on the quotes, and not the "etc." I might want to construct an element as follows (where ™ represents the trademark symbol "?"): <company name='Ben & Jerry's ™'> ... </company> To write this as a ComputedElementConstructor, I would have to write to following: element company { attribute name { 'Ben & Jerry''s ', xf:codepoints-to-string(8482) } ... } To pass this string as an argument to a function I'd have to write the following: f (xf:concat ('Ben & Jerry''s ', xf:codepoints-to-string(8482))) It's rather jarring to allow CharRef in ElementContent and AttributeValueContent, but not in string literals. I suggest that we add CharRef to the content of a string literal. -- Andrew
Decision by: xpath-tf on 2002-10-16 ([link to member only information] )
Decision by: xsl on 2002-10-31 ([link to member only information] )
The XPath TF believes that it is fixed as far as XPath is concerned. Doubled quotes are allowed. CharRef is a query-specific problem, and is subsumed by other issues.
XQuery must specify how namespaces are handled in the context.
Note that:
1. An unprefixed element name used as a nametest in a query has the namespaceURI associated with the default element namespace from the context.
Note: we may decide that this is the same as the default namespace of the in-scope namespaces, but this is not certain.
2. An unprefixed attribute has a null namespaceURI
Should we allow external functions to be defined using a syntax like this?
[71a] ExternalFnDef ::= {"define" S "external" S "function"} QName "(" ParamList? ")" ("returns" Datatype)?
Would we prefer a syntax that requires explicit declaration of a general type when a function is to be loosely typed, rather than use the current syntax in which the type is omitted when the function is untyped.
The question was raised of whether the Query WG and F&O TF have 1) a good rationale for putting built-in functions in a namespace, and 2) a consistent story about how this will relate to default namespace declarations and user-defined functions.
It would seem odd to have to have all user defined functions put in the FandO namespace if a namespace is not declared for it. If you do not do that, then user defined functions that don't require a prefix will not match the QName.
And, if there is not a good rational that provides user benifits, then it seems like we are going through a lot of additional complexity for little or no benefit.
[link to member only information] Kristoffer Rose:
Now that we have keywords, do we need parentheses in the conditional expression?
Decision by: xpath-tf on 2002-10-16 ([link to member only information] )
Decision by: xsl on 2002-10-31 ([link to member only information] )
Recommendation to drop the "then".
Subsequently some problems and differing views were expressed. The discussions will continue.
Consistent tradeoff between interoperability and efficiency. There are a number of places where XQuery must choose between pinning down precise behaviour or offering flexibility to the implementor. These include whether order in "for" expressions is significant, whether sorting is stable, whether order is significant for duplicate elimination, whether order is significant when finding the union, merge, except of sequences of values, and the like. We should have a consistent policy for making these choices.
Consistent bracketing of nested expressions. Some nested expressions are surrounded by parentheses (treat, cast, assert), some nested expressions are surrounded by braces (element construction, function body), and some nested expressions are not bracketed (for expression, conditional expression). We should have a consistent policy for bracketing of nested expressions.
Consistent parenthesizing of test expressions. Some test expressions are surrounded by parentheses (conditional, type switch) and some are not (where). We should have a consistent policy for parenthesizing of test expressions.
I was unable to find the semantics of what happens of sortby tries to order based on a base type that only has partial order (e.g., Duration). Can we explicitly disallow this?
Provide an example of
(employee sortby data(salary))/name
Decision by: xquery on 2002-09-11 ([link to member only information] )
Decision by: xsl on 2002-10-10 ([link to member only information] )
Decided to leave this to editorial discretion.
In attribute definitions, "{a}" will be interpreted as expression a returning the value for the attribute. Is this also the case for texts in general (inside an element construction)?
Decision by: xsl on 2002-10-18 ([link to member only information] )Joint f2f
Decision by: xquery on 2002-10-18 ([link to member only information] )Joint f2f
Yes it will be evaluated, for example in:
<a>this is {@color} text</a>
What is effect of default namespace declarations on unprefixed QNames that may occur in element constructors, attribute constructors, and name tests (or anywhere else).
In XPath 1.0, in-scope namespace decls effect prefixed QNames, but default namespace decl does not effect unprefixed names in a name test. In XSLT 2.0, we introduced multiple default namespace decls :one for constructed elements, one for names in xpath expressions.
Decision by: xquery on 2002-09-11 ([link to member only information] )
Decided to accept status quo:
- default element namespace defines a namespace URI that is associated with unprefixed names of elements and types.
- default function namespace defines a namespace URI that is associated with unprefixed names of functions.
Functions in a function library often need to access the same variables. For instance, a function library that manipulates a grammar may need to use the following variables in many functions:
$grammar := document("xpath-grammar.xml")/g:grammar $target := "xquery"
One possible syntax for this is:
'define' ''variable' varname ':=' expr
The above production would occur only in the prolog.
Consider this query:
for $x in /books/book, $y in /reviews/review where $x/isbn = $y/isbn return <newbook>{ $x/title, $x/author, $y/reviewer }</newbook> sortby isbn
This is an error, since isbn doesn't appear in newbook. (The static type system would catch this error.) What you have to write is
for $z in for $x in book, $y in review where $x/isbn = $y/isbn return <dummy>{ $x/title, $x/author, $y/reviewer, $x/isbn }</dummy> sortby isbn return <newbook>{ $z/title, $z/author, $z/reviewer }</newbook>
This is painful.
I think that XQuery should support this syntax, or something similar:
for $x in book, $y in review where $x/isbn = $y/isbn sortby $x/isbn return <newbook>{ $x/title, $x/author, $y/reviewer }</newbook>
Our plate is full with more important matters just now, but I hope we could fix this before we finalize XQuery.
Decision by: xquery on 2002-09-18 ([link to member only information] )
Decision by: xsl on 2002-10-10 ([link to member only information] )Confirming that there are no concerns for the resolution of this XQuery only issue.
Resolved by the adoption of the proposal to add "orderby" to the FLWR expression and to drop the previous "sortby" syntax.
Does collection() always return same result for the same URI? The same within the scope of a query/transformation? Are the nodes in the sequence identical?
Decision by: xpath-tf on 2002-10-16 ([link to member only information] )
Decision by: xquery on 2002-10-23 ([link to member only information] )
Decision by: xsl on 2002-10-31 ([link to member only information] )
It should return the same answer every time. Applies also to input(). We should use the same language as we use for document() and for current-dateTime().
Consider the following query:
if (document("foo.com") == document("foo.com")) then <yep/> else <nope/>
I would like the following output:
<yep/>
I think we can achieve this if we say that the URI of a resource is used as its identity. However, one resource can be identified by more than one URI. Suppose that "foo.com/here/there/hi.xml" and "file://c:/temp/limerick-tei.xml" refer to the same resource. What does the following return?
if (document("foo.com/here/there/hi.xml") == document("file://c:/temp/limerick-tei.xml")) then <yep/> else <nope/>
Should we simply use the URI of the parameter to establish identity and say that the two do not match? Should we make the result implementation-dependent?
Decision by: xpath-tf on 2002-10-16 ([link to member only information] )
Decision by: xquery on 2002-10-23 ([link to member only information] )
Decision by: xsl on 2002-10-31 ([link to member only information] )
This is already covered by the existing spec, but we may want to review the language as part of the actions for issue 257.
We currently say that in a constant string in XQuery, I can do any of the following three to escape quotes (please correct if I am wrong):
A. XQuery rule (works both in XQuery only and XQuery in XML embedding): quotes and double quotes are doubled if they are enclosed inside their own kind.
E.g.,
Lexical Value in datamodel '"' " '''' ' """" " '""' ""
B. XML rules (work only in XQuery in XML embedding since XML parser will work:
B1. Use ' when string delimiter is " and viceversa. This of course does not preserve data fidelity, so if the difference between them is important, you will need to use B2.
B2. Entitize
I assume that I cannot do just B, but that I have to use B to get A. E.g., <a foo="""/> in an XML document is not a valid XQuery and I have to write <a foo=""""/>
The problem that I have is that I do not know what the rules are for nesting quotes inside XQuery expressions:
What are the rules for:
<foo bar="{fnc1(<baz goo="{fnc2("string arg")}"/>)}"/>
Do I have to double and then triple? Does {} mean that the outside "" become inconsequential?
XSLT does not allow a local variable to be declared if there is already a local variable in scope with the same name. For example, the following is disallowed:
<xsl:variable name="i" select="0"/> <xsl:for-each select="item"> <xsl:variable name="i" select="$i + 1"/> <a><xsl:value-of select="$i"/></a> </xsl:for-each>
This restriction has proved with experience to be a good thing, because users writing a construct such as the one above have almost invariably misunderstood the way variables work in a declarative language; if the construct were allowed, it would not give them the results they expect.
The equivalent XQuery expression is currently allowed:
let $i := 0 for $x in item let $i := $i + 1 return <a>{$i}</a>
XPath 2.0 has no "let" expression, but it can include variable declarations, and these are allowed to shadow each other.
For XSLT users, it seems inconsistent that there should be different rules in XSLT and in XPath. The XSLT 1.0 rule, which makes variable shadowing an error, has proved useful in practice and we recommend that it should be adopted also for XPath 2.0 and XQuery 1.0.
If "validate" is in XPath the "{}" in the syntax conflicts with the current use in XPath. It needs to change to use "()" instead.
Decision by: x-editors on 2002-10-02 ([link to member only information] )
Scott: We can close this because {} does not create a problem.
Decision by: xsl on 2002-10-18 ([link to member only information] )Joint f2f
Decision by: xquery on 2002-10-18 ([link to member only information] )Joint f2f
It has been confirmed that there are no problems, example:
<e a="{(validate {bookdoc})/title}"/>
Currently the formal semantics maps arithmetic and comparison operations that have union types as (at least of one of) their argument types to a runtime type switch. This has serious unwanted consequences for "algebraization" of queries and optimization and leads to some surprising static typing results.
Should we make non-promotable union types on such operations a type error instead?
The ability to call external functions is an established feature of XSLT 1.0, and is retained in XSLT 2.0. The facility is widely used, and some significant libraries of external functions have been developed by third parties. We made an attempt to standardize language bindings for external functions in the XSLT 1.1 working draft, but this proved highly controversial and has been dropped. The facility remains, however, even though the binding mechanisms remain implementation-defined.
The XPath 2.0 specification continues to tolerate external functions, though it doesn't really acknowledge their existence properly. All we say is that the repertoire of functions that can be called is part of the context.
The issue is: should the function function-available() function be transferred from XSLT to XPath?
This function tests whether a named function is available, and returns true if it is, and false if it isn't. A typical call is:
if (function-available('my:debug')) then my:debug('Hi!') else ()
This has two implications:
(a) a call on my:debug must not be a static error if the function is not available
(b) the names of functions (and the in-scope namespaces needed to resolve their QNames) must be available at run-time.
Logically the function-available() function has no dependencies on XSLT so it should be transferred to XPath.
Part of the strength of external functions is that they can return objects that are outside the scope of the XPath type system. For example, a function library for performing SQL database access may have a function sql:connect() that returns an object representing a database connection. This object may be passed as an argument to calls on other functions in the SQL function library.
The way this is handled in XPath 1.0 is that the XPath specification defines four data-types, and explicitly leaves the host language free to define additional data types. We could probably live with a similar solution for XPath 2.0, but it's a fudge, and I think we ought to try and do better.
Note that the only things you can do with an external object (under the XSLT 1.0 rules) are to assign it to a variable, or pass it as the argument to another function. In practice I think implementations also allow external objects to have additional behavior, for example they might allow conversion to a string when used in a context where a string is required. I think we should leave such behavior implementation-defined rather than saying that it is always an error.
The question arises as to where external objects should fit into the type hierarchy. Should they be a top-level thing at the same level as "sequence", or should they be one level down, along with "node" and "atomic value"? I think it makes most sense to preserve the principle "everything is a sequence", which means that there are now three kinds of item: nodes, atomic values, and external objects.
Handling this rigorously sounds like quite a pervasive change to the spec, but I don't think it's as bad as it seems. I don't think we should add any language features to support external objects, with the possible exception of a keyword "external" in the type syntax so that one can test for it using "instance of". Functions and operators that work on any sequence (for example, count) should treat an external object like any other item in the sequence. Operations that expect nodes will fail if presented with an external object; operations that expect atomic values will also fail, except that implementations may define fallback conversions from external objects to atomic values.
Should there be any provision for a lightweight cast that does not observe facets? Phil Wadler has suggested that 'validate' be used whenever full schema validation is desired, and 'cast' be used as a lightweight validation, which can be used for either simple or complex types, but which does not supply defaults, enforce facets, or check integrity constraints. It may be easier to optimize through cast than through validate, but supporting both constructs may confuse users due to their similarity. He suggests the following syntax for these expressions:
('cast'|'validate') as SequenceType () ('cast'|'validate') 'in' ContextExpr { Expr }
Decision by: xquery on 2002-09-11 ([link to member only information] )
Decision by: xsl on 2002-10-10 ([link to member only information] )
Decided to reject this proposal. Cast checks all facets.
The typing must be covered by a static interpretation. If the Formal Semantics encounters difficulties in producing the static semantics, we may need to change the dynamic semantics.
The element construction rules in 2.8 make efficient streaming of element construction difficult/impossible. For example, we execute the following expression on a stream and serialize the result in a streaming processing (such as XSLT like applications):
<foo>{"foo", "bar", if (expr) then "baz" else <baz/>}</foo>
If expr is true, then this is serialized:
<foo>foo bar baz</foo>
If expr is false, then this is serialized: <foo>foobar<baz/></foo>
The implementation must cache up the "foo" and "bar" strings, just in case a sub-element node is constructed. If not, then I must insert a space between "foo" and "bar". This seems to contradict one of our explicit use scenarios in the XML Query Requirements (section 2.5).
Decision by: xquery on 2002-09-04 ([link to member only information] )
This issue has been addressed by the recent changes to the element constructor.
Unlike XSLT, attributes seem to be allowed anywhere which makes streaming implementations impossible. XSLT has the following rule:
"The following are all errors:
* Adding an attribute to an element after children have been added to it; implementations may either signal the error or ignore the attribute."
Example:
let $e := expr return <a>{<b/>, ($e/@* | $e/*)</a>
XSLT would consider this an error. XQuery does not. This makes streaming impossible (see #element-construction-vs-streaming). Note that while the above query can easily be rewritten, there are cases (e.g. function calls) where the rewrite is not possible.
XQuery should allow implementations to disallow attribute nodes that are specified after the first child node in the sequence. It should not allow disregarding them.
What does XQuery do if assigning a list of element nodes to an attribute if the type of the attribute is not a list type?
Example:
<book isbn="{$i/booknum}" />:
This query implicitly gets rewritten to: <book isbn="{data($i/booknum)}" />
What happens if there are more than one booknum elements and ISBN is untyped or not a list type?
Does the name expression on dynamically computed names in element/attribute constructors be of type QName without implicit cast from string, QName with implicit cast from string, or string?
If the name is constructed by an expression, the expected type is xs:QName. Xs:string is in general implicitly cast to xs:QName (and xs:anyURI).
The current element construction treats sequences of anySimpleType values different from other simple typed values. This seems inconsistent. The document should make it clear why there is a difference. If there is a reason, is the reason good enough?
The data model cannot represent CDATA or CharRef, since the Information Set looses this information.
The XQuery document should make it clear that:
1. CDATA sections and CharRefs inside XQueries that are not embedded inside XML (which is what the XQuery document only talks about), are syntactic helps to write queries that otherwise would need entitization (in the case if CDATA sections) or a unicode input device (CharRefs).
2. Implementations can chose to use this information as serialization hints to preserve the CDATA and entitization.
Should all elements and attributes have type annotations? In particular, should a newly-constructed element or attribute have a generic type annotation such as "anyType", rather than the current proposal in which it has no type annotation at all? (This is largely a cosmetic issue, about whether "anyType" should be denoted by an explicit annotation or by the absence of an annotation.)
The wording in section 2.8.3 needs to be aligned with Data model and F&O; 'lexical representation' needs to be defined differently and be consistent in XQuery, Datamodel, F&O. It probably needs to be string value (canonical value of integer in W3C Schema has a "." so not appropriate [or we need to have our own definition of the canonical value...]).
The 2002-06-24 grammar introduces the "binding" production. "assert" is removed from both XQuery and XPath. "binding" currently requires reserved words. Should "binding" be in XPath?
Several reasons NOT to include it in XPath:
- grammar
- semantics don't match function call semantics
- rarely useful
- reads oddly for range variables if (some integer $x in (1,2,"fred") satisfies $x=1)
- biggest of all, users are asking us to simplify. We will get a very adverse reaction if we make "for" expressions more complicated.
But it is worrying to have such a big split between XPath and XQuery.
In the whitespce proposal the treatment of whitespace character reference is different than treatment of literal whitespace (for "compatibility with XSLT/XPath 1.0") and this does not seem to align with XML parsing.
Should the mapping from PSVI to Query Data Model be part of the normative language specification? (The mapping is affected by the presence or absence of the Schema Import Feature).
During the analysis phase, in-scope schema definitions are derived from schemas named in Schema Import clauses.
Should there be additional in-scope schema definitions that are part of the static context? Should there be another set of in-scope schema definitions that are part of the dynamic context? What would that do to static typing? Would this interfere with interoperability?
In particular:
1. Should an environment be allowed to statically predefine schema definitions for a query? This would allow queries on fixed collections or known message types to provide strong type information without forcing users to explicitly import the corresponding schemas.
2. How does type information found dynamically in queried documents affect the query environment?
Does data() dynamically use the type information found in the instances that are queried, even when the types have not been declared in imported schemas? Note that Basic XQuery does not work properly if this is not true, since it must be able to discover the types of elements without importing their definition.
May an instance contain types that have not been imported into the static environment? If we say it may not, then schema imports are needed to query any document that contains types that are not predefined in XQuery.
May documents that are queried have different definitions for the same names? Note that solutions that dynamically load type information from a document into the in-scope schema definitions may try to introduce all such definitions into the static environment, which should cause an error according to our current rules.
If we want Basic XQuery to be able to query documents that have types that are not predefined, then data() must be able to use type information from instances. But if we want to be able to query validated documents that have different schemas this information must not be added to the static environment (or else we must find a way to add more than one schema definition for a given name to the static environment, or say that the static environment is dynamic, or....).
My tentative conclusions:
1. The in-scope schema definitions should be determined statically.
2. data() and many operators must be able to utilize the type information found in a document.
3. As a matter of convenience, it should be possible to import the schemas associated with a single document or with all documents in a collection. For instance, a syntax like the following may be useful:
import schema from collection "jdbc:datadirect:sqlserver://localhost:1433;database='airports'"
or
import schema from document "file:///C:/projects/query/requirements/xml-spec.xsd"
4. Implementations should be allowed to implicitly import schemas into the environment before executing a query, using any of the approved ways above.
The Static Typing Feature is claimed to have a property called "type soundness." However, Dana says she has counterexamples to the claim of type soundness as described in this section (Section 2.4.2.3). (At least sequence type matching breaks TYPE SOUNDNESS so what else breaks it?) We need to examine the claim and make sure it is stated correctly.
Whitespace in an XSLT attribute value template is significant insofar as it survives the XML rules for normalization of attributes. This means that CRLF combinations and tabs are normalized to x20 spaces, unless they are written as XML character references. I think it's an open question whether XQuery wants to emulate the XML attribute normalization rules.
In XSLT,
<foo bar=" {'x'} "/>
will produce the result <foo bar=" x "/>
while <foo bar=" "/> produces an element containing an attribute whose value is a single CR character.
If XQuery wants to reproduce this behavior exactly, then it's going to have to reproduce the XML treatment of whitespace as well as the XSLT treatment.
But whether it does so or not, I think Mary is right that
<foo bar=" {'x'} "/>
should produce lt;foo bar=" x "/> and not <foo bar="x"/>. There is a difference between element and attribute constructors: attributes have quotes around them, and this sets a different expectation.
Given the following function:
define function foo(xs:anySimpleType $x) returns xs:anySimpleType {$x}
and the untyped data
<a a="1"/><a a="2"/><a a="3"/>
should the following be a (static or dyamic) type error or should it work?
foo(/a/@a)
If it should work, what should the following query return?
count(data(<e>1 2</e>)) count(data(<a b="1 2"/>/@b))
Should it be 1 or 2?
anySimpleType is the base type of all the *primitive* XML Schema datatypes.
List and union types are *generated* (my word, Schema uses the word *derived*) from primitive types and thus, not included in anySimpleType. See the extract from the XML Schema datatypes spec below.
"[Definition:] There exists a conceptual datatype, whose name is anySimpleType, that is the simple version of the ur-type definition from [XML Schema Part 1: Structures]. anySimpleType can be considered as the *base type* of all *primitive* types. The *value space* of anySimpleType can be considered to be the *union* of the *value space*s of all *primitive* datatypes."
Thus, the function call above should result in a (static or dynamic, depending on typing conformance) type error.
The count expressions would always return 1.
Issue: XQuery has not determined what extension mechanisms might be supported. XQuery may support the following:
Four issues were raised in a proposal to restructure sorting in XQuery [1]:
1. Should we add an 'order by' clause to FLWR?
The following syntax has been proposed:
FLWRExpr ::= (ForClause | LetClause)+ SortClause? WhereClause? "return" Expr OrderClause ::= "order by" stable? SortSpecList SortSpecList ::= Expr SortModifier ("," SortSpecList)? SortModifier ::= ("ascending" | "descending")? ("empty" "greatest" | "empty" "least")?
The OrderClause sorts the tuple stream based on the conditions specified in the SortSpecList.
In the status quo, 'sortby' is a standalone postfix expression. FLWR is used to iterate, and 'sortby' is used to sort. This causes certain difficulties, because iteration and sorting are not distinct, unrelated operations - in general, the order in which the output sequence is ordered determines the best order to choose when iterating over the input.
When sorting data created with element constructors, it can sometimes be quite tricky to determine the original source of data in a constructed element. The more complex the expressions that construct the element, the more tricky this becomes. It is also tricky to iterate in an order determined by data that is not returned in a generated sequence.
If we add this clause, should a FLWOR expression that contains an OrderClause but no ForClause result in a semantic error, since there is no tuple stream to sort?
2. If we add an 'order by' clause, should we keep the sortby() expression, or remove it from our language?
Keeping it is convenient for some expressions. Removing it leaves us with a simpler language, and does not require us to explain to our users why we have two ways of doing the same thing.
3. How should we formalize 'order by' - or should we formalize it in Version 1.0?
The most straightforward way to formalize 'order by' is to use tuples, which do not exist in our Data Model, and these would cause significant change to our Formal Semantics. However, the semantics of 'order by' are straightforward.
Our options seem to be:
3.a. Ensure that we know how it would be formalized using tuples, but postpone including this in the Formal Semantics until after Version 1.
3.b. Refuse to add the feature unless it can be formalized with our current Data Model.
3.c. Restrict the feature to functionality easily formalized with our current Data Model.
I believe there was significant enthusiasm for 3.a. in today's telcon.
4. Is the 'order by' clause part of the XPath spec, or is it only in XQuery?
Jonathan
[1] http://lists.w3.org/Archives/Member/w3c-xsl-query/2002Jul/0177.html
Decision by: xpath-tf on 2002-10-16 ([link to member only information] )
'order by' has been added.
Addition of namespaces in the query prolog to the in-scope namespaces; how is this information carried through to provide input to validation?
Additional aspecs are:
(a) the whole question of how the namesapce context is affected by namespace declarations in element constructors
(b) the general notion (in XQuery, specifically), that the static context can vary for different parts of a query
(c) what information gets through to act as input to validation
Are different conformance levels going to give the same results? Is it possible to get different results for the same query? The principle should be that you either get the same result or a failure. Currently this isn't the case.
[link to member only information] Anders Berglund:
[link to member only information] Kristoffer Rose:
In recent discussions on the type system and when reviewing the documents I noticed that many people interpret
element foo
differently than the spec indicates it needs to be interpreted. This seems to indicate that we have a problem.
The semantics that people expect seems to be:
element foo is the same as element foo of type xs:anyType and matches all elements with the given name (regardless where or whether the element was declared in the schema).
attribute foo is the same as attribute foo of type xs:anySimpleType and matches all attributes with the given name regardless where or whether it was declared in the schema).
However our spec [1] says:
Another form of ElemOrAttrType is simply a QName, which is interpreted as the required name of the element or attribute. The QName must be an element or attribute name that is found in the in-scope schema definitions. The match is successful only if the given element or attribute has the required name and also conforms to the schema definition for the required name. This can be verified in either of the following ways:
If the schema definition for the required name has a named type, the given element or attribute must have a type annotation that is the same as that named type or is known (in the in-scope schema definitions) to be derived from that named type. For example, suppose that a schema declares the element named location to have the type State. Then the SequenceType element location will match a given element only if its name is location and its type annotation is State or some named type that is derived from State.
If the schema definition for the required name has an anonymous (unnamed) type definition, the actual content of the given element or attribute must structurally comply with this type definition. For example, suppose that a schema declares the element named shippingAddress to have an anonymous complex type consisting of a street element followed by a city element. Then the SequenceType element shippingAddress will match a given element only if its name is shippingAddress and its content is a street element followed by a city element.
The constraint that an element must have a required name is considered to be satisfied if the element has been validated and found to be a member of a substitution group whose head element has the required name. Substitution groups are described in [XML Schema].
which seems to indicate that this is not the case.
I would like to open an issue on this. I think even if people do not want to use schema types, they may still want to restrict the argument type of a function to an element with a given name.
In addition, many people are surprised to see the SchemaContext in the SequenceType production for other usages than for validate in ...
While there is a use case, I wonder whether this needs to be a required feature for XQuery V1 given the leap in complexity. Maybe it would be useful to solve the above problem by saying that you have to use
element foo in /
to force the name to be in the in-scope schema definition? This would mean that / becomes allowed in the SchemaGlobalContext production.
When using the form 'element foo of type T', should 'foo' be a globally declared element in the in-scope schema or not? Should there be constraints on which type T is allowed? The language document assumes foo is globally declared and T is a restriction of the type of foo. The formal semantics does not make that assumption.
Is an implementation obligated to evaluate all its parameters (and raise any errors doing so) even when they're not needed in the function body?
Decision by: xpath-tf on 2002-10-29 ([link to member only information] )as part of Agendum 1.
There is no need to evaluate "non needed" expressions.
Decision by: xquery on 2002-10-30 ([link to member only information] )accepting text for next publication, but keep issue active.
Decision by: xsl on 2002-10-31 ([link to member only information] )accepting text for next publication, but keep issue active.
Currently "some" doesn't do any filtering, which seems unnatural. We could change the some behaviour to actually do the type filtering.
It is easy to imagine that "some hatsize $h in $seq satisfies $h=3" ignores items in $seq that are not hatsizes. Currently, of course, it causes an error if the sequence might contains things other than hatsizes.
The current XPath/XQuery specification, as well as the Formal semantics document, mandate that the specific arithmetic operation to be executed depends on the runtime type of the arguments. For example, the addition of two variables $x and $y will be executed as an integer addition if the dynamic types of the two values are both subtypes of integer, and does not depend on the static type of the variables $x and $y (which may be decimal).
Implementing this semantics requires a runtime dispatch plus an runtime interaction with the type system for subtype testing. This can be very costly. Moreover, this semantics can prohibit other useful compile time optimizations like index utilization.
We may allow implementations to use either a static or dynamic dispatch for arithmetic operations in order to improve performance.
What interoperability is expected for queries that are executed with and without Schema Import? Does the current text reflect the desired goals?
What interoperability is expected for queries that are executed with and without Static Typing? Does the current text reflect the desired goals?
[link to member only information] Phil Wadler:
Should "Schema Import" and "Static Typing" be independent, optional features or should there be a layer of conformance levels? For XQuery the latter might be "Basic XQuery", "Basic XQuery" + "Schema Import", and "Basic XQuery" + "Schema Import" + "Static Typing".
What is the result of a failed validation? Can you inspect the result to detect this? Do you just get anySimpleType and anyType?
Current semantics basically defines the semantics by mapping FLWRs and path expression to go top-down. Errors are normative. Problem is that we can not apply many optimizations. Simple query rewrites such as pushing or pulling filters, etc. Like to be able to push predicates down and evaluate them. Potentially the predicate might raise an error you would not have gotten if you processed top down. Want to allow implementations to do bottom up evaluations.
Suggested resolution:
The formal semantics defines dynamic evaluation in terms of a naive, top-down reduction of a core expression to a data-model value. Implementations may choose alternative evaluation strategies, which, for example, may reduce a core expression bottom-up. If an evaluation of a core expression yields a value (i.e., it does not raise an error), the value must be the same value as would be produced by the dynamic semantics defined in this document. The evaluation of a core expression may raise an error that may not be raised by the dynamic semantics as defined in this document.
Decision by: xpath-tf on 2002-10-29 ([link to member only information] )as part of Agendum 1.
Expressions, with the exception of "if", may be reordered and thus some errors may be raised that using another evaluation strategy may not have occurred.
Decision by: xquery on 2002-10-30 ([link to member only information] )accepting text for next publication, but keep issue active.
Decision by: xsl on 2002-10-31 ([link to member only information] )accepting text for next publication, but keep issue active.
The effect of CharRef in Element or Attribute content is underspecified. For example, if the value of the CharRef is whitespace, does it behave like whitespace in Element or Attribute content, or does it behave like ordinary characters? Either way, it is hard to make it behave exactly like the XML construct that it mimics: in XML, a character reference such as suppresses certain effects such as whitespace normalization. It is not clear whether such normalization happens in XQuery.
Using the "instance of SequenceType" construct within a predicate of a path expression, or in an XSLT match pattern, is very unwieldy: the verbose English-like syntax of a SequenceType does not go well with the terse syntax of path expressions, leading to inelegant constructs like
select="//*[.instance of element of type address]"
[link to member only information] Michael Kay:
The prolog productions require special handling, but there is no special prolog state. Right now prolog productions must be distinguished by compound keywords such as <"declare" "namespace">. We either need to make sure we're happy with this, or make some sort of prolog container.
If you define the DFN (default function namespace) to be the null namespace, which you must do if you are going to call functions in this namespace, can you still use unprefixed names to refer to functions in the built-in namespace?
Backward compatibility with XPath Version 1.0 is now handled in a different way; fallback conversions have been eliminated, and an "XPath Version 1 Compatibility Mode" has been introduced that affects the semantics of certain functions and operators.
The sort by
expression has been eliminated, and in its place a new order by
clause has been added to the FLWR expression (now called an FLWOR expression).
New syntax has been added for explicit construction of text nodes.
An optional "positional variable" has been added to the for-clause of a FLWOR expression, to capture the position of each variable binding in the iteration sequence.
New and more liberal rules have been adopted for casting, allowing (for example) a value of a derived atomic type to be cast into another derived atomic type as long as the two types have a common supertype.
Every atomic type, including user-defined atomic types, now has a constructor function with the same name as the type and with semantics equivalent to a cast
expression with the atomic type as the target type.
A new form of predicate called castable
can now be used to determine if a given value can be cast into a given target type without raising an error.
Certain grammar changes have been made in order to eliminate the need for reserved keywords. For example, the keyword as
is now used in function signatures, and the keyword context
is used in validate
expressions. For the same reason, the unordered
keyword has been replaced by a function named fn:unordered
.
Rules for SequenceType Matching are now based purely on names of types and elements rather than on structural subsumption.
Variables may now be added to the static and dynamic context by the environment external to the query or transformation.
Attributes are now required to be specified before other forms of content in an element constructor.
New material has been added describing how errors are handled and how optimizers are allowed certain flexibility in evaluating an expression.
The process of numeric promotion is clearly distinguished from the process of subtype substitution. It is also clarified that, when a function is invoked with an argument that is a subtype of the expected type, that argument retains its most specific type in the body of the function.
The predefined namespace prefix xsd:
is deleted, and the predefined namespace prefix fn:
is added. The prefix fn:
is used to refer to the namespace of the built-in function library.