Skip to content

Commit 6ee83a8

Browse files
[SDP] UnresolvedFlow et al.
1 parent f83bc4d commit 6ee83a8

File tree

5 files changed

+75
-5
lines changed

5 files changed

+75
-5
lines changed
Lines changed: 14 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,14 @@
1+
# AppendOnceFlow
2+
3+
`AppendOnceFlow` is a [ResolvedFlow](ResolvedFlow.md) with [once](Flow.md#once) enabled.
4+
5+
## Creating Instance
6+
7+
`AppendOnceFlow` takes the following to be created:
8+
9+
* <span id="flow"> [UnresolvedFlow](UnresolvedFlow.md)
10+
* <span id="funcResult"> `FlowFunctionResult`
11+
12+
`AppendOnceFlow` is created when:
13+
14+
* `FlowResolver` is requested to [convertResolvedToTypedFlow](FlowResolver.md#convertResolvedToTypedFlow) (for [UnresolvedFlow](UnresolvedFlow.md)s with [once](UnresolvedFlow.md#once) enabled)
Lines changed: 15 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1,3 +1,17 @@
11
# CompleteFlow
22

3-
`CompleteFlow` is...FIXME
3+
`CompleteFlow` is a [ResolvedFlow](ResolvedFlow.md) that may or may not be [append](#mustBeAppend).
4+
5+
`CompleteFlow` is planned for execution as [BatchTableWrite](BatchTableWrite.md) by [FlowPlanner](FlowPlanner.md#plan).
6+
7+
## Creating Instance
8+
9+
`CompleteFlow` takes the following to be created:
10+
11+
* <span id="flow"> [UnresolvedFlow](UnresolvedFlow.md)
12+
* <span id="funcResult"> `FlowFunctionResult`
13+
* <span id="mustBeAppend"> `mustBeAppend` flag (default: `false`)
14+
15+
`CompleteFlow` is created when:
16+
17+
* `FlowResolver` is requested to [convertResolvedToTypedFlow](FlowResolver.md#convertResolvedToTypedFlow) (for [UnresolvedFlow](UnresolvedFlow.md)s that are neither [once](UnresolvedFlow.md#once) nor their results are streaming dataframes)
Lines changed: 14 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,14 @@
1+
# ResolutionFailedFlow
2+
3+
`ResolutionFailedFlow` is a [ResolutionCompletedFlow](ResolutionCompletedFlow.md).
4+
5+
## Creating Instance
6+
7+
`ResolutionFailedFlow` takes the following to be created:
8+
9+
* <span id="flow"> [UnresolvedFlow](UnresolvedFlow.md)
10+
* <span id="funcResult"> `FlowFunctionResult`
11+
12+
`ResolutionFailedFlow` is created when:
13+
14+
* `FlowResolver` is requested to [attemptResolveFlow](FlowResolver.md#attemptResolveFlow)

docs/declarative-pipelines/StreamingFlow.md

Lines changed: 3 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -1,8 +1,8 @@
11
# StreamingFlow
22

3-
`StreamingFlow` is a [ResolvedFlow](ResolvedFlow.md).
3+
`StreamingFlow` is a [ResolvedFlow](ResolvedFlow.md) that may or may not be [append](#mustBeAppend).
44

5-
`StreamingFlow` is [planned for execution](FlowPlanner.md#plan) as a [StreamingTableWrite](StreamingTableWrite.md).
5+
`StreamingFlow` is planned for execution as [StreamingTableWrite](StreamingTableWrite.md) by [FlowPlanner](FlowPlanner.md#plan).
66

77
## Creating Instance
88

@@ -14,4 +14,4 @@
1414

1515
`StreamingFlow` is created when:
1616

17-
* `FlowResolver` is requested to [convertResolvedToTypedFlow](FlowResolver.md#convertResolvedToTypedFlow)
17+
* `FlowResolver` is requested to [convertResolvedToTypedFlow](FlowResolver.md#convertResolvedToTypedFlow) (for [UnresolvedFlow](UnresolvedFlow.md)s with their results being streaming dataframes)
Lines changed: 29 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1,3 +1,31 @@
11
# UnresolvedFlow
22

3-
`UnresolvedFlow` is...FIXME
3+
`UnresolvedFlow` is a [Flow](Flow.md).
4+
5+
`UnresolvedFlow` is registered to a [GraphRegistrationContext](GraphRegistrationContext.md) with [registerFlow](GraphRegistrationContext.md#registerFlow).
6+
7+
`UnresolvedFlow` is analyzed and resolved to [ResolvedFlow](ResolvedFlow.md) (by [FlowResolver](FlowResolver.md#attemptResolveFlow) when [DataflowGraph](DataflowGraph.md) is requested to [resolve](DataflowGraph.md#resolve)).
8+
9+
`UnresolvedFlow` [must have unique identifiers](GraphRegistrationContext.md#assertFlowIdentifierIsUnique) (or an `AnalysisException` is reported).
10+
11+
## Creating Instance
12+
13+
`UnresolvedFlow` takes the following to be created:
14+
15+
* <span id="identifier"> `TableIdentifier`
16+
* <span id="destinationIdentifier"> Flow destination (`TableIdentifier`)
17+
* <span id="func"> `FlowFunction`
18+
* <span id="queryContext"> `QueryContext`
19+
* <span id="sqlConf"> SQL Config
20+
* <span id="once"> `once` flag
21+
* <span id="origin"> `QueryOrigin`
22+
23+
`UnresolvedFlow` is created when:
24+
25+
* `PipelinesHandler` is requested to [define a flow](PipelinesHandler.md#defineFlow)
26+
* `SqlGraphRegistrationContext` is requested to [handle the following pipeline commands](SqlGraphRegistrationContext.md#processSqlQuery):
27+
* [CreateFlowCommand](SqlGraphRegistrationContext.md#CreateFlowCommand)
28+
* [CreateMaterializedViewAsSelect](SqlGraphRegistrationContext.md#CreateMaterializedViewAsSelect)
29+
* [CreateView](SqlGraphRegistrationContext.md#CreateView)
30+
* [CreateStreamingTableAsSelect](SqlGraphRegistrationContext.md#CreateStreamingTableAsSelect)
31+
* [CreateViewCommand](SqlGraphRegistrationContext.md#CreateViewCommand)

0 commit comments

Comments
 (0)