public class TFilesTableFunction extends TTableFunction
The FILES() function allows querying data files directly from cloud storage (S3, HDFS, GCS, Azure Blob, etc.) without creating external tables.
Syntax:
FILES(
"path" = "s3://bucket/path/*.parquet",
"format" = "parquet",
"aws.s3.access_key" = "xxx",
"aws.s3.secret_key" = "xxx",
"aws.s3.region" = "us-west-2"
)
Example usage:
SELECT * FROM FILES(
"path" = "s3://bucket/data.parquet",
"format" = "parquet"
);
INSERT INTO my_table SELECT * FROM FILES(...);
analyticFunction, Args, filterClause, fntAddDate, fntCaseN, fntCast, fntContains, fntConvert, fntCSUM, fntDateAdd, fntDateSub, fntExtract, fntExtractXML, fntFreetext, fntGroupConcat, fntMatchAgainst, fntOGC, fntPosition, fntRangeN, fntRank, fntSubDate, fntSubstring, fntSubString, fntTimestampAdd, fntTimestampDiff, fntTranslate, fntTranslateCHK, fntTreat, fntTrim, fntUdf, fntXmlQuery, functionName, functionType, Trim_Expr, Trim_From_Expr, windowDef, withinGroupdbvendor, doubleLinkedTokenListToString, nodeActionAppend, nodeActionInsert, nodeActionRemove, nodeActionUnknown, nodeActionUpdate, nodeActionUpdateText, nodeChangeEndToken, nodeChangeStartToken| Constructor and Description |
|---|
TFilesTableFunction()
Creates a new TFilesTableFunction.
|
| Modifier and Type | Method and Description |
|---|---|
void |
accept(TParseTreeVisitor v)
Accept a visitor
|
void |
acceptChildren(TParseTreeVisitor v)
Accept a visitor to iterate this class and sub-nodes of this class
|
void |
doParse(TCustomSqlStatement psql,
ESqlClause plocation)
Analyze the sub-nodes inside this node.
|
String |
getColumnsFromPath()
Gets the columns_from_path property value.
|
String |
getFormat()
Gets the file format from the "format" property.
|
String |
getPath()
Gets the file path from the "path" property.
|
TPTNodeList<TFlinkTableProperty> |
getProperties()
Gets the properties list.
|
String |
getPropertyValue(String key)
Gets a property value by key name.
|
void |
init(Object arg1)
Initialize with properties list.
|
void |
init(Object arg1,
Object arg2)
Initialize with function name and properties list.
|
boolean |
isListFilesOnly()
Checks if this is a list-files-only operation.
|
boolean |
isListRecursively()
Checks if recursive listing is enabled.
|
void |
setProperties(TPTNodeList<TFlinkTableProperty> properties)
Sets the properties list.
|
getAttributes, getRelationName, init, init, initAttributes, sizegetAgainstExpr, getAggregateType, getAnalyticFunction, getArgs, getAsDatatype, getCallTarget, getCastOperand, getColumnNameOrListExpression, getDataConversionItems, getDatatypeAttribute, getDateExpression, getDummy, getExpr1, getExpr2, getExpr3, getExprList, getExtract_time_token, getFieldDefs, getFieldValues, getFilterClause, getFunctionName, getFunctionType, getFuncType, getGroupConcatParam, getIndirection, getInExpr, getIntervalUnit, getLengthExpression, getListaggOverflow, getMatchColumns, getNamespace_String, getOrderByList, getParameter, getPassingClause, getSearchCondition, getSeparatorExpr, getSortClause, getSourceExpression, getStartExpression, getStringExpr, getStyle, getTrimArgument, getTypeExpression, getTypename, getWindowDef, getWindowSpecification, getWithinGroup, getXMLAttributesClause, getXMLElementNameExpr, getXMLElementValueExprList, getXMLForestValueList, getXmlPassingClause, getXMLType_Instance, getXPath_String, hasParenthesis, isBuiltIn, isBuiltIn, isColumnInThisTableFunction, setAgainstExpr, setAggregateType, setAnalyticFunction, setArgs, setAsDatatype, setBuiltIn, setCallTarget, setCastOperand, setCheckedBuiltIn, setColumnNameOrListExpression, setDataConversionItems, setDatatypeAttribute, setDateExpression, setDummy, setExpr1, setExpr2, setExpr3, setExprList, setExtract_time_token, setExtractXMLArg, setFilterClause, setFilterClause, setFirstArgAsDateTimePart, setFunctionName, setFunctionOptionsWithDummy, setFunctionType, setFuncType, setGroupConcatParam, setIndirection, setInExpr, setIntervalUnit, setLengthExpression, setListaggOverflow, setMatchColumns, setNamespace_String, setOrderByList, setParameter, setPassingClause, setSearchCondition, setSeparatorExpr, setSortClause, setSourceExpression, setStartExpression, setStringExpr, setStyle, setTrim_Expr, setTrim_From_Expr, setTrimArgument, setTypeExpression, setTypename, setWindowDef, setWithinGroup, setXMLAttributesClause, setXMLElementNameExpr, setXMLElementValueExprList, setXMLForestValueList, setXmlPassingClause, setXMLType_Instance, setXPath_StringaddAllMyTokensToTokenList, addToTokenChain, appendNewNode, calculateTokenCount, doAppendNewNode, fastSetString, getAnchorNode, getColumnNo, getCommentAfterNode, getCommentBeforeNode, getCompactString, getDummyTag, getEndToken, getEvaluateDatatype, getEvalValue, getGsqlparser, getLineNo, getLocation, getMd5, getNodeStatus, getNodeType, getParentObjectName, getPlainText, getStartToken, getTokenCount, hasNext, init, init, init, init, init, init, insertAfterAToken, insertNewNodeBeforeMe, isChanged, isTokensInChain, next, refreshAllNodesTokenCount, remove, removeAllMyTokensFromTokenList, removeTokens, removeTokensBetweenNodes, removeTokensBetweenToken, replaceWithNewNode, resetIterator, setAnchorNode, setChanged, setDummyTag, setEndToken, setEndToken, setEndToken, setEndToken, setEndToken, setEndTokenDirectly, setEvaluateDatatype, setEvalValue, setGsqlparser, setIncludingComment, setLocation, setNewSubNode, setNodeStatus, setNodeType, setParent, setPlainText, setStartToken, setStartToken, setStartToken, setStartToken, setStartTokenDirectly, setString, setString2, subNodeInNode, toScript, toString, toString2clone, equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, waitforEachRemainingpublic TFilesTableFunction()
public void init(Object arg1)
init in class TFunctionCallarg1 - the properties list (TPTNodeList<TFlinkTableProperty>)public void init(Object arg1, Object arg2)
init in class TFunctionCallarg1 - the function name (TObjectName)arg2 - the properties list (TPTNodeList<TFlinkTableProperty>)public TPTNodeList<TFlinkTableProperty> getProperties()
public void setProperties(TPTNodeList<TFlinkTableProperty> properties)
properties - the list of key-value propertiespublic String getPropertyValue(String key)
key - the property key (without quotes)public String getPath()
public String getFormat()
public boolean isListFilesOnly()
public boolean isListRecursively()
public String getColumnsFromPath()
public void doParse(TCustomSqlStatement psql, ESqlClause plocation)
TParseTreeNodedoParse in class TTableFunctionpsql - SQL statement this node belongs toplocation - SQL clause this node belongs topublic void accept(TParseTreeVisitor v)
TParseTreeNodeaccept in interface Visitableaccept in class TTableFunctionv - visitor is a descendant class of TParseTreeVisitorpublic void acceptChildren(TParseTreeVisitor v)
TParseTreeNodeacceptChildren in interface VisitableacceptChildren in class TTableFunctionv - visitor is a descendant class of TParseTreeVisitor