Index
All Classes and Interfaces|All Packages|Serialized Form
A
- addColumn(String, String) - Method in class io.delta.tables.DeltaTableBuilder
-
:: Evolving ::
- addColumn(String, String, boolean) - Method in class io.delta.tables.DeltaTableBuilder
-
:: Evolving ::
- addColumn(String, DataType) - Method in class io.delta.tables.DeltaTableBuilder
-
:: Evolving ::
- addColumn(String, DataType, boolean) - Method in class io.delta.tables.DeltaTableBuilder
-
:: Evolving ::
- addColumn(StructField) - Method in class io.delta.tables.DeltaTableBuilder
-
:: Evolving ::
- addColumns(StructType) - Method in class io.delta.tables.DeltaTableBuilder
-
:: Evolving ::
- addFeatureSupport(String) - Method in class io.delta.tables.DeltaTable
-
Modify the protocol to add a supported feature, and if the table does not support table features, upgrade the protocol automatically.
- alias(String) - Method in class io.delta.tables.DeltaTable
-
Apply an alias to the DeltaTable.
- as(String) - Method in class io.delta.tables.DeltaTable
-
Apply an alias to the DeltaTable.
B
- build() - Method in class io.delta.tables.DeltaColumnBuilder
-
:: Evolving ::
C
- clone(String, boolean) - Method in class io.delta.tables.DeltaTable
-
Clone a DeltaTable to a given destination to mirror the existing table's data and metadata.
- clone(String, boolean, boolean) - Method in class io.delta.tables.DeltaTable
-
Clone a DeltaTable to a given destination to mirror the existing table's data and metadata.
- clone(String, boolean, boolean, HashMap<String, String>) - Method in class io.delta.tables.DeltaTable
-
clone used by Python implementation using java.util.HashMap for the properties argument.
- clone(String, boolean, boolean, Map<String, String>) - Method in class io.delta.tables.DeltaTable
-
Clone a DeltaTable to a given destination to mirror the existing table's data and metadata.
- cloneAtTimestamp(String, String, boolean) - Method in class io.delta.tables.DeltaTable
-
Clone a DeltaTable at a specific timestamp to a given destination to mirror the existing table's data and metadata at that timestamp.
- cloneAtTimestamp(String, String, boolean, boolean) - Method in class io.delta.tables.DeltaTable
-
Clone a DeltaTable at a specific timestamp to a given destination to mirror the existing table's data and metadata at that timestamp.
- cloneAtTimestamp(String, String, boolean, boolean, HashMap<String, String>) - Method in class io.delta.tables.DeltaTable
-
cloneAtTimestamp used by Python implementation using java.util.HashMap for the properties argument.
- cloneAtTimestamp(String, String, boolean, boolean, Map<String, String>) - Method in class io.delta.tables.DeltaTable
-
Clone a DeltaTable at a specific timestamp to a given destination to mirror the existing table's data and metadata at that timestamp.
- cloneAtVersion(long, String, boolean) - Method in class io.delta.tables.DeltaTable
-
Clone a DeltaTable at a specific version to a given destination to mirror the existing table's data and metadata at that version.
- cloneAtVersion(long, String, boolean, boolean) - Method in class io.delta.tables.DeltaTable
-
Clone a DeltaTable at a specific version to a given destination to mirror the existing table's data and metadata at that version.
- cloneAtVersion(long, String, boolean, boolean, HashMap<String, String>) - Method in class io.delta.tables.DeltaTable
-
cloneAtVersion used by Python implementation using java.util.HashMap for the properties argument.
- cloneAtVersion(long, String, boolean, boolean, Map<String, String>) - Method in class io.delta.tables.DeltaTable
-
Clone a DeltaTable at a specific version to a given destination to mirror the existing table's data and metadata at that version.
- clusterBy(String...) - Method in class io.delta.tables.DeltaTableBuilder
-
:: Evolving ::
- clusterBy(Seq<String>) - Method in class io.delta.tables.DeltaTableBuilder
-
:: Evolving ::
- columnBuilder(String) - Static method in class io.delta.tables.DeltaTable
-
:: Evolving ::
- columnBuilder(SparkSession, String) - Static method in class io.delta.tables.DeltaTable
-
:: Evolving ::
- comment(String) - Method in class io.delta.tables.DeltaColumnBuilder
-
:: Evolving ::
- comment(String) - Method in class io.delta.tables.DeltaTableBuilder
-
:: Evolving ::
- ConcurrentAppendException - Exception in io.delta.exceptions
-
:: Evolving ::
- ConcurrentAppendException(String) - Constructor for exception io.delta.exceptions.ConcurrentAppendException
- ConcurrentAppendException(String[]) - Constructor for exception io.delta.exceptions.ConcurrentAppendException
- ConcurrentDeleteDeleteException - Exception in io.delta.exceptions
-
:: Evolving ::
- ConcurrentDeleteDeleteException(String) - Constructor for exception io.delta.exceptions.ConcurrentDeleteDeleteException
- ConcurrentDeleteDeleteException(String[]) - Constructor for exception io.delta.exceptions.ConcurrentDeleteDeleteException
- ConcurrentDeleteReadException - Exception in io.delta.exceptions
-
:: Evolving ::
- ConcurrentDeleteReadException(String) - Constructor for exception io.delta.exceptions.ConcurrentDeleteReadException
- ConcurrentDeleteReadException(String[]) - Constructor for exception io.delta.exceptions.ConcurrentDeleteReadException
- ConcurrentTransactionException - Exception in io.delta.exceptions
-
:: Evolving ::
- ConcurrentTransactionException(String) - Constructor for exception io.delta.exceptions.ConcurrentTransactionException
- ConcurrentTransactionException(String[]) - Constructor for exception io.delta.exceptions.ConcurrentTransactionException
- ConcurrentWriteException - Exception in io.delta.exceptions
-
:: Evolving ::
- ConcurrentWriteException(String) - Constructor for exception io.delta.exceptions.ConcurrentWriteException
- ConcurrentWriteException(String[]) - Constructor for exception io.delta.exceptions.ConcurrentWriteException
- convertToDelta(SparkSession, String) - Static method in class io.delta.tables.DeltaTable
-
Create a DeltaTable from the given parquet table.
- convertToDelta(SparkSession, String, String) - Static method in class io.delta.tables.DeltaTable
-
Create a DeltaTable from the given parquet table and partition schema.
- convertToDelta(SparkSession, String, StructType) - Static method in class io.delta.tables.DeltaTable
-
Create a DeltaTable from the given parquet table and partition schema.
- create() - Static method in class io.delta.tables.DeltaTable
-
:: Evolving ::
- create(SparkSession) - Static method in class io.delta.tables.DeltaTable
-
:: Evolving ::
- createIfNotExists() - Static method in class io.delta.tables.DeltaTable
-
:: Evolving ::
- createIfNotExists(SparkSession) - Static method in class io.delta.tables.DeltaTable
-
:: Evolving ::
- createOrReplace() - Static method in class io.delta.tables.DeltaTable
-
:: Evolving ::
- createOrReplace(SparkSession) - Static method in class io.delta.tables.DeltaTable
-
:: Evolving ::
D
- dataType(String) - Method in class io.delta.tables.DeltaColumnBuilder
-
:: Evolving ::
- dataType(DataType) - Method in class io.delta.tables.DeltaColumnBuilder
-
:: Evolving ::
- delete() - Method in class io.delta.tables.DeltaMergeMatchedActionBuilder
-
Delete a matched row from the table.
- delete() - Method in class io.delta.tables.DeltaMergeNotMatchedBySourceActionBuilder
-
Delete an unmatched row from the target table.
- delete() - Method in class io.delta.tables.DeltaTable
-
Delete data from the table.
- delete(String) - Method in class io.delta.tables.DeltaTable
-
Delete data from the table that match the given
condition
. - delete(Column) - Method in class io.delta.tables.DeltaTable
-
Delete data from the table that match the given
condition
. - DeltaColumnBuilder - Class in io.delta.tables
-
:: Evolving ::
- DeltaConcurrentModificationException - Exception in io.delta.exceptions
-
:: Evolving ::
- DeltaConcurrentModificationException(String) - Constructor for exception io.delta.exceptions.DeltaConcurrentModificationException
- DeltaMergeBuilder - Class in io.delta.tables
-
Builder to specify how to merge data from source DataFrame into the target Delta table.
- DeltaMergeBuilder(DeltaTable, Dataset<Row>, Column, Seq<DeltaMergeIntoClause>) - Constructor for class io.delta.tables.DeltaMergeBuilder
- DeltaMergeMatchedActionBuilder - Class in io.delta.tables
-
Builder class to specify the actions to perform when a target table row has matched a source row based on the given merge condition and optional match condition.
- DeltaMergeMatchedActionBuilder() - Constructor for class io.delta.tables.DeltaMergeMatchedActionBuilder
- DeltaMergeNotMatchedActionBuilder - Class in io.delta.tables
-
Builder class to specify the actions to perform when a source row has not matched any target Delta table row based on the merge condition, but has matched the additional condition if specified.
- DeltaMergeNotMatchedActionBuilder() - Constructor for class io.delta.tables.DeltaMergeNotMatchedActionBuilder
- DeltaMergeNotMatchedBySourceActionBuilder - Class in io.delta.tables
-
Builder class to specify the actions to perform when a target table row has no match in the source table based on the given merge condition and optional match condition.
- DeltaMergeNotMatchedBySourceActionBuilder() - Constructor for class io.delta.tables.DeltaMergeNotMatchedBySourceActionBuilder
- DeltaOptimizeBuilder - Class in io.delta.tables
-
Builder class for constructing OPTIMIZE command and executing.
- DeltaOptimizeBuilder() - Constructor for class io.delta.tables.DeltaOptimizeBuilder
- DeltaTable - Class in io.delta.tables
-
Main class for programmatically interacting with Delta tables.
- DeltaTableBuilder - Class in io.delta.tables
-
:: Evolving ::
- detail() - Method in class io.delta.tables.DeltaTable
-
:: Evolving ::
- dropFeatureSupport(String) - Method in class io.delta.tables.DeltaTable
-
Modify the protocol to drop a supported feature.
- dropFeatureSupport(String, boolean) - Method in class io.delta.tables.DeltaTable
-
Modify the protocol to drop a supported feature.
E
- execute() - Method in class io.delta.tables.DeltaMergeBuilder
-
Execute the merge operation based on the built matched and not matched actions.
- execute() - Method in class io.delta.tables.DeltaTableBuilder
-
:: Evolving ::
- executeCompaction() - Method in class io.delta.tables.DeltaOptimizeBuilder
-
Compact the small files in selected partitions.
- executeZOrderBy(String...) - Method in class io.delta.tables.DeltaOptimizeBuilder
-
Z-Order the data in selected partitions using the given columns.
- executeZOrderBy(Seq<String>) - Method in class io.delta.tables.DeltaOptimizeBuilder
-
Z-Order the data in selected partitions using the given columns.
F
- forName(String) - Static method in class io.delta.tables.DeltaTable
-
Instantiate a
DeltaTable
object using the given table name. - forName(SparkSession, String) - Static method in class io.delta.tables.DeltaTable
-
Instantiate a
DeltaTable
object using one of the following: 1. - forPath(String) - Static method in class io.delta.tables.DeltaTable
-
Instantiate a
DeltaTable
object representing the data at the given path, If the given path is invalid (i.e. - forPath(SparkSession, String) - Static method in class io.delta.tables.DeltaTable
-
Instantiate a
DeltaTable
object representing the data at the given path, If the given path is invalid (i.e. - forPath(SparkSession, String, Map<String, String>) - Static method in class io.delta.tables.DeltaTable
-
Java friendly API to instantiate a
DeltaTable
object representing the data at the given path, If the given path is invalid (i.e. - forPath(SparkSession, String, Map<String, String>) - Static method in class io.delta.tables.DeltaTable
-
Instantiate a
DeltaTable
object representing the data at the given path, If the given path is invalid (i.e.
G
- generate(String) - Method in class io.delta.tables.DeltaTable
-
Generate a manifest for the given Delta Table
- generatedAlwaysAs(String) - Method in class io.delta.tables.DeltaColumnBuilder
-
:: Evolving ::
- generatedAlwaysAsIdentity() - Method in class io.delta.tables.DeltaColumnBuilder
-
:: Evolving ::
- generatedAlwaysAsIdentity(long, long) - Method in class io.delta.tables.DeltaColumnBuilder
-
:: Evolving ::
- generatedByDefaultAsIdentity() - Method in class io.delta.tables.DeltaColumnBuilder
-
:: Evolving ::
- generatedByDefaultAsIdentity(long, long) - Method in class io.delta.tables.DeltaColumnBuilder
-
:: Evolving ::
- getErrorClass() - Method in exception io.delta.exceptions.ConcurrentAppendException
- getErrorClass() - Method in exception io.delta.exceptions.ConcurrentDeleteDeleteException
- getErrorClass() - Method in exception io.delta.exceptions.ConcurrentDeleteReadException
- getErrorClass() - Method in exception io.delta.exceptions.ConcurrentTransactionException
- getErrorClass() - Method in exception io.delta.exceptions.ConcurrentWriteException
- getErrorClass() - Method in exception io.delta.exceptions.MetadataChangedException
- getErrorClass() - Method in exception io.delta.exceptions.ProtocolChangedException
- getMessage() - Method in exception io.delta.exceptions.ConcurrentAppendException
- getMessage() - Method in exception io.delta.exceptions.ConcurrentDeleteDeleteException
- getMessage() - Method in exception io.delta.exceptions.ConcurrentDeleteReadException
- getMessage() - Method in exception io.delta.exceptions.ConcurrentTransactionException
- getMessage() - Method in exception io.delta.exceptions.ConcurrentWriteException
- getMessage() - Method in exception io.delta.exceptions.MetadataChangedException
- getMessage() - Method in exception io.delta.exceptions.ProtocolChangedException
H
- history() - Method in class io.delta.tables.DeltaTable
-
Get the information available commits on this table as a Spark DataFrame.
- history(int) - Method in class io.delta.tables.DeltaTable
-
Get the information of the latest
limit
commits on this table as a Spark DataFrame.
I
- insert(Map<String, Column>) - Method in class io.delta.tables.DeltaMergeNotMatchedActionBuilder
-
Insert a new row to the target table based on the rules defined by
values
. - insert(Map<String, Column>) - Method in class io.delta.tables.DeltaMergeNotMatchedActionBuilder
-
Insert a new row to the target table based on the rules defined by
values
. - insertAll() - Method in class io.delta.tables.DeltaMergeNotMatchedActionBuilder
-
Insert a new target Delta table row by assigning the target columns to the values of the corresponding columns in the source row.
- insertExpr(Map<String, String>) - Method in class io.delta.tables.DeltaMergeNotMatchedActionBuilder
-
Insert a new row to the target table based on the rules defined by
values
. - insertExpr(Map<String, String>) - Method in class io.delta.tables.DeltaMergeNotMatchedActionBuilder
-
Insert a new row to the target table based on the rules defined by
values
. - io.delta.exceptions - package io.delta.exceptions
- io.delta.tables - package io.delta.tables
- isDeltaTable(String) - Static method in class io.delta.tables.DeltaTable
-
Check if the provided
identifier
string, in this case a file path, is the root of a Delta table. - isDeltaTable(SparkSession, String) - Static method in class io.delta.tables.DeltaTable
-
Check if the provided
identifier
string, in this case a file path, is the root of a Delta table using the given SparkSession.
L
- location(String) - Method in class io.delta.tables.DeltaTableBuilder
-
:: Evolving ::
M
- merge(Dataset<Row>, String) - Method in class io.delta.tables.DeltaTable
-
Merge data from the
source
DataFrame based on the given mergecondition
. - merge(Dataset<Row>, Column) - Method in class io.delta.tables.DeltaTable
-
Merge data from the
source
DataFrame based on the given mergecondition
. - MetadataChangedException - Exception in io.delta.exceptions
-
:: Evolving ::
- MetadataChangedException(String) - Constructor for exception io.delta.exceptions.MetadataChangedException
- MetadataChangedException(String[]) - Constructor for exception io.delta.exceptions.MetadataChangedException
N
- nullable(boolean) - Method in class io.delta.tables.DeltaColumnBuilder
-
:: Evolving ::
O
- optimize() - Method in class io.delta.tables.DeltaTable
-
Optimize the data layout of the table.
P
- partitionedBy(String...) - Method in class io.delta.tables.DeltaTableBuilder
-
:: Evolving ::
- partitionedBy(Seq<String>) - Method in class io.delta.tables.DeltaTableBuilder
-
:: Evolving ::
- property(String, String) - Method in class io.delta.tables.DeltaTableBuilder
-
:: Evolving ::
- ProtocolChangedException - Exception in io.delta.exceptions
-
:: Evolving ::
- ProtocolChangedException(String) - Constructor for exception io.delta.exceptions.ProtocolChangedException
- ProtocolChangedException(String[]) - Constructor for exception io.delta.exceptions.ProtocolChangedException
R
- replace() - Static method in class io.delta.tables.DeltaTable
-
:: Evolving ::
- replace(SparkSession) - Static method in class io.delta.tables.DeltaTable
-
:: Evolving ::
- restoreToTimestamp(String) - Method in class io.delta.tables.DeltaTable
-
Restore the DeltaTable to an older version of the table specified by a timestamp.
- restoreToVersion(long) - Method in class io.delta.tables.DeltaTable
-
Restore the DeltaTable to an older version of the table specified by version number.
T
- tableName(String) - Method in class io.delta.tables.DeltaTableBuilder
-
:: Evolving ::
- toDF() - Method in class io.delta.tables.DeltaTable
-
Get a DataFrame (that is, Dataset[Row]) representation of this Delta table.
U
- update(Map<String, Column>) - Method in class io.delta.tables.DeltaMergeMatchedActionBuilder
-
Update a matched table row based on the rules defined by
set
. - update(Map<String, Column>) - Method in class io.delta.tables.DeltaMergeNotMatchedBySourceActionBuilder
-
Update an unmatched target table row based on the rules defined by
set
. - update(Map<String, Column>) - Method in class io.delta.tables.DeltaTable
-
Update rows in the table based on the rules defined by
set
. - update(Column, Map<String, Column>) - Method in class io.delta.tables.DeltaTable
-
Update data from the table on the rows that match the given
condition
based on the rules defined byset
. - update(Column, Map<String, Column>) - Method in class io.delta.tables.DeltaTable
-
Update data from the table on the rows that match the given
condition
based on the rules defined byset
. - update(Map<String, Column>) - Method in class io.delta.tables.DeltaTable
-
Update rows in the table based on the rules defined by
set
. - update(Map<String, Column>) - Method in class io.delta.tables.DeltaMergeMatchedActionBuilder
-
Update the matched table rows based on the rules defined by
set
. - update(Map<String, Column>) - Method in class io.delta.tables.DeltaMergeNotMatchedBySourceActionBuilder
-
Update an unmatched target table row based on the rules defined by
set
. - updateAll() - Method in class io.delta.tables.DeltaMergeMatchedActionBuilder
-
Update all the columns of the matched table row with the values of the corresponding columns in the source row.
- updateExpr(String, Map<String, String>) - Method in class io.delta.tables.DeltaTable
-
Update data from the table on the rows that match the given
condition
, which performs the rules defined byset
. - updateExpr(String, Map<String, String>) - Method in class io.delta.tables.DeltaTable
-
Update data from the table on the rows that match the given
condition
, which performs the rules defined byset
. - updateExpr(Map<String, String>) - Method in class io.delta.tables.DeltaMergeMatchedActionBuilder
-
Update a matched table row based on the rules defined by
set
. - updateExpr(Map<String, String>) - Method in class io.delta.tables.DeltaMergeNotMatchedBySourceActionBuilder
-
Update an unmatched target table row based on the rules defined by
set
. - updateExpr(Map<String, String>) - Method in class io.delta.tables.DeltaTable
-
Update rows in the table based on the rules defined by
set
. - updateExpr(Map<String, String>) - Method in class io.delta.tables.DeltaTable
-
Update rows in the table based on the rules defined by
set
. - updateExpr(Map<String, String>) - Method in class io.delta.tables.DeltaMergeMatchedActionBuilder
-
Update the matched table rows based on the rules defined by
set
. - updateExpr(Map<String, String>) - Method in class io.delta.tables.DeltaMergeNotMatchedBySourceActionBuilder
-
Update an unmatched target table row based on the rules defined by
set
. - upgradeTableProtocol(int, int) - Method in class io.delta.tables.DeltaTable
-
Updates the protocol version of the table to leverage new features.
V
- vacuum() - Method in class io.delta.tables.DeltaTable
-
Recursively delete files and directories in the table that are not needed by the table for maintaining older versions up to the given retention threshold.
- vacuum(double) - Method in class io.delta.tables.DeltaTable
-
Recursively delete files and directories in the table that are not needed by the table for maintaining older versions up to the given retention threshold.
W
- whenMatched() - Method in class io.delta.tables.DeltaMergeBuilder
-
Build the actions to perform when the merge condition was matched.
- whenMatched(String) - Method in class io.delta.tables.DeltaMergeBuilder
-
Build the actions to perform when the merge condition was matched and the given
condition
is true. - whenMatched(Column) - Method in class io.delta.tables.DeltaMergeBuilder
-
Build the actions to perform when the merge condition was matched and the given
condition
is true. - whenNotMatched() - Method in class io.delta.tables.DeltaMergeBuilder
-
Build the action to perform when the merge condition was not matched.
- whenNotMatched(String) - Method in class io.delta.tables.DeltaMergeBuilder
-
Build the actions to perform when the merge condition was not matched and the given
condition
is true. - whenNotMatched(Column) - Method in class io.delta.tables.DeltaMergeBuilder
-
Build the actions to perform when the merge condition was not matched and the given
condition
is true. - whenNotMatchedBySource() - Method in class io.delta.tables.DeltaMergeBuilder
-
Build the actions to perform when the merge condition was not matched by the source.
- whenNotMatchedBySource(String) - Method in class io.delta.tables.DeltaMergeBuilder
-
Build the actions to perform when the merge condition was not matched by the source and the given
condition
is true. - whenNotMatchedBySource(Column) - Method in class io.delta.tables.DeltaMergeBuilder
-
Build the actions to perform when the merge condition was not matched by the source and the given
condition
is true. - where(String) - Method in class io.delta.tables.DeltaOptimizeBuilder
-
Apply partition filter on this optimize command builder to limit the operation on selected partitions.
- withSchemaEvolution() - Method in class io.delta.tables.DeltaMergeBuilder
-
Enable schema evolution for the merge operation.
All Classes and Interfaces|All Packages|Serialized Form