Package dev.vortex.spark.write

Class VortexWriterCommitMessage

java.lang.Object

dev.vortex.spark.write.VortexWriterCommitMessage

All Implemented Interfaces:

Serializable, org.apache.spark.sql.connector.write.WriterCommitMessage

public final class VortexWriterCommitMessage
extends Object
implements org.apache.spark.sql.connector.write.WriterCommitMessage, Serializable

Commit message containing information about a successfully written Vortex file. This message is passed from executors back to the driver to coordinate the commit phase of the write operation.

See Also:

• Serialized Form

Constructor Summary

Constructors

Constructor	Description
VortexWriterCommitMessage(String filePath, long recordCount, long bytesWritten)	Creates a new commit message for a written Vortex file.

Method Summary

Modifier and Type	Method	Description
long	getBytesWritten()	Gets the number of bytes written to the file.
String	getFilePath()	Gets the path to the written Vortex file.
long	getRecordCount()	Gets the number of records written to the file.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Details

VortexWriterCommitMessage

public VortexWriterCommitMessage(String filePath,
 long recordCount,
 long bytesWritten)

Creates a new commit message for a written Vortex file.

Parameters:

filePath - the path to the written file

recordCount - the number of records written

bytesWritten - the number of bytes written

Method Details

getFilePath

public String getFilePath()

Gets the path to the written Vortex file.

Returns:

the file path

getRecordCount

public long getRecordCount()

Gets the number of records written to the file.

Returns:

the record count

getBytesWritten

public long getBytesWritten()

Gets the number of bytes written to the file.

Returns:

the byte count