gudusoft.gsqlparser.util

Class FileSplitter

Object

gudusoft.gsqlparser.util.FileSplitter

public class FileSplitter
extends Object

Splits large files into smaller chunks for parallel processing.

Supports two categories of input:

• Plain SQL files — split by statement boundaries using the SQL parser to find safe cut points.
• JSON metadata files — split by format (sqldep/grabit, sqlflow, sqlflow-sharded), converting each into smaller self-contained JSON files that the re-reader can consume independently.

JSON format routing

splitJsonFile() routes to the appropriate splitter based on createdBy and format:

• format: "sqlflow-sharded" → splitSqlflowShardedJson()
• createdBy contains "sqldep" or "grabit" → splitSqldepGrabitJson()
• createdBy contains "sqlflow" → splitSqlflowJson()

Constructor Summary

Constructors

Constructor and Description
FileSplitter()

Method Summary

Modifier and Type	Method and Description
static List<File>	splitFile(File inputFile, File outputDir, int splitSizeMB, EDbVendor dbVendor) Split large file

Methods inherited from class Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

FileSplitter

public FileSplitter()

Method Detail

splitFile

public static List<File> splitFile(File inputFile,
                                   File outputDir,
                                   int splitSizeMB,
                                   EDbVendor dbVendor)
                            throws IOException

Split large file

Parameters:

inputFile - Input file

outputDir - Output directory

splitSizeMB - Split size (MB)

dbVendor - Database vendor

Returns:

List of split files

Throws:

IOException - IO exception