SparkOptions class

Options for a user-defined Spark routine.

Constructors

SparkOptions({List<String>? archiveUris, String? connection, String? containerImage, List<String>? fileUris, List<String>? jarUris, String? mainClass, String? mainFileUri, Map<String, String>? properties, List<String>? pyFileUris, String? runtimeVersion})
SparkOptions.fromJson(Map json_)

Properties

archiveUris List<String>?
Archive files to be extracted into the working directory of each executor.
getter/setter pair
connection String?
Fully qualified name of the user-provided Spark connection object.
getter/setter pair
containerImage String?
Custom container image for the runtime environment.
getter/setter pair
fileUris List<String>?
Files to be placed in the working directory of each executor.
getter/setter pair
hashCode int
The hash code for this object.
no setterinherited
jarUris List<String>?
JARs to include on the driver and executor CLASSPATH.
getter/setter pair
mainClass String?
The fully qualified name of a class in jar_uris, for example, com.example.wordcount.
getter/setter pair
mainFileUri String?
The main file/jar URI of the Spark application.
getter/setter pair
properties Map<String, String>?
Configuration properties as a set of key/value pairs, which will be passed on to the Spark application.
getter/setter pair
pyFileUris List<String>?
Python files to be placed on the PYTHONPATH for PySpark application.
getter/setter pair
runtimeType Type
A representation of the runtime type of the object.
no setterinherited
runtimeVersion String?
Runtime version.
getter/setter pair

Methods

noSuchMethod(Invocation invocation) → dynamic
Invoked when a nonexistent method or property is accessed.
inherited
toJson() Map<String, dynamic>
toString() String
A string representation of this object.
inherited

Operators

operator ==(Object other) bool
The equality operator.
inherited