org.mule.modules.sparksql.data

Class FileDataProperties

java.lang.Object

org.mule.modules.sparksql.data.FileDataProperties

public class FileDataProperties
extends Object

A single file at Hadoop HDFS to include and make available as a 'table' to the Apache Spark SQL Context.
see FileDataProperties(String, String, String, Boolean)

Constructor Summary

Constructors

Constructor and Description
FileDataProperties() Default constructor
FileDataProperties(String type, String uri, String alias, Boolean addJar) Create the configuration for a single file at Hadoop HDFS to include and make available as a 'table' to the Apache Spark SQL Context.

Method Summary

Modifier and Type	Method and Description
String	getAlias() see FileDataProperties(String, String, String, Boolean)
String	getType() see FileDataProperties(String, String, String, Boolean)
String	getUri() see FileDataProperties(String, String, String, Boolean)
Boolean	isAddJar() see FileDataProperties(String, String, String, Boolean)
void	setAddJar(Boolean addJar) see FileDataProperties(String, String, String, Boolean)
void	setAlias(String alias) see FileDataProperties(String, String, String, Boolean)
void	setType(String type) see FileDataProperties(String, String, String, Boolean)
void	setUri(String uri) see FileDataProperties(String, String, String, Boolean)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

FileDataProperties

public FileDataProperties()

Default constructor

FileDataProperties

public FileDataProperties(String type,
                          String uri,
                          String alias,
                          Boolean addJar)

Create the configuration for a single file at Hadoop HDFS to include and make available as a 'table' to the Apache Spark SQL Context.

Parameters:

type - file content type. Next types are currently supported:

• JSON
• PARQUET
• AVRO
• CSV

uri - hadoop file uri, for example: hdfs://nn.example.com/hadoop/hadoopfile

alias - the 'table' alias name through which the file content will be available to the Apache Spark SQL Context.

addJar - flag used to instruct the Spark Context to send the file type driver to Spark Workers. This is usually required (true).

Method Detail

getType

public String getType()

see FileDataProperties(String, String, String, Boolean)

Returns:

file content type

getUri

public String getUri()

see FileDataProperties(String, String, String, Boolean)

Returns:

hadoop file uri

getAlias

public String getAlias()

see FileDataProperties(String, String, String, Boolean)

Returns:

the 'table' alias name

isAddJar

public Boolean isAddJar()

see FileDataProperties(String, String, String, Boolean)

Returns:

is send the file type driver to Spark Workers

setType

public void setType(String type)

see FileDataProperties(String, String, String, Boolean)

Parameters:

type - file content type

setUri

public void setUri(String uri)

see FileDataProperties(String, String, String, Boolean)

Parameters:

uri - hadoop file uri

setAlias

public void setAlias(String alias)

see FileDataProperties(String, String, String, Boolean)

Parameters:

alias - the 'table' alias name

setAddJar

public void setAddJar(Boolean addJar)

see FileDataProperties(String, String, String, Boolean)

Parameters:

addJar - is send the file type driver to Spark Workers