org.mule.modules.sparksql.data

Class JdbcDataProperties

java.lang.Object

org.mule.modules.sparksql.data.JdbcDataProperties

public class JdbcDataProperties
extends Object

A schema or table at a JDBC accesible database to include and make available as a 'table(s)' to the Apache Spark SQL Context.
Members:

• driver: JDBC driver class name
• url: JDBC URL used to connect to the database
• dbTable: database table to be included to the context. Leave this value empty to include all tables in the schema (should be defined at the jdbc URL).
• addJar: flag used to instruct the Spark Context to send the JDBC driver to Spark Workers. This is usually required (true).
• columnName, lowerBound, upperBound and numPartitions: must all be specified if any of them is specified. They describe how to partition the table when reading in parallel from multiple workers. partitionColumn must be a numeric column from the table in question. Notice that lowerBound and upperBound are just used to decide the partition stride, not for filtering the rows in table. So all rows in the table will be partitioned and returned. see Apache Spark SQL programming guide

Constructor Summary

Constructors

Constructor and Description
JdbcDataProperties() Default constructor
JdbcDataProperties(String driver, String url, String dbTable, Boolean addJar) Create the configuration for a schema or table at a JDBC accesible database to include and make available as a 'table(s)' to the Apache Spark SQL Context.

Method Summary

Modifier and Type	Method and Description
String	getColumnName() see JdbcDataProperties
String	getDbTable() see JdbcDataProperties
String	getDriver() see JdbcDataProperties
Long	getLowerBound() see JdbcDataProperties
Integer	getNumPartitions() see JdbcDataProperties
Long	getUpperBound() see JdbcDataProperties
String	getUrl() see JdbcDataProperties
Boolean	isAddJar() see JdbcDataProperties
void	setAddJar(Boolean addJar) see JdbcDataProperties
void	setColumnName(String columnName) see JdbcDataProperties
void	setDbTable(String dbTable) see JdbcDataProperties
void	setDriver(String driver) see JdbcDataProperties
void	setLowerBound(Long lowerBound) see JdbcDataProperties
void	setNumPartitions(Integer numPartitions) see JdbcDataProperties
void	setUpperBound(Long upperBound) see JdbcDataProperties
void	setUrl(String url) see JdbcDataProperties

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

JdbcDataProperties

public JdbcDataProperties()

Default constructor

JdbcDataProperties

public JdbcDataProperties(String driver,
                          String url,
                          String dbTable,
                          Boolean addJar)

Create the configuration for a schema or table at a JDBC accesible database to include and make available as a 'table(s)' to the Apache Spark SQL Context.
(This constructor does not set any partitioning information) see JdbcDataProperties

Parameters:

driver - JDBC driver class name

url - JDBC URL used to connect to the database

dbTable - database table to be included to the context. Leave this value empty to include all tables in the schema (should be defined at the jdbc URL).

addJar - flag used to instruct the Spark Context to send the JDBC driver to Spark Workers. This is usually required (true).

Method Detail

getDbTable

public String getDbTable()

see JdbcDataProperties

Returns:

database table to be included to the context

getUrl

public String getUrl()

see JdbcDataProperties

Returns:

JDBC URL used to connect to the database

getDriver

public String getDriver()

see JdbcDataProperties

Returns:

JDBC driver class name

isAddJar

public Boolean isAddJar()

see JdbcDataProperties

Returns:

is send the file type driver to Spark Workers

getNumPartitions

public Integer getNumPartitions()

see JdbcDataProperties

Returns:

partition information

getUpperBound

public Long getUpperBound()

see JdbcDataProperties

Returns:

partition information

getLowerBound

public Long getLowerBound()

see JdbcDataProperties

Returns:

partition information

getColumnName

public String getColumnName()

see JdbcDataProperties

Returns:

partition information

setDriver

public void setDriver(String driver)

see JdbcDataProperties

Parameters:

driver - JDBC driver class name

setUrl

public void setUrl(String url)

see JdbcDataProperties

Parameters:

url - JDBC URL used to connect to the database

setDbTable

public void setDbTable(String dbTable)

see JdbcDataProperties

Parameters:

dbTable - database table to be included to the context

setAddJar

public void setAddJar(Boolean addJar)

see JdbcDataProperties

Parameters:

addJar - is send the file type driver to Spark Workers

setNumPartitions

public void setNumPartitions(Integer numPartitions)

see JdbcDataProperties

Parameters:

numPartitions - partition information

setUpperBound

public void setUpperBound(Long upperBound)

see JdbcDataProperties

Parameters:

upperBound - partition information

setLowerBound

public void setLowerBound(Long lowerBound)

see JdbcDataProperties

Parameters:

lowerBound - partition information

setColumnName

public void setColumnName(String columnName)

see JdbcDataProperties

Parameters:

columnName - partition information