Read data from a DBI connection into an ffdf. This can for example be used to import large datasets from Oracle, SQLite, MySQL, PostgreSQL, Hive or other SQL databases into R.
ETLUtils-package
(Package: ETLUtils) :
Extra utility functions to execute standard ETL operations on large data
Provides functions to load bigdata (e.g. from Oracle) directly into ffdf objects using DBI and some utility functions like recoding and matchmerge which does fast left outer join merging based on match.
matchmerge
(Package: ETLUtils) :
Merge two data frames (fast) by common columns by performing a left (outer) join or an inner join.
Merge two data frames (fast) by common columns by performing a left (outer) join or an inner join. The data frames are merged on the columns given by by.x and by.y. Columns can be specified only by name. This differs from the merge function from the base package in that merging is done based on 1 column key only. If more than one column is supplied in by.x and by.y, these columns will be concatenated together to form 1 key which will be used to match. Alternatively, by.x and by.y can be 2 vectors of length NROW(x) which will be used as keys.
write.jdbc.ffdf
(Package: ETLUtils) :
Write ffdf data to a database table by using a JDBC connection.
Write ffdf data to a database table by using a JDBC connection. This can for example be used to store large ffdf datasets from R in Oracle, SQLite, MySQL, PostgreSQL, Hive or other SQL databases. Mark that for very large datasets, these SQL databases might have tools to speed up by bulk loading. You might also consider that as an alternative to using this procedure.
write.odbc.ffdf
(Package: ETLUtils) :
Write ffdf data to a database table by using a ODBC connection.
Write ffdf data to a database table by using a ODBC connection. This can for example be used to store large ffdf datasets from R in Oracle, SQLite, MySQL, PostgreSQL, Hive or other SQL databases. Mark that for very large datasets, these SQL databases might have tools to speed up by bulk loading. You might also consider that as an alternative to using this procedure.
write.dbi.ffdf
(Package: ETLUtils) :
Write ffdf data to a database table by using a DBI connection.
Write ffdf data to a database table by using a DBI connection. This can for example be used to store large ffdf datasets from R in Oracle, SQLite, MySQL, PostgreSQL, Hive or other SQL databases. Mark that for very large datasets, these SQL databases might have tools to speed up by bulk loading. You might also consider that as an alternative to using this procedure.