Monthly Archives: January 2015

esProc Helps with Computation in MongoDB – Relationships between Tables

Posted on January 30, 2015 by datathinker

MongoDB doesn’t support join. The unity JDBC recommended by its official website can perform join operation after retrieving data out, but charges a fee for the service. Other free JDBC drivers can only support the basic SQL statements, without join … Continue reading →

Posted in MongoDB | Tagged , , , , | Leave a comment

esProc Helps Process Structured Text in Java – Import data into the database

Posted on January 27, 2015 by datathinker

While importing the structured text files into the database using Java alone, we need to combine the SQL statements together manually, and to deal with various troublesome situations as well, like if the data in a table has been existed, … Continue reading →

Posted in esProc/R/Python/Perl, Structured Data Process | Tagged , , , | Leave a comment

esProc Helps Process Structured Texts in Java – Alignment Join

Posted on January 21, 2015 by datathinker

The join statements of the database can be used conveniently to perform the operation of alignment join. But sometimes the data is stored in the text files, and to compute it in Java alone we need to write a large … Continue reading →

Posted in esProc/R/Python/Perl, Structured Data Process | Tagged , , , , , | Leave a comment

esProc Helps Process Structured Texts in Java –Non-Single Row Records

Posted on January 14, 2015 by datathinker

esProc can help Java deal with various computations in processing structured texts. But in the case of non-single row records, it is necessary to preprocess the data before esProc can perform computations on it. Let’s look at this through an … Continue reading →

Posted in Structured Data Process | Tagged , , , , | Leave a comment

esProc Helps Process Structured Texts in Java – Handle Big Files in Groups

Posted on January 8, 2015 by datathinker

There is a type of text files that they are too big to be entirely loaded into the memory, yet as the data have been sorted by a certain column and if they are imported in groups according to this … Continue reading →

Posted in esProc/R/Python/Perl, Structured Data Process | Tagged , , , , , | Leave a comment

esProc Helps Process Structured Texts in Java – Set Operations

Posted on January 6, 2015 by datathinker

Java doesn’t support set operations directly, so nested loops have to be used to realize the operations of intersection, union, complement and etc. between text files. If there are many text files, or the file to be computed is too … Continue reading →

Posted in esProc/R/Python/Perl, Structured Data Process | Tagged , , , | Leave a comment