Category Archives: Structured Data Process

Functions of esProc/R/Python/Perl in structured data process by comparison

esProc Performs Dynamic Cross-database MERGE Operation

The MERGE statement provided by databases like MSSQL and ORACLE is very convenient for updating tables. But it is not as convenient as it is expected to be when the source table and target table exist in different databases. In … Continue reading

Posted in esProc/R/Python/Perl, Structured Data Process | Tagged , , , , | Leave a comment

esProc Assists Java in Merging Text Files to Excel

Problem source:http://bbs.csdn.net/topics/390842850  . In this case, you need to merge data from all text files in a given directory and export it to an Excel file. Each of these text files has tab-seperated data with one row and three columns. … Continue reading

Posted in esProc/R/Python/Perl, Program Language, Structured Data Process | Tagged , , , , | Leave a comment

esProc Finds Differences between CSV files

userName and date are the logical primary key of both old.csv file and new.csv file, in which we want to find rows that are new, deleted and updated. The source data is as follows:   As can be seen from … Continue reading

Posted in esProc/R/Python/Perl, Structured Data Process | Tagged , , , | Leave a comment

esProc Joins Text files and Generates a Computed Column

There are two tab-separated structured text files. chr column in AssociatedMarkers.txt is the logical foreign key pointing toChr column in DiseaseMarkers.txt. We want to create a new structured text file, in which one column comes from AssociatedMarkers.txt’s snps_BCG24 column and … Continue reading

Posted in esProc/R/Python/Perl, Structured Data Process | Tagged , , , | Leave a comment

esProc Joins a Structured Text file with a JSON File

structure.txt is a tab-separated structured text file. json.txt contains non-structured JSON strings. We need to join the two files to create a new file result.txt. The original data is as follows. structure.txt Json.txt Result.txt esProc will first import json.txt as … Continue reading

Posted in esProc/R/Python/Perl, Structured Data Process | Tagged , , , | Leave a comment

Processing Big Text Files with esProc Cursor: Code Examples

esProc supports cursor objects and provides related functions to process big text files conveniently. Below is an example. Suppose a text file, sales.txt, stores ten million sales records. Its fields mainly include SellerID, OrderDate and Amount. Requirement: Computing each seller’s … Continue reading

Posted in esProc/R/Python/Perl, Structured Data Process | Tagged , , | Leave a comment

esProc Assists Java to Query Big Text Files

Sometimes you need to query a big text file, instead of the database. In those cases, you need to retrieve the file in a stream style to perform the query algorithm, in which parallel processing is required in order to … Continue reading

Posted in esProc/R/Python/Perl, Program Language, Structured Data Process | Tagged , , , | Leave a comment

esProc Simplifies SQL-style Computations – Record Splitting

Programmers often encounter complicated SQL-style computations during database application development. Record splitting, for example, is to split a record separated by a certain separator into multiple ones. For different databases, SQL has various problems like poor syntax support and the … Continue reading

Posted in esProc/R/Python/Perl, Program Language, SQL-related Puzzle, Structured Data Process | Tagged , , | Leave a comment

esProc Simplifies SQL-style computations – Ungrouping

During database application development, we often need to handle complicated SQL-style computations. One of them is the ungrouping, that is, the opposite process of grouping and summarizing which requires, for example, splitting each record into multiple records. We cannot realize … Continue reading

Posted in Program Language, Structured Data Process | Tagged , , | Leave a comment

esProc Helps Process Structured Text in Java – Import data into the database

While importing the structured text files into the database using Java alone, we need to combine the SQL statements together manually, and to deal with various troublesome situations as well, like if the data in a table has been existed, … Continue reading

Posted in esProc/R/Python/Perl, Structured Data Process | Tagged , , , | Leave a comment