Category Archives: Structured Data Process

Functions of esProc/R/Python/Perl in structured data process by comparison

esProc Performs Dynamic Cross-database MERGE Operation

The MERGE statement provided by databases like MSSQL and ORACLE is very convenient for updating tables. But it is not as convenient as it is expected to be when the source table and target table exist in different databases. In … Continue reading

Posted in esProc/R/Python/Perl, Structured Data Process | Tagged , , , , | Leave a comment

esProc Assists Java in Merging Text Files to Excel

Problem source:http://bbs.csdn.net/topics/390842850  . In this case, you need to merge data from all text files in a given directory and export it to an Excel file. Each of these text files has tab-seperated data with one row and three columns. … Continue reading

Posted in esProc/R/Python/Perl, Program Language, Structured Data Process | Tagged , , , , | Leave a comment

esProc Finds Differences between CSV files

userName and date are the logical primary key of both old.csv file and new.csv file, in which we want to find rows that are new, deleted and updated. The source data is as follows:   As can be seen from … Continue reading

Posted in esProc/R/Python/Perl, Structured Data Process | Tagged , , , | Leave a comment

esProc Joins Text files and Generates a Computed Column

There are two tab-separated structured text files. chr column in AssociatedMarkers.txt is the logical foreign key pointing toChr column in DiseaseMarkers.txt. We want to create a new structured text file, in which one column comes from AssociatedMarkers.txt’s snps_BCG24 column and … Continue reading

Posted in esProc/R/Python/Perl, Structured Data Process | Tagged , , , | Leave a comment

esProc Joins a Structured Text file with a JSON File

structure.txt is a tab-separated structured text file. json.txt contains non-structured JSON strings. We need to join the two files to create a new file result.txt. The original data is as follows. structure.txt Json.txt Result.txt esProc will first import json.txt as … Continue reading

Posted in esProc/R/Python/Perl, Structured Data Process | Tagged , , , | Leave a comment

Processing Big Text Files with esProc Cursor: Code Examples

esProc supports cursor objects and provides related functions to process big text files conveniently. Below is an example. Suppose a text file, sales.txt, stores ten million sales records. Its fields mainly include SellerID, OrderDate and Amount. Requirement: Computing each seller’s … Continue reading

Posted in esProc/R/Python/Perl, Structured Data Process | Tagged , , | Leave a comment

esProc Assists Java to Query Big Text Files

Sometimes you need to query a big text file, instead of the database. In those cases, you need to retrieve the file in a stream style to perform the query algorithm, in which parallel processing is required in order to … Continue reading

Posted in esProc/R/Python/Perl, Program Language, Structured Data Process | Tagged , , , | Leave a comment