Latest News from Jessica Qiuhttp://jessicaqiu.ulitzer.com/
Latest News from Jessica QiuenCopyright 2018 Ulitzer.com Ulitzer.comWed, 19 Dec 2018 03:06:19 ESThttp://backend.userland.com/rss360xxxhttp://jessicaqiu.ulitzer.com/node/3190434
How to sort records of the tables if the data are massive and cannot be loaded into memory all together? Especially for cursor involved sorting, ie.,the operation of orderly merging gets data from many cursors, and joining records of a cursor in alignment also requires that the data in every cursor are sorted.This article shows the solution with code examples. <p><a href="http://jessicaqiu.ulitzer.com/node/3190434" target="_blank">read more</a></p>Mon, 29 Sep 2014 11:55:00 EDThttp://jessicaqiu.ulitzer.com/node/3190434http://jessicaqiu.ulitzer.com/node/3190434#feedbackComparison of esProc and R Language in Processing Text Fileshttp://jessicaqiu.ulitzer.com/node/3152187
As programming languages for data computing, both esProc and R language have rich functions to process text files. They have many similarities in basic usage, as well as obvious differences, such as in the aspect of processing files with fixed column width and big text files, reading and writing designated columns, computational performance, etc. The article aims to compare their similarities and differences, and also hope for your suggestions if there are any faults in R language coding.<p><a href="http://jessicaqiu.ulitzer.com/node/3152187" target="_blank">read more</a></p>Tue, 19 Aug 2014 06:50:00 EDThttp://jessicaqiu.ulitzer.com/node/3152187http://jessicaqiu.ulitzer.com/node/3152187#feedbackExcel Data Processing Examplehttp://jessicaqiu.ulitzer.com/node/3144150
A code example to read, calculate and write large Excel data in batch more efficiently: Read data of orders and sellers’ information list from data.xlsx, compute sales amount of every department, and return the result into result.xlsx. <p><a href="http://jessicaqiu.ulitzer.com/node/3144150" target="_blank">read more</a></p>Fri, 15 Aug 2014 13:37:06 EDThttp://jessicaqiu.ulitzer.com/node/3144150http://jessicaqiu.ulitzer.com/node/3144150#feedbackParallelism Enhances Oracle Data Import Speedhttp://jessicaqiu.ulitzer.com/node/3092043
Recently, we skillfully handled an industry project to import a great amount of data from file to Oracle in comparatively short time.
Later, by adopting the parallel import of sqlldr, the time is shortened to 0.8 hour. Here are the full details:
Train of thoughts
Split the data file to import into 10 shares. Then, with the multi-task parallelism, execute the sqlldr command for the corresponding shares. Needless to say, prepare the control files of the same amount. Then, multiple clients will start to import data to database all at the same time.<p><a href="http://jessicaqiu.ulitzer.com/node/3092043" target="_blank">read more</a></p>Mon, 26 May 2014 12:03:00 EDThttp://jessicaqiu.ulitzer.com/node/3092043http://jessicaqiu.ulitzer.com/node/3092043#feedbackEsProc Enables Oracle JDBC to Speed Up Retrieve Processhttp://jessicaqiu.ulitzer.com/node/3085233
How to solve a disturbing issue occurred when retrieving the data in a big detail report? here are some best tips on how to expedite multilevel retrieve process synchronously.
Recently, a performance issue occurs in a big detail report, where the original data volume in the two data tables as it involved has exceeded 3 million rows; the data volume that the report can retrieve after filtering remains at round 2 million rows. As we expected before, by using paged retrieve method, this report would present a much higher performance. However, for the fact that the user also needs to export the data from the report, the only option is that the data retrieve can be achieved from Oracle at a time. As the JDBC of Oracle runs quite slowly, it takes least 6-7 minutes to retrieve the data of more than 2 million rows from the Oracle. In general, such performance cannot meet the expectation of the customer.<p><a href="http://jessicaqiu.ulitzer.com/node/3085233" target="_blank">read more</a></p>Mon, 26 May 2014 11:55:45 EDThttp://jessicaqiu.ulitzer.com/node/3085233http://jessicaqiu.ulitzer.com/node/3085233#feedbackTop Three Salespersons Ranking by Monthly Sales Amounthttp://jessicaqiu.ulitzer.com/node/3066054
Both R language and esProc have the outstanding ability to perform the stepwise computations. However, in the particulars they differ from each other. A comparison between them will be done by the following example.<p><a href="http://jessicaqiu.ulitzer.com/node/3066054" target="_blank">read more</a></p>Wed, 23 Apr 2014 15:21:54 EDThttp://jessicaqiu.ulitzer.com/node/3066054http://jessicaqiu.ulitzer.com/node/3066054#feedbackSolving Complex Computationshttp://jessicaqiu.ulitzer.com/node/3065856
A company has a High Growth SalesMan of the Year report, which analyzes, mainly through sales data, the salesmen whose sales amount exceeds 10% for three consecutive months, and demonstrates the indices such as their sales amount(Sales Amount), sales amount link relative ratio(Amount LRR), client count(Client Count), and client count link relative ratio(Client LRR).<p><a href="http://jessicaqiu.ulitzer.com/node/3065856" target="_blank">read more</a></p>Wed, 23 Apr 2014 11:26:22 EDThttp://jessicaqiu.ulitzer.com/node/3065856http://jessicaqiu.ulitzer.com/node/3065856#feedbackSolving a JOIN Computation by SQL and esProchttp://jessicaqiu.ulitzer.com/node/3063906
Based on the generic data type, esProc provides the sequence and the Table Sequence for implementing the complete set-lizing and the much more convenient relational queries.
The relation between the department and the employee is one-to-many and that between the employee and the SSN (Social Security Number) is one-to-one. Everything is related to everything else in the world. The relational query is the access to relational dataset with the mathematical linguistics. Thanks to the associated query, the relational database (RDBMS) is extensively adopted. <p><a href="http://jessicaqiu.ulitzer.com/node/3063906" target="_blank">read more</a></p>Fri, 18 Apr 2014 12:06:17 EDThttp://jessicaqiu.ulitzer.com/node/3063906http://jessicaqiu.ulitzer.com/node/3063906#feedbackCross Database Computing in Report Developmenthttp://jessicaqiu.ulitzer.com/node/3057623
Recently a development team met some difficulties in data source computation when developing iReport reports. After the use of esProc for cross database computation, the problem is resolved.
This is a project payment progress report, as part of a project management system. It's based on an Oracle database. The reports needs to present the project name, payment amount, contract value, payment progress (in percentage), and name of the project manager, etc., for all ongoing projects. Amount these the first 3 items contributes to the difficulties met by the development team.<p><a href="http://jessicaqiu.ulitzer.com/node/3057623" target="_blank">read more</a></p>Wed, 16 Apr 2014 09:53:08 EDThttp://jessicaqiu.ulitzer.com/node/3057623http://jessicaqiu.ulitzer.com/node/3057623#feedbackesProc Optimizes the Performance of Oracle Datasource Reporthttp://jessicaqiu.ulitzer.com/node/3055436
Some reports in a project suffered from very low speed. Despite various iReport and Oracle database optimizations, the situation is not yet satisfying. For example, there is a detail report, involving large data volume, many (dozens of) data tables, and frequent inter-table join (including self join). This report includes inter-cell computing expressions (ratios and sum). Here are some complicated data set SQL statements from this report: New reporting tool to optimize the reporting data source preparation performance in iReport and oracle database.<p><a href="http://jessicaqiu.ulitzer.com/node/3055436" target="_blank">read more</a></p>Mon, 14 Apr 2014 14:59:09 EDThttp://jessicaqiu.ulitzer.com/node/3055436http://jessicaqiu.ulitzer.com/node/3055436#feedbackLeveraging esProc for a Heterogeneous Data Source Computation Issuehttp://jessicaqiu.ulitzer.com/node/3051711
Recently we resolved an issue with Crystal Report, related with heterogeneous data source computation. Due to its complexity, the computation cannot be done with the current functionality of Crystal Report. Thus esProc is used for cross database computation.<p><a href="http://jessicaqiu.ulitzer.com/node/3051711" target="_blank">read more</a></p>Fri, 11 Apr 2014 16:05:46 EDThttp://jessicaqiu.ulitzer.com/node/3051711http://jessicaqiu.ulitzer.com/node/3051711#feedbackIssue of Reporting Development in Different Databaseshttp://jessicaqiu.ulitzer.com/node/3039079
This is a solution of solving multi databases issue in reporting development.<p><a href="http://jessicaqiu.ulitzer.com/node/3039079" target="_blank">read more</a></p>Thu, 10 Apr 2014 11:49:44 EDThttp://jessicaqiu.ulitzer.com/node/3039079http://jessicaqiu.ulitzer.com/node/3039079#feedbackPerformance Testing of Hive, esProc, and Impala | Part 2http://jessicaqiu.ulitzer.com/node/3024136
Comparison of Hive, Impala and esProc in terms of computing performance<p><a href="http://jessicaqiu.ulitzer.com/node/3024136" target="_blank">read more</a></p>Mon, 31 Mar 2014 14:51:28 EDThttp://jessicaqiu.ulitzer.com/node/3024136http://jessicaqiu.ulitzer.com/node/3024136#feedbackPerformance Comparison Testing of Hive, esProc, and Impala Part 1http://jessicaqiu.ulitzer.com/node/3014276
In order to ensure the test data is typical and comparable, the three products must go through the same computing. The Hive or Impala is designed for the data warehouse, providing the SQL-like syntax as the only available syntax. By comparison, esProc is designed as the complex procedural computing script, but not the data warehouse. In other words, esProc does not provide the SQL -style syntax directly, and esProc script can achieve the result of SQL computing by simulating in a more convenient style. So, the test computation this time is the SQL-style grouping, summarizing, and join operations.<p><a href="http://jessicaqiu.ulitzer.com/node/3014276" target="_blank">read more</a></p>Tue, 18 Mar 2014 15:51:10 EDThttp://jessicaqiu.ulitzer.com/node/3014276http://jessicaqiu.ulitzer.com/node/3014276#feedbackExamples to Demonstrate Why Cell Coding Overpowers Text Codinghttp://jessicaqiu.ulitzer.com/node/2991225
In the previous article, I’ve shared some experiences in Hadoop coding with the agile esProc syntax. This article is the supplementary and in-depth discussion based on the previous one.
Firstly, let’t talk about the Cellset Code.
In the previous article, I ‘ve introduced the convenience of using cellset code to define variable, make reference to variable, and achieve the complex computation goal in multiple steps. In facts, the cellset or grid can be used to make it more simple to reuse the computational result. Please refer to the code block below:<p><a href="http://jessicaqiu.ulitzer.com/node/2991225" target="_blank">read more</a></p>Fri, 28 Feb 2014 13:39:20 ESThttp://jessicaqiu.ulitzer.com/node/2991225http://jessicaqiu.ulitzer.com/node/2991225#feedbackSix Desktop BI Toolshttp://jessicaqiu.ulitzer.com/node/2938602
Recently, I finished a project which involves using the Excel, R Project, and es-series in combination. An idea occurred to me in the work. Why not put them along with the Matlab, SPSS, and Stata side-by-side to make an introductions and comparisons of Desktop BI tools? At last, this essay comes into being, as you can see below.
Desktop BI refers to the BI tools running on the desktop environment, almost not requiring any server supports. The typical Desktop BI only provides the core BI functions with less requirement on the technical environments. By comparison, such software as Solution BI cannot operate without the support from private server. They are usually the integrated solution or platform system in-built with lots of half-finished components. Besides the core BI functions, Solution BI also provide some non-core functions like the authority management, resources sharing, and collaboration between jobs of various types. Desktop BI is the commonest tool for people doing the data computing and analysis.<p><a href="http://jessicaqiu.ulitzer.com/node/2938602" target="_blank">read more</a></p>Wed, 29 Jan 2014 11:52:37 ESThttp://jessicaqiu.ulitzer.com/node/2938602http://jessicaqiu.ulitzer.com/node/2938602#feedbackAgile Program Language to Deal with Complex Procedureshttp://jessicaqiu.ulitzer.com/node/2925379
Hadoop is an outstanding parallel computing system whose default parallel computing mode is MapReduce. However, such parallel computing is not specially designed for parallel data computing. Plus, it is not an agile parallel computing program language, the coding efficiency for data computing is relatively low, and this parallel computing is even more difficult to compose the universal algorithm.<p><a href="http://jessicaqiu.ulitzer.com/node/2925379" target="_blank">read more</a></p>Tue, 14 Jan 2014 15:08:03 ESThttp://jessicaqiu.ulitzer.com/node/2925379http://jessicaqiu.ulitzer.com/node/2925379#feedbackAn Example to Illustrate Hadoop Code Reusehttp://jessicaqiu.ulitzer.com/node/2918199
The MapReduce of Hadoop is a widely-used parallel computing framework. However, its code reuse mechanism is inconvenient, and it is quite cumbersome to pass parameters. Far different from our usual experience of calling the library function easily, I found both the coder and the caller must bear a sizable amount of precautions in mind when writing even a short pieces of program for calling by others.
However, we finally find that esProc could easily realize code reuse in hadoop. Still a simple and understandable example of grouping and summarizing, let's check out a solution with not so great reusability. Suppose we need to group the big data of order (sales.txt) on HDFS by salesman (empID), and seek the corresponding sales amount of each Salesman. esProc codes are:<p><a href="http://jessicaqiu.ulitzer.com/node/2918199" target="_blank">read more</a></p>Fri, 10 Jan 2014 10:33:21 ESThttp://jessicaqiu.ulitzer.com/node/2918199http://jessicaqiu.ulitzer.com/node/2918199#feedbackParallel Computing with esProc to Make Complex Logic Programming Easierhttp://jessicaqiu.ulitzer.com/node/2911173
Hadoop is an outstanding distributed computing system. However, many users find MapReduce is too complex and too tough to manage, the response is too slow, the realtime is too poor, and the running is inefficient. In a word, it is too heavy. They are users of middle-and-small-scale cluster. They do not need such heavyweight solution. In this case, using esProc to realize the lightweight database or hadoop parallel computing would be one of the choices.
Let’s demonstrate how esProc realizes the lightweight database or hadoop parallel computing for Hadoop with a typical grouping computing example below. In this example, we summarize and count the order data from a file in HDFS to compute the sales value for each sales person. Because the data volume is too large for a single computer to process, we need to speed up by distributing the computing workload.<p><a href="http://jessicaqiu.ulitzer.com/node/2911173" target="_blank">read more</a></p>Tue, 31 Dec 2013 10:30:16 ESThttp://jessicaqiu.ulitzer.com/node/2911173http://jessicaqiu.ulitzer.com/node/2911173#feedbackRealize Memory Computation in Hadoophttp://jessicaqiu.ulitzer.com/node/2902292
The low efficiency of Hadoop computation is an undeniable truth. We believe, one of the major reasons is that the underlying computational structure of MapReduce for Hadoop is basically of the external memory computation. The external memory computation implements the data exchange through the frequent external memory read/write. Because the efficiency of file I/O is two orders of magnitude lower than that of memory, the computational performance of Hadoop is unlikely high.<p><a href="http://jessicaqiu.ulitzer.com/node/2902292" target="_blank">read more</a></p>Wed, 18 Dec 2013 14:37:20 ESThttp://jessicaqiu.ulitzer.com/node/2902292http://jessicaqiu.ulitzer.com/node/2902292#feedbackConsolidate Multiple Database Sources for Single-Source Reporting Toolhttp://jessicaqiu.ulitzer.com/node/2891588
An effort to solve data source preparation in reporting tool developing.
Data sources cover the result set of SQL queries or stored procedures, and the 2D table from the text or Excel files. Owing to the technical competence or versioning, various reporting tools may only support a single data source, such as JasperReport, Quiee, BIRT, and Crystal Report.<p><a href="http://jessicaqiu.ulitzer.com/node/2891588" target="_blank">read more</a></p>Wed, 11 Dec 2013 15:17:29 ESThttp://jessicaqiu.ulitzer.com/node/2891588http://jessicaqiu.ulitzer.com/node/2891588#feedbackAn Alternative to Stored Procedure in Big Data Computationhttp://jessicaqiu.ulitzer.com/node/2888134
In the past, the data structure and business logics were so simple that one SQL statement was enough to achieve user's computational goal. With the rapid growing of information industry, users frequently find that they need to achieve the increasingly complex computational goals to out-perform their competitors. To address such computations, SQL alone is far from enough. Database programmers have the additional demands regarding the judge and loop statements, branches at multiple levels, or more accurate data transverse operations, as well as decomposing an obscure goal into several clear and actionable steps correlated with complex logics. It was for all these demands that the stored procedure was introduced.<p><a href="http://jessicaqiu.ulitzer.com/node/2888134" target="_blank">read more</a></p>Mon, 09 Dec 2013 06:45:00 ESThttp://jessicaqiu.ulitzer.com/node/2888134http://jessicaqiu.ulitzer.com/node/2888134#feedbackDatabase to Implement Big Data Real-Time Applicationhttp://jessicaqiu.ulitzer.com/node/2880003
Traditional database is difficult to implement real-time application when the data volume is big. Now with data computing middleware, performance of database is improved and real-time application is also realized.
The Big Data Real-time Application is a scenario to return the computation and analysis results in real time even if there are huge amount of data. This is an emerging demand on database applications in recent years.
In the past, because there are not so much data, the computation is simple, and few parallelisms, the pressure on the database is not great. A high-end or middle-range database server or cluster can allocate enough resource to meet the demand. Moreover, in order to rapidly and parallelly access to the current business data and the historic data, users also tend to arrange a same database server for both the query analysis system and the production system. By this way, the database cost can be lowered, the data management streamlined, and the parallelism ensured to some extent. We are in the prime time of database real-time application development.<p><a href="http://jessicaqiu.ulitzer.com/node/2880003" target="_blank">read more</a></p>Mon, 02 Dec 2013 04:45:00 ESThttp://jessicaqiu.ulitzer.com/node/2880003http://jessicaqiu.ulitzer.com/node/2880003#feedbackHadoop + esProc Help You Replace IOEhttp://jessicaqiu.ulitzer.com/node/2876966
What is IOE? I=IBM, O=Oracle, and E=EMC. They represent the typical high-end database and data warehouse architecture. The high-end servers include HP, IBM, and Fujitsu, the high-end database software includes Teradata, Oracle, Greenplum; the high-end storages include EMC, Violin, and Fusion-io.
In the past, such typical high performance database architecture is the preference of large and middle sized organizations. They can run stably with superior performance, and became popular when the informatization degree was not so high and the enterprise application was simple. With the explosive data growth and the nowadays diversified and complex enterprise applications, most enterprises have gradually realized that they should replacing IOE, and quite a few of them have successfully implemented their road map to cancel the high-end database totally, including Intel, Alibaba, Amazon, eBay, Yahoo, and Facebook.<p><a href="http://jessicaqiu.ulitzer.com/node/2876966" target="_blank">read more</a></p>Wed, 20 Nov 2013 14:42:58 ESThttp://jessicaqiu.ulitzer.com/node/2876966http://jessicaqiu.ulitzer.com/node/2876966#feedbackInnovative Tool-Defined Solution for Data Preparation of Reportshttp://jessicaqiu.ulitzer.com/node/2763032
In report development, it is the “computation” part and not the “presentation” part that brings about major difficulties. But reporting tool is weak in computation. The report developers as usual are more willing to compute in the report straightforwardly after retrieving data with SQL or Wizard. However, SQL script is more difficult to understand.
According to research, most complex report development work can be simplified by performing the data source computation in advance. For example, find out the clients who bought all products in the given list, and then present the details of these clients.
In developing such reports, it is the "computation" part and not the "presentation" part that brings about major difficulties. In which stage will the computation be most cost-effective? Shall the computation be set in the data retrieval scripting or the post-retrieval report presentation?
The report developers as usual are more willing to compute in the report straightforwardly after retrieving data with SQL or Wizard. On the one hand, it is because most report tools are capable of some step-by-step simple computations by themselves, while SQL only allows for incorporating all logics in one statement and is impossible to be decomposed into several examinable components; on the other hand, most report developers are more familiar with the report functions than that of SQL/SP, and the SQL/SP scripts are more difficult to understand.<p><a href="http://jessicaqiu.ulitzer.com/node/2763032" target="_blank">read more</a></p>Wed, 28 Aug 2013 13:14:40 EDThttp://jessicaqiu.ulitzer.com/node/2763032http://jessicaqiu.ulitzer.com/node/2763032#feedbackThe Truth About Efficient Data Processes in Java Developmenthttp://jessicaqiu.ulitzer.com/node/2757122
In the process of Java development, developers will come across data computation. But Java alone is not convenient to handle such computation. SQL has limited impact on improving the computational efficiency for Java.
With Java alone it's difficult to handle such computations. Although it is powerful enough and also quite convenient in debugging, Java has not directly implemented the common computational algorithms yet. So, Java programmers still have to spend great time and efforts to implement the details like aggregating, filtering, grouping, sorting, and ranking. In the respect of data storage and access, programmers have to use List and other objects to assemble every 2D table and every piece of data, and then arrange the nested multi-level loops. In addition, such computation involves set and relation operations on massive data, or relative position between object and object properties. The underlying logics for these computations demand great efforts, not to mention the Excel or Text data, data from set, and the complex computational goal.<p><a href="http://jessicaqiu.ulitzer.com/node/2757122" target="_blank">read more</a></p>Tue, 20 Aug 2013 09:59:09 EDThttp://jessicaqiu.ulitzer.com/node/2757122http://jessicaqiu.ulitzer.com/node/2757122#feedbackMore Efficient Data Preparation for Reports Beyond ETL/DWhttp://jessicaqiu.ulitzer.com/node/2753412
In the process of report development, developers may need to handle data from multiple sources. But most of reporting tools only support single data source. Even the so-called reporting tools for multiple data source can only join 2 result sets roughly, and are also very inconvenient for the complex multi-data-source computations.<p><a href="http://jessicaqiu.ulitzer.com/node/2753412" target="_blank">read more</a></p>Thu, 08 Aug 2013 12:29:47 EDThttp://jessicaqiu.ulitzer.com/node/2753412http://jessicaqiu.ulitzer.com/node/2753412#feedbackWhich Tool Will You Choose for Java: Hibernate, esProc, SQL, iBATIS or R?http://jessicaqiu.ulitzer.com/node/2749722
The data computation layer of Java aims to reduce the coupling between these two layers and shift the computational workload from them. What are the features of the typical computation layer? What are the advantages and disadvantages of 5 data computation layers of Hibernate, esProc, SQL, iBATIS, and R language?
Ability to compute on the data from arbitrary data persistence layers, not only databases, but also the non-database Excel, Txt, or XML files. Of all these computations, the key is the computation on the commonest structured data.
Ability to perform the interactive computations among various data sources uniformly, not only including the computation among different databases, but also calculation between the databases and non-database data sources.<p><a href="http://jessicaqiu.ulitzer.com/node/2749722" target="_blank">read more</a></p>Sat, 03 Aug 2013 13:00:00 EDThttp://jessicaqiu.ulitzer.com/node/2749722http://jessicaqiu.ulitzer.com/node/2749722#feedbackWill Big Data Fall into the Pitfall of Failure?http://jessicaqiu.ulitzer.com/node/2745051
Why big data will fall into the pitfall of failure? It is because the current big data only provides the solution for data storage and query. It lacks a good solution for business analysis to enhance the competiveness, which is the most crucial.<p><a href="http://jessicaqiu.ulitzer.com/node/2745051" target="_blank">read more</a></p>Tue, 23 Jul 2013 05:45:00 EDThttp://jessicaqiu.ulitzer.com/node/2745051http://jessicaqiu.ulitzer.com/node/2745051#feedbackTwo Ideal Solutions to Complex Calculation on Set in Javahttp://jessicaqiu.ulitzer.com/node/2738997
In Java development, programmers may encounter the complex set operations. But Java is not capable enough to handle such computations. For this reason, programmers usually resort to dynamic calculation script for set operation. But SQL does not support the explicit set, and is unable to represent the sets of a set, ordered set, generic set, and only the result set can be recognized as a set. In this article, I'll show you a new way.
SQL is surely the first kind of script that comes into most programmers' mind. However, to their disappointments, SQL does not support the explicit set, and is unable to represent the sets of a set, ordered set, generic set, and only the result set can be recognized as a set. Therefore, it is only the subset of the true set. Many operations on sets are hard to implement through SQL. Moreover, the computation is not limited on database, such as the data from Excel and even there is no database in the application environment. In this case, the usage of SQL database is further narrowed.<p><a href="http://jessicaqiu.ulitzer.com/node/2738997" target="_blank">read more</a></p>Wed, 17 Jul 2013 11:43:10 EDThttp://jessicaqiu.ulitzer.com/node/2738997http://jessicaqiu.ulitzer.com/node/2738997#feedbackBe Aware of a Java Development Tool for Data Computinghttp://jessicaqiu.ulitzer.com/node/2724367
Computing on structured data is difficult to completed with Java. Then, how to implement the computation similar to database in Java conveniently?
In the process of development with Java, we will occasionally encounter the computation similar to data processing in database. For instance, there are two frequently updated Excel sheets, which are the clients' information and the orders. We need to query the data of clients who have bought all the products on the list through entering a dynamic product list.
The "computation similar to data processing in database" refers to structured data computation of an application without database. Although Java is capable of handling such computation, the procedure is very cumbersome and verbose.
It takes programmers a lot of time and efforts to implement the computational details. For example, seek the maximum value, rank, filter, group, and average. In addition, it is cumbersome to define various data types. For example, define class, use object to represent every piece of data, and then use List to store multiple pieces of data. The computational procedure is implemented with nested multiple level of loops. The computations involve the set computation and relation computation between massive data, or computation on relative positions between objects and object attributes. It takes great efforts to implement the underlying logics for these computations.<p><a href="http://jessicaqiu.ulitzer.com/node/2724367" target="_blank">read more</a></p>Wed, 03 Jul 2013 12:38:07 EDThttp://jessicaqiu.ulitzer.com/node/2724367http://jessicaqiu.ulitzer.com/node/2724367#feedbackVisualized Calculation by Empowering Spreadsheet with SQL Abilityhttp://jessicaqiu.ulitzer.com/node/2629324
Spreadsheet software is widely used by people in every industry with flexibility for data computing and analysis. But due to inherent drawbacks, common business spreadsheet software can't conduct relational query like SQL.
The spreadsheet can implement the visualized calculation to some extent, and the nontechnical people can perform some rather complex calculations without having to learn the SQL. However, as the core of SQL, the relational query is unable to be implemented through common business spreadsheet software, which adds complexity to the apparently simple problems of multi-table join.<p><a href="http://jessicaqiu.ulitzer.com/node/2629324" target="_blank">read more</a></p>Fri, 26 Apr 2013 08:55:55 EDThttp://jessicaqiu.ulitzer.com/node/2629324http://jessicaqiu.ulitzer.com/node/2629324#feedbackGet a Standalone Alternative for Excelhttp://jessicaqiu.ulitzer.com/node/2564727
Raqsoft welcomes anyone who interested in powerful spreadsheet software to write reviews for esCalc or share application cases. Participants can get esCalc for free by doing this.
A standalone alternative for Excel on complex data computing, esCalc, will be offered for free to participants who write reviews or share their application cases (The application cases could be the usage of esCalc in a task or a function introduction of esCalc.), according to the announcement of Raqsoft. This campaign starts from March 6, 2013 and will end at May 6, 2013.
Participants will get various licenses of esCalc through different forms of participation, showing as below:<p><a href="http://jessicaqiu.ulitzer.com/node/2564727" target="_blank">read more</a></p>Wed, 06 Mar 2013 13:10:01 ESThttp://jessicaqiu.ulitzer.com/node/2564727http://jessicaqiu.ulitzer.com/node/2564727#feedbackTruth behind Ticket Purchasing Rush: Statistical Analysis Workshttp://jessicaqiu.ulitzer.com/node/2548205
Getting tickets is always very hard during holidays, especially during transport peak from Jan. 26, 2013 to According to the data of Chendu Railway Station on 18th, February, 2013, 14 temporary trains have been added while still tickets of many trains haven’t been left. To ease the ticket purchasing rush, MOR (China’s Ministry of Railways) has taken various measures, such as adding more temporary passenger trains, extending the presale period and calling for prohibition of tickets purchasing plug-ins, etc. But The result is not so outstanding. What are the reasons?<p><a href="http://jessicaqiu.ulitzer.com/node/2548205" target="_blank">read more</a></p>Fri, 22 Feb 2013 09:54:45 ESThttp://jessicaqiu.ulitzer.com/node/2548205http://jessicaqiu.ulitzer.com/node/2548205#feedbackOnly Two Weeks Left for Special Offerhttp://jessicaqiu.ulitzer.com/node/2507634
With Christmas and New Year celebration passing by, enterprises from different industries turn their focus from festival fun to work. It’s time to fresh your mind and recharge your batteries to kick off 2013 in a perfect way. Statistical computing and analytics tools, esProc and esCalc are ideal solutions to help you make smart decisions and work out strategic plan for your business.
<p><a href="http://jessicaqiu.ulitzer.com/node/2507634" target="_blank">read more</a></p>Fri, 11 Jan 2013 13:32:34 ESThttp://jessicaqiu.ulitzer.com/node/2507634http://jessicaqiu.ulitzer.com/node/2507634#feedbackBeijing Spirit Leads Enterprises to Continuous Progresshttp://jessicaqiu.ulitzer.com/node/2473658
Beijing Spirit? Have you ever heard it? It is announced by Beijing government on 2nd, November, 2011. This Beijing Spirit has been taken as a guide by Beijing citizens including the local enterprises. Do you wonder to know why?
A country needs great national spirit and so does a city. That's the reason that Beijing, the capital of China announced "Beijing Spirit" on 2nd, November, 2011. Beijing Spirit includes Patriotism, Innovation, Inclusiveness and Virtue. This is the summary of the spiritual wealth formed in the development and practice of Beijingers. It has become a guide to Beijing citizens' practice since then. As an advanced local enterprise in Beijing, Raqsoft integrates Beijing Spirit into its long-term development strategy. <p><a href="http://jessicaqiu.ulitzer.com/node/2473658" target="_blank">read more</a></p>Thu, 06 Dec 2012 13:55:30 ESThttp://jessicaqiu.ulitzer.com/node/2473658http://jessicaqiu.ulitzer.com/node/2473658#feedbackMade-in-China IT Products Emerge with Outstanding Capabilityhttp://jessicaqiu.ulitzer.com/node/2461590
Nowadays, made-in-China has become a global phenomenon. But even now, there is still prejudice about Chinese origin products. When many foreign customers talk or mention a made-in-China product, the words that occur to them first might be "cheap and low quality". Such view is particularly common in IT industry. However, this perception is not applicable to all Chinese made products and Raqsoft is among those which break that mindset.
When searching “Made in China” on Google, there are 1.6 billion results. How big the number is! This indicates that made-in-China has become a global phenomenon. But even now, when many foreigners talk or mention a made-in-China product, the words that occur to them first maybe “cheap and low quality”. In IT industry which was dominated by foreign enterprises before, such view is particularly common. However, this perception is not applicable to all Chinese made products and Raqsoft is among those which break that mindset.<p><a href="http://jessicaqiu.ulitzer.com/node/2461590" target="_blank">read more</a></p>Fri, 30 Nov 2012 13:39:23 ESThttp://jessicaqiu.ulitzer.com/node/2461590http://jessicaqiu.ulitzer.com/node/2461590#feedbackBusiness Intelligence Suppliers: Are You Ready for 2013?http://jessicaqiu.ulitzer.com/node/2456477
With the ever-changing economy, the business intelligence landscape is also transforming. According to some predictions, the worldwide spending on IT will continuously increase in 2013 and even at the next few years. The growth drivers may include data visualization, big data, speed, agility, self-service, cloud computing, etc. Therefore, the BI suppliers who have these features will be more competitive compared with their rivals.
Business growth turns BI into a daily business processes. Thus demands for new generation BI software are increasing and agility one requirement for those tools. Many BI solution providers carry out technology innovation to meet this demand. Among these providers, Raqsoft, the supplier for statistical computing and analytics software does great job in this aspect. Its main products esProc and esCalc have agile syntax and are very easy to understand. Analysts can write the scripts in the grid very fast. <p><a href="http://jessicaqiu.ulitzer.com/node/2456477" target="_blank">read more</a></p>Mon, 26 Nov 2012 15:18:35 ESThttp://jessicaqiu.ulitzer.com/node/2456477http://jessicaqiu.ulitzer.com/node/2456477#feedbackData Environments Support of esProc Makes Statistical Computing More Flexible http://jessicaqiu.ulitzer.com/node/2436140
esProc supports various data sources. These data sources could be JDBC-driving databases or sequence files that are not stored in database like Excel and Txt. With esProc, analysts can access data from a single data source or from multiple data sources. Results can be showed in esProc or exported to different data sources and can also be called by outside applications.
Enterprises always have various data sources, for instance, CRM system may use SQL Server, sales reports adopt Excel, ERP applies Oracle database. When it comes to actual business analysis, enterprises usually need to conduct interactive computation, including filter, group, etc among various data environments. But data Interaction between multiple data sources are not easy to realize with some traditional statistical computing tools. In order to solve such kind of problems, esProc which adapts to various data environments comes into being.<p><a href="http://jessicaqiu.ulitzer.com/node/2436140" target="_blank">read more</a></p>Thu, 15 Nov 2012 03:22:00 ESThttp://jessicaqiu.ulitzer.com/node/2436140http://jessicaqiu.ulitzer.com/node/2436140#feedbackCreative Spreadsheet Software for Data Processing in Developmenthttp://jessicaqiu.ulitzer.com/node/2422194
Raqsoft will launch esCalc soon, targeting at helping analysts achieve self-service analysis and reporting. It will provide agility and shortcut to decision makers with its outstanding capabilities.<p><a href="http://jessicaqiu.ulitzer.com/node/2422194" target="_blank">read more</a></p>Mon, 12 Nov 2012 14:03:47 ESThttp://jessicaqiu.ulitzer.com/node/2422194http://jessicaqiu.ulitzer.com/node/2422194#feedbackScript Computation of esProc Optimizes Analysts' Benefitshttp://jessicaqiu.ulitzer.com/node/2419013
esProc is high capable script for business statistical computing, delivering more advances than traditional tools like SQL.
Through a serial of news and articles released in the last few weeks, analysts may have already know some advantages of esProc, including ease of use, friendly interface, strong computing ability etc. Besides the previously introduced highlights, the core of script computing should not be neglected.
esProc is high capable script for business statistical computing. Different from some other script applications, esProc delivers more advances. The script codes of esProc are easy to learn and use since they are short but understandable. Some of its script computation capabilities are similar to SQL, but they are much easier to use for analysts without very high SQL expertise or programming knowledge. With agile script language, analysts can make statistical computation independently at their will. <p><a href="http://jessicaqiu.ulitzer.com/node/2419013" target="_blank">read more</a></p>Mon, 12 Nov 2012 13:37:22 ESThttp://jessicaqiu.ulitzer.com/node/2419013http://jessicaqiu.ulitzer.com/node/2419013#feedbackInstant Computing of esProc Brings Flexibility to Analystshttp://jessicaqiu.ulitzer.com/node/2409024
Instant computation and analysis is one of the outstanding highlights, enabling analysts' work to be more convenient and flexible.
The recently released esProc for data computation and data analysis has many highlights which differentiates it from traditional business intelligence tools. Instant computation and analysis is one of the outstanding highlights, enabling analysts' work to be more convenient and flexible.
In the actual business, analysts always have some random thoughts and their demands are changing with the external environment. However, traditional business intelligence tools either complicate simple problems or haven't the ability to solve temporary problems due to their inherited drawbacks-modeling requirements. In this case, solving the occasional problems or changing the original computational procedure becomes the headaches of analysts.<p><a href="http://jessicaqiu.ulitzer.com/node/2409024" target="_blank">read more</a></p>Wed, 24 Oct 2012 10:05:42 EDThttp://jessicaqiu.ulitzer.com/node/2409024http://jessicaqiu.ulitzer.com/node/2409024#feedbackRaqsoft Officially Releases esProchttp://jessicaqiu.ulitzer.com/node/2369306
Raqsoft, a business intelligence tool provider today officially released esProc, the new generation software for data computation and data analytics. The anticipated product which targets at optimizing analysts' benefits has many outstanding features and advantages.
This newly launched esProc is the typical real OLAP tools for complicated structured data handling. By breaking the limitations of traditional OLAP tools, analysts can feel free to conduct bound-free data analysis in esProc, making pre-modeling unnecessary. In this case, the real time computation and analysis are realized easily, giving analysts more time to focus on business analysis. Besides, with esProc, the previous results can be referenced conveniently, allowing analysts research into the key point of targets and get the greatest value of data. What's more, the cell-style interface of esProc displays the layout and relations among computation steps to analysts more clearly and neatly.<p><a href="http://jessicaqiu.ulitzer.com/node/2369306" target="_blank">read more</a></p>Fri, 21 Sep 2012 15:51:40 EDThttp://jessicaqiu.ulitzer.com/node/2369306http://jessicaqiu.ulitzer.com/node/2369306#feedbackUpcoming esProc Greatly Enhances Analysts' Work Efficiencyhttp://jessicaqiu.ulitzer.com/node/2360023
The upcoming esProc for data computation and data analytics has many outstanding highlights. Developed by Raqsoft, the leading provider of software for business intelligence, the anticipated esProc will greatly enhance analysts' work efficiency.<p><a href="http://jessicaqiu.ulitzer.com/node/2360023" target="_blank">read more</a></p>Fri, 14 Sep 2012 15:08:42 EDThttp://jessicaqiu.ulitzer.com/node/2360023http://jessicaqiu.ulitzer.com/node/2360023#feedbackUpcoming esProc Features with Ease of Usehttp://jessicaqiu.ulitzer.com/node/2351749
The upcoming esProc, an innovative data computation and data analytics software, will be launched soon within this month. According to Raqsoft, the industry leading data handling software provider, this product features with ease of use.
esProc provides a grid user interface similar to Excel which enables users to perform codes in a grid from left to right and top to bottom. This way of operation conforms to users' thinking mode and reduces the difficulty to learn. Besides, the cell-style code not only makes the code neat and clean, but also offers users a visual way to organize and arrange the relationship between the computation steps, and thus easier to pierce the heart of a problem and solve complicated problems. What's more, the agile expression of esProc is simple but with rich information. Users without highly skilled SQL experience can analyze data easily.<p><a href="http://jessicaqiu.ulitzer.com/node/2351749" target="_blank">read more</a></p>Wed, 12 Sep 2012 15:31:40 EDThttp://jessicaqiu.ulitzer.com/node/2351749http://jessicaqiu.ulitzer.com/node/2351749#feedbackInnovative Data Computation and Analytics Software Coming Soonhttp://jessicaqiu.ulitzer.com/node/2349822
Raqsoft, a software provider for data analytics and structured data computation is going to launch esProc in the next month, aiming at enhancing enterprises' efficiency for decision making and reducing management cost. This tool is innovative in simplifying complex data computation and instant analytics.
All enterprises in every industry come across different data. Usually, these unordered data has little value before it's been handled. Users must make data analytics and computation to get meaningful information as important reference for strategy making. In order to make full use of these data, a powerful and affordable tool is needed in urgent. However, the traditional BI (business intelligence) tools including SQL, JAVA, C++ and other high-level languages, either don't have enough data computation ability or have high requirements for users' technique skills. In this case, esProc is developed to solve these problems.<p><a href="http://jessicaqiu.ulitzer.com/node/2349822" target="_blank">read more</a></p>Fri, 31 Aug 2012 03:28:00 EDThttp://jessicaqiu.ulitzer.com/node/2349822http://jessicaqiu.ulitzer.com/node/2349822#feedbackIssue of reporting development in different databaseshttp://jessicaqiu.ulitzer.com/node/3039078
This is a solution of solving multi databases issue in reporting development.<p><a href="http://jessicaqiu.ulitzer.com/node/3039078" target="_blank">read more</a></p>Wed, 31 Dec 1969 19:00:00 ESThttp://jessicaqiu.ulitzer.com/node/3039078http://jessicaqiu.ulitzer.com/node/3039078#feedbackA case to illustrate reading, calculating and writing Excel data in batch more efficientlyhttp://jessicaqiu.ulitzer.com/node/3144148
A code example to read, calculate and write large Excel data in batch more efficiently: Read data of orders and sellers’ information list from data.xlsx, compute sales amount of every department, and return the result into result.xlsx. <p><a href="http://jessicaqiu.ulitzer.com/node/3144148" target="_blank">read more</a></p>Wed, 31 Dec 1969 19:00:00 ESThttp://jessicaqiu.ulitzer.com/node/3144148http://jessicaqiu.ulitzer.com/node/3144148#feedbackA case to illustrate reading, calculating and writing Excel data in batch more efficientlyhttp://jessicaqiu.ulitzer.com/node/3144149
A code example to read, calculate and write large Excel data in batch more efficiently: Read data of orders and sellers’ information list from data.xlsx, compute sales amount of every department, and return the result into result.xlsx. <p><a href="http://jessicaqiu.ulitzer.com/node/3144149" target="_blank">read more</a></p>Wed, 31 Dec 1969 19:00:00 ESThttp://jessicaqiu.ulitzer.com/node/3144149http://jessicaqiu.ulitzer.com/node/3144149#feedbackA case to illustrate reading, calculating and writing Excel data in batch more efficientlyhttp://jessicaqiu.ulitzer.com/node/3144147
A code example to read, calculate and write large Excel data in batch more efficiently: Read data of orders and sellers’ information list from data.xlsx, compute sales amount of every department, and return the result into result.xlsx. <p><a href="http://jessicaqiu.ulitzer.com/node/3144147" target="_blank">read more</a></p>Wed, 31 Dec 1969 19:00:00 ESThttp://jessicaqiu.ulitzer.com/node/3144147http://jessicaqiu.ulitzer.com/node/3144147#feedback