QueryDef - a complete implementation of a dynamic recordset

This article tries to explain the class library QueryDef intended to be used instead of the classic MFC class CRecordset. CRecordset is a great class with one single exception. You have to generate/write too much code. In a project I was involved there were over 700 recordsets defined. Soon working with CRecordset became a real hassle. I wanted a simpler method to access the data from an ODBC data source.

So the design goals of this library were:

Eliminate the need for one recordset-one class tuple.

Eliminate the need for bindings and the infamous list of data members henceforth.

Eliminate the need to know in advance the database schema.

Blur the distinction between a recordset and a stored procedure with output parameters.

Provide a simple notification mechanism to bind visual controls with certain events related to the recordset.

Compatibilty with the CRecordset class (aka support for positioned updates and inserts).

The cornerstone of the library is the class CQueryDef. This class is designed to be used directly (w/o derivation) although there is nothing stopping you using it as a base class. Basically this class represents a collection of rows and columns returned from a SQL request. The table can be as small as no rows/no columns or as large as milions of rows with 255 columns. CQueryDef uses an internal representation of the column data making it possible to hold the following data types:

String or text (this includes numeric and decimal SQL types)

Int, long or short

Float and double

Datetime, smalldatetime, timestamps

Binary data

To accommodate this data type spectrum the library makes use of the CQueryVar class. This class offers the necessary data type conversions by defining a series of conversion constructors and operators as well as assignment operators. Also provides several functions to format the data as output strings (human readable). CQueryVar holds only one data value.

CQueryVariant on the other hand holds a variable array of CQueryVar values. Basically it represents an entire row of SQL data. This class offers access to individual CQueryVar values (column data) and can manipulate an entire row as a whole.

CQueryCol describes an entire SQL column. All the information is retrieved from the ODBC data source once and contains:

The name of the column as returned from the data source

The SQL type

The scale

The precision

Whether accepts SQL null values

CQueryCol information is returned as a collection or as individual values from the CQueryDef class (see the reference).

The notification mechanism relies upon the abstract sink IQueryDefEventSink that defines the following events:

struct IQueryDefEventSink; // CQueryDef event sink
{
// possible notifications - returning 0 means proceed with the next notification otherwise stop
virtual LPARAM RSNotifyOpen(EVNHANDLE) = 0; // the recordset has been opened
virtual LPARAM RSNotifyClose(EVNHANDLE) = 0; // the recordset has been closed
virtual LPARAM RSNotifyMove(EVNHANDLE) = 0; // the recordset has modified the current position
virtual LPARAM RSNotifyAddNew(EVNHANDLE) = 0; // recordset is about to insert a new record (called after CQueryDef::AddNew)
virtual LPARAM RSNotifyEdit(EVNHANDLE) = 0; // the current record will be modified to be updated (called after CQueryDef::Edit)
virtual LPARAM RSNotifyUpdate(EVNHANDLE) = 0; // the current record has beeen updated (called after CQueryDef::Update)
virtual LPARAM RSNotifyDelete(EVNHANDLE) = 0; // the current record has been deleted
virtual LPARAM RSNotifyCancelUpdate(EVNHANDLE) = 0; // the update of the current record has been canceled (called after CQueryDef::CancelUpdate)
virtual LPARAM RSNotifyRequery(EVNHANDLE) = 0; // the recordset has been refreshed
virtual LPARAM RSNotifyFormatChanged(EVNHANDLE,BYTE nFormat) = 0; // number of decimal digits or date format has been changed
}

A class object may be notified with these 10 events implementing a sink based on IQueryDefEventSink. To make things easier, the developer may choose to use CQueryDefDefaultSink instead and override only the events hes interested in.

The library has two other helper classes. CTabbedString holds an entire row of data as TAB separated string values. It gives access to individual column values using the convenient operator []. Very useful when you want to fill a listbox or a list control with data from a SQL request.

Class CSQLNull is used to define a representation for the SQL null value. This class defines the library wide constant QueryDef::CSQLNull SQL_NULL. This value can be used to test for SQL null various returned results from CQueryDef and CTabbedString objects.

This section shows only the most important functions and operators of the QueryDef library, the header file speaks for itself for the others. Typical database programs will make use of the QueryDef library in the following manner:

Declare a CQueryDef variable.

Connect it with a database connection (MFC CDatabase)

Open a recordset based on an ad-hoc query or stored procedure with or without parameters.

Navigate thru the recordset with the CRecordset navigational functions testing for the ending or beginning of the data set.

Process data contained in the CQueryDef variable in some manner (read or update the recordset).

Possibly process the notifications received from the CQueryDef object.

The following examples assume you already have an open database connection defined at the application level. Let it be theApp.m_db.

You can access the column values on the current row of a CQueryDef object using several methods:

qDef["SaleAmount"] or
qDef[2] or
qDef.Field("SaleAmount") or
qDef.Field(2)

The first and the third are used when you dont know or dont care about the position of this column in the recordset. The second and the fourth are used when you know the position of the column in the recordset or you dont know the name of the column (select * might be one case). Using numbers instead of column names is faster too since there is no search involved. Using an invalid index or column name will result in an integer exception (CQueryVariant::eBoundary).

On the other hand the parameters are accessed always using the function CQueryDef::Param():

Param(int nPos) // parameters are numbered starting with 0 from left to right

This functions/operators return CQueryVar& making it possible to use them on both sides of the assignment operator. It is legal to write:

CQueryDef qDef(&theApp.m_db);
qDef.Param(1) = "AMOCO%";
qDef.Open(CRecordset::forwardOnly,"{?L = CALL rpt_CustomersByName ?}");
// rpt_CustomersByName is "select ID,Name,SaleAmount from CUSTOMERS where Name like ? order by Name"
while (!qDef.IsEOF())
{
m_listbox1.AddString(qDef[0]); // ID is SQL long
m_listBox2.AddString(qDef[1]); // Name is varchar
...
}

Each ? is counted so the input parameter to the stored procedure is number 1 (0 being the stored procedures returned value). Notice the suffix following the first parameter. This is used to specify the output parameters type. The table below shows the meaning of every type suffix:

Suffix

Type

L

Long

I

Int

Y

Byte

C

Char, varchar

F

Float

D

Double

T

Datetime

B

Bool

X

Binary

You dont need to provide values (only types) for the output parameters. They will be dynamically allocated by CQueryDef and populated with the stored procedures output parameters. In a similar way you can use input/output parameters:

SetDateFormat() and SetDecimalDigits() can be applied to the whole CQueryDef object or to individual columns. They have effect only on appropriate data types. When you apply one of these functions to the CQueryDef object level, it will overwrite individual column settings. An "EndingDate" column may be formatted different in the example above using:

qDef["EndingDate"].SetDateFormat("%m/%d/%y");

The string parameter for the SetDateFormat() function is documented in strftime() C runtime function.

The moment the link with the data source is lost (due to a communication problem) the framework will close all the recordsets opened on that connection. Using ReOpen() you may open again the CQueryDef object with the same attributes (w/o preserving the cursor position).

More things about notifications

The notification to a user implemented sink, is started calling the function Advise():

EVNHANDLE CQueryDef::Advise(IQueryDefEventSink* pSink);

More than a sink may be connected to a CQueryDef object. The notification of all the sinks will be done in the order of the advise. One event is sent to a particular sink only and only if the sink just before it in the advise loop doesnt respond with a non 0 value. This means that you may choose to stop the event to "bubble" by returning a non 0 value from the yours implemented notification function. The handle returned from the Advise() function must be saved to be passed as the parameter to the Unadvise() function

void CQueryDef::Unadvise(EVNHANDLE evnHandle);

A disconnected sink will no longer receive any notification from the CQueryDef object. To temporarily stop the receiving of notifications you can call the FreezeEvents() function:

void CQueryDef::FreezeEvents(EVNHANDLE evnHandle,BOOL bFreeze=TRUE);

To resume receiving notifications youll have to call the same function with bFreeze FALSE. Just before a CQueryDef object is closed a Close notification will be sent and all the sinks are disconnected. After the CQueryDef object is closed the Advise handle becomes invalid and its use must be discontinued.

Known problems and workarounds

The CRecordset::SetFieldNull() and CRecordset::SetParamNull() functions dont fit in the QueryDef architecture. Their usage is forbidden and a call to any of them will result in a linker error. This behavior is by design. Instead use the assingment operator and the SQL_NULL constant.

CRecordset and CQueryDef henceforth, doesnt handle multiple TIMESTAMP columns. Furthermore such a column must be used at the end of the SQL query otherwise the "Invalid descriptor index" will be fired.

CQueryDef is not directly derived from CRecordset. Instead CRecordset2 is used to correct a problem related to binding string values w/o specifying the length of the string variable. Due to this problem QueryDef.DLL is related to RecordSetPatch.DLL. This secondary DLL must be shipped with your executable alongside QueryDef.DLL.

Usage
To use this class library you have to take the following steps:

Include QueryDef.H file in your project.

Specify the QueryDef namespace by using USE_QUERYDEF macro in the files where you refer the library.

Use the CQueryDef class directly (you dont need to derive from it).

Have the QueryDef(D).LIB and RecordsetPatch(D).LIB files in your library path (D is for the debug version your executable will link with the correct version).

Put QueryDef(D).DLL and RecordsetPatch(D).DLL in your path.

The library has some limitations:

It doesnt support multiple queries/batch of commands (maybe in a next version).

It doesnt have a good exception handling mechanism (although the CDBException can be used in relation with SQL exceptions) and requires care in manipulation due to automatic conversions that may slow down data processing.

The current version doesnt handle new UNICODE data types introduced by ODBC 3.51 (and present in SQL 7.0).

The example accompanying this document assumes the presence of an ODBC data source defined against a SQL Server 6.5 (7.0). The initial query works on the pubs database (make an ODBC DS with pubs the default database). Experiment with different queries and see the results. Call the formatting functions. Use stored procedures. Modify the source code to accommodate parameters. The TEST project was compiled with VC++ 6.0. The QueryDef library in the zip file is bult also with this compiler. Youll have to rebuild the library with VC++ 5.0 if you intend to use it with this compiler (see QueryDef.h file for special steps to take in library rebuild).

You may use this class library, even modify it w/o restriction if you specify the source. However you understand you do that it at your own risk.
The code in this class library represents my personal work and does not imply Computer Associates in any way.

about type 'smalldatetime' when using ADO to manipulate a sql2k DB

A question.
When I used ADO to add sth. into a sql2k DB, i met with some problems because one column of a table in the DB is 'smalldatetime' type. When I used the 'datetime' type instead, the similar codes are as follows:

They worked quite well. But after I had changed the column "Time" from type 'datetime' to 'smalldatetime', the program generated run-time errors. How can I do with it? Are there any cast functions I can use?
Thanks a lot!

Adding large number of records in sorted combobox

I am finding difficult in initializing the combobox with large number of records and then sorting it.
Every time, a function is called, its takes a long time to read the records and sort them.
Is there any way, where after the first use, the process takes a very short time after every reuse.
I am using VC++ as my application.

Returing a Recordset Based on a Single YES/NO Answer

I like many of you may have the same dilemma and I think its about time this problem and hopefully the answer gets published.

PROBLEM:
I want to know how to have a recordset of data from my access database published on the final ASP page based on YES or NO choice on a form on the previous ASP page.
Presently, I have an ASP page with a Form requiring a YES or No answer to a question above it. Once the user inputs into the RADIO button their choice then they submit it. This Yes or No answer gets posted to another ASP that displays the answer as either, "The Answer is YES" or "The Answer is NO".

How can I have my YES answer from the user pull in data from the database as a recordset and post that specific data to the final ASP page based on the YES input into the Radio button "YES".

How to get Table names in any database connected thru DSN

My problem is:
I have a DSN. From this i can easily get the name if database it is pointing to. But how to get the tables in that database at run time?
plss mail the reply at jainmj@hotmail.com.
Thanks and regards
Manish

Top White Papers and Webcasts

Live Event Date: March 19, 2015 @ 1:00 p.m. ET / 10:00 a.m. PT
The 2015 Enterprise Mobile Application Survey asked 250 mobility professionals what their biggest mobile challenges are, how many employees they are equipping with mobile apps, and their methods for driving value with mobility.
Join Dan Woods, Editor and CTO of CITO Research, and Alan Murray, SVP of Products at Apperian, as they break down the results of this survey and discuss how enterprises are using mobile application management and private …

This report outlines the future look of Forrester's solution for security and risk (S&R) executives working on building an identity and access management strategy for the extended enterprise. We designed this report to help you understand and navigate the major business and IT trends affecting identity and access management (IAM) during the next five years. IAM in 2012 has become a tool not just for security but also for business agility. Competitive challenges push businesses into the cloud and encourage …