Abstract

The invention discloses a kind of method of testing of parameter and equipment, the method includes：Determine test target and the corresponding test parameter of the test target, and client is divided into by multiple test groups according to client identification；For the parameter value that each test group configures the test parameter, and the parameter value configured by each test group is different；The client in the test group corresponding to the parameter value is tested using the parameter value of the test parameter, and obtain the test effect of the plurality of test group；Determine in the test effect of the plurality of test group the targeted parameter value that parameter value that optimum test group is used is the test parameter.In the embodiment of the present invention, the test of multigroup parameter value can be supported simultaneously, one group of best parameter value of effect be found out by statistical regression methods, so as to quickly obtain the parameter value of the best test parameter of effect, the testing time is saved, the target of advertising results maximizing is realized then.

Description

A kind of method of testing of parameter and equipment

Technical field

The present invention relates to field of computer technology, more particularly, to a kind of method of testing of parameter and equipment.

Background technology

A/B is tested for two elements of determination or version（A and B）In which version more preferably, made with the version for selecting best
With raising conversion ratio；In A/B test processs, in order to optimize effect of advertising, for same test parameter, can arrange multiple
Different parameter values testing effect, the parameter value best so as to find out effect；Wherein, effect can be click on rate, purchase volume
Or installation etc..

In prior art, for the process of A/B tests, its handling process includes：

Step 1, determine test target and test parameter.

Step 2, tested using a parameter value of test parameter, and the effect of the parameter value of statistical test parameter
And the gap with target.

Step 3, the parameter value for based on the gap with target, revising test parameter, and using revised test parameter
Parameter value is tested, and continues the effect of the parameter value of the test parameter after statistical correction.

By that analogy, subsequently repeat no more.

During the present invention is realized, inventor has found at least there is problems with prior art：

Test parameter parameter Data-Statistics its effect can only be modified to the parameter value of test parameter every time
Afterwards, continue the effect of the amended parameter value of statistics；During due to effect in each parameter value of statistical test parameter, its time
Cycle is long, and therefore aforesaid way cannot quickly reach target.Additionally, effect after once than previous secondary poor when, need back
Test parameter is readjusted in front once test to be tested, very long so as to further result in the testing time.

Content of the invention

The embodiment of the present invention provides a kind of method of testing of parameter and equipment, the test parameter best quickly to obtain effect
Parameter value, save the testing time.

In order to achieve the above object, the embodiment of the present invention provides a kind of method of testing of parameter, including：

Determine test target and the corresponding test parameter of the test target, and client is divided according to client identification
Into multiple test groups；

For the parameter value that each test group configures the test parameter, and the parameter value configured by each test group is different；

The client in the test group corresponding to the parameter value is tested using the parameter value of the test parameter, and
Obtain the test effect of the plurality of test group；

Determine that the parameter value used by optimum test group in the test effect of the plurality of test group is the test ginseng
Several targeted parameter values.

When the corresponding test parameter of the test target is multiple test parameters, methods described is further included：Successively
It is current test parameter to select a test parameter in the plurality of test parameter, and using other test parameters and described
The parameter value of current test parameter is tested to the client in the test group corresponding to the parameter value；Wherein, other tests
The parameter value of parameter is identical.

The parameter value of other test parameters is identical, specially：

If other test parameters described have had determined targeted parameter value, the parameter value of other test parameters and have been
The targeted parameter value；

If other test parameters described have had not determined targeted parameter value, the parameter value of other test parameters is
Selected according to practical situation.

The client identification includes：The instant communication number of client, the cookie id of client browser, client
The IP address at end.

The test period tested by client in test group is by day or in units of week.

The embodiment of the present invention provides a kind of test equipment of parameter, including：

First determining module, for determining test target and the corresponding test parameter of the test target；

Division module, for being divided into multiple test groups according to client identification by client；

Configuration module, for configuring the parameter value of the test parameter for each test group, and each test group is configured
Parameter value different；

Test module, for the parameter value using the test parameter to the client in the test group corresponding to the parameter value
End is tested, and obtains the test effect of the plurality of test group；

Second determining module, for determining ginseng that optimum test group in the test effect of the plurality of test group is used
Numerical value is the targeted parameter value of the test parameter.

When the corresponding test parameter of the test target is multiple test parameters, the test module is further used for
It is current test parameter to select a test parameter in the plurality of test parameter successively, and using other test parameters and
The parameter value of the current test parameter is tested to the client in the test group corresponding to the parameter value；Wherein, other
The parameter value of test parameter is identical.

The parameter value of other test parameters is identical, specially：

If other test parameters described have had determined targeted parameter value, the parameter value of other test parameters and have been
The targeted parameter value；

If other test parameters described have had not determined targeted parameter value, the parameter value of other test parameters is
Selected according to practical situation.

The client identification includes：The instant communication number of client, the cookie id of client browser, client
The IP address at end.

The test period tested by client in test group is by day or in units of week.

Compared with prior art, the embodiment of the present invention at least has advantages below：

The test of multigroup parameter value in the embodiment of the present invention, can be supported simultaneously, effect be found out most by statistical regression methods
One group of good parameter value, so as to quickly obtain the parameter value of the best test parameter of effect, saves the testing time, realizes then wide
Accuse the maximized target of effect.

Description of the drawings

In order to be illustrated more clearly that technical scheme, embodiment will be described below needed for accompanying drawing to be used
Be briefly described, it should be apparent that, drawings in the following description are only some embodiments of the present invention, for this area general
For logical technical staff, on the premise of not paying creative work, can be with according to these other accompanying drawings of accompanying drawings acquisition.

Fig. 1 is a kind of method of testing schematic flow sheet of parameter that the embodiment of the present invention one is provided；

Fig. 2 is a kind of test equipment structural representation of parameter that the embodiment of the present invention two is provided.

Specific embodiment

Accompanying drawing in below in conjunction with the present invention, to the present invention in technical scheme be clearly and completely described, show
So, described embodiment a part of embodiment only of the invention, rather than whole embodiments.In based on the present invention
Embodiment, the every other embodiment obtained under the premise of creative work is not made by those of ordinary skill in the art, all
Belong to the scope of protection of the invention.

Embodiment one

The embodiment of the present invention one provides a kind of method of testing of parameter, in A/B test processs, true by test equipment
Fixed optimum test parameter, as shown in figure 1, the method is comprised the following steps：

It should be noted that each test target has its corresponding one or more test parameter；For example, when determination is surveyed
Examination target（The target of A/B tests）For optimizing during effect of advertising, effect of advertising can be lifted due to optimizing clicking rate, therefore tested
The corresponding test parameter of target can be clicking rate.

Client is divided into multiple test groups according to client identification by step 102.

In the embodiment of the present invention, the client identification is included but is not limited to：The instant communication number of client（Such as No. QQ
Code）, client browser cookie id（Mark）, client IP address etc..It should be noted that client identification is simultaneously
This is not limited to, all marks that can distinguish client, within embodiment of the present invention protection domain, will not be described here.

For example, when client is divided into multiple test groups, it is possible to use last position of QQ numbers（Or penultimate
Deng）It is grouped, all clients is divided into 10 test groups from 0 to 9 according to last of QQ numbers, will QQ numbers
Last be divided into test group 1 for 0 client, last by QQ numbers is divided into test group 2 for 1 client, with
This analogizes, and last by QQ numbers is divided into test group 10 for 9 client.

For other client identifications such as cookie id, the IP address of client, its be divided into the mode of multiple test groups with
The mode of the instant communication number of client is similar to, here no longer elaborate.

It should be noted that from statistical regression（I.e. any a series of repetition activity, its result generally can all be close to averagely
Value or intermediate value）In the sense that say, as the client covered by each test group is identical, therefore each test group
For the test result of same test parameter is identical, you can so that client is divided into multiple tests in the manner described above
Group.

Step 103, is the parameter value of each test group configuration testing parameter, and the parameter value configured by each test group is not
With.

So that test parameter is for test parameter a as an example, then the different parameters value of test parameter a can be allocated to different surveys
Examination group；For example, the different parameters value of test parameter a be respectively a1, a2 ... during a10, then tested based on above-mentioned test group 1-
Parameter value a1 can be allocated to test group 1, parameter value a2 is allocated to test group 2, by that analogy, by parameter value a10 by group 10
It is allocated to test group 10.

It should be noted that for parameter value preferably for each test group configuration testing parameter, a kind of preferred
In embodiment, can be with the parameter value according to test parameter（The value quantity of parameter value）And client identification is by client
It is divided into multiple test groups；For example, in actual applications, client is then being divided into by test parameter a to having during 5 parameter values
During multiple test groups, last of QQ numbers can be divided into test group 1 for 0 and 1 client, by that analogy, by No. QQ
Last of code is divided into test group 10 for 8 and 9 client.

Step 104, is surveyed to the client in the test group corresponding to the parameter value using the parameter value of test parameter
Examination, and obtain the test effect of multiple test groups.The test period tested by client in test group can with day or
Person's week is unit（That is the cycle of A/B tests is day or week）.

For example, based on above-mentioned configuration mode, it is possible to use parameter value a1 is tested to the client in test group 1,
The client in test group 2 is tested using parameter value a2, by that analogy, using parameter value a10 in test group 10
Client is tested, and is repeated no more in the related test mode embodiment of the present invention.Further, in each test group
The test process of client, can obtain the test effect of the test group；And the test based on client in all test groups
Journey, can obtain the test effect of above-mentioned multiple test groups, repeat no more in the mode embodiment of the present invention for obtaining test effect.

Step 105, determines that the parameter value used by optimum test group in the test effect of multiple test groups is test ginseng
Several targeted parameter values.

In the embodiment of the present invention, for different test groups, after which is configured with the different parameters value of test parameter, you can with
In the target of test optimization, the i.e. test effect ginseng used by optimum test group is obtained from the test effect of multiple test groups
Numerical value.

It should be noted that said process is for the process that the corresponding test parameter of test target is, in test
When the corresponding test parameter of target is multiple test parameters, the method is further included：Selected in multiple test parameters successively
One test parameter is current test parameter（The process of one test parameter is same as described above）, and using other test ginsengs
The parameter value of number and current test parameter is tested to the client in the test group corresponding to the parameter value；Wherein, its
His parameter value of test parameter is identical, and which is specially：If other test parameters have had determined targeted parameter value, other surveys
The parameter value of examination parameter is the targeted parameter value；If other test parameters have had not determined targeted parameter value, other tests
The parameter value of parameter is to be selected according to practical situation（As empirical value）.

It is current test parameter to select test parameter a first, and the different parameters value of test parameter a is respectively configured to difference
Test group（By taking test group 1, test group 2, test group 3 as an example）, and the client in test group 1 is carried out using parameter value a1
Test, is tested to the client in test group 2 using parameter value a2, using parameter value a3 to the client in test group 3
Tested；In above-mentioned test process, as test parameter b, test parameter c, test parameter d have had not determined target component
Value, therefore can select according to practical experience, as a example by selecting b1, c1, d1；This is based on, using parameter value a1, b1, c1, d1 to surveying
Client in examination group 1 is tested, and the client in test group 2 is tested using parameter value a2, b1, c1, d1, is utilized
Parameter value a3, b1, c1, d1 are tested to the client in test group 3；After above-mentioned process, it may be determined that test parameter a's
Targeted parameter value（By taking a3 as an example）.

Secondly it is current test parameter to select test parameter b, and the different parameters value of test parameter b is respectively configured to difference
Test group, and the client in test group 1 is tested using parameter value b1, using parameter value b2 in test group 2
Client is tested, and the client in test group 3 is tested using parameter value b3；In above-mentioned test process, test
Parameter a has had determined targeted parameter value a3, and test parameter c, test parameter d have had not determined targeted parameter value, according to reality
Experience selects c1, d1；Based on this, the client in test group 1 is tested using parameter value a3, b1, c1, d1, using ginseng
Numerical value a3, b2, c1, d1 are tested to the client in test group 2, using parameter value a3, b3, c1, d1 in test group 3
Client is tested；After above-mentioned process, it may be determined that the targeted parameter value of test parameter b（By taking b3 as an example）.

Secondly it is current test parameter to select test parameter c, and the different parameters value of test parameter c is respectively configured to difference
Test group, and the client in test group 1 is tested using parameter value c1, using parameter value c2 in test group 2
Client is tested, and the client in test group 3 is tested using parameter value c3；In above-mentioned test process, test
Parameter a has had determined that targeted parameter value a3, test parameter b have had determined that targeted parameter value b3, test parameter d have not determined
There is targeted parameter value, d1 is selected according to practical experience；This is based on, using parameter value a3, b3, c1, d1 to the client in test group 1
End tested, the client in test group 2 is tested using parameter value a3, b3, c2, d1, using parameter value a3, b3,
C3, d1 are tested to the client in test group 3；After above-mentioned process, it may be determined that the targeted parameter value of test parameter c
（By taking c3 as an example）.

It is current test parameter finally to select test parameter d, and the different parameters value of test parameter d is respectively configured to difference
Test group, and the client in test group 1 is tested using parameter value d1, using parameter value d2 in test group 2
Client is tested, and the client in test group 3 is tested using parameter value d3；In above-mentioned test process, test
Parameter a has had determined that targeted parameter value a3, test parameter b have had determined that targeted parameter value b3, test parameter c have determined
There is targeted parameter value c3；Based on this, the client in test group 1 is tested using parameter value a3, b3, c3, d1, using ginseng
Numerical value a3, b3, c3, d2 are tested to the client in test group 2, using parameter value a3, b3, c3, d3 in test group 3
Client is tested；After above-mentioned process, it may be determined that the targeted parameter value of test parameter d（By taking d3 as an example）.

After the process of said process, you can to obtain the corresponding optimum test parameter group of test target be（a3、b3、
c3、d3）；Afterwards, using optimum test parameter group（a3、b3、c3、d3）Test target is processed accordingly, the present invention is real
Apply in example and this is repeated no more.

In sum, the test of multigroup parameter value in the embodiment of the present invention, can be supported simultaneously, is looked for by statistical regression methods
Go out one group of best parameter value of effect, so as to quickly obtain the parameter value of the best test parameter of effect, save the testing time, after
And realize the target of advertising results maximizing.

Embodiment two

Based on the inventive concept same with said method, a kind of test of parameter is additionally provided in the embodiment of the present invention and is set
Standby, as shown in Fig. 2 the equipment includes：

First determining module 21, for determining test target and the corresponding test parameter of the test target；

Division module 22, for being divided into multiple test groups according to client identification by client；

Configuration module 23, for configuring the parameter value of the test parameter for each test group, and each test group is matched somebody with somebody
The parameter value that puts is different；

Test module 24, for the parameter value using the test parameter to the visitor in the test group corresponding to the parameter value
Family end is tested, and obtains the test effect of the plurality of test group；

Second determining module 25, for determining what optimum test group in the test effect of the plurality of test group was used
Parameter value is the targeted parameter value of the test parameter.

When the corresponding test parameter of the test target is multiple test parameters, the test module 24 is further used
In selecting in the plurality of test parameter test parameter successively for current test parameter, and using other test parameters with
And the parameter value of the current test parameter is tested to the client in the test group corresponding to the parameter value；Wherein, its
His parameter value of test parameter is identical.

The parameter value of other test parameters is identical, specially：If other test parameters described have had determined mesh
Mark parameter value, then the parameter value of other test parameters is the targeted parameter value；If other test parameters described are not also true
Surely there is targeted parameter value, then the parameter value of other test parameters is to select according to practical situation.

In the embodiment of the present invention, the client identification includes：The instant communication number of client, client browser
Cookie id, the IP address of client.

In the embodiment of the present invention, the test period tested by the client in test group is with day or week as list
Position.

Wherein, the modules of apparatus of the present invention can be integrated in one, it is also possible to be deployed separately.Above-mentioned module can be closed
And be a module, it is also possible to it is further split into multiple submodule.

In sum, the test of multigroup parameter value in the embodiment of the present invention, can be supported simultaneously, is looked for by statistical regression methods
Go out one group of best parameter value of effect, so as to quickly obtain the parameter value of the best test parameter of effect, save the testing time, after
And realize the target of advertising results maximizing.

Through the above description of the embodiments, those skilled in the art can be understood that the present invention can be by
Software adds the mode of required general hardware platform to realize, naturally it is also possible to which by hardware, but the former is more in many cases
Good embodiment.Such understanding is based on, technical scheme is substantially contributed to prior art in other words
Part can be embodied in the form of software product, and the computer software product is stored in a storage medium, if including
Dry instruction is used so that a computer equipment（Can be personal computer, server, or network equipment etc.）Execute this
Method described in each embodiment bright.

It will be appreciated by those skilled in the art that accompanying drawing is the schematic diagram of a preferred embodiment, the module or stream in accompanying drawing
Journey is not necessarily implemented necessary to the present invention.

It will be appreciated by those skilled in the art that module in device in embodiment can be carried out point according to embodiment description
It is distributed in the device of embodiment, it is also possible to carry out respective change and be disposed other than in one or more devices of the present embodiment.On
The module for stating embodiment can merge into a module, it is also possible to be further split into multiple submodule.

The embodiments of the present invention are for illustration only, do not represent the quality of embodiment.

Disclosed above is only several specific embodiments of the invention, but, the present invention is not limited to this, any ability
What the technical staff in domain can think change should all fall into protection scope of the present invention.

Claims (8)

1. a kind of method of testing of parameter, it is characterised in that include：

Determine test target and the corresponding test parameter of the test target, and client is divided into according to client identification many
Individual test group, is the parameter value of each test group configuration test parameter, and the parameter value configured by each test group is different；

The client in the test group corresponding to the parameter value is tested using the parameter value of the test parameter, and obtained
The test effect of the plurality of test group；

Determine that the parameter value used by optimum test group in the test effect of the plurality of test group is the test parameter
Targeted parameter value；

Described client is divided into by multiple test groups according to client identification, including：

The client is divided into according to the value quantity of the parameter value of the test parameter and the client identification multiple
Test group；

When the corresponding test parameter of the test target is multiple test parameters, methods described is further included：

It is current test parameter to select a test parameter in the plurality of test parameter successively, and utilizes other test parameters
Parameter value and the current test parameter parameter value, to the test corresponding to the parameter value of the current test parameter
Client in group is tested；Wherein, the parameter value of other test parameters is identical；

The test effect includes at least one clicking rate, purchase volume and installation.

2. the method for claim 1, it is characterised in that the parameter value of other test parameters is identical, specially：

If other test parameters described have had determined targeted parameter value, the parameter value of other test parameters is the mesh
Mark parameter value；

If other test parameters described have had not determined targeted parameter value, the parameter value of other test parameters is experience
Value.

3. the method as described in any one of claim 1-2, it is characterised in that the client identification includes：Client i.e.
When communicating number, the cookie id of client browser, the IP address of client.

4. the method as described in any one of claim 1-2, it is characterised in that the survey tested by the client in test group
The examination cycle is by day or in units of week.

5. a kind of test equipment of parameter, it is characterised in that include：

First determining module, for determining test target and the corresponding test parameter of the test target；

Division module, for being divided into multiple test groups according to client identification by client；

Configuration module, for configuring the parameter value of the test parameter, and the ginseng configured by each test group for each test group
Numerical value is different；

Test module, for being entered to the client in the test group corresponding to the parameter value using the parameter value of the test parameter
Row test, and obtain the test effect of the plurality of test group；

Second determining module, for determining parameter value that optimum test group in the test effect of the plurality of test group is used
Targeted parameter value for the test parameter；

The test equipment, the value quantity and the client identification for the parameter value according to the test parameter is by institute
State client and be divided into multiple test groups；

When the corresponding test parameter of the test target is multiple test parameters,

The test module, it is current test to be further used for selecting a test parameter in the plurality of test parameter successively
Parameter, and the parameter value of the parameter value using other test parameters and the current test parameter, to the test parameter
The client in test group corresponding to parameter value is tested；Wherein, the parameter value of other test parameters is identical, described
Test effect includes at least one clicking rate, purchase volume and installation.

6. equipment as claimed in claim 5, it is characterised in that the parameter value of other test parameters is identical, specially：

If other test parameters described have had determined targeted parameter value, the parameter value of other test parameters is the mesh
Mark parameter value；

If other test parameters described have had not determined targeted parameter value, the parameter value of other test parameters is experience
Value.

7. the equipment as described in any one of claim 5-6, it is characterised in that the client identification includes：Client i.e.
When communicating number, the cookie id of client browser, the IP address of client.

8. the equipment as described in any one of claim 5-6, it is characterised in that the survey tested by the client in test group
The examination cycle is by day or in units of week.

CN201210025878.1A2012-02-072012-02-07A kind of method of testing of parameter and equipment
CN103246597B
(en)