Reliable Server Pooling (RSerPool) Bakeoff Scoring
University of Duisburg-Essen, Institute for Experimental MathematicsEllernstrasse 2945326 EssenNordrhein-WestfalenGermany+49-201-1837637+49-201-1837673dreibh@iem.uni-due.dehttp://www.iem.uni-due.de/~dreibh/University of Applied Sciences MuensterStegerwaldstrasse 3948565 SteinfurtNordrhein-WestfalenGermanytuexen@fh-muenster.deInternet-DraftThis memo describes some of the scoring to be used in the testing of
Reliable Server Pooling protocols ASAP and ENRP at upcoming bakeoffs.This document will be used as a basis for point scoring at upcoming
RSerPool bakeoffs. Its purpose is similar to that described in RFC1025. It
is hoped that a clear definition of where and how to score points will
further the development of RSerPool.
Note that while attending a bakeoff no one else will score your points
for you. We trust that all implementations will faithfully record their
points that are received honestly. Note also that these scores are NOT
to be used for marketing purposes. They are for the use of the
implementations to know how well they are doing. The only reporting
that will be done is a basic summary to the Reliable Server Pooling Working
Group but please note that NO company or implementation names will be
attached.The ASAP protocol is described in the follwing documents:
These points will be scored for EACH peer implementation that you
successfully communicate with.2 Successful ASAP Registration Request of a PE in a pool using Round Robin
policy and handling of ASAP Registration Response.2 Failing ASAP Registration Request of a PE requesting Least Used policy in
a pool using Round Robin policy and appropriate handling of ASAP
Registration Response (e.g. printing error message, but not retrying
registration).2 Successful re-registration of a PE in a pool using Round Robin policy.2 Successful ASAP Deregistration Request of the PE from its pool
and handling of ASAP Deregistration Response.2 Successful handling of ASAP Endpoint Keep-Alive without Home bit set, i.e.
answering with ASAP Endpoint Keep-Alive Ack.5 Successful handling of ASAP Endpoint Keep-Alive with Home bit set:
respond with ASAP Endpoint Keep-Alive Ack and
use new ENRP server for re-registration.5 Successful connection to and registration at an ENRP server announcing
itself via multicast ASAP Announces.1 Successful registration into pool using Least Used policy.1 Successful registration into pool using Weighted Round Robin policy.1 Successful registration into pool using Random policy.1 Successful registration into pool using Weighted Random policy.These points will be scored for EACH peer implementation that you
successfully communicate with.5 Successful ASAP Handle Resolution in a pool using Round Robin policy,
correct handling of ASAP Handle Resolution Response.2 Successful failure reporting using ASAP Endpoint Unreachable.5 Successful connection to and handle resolution at ENRP server announcing itself
via multicast ASAP Announces.1 Successful handle resolution in a pool using Least Used policy.1 Successful handle resolution in a pool using Weighted Round Robin policy.1 Successful handle resolution in a pool using Random policy.1 Successful handle resolution in a pool using Weighted Random policy.These points will be scored for EACH peer implementation that you
successfully communicate with.2 Successful handling of an ASAP Registration Request into a pool using
Round Robin policy (ENRP server answers with successful
ASAP Registration Response).2 Rejecting registration of a PE requesting Round Robin policy into
a pool using Least Used policy.5 Rejecting registration of a PE with all addresses *not* being part
of the ASAP association.5 Successful registration of a PE with some addresses *not* being part
of the ASAP association. The invalid addresses may *not* go into the
handlespace.5 Successful handling of ASAP Endpoint Unreachable messages. The ENRP server
must remove the given PE after MAX-BAD-PE-REPORTS=3 unreachability
reports.2 Sending regular ASAP Endpoint Keep-Alives to its PEs.2 Removing PE not answering to ASAP Endpoint Keep-Alive.The ENRP protocol is described in the follwing documents:
These points will be scored for EACH peer implementation that you
successfully communicate with.2 Sending ENRP Presence to a new ENRP server.2 Sending ENRP Presences in the interval given by PEER-HEARTBEAT-CYCLE.5 Requesting peer list from new ENRP server using ENRP Peer List Request,
handling ENRP Peer List Response and adding entries to its own peer list.2 Handling ENRP Peer List Request and replying with own peer list in
ENRP Peer List Response.5 Requesting handlespace from new ENRP server using ENRP Handle Table Request,
handling ENRP Handle Table Response (without M-bit set) and inserting entries
into its own handlespace copy.5 Requesting handlespace from new ENRP server using ENRP Handle Table Request,
handling ENRP Handle Table Response with M-bit set,
requesting more entries and inserting entries into its own handlespace copy.2 Handling ENRP Handle Table Request and replying own handlespace in
ENRP Handle Table Response (without M-bit).10 Handling ENRP Handle Table Request and replying own handlespace in
ENRP Handle Table Response with M-bit set, remembering point to continue from,
responding next block of handlespace entries upon following
ENRP Handle Table Request, etc. until transfer of handlespace data is
complete.5 Successful addition of new ENRP server announcing itself via multicast
ENRP Presence (including association establishment as well as download
of peer list and handlespace).These points will be scored for EACH peer implementation that you
successfully communicate with.2 Handling an ENRP Handle Update adding a PE.2 Handling an ENRP Handle Update updating a PE. The changes must be entered
into the local handlespace copy.2 Handling an ENRP Handle Update removing a PE.These points will be scored for EACH peer implementation that you
successfully communicate with.5 Successful detection of different handlespace checksums
upon reception of ENRP Presence (due to additional PE),
request of Handle Table with W-bit set, integration of missing
PE into local handlespace copy and reporting the correct
checksum in own ENRP Presence.5 Successful detection of different handlespace checksums
upon reception of ENRP Presence (due to out-of-date PE),
request of Handle Table with W-bit set, removal of
PE from local handlespace copy and reporting the correct checksum
in own ENRP Presence.10 Successful detection of different handlespace checksums
upon reception of ENRP Presence (due to multiple new and
out-of-date PE identities; size of PE identities is larger
than maximum ENRP message size),
request of Handle Table with W-bit set,
handling of ENRP Handle Table Responses with M-bit set,
removal of out-of-date PEs, integration of new PEs
into the local handlespace copy
and reporting correct checksum in own ENRP Presence.These points will be scored for EACH peer implementation that you
successfully communicate with. The setup contains your ENRP server
plus a set of peers running another implementation.5 Successfully detecting the failure of a remote peer and
initiating a takeover procedure.5 Acknowledging another peer's takeover and
aborting own takeover procedure.10 Correctly handling a remote peer's Takeover Server message,
including ownership change for the remote peer's PEs.10 Successfully taking over a dead peer, including ownership
change and informing the PEs taken over.You can also earn Bonus Points:
20 points for the ENRP server handling the largest number of PEs.20 points for the ENRP server achieving the highest handle resolution
throughput for a pool containing 100 (should this be larger?) PEs.
Please note that the whole period of the bakeoff is relevant.
The RSerPool reference implementation RSPLIB can be found at
. It supports the functionalities
defined by
,
,
,
and
as well as the options
,
and
.
An introduction to this implementation is provided in
.This document does only describe test scenarios and therefore does not
introduce any new security issues.For security considerations of the RSerPool protocols see
,
,
,
,
.
and in particular
.
This document introduces no additional considerations for IANA.