Re: [xacml-dev] Standard Performance Test Suite for XACML

On Fri, Oct 28, 2011 at 11:52 AM, Prabath Siriwardena <prabath@wso2.com> wrote:

Having a XACML conformation test suite is important - but performance test suite is addressing another concern..

I do accept its complex to build a criteria for a performance test suite and that once again raises the need for a standard test suite - which will be an aggregated effort of the community behind XACML..

The result of a performance test suite is not just an input for marketing - even today different XACML vendors have developed their own performance tests...

But having a standard performance test would help to improve all the implementations and will help to benchmark...

Thanks & Regards,

Prabath

Architect & Senior Manager,
WSO2.

http://blog.facilelogin.com
http://RampartFAQ.com

On Fri, Oct 28, 2011 at 9:13 PM, Brad Cox <bradjcox@gmail.com> wrote:
We're in the middle of performance testing our compiled XACML implementation (http://bradjcox.blogspot.com). As David pointed out, its not easy to know when there's so much else going on that can dominate the results (is XML marshaling/unmarshaling speed relevant? SAML signing/verification? Attribute retrieval speed vs caching? Retrieval of policies from policy service vs caching?).

For my part an robust XACML3.0 conformance test would be much more help since I don't see how you'd ever answer all those questions to everyone's satisfaction, and the results mainly useful for marketing.

On Fri, Oct 28, 2011 at 11:27 AM, Prabath Siriwardena <prabath@wso2.com> wrote:

Thanks folks for the interest shown on the $subject...

Although there are some individual efforts on XACML performance testing - we still don't have a standard performance test suite..

Having a standard performance test to benchmark different PDP implementations will be really helpful..

How can OASIS help on building a performance test suite for XACML..?

--
Thanks & Regards,
Prabath

Architect & Senior Manager,
WSO2.

http://blog.facilelogin.com
http://RampartFAQ.com

On Fri, Oct 28, 2011 at 8:40 PM, David Brossard <david.brossard@axiomatics.com> wrote:

Dear all,

I wrote a blog post on XACML PDP performance and what it means.

http://www.webfarmr.eu/2011/07/the-worlds-fastest-xacml-engine/

It actually references Fatih's paper :-)

It's important to understand there are many different factors - this is what I try to outline.

Cheers,
David.

On Fri, Oct 28, 2011 at 4:57 PM, Fatih Turkmen <fturkmen@gmail.com> wrote:

Hi,

There are also these two early ones regarding XACML PDP (as a standalone component):
1. Fatih Turkmen and Bruno Crispo, "Performance evaluation of XACML PDP implementations", SWS 2008..
2. Fatih Turkmen, Pietro Mazzoleni, Bruno Crispo, Elisa Bertino, "P-CDN: Extending access control capabilities of P2P systems to provide CDN services", ISCC 2008.

Cheers.

--
Fatih Turkmen
Web: http://sites.google.com/site/fturkmen/

On Fri, Oct 28, 2011 at 10:50 AM, Helmut Petritsch <helmut@petritsch.co.at> wrote:

Hi all,

just as a note: although not part of "core XACML", the resolution of
attributes influences the performance of an XACML PDP; we have though
about efficient strategies for attribute resolution in

Achim D. Brucker and Helmut Petritsch. Idea: Efficient Evaluation of
Access Control Constraints. In International Symposium on Engineering
Secure Software and Systems (ESSoS). Lecture Notes in Computer Science
(5965), pages 157-165, Springer-Verlag, 2010.
http://www.brucker.ch/bibliography/download/2010/brucker.ea-efficient-2010.pdf

King regards,
Helmut

On 10/28/2011 10:46 AM, Ali Ahmed wrote:
> That is interesting Prabath. I had some hard times during PhD during
> this sort of performance evaluation for my model but could not relate to
> any current benchmarks. I am interested in joining.
>
> Best wishes
> Ali
>
> On 28/10/2011 16:33, Prabath Siriwardena wrote:
>> Hi folks,
>>
>> Evaluating performance of a XACML PDP is not straight forward - it
>> depends on so many factors..
>>
>> Would like to know whether there are any standard performance test
>> suites developed for XACML.. If not how about initiating it..?
>>
>> WDYT?
>>
>> --
>> Thanks & Regards,
>> Prabath
>>
>> Architect & Senior Manager,
>> WSO2.
>>
>> http://blog.facilelogin.com
>> http://RampartFAQ.com
>
>

---------------------------------------------------------------------
To unsubscribe, e-mail: xacml-dev-unsubscribe@lists.oasis-open.org
For additional commands, e-mail: xacml-dev-help@lists.oasis-open.org

--
David Brossard, M.Eng, SCEA, CSTP
VP Product Marketing & Customer Relations
+46(0)760 25 85 75
Axiomatics AB
Skeppsbron 40
S-111 30 Stockholm, Sweden
http://www.linkedin.com/companies/536082
http://www.axiomatics.com
http://twitter.com/axiomatics

--
Cell: 703-594-1883
Blog: http://bradjcox.blogspot.com
Web: http://virtualschool.edu
Manassas VA 20111

xacml-dev message