OASIS Mailing List ArchivesView the OASIS mailing list archive below
or browse/search using MarkMail.

 


Help: OASIS Mailing Lists Help | MarkMail Help

sarif message

[Date Prev] | [Thread Prev] | [Thread Next] | [Date Next] -- [Date Index] | [Thread Index] | [List Home]


Subject: RE: Does making resources.rules an array present a problem?


Yes, I read and understood your comment, which led to my observation on the requirement for implementation discipline suggests missing design guardrails.

 

Let me correct your comment slightly, as I know you will appreciate: the tool author must never make changes to the ordering of an external localized resource file without incrementing the version number. It is fine to, say, fix a spelling mistake in a single string without updating the version #.

 

I don’t see a strong illustrative example for the rule id collision in the spec. This data is under the control of the rules author (as opposed to data around file paths and logical locations, which can’t be controlled). I tend to think that we should investigate a solution for resources that 1) preserves the use of dictionaries, 2) attempts to unify the resources probing/external files model.

 

We have tools such as hierarchical strings to help with collision resolution (which also minimizes creation of new mini-languages beyond existing use).

 

Michael

From: Larry Golding (Myriad Consulting Inc) <v-lgold@microsoft.com>
Sent: Wednesday, October 31, 2018 9:29 AM
To: Larry Golding (Myriad Consulting Inc) <v-lgold@microsoft.com>; Michael Fanning <Michael.Fanning@microsoft.com>; OASIS SARIF TC Discussion List <sarif@lists.oasis-open.org>
Subject: RE: Does making resources.rules an array present a problem?

 

And yes, the discipline you refer to is on the part of the tool author, as I said below:

 

… external localized resource files are always associated with a particular version of the tool … the SARIF consumer will always find the same version of the external localized resource file…

 

That is, the tool author must never make changes to an external localized resource file without incrementing the version number.

 

From: sarif@lists.oasis-open.org <sarif@lists.oasis-open.org> On Behalf Of Larry Golding (Myriad Consulting Inc)
Sent: Wednesday, October 31, 2018 9:25 AM
To: Michael Fanning <Michael.Fanning@microsoft.com>; OASIS SARIF TC Discussion List <sarif@lists.oasis-open.org>
Subject: [sarif] RE: Does making resources.rules an array present a problem?

 

Rule id collisions occur because some tools use the same rule id to refer to a collection of logically related but distinct diagnostics. The spec gives an example.

 

From: Michael Fanning <Michael.Fanning@microsoft.com>
Sent: Wednesday, October 31, 2018 8:28 AM
To: Larry Golding (Myriad Consulting Inc) <v-lgold@microsoft.com>; OASIS SARIF TC Discussion List <sarif@lists.oasis-open.org>
Subject: RE: Does making resources.rules an array present a problem?

 

Hello!

 

I think we should probably take a closer look at the resources object in general. Resources now has a root level dictionary (messages) and an array (rules), an inconsistency worth considering. We have discussed in the TC whether we should retain the resources probing mechanism now that we have developed the external files mechanism. As mentioned in the last TC, my intuition is that we’re getting a bit out of our wheelhouse with the resources mechanism, specifying significant behaviors (related to locale/region, probing for files, etc.) that are outside the static analysis domain.

 

That’s a general comment. My comment on your specific issue: I agree that our current design raises a concern, we’ve lost some useful coupling between a  localized resources file and a log (i.e., a stable resource name used as a key into a table) but this issue can be worked around with some discipline. That requirement for discipline, though, underscores a design weakness we’ve introduced.

 

Can you or someone else recall for me why we believe rule id collisions are likely to occur? File name and logical name collisions are clear because a single tool + analysis run may operate against targets that share these constructs. Presumably a tool ships a single, consistently named body of rules that apply to results generated. I can’t recall the scenario we had in mind for a collision in rule id (but trust that it turned up). Jim, do you recall?

 

Michael

From: sarif@lists.oasis-open.org <sarif@lists.oasis-open.org> On Behalf Of Larry Golding (Myriad Consulting Inc)
Sent: Thursday, October 25, 2018 2:40 PM
To: OASIS SARIF TC Discussion List <sarif@lists.oasis-open.org>
Subject: [sarif] Does making resources.rules an array present a problem?
Importance: High

 

TL;DR: After consideration, I don’t think there is actually a problem here. But please follow my argument to see if you agree.

 

Consider a SARIF consumer that has in hand a result object that specifies ruleId. If the consumer needs any rule metadata other than its id – for example, if it needs to display the message – then it needs result.ruleIndex to locate the associated rule object. If resources.rules does not appear in the log file, the consumer must probe for an external localized resource file, which might, for example, reside on a web site.

 

This means that the external localized resource file can never alter the order of the rule objects it contains. Newer versions of the file can’t reorder elements in the array or remove elements from the array. This wasn’t a problem when resources.rules was a dictionary.

 

Note that this is not a problem if the rules reside in a “external property file”, because such files are logically part of the root file. It’s only a problem if the consumer has to probe for an external localized resource file. It is also not a problem for run.files or run.logicalLocations.

 

On further consideration, I don’t think this is a real problem because external localized resource files are always associated with a particular version of the tool, so you’ll have something like this:

 

"tool": {

  "name": "CodeScanner",

  "version": "2.1.1",

  "language": "en-US",

  "resourceLocation": "https://www.contoso.com/CodeScanner/resources/2.1.1/",

  ...

}

 

So the SARIF consumer will always find the same version of the external localized resource file, and ruleIndex will always be good.

 

Do you agree?

 

Thanks,

Larry



[Date Prev] | [Thread Prev] | [Thread Next] | [Date Next] -- [Date Index] | [Thread Index] | [List Home]