Metadata support: Extensions handling
Brent Putman
putmanb at georgetown.edu
Tue Aug 13 17:58:26 EDT 2013
On 8/12/13 8:53 PM, Cantor, Scott wrote:
>
> I meant for configuration; obviously the actual processing has to be
> pluggable somehow if it's not just going to be brute force copying.
Ok, I think that's also what I had in mind. The "copy stuff" plugin
would take the whitelist of QNames of extensions to copy.
>> I'd like to think that (large) batches are going to go away soon, but I
>> fear that they will not, at least in the timeframe of v3 (v4...?)
> I don't think they will until they have to, but we can't make them scale
> once they reach a certain size.
True enough. My main concern there was suddenly not being able to
support the sizes we already see in the wild, by changing our processing
algorithm to do a lot of potentially unnecessary upfront stuff.
But I think the upfront indexing and EntitiesDescriptor/@Name processing
will not kill us there. The Extensions stuff was more of a concern, but
if we do things selectively as we are discussing then I tentatively
think we'll be ok.
More information about the dev
mailing list