Updating extractors with data pending
What is the expected behavior if the ingestion workflow is updated in SaffronAdmin while data is pending/working, e.g. what should happen if I modify my XMLParser categories, update category extractor, or remove extractors from my ingestion workflow?
Comments are currently closed for this discussion. You can start a new one.
2 Posted by Jared Peterson on 09 Feb, 2011 02:27 PM
Jamie,
In general this is not a good idea. We need to improve SaffronAdmin so that things are "read-only" while your space is in certain states.
I'm going to attach a ticket.
Thanks,
Jared
3 Posted by Jamie Singer on 11 Feb, 2011 05:08 PM
How do I track the ticket?
I would like to create/remove/modify NameLists, create/remove/modify Categories, and/or update ingestion workflow while data is flowing.
Will that be possible in a future version?
Support Staff 4 Posted by Jim Fleming on 11 Feb, 2011 11:06 PM
Jamie, We could potentially update config while ingesting is going on and save to a draft state (to be activated at sometime later), but would be able to active immediately since data has already been ingested with another schema. The activation process would also necessitate a clear space and a re-ingest (we have no 'alter table' equivalent).
Namelists are a different story. They are live objects, so any update you make will immediately impact whatever is going on. Here too I don't think we've put any protection in the UI, so the admin needs to know what they are doing.
Let me know if the 'save draft next to my published space' is a worthwhile feature. There is a way around this right now, however, if you edit your space and hit the back button on your broswer, the working copy doesn't get deleted so you'll see the (in process) phrase next to your space. If you re-edit the space, it will open your last edited version and not your published version. So sort of a back door to the draft update to a published configuration.
/Jim
Jamie Singer closed this discussion on 02 Jun, 2011 03:10 PM.