Skip to main content
Not Planned

History - [SCD Is Tombstone] - Option Push data last active record into Tombstone record

  • September 18, 2018
  • 6 replies
  • 2 views

Forum|alt.badge.img

Could another option be created for deletion in History tables.

Either the option to push all the data from the lastest active record into the tomstone record

or a field [SCD Last Active Record] that acts like an indicator that this record was the last active record before the deletion.

This way the last active record is easily selectable.

In some of our sources we don't have a reliable enough date we can use to match with dimensions to find the correct surrogate key. We therefore want to display the latest active record of a dimension.     

6 replies

Forum|alt.badge.img
  • Author
  • Participating Frequently
  • September 18, 2018

Hi Thomas,

I see the record as displayed in the attached image. The new tombstone record only contains the business key other fields are empty

(discovery Hub 18.6.1.64)

MTr8jfNI8P-8oLgVaCh7Fg.gif


Forum|alt.badge.img
  • Author
  • Participating Frequently
  • September 18, 2018

Hi Thomas,

It happens when the option  'Create a new record when a deleted record appears in the source' is selected. I assumed the behavior would be the same when this is not selected. i.e. create a new empty record marked as tombstone.

It appears we can choose between either just mark the record as tombstone and then loose history when a record has been deleted and then reappeared or keep deletion history but have a tombstone record with empty fields.

I didn't really get that from the description.

I would prefer the new tombstone records with the ability to push the data from the last active record.  

 

 

 

 

 


Forum|alt.badge.img
  • Author
  • Participating Frequently
  • October 29, 2018

Hi Thomas,

I understand why it works like that. I would like the option to be flexible.

Either a boolean field 'IsLastKnownValue' would be nice or the ability to select an option to push the data from the last active record. 

I don't mean to change the current default behaviour. 


Forum|alt.badge.img
  • Author
  • Participating Frequently
  • October 30, 2018

Hi Radek, 

Unfortunately it's for some reports as well where the customer wants to see the latest values that were active

Thanks for the tip on the lookup though. I can use that too.

 


Forum|alt.badge.img

Hi Jan,

For this functionality I think the proper solution is to disable the "tombstone record" option, then you just get the tombstone flag on the last active record.

Thomas is right that when you add a tombstone record, in order for it to be correct it must have NULL values for all (non-key) attributes.


Forum|alt.badge.img
  • Author
  • Participating Frequently
  • February 26, 2019

Hi Steven,

Yes, you only loose history about when a record was deleted then. If that is not a problem this works.