Thanks Phil! I can’t remember exactly where the idea of using MERGE for delta tracking came from (I think it was a colleague mentioned something similar in another system and I noticed MERGE can do the same thing in BQ). But the TO_JSON_STRING() idea to avoid null issues were from you😁 don’t you remember?
Hi , Thank you for the awesome video but I think I didn't understand the use case properly. If we have last updated column, then all I need to do is to get records changed after last timestamp like you explained in the end. Right??
Timestamps are often not reliable, the hash comparisons are checking the real data differences. However if you can rely on the last changed time stamp (so they are not timestamp for ingestion but real change from the source data) then it’s fine not to use hash comparisons
