@@firza6674 please Can I have your contact? I would like to ask some questions and get some information from you because I just got a job as a Data Quality Analyst too
Good video and we particular like the section on data profiling at 13:01 as this is something we have been working on for many years in our tools, and by using this method you can quickly discover patterns and meaning in your data, and to check the quality of it by analyzing formats, types, completeness and value counts. Great stuff 👍
At around 14:20, for the data quality example, in the data assessment results, you mentioned Validity failed results as 2. But the date looks valid as 2/30/1968 which is correct according to the rule. Please correct me if I a wrong.
There are many connections between data quality dimensions. Should an analyst include number of blank values in both Completeness and Validity? Should he/she include blank values in duplicate values?
If the field is blank, or Null, then you measure that in your completeness metric. If the value in the field is "blank" and that value is not a valid use of that field, such as if you had a product name field and the value was "blank", then you wouldn't measure that as completeness, you would measure that as Invalid.
