I am facing a Data Selection issue.
I can access a large database with a great amount of variables (i.e. hundreds of columns) on SAP BW. I have very little documentation for this db. I want to go through each variable, ignore the empty ones, and identify the useful ones.
I have done this in a very inefficient way. I load my data in Power BI Desktop and I check each variable one at a time. By doing this, I’m sure I’m making no mistake but it takes too much time. I really need a first cleaning.
I’m looking for a software that could help me to select the interesting variables out of a large dataset. I want it to be at least able to detect the empty variable and possibly to figure out duplicates or correlations.
I’d really like to know your tips and good practices for this kind of data selection!