Data Cleansing Often the existing data has no consistent format being derived from many sources. Or it contains duplicate records/items and may have missing or incomplete descriptions. Suntec's data cleansing process fixes misspellings, abbreviations, and errors. The data is normalized so that there is a common unit of measure for items in a class, e.g. feet, inches, meters, etc. are all converted to one unit of measure.
The values are also standardized so that the name of each attribute is consistent, e.g. inch, in., and the symbol “ are all shown as inch.Data scrubbing, also called data cleansing, is the process of amending or removing data in a database that is incorrect, incomplete, improperly formatted, or duplicated. An organization in a data-intensive field like banking, insurance, retailing, telecommunications, or transportation might use a data scrubbing tool to systematically examine data for flaws by using rules, algorithms, and look-up tables.
Typically, a database scrubbing tool includes programs that are capable of correcting a number of specific type of mistakes, such as adding missing zip codes or finding duplicate records. Using a data scrubbing tool can save a database administrator a significant amount of time and can be less costly than fixing errors manually.
The issues involved in data cleansing, formatting, converting and preparing for upload are so time consuming and so exacting that it makes sense to outsource select components of the project to an established firm with extensive experience in data migration.
Data scrubbing, also called data cleansing, is the process of amending or removing data in a database that is incorrect, incomplete, improperly formatted, or duplicated. An organization in a data-intensive field like banking, insurance, retailing, telecommunications, or transportation might use a data scrubbing tool to systematically examine data for flaws by using rules, algorithms, and look-up tables.
Typically, a database scrubbing tool includes programs that are capable of correcting a number of specific type of mistakes, such as adding missing zip codes or finding duplicate records. Using a data scrubbing tool can save a database administrator a significant amount of time and can be less costly than fixing errors manually.
Subscribe to:
Post Comments (Atom)
No comments:
Post a Comment