"An introduction to duplicate detection" - Information and Links:

An introduction to duplicate detection - Info and Reading Options

Book's cover
The cover of “An introduction to duplicate detection” - Open Library.

"An introduction to duplicate detection" was published by Morgan & Claypool in 2010 - San Rafael, Calif. (1537 Fourth Street, San Rafael, CA 94901 USA), it has 77 pages and the language of the book is English.


“An introduction to duplicate detection” Metadata:

  • Title: ➤  An introduction to duplicate detection
  • Author:
  • Language: English
  • Number of Pages: 77
  • Publisher: Morgan & Claypool
  • Publish Date:
  • Publish Location: ➤  San Rafael, Calif. (1537 Fourth Street, San Rafael, CA 94901 USA)

“An introduction to duplicate detection” Subjects and Themes:

Edition Specifications:

  • Format: [electronic resource] /

Edition Identifiers:

AI-generated Review of “An introduction to duplicate detection”:


"An introduction to duplicate detection" Table Of Contents:

  • 1- 1. Data cleansing: introduction and motivation
  • 2- Data quality
  • 3- Data quality dimensions
  • 4- Data cleansing
  • 5- Causes for duplicates
  • 6- Intra-source duplicates
  • 7- Inter-source duplicates
  • 8- Use cases for duplicate detection
  • 9- Customer relationship management
  • 10- Scientific databases
  • 11- Data spaces and linked open data
  • 12- Lecture overview
  • 13- 2. Problem definition
  • 14- Formal definition
  • 15- Complexity analysis
  • 16- Data in complex relationships
  • 17- Data model
  • 18- Challenges of data with complex relationships
  • 19- 3. Similarity functions
  • 20- Token-based similarity
  • 21- Jaccard coefficient
  • 22- Cosine similarity using token frequency and inverse document frequency
  • 23- Similarity based on tokenization using q-grams
  • 24- Edit-based similarity
  • 25- Edit distance measures
  • 26- Jaro and Jaro-Winkler distance
  • 27- Hybrid functions
  • 28- Extended Jaccard similarity
  • 29- Monge-Elkan measure
  • 30- Soft TF/IDF
  • 31- Measures for data with complex relationships
  • 32- Other similarity measures
  • 33- Rule-based record comparison
  • 34- Equational theory
  • 35- Duplicate profiles
  • 36- 4. Duplicate detection algorithms
  • 37- Pairwise comparison algorithms
  • 38- Blocking
  • 39- Sorted-neighborhood
  • 40- Comparison
  • 41- Algorithms for data with complex relationships
  • 42- Hierarchical relationships
  • 43- Relationships forming a graph
  • 44- Clustering algorithms
  • 45- Clustering based on the duplicate pair graph
  • 46- Clustering adjusting to data & cluster characteristics
  • 47- 5. Evaluating detection success
  • 48- Precision and recall
  • 49- Data sets
  • 50- Real-world data sets
  • 51- Synthetic data sets
  • 52- Towards a duplicate detection benchmark
  • 53- 6. Conclusion and outlook
  • 54- Bibliography
  • 55- Authors' biographies.

"An introduction to duplicate detection" Description:

The Open Library:

With the ever increasing volume of data, data quality problems abound. Multiple, yet different representations of the same real-world objects in data, duplicates, are one of the most intriguing data quality problems. The effects of such duplicates are detrimental; for instance, bank customers can obtain duplicate identities, inventory levels are monitored incorrectly, catalogs are mailed multiple times to the same household, etc. Automatically detecting duplicates is difficult: First, duplicate representations are usually not identical but slightly differ in their values. Second, in principle all pairs of records should be compared, which is infeasible for large volumes of data. This lecture examines closely the two main components to overcome these difficulties: (i) Similarity measures are used to automatically identify duplicates when comparing two records.Well-chosen similarity measures improve the effectiveness of duplicate detection. (ii) Algorithms are developed to perform on very large volumes of data in search for duplicates.Well-designed algorithms improve the efficiency of duplicate detection. Finally, we discuss methods to evaluate the success of duplicate detection.

Read “An introduction to duplicate detection”:

Read “An introduction to duplicate detection” by choosing from the options below.

Search for “An introduction to duplicate detection” downloads:

Visit our Downloads Search page to see if downloads are available.

Find “An introduction to duplicate detection” in Libraries Near You:

Read or borrow “An introduction to duplicate detection” from your local library.

Buy “An introduction to duplicate detection” online:

Shop for “An introduction to duplicate detection” on popular online marketplaces.