The Evolution of Data Extraction

Data extraction is not a new technology, and has been used in one capacity or another since the inception of computers. It has undergone quite a few changes and advancements however, to keep up with the ever changing and evolving computer and later internet. Here is a brief history:

(1960s)

Evolutionary Step: Data Collection

Business Question: "What was my total revenue in the last five years?"

Enabling Technologies: Computers, tapes, disks

Product Providers: IBM, CDC

Characteristics: Retrospective, static data delivery

(1980s)

Evolutionary Step: Data Access

Business Question: "What were unit sales in New England last March?"

Enabling Technologies: Relational databases (RDBMS), Structured Query Language (SQL), ODBC

Product Providers: Oracle, Sybase, Informix, IBM, Microsoft

Characteristics: Retrospective, dynamic data delivery at record level

(1990s)

Evolutionary Step: Data Warehousing & Decision Support

Business Question: "What were unit sales in New England last March? Drill down to Boston."

Enabling Technologies: On-line analytic processing (OLAP), multidimensional databases, data warehouses

Product Providers: Pilot, Comshare, Arbor, Cognos, Microstrategy

Characteristics: Retrospective, dynamic data delivery at multiple levels
Data Mining

(Today)

Evolutionary Step: Data mining

Business Question: "What’s likely to happen to Boston unit sales next month? Why?"

Enabling Technologies: Advanced algorithms, multiprocessor computers, massive databases

Product Providers: Pilot, Lockheed, IBM, SGI, numerous startups

Characteristics: Prospective, proactive information delivery