Data Mining Introduction

Data Mining Introduction

Introduction

We have been "manually" extracting data in relation to the patterns they form for many years but as the volume of data and the varied sources from which we obtain it grow a more automatic approach is required.

The cause and solution to this increase in data to be processed has been because the increasing power of computer technology has increased data collection and storage. Direct hands-on data analysis has increasingly been supplemented, or even replaced entirely, by indirect, automatic data processing.

Data mining is the process uncovering hidden data patterns and has been used by businesses, scientists and governments for years to produce market research reports. A primary use for data mining is to analyse patterns of behaviour.

It can be easily be divided into stages

Pre-processing

Once the objective for the data that has been deemed to be useful and able to be interpreted is known, a target data set has to be assembled. Logically data mining can only discover data patterns that already exist in the collected data, therefore the target dataset must be able to contain these patterns but small enough to be able to succeed in its objective within an acceptable time frame.

The target set then has to be cleansed. This removes sources that have noise and missing data.

The clean data is then reduced into feature vectors,(a summarized version of the raw data source) at a rate of one vector per source. The feature vectors are then split into two sets, a "training set" and a "test set". The training set is used to "train" the data mining algorithm(s), while the test set is used to verify the accuracy of any patterns found.

Data mining

Data mining commonly involves four classes of task:

Classification - Arranges the data into predefined groups. For example email could be classified as legitimate or spam.
Clustering - Arranges data in groups defined by algorithms that attempt to group similar items together
Regression - Attempts to find a function which models the data with the least error.
Association rule learning - Searches for relationships between variables. Often used in supermarkets to work out what products are frequently bought together. This information can then be used for marketing purposes.

Validation of Results

The final stage is to verify that the patterns produced by the data mining algorithms occur in the wider data set as not all patterns found by the data mining algorithms are necessarily valid.

If the patterns do not meet the required standards, then the preprocessing and data mining stages have to be re-evaluated. When the patterns meet the required standards then these patterns can be turned into knowledge.

Source : http://ezinearticles.com/?Data-Mining-Introduction&id=2731583

Data Mining - Efficient in Detecting and Solving the Fraud Cases

Data Mining - Efficient in Detecting and Solving the Fraud Cases

Data mining can be considered to be the crucial process of dragging out accurate and probably useful details from the data. This application uses analytical as well as visualization technology in order to explore and represent content in a specific format, which is easily engulfed by a layman. It is widely used in a variety of profiling exercises, such as detection of fraud, scientific discovery, surveys and marketing research. Data management has applications in various monetary sectors, health sectors, bio-informatics, social network data research, business intelligence etc. This module is mainly used by corporate personals in order to understand the behavior of customers. With its help, they can analyze the purchasing pattern of clients and can thus expand their market strategy. Various financial institutions and banking sectors use this module in order to detect the credit card fraud cases, by recognizing the process involved in false transactions. Data management is correlated to expertise and talent plays a vital role in running such kind of function. This is the reason, why it is usually referred as craft rather than science.

The main role of data mining is to provide analytical mindset into the conduct of a particular company, determining the historical data. For this, unknown external events and fretful activities are also considered. On the imperious level, it is more complicated mainly for regulatory bodies for forecasting various activities in advance and taking necessary measures in preventing illegal events in future. Overall, data management can be defined as the process of extracting motifs from data. It is mainly used to unwrap motifs in data, but more often, it is carried out on samples of the content. And if the samples are not of good representation then the data mining procedure will be ineffective. It is unable to discover designs, if they are present in the larger part of data. However, verification and validation of information can be carried out with the help of such kind of module.

Source:http://ezinearticles.com/?Data-Mining---Efficient-in-Detecting-and-Solving-the-Fraud-Cases&id=4378613

Data Mining: Its Description and Uses

Data Mining: Its Description and Uses

Data mining also known as the process of analyzing the KDD which stands for Knowledge Discovery in Databases is a part of statistics and computer science. It is a process which aims to find out many various patterns in enormous sets of relational data.

It uses ways at the fields of machine learning, database systems, artificial intelligence, and statistics. It permits users to examine data from many various perspectives, sort it, and summarize the identified relationships.

In general, the objective of data mining process is to obtain info out of a data set and convert it into a comprehensible outline. Also, it includes the following: data processing, data management and database aspects, visualization, complexity considerations, online updating, inference and model considerations, and interestingness metrics.

On the other hand, the actual data mining assignment is the semi-automatic or automatic exploration of huge quantities of information to extract patterns that are interesting and previously unknown. Such patterns can be the unusual records or the anomaly detection, data records groups or the cluster analysis, and the dependencies or the association rule mining. Usually, this involves utilizing database methods like spatial indexes. Such patters could be perceived as a type of summary of input data, and could be used in further examination or, for example, in predictive analysis and machine learning.

Today, data mining is utilized by different consumer-focused companies like those in the financial, retails, marketing, and communications fields. It permits such companies to find out relationships among the internal aspects like staff skills, price, product positioning, and external aspects like customer information, competition, and economic indicators. Additionally, it allows them to define the effect on corporate profits, sales, and customer satisfaction; and dig into the summary information to be able to see transactional data in detail.

With data mining process, a retailer can make use of point-of-scale customer purchases records to send promotions based on the purchase history of a client. The retailer can improve products and campaigns or promotions that can be appealing to a definite customer group by using mining data from comment cards.

Generally, any of the following relationships are obtained.

1. Associations: Data could be mined to recognize associations.
2. Clusters: Data are sorted based on a rational relationships or consumer preferences.
3. Sequential Patters: Data is mined to expect patterns and trends in behavior.
4. Classes: Data that are stored are utilized to trace data in predetermined segments.

Source : http://ezinearticles.com/?Data-Mining:-Its-Description-and-Uses&id=7252273