What do you mean by Multimedia data mining? List some issues of multimedia mining.
MULTIMEDIA DATA MINING
Multimedia data mining is the discovery of interesting patterns from multimedia databases that store and manage large collections of multimedia objects, including image data, video data, audio data, as well as sequence data and hypertext data containing text, text markups, and linkages Multimedia data mining is an interdisciplinary field that integrates image processing and understanding, computer vision, data mining, and pattern recognition. Multimedia data cubes contain additional dimensions and measures for multimedia information. Other topics in multimedia mining include classification and prediction analysis, mining associations, and video and audio data mining.
Issues in multimedia data mining include- content-based retrieval and similarity search, generalization, and multidimensional analysis.
ISSUES IN MULTIMEDIA MINING
Major Issues in multimedia data mining contains:-
1. Content-based retrieval and Similarity search
2. Multidimensional Analysis
3. Classification and Prediction Analysis
4. Mining Associations in Multimedia Data
1. Content-based retrieval and Similarity search
Content-based retrieval in multimedia is a stimulating problem since multimedia data is required for detailed analysis from pixel values. We considered two main families of multimedia retrieval systems i.e. similarity search in multimedia data.
(1) Description-based retrieval system created indices and make object retrieval, based on image descriptions, for example, keywords, captions, size, and time of creation.
(2) Content-based retrieval system supports retrieval of the image content, for example, color histogram, texture, shape, objects, and wavelet transform.
Use of content-based retrieval system: Visual features index images and promotes object retrieval based on feature similarity; it is very desirable in various applications. These applications include diagnosis, weather prediction, TV production, and internet search engines for pictures and e-commerce.
2. Multidimensional Analysis
In order to perform multidimensional analysis of large multimedia databases, multimedia data cubes may be designed and constructed in a method similar to that for traditional data cubes from relational data. A multimedia data cube can have additional dimensions and measures for multimedia data, such as color, texture, and shape. A multimedia data cube has several dimensions.
Examples are the size of the image or video in bytes; width and height of the frames, creating two dimensions, date on which the image or video was created or last modified, format type of the image or video, frame sequence duration in seconds, Internet domain of pages referencing the image or video, the keywords like a color dimension and edge orientation dimension. The Multimedia data mining system prototype is called MultiMediaMiner which is the extension of the DBMiner system that handles multimedia data. The Image Excavator component of MultiMediaMiner uses image contextual information, like HTML tags in Web pages, to derive keywords. By navigating online directory structures, like Yahoo! directory, it is possible to build hierarchies of keywords mapped on the directories in which the image was found.
3. Classification and Prediction Analysis
Classification and predictive analysis has been used for mining multimedia data, particularly in scientific analysis like astronomy, seismology, and geoscientific analysis. Decision tree classification is an important data mining method in reported image data mining applications.
For example, considering the sky images which have been carefully classified by astronomers as the training set, it can create models for the recognition of galaxies, stars, and further stellar objects, based on properties like magnitudes, areas, intensity, image moments, and orientation. The image data are frequently in large volumes and need substantial processing power, for example, parallel and distributed processing. Image data mining classification and clustering are carefully connected to image analysis and scientific data mining and hence many image analysis techniques and scientific data analysis methods could be applied to image data mining.
4. Mining Associations in Multimedia Data
Association rules involving multimedia objects have been mined in image and video databases. Three categories can be observed:
1. Associations between image content and non-image content features
2. Associations among image contents that are not related to spatial relationships
3. Associations among image contents related to spatial relationships
With the associations between multimedia objects, we can treat every image as a transaction and find commonly occurring patterns among different images. First, an image contains multiple objects, each with various features such as color, shape, texture, keyword, and spatial locations, so that there can be a huge number of possible associations. Second, a picture containing multiple repeated objects is an essential feature in image analysis, recurrence of similar objects should not be ignored in association analysis. Third, to find the associations between the spatial relationships and multimedia images and this can be used for discovering object associations and correlations
Comments
Post a Comment