What is the term for an operation that purges redundant data while maintaining data integrity?
Normalization is the process of eliminating redundancy and protecting integrity of the data. When data normalization is utilized with IPS systems, the IPS manages multiple incoming streams of data and ensures that all data exists only in one form. This eliminates redundant data. Normalization is the part of the security analysis process that reduces the sheer amount of data and makes the process cleaner and more efficient.
Modularization is the breaking of a process into modules. A great example is the OSI model, which breaks the communication process down into seven modules or layers.
Aggregation is the process of taking data from multiple sources, such as IPS, firewall and router, and combining into a single integrated log file. A Security Information and Event (SIEM) system collects data from the different security devices in the system, such as firewalls and IPSs, and then aggregates the log files for analysis.
Data warehousing is the combination of data from multiple data sources or databases into a single repository for analysis and manipulation.