FROM MASSIVE DATA TO USEFUL INTELLIGENCE

Posted by on Jun 7, 2013 in Articles, Slider | 2 comments

FROM MASSIVE DATA TO USEFUL INTELLIGENCE

CONSOLIDATION  AND  INTEGRATION  THROUGH COMMUNICATIONS  –  FROM  MASSIVE  DATA  TO USEFUL  INTELLIGENCE

 

 

 

The rising tendency of Businesses, Organizations and Agencies worldwide to allocate tremendous amounts of IT resources, due to the overwhelming data flows, along with the current need of logging everything for a multitude of reasons, have – among other things – brought us to an era of huge volumes of data being transferred Internationally. It has been the trend of our time to refer to such data movements using a unique term, “Big Data”. As large Technology Solutions providers (e.g. Intel) and frequent references in the Signal Magazine show, we are driven towards the need for powerful Coms systems that can support such data flows. Therefore, the need of Integration and Information Consolidation is not only needed for reasons of efficiency, but also for what was mentioned at the First Unclassified Intelligence Conference in Brussels, as “moving from raw data to tangible intel”.

 

When designing systems of such caliber, Engineers and Analysts will have to consider such factors as current bandwidth limitations, expected systems needs and future scalability when tensions get high. As such, we have to  “upgrade” our use of current telecommunications arrays in a manner that will allow for these rising, data-consuming systems to keep functioning, while we design the Architecture and Infrastructure that will support the next generation of systems, those fully compliant with Big Data. In this way, we will not lose time migrating and thus any Big Data based system that we need to deploy earlier than planned, can provide a number of facilities, assisting in threats prevention, waiting for the new Coms to come into play. On another account, we may find fertile ground for solutions in the field of Data Compression.

 

Research could lead us towards a hybrid model of compression, which would not only combine current algorithms, but based upon that combination we could add an extra layer of “bridging compression” that will fill in the blanks of space we can save, while allowing a window for added Security (e.g. an added security token). This will effectively allow smaller size packets, lighter signal needs and monitored propagation, while transceivers function. In this way, we can cover more than the average expected system’s needs. Last but not least, much like the concepts behind Cloud

 

Computing, the hardware supporting such systems that provide major Telecommunication Services, will have to withstand sudden changes in data volumes (i.e. be scalable). Understandably, sometimes thinking simple yields more results, with a solution easily found in nature, more specifically in Storms; the more powerful a storm tends to be, the more electricity charges are exchanged, especially when 2 storms come close to a Perfect Storm. What if scientists could build material that would come near the resilience levels of the sky elements involved in storms (i.e. clouds). The capacity and durability of Telecom hardware would therefore increase exponentially; essentially this would allow for bandwidth expansion (after all, we are still using electrical and other signals to express 1 and 0). Isn’t this the main issue? Thinking simple, as said! I will try to explain these remarks in a more detailed fashion within my Final Paper, using words and alternative thinking, rather than Math. This could then be transferred to experienced engineers to deliver hardware and software based upon advanced mathematics that they shall create and test.

 

As bandwidth limitations are taken care of, while security is kept into focus, we will be able to use existing IT systems (with a few amendments) so as to bring all the raw data into our data silos and mine them for useful intel. Adapting to the new Coms Infrastructure proposed will pretty much be the only amendment required, leading in reduced systems development costs and the ability to send and receive more data for analysis and vetting. In my humble opinion, with proper minds behind this, it could very well work and secure definitive results.

George M. Chatzitheodosiou
Vice President, AFCEA Student Club
DEREE – The American College of Greece
6, Gravias Street
15342 Aghia Paraskevi
Athens, Greece
http://www.afceayouth.com
http://www.acg.edu/afcea-club
http://gr.linkedin.com/in/afceaclubgreece