CHolmes's picture

Having spent the last 10 years or so working with technology on a day-to-day basis, I thought I’d seen a good deal of “Woah, that is cool” moments. These moments range from just discovering modern day technology (the fact that companies made billions on database software blew my much younger mind for about a week) to more niche discoveries (my first identified SQL Injection vulnerability was a doozie, and I didn’t even know it had a name until two years later!)

Now these moments are expected as technology improves, markets mature and breakthroughs are made, but rarely do folks get to encounter the collision of two complementary technologies like we’re seeing with Cloud Computing and Big Data. “The Cloud” has been kicking around for some time and is still somewhat ill-defined, but can loosely be seen as remote computing and data storage services ranging from eReader stores to paying for on-demand processing and storage services. “Big Data” on the other hand is just starting to get recognition, most notably with Nate Silver’s uncanny, data driven prediction of the most recent United States elections.

Seeing these services collide from afar is interesting to watch…but it’s even more awe inspiring in everyday life. As an example, no more than a week ago an innocent question from a college friend around Java 7 adoption rates started a chain reaction of big data, cloud services and human feedback that would not have been possible even a few years ago. In short, the chain went something like this:

  • A private twitter conversation lead to a question about Java 7 adoption in the open source community
  • The request was relayed to Veracode engineers as an informal inquiry
  • Veracode engineers polled a massive amount of security analysis data collected via our cloud based static binary analysis server and crunched numbers across 100+ global customers that had performed a Java scan in the last month (more on the results below)
  • An innocent tweet from a comfortable Starbucks chair about how quickly such requests can be processed lead to feedback from friends, colleagues, co-workers and several others asking for more specific details and helping shape the request
  • The data was rerun, re-analyzed and cross referenced against other posts
  • Results were shot to a marketing department for cleansing
  • A blog post extolling the virtues of cloud computing and big data was posted to our site

In short – a combination of cloud messaging and analysis services lead to a quick, effective, ad-hoc international cooperative that quickly answered a simple question.

So what’s the point? Easy – technology is really, really cool, but not only that. Technology, if used correctly and done in a collaborative manner can be incredibly powerful. It can help answer questions that otherwise would go unanswered. It has helped solve medical issues, predict an election with a high degree of accuracy, and in Veracode’s case, enable developers worldwide to identify software flaws while also helping improve the very engine that they’re submitting to.

At the end of the day, the collision of these two technologies can and will be used for the greater good. We at Veracode see it in the form of our State of Software Security reports, infographics and a variety of other analysis we provide for free to the greater community. On a broader scale it can hopefully help make the world a healthier, happier place.

Side note: The Java7 Scan Answer

The short answer is that we don’t see widespread use of Java7 in our customer base. To be fair, our full Java7 support has been out for less than a couple of months, but in that timeframe less than 0.3% of all Java applications submitted are in Java7. Of those submissions all were from commercial organizations well known for their quick adoption of technology, and even those were a small subset of their individual submissions. While our data doesn’t show much in the way of Java7 adoption there are other sample sets (also admittedly small) that see the exact opposite, such as the Jelastic blog post that is well summarized by Henrik Stahl at

Comments (2)

Justin | December 29, 2012 10:00 am

Hi Chad,

Great post on the impact of big data and the cloud. I'm particularly interested in your opinion on the integration of The Internet of Things with big data in the next few years ; we're already seeing it in the use of QR codes and internet-ready TV's. Do you see any big cultural impact big data is poised to have in the average Joe's daily life experience?


CHolmes | January 2, 2013 5:02 pm

Thanks for the question Justin. Big data already impacts daily lives in a couple of ways, although people may not realize it.

On a personal level, I'm a big baseball fan and over the last few years Sabermetrics has become huge in determining the true impact a player has on the game. Michael Lewis' "Moneyball" is a great read (with a surprisingly good film adaptation) if you're interested in seeing how a whole lot of historical data and a few really smart folks helped change the way a multi-billion dollar game is played. This analytic approach to building teams is quickly making way into other major sports and challenging many of the traditional approaches of each game.

On an even larger level, the availability of data and ability to analyze it impacts most consumers - Netflix makes recommendations based on the viewing habits of their full consumer base compared to yours. Amazon recommends items based on your purchase history compared to others. Apple's iTunes Genius functionality creates playlists based on information from others. And in one rather interesting occurrence, Target actually predicted a teenage girl was pregnant before she told her family ( This last point clearly demonstrates that those with great power (and data access) need to also exercise a great deal of responsibility.

As for where we'll see new breakthroughs, my guess is as good as any. As it has for years, weather predictability will continue to get great deals of attention. Personally, I'd also like to see data used to improve traffic flow, recommend better GPS routes and reduce congestion overall...but that's likely many years in the future.

Please Post Your Comments & Reviews

Your email address will not be published. Required fields are marked *

Love to learn about Application Security?

Get all the latest news, tips and articles delivered right to your inbox.