Six years ago Robert Scoble and Shel Israel published Naked Conversations, a book that defined the business use of social media. Last month, Scoble and Israel released a new book, The Age of Context, which promises to define the conversation about the most important trends in our digital lives. The book, based on over 300 interviews conducted over eighteen months, is an engaging journey through the five “converging forces that promise to … [Read more...]
Big Data Articles
We hope you’ll both enjoy and benefit from this inside look at the world of ‘big data’. The authors will cover data management trends, in addition to big data architecture, predictive analytics, and inspiring use cases.
The following big data articles represent the latest features from Inside Tech Talk. If you would like to receive new big data features as they become available, simply subscribe, for free via RSS or email.
A veteran CIO recounted to me recently how responsive her IT organization has become once they started separating the data from the hardware. Before, it was common to have a hard drive failure and find out the user has not done a backup. Once they put the data in the cloud (private cloud, in this case), they became a very effective and responsive service center. No matter what happened to the hardware, they could restore the user data to a new … [Read more...]
Apple’s September 10th announcement of the new iPhones was greeted by negative commentary and a drop in the price of its stock. Dylan Tweney, executive editor at VentureBeat spoke for many when he asked if this is “the beginning of a long decline.” After a couple of days, however, some commentators got over the colors and the plastic and declared that there were indeed a few new things to chew on: A 64-bit chip and a “motion coprocessor.” The … [Read more...]
I’ve been interested in large scale computing ever since I was introduced to it at the University of Southampton where the Computer Science department was heavily involved in Data Mining and Grid Computing research, which obviously influenced the courses on offer and what the lecturers liked to talk about. My dissertation looked at how these techniques could be applied to protein folding research, which generated much more data than could be … [Read more...]
OK, I'm going to stay on tech here, away from the politics of big-data, because you can draw your own conclusions. By now EVERYBODY has heard about 'big data', the information companies gather and what the government requires they acquire. I personally have been involved in 'lawful intercept' projects and understand the technologies and laws that govern access. The fact is that ‘you’re opted in’, whether you like it or not, so when you think … [Read more...]
In the last couple of weeks my colleagues and I attended the Hadoop and Cassandra Summits in the San Francisco Bay Area. It was rewarding to talk to so many experienced Big Data technologists in such a short time frame – thanks to DataStax and Hortonworks for hosting these great events! It was also great to see that performance is becoming an important topic in the community at large. We got a lot of feedback on typical Big Data performance … [Read more...]
If you thought you’ve conquered BYOD, think again. The new BYOD stands for Bring Your Own Data. By 2019, 90 percent of organizations will have personal data on IT systems that they don't own or control, Gartner recently predicted. In warning about the consequences of ignoring personal data, Gartner made the distinction between data that relates to people and data that does not. Personal data includes “contact information and health and … [Read more...]
Nate Silver is the author of one of my favorite books, “The Signal and the Noise”. The term explains itself but the premise is that the “signal-to-noise ratio is sometimes used informally to refer to the ratio of useful information to false or irrelevant data in a conversation or exchange” (Wikipedia). Nate does a great job of illustrating this concept in his book. In my mind, signal-to-noise is the ratio of usefulness to uselessness, which … [Read more...]
Big data fascinates me. It also frustrates me. First, the fascination: Some years ago, I read a book called “Freakonomics”, written by economist Steven Levitt and New York Times journalist Stephen J. Dubner. The book analyzes hidden socio-economic data to connect events and trends that conventional wisdom says aren’t connected. For instance, “What do school teachers and sumo wrestlers have in common?”, and “Why do drug dealers live with their … [Read more...]
The other day I ran a Pig script. Nothing fancy; I loaded some data into HBase and then ran a second Pig job to do some aggregations. I knew the data loading would take some time as it was multiple GB of data, but I expected the second aggregation job to run much faster. It ran for over 15 hours and was not done at that time. This was too long in my mind and I terminated it. I was using Amazon Elastic Map Reduce as my Hadoop environment, so I … [Read more...]