“In the era of Big Data, the choice of data containers is critical”

2 min reading
Developers / 28 April 2016
“In the era of Big Data, the choice of data containers is critical”
“In the era of Big Data, the choice of data containers is critical”

BBVA API Market

How can containers contribute to improving Big Data?

They’re essential. Until a short while ago, data analysts concentrated on algorithms, and containers were merely there to help. However with the avalanche of data we’re currently seeing in the Big Data era, deciding what data containers we’re going to use for our analysis is critical to be able to handle data efficiently. In fact, a suboptimal choice of container may mean the difference between being able to make a Big Data analysis or not.

You’re a freelance developer and an expert in high-yield data storage and compression. How does storage contribute to the development ecosystem?

As I said before, it’s essential. High-yield compression in fast disks (SSD) can mean being able to store large quantities of data on laptops or single servers which would otherwise require a cluster with many nodes. And while clusters take a lot of time and experience to develop, it’s much simpler and faster to develop systems with a single node, and speeds up the whole development process.

What are the differences between Ruby, PHP and Python?

Although I’m not 100% familiar with Ruby and PHP, my impression is that PHP is more geared to developing web applications very fast. You can do this with Python too, but with the extra bonus of structuring –and therefore maintainability– that you don’t get from PHP.

How has Python helped to improve development over the years?

Basically the fact that this is a simple but very powerful language, with an enormous ecosystem of packages that work very efficiently, and in many cases have inherited the simplicity of the language in their APIs.

Why is Python based on legibility and transparency?

This is part of the initial design, so I guess that Guido Van Rossum, the creator of the language and BDFL (Benevolent Dictator For Life), can take much of the blame for that.

Follow us on @BBVAAPIMarket

It may interest you