Social Media Analysis: talking with humanity

The publicly available Social Media data is a cluster of data sources within the vast “Data Universe”. It is huddled right next to polling data, news data, and other human behavior and sociology datasets. While substantial in size, it is far from the largest dataset out there. However, if there were a prize for the most interesting dataset, it should be given to Social Media. It is there that we find, for the first time in history, a dynamic interactive representation of human society. Not only can we “listen” to what the humanity has to say, but we can also reply. We can talk with humanity. Moreover, this conversation has been increasingly powerful in shaping humanity’s...

Read More

Data specialists versus Data generalists

Data specialists focus on a specific data source or category (e.g., social media, satellite, radiology) and then seek to apply the derived insights to a...

An illusion of success: the problem-solution gap in data science

Data science solutions, in the form of a commercial product or custom-built, are unlike other types of software. The classic problem-solution gap, illustrated...