Tribute to Hans Rosling

Hans Rosling is one of the reasons why this blog exists. He defined himself as a “edutainer” and his way of explaining statistics to the public was simply mind blowing. I have been directed to the web site of his foundation, gapminder.org, by one of the courses I was following, I think it was “Analytic …

More

Working with SQLite in R

In the words of its creators, SQLite is a self-contained, high-reliability, embedded, full-featured, public-domain, SQL database engine. And apparently is the most used in the world. Libraries exist for interfacing R with SLQLite, the minimum requirement being DBI (A Common Database Interface) and RSQLite (SQLite interface for R). The keyword here is “embedded”. You do …

More

Data Science Specialization it is!

I just went through the experience of completing the Johns Hopkins University Data Science Specialization on Coursera. The last course of this specialization was the Capstone project, which consists basically in learning about a new subject, Natural Language Processing (or NLP in short) and producing a Shiny application hosted on Shinyapps.io that predicts the next word a …

More

R Rants…

This JH Data Science capstone project is transforming into a nightmare, especially because of R and tm, which do not do what they are supposed to do. True I have changed architecture and PC in the middle, but this is not the problem.  R and R packages like tm evolve fast and sometimes too fast …

More

Tabular output in R

R provides several libraries to format tabular output. As I have had the problem of finding one that worked well in all occasions and without  too much hassle, I would like to compare, from the point of view of aesthetic and ease of use.  I will not use any of the options and parameters. Just …

More

NLP: Language Detection in R

I have played a bit with two language detection libraries in R, without going too much in the details of how they work.  These are:   textcat CLRD The second package does not seem actively maintained, as the last update (version 1.1.0) is now over three years old. It can be however obtained and installed …

More

Speak Like a doctor: Basic NPL in R

I am now aiming at the Capstone project in the Coursera’s Data Science Specialization from Johns Hopkins, to finish the Specialization. The project is focused on predicting the next word that somebody is going to type, based on several databases to be used to build up the prediction algorithm. There is a lot of previous …

More

Tutorial Review: How to Build a Text Mining, Machine Learning Document Classification System in R!

This tutorial by Tim D’Auria on Youtube, is shorter than 30 minutes. Without pretending too much background it gives you the basic tools and knowledge to build a basic document classification system. The classifier uses a simple KNN  classification algorithm and text mining techniques to learn to distinguish the candidate who pronounced the speeches of …

More