big data

XGBoost Distributed Training and Parallel Predictions with Apache Spark

Background In Boosting (ML ensemble method), algorithms implement a sequential process (as opposed to Bagging where it is parallelised) that generates weak learners and combine them to a strong learner (as in all Ensemble methods). In Boosting, at each iteration of this process, the model tries to correct the mistakes of the previous one in […]

Cloudzone_admin

July 15, 2020

Making Government Data Accessible with Google Kubernetes Engine

Recently, I’ve had the pleasure of working alongside a group of subcontractors in charge of creating the first cloud-based public data portal available to the public. We set out to create a solution, which we didn’t know at the outset if it was feasible or not. It was a mighty endeavour, and of course, we […]

Cloudzone_admin

July 15, 2020