Vinta

Spark SQL cookbook (Scala)

2017-09-022019-10-22VintaBig Data, Machine Learning

Scala is the first class citizen language for interacting with Apache Spark, but it's difficult to learn. This article is mostly about operating DataFrame or Dataset in Spark SQL.

Play with GitHub Archive Dataset on BigQuery

2017-09-012019-10-29VintaBig Data

Google BigQuery is a web service that lets you do interactive analysis of very massive datasets - analyzing billions of rows in seconds.

Use Makefile as a task runner for arbitrary projects

2017-08-312019-10-22VintaDevOps

Use the make, Luke!

Setup Spark, Scala and Maven with Intellij IDEA

2017-08-302019-10-22VintaBig Data

IntelliJ IDEA supports Scala and Apache Spark perfectly. You're able to browse a complete Spark project built with IntelliJ IDEA on GitHub: https://github.com/vinta/albedo

Feature Engineering 特徵工程中常見的方法

2017-08-092019-10-22VintaMachine Learning

Feature Engineering 是個手藝活，講求的是創造力。