Vinta

Spark SQL cookbook (Scala)

2017-09-022026-03-17VintaAI, Big Data

Scala is the first class citizen language for interacting with Apache Spark, but it's difficult to learn. This article is mostly about operating DataFrame or Dataset in Spark SQL.

Play with GitHub Archive Dataset on BigQuery

2017-09-012026-03-17VintaBig Data

Google BigQuery is a web service that lets you do interactive analysis of very massive datasets - analyzing billions of rows in seconds.

Use Makefile as a task runner for arbitrary projects

2017-08-312026-03-17VintaDevOps

Use the make, Luke!

Setup Spark, Scala and Maven with Intellij IDEA

2017-08-302026-03-17VintaBig Data

IntelliJ IDEA supports Scala and Apache Spark perfectly. You're able to browse a complete Spark project built with IntelliJ IDEA on GitHub: https://github.com/vinta/albedo

Feature Engineering 特徵工程中常見的方法

2017-08-092026-02-18VintaAI

Feature Engineering 是個手藝活，講求的是創造力。