Vinta

Setup Spark, Scala and Maven with Intellij IDEA

2017-08-302019-10-22VintaBig Data

IntelliJ IDEA supports Scala and Apache Spark perfectly. You're able to browse a complete Spark project built with IntelliJ IDEA on GitHub: https://github.com/vinta/albedo

Feature Engineering 特徵工程中常見的方法

2017-08-092019-10-22VintaMachine Learning

Feature Engineering 是個手藝活，講求的是創造力。

Spark troubleshooting

2017-08-052019-10-22VintaBig Data, DevOps, Machine Learning

Wild "Task not serializable" appeared!

Observe system metrics, status, and logs on Linux

2017-08-052019-10-22VintaDevOps

Linux commands that every DevOps engineer or SysAdmin should know.

Build a recommender system with Spark: Implicit ALS

2017-05-202019-10-22VintaBig Data, Machine Learning, Python

在本篇文章中，我們以 Candidate Generation 階段常用的方法之一：Collaborative Filtering 協同過濾演算法為例，利用 Apache Spark 的 ALS (Alternating Least Squares) 模型建立一個 GitHub repositories 的推薦系統，以用戶對 repo 的打星紀錄作為訓練數據，推薦出用戶可能會感興趣的其他 repo 作為候選物品集。