Category Archive for: "Technology"

New Release of Treasure Agent: Improved Portability, Enhanced Performance

Treasure Agent (td-agent) is a distribution package of Fluentd -- the popular open source unified data collection software -- that adds extra support within Treasure Data Service. Since September of last year, we have been working on a new version of the Treasure Agent streaming data collector. A...

Why the Unified Logging Layer Matters

The amount of logs produced today is staggering. The logs provide opportunities for analysis to better understand customers and continually improve products. The log collection pipeline, then, becomes a source of valuable data. Collecting and unifying the data for better consumption and analysis ...

Treasure Data Joins the Linux Foundation

Today is a big step forward for our customers and community in general, as we officially join the Linux Foundation. As you may know, our company is driven by an open source culture: We believe that continuous innovation, integration and knowledge sharing makes it possible to solve real-world problem...

Presto versus Hive: What You Need to Know

There is much discussion in the industry about analytic engines and, specifically, which engines best meet various analytic needs. This post looks at two popular engines, Hive and Presto, and assesses the best uses for each. (more…)...

Treasure Data Senior Engineer to Present at FOSSASIA

On March 13th-15th, one of the biggest FOSS events in Asia will take place in Singapore: FOSSASIA. Treasure Data is excited to interact with the community and participate as a sponsor. Additionally, Treasure Data Senior Engineer Masahiro Nakagawa (aka Masa or @repeatedly), will be a presenter at the...

Four Reasons Presto is the Best SQL-on-Hadoop (That You Haven’t Heard Of)

Presto is an in-memory distributed SQL query engine developed by Facebook that has been open-sourced since November 2013. Presto has a number of key advantages over other SQL-on-Hadoop engines, yet these benefits are not widely recognized or understood. (more…)...

February 27, 2015

Eliminating Schema Rot in MPP Databases Like Redshift

The MPP database is an incredible piece of technology. These databases run large-scale analytic queries very quickly, making them great tools for iterative data exploration. With a cloud offering like Redshift ...

February 25, 2015

Managing the Data Pipeline with Git + Luigi

One of the common pains of managing data, especially for larger companies, is that a lot of data gets dirty (which you may or may not even notice!) and becomes scattered around everywhere. Many ad hoc scripts a...

February 5, 2015

Learn SQL by Calculating Customer Lifetime Value Part 2: GROUP BY and JOIN

This is the second installment of our SQL tutorial blog series. In the first part, we set up the data source with SQLite and learned how to filter and sort data. This time, we will learn two other key concepts ...

December 5, 2014

Learn SQL by Calculating Customer Lifetime Value Part 1: Setup, Counting and Filtering

Motivation As far as technical skills go, SQL is a really nice skill to have for product managers and product marketers. Instead of constantly running into performance issues in Excel or begging "technical" pe...

16