Category Archive for: "Technology"

4 Ways AdTech Uses Treasure Data’s Open Source Software

Like many cloud services, Treasure Data has been a huge beneficiary of open source software. For example, we have adopted and modified Hive and Presto for our distributed processing back end and made several key contributions back to Presto. We run dozens of Chef recipes everyday, and Rails and Angu...

Tableau and Treasure Data: From Logging to Visualization

Previously, we looked at how to log events from our very simple Python “Rock, Paper, Scissors” app. While there are many types of logs (error logs, sensor logs, event logs, payment, and CRM logs, to name a few), the principle is effectively the same for any sort of log, regardless of how the log...

Python 101 for Aspiring Data Nerds

As a data scientist, or anyone interested in collecting data for that matter, it's no doubt helpful to know about how to go about collecting the data in your app - data that you'll want to later query and analyze. Here, we'll build an app in Python from A-Z, iterate on it to make it more robust...

New UDFs in Presto: currency conversion and geocoding tools

Today, we introduced three new UDFs (user-defined functions) to to Treasure Data's Presto offering. They are: TD_CURRENCY_CONV [crayon-5b7a33d778d7e769449370-i/] TD_IP_TO_COUNTRY_CODE [crayon-5b7a33d778d86437333871-i/] TD_IP_TO_COUNTRY_NAME [crayon-5b7a33d778d88457877845-i/] (more&hellip...

Open Source’s Main Advantage is NOT Cost

Let's start with a trick question: How much does MySQL cost Facebook every year? Depending on whom you ask, the answer ranges from “nothing” to “millions of dollars every year.” True, the MySQL software is free; it costs nothing for anyone to download it. What's more, it's free for anyone...

New Release of Treasure Agent: Improved Portability, Enhanced Performance

Treasure Agent (td-agent) is a distribution package of Fluentd -- the popular open source unified data collection software -- that adds extra support within Treasure Data Service. Since September of last year, we have been working on a new version of the Treasure Agent streaming data collector. A...

Why the Unified Logging Layer Matters

The amount of logs produced today is staggering. The logs provide opportunities for analysis to better understand customers and continually improve products. The log collection pipeline, then, becomes a source of valuable data. Collecting and unifying the data for better consumption and analysis ...

Treasure Data Joins the Linux Foundation

Today is a big step forward for our customers and community in general, as we officially join the Linux Foundation. As you may know, our company is driven by an open source culture: We believe that continuous innovation, integration and knowledge sharing makes it possible to solve real-world problem...

Presto versus Hive: What You Need to Know

There is much discussion in the industry about analytic engines and, specifically, which engines best meet various analytic needs. This post looks at two popular engines, Hive and Presto, and assesses the best uses for each. (more…)...

Treasure Data Senior Engineer to Present at FOSSASIA

On March 13th-15th, one of the biggest FOSS events in Asia will take place in Singapore: FOSSASIA. Treasure Data is excited to interact with the community and participate as a sponsor. Additionally, Treasure Data Senior Engineer Masahiro Nakagawa (aka Masa or @repeatedly), will be a presenter at the...

16