Open Source - Treasure Data Blog - Part 4

Tag Archives for: "Open Source"

November 26, 2014

12 Open Source Software Innovations from Treasure Data Engineers

TD is proud to have some of the best technical minds in the world working on our unique managed service. When they’re not working on the TD Service or supporting our customers, many of our engineers continue ...

Fluentd Talk at MongoDB SV User Group

We originally developed it to solve the problem of data collection for our own service. Since open-sourcing it last October, it’s been deployed at many organizations including SlideShare/LinkedIn, ContextLogic, Viki, NHN, and many others......

Log Everything as JSON. Make Your Life Easier

The Story of an Engineer. Here is an anecdote. I am sure some of you have had a similar experience. (more…)...

January 17, 2012

Enabling Facebook’s Log Infrastructure with Fluentd

Facebook uses Scribe as its core log aggregation service. The description of Github reads, “Scribe is a server for aggregating log data streamed in real time from a large number of servers.”.....

November 23, 2011

Fluentd: The Missing Log Collector Software

The fundamental problem with logs is that they are usually stored in files although they are best represented as streams (by Adam Wiggins, CTO at Heroku). Traditionally, they have been dumped into text-based files and collected by rsync in......

November 21, 2011

MessagePack: The Missing Serializer

MessagePack, the efficient, blazing, fast serializer is the core of our technology. The best way to describe MessagePack is “JSON on steroids”. It supports an almost identical set of data types as JSON —Nil, Boolean, Integer, Float, String, Array, and Associative Array— but runs much faste...

4