Treasure Data Blog | Analytics Infrastructure as a Service - Part 24

August 21, 2015

Treasure Data and Chartio Co-panel: Big Data and How to Get it Right

On Wednesday, August 26, SOMA Central (450 Townsend Street, San Francisco) will host a panel with Treasure Data and Chartio: "Big Data and How to Get it Right." You can RSVP here. Panelists will include Stuart Reavely (Product Lead, Class Dojo); A...

August 21, 2015

Redshift Data Loading Simplified with Schema-On-Read ELT

By now, it's become pretty clear that Amazon Redshift is becoming the preferred data warehouse solution due to a number of factors. One factor may be its compatibility with Postgresql, enabling talent with existing SQL skill sets to immediately handle and enable access to massive volumes of data; an...

August 18, 2015

5 Tips to Optimize Fluentd Performance

We've recently gotten quite a few questions about how to optimize Fluentd performance when there is an extremely high volume of incoming logs. Kazuki Ohta presents 5 tips to optimize fluentd performance. They are: Use td-agent2, not td-agent1. Use 'num_threads' option. Avoid extra computatio...

August 17, 2015

Treasure Data at LinuxCon North America 2015

As many of you already know, Treasure Data contributes and promotes open source software. We are happy to announce that we will be actively participating at CloudOpen & LinuxCon North America 2015. Eduardo Silva, a member of our...

August 11, 2015

Making Magic with pandas-td

Magic functions enable common tasks by saving you typing. (NOTE: Pandas itself doesn't have magic functions; the IPython kernel does.) Magic functions are functions preceeded by a % symbol. Magic functions have been introduced into pandas-td version 0.8.0! Toru Takahashi from Treasure Data walks...

5 Use Cases Enabled by Docker 1.8’s Fluentd Logging Driver

Docker 1.8 Is Here with Fluentd If you are interested in deploying Fluentd + Kubernetes/Docker at scale, check out our Fluentd Enterprise offering. Docker 1.8 is coming soon! One of the major items in the 1.8 releases is its support for Fluentd as a Logging Driver. As the inventor of Fluentd, ...

Pandas: A Crash Course

"In Data Science, 80% of time spent prepare data, 20% of time spent complain about need for prepare data.” - @BigDataBorat On July 1, Treasure Data hosted the latest round of the Silicon Valley Data Engineering meetup, “Pandas: Lessons Learned for Open-Source Data Tools with Chang She”. ...

Analyzing Landsat Data with Treasure Data and Amazon S3

As a data scientist (or would-be dabbler), you'll want to get a handle on pulling data from open data from public sources. More and more, those sources can be found in Amazon S3 buckets. Treasure Data now offers a connector for S3, so you can pull down public data sets from S3 buckets as *tsv an...

24