Take the 2-minute tour ×

I have seen a thousand ways show XML, JSON, and other complicated ways of showing activity data.

That appears to be step 1000, and I am on step 1.

I can log anything, and save anything to the table. My question is where to start...

How do I setup a data model to collect my activity?

From this question I have several data gaps I need to fill...

  1. Do I use independent logs? or do I prestage activity data? In either case, what columns do I need?

  2. Based on question 1, how do I construct the queries to provide the response I need? Do I use string-based constructions per user? or stored procedures to return the dataset?

I realize this is a really-noob question in regards to activity streams, but any information on this would really be appreciated.


share|improve this question
add comment

2 Answers

Have you tried taking a look at pump.io

share|improve this answer
add comment

This tutorial will help you setup a system like Pinterest's feed using Redis. It's quite easy to get started with.

Over at Fashiolista we've opensourced our approach to building feed systems. https://github.com/tschellenbach/Feedly

In addition have a look at this high scalability post were we explain some of the design decisions involved: http://highscalability.com/blog/2013/10/28/design-decisions-for-scaling-your-high-traffic-feeds.html


share|improve this answer
add comment

Your Answer


