NoSQL: The Social Graph Challenge

The Social Graph Challenge

Nati Shalom (Gigaspaces) describes a solution to solving a large scale graph problem:

via NoSQL databases

NoSQL: Building Publish / Subscribe Apps with Tropo and Redis

Building Publish / Subscribe Apps with Tropo and Redis

I'm hearing quite often lately of Redis PUB/SUB replacing real queuing systems. Here is an example application:

tags:Redis

via NoSQL databases

NoSQL: The Rise of Hadoop: How many Hadoop-related solutions exist?

The Rise of Hadoop: How many Hadoop-related solutions exist?

The CMSWire commented list of Hadoop-related solutions:

tags:Hadoop

via NoSQL databases

NoSQL: MongoDB on EC2

MongoDB on EC2

The basic setup:

tags:MongoDB

via NoSQL databases

NoSQL: Introducing AODBM

Introducing AODBM

What's the point in writing a new dbm style DBMS when so many exist already? Surely there is nothing new that anyone can add to this long line of projects?

via NoSQL databases

NoSQL: Yahoo Could Spinoff Hadoop Software Unit

Yahoo Could Spinoff Hadoop Software Unit

WSJ:

tags:Hadoop

via NoSQL databases

NoSQL: BookSleeve: StackExchange Redis C# async Library

BookSleeve: StackExchange Redis C# async Library

So; what are the goals? to operate as a fully-functional Redis client (obviously) to be thread-safe and non-blocking to support implicit database switching to help with multi-tenancy scenarios to be on-par with redis-sharp on like scenarios (i.e. a complete request/response cycle) to allow absolute minimum cost fire-and-forget usage (for when you don't care what the reply is, and errors will be handled separately) to allow use as a "future" – i.e request some data from Redis and start some other work while it is on the wire, and merge in the Redis reply when available to allow use with callbacks for when you need the reply, but not necessarily as part of the current request to allow C# 5 continuation usage (aka async/await) to allow fully pipelined usage – i.e. issue 200 requests before we've even got the first response to allow fully multiplexed usage – i.e. it must handle meshing the responses from different callers on different threads and on different databases but on the same connection back to the originator

tags:Redis

via NoSQL databases

NoSQL: MongoDB at Guardian.co.uk

MongoDB at Guardian.co.uk

For a long time CouchDB listed BBC as one of its largest users — you can read more about it Enda Farrell's talk about CouchDB at BBC and CouchDB case study . At QCon London 2011 , Matthew Wall [1] talked about Guardian.co.uk usage of MongoDB. InfoQ hasn't published the video of the presentation yet, so here's Graham Tackley's slides:

tags:MongoDB,CouchDB

via NoSQL databases

NoSQL: Riak Backend Based on CouchDB B-Tree

Riak Backend Based on CouchDB B-Tree

The CouchDB with a Riak backend didn't get too far and since then we've got BigCouch . But the opposite combination seems to be interesting too.

tags:Riak,CouchDB

via NoSQL databases

NoSQL: Hadoop Jobs

Hadoop Jobs

Real jobs:

tags:Hadoop

via NoSQL databases

NoSQL: Easy IP Geotargeting with Geokit and MongoMapper

Easy IP Geotargeting with Geokit and MongoMapper

There are several cases in which it might make sense to tailor your app's content based on a user's physical location. But asking them directly is a bit of a pain. Luckily, it's extremely simple to find a user's location knowing only something you will always know about a visitor: their IP address. Today I'll walk you through how to use IPs to geolocate your visitors in a Rails application using Geokit and MongoDB's geospatial indexing with MongoMapper.

tags:MongoDB

via NoSQL databases

NoSQL: Paper: NoSQL and the Windows Azure Platform

Paper: NoSQL and the Windows Azure Platform

A paper by Andrew J.Brust. Abstract:

via NoSQL databases

NoSQL: MongoDB Competitors: CouchDB, Membase, Couchbase, Cassandra, HBase, Riak

MongoDB Competitors: CouchDB, Membase, Couchbase, Cassandra, HBase, Riak

In a post describing different ways to measure adoption of open source projects, Max Schireson (President 10gen) named Couchbase's products (CouchDB, Membase), Cassandra, HBase, and Riak as main MongoDB competitors.

tags:MongoDB

via NoSQL databases

NoSQL: wooga's architecture: Facebook Games on MySQL and Redis

wooga's architecture: Facebook Games on MySQL and Redis

Tim Lossen's presentation about the evolution of wooga's architecture (Facebook games) from using sharded MySQL to a polyglot persistence solution based on master/slave Redis and master/slave MySQL, with pluses and minuses:

tags:Redis

via NoSQL databases

NoSQL: How would an iTunes model for data address licensing and ownership?

How would an iTunes model for data address licensing and ownership?

Gil Elbaz (Factual)

tags:BigData

via NoSQL databases

NoSQL: The 5 Stages of Data Maturity Model

The 5 Stages of Data Maturity Model

Markus Sprenger:

tags:BigData

via NoSQL databases

NoSQL: Emil Eifrem about the Neo4j 1.3 and Neo4j GPL Community Edition

Emil Eifrem about the Neo4j 1.3 and Neo4j GPL Community Edition

Last week, Neo Technology has released the 1.3 version of their graph database Neo4j. The technical aspects of the release have been covered in this blog post . Briefly:

tags:Neo4j

via NoSQL databases

NoSQL: Redis Sharding with Erlang

Redis Sharding with Erlang

Chris Moos:

tags:Redis

via NoSQL databases

NoSQL: Why MapReduce is Simple

Why MapReduce is Simple

Mathias Meyer:

tags:MapReduce

via NoSQL databases

NoSQL: Adopting Apache Hadoop and Hive

Adopting Apache Hadoop and Hive

Moving Federal Gov analytics from MySQL to Hadoop and Hive:

tags:Hadoop

via NoSQL databases

NoSQL: Graph Databases: Distributed Traversal Engines

Graph Databases: Distributed Traversal Engines

Marko A.Rodriguez:

via NoSQL databases

NoSQL: Cloud Foundry, NoSQL Databases, and Polyglot Persistence

Cloud Foundry, NoSQL Databases, and Polyglot Persistence

VMWare's Cloud Foundry has the potential to become the preferred PaaS solution. It bundles together a set of services that it took years for other PaaS providers (Google App Engine, Microsoft Azure) to offer. And it seems that Cloud Foundry has much less (or none at all) vendor lock in [1] .

via NoSQL databases

NoSQL: Yet NoSQL Dogma

Yet NoSQL Dogma

Given all this I did some benchmarks and as expected the NOSQL community was hurt […]

via NoSQL databases

NoSQL: Data Science & The Role of the Data Scientist

Data Science & The Role of the Data Scientist

From the Wikibon blog infographic about data science and the data scientist:

via NoSQL databases

NoSQL: Powered by Membase: Ad Platform AdAction

Powered by Membase: Ad Platform AdAction

Wouter de Bie (systems developer for AdAction):

tags:Membase,Couchbase

via NoSQL databases

NoSQL: As the minicomputer brought Oracle, will the cloud bring a new database?

As the minicomputer brought Oracle, will the cloud bring a new database?

The question I think about a lot is what changes will cloud computing bring to the database industry. Will cloud be the platform change that ushers in a new generation of database technologies, and if so which ones and how sweeping will the change be? It is both intellectually interesting and one of the largest external factors effecting the company I run (10gen, the company that builds mongoDB; yes, this is an obvious source of bias for me in this post

via NoSQL databases

NoSQL: A Rake Task for Backing Up a MongoDB Database

A Rake Task for Backing Up a MongoDB Database

Daniel Doubrovkine:

tags:MongoDB

via NoSQL databases

NoSQL: Why would I use Document Database?

Why would I use Document Database?

Fitzchak Yitzchaki:

tags:RavenDB

via NoSQL databases

NoSQL: Multi-tenancy and Cloud Storage Performance

Multi-tenancy and Cloud Storage Performance

Adrian Cockcroft [1] has a great explanation of the impact of multi-tenancy on cloud storage performance. The connection with NoSQL databases is not necessarily in the Amazon EBS and SSD Price, Performance, QoS comparison , but:

via NoSQL databases

NoSQL: Amazon EC2 Cassandra Cluster with DataStax AMI

Amazon EC2 Cassandra Cluster with DataStax AMI

This AMI does the following: installs Cassandra 0.7.4 on a Ubuntu 10.10 image configures emphemeral disks in raid0, if applicable ( EBS is a bad fit for Cassandra configures Cassandra to use the root volume for the commitlog and the ephemeral disks for data files configures Cassandra to use the local interface for intra-cluster communication configures all Cassandra nodes with the same seed for gossip discovery

tags:Cassandra

via NoSQL databases

NoSQL: Scaling an RDBMS in 6 Steps

Scaling an RDBMS in 6 Steps

From Gavin Heavyside's slides :

via NoSQL databases

NoSQL: Open Large Datasets

Open Large Datasets

Quora thread listing over 50 sources of open large datasets. Combined with datasciencetoolkit.org and NoSQL databases these may lead to interesting experiments. Remember BigData doesn't necessarily need big budgets .

tags:BigData

via NoSQL databases

NoSQL: NoSQL Speed Bumps

NoSQL Speed Bumps

Dr.Doob's Ken North writes a history of NoSQL failures :

via NoSQL databases

NoSQL: Scale Fail

Scale Fail

Josh Berkus:

via NoSQL databases

NoSQL: Big and Small Data at Twitter: MySQL CE 2011

Big and Small Data at Twitter: MySQL CE 2011

Twitter DBA Lead at Twitter, Jeremy Cole 's talk about MySQL at Twitter from MySQL CE 2011:

tags:BigData

via NoSQL databases

NoSQL: Cloudera: An Operating System for BigData

Cloudera: An Operating System for BigData

From a must read Bloomberg article about BigData being used mainly for ads optimization:

tags:BigData,Hadoop

via NoSQL databases

NoSQL: Open-Source VoIP Cloud Services with Erlang

Open-Source VoIP Cloud Services with Erlang

There's a bit of CouchDB in the project:

tags:CouchDB

via NoSQL databases

NoSQL: riak_zab: ZooKeeper's Zab Protocol for Riak

riak_zab: ZooKeeper's Zab Protocol for Riak

Last night, Mark Phillips [1] sent me the following message:

tags:Riak

via NoSQL databases

NoSQL: Geolocation, Rails and MongoDB- a recipe for success

Geolocation, Rails and MongoDB- a recipe for success

'Geolocation' seems to be the best dish being served today. Every web-portal, every mobile app wants to be sensitive to a persons location. Everyone wants to see information that is 'relative' or location sensitive. Whether its a deal portal, travel portal, social network – giving users information that is relevant to their location bring not only a personalized touch but also keeps tuned in to the portal.

tags:MongoDB

via NoSQL databases

NoSQL: Nedis: Redis Implemented With Node

Nedis: Redis Implemented With Node

Nedis is a (partial) redis implementation written with node. Primarily for fun, however as our team grows larger, and as we add more non-technical team members over at LearnBoost I figured it would be nice help prevent the need for compiling development dependencies.

tags:Redis

via NoSQL databases

NoSQL: What are the major issues surrounding data ownership?

What are the major issues surrounding data ownership?

Jeff Jonas (IBM):

tags:BigData

via NoSQL databases

NoSQL: Using Solr and Hadoop as a NoSQL database

Using Solr and Hadoop as a NoSQL database

The combination of Hadoop and Solr makes it easy to crunch lots of data and then quickly serve up the results via a fast, flexible search & query API. Because Solr supports query-style requests, it's suitable as a NoSQL replacement for traditional databases in many situations, especially when the size of the data exceeds what is reasonable with a typical RDBMS.

tags:Hadoop

via NoSQL databases

NoSQL: Activity Feeds with Redis

Activity Feeds with Redis

The how:

tags:Redis

via NoSQL databases

NoSQL: Iris Couch: Your New Source for CouchDB Hosting

Iris Couch: Your New Source for CouchDB Hosting

Today, we are proud to introduce Iris Couch, a Couchbase spin-off and your new one-stop shop for hosted CouchDB. We are transferring the Couchbase hosting business to Iris Couch – a company founded and operated by the former Couchbase hosting team – and Iris Couch will focus solely on providing the rock-solid hosting service you deserve.

tags:CouchDB,Couchbase

via NoSQL databases

NoSQL: VMWare Cloud Foundry Storage Engines: MySQL, MongoDB, Redis

VMWare Cloud Foundry Storage Engines: MySQL, MongoDB, Redis

VMWare's acquisitions at work:

tags:MongoDB,Redis

via NoSQL databases

NoSQL: Netflix: Run Consistency Checkers All The Time To Fixup Transactions

Netflix: Run Consistency Checkers All The Time To Fixup Transactions

Todd Hoff about NoSQL and Cloud at Netflix :

tags:Cassandra,SimpleDB

via NoSQL databases

NoSQL: The First Weeks of MongoDB at IJENKO

The First Weeks of MongoDB at IJENKO

We have been testing MongoDB 1.8.0 in two different environments. The first, a quite powerful testing server and the second, a "lab-cluster" build from tiny Proxmox -instances

tags:MongoDB

via NoSQL databases

NoSQL: Videos from Surge Conference

Videos from Surge Conference

Even if not focused on NoSQL, the videos from the Surge conference are covering very interesting aspects related to scalability. Here are a couple of examples:

via NoSQL databases

NoSQL: The Data Deluge

The Data Deluge

The Economist in an issue from 2010:

tags:BigData

via NoSQL databases

NoSQL: The New SingleNode NoSQL Database

The New SingleNode NoSQL Database

The news today is brought to you by Milind Bhandarkar :

via NoSQL databases

NoSQL: Optimizing Memcached Performance on a Rapidly Growing Site

Optimizing Memcached Performance on a Rapidly Growing Site

Predicting operational growth by monitoring the correct metrics:

tags:memcached

via NoSQL databases

NoSQL: Why Should I Use MongoDB?

Why Should I Use MongoDB?

Kristina Chodorow answering the question why should I use MongoDB :

tags:MongoDB

via NoSQL databases

NoSQL: CouchDB Strengths

CouchDB Strengths

From someone that tried CouchDB and now is evaluating other document databases:

tags:CouchDB,MongoDB

via NoSQL databases

NoSQL: FlockDB and Graph Databases

FlockDB and Graph Databases

Michael Marr:

via NoSQL databases

NoSQL: Why NoSQL

Why NoSQL

Ramji Narasimhan:

via NoSQL databases

NoSQL: NoSQL Databases Updates: MongoDB and Redis

NoSQL Databases Updates: MongoDB and Redis

Two minor updates for MongoDB (1.8.1) and Redis (2.2.4). From the official announcement for MongoDB 1.8.1:

tags:MongoDB,Redis

via NoSQL databases

NoSQL: A Taxonomy of Data Science

A Taxonomy of Data Science

Hilary Mason [1] and Chris Wiggins [2] :

via NoSQL databases

NoSQL: R: What Is and How Can It Help?

R: What Is and How Can It Help?

From Loraine Lawson interview with Jeff Erhardt [1] .

via NoSQL databases

NoSQL: NewSQL: A New Term in Polyglot Persistence

NewSQL: A New Term in Polyglot Persistence

Matthew Aslett (The 451 Group):

via NoSQL databases

NoSQL: The Data Processing Platform for Tomorrow

The Data Processing Platform for Tomorrow

In the blue corner we have IBM with Netezza as analytic database, Cognos for BI, and SPSS for predictive analytics. In the green corner we have EMC with Greenplum and the partnership with SAS [1] . And in the open source corner we have Hadoop and R.

tags:BigData,Hadoop

via NoSQL databases

NoSQL: BigData and Comprehensive Profiling

BigData and Comprehensive Profiling

Daniel Hernandez:

tags:BigData

via NoSQL databases

NoSQL: The Big Data Revolution Will Affect Us From Head To Toe

The Big Data Revolution Will Affect Us From Head To Toe

Consider, for instance, the makers of Stride Rite shoes, who imagined in the book that when you went to the shoe store, a wireless device would measure your foot and the way you walk. It would select your shoe size, produce your shoe from parts the store had on-site, and share data about your foot with supply chain vendors, non-competing retailers, health-care providers and medical researchers.

tags:BigData

via NoSQL databases

NoSQL: Dealmaker Media: Data-as-a-Service Startups

Dealmaker Media: Data-as-a-Service Startups

If you are one of the many people out there searching for database solutions, we have found five companies that are providing answers to all your database problems in unique and innovative ways. Akiban Clustrix Hadapt NimbusDB RethinkDB

via NoSQL databases

NoSQL: RethinkDB: On TRIM, NCQ, and Write Amplication

RethinkDB: On TRIM, NCQ, and Write Amplication

Going full circle :

via NoSQL databases

NoSQL: Contrary to popular belief, SQL and noSQL are really just two sides of the same coin

Contrary to popular belief, SQL and noSQL are really just two sides of the same coin

Not sure why it took me so long to mention Erik Meijer and Gavin Bierman paper: "A Co-Relational Model of Data for Large Shared Data Banks":

via NoSQL databases

NoSQL: Consistency in the ACID and CAP Perspectives

Consistency in the ACID and CAP Perspectives

Following a tweet from Nathan Marz :

via NoSQL databases

NoSQL: Search over Key Value Storage

Search over Key Value Storage

Given all the complication, should we search over key value storage? It depends on nature of your problem domain. However if you do need to search over key value storage, it's not such a bad idea either :)

via NoSQL databases

NoSQL: Apixio Using Hadoop, Pig and Cassandra for Advanced Analytics on Medical Records

Apixio Using Hadoop, Pig and Cassandra for Advanced Analytics on Medical Records

Apixio uses Hadoop and Pig for analysing medical records and Cassandra for serving seach queries. All production machines are Amazon EC2 instances.

tags:Hadoop,Cassandra

via NoSQL databases

NoSQL: Cassandra Resiliency: How a data corruption problem made me more confident about Cassandra

Cassandra Resiliency: How a data corruption problem made me more confident about Cassandra

Gil Hildebrand (Squidoo):

tags:Cassandra

via NoSQL databases

NoSQL: Script for Launching a 100-node Riak Cluster

Script for Launching a 100-node Riak Cluster

Remember last week's discussion about administering and scaling up a Riak cluster on Amazon EC2 ? Reid Draper created a Python script to launch a 100-node Riak cluster:

tags:Riak

via NoSQL databases

NoSQL: Origin of BigData and How Hadoop Can Help

Origin of BigData and How Hadoop Can Help

Michael Olson [1] about origins of BigData in an interview on ODBMS Industry Watch :

tags:BigData,Hadoop

via NoSQL databases

NoSQL: RStudio: The Free and Open R IDE

RStudio: The Free and Open R IDE

For data scientists and not only: RStudio , the R IDE that runs on all major platforms or alongside R on a server and being accessible through a browser. Free and Open.

via NoSQL databases

NoSQL: MapReduce in MongoDB 1.8

MapReduce in MongoDB 1.8

Brendan W. McAdams has two posts — here and here — about the updates of MapReduce in MongoDB 1.8 and using Java and respectively Scala Casbah to working with MapReduce:

tags:MongoDB,MapReduce

via NoSQL databases

NoSQL: RDBMS Shortcomings and Band-Aids or What Lead to NoSQL

RDBMS Shortcomings and Band-Aids or What Lead to NoSQL

James Phillips' [1] version of what lead to NoSQL:

via NoSQL databases

NoSQL: Big Data and Storage Area Networks

Big Data and Storage Area Networks

John Webster reporting his learnings from the Structure Big Data event:

tags:BigData

via NoSQL databases

NoSQL: Hadapt and Why I'm doing a start-up pre-tenure

Hadapt and Why I'm doing a start-up pre-tenure

Daniel Abadi's [1] reasons for backing his HadoopDB research with the Hadapt startup :

via NoSQL databases

NoSQL: Citrix sprinkles apps magic on SQL, NoSQL data

Citrix sprinkles apps magic on SQL, NoSQL data

The Register:

via NoSQL databases

NoSQL: HP Mergers & Acquisitions: MongoDB Next?

HP Mergers & Acquisitions: MongoDB Next?

M&A speculations are on :

tags:MongoDB

via NoSQL databases

NoSQL: Four BigData Trends

Four BigData Trends

Jason Monberg (MarkLogic) distills what he heard at the last BigData conferences into four trends:

tags:BigData

via NoSQL databases

NoSQL: Riak and Scala at Yammer

Riak and Scala at Yammer

Coda Hale and Ryan Kennedy [1] presented recently about Riak and Scala usage at Yammer providing details about choosing Riak and sharing some of the leassons learned while using Riak for building Streamie.

tags:Riak

via NoSQL databases

NoSQL: MongoDB, NoSQL, and Web Scale with 10gen CTO Eliot Horowitz

MongoDB, NoSQL, and Web Scale with 10gen CTO Eliot Horowitz

From thechangelog podcast :

tags:MongoDB

via NoSQL databases

NoSQL: Stop Trying to Put a Monetary Value on Data - It's the Wrong Path

Stop Trying to Put a Monetary Value on Data - It's the Wrong Path

Rob Karel:

tags:BigData

via NoSQL databases

NoSQL: BigCouch Case Study: Research of Radition in Seattle

BigCouch Case Study: Research of Radition in Seattle

Cloudant's BigCouch database let the team keep up with a steady flow of data so it could process and analyze it, then share it with the various stakeholders in near-real-time. The team was changing the data about 20 times per day and writing complex workflows to process it, two tasks that fall into BigCouch's wheelhouse. The database has a built-in MapReduce engine to enable writing and processing the workflows, and it allows for secondary indices, which users can populate with new data from their MapReduce jobs and query very quickly.

via NoSQL databases

NoSQL: .NET Rocks Podcast about RavenDB

.NET Rocks Podcast about RavenDB

Carl and Richard talk to Oren Eini, aka Ayende Rahein, about RavenDB. RavenDB is a NoSQL JSON document database. Oren explains how he came to the realization that he needed to build his own data store, and the advantages of document databases over relational databases. Is SQL dead? Not hardly, but RavenDB is an interesting addition to your data solution!

tags:RavenDB

via NoSQL databases

NoSQL: The Birth of a Word: The Future of Data Science

The Birth of a Word: The Future of Data Science

Even if the name of this TED talk is "The birth of a word", I would have called it anything from the future of data science, extreme data analysis, and brilliant informatio visualization. Anyway, it is a must see:

via NoSQL databases