NoSQL: MongoDB Schema Design Goals

MongoDB Schema Design Goals

Roger Bodamer's slidedeck on designing schemas for MongoDB. A nice addition to our MongoDB schema design :

tags:mongodb

via NoSQL databases

NoSQL: Graph Databases: Moving Data from One Machine to Another

Graph Databases: Moving Data from One Machine to Another

I've seen the following question on the Neo4j mailing list: "how can you move a Neo4j database from a machine to another?" and I was wondering how are existing graph databases dealing with this problem having in mind most of them are embedded databases that do not necessarily focus on bulk import/export operations?

via NoSQL databases

NoSQL: More Memory or SSD?

More Memory or SSD?

From the "MySQL Performance Blog":

via NoSQL databases

NoSQL: Google: A Study in Scalability, MapReduce Evolution

Google: A Study in Scalability, MapReduce Evolution

Krishna Sankar has a ☞ great summary of a recent talk of Google's Jeff Dean on Google's systems and infrastructure:

tags:mapreduce

via NoSQL databases

NoSQL: Document-oriented Databases and Normalization

Document-oriented Databases and Normalization

Curt Monash ☞ in a recent post ( nb : reformatted for better readability):

via NoSQL databases

NoSQL: MongoDB Tip: Manual Shard Balancing

MongoDB Tip: Manual Shard Balancing

Every once in a while though, data chunks go out of balance. The Mongo team is working on making the auto-rebalancing a little more intelligent in future releases. In the meantime, you can manually move chunks around between shards to keep things in balance if needed.

tags:mongodb

via NoSQL databases

NoSQL: Build Your Mobile Back-End with MongoDB

Build Your Mobile Back-End with MongoDB

Will Shulman, from MongoLab, talking about mobile app development using MongoDB for the back-end.

tags:mongodb

via NoSQL databases

NoSQL: CouchDB for .NET Developers

CouchDB for .NET Developers

A presentation from the Norwegian Developer Conference 2010 covering the basics of CouchDB and how to interact with CouchDB from .NET applications. Video available ☞ here ( nb : I had to start the player and get back to watching it after a bit so it’d have time to buffer).

tags:couchdb

via NoSQL databases

NoSQL: Membase at FLOSS Weekly Podcast with James Phillips and Randal Schwartz

Membase at FLOSS Weekly Podcast with James Phillips and Randal Schwartz

Podcast of James Phillips [ 1 ] talking Membase with FLOSS weekly host Randal Schwartz. Podcast can be downloaded from ☞ here or listened to online on ☞ castroller.com .

tags:membase

via NoSQL databases

NoSQL: Intro to RavenDB

Intro to RavenDB

This weekend is the time to watch Oren Eini (aka Ayende Rahien), creator of RavenDB, talk about RavenDB.

tags:ravendb

via NoSQL databases

NoSQL: Hadoop Research Topics

Hadoop Research Topics

If you feel like starting to hack Hadoop, a list of interesting Hadoop improvements from Dhruba Borthakur [ 1 ] . Just a couple to wet your taste:

tags:hadoop

via NoSQL databases

NoSQL: CouchDB Incremental Backups

CouchDB Incremental Backups

you can just rsync or copy the files while CouchDB is running. Thanks to CouchDB's append-only file structure this is safe.

tags:couchdb

via NoSQL databases

NoSQL: Cassandra on EC2: A Presentation

Cassandra on EC2: A Presentation

After taking a look at the possible models of running both SQL and NoSQL in the cloud and the very, very detailed guide for Hadoop on EC2 , today is the time to check Dave Gardner's slides deck [ 1 ] answering questions like:

via NoSQL databases

NoSQL: HBase: Importing Large Data

HBase: Importing Large Data

Not sure how new/old these slides from Ryan Rawson [ 1 ] about importing large data into HBase are, but I'm pretty sure many newbies will find them useful:

tags:hbase

via NoSQL databases

NoSQL: CouchDB: Preview of New Documentation

CouchDB: Preview of New Documentation

Announced through a ☞ CouchOne blog post the new CouchDB documentation — currently the URL API docs — can be found ☞ here .

tags:couchdb

via NoSQL databases

NoSQL: Why the Cloudera - Membase partnership?

Why the Cloudera - Membase partnership?

For those scenarios that require both scalable low latency data access and batch analytics to complete the application's mission. This kind of hybrid, bidirectional data integration is the topological requirement of new applications – AOL Advertising and ShareThis are joint customers with these requirements. A Flume interface provides a streaming interface from Membase to Hadoop;  a Sqoop utility can be used for batch transfers between the two. Both of these utilities will be familiar to Hadoop watchers.

tags:membase

via NoSQL databases

NoSQL: New versions of Kyoto Cabinet and Kyoto Tycoon Released

New versions of Kyoto Cabinet and Kyoto Tycoon Released

In a post yesterday about NoSQL comparisons , I was asking when was the last Tokyo Cabinet release . It looks like from that family of products, the ones going forward are Kyoto Cabinet and Kyoto Tycoon as Mikio Hirabayashi ☞ has announced on Twitter the release of Kyoto Cabinet 1.2.5 and Kyoto Tycoon 0.9.9:

via NoSQL databases

NoSQL: SQL and NoSQL In the Cloud

SQL and NoSQL In the Cloud

Options of running RDBMSs in the cloud:

via NoSQL databases

NoSQL: Neo4j Transactions and JTA

Neo4j Transactions and JTA

I've already told you about ☞ Chris Gioran's series on Neo4j internals . Now, he is working on providing support for pluggable JTA compliant transaction managers in Neo4j and details about the current status can be found in his ☞ last post . Anyways, before that he started with a deep dive into the Neo4j transactions and that resulted in 4 (quite long) articles:

tags:neo4j

via NoSQL databases

NoSQL: Sybase: Distributed Shared-everything MPP Query Processing Architecture

Sybase: Distributed Shared-everything MPP Query Processing Architecture

Using an MPP shared-everything architecture, Sybase IQ 15.3 PlexQ Distributed Query Platform surpasses typical shared-nothing MPP architectures with better concurrency, self service ad-hoc queries, and independent scale out of compute and storage resources. With this architecture, PlexQ can exceed Service Level Agreements (SLAs) through simple and flexible resource provisioning that allows nodes to be grouped together as unified images that can be assigned to different application profiles.

via NoSQL databases

NoSQL: Why Comcast is Interested in NoSQL databases

Why Comcast is Interested in NoSQL databases

Fantastic presentation from Jon Moore on why Comcast (enterprises?) is not interested in NoSQL databases:

via NoSQL databases

NoSQL: Everybody Flumes

Everybody Flumes

Everyone is integrating with ☞ Flume , the distributed, reliable, and available service for collecting, aggregating, and moving large amounts of log data.

tags:mongodb,voldemort

via NoSQL databases

NoSQL: Is NoSQL for me? Persistence Ignorance Has Shifted

Is NoSQL for me? Persistence Ignorance Has Shifted

As Hadi Hariri is saying: persistence ignorance has shifted :

via NoSQL databases

NoSQL: Hadoop on EC2: A Detailed Guide

Hadoop on EC2: A Detailed Guide

Lars George, with his very (very) detailed style, explains step by step how to setup Hadoop on EC2.

tags:hadoop

via NoSQL databases

NoSQL: Intro to MongoDB Geospatial Queries

Intro to MongoDB Geospatial Queries

The post will walk you through creating the needed 2d index and executing geo queries using $near , $maxDistance , $box , $within , $box :

tags:mongodb

via NoSQL databases

NoSQL: The Protovis CouchApp

The Protovis CouchApp

So you have lots of data, you've made some nice views on that data in CouchDB and want to visualise it. Sure you could use some server side scripts to take the CouchDB view out and make a plot, but that's not cool these days.

tags:couchdb

via NoSQL databases

NoSQL: Another NoSQL Comparison: Evaluation Guide

Another NoSQL Comparison: Evaluation Guide

The requirements were clear :

tags:memcachedb,voldemort,redis,mongodb

via NoSQL databases

NoSQL: Riak Map/Reduce Improvements

Riak Map/Reduce Improvements

Kevin Smith [ 1 ] has recently given a presentation about a set of upcoming improvements to the Riak Map/Reduce implementation.

tags:riak,mapreduce

via NoSQL databases

NoSQL: MongoDB Cloud Hosting Compared

MongoDB Cloud Hosting Compared

Via Sérgio Santos:

tags:mongodb

via NoSQL databases

NoSQL: Cassandra: Idempotent Updates

Cassandra: Idempotent Updates

With Cassandra, the closest we get to a transaction is a "batch mutate", which allows us to submit multiple updates in one request. But while those updates are being applied, they can be immediately accessed by other applications. If our application (or Cassandra) crashes, there's no guarantee about which updates in the batch will succeed. Without ACID transactions, how do we prevent conflicts between applications? How do we recover if a crash occurs? One strategy is to design updates to be idempotent, which means that applying the same update twice produces the same results as applying the update once. In other words, if an update is successfully processed once, applying the same update again is essentially a no-op. As we'll see in a moment, this strategy not only simplifies restarts after a crash, it can prevent conflicts between multiple updaters.

via NoSQL databases

NoSQL: FuzzyTable is a large-scale, low-latency, parallel fuzzy-matching database built on Hadoop

FuzzyTable is a large-scale, low-latency, parallel fuzzy-matching database built on Hadoop

Interesting solution built on top of Hadoop:

tags:hadoop

via NoSQL databases

NoSQL: Basho Banjo: Distributed Orchestra Powered by Riak Core

Basho Banjo: Distributed Orchestra Powered by Riak Core

Basho Banjo is an experiment in using Riak Core to create a distributed orchestra powered by midi files. It serves as a simple example of how to create a distributed application with Riak Core.

tags:riak

via NoSQL databases

NoSQL: Suitability of NoSQL Solutions

Suitability of NoSQL Solutions

Monty Taylor:

via NoSQL databases

NoSQL: MongoDB Impressions

MongoDB Impressions

I've spent the past three days diving into MongoDB and jQuery. [ …] But the real attraction is the ability to work with syntax very similar to Javascript and JSON from client to server to database. Just better for my relatively weak, pan-fried brain.

tags:mongodb

via NoSQL databases

NoSQL: How to prepare for integrating new social media into proprietary software?

How to prepare for integrating new social media into proprietary software?

How does one prepare for and integrate the inclusion of new social media outlets into proprietary software when the shape and substance of those platform is not immediately available and has not yet been designed?? […] The second lies in abandoning the old traditional relational database structure, where appropriate, and embracing a more flexible and more adaptable document oriented database format, commonly referred to as NoSQL databases.  […] The advantage of the NoSQL format is that the data model does not need to be rigidly defined.  The DBMS assumes that the data is unstructured, and allows for a wide diversity of formats: media, pictures, text, documents, numbers, arrays of undetermined length, etc.  Data retrieval is lightening fast, and supported by a javascript query language (which interfaces with C++ drivers).  The genius and the beauty of such a system is that it accommodates very well additions and mutations to the data structure.  A field in any record, for instance could be an array of any type, and that array need not have the same size or even type as an array in the following record.  (To be precise, NoSQL DBMS refer to records as 'documents' and tables as 'collections'.)

via NoSQL databases

NoSQL: Puppet and CouchDB

Puppet and CouchDB

Starting in Puppet 2.6, its possible to store all facts in a couchdb database. […] Advantages: Facts can be aggregated to a separate service to be queried. We can now access a clients fact information using Couch's RESTful interface.

tags:couchdb

via NoSQL databases

NoSQL: My Sunday project using Node.js, Twilio, and Redis: TxtAtlas.com

My Sunday project using Node.js, Twilio, and Redis: TxtAtlas.com

Cool little project: send a text message and that get on a ☞ map . Source code available on ☞ GitHub and conversation on ☞ Reddit or ☞ HN .

tags:redis

via NoSQL databases

NoSQL: Goodbye Google App Engine (GAE)

Goodbye Google App Engine (GAE)

[…] developing on GAE introduced such a design complexity that working around it pushes us 5 months behind schedule. Now that we had developed tools and workarounds for all the problems we found in GAE, we were starting being fast with the development of features eventually, and at that point we found the cloud was totally unstable, doggy.

via NoSQL databases

NoSQL: RavenDB and CouchDB Compared

RavenDB and CouchDB Compared

A fair emphasis on what differentiates RavenDB from CouchDB ( nb coming from RavenDB creator). Just to mention the most interesting ones:

tags:couchdb,ravendb

via NoSQL databases

NoSQL: Scalability as a Discipline and Scalability Architects

Scalability as a Discipline and Scalability Architects

One of the missing disciplines, in my opinion, is the scalability architect or scalability as a discipline. While understanding the rules, patterns, and principles of scalability are completely achievable by anyone in the technology organization, this does not mean that they are widely known. Scalability architects would be more like evangelist and teachers rather than the gatekeepers of secret knowledge. Unlike DBA's or network engineers, whose jobs really aren't to educate any other technology person on how to create an index or open a port, the scalability architect would educate tech people. All other disciplines from software developers to DBA's could benefit from additional knowledge about scaling.

via NoSQL databases

NoSQL: CouchDB and the CouchOne Mobile Platform Podcast

CouchDB and the CouchOne Mobile Platform Podcast

A conversation with CouchOne's Aaron Miller [ 1 ] and Nitin Borwankar [ 2 ] about the CouchDB application environment and CouchOne efforts to port it to Android and more generally to mobile platforms. The mp3  ☞ hosted by IBM developerWorks website can be downloaded from ☞ here (mp3) .

tags:couchdb

via NoSQL databases

NoSQL: NoSQL and Django Panel Video

NoSQL and Django Panel Video

Featuring Jacob Burch, Alex Gaynor, Eric Florenzano, Jacob Kaplan-Moss, Michael Richardson, Noah Silas [ 1 ] :

via NoSQL databases

NoSQL: Video: Riak with Kevin Smith

Video: Riak with Kevin Smith

Weekend video: 30 minutes of Riak with Kevin Smith [ 1 ] :

tags:riak

via NoSQL databases

NoSQL: Paper: A Universal NoSQL Engine Using MUMPS Global Persistent Variables

Paper: A Universal NoSQL Engine Using MUMPS Global Persistent Variables

The guys behind GT.M (a system I've covered on rare occasions ) have published and tried to popularize a paper describing the usage of MUMPS Global Persistent Variables [ 1 ] to model and store the different types of NoSQL databases: key-value stores, columnar stores, document databases, and graph databases.

via NoSQL databases

NoSQL: CouchDB: An Introduction to Rewrites and Virtual Hosting

CouchDB: An Introduction to Rewrites and Virtual Hosting

Useful for normal usage of CouchDB, but mostly for CouchApps:

tags:couchdb

via NoSQL databases

NoSQL: InfiniteGraph for Mac OS X 1.0 Released

InfiniteGraph for Mac OS X 1.0 Released

After being available only on Windows and Linux, now InfiniteGraph has released a version for Mac OS X 64bit. You can get it from ☞ here . As far as I know the guys at InfiniteGraph are working on a friendlier licensing model for developers.

tags:infinitegraph

via NoSQL databases

NoSQL: Integrating VoltDB and Hadoop

Integrating VoltDB and Hadoop

A paper on integrating VoltDB and Hadoop. From what I read, for now it works on a single direction (exporting data from VoltDB to Hadoop):

tags:voltdb,hadoop

via NoSQL databases

NoSQL: Why We Love HBase: An Interview with Ryan Rawson

Why We Love HBase: An Interview with Ryan Rawson

A must read interview with Ryan Rawson [ 1 ] about HBase:

tags:hbase

via NoSQL databases

NoSQL: MongoDB: Dealing with Schema(less) Databases

MongoDB: Dealing with Schema(less) Databases

What I get with Mongo is a pretty organic type of database. I can add stuff as i need it without worrying about writing DML/DDL and managing that. […] Because it is such and unstructured system, I've built structure into it by creating an API which the application layer talks to. The rule is that if you need to talk to the DB, you talk via the API, not directly.

tags:mongodb

via NoSQL databases

NoSQL: ZooKeeper Promoted to Apache Top Level Project

ZooKeeper Promoted to Apache Top Level Project

ZooKeeper, the centralized service for maintaining configuration information, naming, providing distributed synchronization, and providing group services, that started under Hadoop umbrella has been promoted to an Apache Top Level Project, according to the ☞ report sent out by Doug Cutting.

via NoSQL databases

NoSQL: Neo4j High Availability Cluster

Neo4j High Availability Cluster

Neo4j uses the Master-Slave replication model. All writes must go through the master and the slaves will be read only. Changes performed on the master will be pushed out to the slaves when the logical log is rotated (based on configured size or invoking a method on the master). The online backup utility used to synchronize a destination Neo4j database from a source Neo4j database can be used to emulate "high availability" (HA) having the master replicating changes to read only slaves.

tags:neo4j

via NoSQL databases

NoSQL: PostgresSQL: How to Make it Faster

PostgresSQL: How to Make it Faster

I usually cross the line and post about RDBMS when there are interesting things that can be learned. Robert Hass explains some PostgreSQL knobs that can be turned to make things faster. But more interesting is what these knobs are doing: some are disabling fsync, others are disabling the write-ahead-log, others are making the commits asynchronous. Even more interesting is that all these knobs are in the end trading off durability for speed.

via NoSQL databases

NoSQL: HBase at Facebook and Why Not MySQL or Cassandra

HBase at Facebook and Why Not MySQL or Cassandra

Jeremiah Peschka on:

tags:hbase

via NoSQL databases

NoSQL: What real uses I could use CouchDB for? What can I use it for?

What real uses I could use CouchDB for? What can I use it for?

A must read:

tags:couchdb

via NoSQL databases

NoSQL: Talking with Jonathan Ellis, Co-Founder of Riptano

Talking with Jonathan Ellis, Co-Founder of Riptano

The Windows Azure blog publishes an interview with Jonathan Ellis [ 1 ] :

via NoSQL databases

NoSQL: CouchDB Case Study: Ataxo - Social Media Tracker

CouchDB Case Study: Ataxo - Social Media Tracker

New CouchDB case study from Ataxo Social Insider social network monitoring app:

tags:couchdb

via NoSQL databases

NoSQL: Basho and Gemini Mobile New Contributions to Erlang Cluster Management

Basho and Gemini Mobile New Contributions to Erlang Cluster Management

After riak_core — the refactored Riak core that can be used for building distributed apps without shared state , Basho is releasing now riak_err :

tags:riak

via NoSQL databases

NoSQL: Membase and Redis

Membase and Redis

Attila Kisko, author and maintainer of a Membase .NET client:

tags:membase,redis

via NoSQL databases

NoSQL: Names You Need to Know in 2011: R Data Analysis Software

Names You Need to Know in 2011: R Data Analysis Software

Steve McNally (Forbes):

via NoSQL databases

NoSQL: How does HBase write performance differ from write performance in Cassandra

How does HBase write performance differ from write performance in Cassandra

The answer(s) in the ☞ Quora thread . Make sure you expand and read all comments.

tags:hbase

via NoSQL databases

NoSQL: Notes from Cassandra by Example at Devoxx

Notes from Cassandra by Example at Devoxx

From David's notes on Jonathan Ellis' Cassandra by example presentation at Devoxx:

via NoSQL databases

NoSQL: Welcome to HBase!

Welcome to HBase!

When you need a really really big database, forget MySQL, Oracle, Access, HBase is your free tool

tags:HBase

via NoSQL databases

NoSQL: NoSQL databases Can Make or Break Your Project

NoSQL databases Can Make or Break Your Project

Jeremy Pinkham:

via NoSQL databases

NoSQL: Are databases in the cloud really all that different?

Are databases in the cloud really all that different?

Dave Rosenberg (CNET):

via NoSQL databases

NoSQL: Y! News: An inside look at rebuilding the largest news site on the web

Y! News: An inside look at rebuilding the largest news site on the web

Handling Yahoo! News data:

via NoSQL databases

NoSQL: Canonical and Riptano Partnering on Cassandra

Canonical and Riptano Partnering on Cassandra

Canonical, the company sponsoring Ubuntu, has announced a new round of partnership which also lists Riptano, the company offering Cassandra technical support, professional services, and training . The PR announcement can be found ☞ here .

via NoSQL databases

NoSQL: Tarantool/Silverbox: Another In-Memory Key-Value Store from Mail.Ru

Tarantool/Silverbox: Another In-Memory Key-Value Store from Mail.Ru

Mail.ru, one of the most popular Russian web sites, has open sourced ☞ Tarantool which among other components includes also (another) in-memory key-value store.

tags:memcached

via NoSQL databases

NoSQL: NoSQL Databases - The Trend for Databases in the Cloud?

NoSQL Databases - The Trend for Databases in the Cloud?

From a sys-con article [ 1 ] :

via NoSQL databases

NoSQL: Paper: Netflix's Transition to High-Availability Storage Systems

Paper: Netflix's Transition to High-Availability Storage Systems

A while ago, Sid Anand [ 1 ] has written a series of posts on challenges of a hybrid solution: Oracle - Amazon SimpleDB . This has become now a paper which offers a much better organized and detailed view on Netflix's transition to using a hybrid Oracle - Amazon Web Services (SimpleDB, S3) architecture.

tags:simpledb

via NoSQL databases

NoSQL: NoSQL: Don't Take the Drug Unless You Have the Symptoms

NoSQL: Don't Take the Drug Unless You Have the Symptoms

Nice comparison:

via NoSQL databases

NoSQL: Szl: A Compiler and Runtime for the Sawzall Language

Szl: A Compiler and Runtime for the Sawzall Language

Google open sourced szl an implementation of ☞ Sawzall :

via NoSQL databases

NoSQL: Szl: A Compiler and Runtime for the Sawzall Language

Szl: A Compiler and Runtime for the Sawzall Language

Google open sourced szl an implementation of ☞ Sawzall :

via NoSQL databases

NoSQL: Szl: A Compiler and Runtime for the Sawzall Language

Szl: A Compiler and Runtime for the Sawzall Language

Google open sourced szl an implementation of ☞ Sawzall :

via NoSQL databases

NoSQL: Redis at Smories

Redis at Smories

Smories is a Django app. Although the little server it runs on handles the spiky traffic fine I've been fiddling with Redis to prepare the site for when it eventually overtakes Facebook. I love Redis. It feels like a natural, ultra-performant extension to Python's easy way of handling data types.

tags:redis

via NoSQL databases

NoSQL: Microsoft coaches NoSQL options for Azure cloud

Microsoft coaches NoSQL options for Azure cloud

The Register writing about Microsoft initiative to bring NoSQL databases to the Azure cloud, Membase and MongoDB being mentioned in the article [ 1 ] :

tags:membase,memcached,mongodb

via NoSQL databases

NoSQL: MongoDB adapter for Hadoop

MongoDB adapter for Hadoop

If you want to join the BigData camp you need integration with Hadoop (or at least that's what many would be looking for). The still experimental/alpha version of ☞ mongo-hadoop project aims to provide a bidirectional MongoDB adapter for Hadoop. Let's see how far it gets.

tags:hadoop,mongodb

via NoSQL databases

NoSQL: Full text search with MongoDB and Lucene analyzers

Full text search with MongoDB and Lucene analyzers

Johan Rask:

tags:mongodb

via NoSQL databases

NoSQL: Efficient Large-Scale Graph Analysis with Hadoop

Efficient Large-Scale Graph Analysis with Hadoop

Michael Schatz [ 1 ] :

tags:hadoop,mapreduce

via NoSQL databases

NoSQL: MongoDB adapter for Hadoop

MongoDB adapter for Hadoop

If you want to join the BigData camp you need integration with Hadoop (or at least that's what many would be looking for). The still experimental/alpha version of ☞ mongo-hadoop project aims to provide a bidirectional MongoDB adapter for Hadoop. Let's see how far it gets.

tags:mongodb,hadoop

via NoSQL databases

NoSQL: Railo Cache Benchmark - CouchDB, MongoDB, RAM

Railo Cache Benchmark - CouchDB, MongoDB, RAM

They're all fast, but what amazes me is how little difference there is between RAM vs MongoDB performance!

tags:couchdb,mongodb

via NoSQL databases

NoSQL: A Study of Hadoop Developers from Karmasphere

A Study of Hadoop Developers from Karmasphere

Karmasphere, a a Big Data Intelligence (BDI) software company bringing Apache Hadoop power to developers and analysts, has published the results of a survey among Hadoop users. The report can be downloaded from ☞ here (PDF) .

tags:hadoop

via NoSQL databases

NoSQL: Redis: 3 Links

Redis: 3 Links

Three links I've missed and I think that should be here:

tags:redis

via NoSQL databases

NoSQL: Implementing a Social Graph using Redis

Implementing a Social Graph using Redis

We've seen before a Redis snippet for storing the social graph , this one in PHP:

tags:redis

via NoSQL databases

NoSQL: Grails/GORM for MongoDB

Grails/GORM for MongoDB

Our crusade to make GORM ubiquitous across NoSQL stores hit another milestones today as we are pleased to announce GORM for MongoDB.

tags:mongodb

via NoSQL databases

NoSQL: Facebook: The Underlying Technology of Messages Using HBase

Facebook: The Underlying Technology of Messages Using HBase

Cassandra, MySQL, and HBase were compared for the Facebook new messaging system . HBase was finally picked and is now behind the new product announced today:

tags:hbase

via NoSQL databases

NoSQL: Facebook Replacing Cassandra with HBase In New Messaging System

Facebook Replacing Cassandra with HBase In New Messaging System

Minutes ago Facebook hosted a press conference about their upcoming messaging system, a combination of email and IM [ 1 ] . There weren't many details about the technical solution, except one slide mentioning that while rebuilding the messaging solution:

tags:hbase

via NoSQL databases

NoSQL: Distributed Graph Databases and Usecases

Distributed Graph Databases and Usecases

Darren Wood [ 1 ] presentation containing a mix of details on distributed graph databases and graph databases use cases :

tags:infinitegraph

via NoSQL databases

NoSQL: Riak Core: Building Distributed Applications without Shared State

Riak Core: Building Distributed Applications without Shared State

A presentation about Riak core as building blocks of Dynamo-style distributed systems :

tags:riak

via NoSQL databases

NoSQL: Videos from Hadoop World

Videos from Hadoop World

There was one NoSQL conference that I've missed and I was really pissed off: Hadoop World. Even if I've followed and curated the Twitter feed, resulting in Hadoop World in tweets , the feeling of not being there made me really sad. But now, thanks to Cloudera I'll be able to watch most of the presentations. Many of them have already been published and the complete list can be found ☞ here .

tags:hadoop

via NoSQL databases

NoSQL: Casandra 0.6.7 Released

Casandra 0.6.7 Released

Getting closer to 0.7, Cassandra has released version 0.6.7. From the ☞ changelog :

via NoSQL databases

NoSQL: Podcast: Riak, Riak Search, GitHub with Basho

Podcast: Riak, Riak Search, GitHub with Basho

For the weekend or commute time: a conversation between Basho's Andy Gross and Mark Phillips and John Nunemaker on Riak , Riak search , and GitHub via ☞ the changelog . MP3 downloadable from ☞ here .

tags:riak

via NoSQL databases

NoSQL: Grails and NoSQL with Graeme Rocher and Scott Davis

Grails and NoSQL with Graeme Rocher and Scott Davis

It is weekend and so it’s time for videos and podcasts. Back in February, I wrote that, at the time, I could count 4  NoSQL plugins for Grails : CouchDB, HBase, Neo4j, AppEngine. In September, Grails added "official" support for Redis . Graeme talked about Grails/GORM for Redis with Jaxenter and community feedback was great .

via NoSQL databases

NoSQL: NoSQL, RDBMS, and The Innovator's Dilemma

NoSQL, RDBMS, and The Innovator's Dilemma

I was reading ☞ this post by Mark Suster explaining the innovator's dilemma, incumbent and new comers behavior in the market. And then I realized that it applies very well to the NoSQL databases market too:

via NoSQL databases

NoSQL: RavenDB: An Example of Polymorphic Collections

RavenDB: An Example of Polymorphic Collections

Mike Hadlow trying out RavenDB for dealing with inheritance and polymorphic queries:

tags:ravendb

via NoSQL databases

NoSQL: CouchDB Case Study: SkinnyBoard

CouchDB Case Study: SkinnyBoard

From another CouchDB usage story:

tags:couchdb

via NoSQL databases

NoSQL: Why Every Node in a Cassandra Cluster is the Same

Why Every Node in a Cassandra Cluster is the Same

An additional benefit — besides elasticity and fault tolerance — of having a single type of nodes in your cluster:

via NoSQL databases

NoSQL: The impact of document IDs on performance of CouchDB

The impact of document IDs on performance of CouchDB

One CouchDB trick that is probably not so well known:

tags:couchdb

via NoSQL databases

NoSQL: Membase: Quick Getting Started Videos

Membase: Quick Getting Started Videos

Two short videos on setting up ☞ a single Membase node (aprox.2 min) and ☞ a Membase cluster (aprox.3 min). As you can imagine this is just the very very basics. But on the other hand it is kind of cool to know that’s so easy to get it up and running.

tags:membase

via NoSQL databases

NoSQL: NoSQL Market to Reach $1.8bn by 2015

NoSQL Market to Reach $1.8bn by 2015

Relational database market is estimated at $20-$30bn/year:

via NoSQL databases

NoSQL: MongoDB Replica Sets

MongoDB Replica Sets

Even if MongoDB replica sets ☞ official documentation is quite good , that doesn't mean more coverage of the subject is not going to be useful.

tags:mongodb

via NoSQL databases

NoSQL: Benchmarks or Which is faster?

Benchmarks or Which is faster?

Evan Weaver answering a question on quora:

via NoSQL databases

NoSQL: Quick Reference: Hadoop Tools Ecosystem

Quick Reference: Hadoop Tools Ecosystem

Just a quick reference of the continuously growing Hadoop tools ecosystem.

tags:hadoop,mapreduce,hbase

via NoSQL databases

NoSQL: Data Science and Data Scientists

Data Science and Data Scientists

Hal Varian [ 1 ] said a couple of years ago [ 2 ] :

via NoSQL databases

NoSQL: Cassandra and ElasticSearch backends for Django-nonrel in development

Cassandra and ElasticSearch backends for Django-nonrel in development

Django continues his path towards NoSQL:

via NoSQL databases

NoSQL: Notes on data warehouse appliance prices

Notes on data warehouse appliance prices

Curt Monash:

via NoSQL databases

NoSQL: Video from A NOSQL Evening in Palo Alto

Video from A NOSQL Evening in Palo Alto

Besides all reports from a NOSQL evening in Palo Alto now we also have the video embedded below for your convenience.

via NoSQL databases

NoSQL: SQL vs NoSQL: Twinkle, Twinkle, NoSQL!

SQL vs NoSQL: Twinkle, Twinkle, NoSQL!

Story and script by Latha Annur Subramaniam:

via NoSQL databases

NoSQL: Understanding Cassandra Code Base

Understanding Cassandra Code Base

A bit old, but great read. And very useful diagrams:

via NoSQL databases

NoSQL: NoSQL Is ... SQL at Scale

NoSQL Is ... SQL at Scale

Cannot wonder what happened to Benjamin Black since it's only a couple of weeks since "yelling": "NoSQL took away the relational model and gave nothing back". But it looks like he came up with the answer:

via NoSQL databases

NoSQL: Why Redis? And Memcached, Cassandra, Lucene, ElasticSearch

Why Redis? And Memcached, Cassandra, Lucene, ElasticSearch

Why do we keep jumping from one storage engine to another? Can't we make up our minds already and settle with the "best" storage engine that meets our needs? In short, No. A common misconception is the belief that all storage engines are created equal, all designed to simply "store stuff" and provide fast access to your data. Unless your application performs one clearly defined simple task, it is a dire mistake to expect a single storage engine will effectively fulfill all of your data warehousing and processing needs.

tags:redis,memcached

via NoSQL databases

NoSQL: Measuring Redis SINTER/Set Intersection Performance

Measuring Redis SINTER/Set Intersection Performance

Redis ☞ SINTER (set intersection) operation benchmarked. An O(N * M) op:

tags:redis

via NoSQL databases

NoSQL: Membase Intro

Membase Intro

An intro slidedeck to Membase:

tags:membase

via NoSQL databases

NoSQL: MongoDB Indexing: An Optimization Primer

MongoDB Indexing: An Optimization Primer

Even if I've covered MongoDB Indexing and Indexes , now we have a video of Kyle Banker introducing MongoDB indexing:

tags:mongodb

via NoSQL databases

NoSQL: Ruby, Rails, and NoSQL: Cassandra, CouchDB, MongoDB

Ruby, Rails, and NoSQL: Cassandra, CouchDB, MongoDB

List of gems and brief installation notes and examples for using Cassandra, CouchDB, and MongoDB from Ruby on Rails:

tags:couchdb,mongodb

via NoSQL databases

NoSQL: Scaling Out CouchDB with BigCouch

Scaling Out CouchDB with BigCouch

While CouchOne is focused on getting CouchDB on the mobiles — CouchDB is available on Android and probably coming to iOS , Cloudant, the other CouchDB oriented company, is focused on CouchDB horizontal scalability by providing as open source and hosting BigCouch .

tags:couchdb

via NoSQL databases

NoSQL: CouchDB Case Study: Dimagi - CouchDB Replication at Work

CouchDB Case Study: Dimagi - CouchDB Replication at Work

From the Dimagi CouchDB success story:

tags:couchdb

via NoSQL databases

NoSQL: Memcached/Membase: Writing Your Own Storage Engine

Memcached/Membase: Writing Your Own Storage Engine

Not sure how many will need to implement their own storage engine, but knowing there're a couple of projects that support pluggable engines ( Project Voldemort , Riak ) it might be that for special scenarios special engines could perform better. Now you can learn how to do it for Membase :

tags:membase,memcached

via NoSQL databases

NoSQL: OpenTSDB: A HBase Scalable Time Series Database

OpenTSDB: A HBase Scalable Time Series Database

OpenTSDB: a distributed, scalable monitoring system on top of HBase :

tags:hbase

via NoSQL databases

NoSQL: Hadoop Best Practices and Anti-Patterns

Hadoop Best Practices and Anti-Patterns

An extensive post about Hadoop best practices and anti-patterns from Yahoo!:

tags:hadoop

via NoSQL databases

NoSQL: Redis 2.0.4: Non Critical Bug Fixes

Redis 2.0.4: Non Critical Bug Fixes

Speaking of releases , Redis has announced version 2.0.4, a minor bug fix release:

tags:redis

via NoSQL databases

NoSQL: VoltDB Release: Version 1.2 Featuring Data Availability Enhancements

VoltDB Release: Version 1.2 Featuring Data Availability Enhancements

VoltDB 1.2 released earlier this month:

via NoSQL databases

NoSQL: Riak SmartMachine Benchmark: The Technical Details

Riak SmartMachine Benchmark: The Technical Details

Remember the Riak in the Joyent cloud benchmark ? There's a post providing many more details about the tests run:

tags:riak

via NoSQL databases

NoSQL: Notes from the MongoBerlin Conference

Notes from the MongoBerlin Conference

At least 6 MongoDB talks summarized on topics like: BRAINREPUBLIC MongoDB case study, MongoDB internals, MongoDB indexing and query optimizer, MongoDB sharding internals, MongoDB replication internals, and scaling with MongoDB. I've found the ones on MongoDB internals quite interesting:

tags:MongoDB

via NoSQL databases

NoSQL: eBay, Hadoop, HBase

eBay, Hadoop, HBase

From ☞ DBMS2 :

tags:hadoop,hbase

via NoSQL databases

NoSQL: Extending Business Intelligence with Graph Analytics

Extending Business Intelligence with Graph Analytics

But there are things most of these tools can't do, and that is analyze data when it's structured as a graph or network and when that data must be analyzed by traversing the graph. […] This problem can't be solved by simply summarizing data, nor does it have anything to do with predicting. Instead, the data must be organized as a graph and a tool must be able to traverse that graph; it has to be able "walk" from node to node. And today, this is not a feature found in most reporting and analytical tools.

via NoSQL databases

NoSQL: FameTown - A New AWS-Powered Facebook Game Using Membase

FameTown - A New AWS-Powered Facebook Game Using Membase

Any particular reason for Membase appearing mostly in game usecases? Or is it more like: "if Zynga is using Membase , then we will too"?

tags:membase

via NoSQL databases

NoSQL: Using Map-Reduce in a MongoDB Based Application

Using Map-Reduce in a MongoDB Based Application

This works fine, but there are a few issues with it: The map-reduce is run every time the page is hit. Since a variation of this method is used to provide a list of common tags for the home page of the site, this is definitely less than ideal. When a map-reduce function is run in MongoDB, by default the results are stored in a temporary collection which is cleaned up once the connection to MongoDB is closed, or when it is explicitly dropped – which I am not doing. Like the above issue, having to explicitly delete the collection on every page hit seems like excessive work. However leaving it as I currently am causes all these temporary collections to build up whilst the site is running. What a waste of space.

tags:mongodb,mapreduce,couchdb

via NoSQL databases

NoSQL: Oracle Drops InnoDB from MySQL Classical Edition, But Not From Community Edition

Oracle Drops InnoDB from MySQL Classical Edition, But Not From Community Edition

I have heard many mentioning that Oracle removed InnoDB from the MySQL classical edition version. Now, I don't know too much about the various versions and licenses of MySQL — it looks like there are at least 5: enterprise, classical, standard, cluster carrier grade, and community — but InnoDB doesn't seem to have been dropped from the community edition too. So, I'm not really sure this is such a big deal. [ 1 ]

via NoSQL databases

NoSQL: HBase and Hadoop: How StumbleUpon Built an Advertising Platform

HBase and Hadoop: How StumbleUpon Built an Advertising Platform

Jean-Daniel Cryans presentation from Hadoop World on mixing real-time needs and batch processing for building an advertising platform using HBase and Hadoop:

tags:hbase,hadoop

via NoSQL databases

NoSQL: Hadoop: Solving Unsolvable Problems

Hadoop: Solving Unsolvable Problems

Abhishek Mehta [ 1 ] :

tags:hadoop

via NoSQL databases

NoSQL: Terrastore and ElasticSearch to Replace MySQL, Memcached and Sphinx

Terrastore and ElasticSearch to Replace MySQL, Memcached and Sphinx

Currently we are using PHP, MySQL, Sphinx, and Memcached to serve up pages so quick. […] […] Our (MY) final decision was to use Terrastore. I'm not sure if it is the fastest, but it is fast. The main reason is how easy it is to scale with growth, how well it protects the data and keeps multiple copies always available, and the fast release cycle which means it is always improving. As a replacement for Sphinx , we have considered many, but have landed on ElasticSearch, which just so happens to have a direct integration with Terrastore. A no-brainer for us to choose ElasticSearch for our search and ranking algorithms.

tags:terrastore,memcached

via NoSQL databases

NoSQL: MongoDB: When would you need more than 7 replica set members?

MongoDB: When would you need more than 7 replica set members?

From BoxedIce experience:

tags:mongodb

via NoSQL databases

NoSQL: Big Data and NoSQL March to the Enterprise

Big Data and NoSQL March to the Enterprise

On GigaOm the other day NoSQL was gone already , now it is cool again:

via NoSQL databases

NoSQL: Presentations from NOSQL Afternoon in Japan

Presentations from NOSQL Afternoon in Japan

The Palo Alto NoSQL event has been followed by one in Japan called NOSQL afternoon in Japan. Thanks to ☞ Gemini Mobile Technology blog I have found links to the video recordings from the event:

via NoSQL databases

NoSQL: Pylons & MongoDB: User Registration & Login

Pylons & MongoDB: User Registration & Login

For Pylons users:

tags:mongodb

via NoSQL databases

NoSQL: We are experiencing too much load. Let's add a new server.

We are experiencing too much load. Let's add a new server.

There's this idea floating around that we can scale out our data services "just in time". Proponents of cloud computing frequently tout this as an advantage of such a platform. Got a load spike? No problem, just spin up a few new instances to handle the demand. It's a great sounding story, but sadly, things don't quite work that way.

via NoSQL databases

NoSQL: Real-Time MapReduce

Real-Time MapReduce

Yahoo! Labs! Advertising Sciences has built a general-purpose, real-time, distributed, fault-tolerant, scalable, event driven, expandable platform called S4 which allows programmers to easily implement applications for processing continuous unbounded streams of data.

tags:hadoop,mapreduce

via NoSQL databases

NoSQL: Search Analytics with Flume and HBase

Search Analytics with Flume and HBase

In the last week, I've seen 3 articles or presentations on using Hadoop-based searches :

tags:hbase,mapreduce

via NoSQL databases

NoSQL: Graph Databases to Standardize on an API

Graph Databases to Standardize on an API

Are graph databases going to standardize on a common API? It's still early to say, but it looks like some are making small steps towards it:

via NoSQL databases

NoSQL: Apache Hadoop and HBase

Apache Hadoop and HBase

Todd Lipcon's [ 1 ] slides from the NOSQL afternoon in Japan — the japanese version of the NOSQL evening in Palo Alto event:

tags:hadoop,hbase

via NoSQL databases

NoSQL: Why There Won't Be a LAMP For Big Data

Why There Won't Be a LAMP For Big Data

Redmonk:

via NoSQL databases

NoSQL: Redis and Memcached Benchmarks

Redis and Memcached Benchmarks

A long and interesting discussion on comparing Redis and Memcached performance. It all started ☞ here :

tags:redis,memcached

via NoSQL databases

NoSQL: Large-scale Incremental Processing Using Distributed Transactions and Notifications

Large-scale Incremental Processing Using Distributed Transactions and Notifications

From Daniel Peng and Frank Dabek paper ( ☞ PDF ):

via NoSQL databases

NoSQL: MongoDB Tricks: count() operation

MongoDB Tricks: count() operation

From a ☞ thread on MongoDB group :

tags:mongodb

via NoSQL databases

NoSQL: Hadoop and Elastic MapReduce at Yelp

Hadoop and Elastic MapReduce at Yelp

A story of using Hadoop at Yelp and migrating it to Amazon Elastic MapReduce:

tags:mapreduce,hadoop

via NoSQL databases

NoSQL: Using MySQL as NoSQL: A Story for exceeding 750k qps

Using MySQL as NoSQL: A Story for exceeding 750k qps

How many times do you need to run PK lookups per second? […] These are "SQL" overhead. It's obvious that performance drops were caused by mostly SQL layer, not by "InnoDB(storage)" layer. MySQL has to do a lot of things like below while memcached/NoSQL do not neeed to do. Parsing SQL statements Opening, locking tables Making SQL execution plans Unlocking, closing tables MySQL also has to do lots of concurrency controls.

tags:voldemort,riak,voltdb

via NoSQL databases

NoSQL: Spring Framework Goes NoSQL with Spring Data

Spring Framework Goes NoSQL with Spring Data

Spring frameworks feels like be all do all these days. On the other hand, having NoSQL databases integrated with Spring framework my actually represent an opportunity to penetrate the enterprise world.

tags:neo4j

via NoSQL databases

NoSQL: Designing algorithms for Map Reduce

Designing algorithms for Map Reduce

Another must read from Ricky Ho:

tags:mapreduce

via NoSQL databases

NoSQL: NoSQL databases, Unix Zen, and Taco Bell Programming

NoSQL databases, Unix Zen, and Taco Bell Programming

Recently I've written that NoSQL databases should follow the Unix philosophy . Ted Dziuba, with his metaphoric style, is writing:

via NoSQL databases

NoSQL: CouchDB: A Great Option for Mobile Computing

CouchDB: A Great Option for Mobile Computing

Even if Krishnan Subramanian's title is CouchDB and SaaS, he got the part about CouchDB and mobile development right:

tags:couchdb

via NoSQL databases

NoSQL: MongoDB Replica Sets

MongoDB Replica Sets

Very good coverage of the MongoDB replica sets from Pramod Sadalage:

tags:mongodb

via NoSQL databases

NoSQL: Hadoop at Twitter: An Interview with Kevin Weil, Twitter Analytics Lead

Hadoop at Twitter: An Interview with Kevin Weil, Twitter Analytics Lead

Kevin Weil [ 1 ] in an interview about Twitter's usage of Hadoop:

tags:hadoop,hbase,mapreduce

via NoSQL databases

NoSQL: Neo4j and OrientDB Performance Compared

Neo4j and OrientDB Performance Compared

Sort of a benchmark based on running the ☞ TinkerPop test suite against Neo4j and OrientDB ( nb : we've learned recently that OrientDB is a document-graph database ).

tags:neo4j,orientdb

via NoSQL databases