mindstorms

A thorough post from Trend Micro Hadoop Group (Mingjie Lai, Eugene Koontz, Andrew Purtell) explaining all details of HBase coprocessors included in the latest HBase release 0.92.0 :

tags:hbase,coprocessor

via NoSQL databases

NoSQL: How to Hadoop: Maximizing the value of big data

2012-02-01T14:27:00.001+02:00

How to Hadoop: Maximizing the value of big data

Brian Christian 1 (Zettaset) suggests two roads for adopting Hadoop:

tags:hadoop,bigdata,zettaset

via NoSQL databases

NoSQL: Why NoSQL Databases Are Not Just For Google and Amazon?

2012-02-01T13:27:00.003+02:00

Why NoSQL Databases Are Not Just For Google and Amazon?

Oren Eini 1 :

tags:nosql databases,nosql theory

via NoSQL databases

NoSQL: Column vs Row Stores: How do they compare?

2012-02-01T13:27:00.001+02:00

Column vs Row Stores: How do they compare?

Yesterday I've asked on Twitter about technical papers looking at column-stores vs row-stores. Most of the answers I've got are pointing to the research done by Daniel Abadi : Papers and Technical Reports . I'll start with:

tags:column-store,row-store,nosql theory

via NoSQL databases

NoSQL: Amazon Elastic MapReduce New Features: Metrics, Updates, VPC, and Cluster Compute Support

2012-02-01T12:28:00.003+02:00

Amazon Elastic MapReduce New Features: Metrics, Updates, VPC, and Cluster Compute Support

Starting today customers can view graphs of 23 job flow metrics within the EMR Console by selecting the Monitoring tab in the Job Flow Details page. These metrics are pushed CloudWatch every five minutes at no cost to you and include information on: Job flow progress including metrics on the number of map and reduce tasks running and remaining in your job flow and the number of bytes read and written to S3 and HDFS. Job flow contention including metrics on HDFS utilization, map and reduce slots open, jobs running, and the ratio between map tasks remaining and map slots. Job flow health including metrics on whether your job flow is idle, if there are missing data blocks, and if there are any dead nodes.

tags:elastic mapreduce,hadoop,mapreduce,aws,monitoring,hive,pig

via NoSQL databases

NoSQL: MongoDB at GOV.UK: The Power of the Document Model

2012-02-01T12:28:00.001+02:00

MongoDB at GOV.UK: The Power of the Document Model

The alpha version of GOV.UK was using MySQL and PostgreSQL. GOV.UK beta is based on Amazon RDS (MySQL) and MongoDB. In there words :

tags:mongodb,document database,gov.uk,powered by mongodb

via NoSQL databases

NoSQL: Neo4j on Heroku: Building a Movie Recommendation Website for $0.00

2012-02-01T12:27:00.001+02:00

Neo4j on Heroku: Building a Movie Recommendation Website for $0.00

Recently Max de Marzi has published sort of a getting started with Neo4j on Heroku guide. Here is how Max described it:

tags:neo4j,heroku,gremlin,ruby

via NoSQL databases

NoSQL: Where Does Xeround Fit In The Cap Theorem?

2012-02-01T01:27:00.001+02:00

Where Does Xeround Fit In The Cap Theorem?

Itamar Haber over the Xeround blog:

tags:xeround,cap,mysql,database as a service,daas

via NoSQL databases

NoSQL: Vertica and Hadoop for Big Data

2012-01-31T21:27:00.001+02:00

Vertica and Hadoop for Big Data

Here is what I've jotted down during Vertica's webinar Hadoop vs. RDBMS for Big Data Analytics: Why Choose?

tags:vertica,hadoop,bigdata

via NoSQL databases

NoSQL: NoSQL Tutorial: Setting Up a Hadoop Cluster with MongoDB Support on EC2

2012-01-31T01:27:00.001+02:00

NoSQL Tutorial: Setting Up a Hadoop Cluster with MongoDB Support on EC2

A complete and detailed guide for setting up a Hadoop cluster using MongoDB by Arten Yankov. It uses the MongoDB Hadoop adapter mongo-hadoop , which provides input and output adapters, support for InputSplits, and write-only Pig.

tags:hadoop,mongodb,aws,ec2,nosql library

via NoSQL databases

NoSQL: 5 Key Elements for a Firehose Data System

2012-01-30T17:27:00.003+02:00

5 Key Elements for a Firehose Data System

The 5 key elements for a firehose data system as per a presentation by Josh Berkus, CEO of PostgreSQL Experts Inc. summarized by Brian Proffitt on ITworld :

tags:nosql theory,bigdata

via NoSQL databases

NoSQL: MongoDB Tips and Tricks: More Reads Make For Faster Writes

2012-01-30T17:27:00.001+02:00

MongoDB Tips and Tricks: More Reads Make For Faster Writes

The trick to lowering your lock percentage and thus having faster updates is to query the document you are going to update, before you perform the update. Querying before doing an upsert might seem counter intuitive at first glance, but it makes sense when you think about it. The read ensures that whatever document you are going to update is in RAM. This means the update, which will happen immediately after the read, always updates the document in RAM, which is super fast. I think of it as warming the database for the document you are about to update.

tags:mongodb

via NoSQL databases

NoSQL: History of Couch Projects

2012-01-30T16:27:00.003+02:00

History of Couch Projects

Just in case you thought someone made up the whole thing about the status of CouchDB being confusing :

tags:lotus notes,couchdb,couchone,couchbase,membase,northscale,memcached

via NoSQL databases

NoSQL: Powered by Hadoop and Hive: Budgeting for snow removal in your local community

2012-01-30T16:27:00.001+02:00

Powered by Hadoop and Hive: Budgeting for snow removal in your local community

I don't know how I ended up becoming the head of our local community association. Anyhow, I'm now responsible for laying out next year's budget. Most of our expenses seem to be fixed from one year to another, but then there's the expense for the snow removal service. This year, no snow. Last year, most snow on record in 30 years! How do you budget for something as volatile as snow? I need more data! Instead of just googling the answer, we're going to fetch some raw data and feed it into Hadoop Hive.

tags:hadoop,hive,powered by nosql

via NoSQL databases

NoSQL: MongoDB Replica Sets and Sharding for GridFS as a Distributed File System

2012-01-30T15:28:00.001+02:00

MongoDB Replica Sets and Sharding for GridFS as a Distributed File System

Contrary to many MongoDB deployments, we primarily use it for storing files in GridFS. We switched over to MongoDB after searching for a good distributed file system for years. Prior to MongoDB we used a regular NFS share, sitting on top of a HAST-device. That worked great, but it didn't allow us to scale horizontally the way a distributed file system allows.

tags:mongodb,gridfs,distributed file system

via NoSQL databases

NoSQL: PHP and MongoDB Tutorial

2012-01-30T15:27:00.003+02:00

PHP and MongoDB Tutorial

Derick Rethans's 1 slides are a good MongoDB tutorial for PHP developers covering most of the API.

tags:mongodb,mongodb nosql tutorial,php

via NoSQL databases

NoSQL: Hybrid Word Aligned Bitmaps: Why are column oriented databases so much faster than row oriented databases? -

2012-01-30T15:27:00.001+02:00

Hybrid Word Aligned Bitmaps: Why are column oriented databases so much faster than row oriented databases? -

Terence Siganakis:

tags:nosql theory,column oriented database,bitmap,indexing,fastbit

via NoSQL databases

NoSQL: Analysts' Predictions for Hadoop Market

2012-01-27T17:26:00.003+02:00

Analysts' Predictions for Hadoop Market

With so many players in the market [1] , it's easy to see that not all of them will flourish. IDC has predicted that this year will see a lot of merger and acquisition activity as large technology companies rush to buy smaller companies with expertise in big data. By 2015, the analysts say it's likely that none of the current "major players" in the Hadoop market will still exist.

tags:hadoop,market analysis

via NoSQL databases

NoSQL: MapReduce With Hadoop: What Happens During Mapping

2012-01-27T17:26:00.001+02:00

MapReduce With Hadoop: What Happens During Mapping

An interesting look at what happens during the map phase in Hadoop and the impact of emitting key-value pairs:

tags:hadoop,mapreduce,performance

via NoSQL databases

NoSQL: NoSQL Books: Riak Handbook and the Little Redis Book

2012-01-27T13:26:00.003+02:00

NoSQL Books: Riak Handbook and the Little Redis Book

A couple of recent books that I'll be adding to the list of NoSQL books :

tags:nosql guide,nosql tutorial,nosql books

via NoSQL databases

NoSQL: MoreSQL: No More NoSQL

2012-01-27T13:26:00.001+02:00

MoreSQL: No More NoSQL

We at MoreSQL believe in the following axioms: Universal Applicability: there is no such thing as a problem which cannot be solved with relational databases. It doesn't matter what you're storing or how you need to use it. Tabular structures (which may or may not be linked via foreign keys) are the only way to go. End of discussion. Ends Justify Means: as corollary to axiom 1, we will do whatever it takes to make SQL work for us. Views, stored procedures, cross-database calls: you name it, we'll do it. Oh and by the way, using ORMs does not mean that you're trying to shove a round peg into a square hole. They are beautiful and enchanting, OK? Scale, shmale: relational databases can scale well enough. I mean, Facebook is running on MySQL, for crying out loud! Are you better than Facebook and its 10 trillion active users? I didn't think so.

tags:nosql future,fun

via NoSQL databases

NoSQL: Measuring User Retention With Hadoop and Hive

2012-01-27T12:26:00.001+02:00

Measuring User Retention With Hadoop and Hive

A very practical example of how Hive and Hadoop could deliver value when applied to clickstreams, the most common data for each web property:

tags:hadoop,hive,nosql tutorial

via NoSQL databases

NoSQL: The History of NoSQL: This Was Not Our Technology Vendors' Fault

2012-01-26T23:26:00.001+02:00

The History of NoSQL: This Was Not Our Technology Vendors' Fault

Werner Vogel in the post about Amazon DynamoDB :

tags:nosql databases,nosql theory

via NoSQL databases

NoSQL: Big Data Is More Than Hadoop

2012-01-26T15:26:00.003+02:00

Big Data Is More Than Hadoop

David Menninger commenting the results of a Big Data survey run by Ventana Research:

tags:bigdata,hadoop

via NoSQL databases

NoSQL: Mavuno: A Hadoop-Based Text Mining Toolkit

2012-01-26T15:26:00.001+02:00

Mavuno: A Hadoop-Based Text Mining Toolkit

Mavuno is an open source, modular, scalable text mining toolkit built upon Hadoop. It supports basic natural language processing tasks (e.g., part of speech tagging, chunking, parsing, named entity recognition), is capable of large-scale distributional similarity computations (e.g., synonym, paraphrase, and lexical variant mining), and has information extraction capabilities (e.g., instance and semantic relation mining). It can easily be adapted to new input formats and text mining tasks.

tags:mavuno,hadoop,mahout,text mining

via NoSQL databases

NoSQL: Using Amazon Elastic MapReduce With DynamoDB: NoSQL Tutorials

2012-01-26T14:26:00.001+02:00

Using Amazon Elastic MapReduce With DynamoDB: NoSQL Tutorials

Adam Gray [1] :

tags:elastic mapreduce,dynamodb,aws,amazon

via NoSQL databases

NoSQL: 12 Hadoop Vendors to Watch in 2012

2012-01-25T16:26:00.001+02:00

12 Hadoop Vendors to Watch in 2012

My list of 8 most interesting companies for the future of Hadoop didn't try to include anyone having a product with the Hadoop word in it. But the list from InformationWeek does. To save you 15 clicks, here's their list:

tags:hadoop,amazon,cloudera,greenplum,hadapt,datameer,ibm,informatica,karmasphere,mapr,microsoft,oracle,elastic mapreduce,cloudera,emc,greenplum,unified analytics platform,data computing appliance,infosphere biginsights,hparser

via NoSQL databases

NoSQL: More Details About Apache HBase 0.92.0

2012-01-24T17:26:00.001+02:00

More Details About Apache HBase 0.92.0

Jonathan Hsieh provides a summary of the new features in HBase 0.92.0 by splitting them into user features :

tags:hbase,nosql releases

via NoSQL databases

NoSQL: Google Research: Let's Make TCP Faster

2012-01-24T14:26:00.001+02:00

Google Research: Let's Make TCP Faster

Google is actively researching ways to improve TCP:

tags:nosql theory,latency

via NoSQL databases

NoSQL: A Cost Analysis of DynamoDB for Tarsnap

2012-01-24T12:26:00.003+02:00

A Cost Analysis of DynamoDB for Tarsnap

Tarsnap is a service offering secure online backups. Colin Percival details the costs Tarsnap would have for using Amazon DynamoDB:

tags:dynamodb,amazon,nosql market,tarsnap,aws,s3

via NoSQL databases

NoSQL: Apache Hadoop 1.0 Doesn’t Clear Up Trunks and Branches Questions. Do Distributions?

2012-01-24T12:26:00.001+02:00

Apache Hadoop 1.0 Doesn't Clear Up Trunks and Branches Questions. Do Distributions?

It looks like the three pictures about Hadoop versions — first two by Cloudera and the third by Konstantin I. Boudnik & Cos —are actually worth 1066 Gartner words .

tags:hadoop,cloudera,hortonworks

via NoSQL databases

NoSQL: Introducing Amazon DynamoDB Slidesdeck

2012-01-24T10:26:00.003+02:00

Introducing Amazon DynamoDB Slidesdeck

An official slidedeck to introduce Amazon DynamoDB to your team. My notes about DynamoDB could be a nice addition.

tags:dynamodb,amazon

via NoSQL databases

NoSQL: Latest NoSQL Releases: HBase 0.92, DataStax Community Server, Hortonworks Data Platform, SolrCloud

2012-01-24T10:26:00.001+02:00

Latest NoSQL Releases: HBase 0.92, DataStax Community Server, Hortonworks Data Platform, SolrCloud

Just a quick roundup of the latest releases and announcements.

tags:nosql releases,hbase,datastax community server,cassandra,hdp,hortonworks,solrcloud,solr

via NoSQL databases

NoSQL: Solr Index Replication at Etsy: From HTTP to BitTorrent

2012-01-23T22:26:00.001+02:00

Solr Index Replication at Etsy: From HTTP to BitTorrent

Etsy went from using HTTP to BitTorrent for replicating Solr indexes:

tags:solr,bittorrent,etsy,replication

via NoSQL databases

NoSQL: Jelastic Database Marketshare: MySQL, MongoDB, MariaDB

2012-01-23T18:26:00.001+02:00

Jelastic Database Marketshare: MySQL, MongoDB, MariaDB

Jelastic, a company offering a cloud platform for Java server hosting, has published some stats about the databases used by their over 7000 users:

tags:nosql market,mysql,postgresql,mariadb,mongodb,couchdb

via NoSQL databases

NoSQL: MapR's Map-Reduce Ready Disitributed File System Patent Filing

2012-01-23T16:26:00.005+02:00

MapR's Map-Reduce Ready Disitributed File System Patent Filing

Here's the abstract of the patent filing submitted by MapR's for a Map-Reduce Ready Distributed File System:

tags:mapr,mapreduce,file system

via NoSQL databases

NoSQL: Couchbase: Clarifying Confusions in 5 Bullet Points

2012-01-23T16:26:00.003+02:00

Couchbase: Clarifying Confusions in 5 Bullet Points

Here are the 5 bullet points that would helped Couchbase clarify all the confusion about Couchbase, Membase, CouchDB:

tags:couchbase,membase,couchdb

via NoSQL databases

NoSQL: Couchbase Server 1.8 Released, Rebranding and Some Improvements in Cluster Rebalancing

2012-01-23T16:26:00.001+02:00

Couchbase Server 1.8 Released, Rebranding and Some Improvements in Cluster Rebalancing

Couchbase Server 1.8 replaces Membase Server 1.7 as our "flagship" database offering. In addition to the obvious rebranding, we've made substantial improvements in the cluster rebalancing process and fixed a number of nagging issues in 1.7.

tags:membase,couchbase,nosql releases

via NoSQL databases

NoSQL: NoSQL Tutorials: Getting Started With Cassandra

2012-01-23T14:26:00.001+02:00

NoSQL Tutorials: Getting Started With Cassandra

All the basic steps of installing Cassandra, creating a keyspace and column families, inserting and manipulating data, querying data with CQL on a single page. Even if a bit old, you could continue next with my tutorial on getting started with Cassandra .

tags:cassandra,cassandra nosql tutorial

via NoSQL databases

NoSQL: NoSQL Databases Configuration Management

2012-01-23T14:24:00.001+02:00

NoSQL Databases Configuration Management

After reading about MarkLogic Packaging feature , I was wondering if managing configurations would not be better done with tools like Puppet or Chef instead of a custom built solution even if it comes packaged with your NoSQL database.

tags:nosql theory,puppet,chef

via NoSQL databases

NoSQL: Key-Value Stores, Document Databases, and Column Stores as Aggregate Oriented Databases

2012-01-23T13:24:00.004+02:00

Key-Value Stores, Document Databases, and Column Stores as Aggregate Oriented Databases

A different, unified look at the data model of the key-value stores, document databases, and column-family stores from Martin Fowler:

tags:nosql theory,key-value store,document database,column database

via NoSQL databases

NoSQL: Countandra: Cassandra-Based Hierarchical Distributed Counting Engine

2012-01-23T13:24:00.003+02:00

Countandra: Cassandra-Based Hierarchical Distributed Counting Engine

Countandra features:

tags:cassandra,hector,netty

via NoSQL databases

NoSQL: Will Amazon DynamoDB Be a Game Changer?

2012-01-23T13:24:00.001+02:00

Will Amazon DynamoDB Be a Game Changer?

A question asked by many, but for now only a few shared their thoughts on Quora . Truth is there are many ways to defining a game changer technology: disruptive, innovative, impacting existing solution providers in the same market or in related markets, etc. Amazon DynamoDB could be all or none or a bit of each of these. But if the question implies a "winner-takes-it-all" answer, Sid Anand already answered it :

tags:dynamodb,nosql future

via NoSQL databases

NoSQL: The State of NoSQL in 2012

2012-01-20T11:16:00.003+02:00

The State of NoSQL in 2012

Wise words from Sid Anand:

tags:nosql theory,nosql future

via NoSQL databases

NoSQL: Reinforcing Couchbase's Commitment to Open Source

2012-01-20T11:16:00.001+02:00

Reinforcing Couchbase's Commitment to Open Source

Bob Wiederhol, the CEO of Couchbase:

tags:couchbase,nosql databases,open source

via NoSQL databases

NoSQL: CouchDB: A Season Finale

2012-01-19T19:19:00.001+02:00

CouchDB: A Season Finale

There was a story earlier this year that I, as someone that has spent an enormous amount of time contributing to open source projects, thought it was no story. Considering how much was published about it, chances were you already read something about Damien Katz's The future of CouchDB .

tags:couchdb,couchbase,cloudant

via NoSQL databases

NoSQL: Auto Scaling in the Amazon Cloud: Netflix's Approach and Lessons Learned

2012-01-19T19:16:00.001+02:00

Auto Scaling in the Amazon Cloud: Netflix's Approach and Lessons Learned

Another great post for today from the engineering team at Netflix:

tags:netflix,scalability,aws

via NoSQL databases

NoSQL: RainStor Big Data Analytics on Hadoop Promises Impressive Data Compression Rates

2012-01-19T14:15:00.001+02:00

RainStor Big Data Analytics on Hadoop Promises Impressive Data Compression Rates

RainStor has announced the Big Data Analytics on Hadoop:

tags:hadoop,rainstor

via NoSQL databases

NoSQL: Basho: Congratulations, Amazon!

2012-01-19T11:16:00.003+02:00

Basho: Congratulations, Amazon!

A dynamo-as-a-service offered by Amazon on their ecosystem will appeal to some. For others, the benefits of a Dynamo-inspired product that can be deployed on other public clouds, behind-the-firewall, or not on the cloud at all, will be critical.

tags:basho,riak,dynamodb,amazon

via NoSQL databases

NoSQL: Pros and Cons of Using MapReduce With Distributed Key-Value Stores: HBase, Cassandra, Riak

2012-01-19T11:16:00.001+02:00

Pros and Cons of Using MapReduce With Distributed Key-Value Stores: HBase, Cassandra, Riak

Old Quora question with very good answers.

tags:mapreduce,hbase,cassandra,riak,key-value store

via NoSQL databases

NoSQL: Using MongoDB Replica Sets With Node.js on Microsoft Azure: NoSQL Tutorials

2012-01-19T11:15:00.001+02:00

Using MongoDB Replica Sets With Node.js on Microsoft Azure: NoSQL Tutorials

Mariano Vazquez explains how to configure MongoDB replica sets on Microsoft Azure and how that works:

tags:mongodb,node.js,azure,mongodb nosql tutorial

via NoSQL databases

NoSQL: Amazon DynamoDB: NoSQL in the Cloud

2012-01-19T01:15:00.001+02:00

Amazon DynamoDB: NoSQL in the Cloud

James Hamilton:

tags:amazon dynamodb

via NoSQL databases

NoSQL: Amazon’s DynamoDB Shows Hardware as Means to an End... Actually It's All About Predictability

2012-01-19T00:15:00.001+02:00

Amazon's DynamoDB Shows Hardware as Means to an End... Actually It's All About Predictability

Derrick Harris:

tags:amazon dynamodb,ssd

via NoSQL databases

NoSQL: Introducing Amazon DynamoDB Video

2012-01-18T22:16:00.001+02:00

Introducing Amazon DynamoDB Video

The live broadcast of today's Amazon DynamoDB announcement went down, so here's the complete video featuring Werner Vogels (CTO Amazon), Swami Svbasubramanian (GM of DynamoDB), and Don MacAskill (CEO SmugMug)

tags:amazon dynamodb,nosql screencast

via NoSQL databases

NoSQL: Cassandra and Amazon DynamoDB Comparison

2012-01-18T19:15:00.001+02:00

Cassandra and Amazon DynamoDB Comparison

Maybe a couple of too strong words, but definitely a great comparison of Cassandra and Amazon DynamoDB by Jonathan Ellis (Cassandra chair and founder of DataStax):

tags:cassandra,amazon dynamodb,nosql comparison

via NoSQL databases

NoSQL: Notes About Amazon DynamoDB

2012-01-18T18:15:00.001+02:00

Notes About Amazon DynamoDB

It's been only a couple of hours since the news about Amazon DynamoDB got out and since then I went through as much documentation as I could. Here are my notes so far. If you found interesting bits please leave a comment and I'll add them to the list (with attribution):

tags:amazon dynamodb

via NoSQL databases

NoSQL: The Little Known Secret of Redis

2012-01-18T16:15:00.003+02:00

The Little Known Secret of Redis

It's the redis-benchmark . In Salvatore's words:

tags:redis

via NoSQL databases

NoSQL: Amazon DynamoDB - a Fast and Scalable NoSQL Database Service Designed for Internet Scale Applications

2012-01-18T16:15:00.001+02:00

Amazon DynamoDB - a Fast and Scalable NoSQL Database Service Designed for Internet Scale Applications

Werner Vogels:

tags:amazon dynamo,amazon dynamodb

via NoSQL databases

NoSQL: MongoDB at Viber Media: The Platform Enabling Free Phone Calls and Text Messaging for Over 18 Million Active Users

2012-01-18T14:15:00.001+02:00

MongoDB at Viber Media: The Platform Enabling Free Phone Calls and Text Messaging for Over 18 Million Active Users

Back in November there has been quite a bit of buzz around MongoDB being behind Viber Media's technology for free phone calls and text messaging . Understandingly so, considering we are talking about a platform with more than 18 million active users talking for more than 11 million minutes every day—and these numbers have probably grown quite a bit over the holiday season.

tags:mongodb,viber media,mobiles,powered by nosql

via NoSQL databases

NoSQL: Implementing Auto Saves Using RavenDB: NoSQL Tutorials

2012-01-18T11:15:00.001+02:00

Implementing Auto Saves Using RavenDB: NoSQL Tutorials

[…] implementing Auto Save in the RDBMS system could be a problem because of multiple reasons: The schema and overall logic changes to save versioned data in the RDBMS system will be non-trivial There might be validation checks that fail because users kept didn't fill out some fields at that point. Making periodic (30 second) transactional updates to any live system is not good for overall performance. A work around would be saving your Object Model to RavenDB directly and if user visits the document after a time out, load both Transactional Data and Object data, compare the timestamp and use the freshest set of data.

tags:ravendb,document database,nosql usecase,ravendb nosql tutorial

via NoSQL databases

NoSQL: Setting Up, Modeling and Loading Data in HBase With Hadoop and Clojure: NoSQL Tutorials

2012-01-18T01:15:00.001+02:00

Setting Up, Modeling and Loading Data in HBase With Hadoop and Clojure: NoSQL Tutorials

Even if you are not familiar with Clojure, you'll still enjoy this fantastic HBase tutorial:

tags:hbase,hadoop,clojure,hbase nosql tutorial

via NoSQL databases

NoSQL: Hadoop Versions Take 2: What You Wanted to Know About Hadoop, but Were Too Afraid to Ask: Genealogy of Elephants

2012-01-17T21:15:00.001+02:00

Hadoop Versions Take 2: What You Wanted to Know About Hadoop, but Were Too Afraid to Ask: Genealogy of Elephants

Another great diagram explaining the complicated tree of Hadoop versions.

tags:hadoop,cdh

via NoSQL databases

NoSQL: Flake: An Erlang Decentralized, K-Ordered Unique ID Generator by Boundary

2012-01-17T17:15:00.001+02:00

Flake: An Erlang Decentralized, K-Ordered Unique ID Generator by Boundary

After posting about the proposal of adding a 128-bit K-Order unique id generator to Redis , I've realized I haven't linked to Boundary's post about Flake , their decentralized k-ordered unique id generator project:

tags:flake,snowflake,boundary,twitter

via NoSQL databases

NoSQL: Bug Fix Release Riak 1.0.3 Available for Download

2012-01-17T12:15:00.001+02:00

Bug Fix Release Riak 1.0.3 Available for Download

No mentions of any critical bugs in the announcement , but it is almost always a good idea to stay up to date.

tags:riak,nosql releases

via NoSQL databases

NoSQL: Redis: The Tool I Never Forget When Managing User Presence, Software Caches, Counters, Sessions

2012-01-17T11:16:00.001+02:00

Redis: The Tool I Never Forget When Managing User Presence, Software Caches, Counters, Sessions

Vishal Shah:

tags:redis,nosql usecases

via NoSQL databases

NoSQL: Asking for Performance and Scalability Advice on StackOverflow

2012-01-17T11:15:00.003+02:00

Asking for Performance and Scalability Advice on StackOverflow

How many times have you got an answer that applies to your specific scenario when providing a short list of performance and scalability requirements ? MySQL/InnoDB can do 750k qps , Cassandra is scaling linearly , MongoDB can do 8 mil ops/s . Is any of these the answer for your application?

tags:nosql theory,scalability,performance

via NoSQL databases

NoSQL: LevelDB Might Be a Great Fit for MongoDB

2012-01-17T11:15:00.001+02:00

LevelDB Might Be a Great Fit for MongoDB

Mark Callaghan:

tags:mongodb,leveldb

via NoSQL databases

NoSQL: Oracle Database or Hadoop? And What Led to NoSQL Databases

2012-01-17T10:15:00.001+02:00

Oracle Database or Hadoop? And What Led to NoSQL Databases

In a follow up post to SQL or Hadoop: What Tools Should I Use to Process My Data? , Gwen Shapira presents some reasons why, even if many things that fit into Hadoop better, could be done with Oracle, that's not also a good idea:

tags:hadoop,oracle,big data

via NoSQL databases

NoSQL: Fujitsu Launches Data Utilization Platform Services

2012-01-17T01:15:00.001+02:00

Fujitsu Launches Data Utilization Platform Services

Judging by the diagram included in the PR announcement , Fujitsu Data Utilization Platform Services are supposed to cover all areas of data acquisition, stream filtering and processing, storage, and batch processing.

tags:fujitsu,data utilization platform services

via NoSQL databases

NoSQL: Splunk, the Search Engine for MacHine Data Company, Files for IPO. Why?

2012-01-16T13:14:00.001+02:00

Splunk, the Search Engine for MacHine Data Company, Files for IPO. Why?

Splunk, the company which recently announced Shep a solution combining Splunk's tool for collecting, monitoring, analyzing, searching, and reporting on massive streams of real-time and historical machine data with Hadoop , has filed for IPO.

tags:splunk,hadoop,nosql market

via NoSQL databases

NoSQL: Introducing RavenDB for ASP.NET Developers: NoSQL Tutorials

2012-01-16T12:15:00.003+02:00

Introducing RavenDB for ASP.NET Developers: NoSQL Tutorials

RavenDB still has a weakness that prevents it from becoming the instant choice of all green-field (a project starting fresh) ASP.NET MVC web projects. Most reporting solutions today work best off RDBMS systems and NoSQL databases are just getting their feet wet with respect to Reporting system connectivity. So if you are building a system that doesn't require traditional reporting systems to hook in and retrieve data, RavenDB is the perfect choice. More often that not, that's not the case (specially Line of Business applications) and hence we tend to fallback on SQL Server/MySQL/Oracle etc.

tags:ravendb,ravendb nosql tutorial

via NoSQL databases

NoSQL: Redis: Adding a 128-Bit K-Ordered Unique Id Generator

2012-01-16T12:15:00.001+02:00

Redis: Adding a 128-Bit K-Ordered Unique Id Generator

Interesting pull request submitted to Redis by Pierre-Yves Ritschard:

tags:redis,snowflake,flake,boudary,twitter

via NoSQL databases

NoSQL: NoSQL Databases: HSS Database for .NET, Silverlight, and WP7

2012-01-16T12:14:00.001+02:00

NoSQL Databases: HSS Database for .NET, Silverlight, and WP7

Stefan Edlich adds another object oriented database to the long collection of non-relational databases :

tags:hss database,oodb,odbms

via NoSQL databases

NoSQL: SQL or Hadoop: What Tools Should I Use to Process My Data?

2012-01-16T11:14:00.001+02:00

SQL or Hadoop: What Tools Should I Use to Process My Data?

Great decision flowchart created by Aaron Cordova to help answer the question: what tools should I use to process my data :

tags:hadoop,sql,data science,big data

via NoSQL databases

NoSQL: Redmon - a Web Interface for Managing Redis: Cli, Admin, and Live Monitoring

2012-01-16T10:14:00.003+02:00

Redmon - a Web Interface for Managing Redis: Cli, Admin, and Live Monitoring

Just a few days after posting about Reddish: a hosted visual admin and data analysis tool for Redis , here is another project that tries to provide the same range of functionality, but is self-hosted.

tags:redis,redis admin

via NoSQL databases

NoSQL: Hadoop on Windows Azure: Visualizing Data

2012-01-16T10:14:00.001+02:00

Hadoop on Windows Azure: Visualizing Data

The setup includes a web-based interactive JavaScript console, which lets you put data into HDFS, launch MapReduce jobs, and also visualize results with HTML5 charts - and it's very easy to use.

tags:hadoop,azure

via NoSQL databases

NoSQL: DataFu: Open Source Apache Pig UDFs by LinkedIn

2012-01-12T23:14:00.001+02:00

DataFu: Open Source Apache Pig UDFs by LinkedIn

Here's a taste of what you can do with DataFu: Run PageRank on a large number of independent graphs. Perform set operations such as intersect and union. Compute the haversine distance between two points on the globe. Create an assertion on input data which will cause the script to fail if the condition is not met. Perform various operations on bags such as append a tuple, prepend a tuple, concatenate bags, generate unordered pairs, etc.

tags:pig,linkedin,nosql releases

via NoSQL databases

NoSQL: Redis 2.6 ETA: Quality or Death

2012-01-12T23:13:00.001+02:00

Redis 2.6 ETA: Quality or Death

There are quite a few interesting features scheduled for Redis 2.6 —Lua scripting, high resolution expires, just to name a couple—which makes some people anxious to start using it.

tags:redis

via NoSQL databases

NoSQL: Eventual and Strong Consistency, Sloppy and Strict Quorums, and Other Lessons and Thoughts on Distributed Systems

2012-01-12T22:13:00.001+02:00

Eventual and Strong Consistency, Sloppy and Strict Quorums, and Other Lessons and Thoughts on Distributed Systems

Anything I'd write would just steal from your time to read and think about the email Joseph Blomstedt posted to the Riak list .

tags:riak,dynamo,eventual consistency,strong consistency,cap,distributed systems,sloppy quorum,strict quorum

via NoSQL databases

NoSQL: Comparing Hadoop Appliances: Oracle’s Big Data Appliance, EMC Greenplum DCA, Netapp Hadooplers

2012-01-12T21:14:00.001+02:00

Comparing Hadoop Appliances: Oracle's Big Data Appliance, EMC Greenplum DCA, Netapp Hadooplers

Great post from Gwen Shapira over Pythian diving into the pros and cons of Hadoop appliances vs building your own Hadoop clusters. Plus a comparison of existing Hadoop appliances: Oracle Big Data Appliance, EMC Greenplum DCA, and Netapp Hadooplers.

tags:hadoop,oracle big data appliacne,emc greenplum dca,netapp hadooplers,oracle,emc,greenplum,netapp

via NoSQL databases

NoSQL: Reference Cards for Cassandra CLI, Nodetool, and CQL Available for Download

2012-01-12T21:13:00.001+02:00

Reference Cards for Cassandra CLI, Nodetool, and CQL Available for Download

If you're like me and sometimes struggle to remember the particular syntax for a CQL or Cassandra nodetool or CLI command, we've got something for you that might help. You can now download reference cards for CQL, along with the Cassandra CLI and nodetool.

tags:cassandra,cql

via NoSQL databases

NoSQL: HBase and Hadoop in OpenLogic Top 5 Trending Open Source Projects

2012-01-11T13:13:00.003+02:00

HBase and Hadoop in OpenLogic Top 5 Trending Open Source Projects

It's nice to see HBase and Hadoop in the Top 5 gainers [1] of the OpenLogic's Open source adoption trending report , but the list of contenders in the database and big data category is way too short: HBase, Hadoop, Mongodb, MySQL, PostgreSQL, CouchDB.

tags:hbase,hadoop,openlogic,nosql market

via NoSQL databases

NoSQL: Salmon DNA Used in Data Storage Device

2012-01-11T13:13:00.001+02:00

Salmon DNA Used in Data Storage Device

Salmon … they're good to eat, provide a livelihood for fishermen, are an important part of their ecosystem, and now it seems that they can store data. More specifically, their DNA can. Scientists from National Tsing Hua University in Taiwan and the Karlsruhe Institute of Technology in Germany have created a "write-once-read-many-times" (WORM) memory device, that combines electrodes, silver nanoparticles, and salmon DNA. While the current device is simply a proof-of-concept model, the researchers have stated that DNA could turn out to be a less expensive alternative to traditional inorganic materials such as silicon.

tags:future

via NoSQL databases

NoSQL: Data Science and BI: Similarities and Differences

2012-01-11T13:12:00.003+02:00

Data Science and BI: Similarities and Differences

Data science and BI differ in the foci of their investigations. DS is consumed with supporting the development of data products. As Monica Rogati of LinkedIn notes, "On one side, I've been working on building products … The other side is finding interesting stories in the data." BI, on the other hand, is all about measuring and managing business performance. At their best, though, both disciplines have an evidenced-based "science of business" foundation that makes me reject the contention by some that data science has a higher calling and is more scientifically sophisticated than BI.

tags:data science,bi

via NoSQL databases

NoSQL: Interesting Data Sets and Tools: Monthly Twitter Activity for All Members of the U.S. Congress

2012-01-11T13:12:00.001+02:00

Interesting Data Sets and Tools: Monthly Twitter Activity for All Members of the U.S. Congress

Drew Conway:

tags:couchdb,powered by nosql,twitter

via NoSQL databases

NoSQL: Friend Recommendations Using Gremlin With Neography

2012-01-11T12:12:00.003+02:00

Friend Recommendations Using Gremlin With Neography

Max De Marzi:

tags:graph database,gremlin,neo4j,neography,ruby

via NoSQL databases

NoSQL: Create, Retrieve, Update, and Delete Dragons With MongoDB on C# .NET

2012-01-11T12:12:00.001+02:00

Create, Retrieve, Update, and Delete Dragons With MongoDB on C# .NET

Kory Becker:

tags:mongodb,csharp

via NoSQL databases

NoSQL: Partnerships in the Hadoop Market

2012-01-11T01:12:00.001+02:00

Partnerships in the Hadoop Market

Just a quick recap:

tags:hadoop,cloudera,hortonworks,mapr,oracle,dell,microsoft,emc,greenplum,ibm,amazon,infosphere biginsights

via NoSQL databases

NoSQL: Oracle Big Data Appliance Released Features Cloudera Distribution of Hadoop: What You Need to Know

2012-01-11T00:12:00.001+02:00

Oracle Big Data Appliance Released Features Cloudera Distribution of Hadoop: What You Need to Know

Klint Finley for ServicesANGLE :

tags:hadoop,big data,oracle,cloudera

via NoSQL databases

NoSQL: Cloudera Distribution of Hadoop Powers Oracle's Big Data Appliance

2012-01-10T20:12:00.001+02:00

Cloudera Distribution of Hadoop Powers Oracle's Big Data Appliance

The announcement of the Oracle Big Data Appliance was out for a couple of hours and already hit all media sites. Before looking at the details of the announcement, let's try to understand what this announcement means for the parties involved.

tags:hadoop,cloudera,oracle,big data,appliance

via NoSQL databases

NoSQL: MySQL at Twitter: Storing 250mil Tweets Daily

2012-01-10T14:05:00.001+02:00

MySQL at Twitter: Storing 250mil Tweets Daily

Todd Hoff took the time to disect and extract in a post the interesting bits from Jeremy Cole's talk [1] Big and Small Data at @Twitter from the O'Reilly MySQL conference:

tags:mysql,twitter,cassandra,hadoop,vertica

via NoSQL databases

NoSQL: NoSQL Databases' Adoption in the Enteprise World

2012-01-10T13:05:00.001+02:00

NoSQL Databases' Adoption in the Enteprise World

There are two guaranteed ways that NoSQL databases will penetrate the enterprise world. I'm not referring here to small departamental experiments, but big budget and long-term penetration.

tags:nosql databases

via NoSQL databases

NoSQL: Apache Hadoop Versions

2012-01-10T12:05:00.001+02:00

Apache Hadoop Versions

Cloudera's Charles Zedlewski gives a great explanation of the Apache Hadoop versioning and the major features included in each production-ready version :

tags:hadoop,nosql releases

via NoSQL databases

NoSQL: Neuron Based Data Structure – an Implementation

2012-01-09T23:05:00.001+02:00

Neuron Based Data Structure – an Implementation

Alexander Bresk:

tags:graph database,nosql theory

via NoSQL databases

NoSQL: Hadoop Distributed File System HDFS: A Cartoon Is Worth A

2012-01-09T13:05:00.003+02:00

Hadoop Distributed File System HDFS: A Cartoon Is Worth A

A picture is worth a thousand words. A comic-like explanation of HDFS is worth some too:

tags:hdfs,fun

via NoSQL databases

NoSQL: Fusion-Io: One Billion IOPS

2012-01-09T13:05:00.001+02:00

Fusion-Io: One Billion IOPS

The Verge reporting from DEMO Enterprise Disruption:

tags:fusio-io,io

via NoSQL databases