NoSQL: Memcached and Sherpa for Yahoo! News Activity Data Service

Memcached and Sherpa for Yahoo! News Activity Data Service

Mixer, the recently announced Yahoo's new data service for news activities, uses Memcached and Sherpa for its data backend. Plus a combination of asynchronous libraries and task execution tools:

tags:Memcached

via NoSQL databases

NoSQL: The Big Data Maslow's Pyramid

The Big Data Maslow's Pyramid

Created by Amy Hodler (Hitachi Data Systems) and Anjana Bala (Stanford University):

tags:BigData

via NoSQL databases

NoSQL: Tanuki: A 30000 Cores AWS Cluster

Tanuki: A 30000 Cores AWS Cluster

Sometimes the only valid comment is wow.

tags:Hadoop

via NoSQL databases

NoSQL: Big Data Is Going Mainstream: Facebook, Yahoo!, eBay, Quantcast, and Many Others

Big Data Is Going Mainstream: Facebook, Yahoo!, eBay, Quantcast, and Many Others

Shawn Rogers has a short but compelling list of Big Data deployments in his article Big Data is Scaling BI and Analytics . This list also shows that even if there are some common components like Hadoop, there are no blueprints yet for dealing with Big Data.

tags:BigData,Hadoop

via NoSQL databases

NoSQL: Redis Bulk Load Tips and Tricks

Redis Bulk Load Tips and Tricks

Awesome solutions right from the source :

tags:Redis

via NoSQL databases

NoSQL: The Best Month for NoSQL, Big Data, and the Data Space?

The Best Month for NoSQL, Big Data, and the Data Space?

Last evening I was trying to catch up with the news in the NoSQL and Big Data space —it looks like nobody wants to pick up the job I'm doing here, except maybe GigaOm's Infrastructure Curator Derick Harris .

tags:BigData

via NoSQL databases

NoSQL: MongoDB Selected as Core Content Management Component of SAP's Platform-As-A-Service

MongoDB Selected as Core Content Management Component of SAP's Platform-As-A-Service

MongoDB will be utilised initially for collaborative decision making, data archiving and retention management in a multi-tenant and secure environment. MongoDB will be used as the document-oriented store for SAP's on-demand applications, delivering lower cost of ownership and increased stability. "MongoDB offers scalability and flexibility at a total cost of ownership that enables us to deliver applications to our customers at affordable prices," said Harald Mueller, chief product owner, Java Platform, SAP. "We need to deliver applications that meet our customers' needs now and in the future as they grow their business. MongoDB plays a crucial role in our ability to do that. We're excited about the possibilities and look forward to further use of MongoDB in the future."

tags:MongoDB

via NoSQL databases

NoSQL: Why RavenDB for .NET Development?

Why RavenDB for .NET Development?

Niklas Lundberg summarizes the advantages of using the native .NET document database RavenDB:

tags:RavenDB

via NoSQL databases

NoSQL: From Memcached to Membase Memcached Buckets

From Memcached to Membase Memcached Buckets

SaltwaterC:

tags:memcached,Membase

via NoSQL databases

NoSQL: SDB Explorer for Amazon SimpleDB

SDB Explorer for Amazon SimpleDB

I opened my email this morning just to find one of the daily Mac software deals email promoting an Amazon SimpleDB tool: SDB Explorer [1] . This reminded me that last month I've seen NoSQL mentioned twice on TechMeme . I don't know if any relational database has ever been mentioned on Oprah, but that's the next stop for NoSQL databases. NoSQL is mainstream .

via NoSQL databases

NoSQL: BigData Market: IBM Acquires Two Analytics Companies

BigData Market: IBM Acquires Two Analytics Companies

IBM jumps in the "big data" rush as it announced two major acquisitions in two days. On Wednesday, Big Blue announced that it will acquire security intelligence analytics company i2 […] The second major buy was revealed earlier today. IBM announced the deal to acquire Algorithmics, a risk analytics software and advisory service

tags:BigData

via NoSQL databases

NoSQL: MapR Raises $20 for Friendly Hadoop Distribution

MapR Raises $20 for Friendly Hadoop Distribution

We've already heard of MapR's positioning as a Cloudera competitor for providing a friendly Hadoop distribution. But it was just another company among the many others trying to get into the Big Data with Hadoop space .

tags:Hadoop

via NoSQL databases

NoSQL: What Is a Graph Database?

What Is a Graph Database?

The InfiniteGraph guys put together a page providing a short definition of what graph databases are and what advantages they bring to the table:

tags:InfiniteGraph

via NoSQL databases

NoSQL: Big Data and the 4 Vs: Volume, Velocity, Variety, Variability

Big Data and the 4 Vs: Volume, Velocity, Variety, Variability

In a recent post Curt Monash disagrees with Forrester's definition of BigData as the 4 Vs: volume, velocity, variety, and variability:

tags:BigData

via NoSQL databases

NoSQL: Will Oracle Win the NoSQL Competition

Will Oracle Win the NoSQL Competition

I agree this title is misleading but problem is clear: today Oracle does not provide any product can compete with new cloud computing needs and with the NoSQL movement. It is not possibile to think that actually the RAC technology of oracle can be used in a cloud environment and also a cloud service cannot be deployed over an Exadata.

via NoSQL databases

NoSQL: State of HBase With Michael Stack

State of HBase With Michael Stack

Michael Stack (StumbleUpon & Hadoop PMC) presents on some of the more interesting HBase deployments, HBase scenario usages, HBase and HDFS, and near-future of HBase:

tags:HBase

via NoSQL databases

NoSQL: Amazon Is More Interesting Than Google

Amazon Is More Interesting Than Google

Google has been doing these sort of blog posts for years. Some engineer wites up an entry about how they are doing research using terabytes or petabytes of data. And then they end by saying you should work at Google. So nowadays, I don't care about any of what Google does. […] MapReduce? Great, they've been sitting on this technology for a decade. Good for them. It doesn't matter to me. But the world has changed, and Google can't seem to keep up. Amazon has become the polar opposite of Google, empowering every developer on the planet to make incredible technology. Want MapReduce? Amazon has you covered. Want to play with terabytes of data like it ain't no thing? Check. Want to launch thousands of servers to handle a tough computation? Check, check, and check. Want to launch thousands of human brains to solve otherwise unassailable problems? No problem. Heck, want to simply send email to your users? They have that too.

tags:BigData,MapReduce

via NoSQL databases

NoSQL: Resolving Some CouchDB-Record Inconsistencies in Scala

Resolving Some CouchDB-Record Inconsistencies in Scala

Aleksa Vukotic:

tags:CouchDB

via NoSQL databases

NoSQL: The Appealing Future of Big Data and Data Analytics

The Appealing Future of Big Data and Data Analytics

In a RWW article , David Smith writes about the R statistics language :

tags:BigData

via NoSQL databases

NoSQL: Data Analytics at Work

Data Analytics at Work

Kelley found its Microsoft SQL-based business intelligence and data warehousing infrastructure couldn't handle its growing data analytics requirements. About two years ago, the company started using a new IBM Netezza Twinfin data warehousing appliance, which it supplemented with a second similar system last December. The two systems together, with software from Information Builders and MicroStrategy, form the core of Kelley's new data warehousing and business intelligence capabilities. Kelley is also using a variety of predictive analytics, data mining and text analytics tools from SAS Institute to help analyze the data it collects. Much of the analytics used to deliver new and used-car values, targeted advertisements, customized offers and reviews on the company's website, KBB.com, are powered by SAS's software.

via NoSQL databases

NoSQL: InfiniteGraph and RDF Tuples or Why Using a Specialized Solution Is the Way to Go

InfiniteGraph and RDF Tuples or Why Using a Specialized Solution Is the Way to Go

An excellent explanation for why it makes sense to use a specialized tool for the job:

tags:InfiniteGraph

via NoSQL databases

NoSQL: What Is Business Intelligence 3.0?

What Is Business Intelligence 3.0?

According to Bill Cabiro citing Tableau software the answer is visual analysis :

via NoSQL databases

NoSQL: Paper: HaLoop Efficient Iterative Data Processing on Large Clusters

Paper: HaLoop Efficient Iterative Data Processing on Large Clusters

A paper from the Seattle University of Washington (Yingyi Bu, Bill Howe, Magdalena Balazinska, Michael D. Ernst):

tags:Hadoop

via NoSQL databases

NoSQL: Help CouchDB Break the C10K Barrier

Help CouchDB Break the C10K Barrier

Over the weekend, I was experimenting with CouchDB to see if it can pass the C10K barrier. Some of the performance optimizations I made along the way are really OS-level optimizations that affect MochiWeb (erlang web server) and fairly well documented in many blogs. This one by @metabrew in particular is a pretty good read, since it focuses on Erlang and MochiWeb. While I am a performance junkie, I am not an Erlang hacker. So this is a call for help to the CouchDB hackers for recommendations on scaling out CouchDB.

tags:CouchDB

via NoSQL databases

NoSQL: How Does YARN (NextGen MapReduce) and Mesos Compare?

How Does YARN (NextGen MapReduce) and Mesos Compare?

Jay Kreps (LinkedIn) provides an excellent response to the question in the title on a Quora thread :

tags:Hadoop

via NoSQL databases

NoSQL: Big Data: Quality Over Quantity

Big Data: Quality Over Quantity

Sybase's Derek Klobucher writes in an article titled Better Data Quality Means Higher Sales and ROE [1] :

tags:BigData

via NoSQL databases

NoSQL: Two Kinds of Big Data

Two Kinds of Big Data

Rob Gonzalez:

tags:BigData

via NoSQL databases

NoSQL: Basic Riak MapReduce: Analyzing Apache Logs

Basic Riak MapReduce: Analyzing Apache Logs

Simon Buckle:

tags:Riak,MapReduce

via NoSQL databases

NoSQL: Redis-Based MOM: Redis for Processing Payments

Redis-Based MOM: Redis for Processing Payments

Santosh Kumar:

tags:Redis

via NoSQL databases

NoSQL: MongoDB Query Profiling on MongoLab

MongoDB Query Profiling on MongoLab

There's a (slow) query profiler in MongoLab:

tags:MongoDB

via NoSQL databases

NoSQL: IDC: Storage Shipments Keep Surging. Where Is the Exponential Growth Though?

IDC: Storage Shipments Keep Surging. Where Is the Exponential Growth Though?

IDC:

tags:BigData

via NoSQL databases

NoSQL: Characteristics of Big Data Application Platform

Characteristics of Big Data Application Platform

Nati Shalom describes the main characterstics of a future Big Data platform (as compared to existing application platforms like JavaEE):

tags:BigData

via NoSQL databases

NoSQL: CloudSpokes: From Microsoft Azure to Database.com

CloudSpokes: From Microsoft Azure to Database.com

CloudSpokes, an Appirio-led community rearchitected their solution from Windows Azure to Salesforce's Database.com:

via NoSQL databases

NoSQL: Use Membase and You'll Never Want to Mess With Memcached Servers Again

Use Membase and You'll Never Want to Mess With Memcached Servers Again

All I can say is WOW. I'll never use stand alone memcached server(s) again. crazy easy to install and make a cluster. 0 changes to your app code. Operates seamlessly with memcached protocol. If you want to take advantage of advanced features, you need to modify app code. you can dynamically add and remove nodes without losing all your keys/data. 2 bucket types: Membase : supports data persistence (writes them ionicely to disk) and replication (one node dies, you dont lose your key/value pairs). It sends data to disk as fast as it can (while giving priority to getting data back from disk). This is done asynchronously (with an option for synchronous), so clients shouldn't be able to perceive a difference between Membase and memcached data buckets. Memcached : no persistence or replication. all in memory. I would highly recomend going membase bucket unless you have some I/O concerns (like you get charged for I/O in the cloud). Awesome admin web UI. lots of documentation helpful community

tags:Membase,memcached

via NoSQL databases

NoSQL: Groonga: Open-Source Fulltext Search Engine and Column Store

Groonga: Open-Source Fulltext Search Engine and Column Store

Groonga :

via NoSQL databases

NoSQL: Accumulo: A New BigTable Inspired Distributed Key/Value by NSA

Accumulo: A New BigTable Inspired Distributed Key/Value by NSA

The National Security Agency has submitted to Apache Incubator a proposal to open source Accumulo, a BigTable inspired key-value store that they were building since 2008. The project proposal page provides more details about Accumulo history, building blocks, and how it compares to the other BigTable open source implementation HBase:

tags:BigTable,HBase

via NoSQL databases

NoSQL: MongoDB and New York Times Project Cascade

MongoDB and New York Times Project Cascade

New York Times' Jake Porway talks about Project Cascade and MongoDB usage for collecting, filtering, and analyzing realtime data feeds from a variety of sources to better understand how people interact with the news, the world, and each other.

tags:MongoDB

via NoSQL databases