MongoDB Pre-Splitting for Faster Data Loading and Importing
Jeremy Zawodny (Craigslist) explains how to optimize the import of data that far exceeds the amount of RAM available in a sharded MongoDB cluster:
tags:MongoDB
via NoSQL databases
About me: Software architect, Web Aficionado, Cloud Computing Fanboy, Geek Entrepreneur, Speaker, Co-founder and CTO of InfoQ.com, Writing also about NoSQL on the myNoSQL blog
Latest comments
think differently big
Tag Cloud Sphere ▼
Follow Alex on Twitter ▼
Daily Cloud Stream ▼
Show more articles
- NoSQL: Cassandra User Frustrations and Improvement...
- NoSQL: MongoDB in the Amazon Cloud
- NoSQL: Prototyping Applications with MongoDB
- NoSQL: Global and Local Graph Ranking
- NoSQL: NoSQL + Node.js + Buzzword Bullshit
- NoSQL: Follow the Data
- NoSQL: State of the Linking Open Data Cloud
- NoSQL: CouchDB Tutorial: Starting to relax with Co...
- NoSQL: NoSQL & Cloud at Netflix
- NoSQL: How Digg is Built? Using a Bunch of NoSQL t...
- NoSQL: Scaling up a Riak Cluster on Amazon EC2
- NoSQL: When NoSQL makes better sense than MySQL
- NoSQL: Ravel Hopes to Open-Source Graph Databases
- NoSQL: Cassandra and Neo4j Used by Evident ClearS...
- NoSQL: MongoDB, memcached, EHCache: Compared as Di...
- NoSQL: Backbone-Redis: Model Persistence in backbo...
- NoSQL: The Little MongoDB Book
- NoSQL: The Many Faces Of MapReduce - Hadoop and Be...
- NoSQL: The Many Faces Of MapReduce - Hadoop and Be...
- NoSQL: Videos from MongoUK Event Thanks to SkillsM...
- NoSQL: Riak with node.js
- NoSQL: Hosting websites out of CouchDB
- NoSQL: Malware, MongoDB and Map/Reduce: A New Anal...
- NoSQL: Mapr: a Competitor to Hadoop Leader Cloudera
- NoSQL: Does Big Data Need Big Budgets?
- NoSQL: Why do we need so many different databases?
- NoSQL: MongoDB and Node.js
- NoSQL: Using Redis with Ruby on Rails
- NoSQL: AOL AdLead Powered by Riak Components
- NoSQL: Brisk: The Brangelina of Big Data
- NoSQL: The realtime web with gevent, socket io, re...
- NoSQL: Cassandra + Hadoop = Brisk by DataStax
- NoSQL: MongoDB: ObjectId Tricks
- NoSQL: How Scalable is VoltDB?
- NoSQL: Types of Big Data Work
- NoSQL: Types of Big Data Work
- NoSQL: Data Warehouse 2011 Market According to Gar...
- NoSQL: Firefox Downloads Visualization Powered by ...
- NoSQL: 5 Criteria to Compare Data Marketplaces
- NoSQL: Polyglot Persistence: The Architecture of t...
- NoSQL: Trinity, Dryad, Probase and Bing
- NoSQL: SQL Server and SQL Azure Comparison
- NoSQL: Globals: InterSystems Free NoSQL database f...
- NoSQL: Scaling Graph Databases: Sharding and Consi...
- NoSQL: Trinity: A Graph Database from Microsoft Re...
- NoSQL: Reddit's Story of Running Cassandra & Postg...
- NoSQL: HP CEO about Relational Databases
- NoSQL: 11 Big-Data Analytics Predictions for 2011
- NoSQL: Some observations on MongoDB & CouchDB
- NoSQL: Dealing With Distributed State
- NoSQL: Allura: SourceForge Open Platform Powered b...
- NoSQL: Relational Databases and NoSQL Databases
- NoSQL: R and the web in 2011
- NoSQL: The Key Technical Challenge of Cloud Computing
- NoSQL: Make Data Available - Open Data Manual
- NoSQL: Social Analytics on MongoDB
- NoSQL: Cloudera: A Business Inteligence Leader
- NoSQL: Couchbase Server: What is This First Release?
- NoSQL: The Joy of Indexing
- NoSQL: MySQL Fork Drizzle Released
- NoSQL: MongoDB Tailable Cursors
- NoSQL: Polyglot Persistence: The Future of Databas...
- NoSQL: Redis Commands Dissected: GET and SET
- NoSQL: Creating a Simple and Efficient Rating Syst...
- NoSQL: Google Paper: Availability in Globally Dist...
- NoSQL: Oracle and MySQL Future
- NoSQL: Strategies for Exploiting Large-scale Data
- NoSQL: An Introduction to Distributed Filesystems
- NoSQL: The Fourth Paradigm: Data-Intensive Scienti...
- NoSQL: Persisting Eclipse Modeling Framework model...
- NoSQL: Using Oracle Berkley DB as a NoSQL Data Store
- NoSQL: Data Privacy and Data Marketplaces Future
- NoSQL: Perspectives on Big Data by Werner Vogels
- NoSQL: Neo4j on Windows Azure
- NoSQL: Soulmate: Redis-backed Autocompletion
- NoSQL: Redis: Why Wait for Good Enough?
- NoSQL: Hadoop, Hive and Redis for Foursquare Analy...
- NoSQL: Clustrix: Distribution, Fault Tolerance, an...
- NoSQL: Comparing Dryad and Hadoop
- NoSQL: RethinkDB and SSD Write Performance
- NoSQL: Hadoop and NoSQL Databases at Twitter
- NoSQL: Real Life Issues With Big Data In The Enter...
- NoSQL: iOS Mobile Couchbase
- NoSQL: The Unreasonable Effectiveness of Data
- NoSQL: From CouchDB to Riak at Linkfluence
- NoSQL: CouchDB Tutorial: Getting Started with CouchDB
- NoSQL: RDF Stores are The Silverbullet
- NoSQL: redisfs - a Replication-Friendly Filesystem
- NoSQL: Redis and HBase for Mozilla Grouperfish Sto...
- NoSQL: Everyone's Welcome in the NoSQL Commune
- NoSQL: Everything Drives Storage
- NoSQL: Store and Forget or: How I learned to Stop ...
- NoSQL: MongoDB Pre-Splitting for Faster Data Loadi...
- NoSQL: Where will BigData be Profitable?
- NoSQL: Limit MongoDB memory use on Windows without...
- NoSQL: Facebook Builds HBase-based Real-Time Analy...
- NoSQL: BigData is Great, But What About Quality
- NoSQL: Node.js + NoSQL Database => Real Time Chat ...
- NoSQL: Ruby On Rails: Cron Job Scheduling using Re...
- NoSQL: The Story of Scaling Union Station
Post a Comment