Amazon NoSQL DynamoDB

Having used Amazons SimpleDB NoSQL Cloud database on a customer project I was interested in Amazons newly released cloud nosql db offering called DynamoDB.
Here's my notes from a webcast about DynamoDB. For massive scale, simple queries and little need for transactions the cost is amazing (see case study below).
Includes comparison to SimpleDB at bottom.

Amazon DynamoDB
In market approx 1 month since Jan 2012
DynamoDB is a NoSQL db, hosted by Amazon, access via Rest Apis
Goals: massive scalability, low latency, easy to use.

Easy to create the table (use their ui wizard to define a table and adjust scale as needs changes). Amazon provide a calculator to help you calculate out your needs, you tell them Amazon the capacity you need and they handle it. When you provision capacity is reserved.
Integrated with CloudWatch, You can setup alarms to alert if pass certain thresholds.

Integrated with Elastic MapReduce to perform complex analytics, can export data out to sources link S3
Latency is consistent as throughput and storage grows (they said). AWS handles tuning.
Case Study: customer ran 160k writes a sec for 3 days, over 90% requests were run below 6ms
They handle replication across their data center, you data is partitioned and distributed around their data centers. So don't wait to last minute to increase capacity, use alarms so you can plan in advance.

Pricing:
Pay by the hour for the throughput capacity (a unit is a write/read per sec).
  • Unit of write capacity: $0.01 per 10 units
  • Unit of read capacity: $0.01 per 50 units
  • Storage: $1 per GB
  • Free tier: 100MB, 5 writes per sec, 10 reads. This is a great option for to test it out yourself.
Case Study: during 2012 Superbowl one customer spun up a DynamoDB with 100k writes per sec (more than 10 times Twitters peak of 10k writes during Superbowl) for over 4 hours at a cost of $400...thats right four hundred bucks!..and they spun it up in a few days!

When to use:
  • when have low latency requirements
  • when you need to scale, but are not sure to what
  • reduce costs to manage (Amazon manage h/w, s/w, monitoring, providing the expertize)
  • when complex queries or transactions are not required
It is an option to combine an Rdbms and DynamoDB.

Amazon DynamoDB vs Amazon SimpleDB
  • "the 2 products are complimentary",
  • DynamoDB is for large scale
  • DynamoDB has limited query capability because DynamoDB can only query via primary key so simple query; in SimpleDB every field is inexed
  • if you need massive scale then use DynamoDB, otherwise look at SimpleDB

Comments

Post a Comment

Popular posts from this blog

deep dive into Material UI TextField built by mui

Image
The Material Design system is a design system used to create consistent digital experiences across platforms such as android, web and ios. Includes: a color system a typography system a shape system a grid system it addresses motion and lots more Also includes Material Theming which makes it easy to customize Material Design to match your brand. Material Design is not just a set of guidelines it is a whole ecosystem. Material itself stopped maintaining it's react implementation and recommends opensource versions.  A very popular open source implementation is  MUI ,  a react component library  built to implement Material Design . Bills itself as the "worlds most popular React UI framework" and at this time has 1.2M weekly downloads on npm and used by over 750k projects on github (did I mention it's very popular?).  Note: there are other react component libraries implementing bootstrap and ant design for example, so up to you and your design team on what you choose. 
Read more

angular js protractor e2e cheatsheet

Many from the protractor test suite category detailed task syntax example load page load a page browser.get('yoururl') browser btn actions browser back/forward browser.navigate().back() OR browser.navigate().forward() access elements on page See Protractor API list and examples from Protractors test suite access by angular ngmodel name (must match ngmodel in the html) this is the preferred approach element(by.model('person.name')); access by the css id on the page e.g, #user_name (but this can be brittle) element(by.id('user_name')) access angular binding to get generated value i.e. for {{}} element(by.binding('person.concatName')); access angular repeat list data (must match repeat stmt in the html) See Protractor test suit l
Read more

react-router v6.4+ loaders, actions, forms and more

react-router  react-router is used for in app single page app navigation, we configure routes for pages in the app to map to components react-router has over 1bn downloads, its an industry standard (but there are others e.g. Nextjs router) many apps use react-router, many on v5.x the new react-router 6.4.x the newest major version of react router v6.4 is a significant enhancement which adds a lot of new features. react-router v6.4 offers new features to load data (loaders) and handle actions (actions).  It's done gone all Remix-y which makes sense because the same guys wrote both. eliminates a lot of boilerplate code to fetch data in useEffect() and set various loading states put your data load and update logic in react-route components instead of custom code unlike Remix, react-router v6.4 is still just all on the client (not server like Remix) paradigm shifts Lets start with a couple of high level ideas; "back to the future" so to speak OR "what's old is new ag
Read more