Berkeley Sockets (BSD) are the de facto API for all network communication. With roots from the early 1980′s, it is the original implementation of the TCP/IP suite, and arguably one of the most widely supported and critical components of any operating system today. BSD sockets that most of us are familiar with are peer-to-peer connections, which require explicit setup, teardown, choice of transport (TCP, UDP), error handling, and so on. And once you solve all of the above, then you are into the world of application protocols (ex: HTTP), which require additional framing, buffering and processing logic. In other words, it is no wonder that a high-performance network application is anything but trivial to write.

Wouldn’t it be nice if we could abstract some of the low-level details of different socket types, connection handling, framing, or even routing? This is exactly where the ZeroMQ (ØMQ/ZMQ) networking library comes in: “it gives you sockets that carry whole messages across various transports like inproc, IPC, TCP, and multicast; you can connect sockets N-to-N with patterns like fanout, pubsub, task distribution, and request-reply”. That’s a lot buzzwords, so lets dissect some of these concepts in more detail.

Well written post about ZeroMQ. Lead to some interesting links about RabbitMQ, ActiveMQ the AMQ protocol, ICE (Internet Communications Engine) from ZeroC.

Let’s say that you and I decide to play pool. We agree to play eight-ball, best of five games. Our perception is that what follows is a contest to see who will do something called winning.

But I don’t see it that way. I always imagine the outcome of eight-ball to be predetermined, to about 95% certainty, based on who has practiced that specific skill the most over his lifetime. The remaining 5% is mostly luck, and playing a best of five series eliminates most of the luck too.

I found this really insightful. It seems obvious when you read it but for some reason it doesn’t seem to occur naturally to me.

Well written article on the role of Linkers, covers *nix and Windows systems.

To understand why NoSQL is important to you as an app developer, let’s consider the use cases for some of these features:

• Frequently-written, rarely read statistical data (for example, a web hit counter) should use an in-memory key/value store like Redis, or an update-in-place document store like MongoDB.
• Big Data (like weather stats or business analytics) will work best in a freeform, distributed db system like Hadoop.
• Binary assets (such as MP3s and PDFs) find a good home in a datastore that can serve directly to the user’s browser, like Amazon S3.
• Transient data (like web sessions, locks, or short-term stats) should be kept in a transient datastore like Memcache. (Traditionally we haven’t grouped memcached into the database family, but NoSQL has broadened our thinking on this subject.)
• If you need to be able to replicate your data set to multiple locations (such as syncing a music database between a web app and a mobile device), you’ll want the replication features of CouchDB.
• High availability apps, where minimizing downtime is critical, will find great utility in the automatically clustered, redundant setup of datastores like Casandra and Riak.

Despite all the use cases described above, there will always be a place for the highly normalized, transactional, ad-hoc-query capabilities of SQL databases. We’re adding new tools to our toolbox, not removing old ones.

Nice summary on the Heroku blog about use cases for non-relational storage services.

And just because of the simple fact that you are human, you find yourself heir to an inherent unsatisfactoriness in life which simply will not go away. You can suppress it from your awareness for a time. You can distract yourself for hours on end, but it always comes back–usually when you least expect it. All of a sudden, seemingly out of the blue, you sit up, take stock, and realize your actual situation in life.

There you are, and you suddenly realize that you are spending your whole life just barely getting by. You keep up a good front. You manage to make ends meet somehow and look OK from the outside. But those periods of desperation, those times when you feel everything caving in on you, you keep those to yourself. You are a mess. And you know it. But you hide it beautifully. Meanwhile, way down under all that you just know there has got be some other way to live, some better way to look at the world, some way to touch life more fully. You click into it by chance now and then. You get a good job. You fall in love. You win the game. and for a while, things are different. Life takes on a richness and clarity that makes all the bad times and humdrum fade away. The whole texture of your experience changes and you say to yourself, “OK, now I’ve made it; now I will be happy”. But then that fades, too, like smoke in the wind. You are left with just a memory. That and a vague awareness that something is wrong.

But there is really another whole realm of depth and sensitivity available in life, somehow, you are just not seeing it. You wind up feeling cut off. You feel insulated from the sweetness of experience by some sort of sensory cotton. You are not really touching life. You are not making it again. And then even that vague awareness fades away, and you are back to the same old reality. The world looks like the usual foul place, which is boring at best. It is an emotional roller coaster, and you spend a lot of your time down at the bottom of the ramp, yearning for the heights.

So what is wrong with you? Are you a freak? No. You are just human. And you suffer from the same malady that infects every human being. It is a monster inside all of us, and it has many arms: Chronic tension, lack of genuine compassion for others, including the people closest to you, feelings being blocked up, and emotional deadness. Many, many arms. None of us is entirely free from it. We may deny it. We try to suppress it. We build a whole culture around hiding from it, pretending it is not there, and distracting ourselves from it with goals and projects and status. But it never goes away. It is a constant undercurrent in every thought and every perception; a little wordless voice at the back of the head saying, “Not good enough yet. Got to have more. Got to make it better. Got to be better.” It is a monster, a monster that manifests everywhere in subtle forms.

Very nice article on Buddhist philosophy and the power of meditation.