Search This Blog

Showing posts with label Cloud. Show all posts
Showing posts with label Cloud. Show all posts

Wednesday, April 1, 2026

Your AI Infrastructure Might Be the Problem

PostgreSQL 18 and pgVector are quietly making the case that the most expensive database stack is rarely the smartest one — and the numbers are hard to argue with.

There's a certain appeal to purpose-built tools. A dedicated vector database feels like the serious, grown-up choice when you're building AI infrastructure. It signals commitment. It signals you've done the research. And yet, for a growing number of engineering teams, that commitment is quietly bleeding money while delivering results that PostgreSQL — the database many of them already run — can match or beat.

This isn't a hot take. It's arithmetic.

PostgreSQL 18 paired with the pgVector extension is delivering a 4x performance improvement over earlier configurations, cutting AI deployment timelines by 68%, and — crucially — it handles around 90% of enterprise AI workloads without requiring organizations to stand up a separate system at all. The infrastructure cost reduction runs to about 40%.

That's not a marginal win. That's a rethink.

4×
performance improvement over earlier configurations
68%
faster deployment times for AI workloads
90%
of enterprise AI workloads covered
40%
reduction in infrastructure costs

The specialization trap

The pattern tends to go like this: a team starts building AI features. Someone suggests they need a real vector database — something designed specifically for embeddings, similarity search, semantic retrieval. The procurement process starts. A new system gets spun up. Ops burden increases. The data team now manages one more thing.

Multiply that by the number of AI initiatives at a mid-sized company and you get an infrastructure sprawl problem dressed up as a technology strategy. Costs compound. Complexity compounds. And the actual performance benefit, when you finally measure it honestly against what PostgreSQL could have done, often doesn't hold up.

"The best AI infrastructure is frequently the infrastructure you already have — extended, not replaced."

The deeper issue is that specialization has a real cost that rarely shows up on the vendor's comparison chart: operational overhead, onboarding time, the cognitive load of running polyglot data architectures, and the synchronization problems that emerge when your vector store and your relational store don't speak the same language about transactions, permissions, or backups.

What PostgreSQL 18 actually changes

pgVector isn't new. Engineers have been using it for semantic search and embedding storage for a few years now. But PostgreSQL 18 changes the performance conversation in a meaningful way. The improvements to parallel query execution, index build times, and memory management in this release make pgVector a genuinely competitive option for workloads that, even six months ago, might have pushed teams toward Pinecone, Weaviate, or Qdrant.

What you get with PostgreSQL 18 + pgVector isn't just "good enough." You get ACID guarantees across your vector and relational data in a single transaction. You get a mature ecosystem of tooling, monitoring, and operational knowledge. You get a system your existing team already knows how to run. And you get to skip the data synchronization problem entirely, because your embedding vectors live in the same database as the structured data they describe.

For most production use cases — RAG pipelines, recommendation engines, semantic search over internal knowledge bases, user-facing AI features — that combination is sufficient. More than sufficient, actually. It's often better than the alternative.

How to find out if this applies to you

The only honest way to answer this is to run the test. Vendor benchmarks are designed to make vendors look good. The question isn't whether PostgreSQL 18 is faster than a dedicated vector database in some abstract scenario — it's whether it's fast enough, and cheap enough, and simple enough, for your specific workload.

  1. Pull together your actual AI infrastructure spend — not just licensing, but ops time, engineering time, and the indirect cost of maintaining separate systems.
  2. Set up PostgreSQL 18 with pgVector in a test environment and run your real queries against your real data. Synthetic benchmarks are useful; production query patterns are what matter.
  3. Compare latency, throughput, and cost per query. Include operational complexity in your cost model, not just compute.
  4. If the numbers hold up, start migrating lower-stakes workloads first. Build confidence before touching anything customer-facing.
  5. Consolidate gradually. The goal isn't to rip everything out at once — it's to stop adding complexity you don't need.

The companies getting this right

The teams that are winning here share a specific mindset: they treat infrastructure as a constraint to be minimized, not a portfolio to be expanded. They ask "can we do this with what we have?" before asking "what new tool should we buy?"

That sounds obvious. It rarely gets practiced. There's social and organizational pressure to invest in visible infrastructure, to have a stack that looks sophisticated. But sophistication that doesn't translate to outcomes is just expense.

PostgreSQL has been around for over 35 years. It has survived waves of "the relational model is dead" commentary. It is now, quietly, becoming a credible backbone for AI-native applications — not because it's trendy, but because it keeps getting better and the people who maintain it have an exceptionally long memory for what production systems actually need.


The counterintuitive truth about AI infrastructure is that the most valuable investment might already be sitting in your data center. Before the next procurement cycle, it's worth at least asking whether what you need is already there — just waiting on a newer version and a smart extension.

Thursday, October 30, 2025

When the Cloud Falls: What Recent Outages Taught Us About Digital Resilience

Our cloud provider was down for 47 minutes. We were down for 4 hours.

That gap? That’s the problem we’re not talking about.

We have all been in meetings in which we ask the executive team a simple question: “If our cloud infrastructure went down right now, how long until we’re back up?”

The answers usually range from “a few minutes” to “maybe an hour.”

Then someone asks: “When did we last test that?”

The silence becomes deafening.

Here’s what nobody wants to admit: We’ve been using “we’re on the cloud” as a substitute for actual disaster recovery planning. And these last two months? They just exposed how dangerous that assumption really is.

I’ve been in tech for years. I’ve survived multiple disasters, failed migrations, and that one intern who accidentally deleted the production database (we’ve all been there). But watching these recent outages unfold felt like déjà vu.

We’re not failing because the technology is bad. We’re failing because we’ve outsourced our thinking.

We’ve Seen This Movie Before

I was on a team when our cloud provider had an authentication service issue. I’ll never forget watching our support Slack channel explode with “Anyone else seeing login issues?” while our monitoring dashboard showed nothing but green checkmarks.

That outage taught me something crucial: Perfect monitoring means nothing if you’re monitoring the wrong things.

We spent hours troubleshooting our code before we even checked the provider status page. By the time we understood the issue was upstream, customers had already started leaving angry reviews.

The worst part? We had no fallback. No graceful degradation. When their authentication service went sideways, our entire platform just… broke.

What Separates the Survivors from the Casualties

These recent outages showed me the same pattern I’ve seen before:

The companies that survived weren’t the ones with the biggest budgets or the fanciest tech stacks.

They were the ones who’d actually practiced failing.

I have a friend who runs infrastructure for a fintech startup. During the recent cloud issues, while other companies were scrambling, his team failed over to their secondary region in under 10 minutes.

When I asked him how, his answer was simple: “We break our own stuff every month. This was just another Tuesday.”

Meanwhile, I’ve been on teams where we dusted off disaster recovery docs that referenced services we’d deprecated years ago and contact lists with people who’d left the company. Sound familiar?

The Questions That Haunt Me

Every time I see these major outages, I think back to that meeting and ask myself:

→ When did we last TEST our backups, not just create them?

→ Can our teams actually execute incident response without endless approval chains?

→ Do we really know which dependencies are single points of failure?

→ Are we designing systems that fail gracefully, or fail catastrophically?

Two months ago, I would’ve confidently said “we’re fine, we’re in the cloud.”

Today? I’m asking harder questions.

Here’s What Actually Works (Learned the Hard Way)

Stop treating multi-cloud like it’s paranoia. I used to think it was overkill. I was wrong. Your critical paths need a Plan B that doesn’t depend on one provider having a good day.

Make your runbooks executable, not readable. That Word doc gathering dust? That’s not disaster recovery. That’s wishful thinking. Automate your failover. Script your recovery.

Practice your disasters. Chaos engineering seemed excessive until I lived through an outage with zero preparation. Start small. Break things on purpose. Learn when the stakes are low.

Monitoring ≠ Observability. I learned this one the hard way. You need to know WHY things break, not just THAT they broke.

Your SLA is a refund policy, not a safety net. Service credits don’t rebuild customer trust.

The Real Cost Nobody Talks About

Revenue loss? Obviously. Customer churn? Absolutely.

But here’s the hidden cost I’ve seen destroy teams: Lost credibility with leadership.

Every time engineers warn “we need to invest in resilience” and get told “the cloud is reliable,” then this happens? That trust is brutal to rebuild. I’ve watched talented engineers leave companies over exactly this.


My challenge to you: Open your disaster recovery plan right now. Actually open it.

If you can’t find it, or it hasn’t been updated this year, or half your team doesn’t know it exists—be honest with yourself about what that means.

I’ve been the person scrambling during an outage, wishing we’d prepared better. Don’t be me.

The next outage is coming. The only question is whether it’ll be a brief inconvenience or a resume-generating event.

What’s your honest assessment: If your primary cloud provider went down right now for 2 hours, what would actually happen? And more importantly—what are you doing this week to change that answer?

Drop your thoughts below. Let’s learn from each other before the next incident, not after. 👇


#CloudOutage #SRE #DevOps #DisasterRecovery #CloudComputing #TechLeadership #SiteReliability #ITInfrastructure #EnterpriseIT #TechStrategy #DigitalResilience #CloudArchitecture #dougortiz

Tuesday, November 29, 2016

Great comparison between cloud providers.


In summary, it seems Google Cloud is the most affordable Cloud provider when computing is taken into account.

Article details:
ZDNet Cloud Compute Pricing Bake Off