Skip to content
HomeInsights

Insights

Ideas for building
better software.

Engineering perspectives on architecture, product development, AI, and the everyday decisions behind useful software.

From the engineering desk

Browse practical articles or follow the latest technology updates.

Subscribe via RSS →

Curated links from external sources — not 360Softy original articles.

ExternalAI
AWS Machine Learning Blog

Integrating AWS API MCP Server with Amazon Quick using Amazon Bedrock AgentCore Runtime

This post shows you how to use Amazon Bedrock AgentCore Runtime with Model Context Protocol (MCP) support to connect Amazon Quick with AWS services through the AWS API MCP Server, creating a conversational AI assistant that translates natural language into AWS Command Line Interface (AWS CLI) commands, without the need to switch between tools during critical moments.

Advanced (300)Amazon Bedrock AgentCoreAmazon Quick Suite
AWS Machine Learning BlogRead original
ExternalSoftware Engineering
DZone

Throughput vs Goodput: The Performance Metric You Are Probably Ignoring in LLM Testing

In this blog post, we will see the difference between throughput and goodput, why throughput alone can give you a dangerously false sense of confidence, and how goodput, the metric championed by NVIDIA's AIPerf tool, tells you the truth about your LLM deployment. If you have ever shipped a feature that looked perfectly healthy in your monitoring dashboard but fell apart under real user load, this post is for you.

Let’s start with a conversation

Tell us what you’re working on.

An idea, a challenge, or a system that needs to work better. We’ll help you understand the next step.