Insights
Ideas for building
better software.
Engineering perspectives on architecture, product development, AI, and the everyday decisions behind useful software.
From the engineering desk
Browse practical articles or follow the latest technology updates.
Subscribe via RSS →Curated links from external sources — not 360Softy original articles.
Next.js 3.0
We are very excited excited to announce the stable release of Next.js 3.0. Ever since our , we have been using it to power and have received lots of feedback and contributions from our .beta announcementvercel.comcommunity Let’s walk through what’s been improved and what’s altogether new, or fetch the latest version from !npm Next.js is a zero-configuration, single-command toolchain for React apps, with built-in server-rendering, code-splitting and more. Check out to get started!New to Next.j
Gathering human feedback
RL-Teacher is an open-source implementation of our interface to train AIs via occasional human feedback rather than hand-crafted reward functions. The underlying technique was developed as a step towards safe AI systems, but also applies to reinforcement learning problems with rewards that are hard to specify.
New Tooling to Improve Your GraphQL Workflows | Prisma
Explore new GraphQL tooling like GraphQL Config and related libraries that improve project setup, tooling integration, and workflows.
Better exploration with parameter noise
We’ve found that adding adaptive noise to the parameters of reinforcement learning algorithms frequently boosts performance. This exploration method is simple to implement and very rarely decreases performance, so it’s worth trying on any problem.
Proximal Policy Optimization
We’re releasing a new class of reinforcement learning algorithms, Proximal Policy Optimization (PPO), which perform comparably or better than state-of-the-art approaches while being much simpler to implement and tune. PPO has become the default reinforcement learning algorithm at OpenAI because of its ease of use and good performance.
Let’s start with a conversation
Tell us what you’re working on.
An idea, a challenge, or a system that needs to work better. We’ll help you understand the next step.
Prefer email? [email protected]

