Skip to content
Back to skills

Rnd Dual Value Return Combination

ASecurity

Compute separate extrinsic and intrinsic return streams for Random Network Distillation dual-value-head policy optimization.

  • 247 stars
  • 0 votes
  • 0 copies
  • 1 view
  • Added September 9, 2026
testingpython

Works with

  • cli

Security analysis

A100/100

Scanned September 9, 2026

npx -y skills add VectorSpaceLab/AREX-Skill --skill rnd_dual_value_return_combination --agent claude-code

Installs into .claude/skills of the current project.

Are you the author of Rnd Dual Value Return Combination?

Add the live security badge to your README. It updates with every re-scan.

Security grade badge for Rnd Dual Value Return Combination
[![Security: A — Skills Directory](https://www.skillsdirectory.com/api/skills/vectorspacelab-rnd-dual-value-return-combination/badge)](https://www.skillsdirectory.com/skills/vectorspacelab-rnd-dual-value-return-combination)

More formats (shields.io, HTML) on the badges page. Keep it an A: scan every change in CI with Pro.

SKILL.md
---
name: rnd_dual_value_return_combination
description: Compute separate extrinsic and intrinsic return streams for Random Network Distillation dual-value-head policy optimization.
---

# RND Dual Value Return Combination

Use this skill when implementing the RND paper's combination of episodic extrinsic rewards and potentially non-episodic intrinsic rewards. It is appropriate for PPO-style recovery harnesses or tests that need to verify return boundaries. Do not collapse the streams before return computation when the intrinsic stream is non-episodic.

## Inputs
- Extrinsic reward sequence and done flags.
- Intrinsic reward sequence.
- `gamma_E` and `gamma_I`.
- A flag selecting non-episodic intrinsic returns.

## Outputs
- Extrinsic returns for the extrinsic value head.
- Intrinsic returns for the intrinsic value head.
- Combined value target equal to the elementwise sum.

## Workflow
1. Compute extrinsic discounted returns while resetting at episode boundaries.
2. Compute intrinsic returns with either non-episodic continuation or episodic reset, as configured.
3. Keep the two return targets separate for value-head losses.
4. Sum the two value estimates only when forming the combined value target.

## Validation
Run `python scripts/dual_returns.py --self-test`. The test checks that a done flag resets extrinsic returns but does not reset non-episodic intrinsic returns.

## Limitations
This skill does not implement the PPO clipped objective. It defines the return/value-head contract that a PPO implementation should consume.

Attribution

Is this your skill, or is something wrong with this listing? Request removal or report an issue. Author removals are honored within 72 hours.

Comments

Loading comments…