# Build a Pick-and-Place Scene in MuJoCo in One Prompt
> A robot arm needs a scene before it can grasp anything. See how to build a pick-and-place scene in MuJoCo, arm, cube, and target, in one prompt with Drift.
**Author:** Drift Team
**Published:** 2026-07-08
**Tag:** Product
**Reading time:** 4 min
**Canonical URL:** https://godrift.ai/blogs/pick-and-place-mujoco
---Before a robot can pick up an object, it first needs something to interact with. That means building the scene before you build the behavior.

&nbsp;

<figure data-type="youtube-embed" data-yt-id="3yXeWnU2SkI" data-autoplay="1" data-loop="1">
  <iframe src="https://www.youtube.com/embed/3yXeWnU2SkI?autoplay=1&mute=1&loop=1&playlist=3yXeWnU2SkI&rel=0&playsinline=1" title="YouTube video player" frameborder="0" allow="accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture; web-share" allowfullscreen loading="lazy"></iframe>
</figure>

This walkthrough builds a complete pick-and-place scene in MuJoCo and rather than assembling every object by hand, we let [Drift](https://link.godrift.ai/place) generate the whole manipulation scene from one prompt.

## Why manipulation starts with the right scene

&nbsp;

Manipulation is about a robot physically interacting with the world, which means the world has to exist first. An arm on its own has nothing to grasp, nowhere to place it, and no layout to plan around.

&nbsp;

A proper pick-and-place setup needs a few things working together: a robot arm, a surface to work on, an object to pick, and a destination to place it. Get that environment right and every task built on top of it, from grasping to motion planning, has something real to work with.

## What goes into a pick-and-place scene

&nbsp;

The goal is simple. We want a [Franka Panda](https://github.com/google-deepmind/mujoco_menagerie) robot arm mounted beside a table, a cube ready to be picked up, and a target location to place it. The Franka Panda is a popular seven-jointed research arm, which makes it a natural choice for a manipulation scene.

That's four pieces that have to be positioned sensibly relative to each other: the arm within reach of the cube, the cube on the table, and the target pad somewhere the arm can also reach.

## Generating the manipulation scene in MuJoCo with Drift

&nbsp;

Instead of placing each object manually, we ask [Drift](https://link.godrift.ai/place) to generate the entire scene, from the robot and table to the cube and target pad, and launch it directly in [MuJoCo](https://www.godrift.ai/blogs/what-is-mujoco). If you're just getting set up, here's [how to install MuJoCo in one prompt](https://www.godrift.ai/blogs/install-mujoco).

&nbsp;

In a few moments everything comes together. The Franka Panda is positioned at the table, the cube is placed within reach of the gripper, and the target pad marks where the object should eventually be moved. What would normally be a fiddly bit of scene authoring is done and running.

## Exploring the Franka Panda arm before adding control

&nbsp;

Before jumping into autonomous control, it's worth exploring the robot manually. Rotate the camera around the scene, then adjust the joints yourself and watch how the arm responds.

&nbsp;

Moving the arm by hand gives you a real feel for how it reaches, how the gripper lines up with the cube, and how a robotic manipulator behaves in general. That intuition is valuable before you move on to harder tasks like motion planning and pick-and-place, because you already understand what the arm can and can't reach.

## Adding motion planning and grasping to the scene

&nbsp;

A finished scene is the launch point for the actual manipulation work. From here you can plan grasps, add a motion planner to move the arm to the cube, and build up a full pick-and-place routine that lifts the cube and sets it on the target pad.

&nbsp;

Before you can teach a robot to manipulate objects, you need the right environment, and with [Drift](https://link.godrift.ai/place), creating that environment is as simple as describing what you want. Generate a scene, explore the arm, and start building your first grasp. The full walkthrough is in the video above.

## FAQ

1. **What is a pick-and-place task in robotics?** Pick-and-place is a common manipulation task where a robot grasps an object at one location and places it at another. It's a building block for many applications, from assembly and packaging to sorting, and it combines perception, grasping, and motion planning.
2. **How do you build a manipulation scene in MuJoCo?** You define the arm, a work surface, an object to manipulate, and a target, all positioned so the arm can reach them, in a MuJoCo scene file. In this walkthrough, Drift generates that entire pick-and-place scene and launches it from a single prompt instead of placing each object by hand.
3. **What is the Franka Panda robot arm?** The Franka Emika Panda is a seven-joint collaborative robot arm widely used in research and education. Its dexterity and available simulation models make it a common choice for manipulation and pick-and-place experiments.
4. **Why explore a robot arm manually before autonomous control?** Moving the joints by hand builds intuition for how the arm reaches, how the gripper aligns with objects, and where its limits are. That understanding makes later work like motion planning and grasping much easier to reason about.
5. **What does Drift generate for a manipulation scene?** [Drift](https://link.godrift.ai/place) generates the full scene, the robot arm, table, object, and target, positions everything sensibly, and launches it in MuJoCo, all from a natural-language prompt, so you get a ready-to-use manipulation environment without building it manually.

## Related reading

- [Build a Realistic Office Environment in MuJoCo in One Prompt](https://www.godrift.ai/blogs/office-environment-mujoco)
- [Build a Quadruped Simulation in MuJoCo in One Prompt](https://www.godrift.ai/blogs/quadruped-simulation-mujoco)
- [MuJoCo: The Physics Engine Robotics Research Quietly Runs On](https://www.godrift.ai/blogs/what-is-mujoco)
- [Install MuJoCo and Run Your First Simulation Without the Setup Grind](https://www.godrift.ai/blogs/install-mujoco)
