Combine Affordance map with active exploration policy by deep reinforcement learning to increase manipulation success rate. Especially, we designed a composite robotic manipulator including two paralleled fingers and a suction cup. By introducing promising strategy into grasping process, we make a definite improvement on robot grasping in clutter scenes.