How to customize a learning environment?

[hjh0119]

I'm a MARL learner. I want to customize a MARL learning environment based on macad-gym. How should I proceed?

[praveen-palanisamy]

Hi @hjh0119 ,
You can customize the existing multi-agent environments or create your own!

1. To customize existing environments, you can edit the environment configuration to change the environment or actor parameters. For example, to customize the UrbanSignalIntersection3Car environment you can edit/modify these configuration values:
   

   macad-gym/src/macad_gym/envs/intersection/urban_signal_intersection_3c.py

   Lines 11 to 98 in 1006e84

   	USI3C_CONFIGS = {
   	"env": {
   	"server_map": "/Game/Carla/Maps/Town03",
   	"render": True,
   	"render_x_res": 800,
   	"render_y_res": 600,
   	"x_res": 168,
   	"y_res": 168,
   	"framestack": 1,
   	"discrete_actions": True,
   	"squash_action_logits": False,
   	"verbose": False,
   	"use_depth_camera": False,
   	"send_measurements": False,
   	"enable_planner": True,
   	"spectator_loc": [70, -125, 9],
   	"sync_server": True,
   	"fixed_delta_seconds": 0.05,
   	},
   	"actors": {
   	"car1": {
   	"type": "vehicle_4W",
   	"enable_planner": True,
   	"convert_images_to_video": False,
   	"early_terminate_on_collision": True,
   	"reward_function": "corl2017",
   	"scenarios": "SUIC3_TOWN3_CAR1",
   	"manual_control": False,
   	"auto_control": True,
   	"camera_type": "rgb",
   	"collision_sensor": "on",
   	"lane_sensor": "on",
   	"log_images": False,
   	"log_measurements": False,
   	"render": False,
   	"render_x_res": 800,
   	"render_y_res": 600,
   	"x_res": 168,
   	"y_res": 168,
   	"use_depth_camera": False,
   	"send_measurements": False,
   	},
   	"car2": {
   	"type": "vehicle_4W",
   	"enable_planner": True,
   	"convert_images_to_video": False,
   	"early_terminate_on_collision": True,
   	"reward_function": "corl2017",
   	"scenarios": "SUIC3_TOWN3_CAR2",
   	"manual_control": False,
   	"auto_control": True,
   	"camera_type": "rgb",
   	"collision_sensor": "on",
   	"lane_sensor": "on",
   	"log_images": False,
   	"log_measurements": False,
   	"render": False,
   	"render_x_res": 800,
   	"render_y_res": 600,
   	"x_res": 168,
   	"y_res": 168,
   	"use_depth_camera": False,
   	"send_measurements": False,
   	},
   	"car3": {
   	"type": "vehicle_4W",
   	"enable_planner": True,
   	"convert_images_to_video": False,
   	"early_terminate_on_collision": True,
   	"reward_function": "corl2017",
   	"scenarios": "SUIC3_TOWN3_CAR3",
   	"manual_control": False,
   	"auto_control": True,
   	"camera_type": "rgb",
   	"collision_sensor": "on",
   	"lane_sensor": "on",
   	"log_images": False,
   	"log_measurements": False,
   	"render": False,
   	"render_x_res": 800,
   	"render_y_res": 600,
   	"x_res": 168,
   	"y_res": 168,
   	"use_depth_camera": False,
   	"send_measurements": False,
   	},
   	},
   	}

2. To create your own environments, you can follow this Wiki Page on Extending MACAD-Gym with new learning environments

[praveen-palanisamy]

Hi @hjh0119 , would you need any more help to proceed or do you have any follow-up questions?