代码编织梦想

目录

1.算法概述

2.仿真效果预览

3.核心MATLAB代码预览

4.完整MATLAB程序


1.算法概述

       假设我们的行为准则已经学习好了, 现在我们处于状态s1, 我在写作业, 我有两个行为 a1, a2, 分别是看电视和写作业, 根据我的经验, 在这种 s1 状态下, a2 写作业 带来的潜在奖励要比 a1 看电视高, 这里的潜在奖励我们可以用一个有关于 s 和 a 的 Q 表格代替, 在我的记忆Q表格中, Q(s1, a1)=-2 要小于 Q(s1, a2)=1, 所以我们判断要选择 a2 作为下一个行为. 现在我们的状态更新成 s2 , 我们还是有两个同样的选择, 重复上面的过程, 在行为准则Q 表中寻找 Q(s2, a1) Q(s2, a2) 的值, 并比较他们的大小, 选取较大的一个. 接着根据 a2 我们到达 s3 并在此重复上面的决策过程. Q learning 的方法也就是这样决策的. 看完决策, 我看在来研究一下这张行为准则 Q 表是通过什么样的方式更改, 提升的.

          机器学习算法可以分为3种:有监督学习(Supervised Learning)、无监督学习(Unsupervised Learning)和强化学习(Reinforcement Learning),如下图所示:
 

在这里插入图片描述

有监督学习、无监督学习、强化学习具有不同的特点:

       有监督学习是有一个label(标记)的,这个label告诉算法什么样的输入对应着什么样的输出,常见的算法是分类、回归等;
无监督学习则是没有label(标记),常见的算法是聚类;
强化学习强调如何基于环境而行动,以取得最大化的预期利益。

主要学习内容:
强化学习是什么,奖励思想。
强化学习的三种途径。
深度强化学习的“深”是什么意思

Q-Learning的QTable标签更新公式:​

​Q-Learning的计算步骤:​

​1.判断在当前位置可以有几种操作;​

​2.根据当前位置允许的操作选择一个操作;​

​3.根据选择的操作进行奖赏;​

​4.修改当前行为的本次操作权重;

2.仿真效果预览

matlab2022a仿真结果如下:

 

3.核心MATLAB代码预览

function varargout =PathPlanning(varargin)
% 移动机器人路径规划仿真平台接口:仿真平台提供了机器人工作环境的仿真界面,利用inf=load('inf'),sp=inf.StartPoint,
% EP=inf.EndPoint,WS=inf.env得到机器人工作环境的出发点、目标点位置及障碍物位置信息,工作空间边界及障碍物区域设置为1,自由空间
%设置为0。 
gui_Singleton = 1;
gui_State = struct('gui_Name',       mfilename, ...
                   'gui_Singleton',  gui_Singleton, ...
                   'gui_OpeningFcn', @Simulation_OpeningFcn, ...
                   'gui_OutputFcn',  @Simulation_OutputFcn, ...
                   'gui_LayoutFcn',  [] , ...
                   'gui_Callback',   []);
if nargin && ischar(varargin{1})
    gui_State.gui_Callback = str2func(varargin{1});
end

if nargout
    [varargout{1:nargout}] = gui_mainfcn(gui_State, varargin{:});
else
    gui_mainfcn(gui_State, varargin{:});
end
% End initialization code - DO NOT EDIT


% --- Executes just before GridSimulation is made visible.
function Simulation_OpeningFcn(hObject, eventdata, handles, varargin)
% This function has no output args, see OutputFcn.
% hObject    handle to figure
% eventdata  reserved - to be defined in a future version of MATLAB
% handles    structure with handles and user data (see GUIDATA)
% varargin   command line arguments to GridSimulation (see VARARGIN)

% Choose default command line output for GridSimulation
handles.output = hObject;
% Update handles structure
guidata(hObject, handles);
% UIWAIT makes GridSimulation wait for user response (see UIRESUME)
% uiwait(handles.mainfig);
%cd D:\Simulation\EvolvingPath\path
cla
grid on
xlabel('X'); ylabel('Y');
%初始化,获取各对象句柄
handles.StartPoint=findobj('tag','StartPoint'); %获取“设置开始点”按钮句柄
handles.EndPoint=findobj('tag','EndPoint');     %获取“设置目标点”按钮句柄
handles.Obstacle=findobj('tag','Obstacle');     %获取“设置障碍物”按钮句柄
handles.Start=findobj('tag','Start');           %获取“开始运行”按钮句柄
handles.OldEnv=findobj('tag','OldEnv');           %获取“还原环境”按钮句柄
handles.MainAxes=findobj('tag','MainAxes');     %获取主坐标句柄
handles.MainFigure=findobj('tag','MainFigure'); %获取主窗口句柄
%初始化,设置各按钮显示状态
set(handles.StartPoint,'Enable','on')   %“设置开始点”按钮可用
set(handles.EndPoint,'Enable','off')    %“设置目标点”按钮禁用
set(handles.Obstacle,'Enable','off')    %“设置障碍物”按钮禁用
set(handles.Start,'Enable','off')       %“开始运行”按钮禁用
set(handles.OldEnv,'Enable','off')       %“还原环境”按钮可用
set(handles.MainFigure,'WindowButtonDownFcn','');   %
set(handles.MainFigure,'WindowButtonUpFcn','');     %
set(handles.MainAxes,'ButtonDownFcn','');           %
set(handles.MainAxes,'ButtonDownFcn','');           %
inf=load('inf');    %打开环境信息文件,inf.mat由save命令创建,存储了开始点、目标点、障碍物信息等
XLim=20;    %x轴最大取值
YLim=20;    %y轴最大取值
BreakTask=0;        %初始化终止任务变量
    for i=1:XLim  %将边界设置成障碍物
        for j=1:YLim
            if ((i==1)|(i==XLim)|(j==1)|(j==YLim))
                ws(i,j)=1;
            end
        end
    end
save('inf','ws','-append');
save('inf','BreakTask','-append');

% --- Outputs from this function are returned to the command line.
function varargout = Simulation_OutputFcn(hObject, eventdata, handles) 
% varargout  cell array for returning output args (see VARARGOUT);
% hObject    handle to figure
% eventdata  reserved - to be defined in a future version of MATLAB
% handles    structure with handles and user data (see GUIDATA)

% Get default command line output from handles structure
varargout{1} = handles.output;
% --- Executes on button press in StartPoint.
function StartPoint_Callback(hObject, eventdata, handles)
% hObject    handle to StartPoint (see GCBO)
% eventdata  reserved - to be defined in a future version of MATLAB
% handles    structure with handles and user data (see GUIDATA)
set(handles.StartPoint,'Enable','off')
set(handles.EndPoint,'Enable','on')
set(handles.Obstacle,'Enable','off')
set(handles.Start,'Enable','off')
flag=0;
save('inf','flag','-append');
set(handles.MainFigure,'WindowButtonDownFcn','');
set(handles.MainFigure,'WindowButtonUpFcn','');
set(handles.MainAxes,'ButtonDownFcn','PathPlanning(''MainAxes_ButtonDownFcn'',gcbo,[],guidata(gcbo))');
% --- Executes on button press in EndPoint.
function EndPoint_Callback(hObject, eventdata, handles)
% hObject    handle to EndPoint (see GCBO)
% eventdata  reserved - to be defined in a future version of MATLAB
% handles    structure with handles and user data (see GUIDATA)
set(handles.StartPoint,'Enable','off')
set(handles.EndPoint,'Enable','off')
set(handles.Obstacle,'Enable','on')
set(handles.Start,'Enable','on')
flag=1;
save('inf','flag','-append');
%set(handles.MainFigure,'WindowButtonDownFcn','');
%set(handles.MainFigure,'WindowButtonUpFcn','');
set(handles.MainAxes,'ButtonDownFcn','PathPlanning(''MainAxes_ButtonDownFcn'',gcbo,[],guidata(gcbo))');
% --- Executes on mouse press over axes background.
function MainAxes_ButtonDownFcn(hObject, eventdata, handles)
% hObject    handle to MainAxes (see GCBO)
% eventdata  reserved - to be defined in a future version of MATLAB
% handles    structure with handles and user data (see GUIDATA)
inf=load('inf');
flag=inf.flag;
start_end=inf.start_end;
p=get(handles.MainAxes,'CurrentPoint');
hold on;
if(flag==0)
    p=round(p);
    start_end(1,1)=p(1,1);start_end(1,2)=p(1,2);   %记录起点信息,给inf.mat文件赋值
    StartPoint(1,1)=p(1,1);StartPoint(1,2)=p(1,2);       %为当前点赋值,当前点为起点的位置信息

    save('inf','StartPoint','-append');
    HRobot=plot(start_end(1,1),start_end(1,2),'pentagram');                %画开始点位置
    text(start_end(1,1)-.5,start_end(1,2)-.5,'Start');
    RobotDirection=inf.RobotDirection;%机器人方向应该是传递参数
    x=start_end(1,1);
    y=start_end(1,2);
    RobotPosX=x;
    RobotPosY=y;
   save('inf','RobotPosX','-append');
   save('inf','RobotPosY','-append');
else
    p=round(p);
    start_end(2,1)=p(1,1);start_end(2,2)=p(1,2);
    EndPoint(1,1)=p(1,1);EndPoint(1,2)=p(1,2);       %为当前点赋值,当前点为结束点的位置信息
    EndPoint=round(EndPoint);
    save('inf','EndPoint','-append');
    plot(start_end(2,1),start_end(2,2),'*','color','r')
    text(start_end(2,1)-.5,start_end(2,2)+.5,'Goal');
end
save('inf','start_end','-append');
set(handles.MainAxes,'ButtonDownFcn','');
set(handles.MainAxes,'ButtonDownFcn','');

% --- Executes on button press in Obstacle.
function Obstacle_Callback(hObject, eventdata, handles)
% hObject    handle to Obstacle (see GCBO)
% eventdata  reserved - to be defined in a future version of MATLAB
% handles    structure with handles and user data (see GUIDATA)
env=zeros(50);
save('inf','env','-append');
set(handles.StartPoint,'Enable','off')
set(handles.EndPoint,'Enable','off')
set(handles.Obstacle,'Enable','on')
set(handles.Start,'Enable','on')
set(handles.OldEnv,'Enable','on')       %“开始运行”按钮禁用
set(handles.MainFigure,'WindowButtonDownFcn','PathPlanning(''MainFigure_WindowButtonDownFcn'',gcbo,[],guidata(gcbo))');
%set(handles.MainFigure,'WindowButtonUpFcn','PathPlanning(''MainFigure_WindowButtonUpFcn'',gcbo,[],guidata(gcbo))');
function MainFigure_WindowButtonDownFcn(hObject, eventdata, handles)
% hObject    handle to MainFigure (see GCBO)
% eventdata  reserved - to be defined in a future version of MATLAB
% handles    structure with handles and user data (see GUIDATA)
    inf=load('inf'); 
    ws=inf.env;
    Pos=get(handles.MainAxes,'CurrentPoint');
    Pos=round(Pos);
    XPos=Pos(1,1);YPos=Pos(1,2);       %当前点坐标
    X=[XPos-.5,XPos-.5,XPos+.5,XPos+.5];
    Y=[YPos-.5,YPos+.5,YPos+.5,YPos-.5];
    fill(X,Y,[0 0 0])                   %画障碍物
    text(13-.2,12,'B','color',[1 1 1]);
    text(7-.2,8,'A','color',[1 1 1]);
  %  for i=XPos-1:XPos+1
   %     for j=YPos-1:YPos+1
  %          if((i>0)&(i<=XLim))           %防止出现环境矩阵元素下标为零
  %              if((j>0)&(j<=YLim))
                    ws(XPos,YPos)=1;
  %              end
  %          end
  %      end
  %end
   env=ws;
    save('inf','env','-append');

% --- Executes on button press in SensorChecked.
function SensorChecked_Callback(hObject, eventdata, handles)
% hObject    handle to SensorChecked (see GCBO)
% eventdata  reserved - to be defined in a future version of MATLAB
% handles    structure with handles and user data (see GUIDATA)


% Hint: get(hObject,'Value') returns toggle state of SensorChecked

function RobotVelocity_Callback(hObject, eventdata, handles)    %设置机器人运行速度
% hObject    handle to RobotVelocity (see GCBO)
% eventdata  reserved - to be defined in a future version of MATLAB
% handles    structure with handles and user data (see GUIDATA)

% Hints: get(hObject,'String') returns contents of RobotVelocity as text
%        str2double(get(hObject,'String')) returns contents of RobotVelocity as a double   
 
function RobotRadius_Callback(hObject, eventdata, handles)      %设置机器人半径
% hObject    handle to RobotRadius (see GCBO)
% eventdata  reserved - to be defined in a future version of MATLAB
% handles    structure with handles and user data (see GUIDATA)

% Hints: get(hObject,'String') returns contents of RobotRadius as text
%        str2double(get(hObject,'String')) returns contents of RobotRadius as a double
% --- Executes during object creation, after setting all properties.

function SensorMaxValue_Callback(hObject, eventdata, handles)       %设置传感器测量范围
% hObject    handle to SensorMaxValue (see GCBO)
% eventdata  reserved - to be defined in a future version of MATLAB
% handles    structure with handles and user data (see GUIDATA)

% Hints: get(hObject,'String') returns contents of SensorMaxValue as text
%        str2double(get(hObject,'String')) returns contents of SensorMaxValue as a double    
    
function Handbook_Callback(hObject, eventdata, handles)                 %系统简介
% hObject    handle to Handbook (see GCBO)
% eventdata  reserved - to be defined in a future version of MATLAB
% handles    structure with handles and user data (see GUIDATA)
uiopen('系统简介.txt',1)

function ClearScreen_Callback(hObject, eventdata, handles)      %重新开始
% hObject    handle to ClearScreen (see GCBO)
% eventdata  reserved - to be defined in a future version of MATLAB
% handles    structure with handles and user data (see GUIDATA)

set(handles.StartPoint,'Enable','on')   %“设置开始点”按钮可用
set(handles.EndPoint,'Enable','off')    %“设置目标点”按钮禁用
set(handles.Obstacle,'Enable','off')    %“设置障碍物”按钮禁用
set(handles.Start,'Enable','off')       %“开始运行”按钮禁用
cla
clear all
% --- Executes on button press in OldEnv.
function OldEnv_Callback(hObject, eventdata, handles)
% hObject    handle to OldEnv (see GCBO)
% eventdata  reserved - to be defined in a future version of MATLAB
% handles    structure with handles and user data (see GUIDATA)
XLim=20;    %x轴最大取值
YLim=20;    %y轴最大取值
inf=load('inf');
ws=inf.env;  %得到障碍物信息
SP=inf.StartPoint; %出发点位置
EP=inf.EndPoint;   %目标点位置
set(handles.StartPoint,'Enable','off')
set(handles.EndPoint,'Enable','off')
set(handles.Obstacle,'Enable','off')
set(handles.Start,'Enable','on')
HandleStart=line([SP(1,1) SP(1,1)],[SP(1,2) SP(1,2)]);  %设置开始点
text(SP(1,1)-.5,SP(1,2)-.5,'Start');
HandleTarget=line([EP(1,1) EP(1,1)],[EP(1,2) EP(1,2)]); %设置目标点
text(EP(1,1)-.5,EP(1,2)+.5,'Goal');
set(HandleStart,'marker','pentagram')
set(HandleTarget,'marker','*','color','r')
    for i=1:XLim  %将边界设置成障碍物
        for j=1:YLim
            if ((i==1)|(i==XLim)|(j==1)|(j==YLim))
                ws(i,j)=1;
            end
        end
    end
for i=2:XLim-1                          %还原障碍物信息
    for j=2:YLim-1
        if((ws(i,j)==1))
           X=[i-.5,i-.5,i+.5,i+.5];
            Y=[j-.5,j+.5,j+.5,j-.5];
         fill(X,Y,[0 0 0]);  %设置障碍物
        end
    end
end
           X=[1-.5,1-.5,1+.5,1+.5];
            Y=[6-.5,6+.5,6+.5,6-.5];
         fill(X,Y,[0 0 0]);  %设置障碍物
          X=[1-.5,1-.5,1+.5,1+.5];
            Y=[14-.5,14+.5,14+.5,14-.5];
         fill(X,Y,[0 0 0]);  %设置障碍物
                   X=[10-.5,10-.5,10+.5,10+.5];
            Y=[1-.5,1+.5,1+.5,1-.5];
         fill(X,Y,[0 0 0]);  %设置障碍物
text(13-.2,12,'B','color',[1 1 1]);
text(7-.2,8,'A','color',[1 1 1]);
X=[0,0,.5,.5];
Y=[0,YLim,YLim,0];
fill(X,Y,[0 0 0]);  %设置边界为障碍物
X=[XLim-.5,XLim-.5,XLim,XLim];
Y=[0,YLim,YLim,0];
fill(X,Y,[0 0 0]);  %设置边界为障碍物
X=[0,0,XLim,XLim];
Y=[YLim-.5,YLim,YLim,YLim-.5];
fill(X,Y,[0 0 0]);  %设置边界为障碍物
X=[0,0,XLim,XLim];
Y=[0,.5,.5,0];
fill(X,Y,[0 0 0]);  %设置边界为障碍物
%axis([0 20 0 20])
%机器人当前位置设置为开始位置
RobotPosX=SP(1,1);
RobotPosY=SP(1,2);
    save('inf','RobotPosX','-append');
    save('inf','RobotPosY','-append');
    
function RobotSingleLength_Callback(hObject, eventdata, handles)    %设置单步运行距离
% hObject    handle to RobotSingleLength (see GCBO)
% eventdata  reserved - to be defined in a future version of MATLAB
% handles    structure with handles and user data (see GUIDATA)

% Hints: get(hObject,'String') returns contents of RobotSingleLength as text
%        str2double(get(hObject,'String')) returns contents of RobotSingleLength as a double

function BreakTask_Callback(hObject, eventdata, handles)
% hObject    handle to BreakTask (see GCBO)
% eventdata  reserved - to be defined in a future version of MATLAB
% handles    structure with handles and user data (see GUIDATA)
BreakTask=1;
inf=load('inf');
save('inf','BreakTask','-append');
function SaveAs_Callback(hObject, eventdata, handles)
% hObject    handle to SaveAs (see GCBO)
% eventdata  reserved - to be defined in a future version of MATLAB
% handles    structure with handles and user data (see GUIDATA)
%saveas(hObject,'g.bmp');
%print(gcf, '-depsc','-tiff','-r600','test.eps')
%saveas(gcf, 'test.eps', 'psc2')
%pause
axes(handles.MainAxes); %取得axes1的句柄
if isempty(handles.MainAxes)
   return;
end
newFig = figure;%由于直接保存axes1上的图像有困难,所以保存在新建的figure中的谱图
set(newFig,'Visible','off','color',[1,1,1])%设置新建的figure为不可见
newAxes = copyobj(handles.MainAxes,newFig);   %将axes1中的图复制到新建的figure中
set(newAxes,'Units','default','Position','default');    % 设置图显示的位置
[filename,pathname] = uiputfile({ '*.tif','figure type(*.tif)'}, '结果另存为');
if isequal(filename,0)||isequal(pathname,0)%如果用户选择“取消”,则退出
    return;
else
    fpath=fullfile(pathname,filename);
end
f = getframe(newFig);
f = frame2im(f);
imwrite(f, fpath);
%saveas(newFig,'filename.eps')
%close(newFig)
%移动机器人路径规划仿真平台程序 END END END END END END END END END END END END END END END END END END END
% --------------------------------------------------------------------
function MainFigure_WindowButtonMotionFcn(hObject, eventdata, handles)
% hObject    handle to MainFigure (see GCBO)
% eventdata  reserved - to be defined in a future version of MATLAB
% handles    structure with handles and user data (see GUIDATA)    
%h=get(handles.MainFigure,'SelectionType')

function RobotRadius_CreateFcn(hObject, eventdata, handles)
% hObject    handle to RobotRadius (see GCBO)
% eventdata  reserved - to be defined in a future version of MATLAB
% handles    empty - handles not created until after all CreateFcns called

% Hint: edit controls usually have a white background on Windows.
%       See ISPC and COMPUTER.
if ispc && isequal(get(hObject,'BackgroundColor'), get(0,'defaultUicontrolBackgroundColor'))
    set(hObject,'BackgroundColor','white');
end


function mainfig_CreateFcn(hObject, eventdata, handles)
% hObject    handle to mainfig (see GCBO)
% eventdata  reserved - to be defined in a future version of MATLAB
% handles    empty - handles not created until after all CreateFcns called
% --- Executes during object creation, after setting all properties.
function MainFigure_CreateFcn(hObject, eventdata, handles)
% hObject    handle to MainFigure (see GCBO)
% eventdata  reserved - to be defined in a future version of MATLAB
% handles    empty - handles not created until after all CreateFcns called
% --- Executes on button press in Start.







% --- Executes during object creation, after setting all properties.
function RobotSingleLength_CreateFcn(hObject, eventdata, handles)
% hObject    handle to RobotSingleLength (see GCBO)
% eventdata  reserved - to be defined in a future version of MATLAB
% handles    empty - handles not created until after all CreateFcns called

% Hint: edit controls usually have a white background on Windows.
%       See ISPC and COMPUTER.
if ispc && isequal(get(hObject,'BackgroundColor'), get(0,'defaultUicontrolBackgroundColor'))
    set(hObject,'BackgroundColor','white');
end


% --- Executes during object creation, after setting all properties.
function SensorMaxValue_CreateFcn(hObject, eventdata, handles)
% hObject    handle to SensorMaxValue (see GCBO)
% eventdata  reserved - to be defined in a future version of MATLAB
% handles    empty - handles not created until after all CreateFcns called

% Hint: edit controls usually have a white background on Windows.
%       See ISPC and COMPUTER.
if ispc && isequal(get(hObject,'BackgroundColor'), get(0,'defaultUicontrolBackgroundColor'))
    set(hObject,'BackgroundColor','white');
end





% --- Executes during object creation, after setting all properties.
function RobotVelocity_CreateFcn(hObject, eventdata, handles)
% hObject    handle to RobotVelocity (see GCBO)
% eventdata  reserved - to be defined in a future version of MATLAB
% handles    empty - handles not created until after all CreateFcns called

% Hint: edit controls usually have a white background on Windows.
%       See ISPC and COMPUTER.
if ispc && isequal(get(hObject,'BackgroundColor'), get(0,'defaultUicontrolBackgroundColor'))
    set(hObject,'BackgroundColor','white');
end



function Sensor1Length_Callback(hObject, eventdata, handles)
% hObject    handle to Sensor1Length (see GCBO)
% eventdata  reserved - to be defined in a future version of MATLAB
% handles    structure with handles and user data (see GUIDATA)

% Hints: get(hObject,'String') returns contents of Sensor1Length as text
%        str2double(get(hObject,'String')) returns contents of Sensor1Length as a double


% --- Executes during object creation, after setting all properties.
function Sensor1Length_CreateFcn(hObject, eventdata, handles)
% hObject    handle to Sensor1Length (see GCBO)
% eventdata  reserved - to be defined in a future version of MATLAB
% handles    empty - handles not created until after all CreateFcns called

% Hint: edit controls usually have a white background on Windows.
%       See ISPC and COMPUTER.
if ispc && isequal(get(hObject,'BackgroundColor'), get(0,'defaultUicontrolBackgroundColor'))
    set(hObject,'BackgroundColor','white');
end




function Sensor2Length_Callback(hObject, eventdata, handles)
% hObject    handle to Sensor2Length (see GCBO)
% eventdata  reserved - to be defined in a future version of MATLAB
% handles    structure with handles and user data (see GUIDATA)

% Hints: get(hObject,'String') returns contents of Sensor2Length as text
%        str2double(get(hObject,'String')) returns contents of Sensor2Length as a double


% --- Executes during object creation, after setting all properties.
function Sensor2Length_CreateFcn(hObject, eventdata, handles)
% hObject    handle to Sensor2Length (see GCBO)
% eventdata  reserved - to be defined in a future version of MATLAB
% handles    empty - handles not created until after all CreateFcns called

% Hint: edit controls usually have a white background on Windows.
%       See ISPC and COMPUTER.
if ispc && isequal(get(hObject,'BackgroundColor'), get(0,'defaultUicontrolBackgroundColor'))
    set(hObject,'BackgroundColor','white');
end


function Sensor3Length_Callback(hObject, eventdata, handles)
% hObject    handle to Sensor3Length (see GCBO)
% eventdata  reserved - to be defined in a future version of MATLAB
% handles    structure with handles and user data (see GUIDATA)

% Hints: get(hObject,'String') returns contents of Sensor3Length as text
%        str2double(get(hObject,'String')) returns contents of Sensor3Length as a double


% --- Executes during object creation, after setting all properties.
function Sensor3Length_CreateFcn(hObject, eventdata, handles)
% hObject    handle to Sensor3Length (see GCBO)
% eventdata  reserved - to be defined in a future version of MATLAB
% handles    empty - handles not created until after all CreateFcns called

% Hint: edit controls usually have a white background on Windows.
%       See ISPC and COMPUTER.
if ispc && isequal(get(hObject,'BackgroundColor'), get(0,'defaultUicontrolBackgroundColor'))
    set(hObject,'BackgroundColor','white');
end


function Sensor4Length_Callback(hObject, eventdata, handles)
% hObject    handle to Sensor4Length (see GCBO)
% eventdata  reserved - to be defined in a future version of MATLAB
% handles    structure with handles and user data (see GUIDATA)

% Hints: get(hObject,'String') returns contents of Sensor4Length as text
%        str2double(get(hObject,'String')) returns contents of Sensor4Length as a double


% --- Executes during object creation, after setting all properties.
function Sensor4Length_CreateFcn(hObject, eventdata, handles)
% hObject    handle to Sensor4Length (see GCBO)
% eventdata  reserved - to be defined in a future version of MATLAB
% handles    empty - handles not created until after all CreateFcns called

% Hint: edit controls usually have a white background on Windows.
%       See ISPC and COMPUTER.
if ispc && isequal(get(hObject,'BackgroundColor'), get(0,'defaultUicontrolBackgroundColor'))
    set(hObject,'BackgroundColor','white');
end


function Sensor5Length_Callback(hObject, eventdata, handles)
% hObject    handle to Sensor5Length (see GCBO)
% eventdata  reserved - to be defined in a future version of MATLAB
% handles    structure with handles and user data (see GUIDATA)

% Hints: get(hObject,'String') returns contents of Sensor5Length as text
%        str2double(get(hObject,'String')) returns contents of Sensor5Length as a double


% --- Executes during object creation, after setting all properties.
function Sensor5Length_CreateFcn(hObject, eventdata, handles)
% hObject    handle to Sensor5Length (see GCBO)
% eventdata  reserved - to be defined in a future version of MATLAB
% handles    empty - handles not created until after all CreateFcns called

% Hint: edit controls usually have a white background on Windows.
%       See ISPC and COMPUTER.
if ispc && isequal(get(hObject,'BackgroundColor'), get(0,'defaultUicontrolBackgroundColor'))
    set(hObject,'BackgroundColor','white');
end


function Sensor6Length_Callback(hObject, eventdata, handles)
% hObject    handle to Sensor6Length (see GCBO)
% eventdata  reserved - to be defined in a future version of MATLAB
% handles    structure with handles and user data (see GUIDATA)

% Hints: get(hObject,'String') returns contents of Sensor6Length as text
%        str2double(get(hObject,'String')) returns contents of Sensor6Length as a double


% --- Executes during object creation, after setting all properties.
function Sensor6Length_CreateFcn(hObject, eventdata, handles)
% hObject    handle to Sensor6Length (see GCBO)
% eventdata  reserved - to be defined in a future version of MATLAB
% handles    empty - handles not created until after all CreateFcns called

% Hint: edit controls usually have a white background on Windows.
%       See ISPC and COMPUTER.
if ispc && isequal(get(hObject,'BackgroundColor'), get(0,'defaultUicontrolBackgroundColor'))
    set(hObject,'BackgroundColor','white');
end


function Sensor7Length_Callback(hObject, eventdata, handles)
% hObject    handle to Sensor7Length (see GCBO)
% eventdata  reserved - to be defined in a future version of MATLAB
% handles    structure with handles and user data (see GUIDATA)

% Hints: get(hObject,'String') returns contents of Sensor7Length as text
%        str2double(get(hObject,'String')) returns contents of Sensor7Length as a double


% --- Executes during object creation, after setting all properties.
function Sensor7Length_CreateFcn(hObject, eventdata, handles)
% hObject    handle to Sensor7Length (see GCBO)
% eventdata  reserved - to be defined in a future version of MATLAB
% handles    empty - handles not created until after all CreateFcns called

% Hint: edit controls usually have a white background on Windows.
%       See ISPC and COMPUTER.
if ispc && isequal(get(hObject,'BackgroundColor'), get(0,'defaultUicontrolBackgroundColor'))
    set(hObject,'BackgroundColor','white');
end



function Sensor8Length_Callback(hObject, eventdata, handles)
% hObject    handle to Sensor8Length (see GCBO)
% eventdata  reserved - to be defined in a future version of MATLAB
% handles    structure with handles and user data (see GUIDATA)

% Hints: get(hObject,'String') returns contents of Sensor8Length as text
%        str2double(get(hObject,'String')) returns contents of Sensor8Length as a double


% --- Executes during object creation, after setting all properties.
function Sensor8Length_CreateFcn(hObject, eventdata, handles)
% hObject    handle to Sensor8Length (see GCBO)
% eventdata  reserved - to be defined in a future version of MATLAB
% handles    empty - handles not created until after all CreateFcns called

% Hint: edit controls usually have a white background on Windows.
%       See ISPC and COMPUTER.
if ispc && isequal(get(hObject,'BackgroundColor'), get(0,'defaultUicontrolBackgroundColor'))
    set(hObject,'BackgroundColor','white');
end


% --------------------------------------------------------------------

function RobotPosX_Callback(hObject, eventdata, handles)
% hObject    handle to RobotPosX (see GCBO)
% eventdata  reserved - to be defined in a future version of MATLAB
% handles    structure with handles and user data (see GUIDATA)

% Hints: get(hObject,'String') returns contents of RobotPosX as text
%        str2double(get(hObject,'String')) returns contents of RobotPosX as a double


% --- Executes during object creation, after setting all properties.
function RobotPosX_CreateFcn(hObject, eventdata, handles)
% hObject    handle to RobotPosX (see GCBO)
% eventdata  reserved - to be defined in a future version of MATLAB
% handles    empty - handles not created until after all CreateFcns called

% Hint: edit controls usually have a white background on Windows.
%       See ISPC and COMPUTER.
if ispc && isequal(get(hObject,'BackgroundColor'), get(0,'defaultUicontrolBackgroundColor'))
    set(hObject,'BackgroundColor','white');
end



function RobotPosY_Callback(hObject, eventdata, handles)
% hObject    handle to RobotPosY (see GCBO)
% eventdata  reserved - to be defined in a future version of MATLAB
% handles    structure with handles and user data (see GUIDATA)

% Hints: get(hObject,'String') returns contents of RobotPosY as text
%        str2double(get(hObject,'String')) returns contents of RobotPosY as a double


% --- Executes during object creation, after setting all properties.
function RobotPosY_CreateFcn(hObject, eventdata, handles)
% hObject    handle to RobotPosY (see GCBO)
% eventdata  reserved - to be defined in a future version of MATLAB
% handles    empty - handles not created until after all CreateFcns called

% Hint: edit controls usually have a white background on Windows.
%       See ISPC and COMPUTER.
if ispc && isequal(get(hObject,'BackgroundColor'), get(0,'defaultUicontrolBackgroundColor'))
    set(hObject,'BackgroundColor','white');
end






% --- Executes on selection change in popupmenu6.
function popupmenu6_Callback(hObject, eventdata, handles)
% hObject    handle to popupmenu6 (see GCBO)
% eventdata  reserved - to be defined in a future version of MATLAB
% handles    structure with handles and user data (see GUIDATA)

% Hints: contents = get(hObject,'String') returns popupmenu6 contents as cell array
%        contents{get(hObject,'Value')} returns selected item from popupmenu6


% --- Executes during object creation, after setting all properties.
function popupmenu6_CreateFcn(hObject, eventdata, handles)
% hObject    handle to popupmenu6 (see GCBO)
% eventdata  reserved - to be defined in a future version of MATLAB
% handles    empty - handles not created until after all CreateFcns called

% Hint: popupmenu controls usually have a white background on Windows.
%       See ISPC and COMPUTER.
if ispc && isequal(get(hObject,'BackgroundColor'), get(0,'defaultUicontrolBackgroundColor'))
    set(hObject,'BackgroundColor','white');
end





function RobotDirection_Callback(hObject, eventdata, handles)
% hObject    handle to RobotDirection (see GCBO)
% eventdata  reserved - to be defined in a future version of MATLAB
% handles    structure with handles and user data (see GUIDATA)

% Hints: get(hObject,'String') returns contents of RobotDirection as text
%        str2double(get(hObject,'String')) returns contents of RobotDirection as a double


% --- Executes during object creation, after setting all properties.
function RobotDirection_CreateFcn(hObject, eventdata, handles)
% hObject    handle to RobotDirection (see GCBO)
% eventdata  reserved - to be defined in a future version of MATLAB
% handles    empty - handles not created until after all CreateFcns called

% Hint: edit controls usually have a white background on Windows.
%       See ISPC and COMPUTER.
if ispc && isequal(get(hObject,'BackgroundColor'), get(0,'defaultUicontrolBackgroundColor'))
    set(hObject,'BackgroundColor','white');
end







% --- Executes on button press in Start.
function Start_Callback(hObject, eventdata, handles)
% hObject    handle to Start (see GCBO)
% eventdata  reserved - to be defined in a future version of MATLAB
% handles    structure with handles and user data (see GUIDATA)




% --- Executes on selection change in Tasklistbox.
function Tasklistbox_Callback(hObject, eventdata, handles)
% hObject    handle to Tasklistbox (see GCBO)
% eventdata  reserved - to be defined in a future version of MATLAB
% handles    structure with handles and user data (see GUIDATA)

% Hints: contents = get(hObject,'String') returns Tasklistbox contents as cell array
%        contents{get(hObject,'Value')} returns selected item from Tasklistbox


% --- Executes during object creation, after setting all properties.
function Tasklistbox_CreateFcn(hObject, eventdata, handles)
% hObject    handle to Tasklistbox (see GCBO)
% eventdata  reserved - to be defined in a future version of MATLAB
% handles    empty - handles not created until after all CreateFcns called

% Hint: listbox controls usually have a white background on Windows.
%       See ISPC and COMPUTER.
if ispc && isequal(get(hObject,'BackgroundColor'), get(0,'defaultUicontrolBackgroundColor'))
    set(hObject,'BackgroundColor','white');
end


% --- Executes on selection change in AlgorithmListBox.
function AlgorithmListBox_Callback(hObject, eventdata, handles)
% hObject    handle to AlgorithmListBox (see GCBO)
% eventdata  reserved - to be defined in a future version of MATLAB
% handles    structure with handles and user data (see GUIDATA)

% Hints: contents = get(hObject,'String') returns AlgorithmListBox contents as cell array
%        contents{get(hObject,'Value')} returns selected item from AlgorithmListBox


% --- Executes during object creation, after setting all properties.
function AlgorithmListBox_CreateFcn(hObject, eventdata, handles)
% hObject    handle to AlgorithmListBox (see GCBO)
% eventdata  reserved - to be defined in a future version of MATLAB
% handles    empty - handles not created until after all CreateFcns called

% Hint: listbox controls usually have a white background on Windows.
%       See ISPC and COMPUTER.
if ispc && isequal(get(hObject,'BackgroundColor'), get(0,'defaultUicontrolBackgroundColor'))
    set(hObject,'BackgroundColor','white');
end
A_006

4.完整MATLAB程序

matlab源码说明_我爱C编程的博客-CSDN博客

V

版权声明:本文为博主原创文章,遵循 CC 4.0 BY-SA 版权协议,转载请附上原文出处链接和本声明。
本文链接:https://blog.csdn.net/hlayumi1234567/article/details/127911716

智能体路径规划_华丽邂逅_的博客-爱代码爱编程_多智能体路径规划

C++实现: 代码如下: #include <iostream> #include <time.h> #include <cstdlib> #include <vector> #include <algorithm> #include <it

深度强化学习系列(1): 深度强化学习概述_旺财搬砖记的博客-爱代码爱编程_强化学习算法

机器学习是人工智能的一个分支,在近30多年已发展为一门多领域交叉学科,涉及概率论、统计学、逼近论、凸分析、计算复杂性理论等的学科。强化学习(RL)作为机器学习的一个子领域,其灵感来源于心理学中的行为主义理论,即智能体如何在环

【论文翻译】target-driven visual navigation in indoor scenes using deep reinforcement learning_猪蒙索洛夫的博客-爱代码爱编程

  摘要: 有两个关于深度强化学习的问题没有得到很好的解决: (1)缺乏对新目标的泛化能力(2)数据效率低下,即,模型需要多次(而且往往代价高昂)反复试验和错误才能收敛,将其应用于实际场景是不切实际的。在本文中,我们解决了这两个问题,并将我们的模型应用到目标驱动的视觉导航中。为了解决第一个问题,我们提出了一个actor-critic模型

【论文阅读】Learning to Drive in a Day-爱代码爱编程

论文下载 & 官方Blog 关于AC算法 传统的强化学习中除了value-based方法,还有一大类就是policy-based方法。在RL任务中,我们本质上最终要学习的是策略(Policy)。前者用的是间接方法,即通过学习值函数(value function)或者动作值函数(action-value function)来得到poli

AI基础:深度强化学习之路-爱代码爱编程

本文来源:深度强化学习实验室 作者:侯宇清,陈玉荣 导语 深度强化学习是深度学习与强化学习相结合的产物,它集成了深度学习在视觉等感知问题上强大的理解能力,以及强化学习的决策能力,实现了端到端学习。深度强化学习的出现使得强化学习技术真正走向实用,得以解决现实场景中的复杂问题。从2013年DQN(深度Q网络,deep Q netw

83篇文献-万字总结强化学习之路-爱代码爱编程

深度强化学习实验室报道 作者:侯宇清,陈玉荣 编辑:DeepRL 深度强化学习是深度学习与强化学习相结合的产物,它集成了深度学习在视觉等感知问题上强大的理解能力,以及强化学习的决策能力,实现了端到端学习。深度强化学习的出现使得强化学习技术真正走向实用,得以解决现实场景中的复杂问题。从2013年DQN(深度Q网络,deep Q network)出

论文阅读之Virtual-to-real Deep Reinforcement Learning-爱代码爱编程

目录 论文意义具体思路强化学习算法的选择测试有效性网络架构反馈设计实验结果分析仿真训练实验测试。实验对照虚拟环境测试真实环境测试实验分析实验结论不足之处(个人意见) 论文意义 规划机器人的运动,从当前位置移动到目标位置。 传统方法:基于激光测绘来获得一个全局障碍图(“Simultaneous localization and mapping:

强化学习应用简述---强化学习方向优秀科学家李玉喜博士创作-爱代码爱编程

强化学习 (reinforcement learning) 经过了几十年的研发,在一直稳定发展,最近取得了很多傲人的成果,后面会有越来越好的进展。强化学习广泛应用于科学、工程、艺术等领域。 下面简单列举一些强化学习的成功案例,然后对强化学习做简介,介绍两个例子:最短路径和围棋,讨论如何应用强化学习,讨论一些仍然存在的问题和建议,介绍《机器学习》强化学习应

基于机器学习具有实时高效任务分配的边缘计算系统-爱代码爱编程

Machine Learning based Timeliness-Guaranteed and Energy-Efficient Task Assignment in Edge Computing Systems 基于机器学习具有实时高效任务分配的边缘计算系统 摘要 物联网(IoT)和机器学习(ML)技术在边缘计算系统中的广泛应用,为智能认知助手(

【深度干货】强化学习应用简述-爱代码爱编程

来源:海豚数据科学实验室   强化学习 (reinforcement learning) 经过了几十年的研发,在一直稳定发展,最近取得了很多傲人的成果,后面会有越来越好的进展。强化学习广泛应用于科学、工程、艺术等领域。 下面简单列举一些强化学习的成功案例,然后对强化学习做简介,介绍两个例子:最短路径和围棋,讨论如何应用强化学习,讨论一些仍然存

【AI视野·今日Robot 机器人论文速览 第十八期】Fri, 2 Jul 2021-爱代码爱编程

AI视野·今日CS.Robotics 机器人学论文速览 Fri, 2 Jul 2021Totally 26 papers 👉上期速览✈更多精彩请移步主页 Daily Robotics Papers Learning to See before Learning to Act: Visual Pre-training for Manipul

汪昭然:构建“元宇宙”和理论基础,让深度强化学习从虚拟走进现实-爱代码爱编程

作者 | 陈彩娴 深度强化学习的故事,可以追溯到2015年: 当时,位于英国伦敦的一家小公司 DeepMind 在《Nature》上发表了一篇文章“Human-level control through deep reinforcement learning”,提出了一种新算法叫 Deep Q-Network(简称“DQN”),应用在 Atar

基于深度强化学习的区域化视觉导航方法​​-爱代码爱编程

基于深度强化学习的区域化视觉导航方法 ​​人工智能技术与咨询​​ 本文来自《上海交通大学学报》,作者李鹏等 在环境中高效导航是智能行为的基础,也是机器人控制领域研究的热点之一.实现自主导航的传统方法是结合一系列硬件和算法解决同步定位和建图、路径规划及动作控制等问题,该类方法在实际应用中取得了良好效果,但需人工设计特征和预先构造地图[1].通过对空间认

多Agent 深度强化学习综述-爱代码爱编程

多Agent 深度强化学习综述 人工智能技术与咨询  来源:《自动化学报》,作者梁星星等 摘 要 近年来,深度强化学习(Deep reinforcement learning,DRL) 在诸多复杂序贯决策问题中取得巨大突破.由于融合了深度学习强大的表征能力和强化学习有效的策略搜索能力,深度强化学习已经成为实现人工智能颇有前景的学习范式.然而,深度

基于Q-learning的无人机三维路径规划(含完整C++代码)-爱代码爱编程

目录 1.实验目标 2.相关原理 3.实验过程 3.1基于Q-learning的三维模型创建 3.2无人机类、环境类和障碍物类的建立 3.3继承和多态的实现 3.4训练 3.5测试 4.完整代码 main.cpp Q-learning.cpp  train.cpp test.cpp environment.cpp map.cp

lesson1强化学习(rl)初印象 学习笔记_小蒋的技术栈记录的博客-爱代码爱编程

一、强化学习引入 ​ 人的智能可以遗传获得也可以通过后天学习;学习有两种,模仿前人的经验是一种学习;如果没有前人的经验可以学习,就需要和环境进行交互,得到反馈来学习。 #mermaid-svg-XUx

自主导航与路径规划无人机研究现状-爱代码爱编程

目录  1.SLAM算法的研究现状  2. 无人机定位研究现状  3 路径规划的研究现状 参考文献 1.SLAM算法的研究现状         移动机器人根据传感器获取的自身状态信息和环境信息构建环境地图的过程被称之为SLAM问题,SLAM问题能否解决是移动机器人自主定位以及路径规划的充分条件。1986年Smith等人[20]首先研究了SLAM