DOC PREVIEW
UCF EEL 5937 - Environments

This preview shows page 1-2-3-4-5-6 out of 18 pages.

Save
View full document
View full document
Premium Document
Do you want full access? Go Premium and unlock all 18 pages.
Access to all documents
Download any document
Ad free experience
View full document
Premium Document
Do you want full access? Go Premium and unlock all 18 pages.
Access to all documents
Download any document
Ad free experience
View full document
Premium Document
Do you want full access? Go Premium and unlock all 18 pages.
Access to all documents
Download any document
Ad free experience
View full document
Premium Document
Do you want full access? Go Premium and unlock all 18 pages.
Access to all documents
Download any document
Ad free experience
View full document
Premium Document
Do you want full access? Go Premium and unlock all 18 pages.
Access to all documents
Download any document
Ad free experience
View full document
Premium Document
Do you want full access? Go Premium and unlock all 18 pages.
Access to all documents
Download any document
Ad free experience
Premium Document
Do you want full access? Go Premium and unlock all 18 pages.
Access to all documents
Download any document
Ad free experience

Unformatted text preview:

Applications. Environments.ApplicationsElectronic commerceSpacecraft controlVirtual communitiesGrid computingSensor networksAnd many others…ConclusionEnvironments, events, actionsEnvironments, events and actionsEnvironments: Accessible vs. inaccessibleEnvironments: Deterministic vs. non-deterministicEnvironments: Static vs. dynamicEnvironments: Episodic vs. non-episodicEnvironments: Discrete vs. continuousPhysical Environment: embodied agentsVirtual environment / InternetEEL 5937Applications.Environments.EEL 5937 Multi Agent SystemsLotzi BölöniEEL 5937ApplicationsEEL 5937Electronic commerce•User interface agents on e-commerce sites•Bidding agents•Controversy:–Acting on behalf of the customer?–On behalf of the seller?–No mechanisms for guaranteeing “loyalty” of agentsEEL 5937Spacecraft control•The ground crew is usually required to track the spacecraft’s progress and decide how to deal with eventualities–Remember the control room for the Apollo moon missions?•Expensive•Very long reaction time if the spacecraft is far•NASA is investigating making the probes more autonomous•Example: Deep Space 1EEL 5937Virtual communities•Agents as placeholders for user–Temporarily–Permanently–Avatars•Virtual corporations–Consumer management agents –Economic recession (the burst of the “internet bubble”) slowed down innovation in 2001-2004–It is picking up again, as companies see agents as an alternative to outsourcing.•Massively multiplayer role playing games–E.g. Everquest, Asheron’s Call etc. –As many times, gaming community is in the technical forefront.–We will see many of these ideas going into the virtual corporationsEEL 5937Grid computing•New paradigm for distributed computing–Similar to the electric grid–Providers and consumers. Contracts, requests, resource management•Popular in the scientific computing community•Has the potential to become a widespread approach–If we manage the complexity of use •Managing a long running computation:–Reacting to events (e.g. hardware failure)–Computation steering–Reconfiguring systems for changing prioritiesEEL 5937Sensor networks•Sensors: –Small hardware devices with sensing and wireless capabilities (e.g. “motes”).–Agents which collect data, communicate to pass them to a “sink”–In-network processing (data fusion, data correlation possible)•Negotiation:–Active vs. passive sensors–Who covers which target•Newest trend: sensor/actuator networks–Sensors: limited power, capabilities, fixed: mostly sensing–Actuators: more power, may be mobile: act on the environmentEEL 5937And many others…•Military applications•Health care•Intelligent home, intelligent car•Dynamic spectrum management:–Negotiate spectrum resource allocations•… maybe you will propose the next one?EEL 5937Conclusion•Many interesting research issues •Many interesting business opportunities–“Agent technology” image hurt by many marketing pushes without significant technology behind them–But real advances were madeEEL 5937Environments, events, actionsEEL 5937Environments, events and actions•The agents live in an environment–The operating system–The internet–The world of Quake / the world of Everquest–For an AIBO robot: the home of the owner–The battlefield•The environment is usually not fixed. It is changing through events and actions.•Events: changes in the environment, for which we do not know the source. •Actions: changes in the environment whose source is the agent or another known entity•We usually consider events and actions to be discrete in time and space.EEL 5937Environments: Accessible vs. inaccessible•An accessible environment is one in which the agent can obtain complete, accurate, up-to-date information about the environment’s state.•Most moderately complex environments (including for example, the everyday physical world and the Internet) are inaccessible.•Accessible environments:–Allows a more formal treatment of the agents–Sensing is not an issue–Planning, combinatorical computations become predominant (e.g. chess!)•Inaccessible environments:–Sensing should be a large part of the agents work–Exact planning less important than short time reactionsEEL 5937Environments: Deterministic vs. non-deterministic•A deterministic environment is one in which any action has a single guaranteed effect. There is no uncertainty about the state that will result from performing an action. •Operating in a non-deterministic environment means that we need to verify the result of our actions. •Deterministic environment:–Single program computing environment with strong reservations … and optimism•Non-deterministic–The physical world–The internet–Multi-agent systemsEEL 5937Environments: Static vs. dynamic•A static environment is one that can be assumed to remain unchanged except by the performance of actions by the agent•A dynamic environment: independent changes happen (events, actions of other agents). •A physical world is a highly dynamic environment. •Some computer environments can be made static, but the interesting ones are dynamic.EEL 5937Environments: Episodic vs. non-episodic•In an episodic environment, the performance of an agent is dependent on a number of discrete episodes, with no link between the performance of the agent in different scenarios. •Episodic environments are simpler, because the agent developer can ignore the long term history of the agent. •Example:–A battery powered robot lives in a non-episodic environment.–Everquest is non-episodic, Unreal Tournament is.EEL 5937Environments: Discrete vs. continuous•An environment is discrete is there are a fixed finite number of entities and percepts in it (e.g. a chess game) •Continuous: no isolatable entities, events as analog change etc. (e.g. the ocean)•Discussion:–Computers are usually perceived as discrete. –Nature is usually perceived as continuous, at least at the macro level. –We can usually isolate actions, because they are performed by the agent–Isolating events is more difficult.EEL 5937Physical Environment: embodied agents•Special case of the environment where the environment is the physical world or a simulation of it.•Agents have a physical location (x,y) or (x,y,z). •The environment has a geography. •Actions and sensing are dependent of physical proximity.•There is a continuity property: you


View Full Document

UCF EEL 5937 - Environments

Documents in this Course
Load more
Download Environments
Our administrator received your request to download this document. We will send you the file to your email shortly.
Loading Unlocking...
Login

Join to view Environments and access 3M+ class-specific study document.

or
We will never post anything without your permission.
Don't have an account?
Sign Up

Join to view Environments 2 2 and access 3M+ class-specific study document.

or

By creating an account you agree to our Privacy Policy and Terms Of Use

Already a member?