8/9/2011

Knowledge based systems

Data, Information, and Knowledge

What is Data and Information? Are they different from Knowledge? Data: Unorganized and
unprocessed facts; static; a set of discrete facts about events Information: Aggregation of data that makes decision making easier Knowledge is derived from information in the same way information is derived from data; it is a persons range of information

What is Knowledge
Knowledge includes facts about the real world entities and the relationship between them
It is an Understanding gained through experience familiarity with the way to perform a task an accumulation of facts, procedural rules, or heuristics

Characteristics of Knowledge: It is voluminous in nature and requires proper

structuring. It may be incomplete and imprecise. It may keep on changing (dynamic).

8/9/2011

Knowledge base
Knowledge base is used to store facts and rules. In order to solve problems, the computer needs an internal model of the world.
This model contains, for example, the description of relevant objects and the relations between these objects. All information must be stored in such a way that it is readily accessible. Various methods have been used for KR, such as logic, semantic networks, frames, scripts, etc...

Knowledge base systems (KBSs)

Deal with treating knowledge and ideas on a computer.
Emphases to the importance of knowledge.

Use inference to solve problems on a computer.

Knowledge-based systems describes programs that reason over extensive knowledge bases.

Have the ability to learn ideas so that they can obtain information from outside to use it appropriately.
The value of the system lies in its ability to make the workings of the human mind understandable and executable on a computer.

Artificial Intelligence vs. KBS

Knowledge based system is part of Artificial Intelligence AI also requires extensive knowledge of the subject at hand.
AI program should have knowledge base Knowledge representation is one of the most important and most active areas in AI. AI programs should be learning in nature and update its knowledge accordingly.

8/9/2011

Intelligence
Intelligence is the capability of observing, learning, remembering and reasoning. AI attempts to develop intelligent agents.

Characteristics of Intelligent system

Use vast amount of knowledge Learn from experience and adopt to changing environment Interact with human using natural language and speech Respond in real time Tolerate error and ambiguity in communication

Artificial Intelligence
The concern of AI is to enable computers behave like human and emulate the reasoning power of humans
in order to do tasks that require human intelligence.

Which task requires intelligence?

Complex arithmetic operations For instance, Solving 220 * 350? Mundane tasks Example, Natural language understanding; face recognition Expert tasks: which require specialists knowledge Example, Medical diagnosis; computer maintenance

Views of AI
AI is found on the premise that:
workings of human mind can be explained in terms of computation, and computers can do the right thing given correct premises and reasoning rules to achieve a specified goal.

Views of AI fall into four categories: Thinking humanly Acting humanly Thinking rationally Acting rationally

8/9/2011

Thinking humanly: The Cognitive Modeling

Reasons like humans do
Programs that behave like humans

Requires understanding of the internal activities of the brain

see how humans behave in certain situations and see if you could make computers behave in that same way. Protocol analysis (think aloud) can help in understanding how human beings solve a given problem

Example. write a program that plays chess.

Instead of making the best possible chess-playing program, you would make one that play chess like people do.

Acting humanly: The Turing Test

Can machines act like human do? Can machines behave intelligently? Turing Test: Operational test for intelligent behavior
do experiments on the ability to achieve human-level performance: can the evaluator differentiate the response of the human being from the AI program? Acting like humans requires AI programs to interact with people

Suggested major components of AI: knowledge, reasoning, language understanding, learning

Thinking Rationally: The Laws of Thought

A system is rational if it thinks/does the right thing through correct reasoning.

Aristotle: provided the correct arguments/

thought structures that always gave correct conclusions given correct premises.
Abebe is a man; all men are mortal; therefore Abebe is mortal These Laws of thought governed the operation of the mind and initiated the field of Logic.

8/9/2011

Acting rationally: The rational agent

Doing the right thing so as to achieve ones goal, given ones beliefs. AI is the study and construction of rational agents (an agent that perceives and acts) Rational action requires the ability to represent knowledge and reason with it so as to reach good decision. Learning for better understanding of how the world works

History of AI
Formally initiated in 1956 and the name AI was coined by John McCarthy. The advent of general purpose computers provided a vehicle for creating artificially intelligent entities.
Used for solving general-purpose problems

Which one is preferred?

General purpose problem solving systems Domain specific systems

History of AI
Development of knowledge-based systems: the key to power
Performance of general-purpose problem solving methods is weak for many complex domains. Use knowledge more suited to make better reasoning in narrow areas of expertise (like human experts do). Early knowledge intensive systems include:
The Dendral program (1969): solved the problem of inferring molecular structure (C6H13NO2). MYCIN (1976): used for medical diagnosis. etc.

8/9/2011

History of AI
Shifts from procedural to declarative programming paradigm.
Rather than telling the computer how to compute a solution, a program consists of a knowledge base of facts and relationships. Rather than running a program to obtain a solution, the user asks question so that the system searches through the KB to determine the answer.

Simulate human mind and learning behavior (Neural Network, Belief Network, Hidden Markov Models, etc. )

How to make computers act like humans?

The following sub-fields are emerged Natural Language processing (enable computers communicate in human language, English, Amharic, ..) Knowledge representation (schemes to store information, both facts and inferences, before and during interrogation) Automated reasoning (use stored information/knowledge to
answer questions and to draw new conclusions)

Machine learning (adapt to new circumstances and accumulate

knowledge)

Computer vision (recognize objects based on patterns in the same way as the human visual system does) Robotics (produce mechanical device capable of controlled motion;
which enable computers to see, hear & take actions)

Is AI equals human intelligence ?

Strong AI vs. Weak AI (due: 5 days)

Artificial Intelligence (or AI) is the concept that it is possible for a computer to think in the same sense as humans do. Strong AI argues that it is possible that one day a computer will be invented which can be called a mind in its fullest sense.
Strong AI aims to create an agent that can replicate humans intelligence completely; i.e.., it can think, reason, imagine, etc., and do all the things that we currently associate with the human brain.

Weak AI, on the other hand, argues that computers can only appear to think and are not actually conscious in the same way as human brains are.
The weak AI position holds that AI should try to develop systems which have facets of intelligence, but the objective is not to build a completely sentient entity. For example, weak AI researchers see their contribution as things like expert systems used for medical diagnosis, speech recognition and data mining, which use "intelligent" models, but they do not help create a conscious agent

8/9/2011

Searle's Chinese Room (another test)

Can a machine be intelligent? Have beliefs? Have a mind?
Those who support strong AI and the strongest forms of functionalism argue that a machine with a digital computer and the right kind of computer program could have a mind. Searle's Chinese room argument tries to show that strong AI is false.

Suppose Searle is in the room, and he uses a dictionary to translate the input characters from Chinese to English; he then constructs his answer to the question, translates that back into Chinese and delivers the output. Does Searle understand Chinese?
Of course not and this is Searle's argument: the computer doesn't understand it either, because all it is doing is translating words (symbols) from one language (representation) to another

Assignment (due: 5 days)

Discuss one of the following concepts. Refer at least five sources (books, articles). present in class. Knowledge based system: [4]
What is KBS? KBS vs. ES vs. AI; Knowledge acquisition, knowledge modeling and knowledge representation (semantic networks, frame, production system, ontology)

Reasoning: [5]
What is reasoning, Case based reasoning; probabilistic reasoning; fuzzy reasoning; rule-based reasoning

Learning: [5]
What is Machine learning? Support Vector Machine, Hidden Markov Model, Bayesian Belief Network

Application areas (answer questions like what; how; challenges; application)

Computer vision and robotics [3] Optical Character Recognition (OCR), Writer identification, Face

recognition; script recognition [4]

Speech Recognition; Speech synthesis ; Speaker Identification [3] Natural Language Processing [3] Natural Language Generation [2] Knowledge discovery in databases [2]

Possible research areas

Optical Character Recognition (OCR) system for Braille documents or Historical documents (printed, typewritten or handwritten) Application of OCR: bank-check reader; passport reader, postal OCR system, etc. Speech Analysis (Speech Recognition; Speech synthesis ; Speaker Identification) integrated speech recognition and synthesis system Intelligent agents (information filtering agent, Web semantic and ontology, intelligent database, etc.) Knowledge management: assess practice, evaluation and model design Knowledge based system (Knowledge acquisition, representation and reasoning) Case based reasoning; probabilistic reasoning; rule-based reasoning Natural Language Processing (machine translation; lexical analysis, lexical synthesis, stemming, parsing, etc.) Security (Face recognition; signature recognition, Writer identification, etc.) Knowledge discovery in databases; data mining; text mining; web mining