Saturday, September 3, 2011

Analysis using Blooms Taxonomy

The motive was to analyse a question paper according to Bloom's Taxonomy.
 
 S No.
Question
Comments
Type
1
Analyze the following situation and answer the following questions.
Situation
1) Interpret the function of language used.
2) Elaborate that function.
3) Elaborate that function according to this situation.
The question involves a complex of various levels of Bloom Taxonomy. Part 1 demands the analysis of the situation. Part 2 demands the comprehension and knowledge level. And part 3 requires the application of knowledge about functions of language to this particular situation.
Knowledge
Comprehension
Application
Analysis
2
Explain the following in few words:-
Method, Approach, CLT, DM Role of learner in GTM etc.
The question is an objective type question which is demanding very little, i.e. only the knowledge of the terms asked. There may be some comprehension involved as well as in Role of Learner in GTM.
Knowledge
Comprehension
3
Select and explain the best method you think suitable in Pakistani Govt. Schools.
The question is demanding a knowledge level of evaluation. The student has to select a method and to judge it w.r.t. the given criteria i.e. to be able to use in local context.
Apart from the above view if the student does not see the current available methods suitable he’ll obviously try to devise a new method.
Thus we can see here evaluation and synthesis.
Evaluation
Synthesis
4
Write a comprehensive note on CLT.
The question is demanding understanding of a comprehension level.
Comprehension
5
The aims of linguistic analysis are _______________.
The question only demands a knowledge level as student has to imitate the original.
Knowledge
6
Speech Act theory was introduced by _____________.
The question demands the knowledge level.
Knowledge
7
Prove true or false logically that linguistics is prescriptive not descriptive.
The student has to compare two concepts logically thus the question involves analysis as well as evaluation of the concepts.
Analysis
Evaluation
8
“Young scholars are solving the paper”. Analyze the sentence according to phrase structure grammar.
The question involves an understanding level of Application as well as Analysis. The student will apply the principles of PS Grammar to analyze the sentence.
Application
Analysis
9
“Peterson’s, the publisher of a guide to four-year colleges, said yesterday that from now on it will disclose to readers that schools pay for extra information about themselves in the book.” Divide the sentence into clauses and describe each clause’s function.
The question is also of an analysis and application level question. The student has to recall all the principles about clauses and then apply them to the sentence to identify the clauses and then describe their function.
Application
Analysis
10
Construct a story from the following outline.
Outline
The outlines are just parts of a whole structure. The student will have to focus on these parts and using his imagination he will be able to write a story. So this question involves the construction of a new structure and is of a synthesis level question.
Synthesis
11
Use these idioms and words in your own sentences meaningfully.
Idioms, Words etc.
The question involves the student’s understanding of the meaning, as well as the application of the grammatical knowledge to form sentences and at the same time we can see the formation of new structure from sub-parts i.e. the words or idiomatic phrases. So here we have levels of Knowledge, Comprehension, Application and Synthesis involved.
Knowledge
Comprehension
Application
Synthesis
12
There is no relation between materials and learning. Prove this statement true or false logically.
Here the student has to evaluate the relation between the given concepts to prove the statement true or false. Thus here we have evaluation, analysis and comprehension levels involved.
Comprehension
Analysis
Evaluation
Most of the questions are collected from various papers of linguistics’ courses taught in the same university. It is clear that first three levels are easy to find. Almost all objective questions i.e. fill in the blanks, true/false and MCQs can come under these three basic levels of understanding. Last three levels involve essay type questions.  Questions involve more than one understanding level, as it can be seen above, so the number of questions is decreased to 12 instead of an exact number of (6X3) 18.

Multi/Bilingualism in Pakistani Punjab


The motive was to highlight the bilingual attitude of local Pakistani especially Punjabi Urban Speakers regarding three languages they use in daily life i.e. English, Urdu, Punjabi. I was pre-mature at that time, but the effort was done to create quality content. Of course it was an assignment.
Bilingualism

Bilingual or multilingual is a person who can speak two or more than two languages with equal or less equal proficiency.
A society is called bilingual or multilingual if the people there speak more than one language.

            Bilingualism and multilingualism are referred to same thing mostly. Bilingualism may mean that the users of language are using more than two languages and multilingualism may also mean that the speakers are using two languages in the community or society.
            About half of the world's population is multi/bilingual. It is, in fact, very hard to find a monolingual community or society like Japan etc. While talking about sub continent in general and specially Pakistan we come to know that we are a multilingual community. We use Urdu as a language of communication between different domestic language speakers, thus Urdu working as a lingua franka, we use domestic languages at local level such as Punjabi, Hindko, Barahwi, Sindhi, Pashto, Balochi, Saraiki, Kashmiri etc and we use English also as a foreign language. People of Pakistan are bilingual/trilingual or generally multilingual.
            Bilingualism is believed to be a gradeable system so we can distinguish among its various kinds. Here it will be tried to discuss some concepts relating to multilingualism and then it will be tried to relate them to the local context of Pakistan specially Punjab. As the assignee is a Punjabi, Urdu and English speaker so the examples will be related to these languages mostly, although they will be almost valid for other domestic languages also.
           
            First distinction can be made in bilingualism is that the speaker have equal proficiency in both or all the languages he can speak or write. Such a bilingual is called a balanced bilingual or equilingual. This is not the absolute criteria, there may be some situations where a bilingual's abilities in a given language suffer due to pressure of situation etc. There may also be a situation of more receptive knowledge of once language and more active knowledge of another i.e. he may understand a language but may not speak it and he may speak and understand other language very well. There are also some situations in which bilingual is familiar with the spoken system of one language and written system of another.
            If we compare this kind of bilingualism distinction with our situation we can find certain similarities. Punjabi and Urdu are two languages which are believed  to be known by a person living in Punjab. A Punjabi speaking child learns Urdu along with Punjabi at almost same age. Exposure of both languages at the same time enables him to be proficient in both languages almost equally. But here we come to the point of above para. The difference of reading and writing system hinders here.  A Punjabi speaking child is not necessarily believed to learn writing Punjabi also. He writes in Urdu and it is considered sufficient for him/her. In particular situations where the learner optionally learns Punjabi at school enable him/her to read and write it otherwise it is seen that young speakers of Punjabi avoid reading or writing Punjabi and they feel it convenient to do it in Urdu. So their proficiency suffers here in Punjabi in writing and reading while in Urdu they are proficient in all fields reading, writing, speaking and listening.
            Second kind of distinction in bilingualism can be drawn by the acquisition of language. There are two main processes to learn a language. Acquisition and learning are two methods to learn languages, former is natural and primary while the later is artificial and secondary. A language acquired by a person interacting with his parents, sisters, brothers and friends etc at home will be the native language. Another language he learns at some institute by formal education will be called a foreign or a 2nd or 3rd language. Former bilingual will be called primary and later will be called secondary bilingual.
           
            In case of Urdu and Punjabi we are primary bilinguals. We learn these languages at home, from our surroundings in typical natural situations. While in case of Urdu and English or Punjabi and English we are secondary bilinguals because we learn former from home and later from an institute usually a school.
            A third kind of bilingualism distinction is socio-psychological distinction. The people may feel it additive having another language which enrich their ideas and knowledge. And they may feel it subtractive or loss of their language and culture by another languages (usually a dominant language). In our context this thing is applied to Urdu and English connection in both ways. People feel it additive to their knowledge, considering English as a language of latest knowledge and information and thus enriching their knowledge. People also feel it subtractive in a sense that English is acquiring the place of Urdu in our local life, its words are used and those of Urdu are ignored. So it can be a cause of loss of our culture and identity and there are people who are against its usage.
            A very useful way to describe the bilinguals is the domain specification. A domain is an empirically determined cluster of consisting a location, a set of role relationships and a set of topics. For each domain the bilingual has a pre-defined language to be used. We can see it in this table

Location
Role-relationships
Topics
Home
Mother, Father, Son, Daughter etc
Domestic, Personal etc
Neighborhood
Neighbour, Shop-keeper, street-cleaner
Weather, Shopping, social greetings
School
Teacher, student, principal
Social greetings, educational
Mosque and Religious Places
Imam, Muqtadee, Listener of Sermon etc
Sermons, Prayers, Social talks etc
Work
Boss, Subordinate, Peer
Professional Matters etc

           

            By comparing this theory with our practical use of language we can see what languages we use at each domain. Most likely we use Punjabi at home, talking with parents and other family members on different domestic and even non-domestic issues. With neighbours we also use Punjabi talking with them in different relations. At school the language changes to Urdu, when we talk to our teachers, co-teachers, principle or junior staff and peers etc. At mosque and religious gathering once again we use Urdu usually, sometimes local language is used for better interaction (specially in villages Punjabi is used). At work level or at higher education institutes our talks are a mixture of Urdu and English switching to English when talking in meetings and very formal sittings.

Code Mixing and Code Switching
            In a situation, community or a society where there are bilinguals and they interact with each other in more than one languages, due to the factor of language contact a situation arises which is called code mixing and code switching. This situation can lead towards the language interference in which a language is influenced by another language on the levels of semantics, grammar and phonology.
            A bilingual can talk to another bilingual in each language common between them. He can also use the words of one language into other, knowing that the listener  understands the other language as well. Such kind of mixing is called code mixing.
            Code mixing is also called conversational code switching. Code mixing takes place usually in spoken language as we are less conscious about our language and we have not much time to replace foreign words with native ones. We take it forgranted that other person is understanding us. Code mixing is not only the mixing of words but clauses are also included in it, a part of sentence from one language and other part from other language, and in similar syntactic structured languages such as English and Spanish the grammatical inflexions are also mixed.  It is very much related to domains and situations. At a very formal situation bilinguals can use a mixed code of formal and informal variety in their leisure time. The language in which education is received also influence the choice of words from another language and people tend to code mix who are high educated and specially in a foreign language. It is observed in many countries that teachers having degree from a foreign institute mix their code while delivering lecture.
            If we consider our situation we can find that domains related to education, media and profession are those where people use to mix the code. This code mixing is of two high level formal languages of the community i.e. Urdu and English. Teachers while talking in classroom use frequently the terms of the discipline from English. Media men and specially hosts at TV and radio etc mix the code frequently. They use a blend of Urdu with English and English with Urdu in talk shows and live programmes. An example of a female host from government tv channel PTV is quoted here.
اس وقت آپ کو لگ رہا ہوگا کہ میں بہت ہائپر ہورہی ہوں بڑی ایکسائٹڈ ہورہی ہوں ویسے تو میں ہر وقت ہورہی ہوتی ہوں  نہیں بھی ٹی وی کے سامنے ہوتی تو ہر وقت باتیں کررہی ہوتی ہوں لیکن ہمارے سٹوڈیوز میں بڑے سپیشل دو گیسٹس موجود ہیں انھیں میں سلیبریٹی کپل بھی کہوں  گی تو بالکل بھی غلط نہیں ہوگا۔

            She is mixing English noun, adjectives and verbs in Urdu frequently. We can see the plurals as well used as they are  in Urdu from English.
            Code switching is the umbrella term as compared to code mixing. It involves code mixing as well as the switching of language. Code switching is distinguished from code mixing as here people switch to other language for relatively large chunks of language.
            In our context, if we see, even in classrooms of heigher education levels, the teachers switch to and from the native to foreign language  during their lecture. Similarly media men, professionals also mix and switch their code highly while talking. Here is an example from Pakistani filmstar Javed Sheikh's interview. He is mixing the code and at the end totally shifts to English.
جن کو مجھ پہ کانفیڈنس ہے میرے لیے یہ بہت ضروری تھا کہ ان کا یہ کانفیڈنس برقرار رہے۔ اللہ تعالٰی کا کرم ہے کہ میں نے جو بھی کام کیا ہے “کھلے آسمان کے نیچے” میں   انشاءاللہ Every Pakistani will be proud of it


Borrowing
            Borrowing is very closely related to code mixing and switching. A single person using a foreign word is code mixing while lots of people doing this is called borrowing. Borrowing is to get a foreign language word into native language. In this process its pronunciation may be changed or it can be kept as in Urdu we use English word Policy as palicy. Borrowing can be at semantic level translating certain concepts from foreign to native language. It can be at syntactic level or morphological level to adopt certain language systems in native language.
            Borrowing has a very interesting problem. The meanings of words are changed some times from native meanings and word is used in local language in a different sense. An EFL teacher at Korea reports such problem on his blog. He says that people are using English words in Korean in different sense, these words are when spoken to native speakers of English in local meaning create problems of understanding. In Urdu we have some examples of change in meaning of a borrowed word. Committee is an English noun used in Urdu also as a noun but it is used as a verb also. کمیٹی ڈالنا is a verb which has totally different meanings as compared to the native meaning.
            Code mixing, switching and borrowing is also taking place in domestic languages but it is relatively rare as compared to Urdu. But we can find such examples while traveling in a local bus or standing at a stop.
            اینہوں کنٹرول چ کر
            This is utterance of an old man, who is using an English borrowed verb in Punjabi as a verb and applying the grammar of Punjabi very unconsciously.
            Inter language mixing of Urdu and domestic languages is also taking place. People in cities are tending to use Urdu words to purify  their domestic language. Specially in cities like Karachi it is reported that words of Urdu are frequently spoken in domestic languages like Pashto. The young Pakhtoons are marked by their Urdu-mixed Pushto when they visit Peshawar or the domestic areas of their parents. 
           
            Considering our language situations a diglossic community we can make a continuum of languages according to their formality level.






Bibliography
 Sociolinguistics by R.A. Hudson
 Sociolinguistics by Bernard Spolsky
 The Linguistics Encyclopedia edited by Kristen Malmkjer
 Introducing Language and Society by Peter Trudgill
 http://eflgeek.com/index.php/eflgeek/comments/time-to-clean-up-cunning-konglish/

Validity in Assessment

Definition
            While designing a test, it is essential for it to be valid. Validity can be defined in different ways.
“It is the extent to which a test measures what it is supposed to measure”.
“Validity is the subjective judgment made on the basis of experience and empirical indicators”.
Validity is “the agreement between test score or measure and the quality it is believed to measure”. (Kaplan and Saccuzzo 2001)
            In simple words we can say that validity refers to the meaningfulness of the test. This meaningfulness can work at two levels. At the level of the design, the design of the test should be according to the requirements. At the level of context, the test should be used for the specific purpose for which it is designed. We cannot use a mathematics test to test the writing skills of the learner, it is against the context, the test is used other than its context and will not be valid.
            There are various kinds and aspects of validity. Here they are tried to discuss according to their relevancy and importance.
1. Face Validity
            In fact it is not a kind of scientific aspect of validity. Face Validity refers to the face of the test among general public, test-takers and other lay people/non-related persons etc. Face validity means the test should have certain characteristics. These characteristics are those which the people expect about the test. They include proper printing, a governing body, an appropriate manner of test taking, subjective/essay type of questions etc. Thus a mathematics test will not be considered valid according to face if it has not numerical questions. Numerical Question is the expectation of the lay people from a mathematics test.
            A test that does not have such evidences may be rejected by the test takers and the governing body may bear criticism. Face Validity is nothing in the opinion of the expert but a test should look like a test a common man thinks. So face validity becomes an issue for the test designer and paper setter.

2. Predictive Validity
            Predictive Validity refers to the future performance and success of the learner. This aspect of validity ensures that the test is providing valid information about the future performance of the learner. So it includes all those situations or skills for testing which the learner encounter or perform in his future. The example of the tests must have predictive validity are entry tests and selection tests.
            Language aptitude tests should have predictive validity because they test present skills for future performance. Proficiency tests also use predictive validity. In diagnostic and achievement tests although there are other types of validity involved but they should also have predictive validity. As they are also liked with the future performance of the learner.
            Predictive Validity is calculated by statistical co-relations. The validity coefficient is calculated usually by comparing success in the test with the success in job. Thus the validity of the test is checked and improved for future tests. A 0.6 value of the coefficient is considered high which indicates that all tests do not have predictive validity.

3. Concurrent Validity
            There is  no major difference between the two validity types i.e. Predictive Validity and Concurrent Validity except time. Predictive Validity is related to futures while concurrent validity is related to present. When the future becomes present the predictive validity becomes the concurrent validity. We compare two tests instead of a test with future or job performance.  This comparison is of two test taken usually simultaneously, one written and other oral or spoken usually. It is used to limit the criterion related errors. Most suitable situation is the comparison of a new test with already established test/criterion to find its validity and meaningfulness.
            So a test having concurrent validity will show its validity in a given field. Concurrent validity is  a statistical measure which requires a quantifiable criterion. Although all the criterion are not quantifiable but statistical approach assumes that they are quantifiable. Co-efficient of validity is used to compare the two tests.

4. Content Validity
            It is the appealing aspect for the expert. It seeks the extent upto which the test represents the content from which it is constructed. 
            It is required in achievement tests. They represent a content/syllabus and they should be constituted from the given syllabus and content. Similarly diagnostic tests should also have content validity because they seek certain deficiencies of the learner from a given set of skills or syllabus. The chief examiner, advisor etc. can check that the test is representing the content which it is going to test.
            Teaching materials should have their own validation i.e. predictive and construct validity. Otherwise the content validity of the test will not be fruitful. So the teaching of speaking skills should involve such materials and the examples from native speakers which teach the student appropriate speaking/spoken skills.
            In proficiency tests the content validity can also be employed. Learners will have to perform in certain situations so the test can be a representative of those skills testing. Those areas can be specified before the exam just like the syllabus of the achievement tests. This is a guesswork as compared to other tests where we have syllabuses.
5. Construct Validity
             A construct is a theory, usually a psychological one, which explains certain mental process say learning. It will thus say how the learner learns the language and what are the factors involved and what is the nature of language etc.
            On the base of such theory the test is constructed to evaluate certain factors/indicators of the learner language to measure his ability. Thus the test will have the construct validity if it represents the aspects of that particular theory on which it is based.
            Here a point should be kept in mind that a construct may be wrong. So a test having construct validity will become meaningless due to the false theory on the basis of which it is constituted. Here the problem will be with that construct not with the test. Materials and syllabuses should also be evaluated on the basis of construct validity to know if they represent and teach the language according to the theory of language and language learning. 
Different questions relating each validity evidence are presented in this table.
Content
1.     Do the evaluation criteria address any extraneous content?
2.     Do the evaluation criteria of the test address all aspects of the intended content?
3.     Is there any content addressed in the task that should be evaluated through the test, but is not?
Construct
1.     Are all of the important facets of the intended construct evaluated through the scoring criteria?
2.     Is any of the evaluation criteria irrelevant to the construct of interest?

Criterion (Predictive + Concurrent)
1.     How do the scoring criteria reflect competencies that would suggest success on future or related performances?
2.     What are the important components of the future or related performance that may be evaluated through the use of the assessment instrument?
3.     How do the scoring criteria measure the important components of the future or related performance?
4.     Are there any facets of the future or related performance that are not reflected in the scoring criteria?

Validity is a pre-test concern. We should develop tests in such manner that they have the validity and meaningfulness. In this regard a three step approach can be helpful. 
1. First, clearly state the purpose and objectives of the assessment.
2. Next, develop scoring criteria that address each objective.
3. If one of the objectives is not represented in the score categories, then the rubric is unlikely to provide the evidence necessary to examine the given objective. If some of the scoring criteria are not related to the objectives, then, once again, the appropriateness of the assessment and the test is in question.
Sources of Invalidity
            Validity can suffer due to various factors some of which are discussed.
1.      Lack of reliability indicates that the test is not valid. Although the contrary may also be true, that is, a test is reliable and consistent in its results but it may be meaningless in certain context and irrelevant. Reliability should be seen to prevent invalidity.
2.        Content and Construct under-representation is a situation in which important aspects of the content and construct are not included in the test. Thus the results are unlikely to reveal the true abilities of the student's abilities within that construct or content which were indicated and having been measured by the test.
3.      Content and Construct over-representation is a situation in which the aspects of the content and construct are represented in the test in excess, that is, irrelevant part are also included in the test.  This can further be divided in two situations:
1.      One where the over-representation leads the test to easiness and the learner or test-taker can get some clues from the test to solve some problems, thus guessing increases invalidity.
2.      Other situation can lead the test to difficulty and it becomes difficult for the student to score appropriately. It is not the fault of the student but the construction of the test affects him and he cannot perform well.