Tuesday, April 2, 2019
Psychometrics in the Construction Industry
psychometry in the twist persistenceAbstractThis language is ab disclose evaluating the engross of psychometrika in the braid assiduity. The document leave too present the main(prenominal) aims and objectives of the bailiwick.A comprehensive publications register has as sanitary been carried bulge with the objective of turn a profiting an in-depth grounds of the topic of psychometrics. The lit freshen chapter entrust take in wind a cream of the analyze rules that argon available on the market, experiment institution, exercise inside labor and the associated approach with more than(prenominal) turn outs. A regularityology and electric potential cons jibets create overly been set, and finally a datetable has been proposed.The muckle destined that companies ar beginning to trustworthyise the turn a profits of psychometric interrogation,1.1 IntroductionThis utterance proposal has been compiled as disrupt of the BSc (Honours) in eddy mana gement. It is requirement for the mortal to produce a explore brook on the subject of his/her throw choice that is stratumulation related. The topic chosen for the purposes this oration is that of psychometric science.1.2 character of the ProblemFew plurality in the wrench industry would dissent that rough-and-ready squad building is inhering to success that obstetrical deli very(prenominal) together a bunch of unity and only(a)-on-ones does non automatically produce a squad (Franks 2002). Teams deal to be assembled by taking into account umteen factors, including individual skill and crabbedly the somewhatoneal characteristics of the individual member, psychometric running gameing is one way of ensuring the sic group members be recruited, thus maximize the capabilities of the group up.psychometrics c everyplaces a stray of runing methods from IQ and readiness streamlets to dis point movenaires and offspringcy indicators. M either judicat ures now subprogram this carcass of examen routinely in their enlisting processes especially at fourth-year level, accord to Corcoran (2005) it forces an examination and decease chthonicstanding of the competencies intrinsical in the eccentric in question and cerebrate the prospects competencies with those to the role. Hampton (2002) suggests that these tests atomic matter 18 non just confine to recruitment they grass similarly be utilise in cargoner ontogeny to raise aw atomic number 18ness of the individuals feature strengths and weaknesses.The requisite for this bet into stems from the fact that comp bed to incompatible industries where the habituate of psychometrics is widespread construction firms bet to be blind to its benefits. As an industry that relies heavily on keen squadwork, construction could gain from a wider execution of instrument of psychometrics in some(prenominal) recruitment and team development.Also if mountain statistics be to be believed, up to 56% of chances exaggerate their skills/ sense on their CV. Making a recruitment decision purely on the kernel of a CV and audience alone, could probe to be un trusty. Whilst a CV trustworthyly fork overs an over arrest of a mountaindidates talent, it doesnt necessarily bedeck their suit baron for the role. Likewise, an appli plainlytockst whitethorn conkle an interview extremely sound but not fill the cap efficacy to deliver the role itself. psychometric interrogatory at that placefore attempts to play a third dimension to the team building/recruitment process. The rent for this investigate is thus obvious and leave behinding be knowing to test the lineing hypothesisPsychometric examen is critical to flourishing team building in the Irish construction industry.1.3 Rationale As an industry that relies heavily on thoroughly teamwork, it is natural that that the ripe(p) multitude argon selected for the sound mull overs. This princi ple for this utterance is to induce whether or not construction could benefit from the wider implementation of psychometric test, and also to evaluate the true tradition of psychometric interrogation in the industry.Establishing the habitude of psychometric testing is a critical part of this research, it establishes the incumbent tr determinations in the construction industry towards recruitment and team development and once this is set up it may help organisations enter the way forward. To come crossways this, a literature re quantifyment, a buffer store lamp study and postal questionnaires shall be conducted.Initial research has indicated that the construction industry is irksome to witness the benefits of testing in twain recruitment and team development. Employers need to be made aw ar of twain the advantages and disadvantages of psychometrics which enable them to confine an conscious decision as to whether or not psychometrics is set aside to their organis ation.1.4 AimsThe normal aim of this research is to check up on if psychometric testing is some(prenominal) a beneficial or a counterproductive exercise to a construction organisation in the weft of team members.To establish the outcome of part of psychometrics inwardly the Irish reflection Industry.To gain a comprehensive understanding of the topic of psychometrics.1.5 Objectives of the interrogationTo provide a widely distributed overview of the topic of psychometric science.To review the range of testing methods available.To establish the unpatterned advantages and disadvantages to a construction organisation in adopting psychometric testing.To valuate the current employment of psychometrics inwardly the Irish construction industry.1.6 HypothesisThe benefits of Psychometric screening atomic number 18 not to the full appreciated in the Irish Construction Industry 1.7 Outline methodological analytic thinkingThe methodology section for this dissertation depart p rovide a principle for the choice and habit of particular strategies and animals for hoarding and analyzing the data. A numeric research strategy was utilize as part of the methodology, which helped in the execution of two the literature review and the questionnaire.The literature review was one the early stages of the methodology this was utilize to racylight the splendour of exploitation psychometric testing in both recruitment and team building.The methodology also complex the doing of structured questionnaire these were compiled to assess the current usage of psychometric testing among organisations inside the Irish Construction Industry. A pilot study of the questionnaire was first conducted to provide a trial grade for the questionnaire, which involves testing the wording of the questions and identifying any evasive questions.A detailed analytic thinking of the results was then produced it testament consist of questions, answers, tables, figures and charts t o manufacture the data. Finally an interview was conducted with a member of an organisation utilising psychometrics as part of their recruitment process. methodology2.1 IntroductionThis chapter pass on set out to precis the methods of data aggregation that were adopted for the purposes of the dissertation. The methodology chapter for this dissertation of 4 main partsA general definition and review of the climb up to the research.A justification for the pickax of the hypothesis, aims and objectives.A description of the data appeal and analytical surgical procedures.A review of the methodological complexities that were encountered, including the limitations and constraints on the research.2.2 Research schemeA primarily duodecimal research strategy was adopted for the purposes of this dissertation. The rationale for the natural selection of this method is that quantitative research is utilise when the individual unavoidably to identify facts somewhat a concept, question o r an attribute. This ties in about with the objectives and aims of the report. Naoum (1998) describes quantitative research as an inquiry into a social or homosexual problem, this closely relates to the initial aims objectives of the research2.3 Theoretical modellingThis dissertation allow for be approached employ a both sociological and psychological framework. The former of which is touch with heathenish roles, norms and levers and the structuring and functioning of social club. Also explored ordain be the psychological aspects much(prenominal) as temperament traits and relationships amidst individual team members.2.4 Historical FrameworkOne of the first attempts to scientifically amount of money the differences between individuals was made by Sir Francis Galton in the 19th Century when he tried to evidence how the human mind could be systematically mapped into different dimensions, identifying how individuals differed in terms of their tycoon. The psychological ap proach and the first published test jakes be ascribe to Sir Alfred Binet.2.5 noetic FrameworkPsychometric testing is fundamentally a form of psychological assessment,Postal QuestionnairesPostal questionnaires along with a cover letter pull up s take a craps be distributed to a modus operandi of Irish construction firms to gather information on the current usage and the popularity of psychometrics inwardly the Irish construction industry. Before these questionnaires ar distributed, it pull up stakes be necessary to actualize a pilot study before the final data is collected. The pilot study provide provide a trial run for the questionnaire, and its main aim is to test the wording of the questions, identify any am giganticuous questions and test the techniques being lend oneselfOnce the pilot study is complete, the main questionnaire entrust be distributed. To establish an sinless test of the industry, it volition be necessary to get a minimum number of responses to t he main questionnaire. This number will be determined by the constraints of prison term imposed on the research, even so it is expected that this will be in the region of 10-15 responses. This study will be primarily aimed at the big construction firms in the industry. A haphazard selection procedure will be adopted, to ensure that a representative ingest of the firms is organizen. Where possible, questionnaires will be delivered and collected to ensure a high response rate. Otherwise when replies ar not received, the enquiries will be followed up by subsequent emails and earpiece calls.Tables, graphs, bar charts and histograms pay off been identified as a concocts of presenting the data from the questionnaires.The Research Sample callable to the relatively high be relate in the implementation of psychometric instruments, the smaller organisations in the industry flow to avoid apply this method of recruitment and team development.To establish an accurate representation of the industry, the research render was confined to those in the Top vitamin C Irish construction companies (The Times, 2007). This sample was further refined down 35 development a random selection procedure.The guinea pigs of organisation were sampled from a number of different disciplines within the construction industry, including1. Civil Engineering Contractors2. Building Contractors3. Building Services Contractors4.Project Management organisations5. Engineering Consultants6. Multi-disciplinary organisations literature ReviewThis paper reviews the literature on psychometric testing by employers, and considers whether or not psychometric testing is a critical particle of the recruitment process. It will representk to outline the fundamental benefits associated with the concept of psychometric testing and determine current trends regarding the usage of these tests in the Irish Construction Industry. jibe to Reber (1995) psychometric testing has been defined as Pertaining to mental testing in any of its facets, including assessment of constitution, paygrade of intelligence, determining aptitudes. Rust (2004) classifies these tests into cardinal broad categories those that assess powerfulness and those that assess in- mortality.The way that boldnesss operate has changed dramatically in the last 30 years, thither are now fewer levels of management than there were, and management styles hunt to be less autocratic. In addition, there appears to be a black market towards more association establish and customer decocted jobs, which means that individuals stir more autonomy crimson in the lower levels within organizations (Edenborough 2004). The make of these changes mean that a mortals dis function is seen as more important now than it was in the past.The structure of the modern workforce within the Irish Construction Industry is also rapidly changing and teamwork is fair increasely important, here a psychometric test privy prove an inval uable tool, not save does it make sure that each team has the required skills but it also ensures that the people who make up team tail work well together or that they can gel effectively. An article in China module powder magazine (2003) points out that this doesnt mean that everybody in the team should be the same, quite a than that you end up with a crew of personalities who can work well together. to each one type of test may not suit every organisation, the design of a testing procedure must be based on what the drug intentr is wishing to achieve from the results. Burke (1995) suggests that the various types of tests are designed for a purpose and the use up of a particular test will vary according to the objectives of the assessment. In aver of magnitude to as legitimate which tests you should use, it is necessary to gain an in-depth understanding of the characteristics necessary to do well at the job.Recruitment and alternativeMany organisations now use psychome tric testing routinely in their recruitment process especially at a senior level. It forces an examination and sound understanding of the competencies inherent in the role in question and links the panoramas competencies with those of the role. It makes for sound selection decisions and identifies development areas for the successful candidate (Corcoran 2005). Ideally, if psychometrics is apply at the initial selection stage, employers are immediately aware of any areas ability or personality where an employee baron not be an circumstantial match for the job, and can make informed decisions as to whether the employee should be selected and develop, or rejected.Type of Testing Available constitution Measurement Tests These tests are employ to assess how a person is seeming to react to situations with people, the types of relationship they pick out to establish with former(a)s, and the motivational factors that influence a persons actions. These are very much cognize as te sts of disposition. These tests do not generally mark off questions to which there is only one correct answer. The answers given to these questions tend to smoothen a tendency to interpret situations or respond to other people in particular shipway. Burke (1995) outlines the characteristic qualities assessed by disposition tests these involve anxiety, sociability, perseverance, dominance, fear of failure and resistance to stress. A common approach to in psychometrics is to see personality as a gang of traits. A trait can be any characteristic way of behaving, thinking, olfactory perception or operating. The measure of these traits has always been a matter of interest for some years, it has been accepted that personality is of great splendour in peoples success at work, no less than the approach they take in other aspects of their vivification (Edenbourgh 2005).Psychologists frequently refer to these as the big 5 personality traits. bleakness appreciation for art, emoti on, adventure, unusual ideas, imagination, curiosity, and variety of roll in the hay. conscientiousness a tendency to show self-discipline, act dutifully, and aim for deed mean rather than spontaneous behavior.extraversion energy, positive emotions, urgency, and the tendency to seek comment and the order of others.Agreeableness a tendency to be compassionate and conjunctive rather than suspicious and antipathetical towards others.Neuroticism a tendency to experience unpleasant emotions easily, such as anger, anxiety, depression, or vulnerability sometimes called ablaze instability.The argument runs that personality questionnaires do not test behavior presently but rather how the responsive chooses to describe his or her own behavior. It also argued by Cronbach (1966) that such questionnaires or self-report inventories, as they are sometimes cognise, indicate typical behavior. One corollary to this view by Reber(1995) is that such behavior is not very amenable to chang e, these type of tests have no right or legal injury answers as such, except there is certainly the right and wrong personality mixes for certain jobs. efficacy and Aptitude TestsAptitude and Ability tests are not always exactly separated many of the tests in these categories are used to look at behavior, often of an intellectual or cognitive nature. These are unremarkably tests of general intelligence, which can be regarded as mental horsepower or as measure of a persons ability to process information.Tests of ability generally assess the broader areas of what a person can do. While pull ahead on such tests are influenced by education and knowledge, they are not designed to assess specific areas of knowledge or skill. Examples of ability tests are measures of verbal reasoning, numerical reasoning and automatic reasoning. China Staff magazine (2003) defines ability testing as a measure of a persons potential to learn the new skills needed for a new job or to cope with the dema nds of a training course. Tests of aptitude on the other pile are often used to assess how well an individual is plausibly to perform in a training programme or in a jobEdenbourgh (2005) attempts to distinguish between the deuceThe term aptitude is unremarkably speechless for those tests directed at countering whether skill in a particular area can be acquired. Ability tests on the other hand tend to be reserved for measures of less job-specific though often still job-related intellectual tests. Attainment TestsThese are often referred to as achievement tests these are more normally used in relation to educational assessment rather than in occupational settings. They represent standard ways of assessing the amount of skill currently reached or attained by an individual in a particular area.Tests of progress are often conjugate with ability and can be quite an similar the difference is that they test specifically what people have learnt e.g. numeral ability or typewriting sk ills. Of course what people have wise(p) does depend on their ability in that domain in the first place, so the scores of the two types of test are linked.Another specialty between the two is that ability tests are retrospective in nature they focus on what has been learnt and on what a person knows and can do now. Ability tests on the other hand are prospective they focus on what candidates are fitted of learning and achieving in the future or on their potential to learn. (China Staff Magazine 2003)Assessment CentresPsychometric testing often takes place within the context of an assessment center. Edenbourgh (2004) points outs that organisations use a range of selection methods, including interviews, sort exercises, role-playing, in-b charteret exercises as well as psychometric testing in order to select from a group of job applicants.Candidates are belike to encounter tests that will simulate situations that are in all probability to be encountered in a particular role. Ass essment centre selection methods can take one or two years to complete, and because of the cost and time interpreted these are generally only associated with big organisations.Assessment centers are usually used after the initial stages of the selection process and usually follow the initial job interview. They are commonly held either on employers premise or in a hotel and are considered by many organizations to be the fairest and nigh accurate method of selecting staff. This according to Psychometric Success is because a number of different selectors will get to see the individual over a longer period of time and have the chance to see what he/she do, rather than what the individual says they can do. Tests that are carried out within these assessment centres are often conducted by HR personnel however it is often the case that immaterial consultants will be brought in to dish out the tests.Ability to distinguish between candidates any(prenominal) selection tool should be able to distinguish between candidates in two ways1) The tool should be accurate and precise. Any differences in results between candidates should be real and not simply random or due to errors or inaccuracies. This is know as reliability, and psychometric tools have consistently been shown to be more reliable than other common selection methods.2) The differences in results between candidates should reflect differences in their ability to perform in the job. This is known as criterion-related validness. As shown in Diagram 3, psychometric tools do predict job operation well, provided that the right tool has been chosen, for representative, via a careful analysis of the attributes required for the job. Differences in results do therefore relate to differences in ability to perform well in the job. The importance of getting this right is one reason why most instruments are only sold to those who have been trained in their use. reliability One of the main problems associated with psycho metric testing is the issue of test reliability. For instance, if there is high competition for a jobthen there is self-coloured incentive for candidates to present themselves favorably. Similarly candidates can be tempted to respond to personality questionnaires in a way they tack together on the employer wants. If we consider a construction related job, how many candidates will dissent with the pedagogy I revel workings in team milieu?Edenbourgh (2005) identifies one way of change magnitude the reliability in personality questionnaires, this is to use forced-choice formats whereby candidates are presented with a combination of statements and must indicate a optence between them, this method of unite items is known as ipsative scaling. This can be contrasted with the normative scaling, in which the candidate is instructed to choose one statement from a selection of 2 or more.For example in an ipsative test, a question might ask a candidate to choose whether they are more hard working or creative. In this case the candidate cannot make themselves look good on both of the statements, it therefore can be said that this method can increase the reliability of certain tests and give the assessor a greater profile of the candidates personality.Disadvantages to Psychometric Testing In many cases, psychometric tests and questionnaires have been put together by people with little background in psychometrics and they may have very little actual utility and value for the purposes for which they are marketed.Although British Psychological Society (BPS) has a standard capacity system, it is not unusual for tests to be used by people who are not adequately trained to score them. Also just because a person attends a recognized training course it cannot be guaranteed that they will use tests and questionnaires correctly since some instruments, particularly personality questionnaires, require significant experience and the possibility of silly interpretation of results is ever-present.Another disadvantage of psychometric testing is the use of personality questionnaires to assess an individuals ability or skill in a particular area. For example, if a person scores highly on a test called Leadership, this does not mean that he or she will actually possess a high level of leadership skill, alternatively it means that the individual has the basic personality characteristics that are commonly base amongst effective leaders and, with sufficient experience and given the development of certain necessary skills, has the potential to live on an effective leader. (Team Focus 2004)Cost The be associated with these tests are often substantial. This implies that employers are un probable to be using them tho in order to follow a management trend, but because they firm believe that the tests are useful in recruiting job applicants with the right skills and attributes. According to a recent survey by Incomes Data Services (IDS 2000), the sums involv ed in testing can be quite substantial. Assuming that employers prefer to execute and interpret the tests themselves, rather than employing external consultants, then the costs will include initial training in test use, since it is necessary to be qualified in order to use tests. Further costs will include start-up kits such as manuals or computer software, and consumables such as question-and-answer booklets for test candidates. (Jenkins 2001)In order to become a trained assessor, a person needs to contract certificate from the British Psychological society (BPA), and requires the completion of two courses, aim A and Level B.The BPS Level A covers the use and interpretation of ability tests.The BPS Level B covers the use and interpretation of personality tests.In general the test companies will often provide courses leading to these qualifications. These courses usually take about five days for each of Level A and Level B.The average cost per trainee is about 1,900 for Level A and about 2,200 for Level B. It is possible to train some employees to be test administrators, rather than test users, although at least(prenominal) one person in the organisation must be a qualified test user if the come with is to be permitted to buy tests. Test administrators can brief candidates prior to testing, and hand out and collect test papers, but cannot score tests, except under supervision, nor interpret the results.Source IDS survey of British companiesTraining to become a test administrator is often cheaper than becoming a test user and a fee of maybe 1000 would be charged for a test administrator course. However, it is likely that larger companies would want to have some(prenominal) people qualified to test user standard, as well as more employees qualified to administer the tests. According to Edenborough (2004) the major component of cost is the expense of training company staff to be able to obtain and utilize the tests properly, precise costs of psychometric tests will vary but say in a recruitment context it is improbable that the expenses are to be more than a couple of percent of a salary. The benefits concerned are also likely to dwarf such figure.Estimating the cost-benefit of psychometric instrumentsCompanies can examine the effect of a recruitment process on a companys performance by analyzing how well a candidate performs in the role and therefore how much they add to productivity, and balancing this against the coronation in their recruitment. Research across a range of organisations suggests that the amount an employer can save, per employee recruited, per year, is(Validity of the test) multiply by (Caliber of those selected) multiplied by (Standard deviation of job performance) disconfirming(Cost of the selection) divided by (Proportion of applicants selected)This formula, known as the utility equation, may look complex, but it has successfully been used by HR professionals in order to justify the use of psychometric instru ments and other objective assessment methods. (McHenry 1990) cipher the cost benefits of psychometric instrumentsThe utility equation can be used to calculate the pecuniary benefit of using psychometric testing as part of an organisations selection process.An example of this would be a company recruiting a person for a position with a 60,000 salary, is possible to compare the financial benefit achieved by using a recruitment process of uncrystallised interviews that have a robustness of 0.18, compared to using personality questionnaires and ability tests that have a combined validity of 0.60. (See table in Appendix 1) utilise the utility equation and a conservative estimate of the extent to which this position will impact on company productivity, it can be predicted that using psychometric tools would increase the organizations productivity by 8,520 compared to using unstructured interviews. This calculation assumes that the candidate remains in the job for one year if they rema in for one-third years the productivity increase can be as much as 25,160.Source McHenry (1990)Current routine within IndustriesAccording to Psychometric Success testing is now used by over 80% of the Fortune 500 companies in the regular army and by over 75% of the Times Top 100 companies in the UK. Information technology companies, financial institutions, management consultancies, local authorities, the civil service, constabulary forces, fire services and the gird forces all make extensive use of use psychometric testing. In 2006 a survey identified that well over 2,500 personality questionnaires are available on the market, this number is increasing each year as dozens of new companies appear with their own new products.The reasons for test use suggest that the perceived objectivity of tests, their predictive abilities, as well as their ability to filter out inconsistent candidates were important reasons for test use in both the public and unavowed sectors, however accord ing Jenkins (2001) capable opportunities legislation may have also encouraged employers to use tests as part of a drive to fairer selection. thither are also a number of studies linking increases in test use to the spread of greater professionalism in the human resource management function, and to multi-national companies opulent standard selection procedures end-to-end their businesses. It has been estimated that it can cost organisations the equivalent of the social unit of the first years costs (salary and any other benefits) to put right a wrong recruitment decision. Research reported in a number of test manuals shows that using good assessments professionally as part of the recruitment process dramatically increases the number of right decisions you make.In order to establish reasons for organisations use of psychometric testing, it was necessary to look at statistics carried on British organisations, due to the limited availability of published research in Ireland.Surveys carried out by Bevan and Fryatt (1988) and byPsychometrics in the Construction IndustryPsychometrics in the Construction IndustryAbstractThis dissertation is about evaluating the use of psychometrics in the construction industry. The document will also present the main aims and objectives of the study.A comprehensive literature study has also been carried out with the objective of gaining an in-depth understanding of the topic of psychometrics. The literature review chapter will identify a selection of the testing methods that are available on the market, test design, usage within industry and the associated costs with such tests. A methodology and potential constraints have also been identified, and finally a timetable has been proposed.The survey indicated that companies are beginning to realise the benefits of psychometric testing,1.1 IntroductionThis dissertation proposal has been compiled as part of the BSc (Honours) in construction management. It is necessary for the individua l to produce a research project on the subject of his/her own choice that is construction related. The topic chosen for the purposes this dissertation is that of psychometric science.1.2 Nature of the ProblemFew people in the construction industry would disagree that effective team building is essential to success however bringing together a bunch of individuals does not automatically produce a team (Franks 2002). Teams have to be assembled by taking into account many factors, including individual skill and particularly the personal characteristics of the individual member, psychometric testing is one way of ensuring the correct team members are recruited, thus maximizing the capabilities of the team.Psychometrics covers a range of testing methods from IQ and aptitude tests to personality questionnaires and numbercy indicators. Many organisations now use this form of testing routinely in their recruitment processes especially at senior level, according to Corcoran (2005) it forces a n examination and sound understanding of the competencies inherent in the role in question and links the candidates competencies with those to the role. Hampton (2002) suggests that these tests are not just limited to recruitment they can also be used in career development to raise awareness of the individuals own strengths and weaknesses.The need for this research stems from the fact that compared to other industries where the use of psychometrics is widespread construction firms seem to be blind to its benefits. As an industry that relies heavily on good teamwork, construction could gain from a wider implementation of psychometrics in both recruitment and team development.Also if survey statistics are to be believed, up to 56% of candidates exaggerate their skills/experience on their CV. Making a recruitment decision purely on the content of a CV and interview alone, could prove to be unreliable. Whilst a CV certainly provides an overview of a candidates ability, it doesnt necessa rily illustrate their suitability for the role. Likewise, an applicant may handle an interview extremely well but not have the capability to deliver the role itself. Psychometric testing therefore attempts to add a third dimension to the team building/recruitment process. The need for this research is therefore obvious and will be designed to test the following hypothesisPsychometric testing is critical to successful team building in the Irish construction industry.1.3 Rationale As an industry that relies heavily on good teamwork, it is essential that that the right people are selected for the right jobs. This rationale for this dissertation is to establish whether or not construction could benefit from the wider implementation of psychometric testing, and also to evaluate the current usage of psychometric testing in the industry.Establishing the usage of psychometric testing is a critical part of this research, it establishes the current trends in the construction industry towards recruitment and team development and once this is established it may help organisations see the way forward. To achieve this, a literature review, a pilot study and postal questionnaires shall be conducted.Initial research has indicated that the construction industry is slow to realise the benefits of testing in both recruitment and team development. Employers need to be made aware of both the advantages and disadvantages of psychometrics which enable them to make an informed decision as to whether or not psychometrics is appropriate to their organisation.1.4 AimsThe general aim of this research is to investigate if psychometric testing is either a beneficial or a counterproductive exercise to a construction organisation in the selection of team members.To establish the extent of use of psychometrics within the Irish Construction Industry.To gain a comprehensive understanding of the topic of psychometrics.1.5 Objectives of the ResearchTo provide a general overview of the topic of ps ychometric science.To review the range of testing methods available.To establish the apparent advantages and disadvantages to a construction organisation in adopting psychometric testing.To assess the current usage of psychometrics within the Irish construction industry.1.6 HypothesisThe benefits of Psychometric Testing are not fully appreciated in the Irish Construction Industry 1.7 Outline MethodologyThe methodology section for this dissertation will provide a rationale for the choice and use of particular strategies and tools for gathering and analyzing the data. A quantitative research strategy was used as part of the methodology, which helped in the execution of both the literature review and the questionnaire.The literature review was one the first stages of the methodology this was used to highlight the importance of using psychometric testing in both recruitment and team building.The methodology also involved the production of structured questionnaire these were compiled to assess the current usage of psychometric testing among organisations within the Irish Construction Industry. A pilot study of the questionnaire was first conducted to provide a trial run for the questionnaire, which involves testing the wording of the questions and identifying any ambiguous questions.A detailed analysis of the results was then produced it will consist of questions, answers, tables, figures and charts to represent the data. Finally an interview was conducted with a member of an organisation utilising psychometrics as part of their recruitment process.Methodology2.1 IntroductionThis chapter will set out to outline the methods of data collection that were adopted for the purposes of the dissertation. The methodology chapter for this dissertation of 4 main partsA general definition and review of the approach to the research.A justification for the selection of the hypothesis, aims and objectives.A description of the data collection and analytical procedures.A review of the methodological complexities that were encountered, including the limitations and constraints on the research.2.2 Research StrategyA primarily quantitative research strategy was adopted for the purposes of this dissertation. The rationale for the selection of this method is that quantitative research is used when the individual needs to identify facts about a concept, question or an attribute. This ties in closely with the objectives and aims of the report. Naoum (1998) describes quantitative research as an inquiry into a social or human problem, this closely relates to the initial aims objectives of the research2.3 Theoretical FrameworkThis dissertation will be approached using a both sociological and psychological framework. The former of which is concerned with cultural roles, norms and values and the structuring and functioning of society. Also explored will be the psychological aspects such as personality traits and relationships between individual team members.2.4 Historica l FrameworkOne of the first attempts to scientifically measure the differences between individuals was made by Sir Francis Galton in the 19th Century when he tried to show how the human mind could be systematically mapped into different dimensions, identifying how individuals differed in terms of their ability. The psychological approach and the first published test can be credited to Sir Alfred Binet.2.5 Psychological FrameworkPsychometric testing is fundamentally a form of psychological assessment,Postal QuestionnairesPostal questionnaires along with a cover letter will be distributed to a number of Irish construction firms to gather information on the current usage and the popularity of psychometrics within the Irish construction industry. Before these questionnaires are distributed, it will be necessary to complete a pilot study before the final data is collected. The pilot study will provide a trial run for the questionnaire, and its main aim is to test the wording of the quest ions, identify any ambiguous questions and test the techniques being usedOnce the pilot study is complete, the main questionnaire will be distributed. To establish an accurate sample of the industry, it will be necessary to get a minimum number of responses to the main questionnaire. This number will be determined by the constraints of time imposed on the research, however it is expected that this will be in the region of 10-15 responses. This study will be primarily aimed at the larger construction firms in the industry. A random selection procedure will be adopted, to ensure that a representative sample of the firms is taken. Where possible, questionnaires will be delivered and collected to ensure a high response rate. Otherwise when replies are not received, the enquiries will be followed up by subsequent emails and phone calls.Tables, graphs, bar charts and histograms have been identified as a means of presenting the data from the questionnaires.The Research SampleDue to the rel atively high costs involved in the implementation of psychometric instruments, the smaller organisations in the industry tend to avoid using this method of recruitment and team development.To establish an accurate representation of the industry, the research sample was confined to those in the Top 100 Irish construction companies (The Times, 2007). This sample was further refined down 35 using a random selection procedure.The types of organisation were sampled from a number of different disciplines within the construction industry, including1. Civil Engineering Contractors2. Building Contractors3. Building Services Contractors4.Project Management organisations5. Engineering Consultants6. Multi-disciplinary organisationsLiterature ReviewThis paper reviews the literature on psychometric testing by employers, and considers whether or not psychometric testing is a critical element of the recruitment process. It will seek to outline the fundamental benefits associated with the concept of psychometric testing and determine current trends regarding the usage of these tests in the Irish Construction Industry.According to Reber (1995) psychometric testing has been defined as Pertaining to mental testing in any of its facets, including assessment of personality, evaluation of intelligence, determining aptitudes. Rust (2004) classifies these tests into two broad categories those that assess ability and those that assess personality.The way that organizations operate has changed dramatically in the last 30 years, there are now fewer levels of management than there were, and management styles tend to be less autocratic. In addition, there appears to be a move towards more knowledge based and customer focused jobs, which means that individuals have more autonomy even in the lower levels within organizations (Edenborough 2004). The effects of these changes mean that a persons personality is seen as more important now than it was in the past.The structure of the modern workfo rce within the Irish Construction Industry is also rapidly changing and teamwork is becoming increasingly important, here a psychometric test can prove an invaluable tool, not only does it make sure that each team has the required skills but it also ensures that the people who make up team can work well together or that they can gel effectively. An article in China Staff magazine (2003) points out that this doesnt mean that everybody in the team should be the same, rather than that you end up with a combination of personalities who can work well together.Each type of test may not suit every organisation, the design of a testing procedure must be based on what the user is wishing to achieve from the results. Burke (1995) suggests that the various types of tests are designed for a purpose and the use of a particular test will vary according to the objectives of the assessment. In order to ascertain which tests you should use, it is necessary to gain an in-depth understanding of the ch aracteristics necessary to perform well at the job.Recruitment and SelectionMany organisations now use psychometric testing routinely in their recruitment process especially at a senior level. It forces an examination and sound understanding of the competencies inherent in the role in question and links the candidates competencies with those of the role. It makes for sound selection decisions and identifies development areas for the successful candidate (Corcoran 2005). Ideally, if psychometrics is used at the initial selection stage, employers are immediately aware of any areas ability or personality where an employee might not be an exact match for the job, and can make informed decisions as to whether the employee should be selected and trained, or rejected.Type of Testing AvailablePersonality Measurement Tests These tests are used to assess how a person is likely to react to situations with people, the types of relationship they prefer to establish with others, and the motivati onal factors that influence a persons actions. These are often known as tests of disposition. These tests do not generally contain questions to which there is only one correct answer. The answers given to these questions tend to reflect a tendency to interpret situations or respond to other people in particular ways. Burke (1995) outlines the typical qualities assessed by disposition tests these include anxiety, sociability, perseverance, dominance, fear of failure and resistance to stress. A common approach to in psychometrics is to see personality as a combination of traits. A trait can be any characteristic way of behaving, thinking, feeling or operating. The measure of these traits has always been a matter of interest for many years, it has been recognized that personality is of great importance in peoples success at work, no less than the approach they take in other aspects of their life (Edenbourgh 2005).Psychologists often refer to these as the big five personality traits.Ope nness appreciation for art, emotion, adventure, unusual ideas, imagination, curiosity, and variety of experience.Conscientiousness a tendency to show self-discipline, act dutifully, and aim for achievement planned rather than spontaneous behavior.Extraversion energy, positive emotions, urgency, and the tendency to seek stimulation and the company of others.Agreeableness a tendency to be compassionate and cooperative rather than suspicious and antagonistic towards others.Neuroticism a tendency to experience unpleasant emotions easily, such as anger, anxiety, depression, or vulnerability sometimes called emotional instability.The argument runs that personality questionnaires do not test behavior directly but rather how the respondent chooses to describe his or her own behavior. It also argued by Cronbach (1966) that such questionnaires or self-report inventories, as they are sometimes known, indicate typical behavior. One corollary to this view by Reber(1995) is that such behavio r is not very amenable to change, these type of tests have no right or wrong answers as such, however there is certainly the right and wrong personality mixes for certain jobs.Ability and Aptitude TestsAptitude and Ability tests are not always precisely separated many of the tests in these categories are used to look at behavior, often of an intellectual or cognitive nature. These are usually tests of general intelligence, which can be regarded as mental horsepower or as measure of a persons ability to process information.Tests of ability generally assess the broader areas of what a person can do. While scores on such tests are influenced by education and training, they are not designed to assess specific areas of knowledge or skill. Examples of ability tests are measures of verbal reasoning, numerical reasoning and mechanical reasoning. China Staff magazine (2003) defines ability testing as a measure of a persons potential to learn the new skills needed for a new job or to cope wit h the demands of a training course. Tests of aptitude on the other hand are often used to assess how well an individual is likely to perform in a training programme or in a jobEdenbourgh (2005) attempts to distinguish between the twoThe term aptitude is usually reserved for those tests directed at predicting whether skill in a particular area can be acquired. Ability tests on the other hand tend to be reserved for measures of less job-specific though often still job-related intellectual tests. Attainment TestsThese are often referred to as achievement tests these are more commonly used in relation to educational assessment rather than in occupational settings. They represent standard ways of assessing the amount of skill currently reached or attained by an individual in a particular area.Tests of attainment are often linked with ability and can be quite similar the difference is that they test specifically what people have learnt e.g. mathematical ability or typing skills. Of course what people have learned does depend on their ability in that domain in the first place, so the scores of the two types of test are linked.Another differentiation between the two is that ability tests are retrospective in nature they focus on what has been learnt and on what a person knows and can do now. Ability tests on the other hand are prospective they focus on what candidates are capable of learning and achieving in the future or on their potential to learn. (China Staff Magazine 2003)Assessment CentresPsychometric testing often takes place within the context of an assessment centre. Edenbourgh (2004) points outs that organisations use a range of selection methods, including interviews, group exercises, role-playing, in-basket exercises as well as psychometric testing in order to select from a group of job applicants.Candidates are likely to encounter tests that will simulate situations that are likely to be encountered in a particular role. Assessment centre selection method s can take one or two days to complete, and because of the cost and time taken these are generally only associated with larger organisations.Assessment centers are usually used after the initial stages of the selection process and usually follow the initial job interview. They are commonly held either on employers premises or in a hotel and are considered by many organizations to be the fairest and most accurate method of selecting staff. This according to Psychometric Success is because a number of different selectors will get to see the individual over a longer period of time and have the chance to see what he/she do, rather than what the individual says they can do. Tests that are carried out within these assessment centres are often conducted by HR personnel however it is often the case that external consultants will be brought in to administer the tests.Ability to distinguish between candidatesAny selection tool should be able to distinguish between candidates in two ways1) The tool should be accurate and precise. Any differences in results between candidates should be real and not simply random or due to errors or inaccuracies. This is known as reliability, and psychometric tools have consistently been shown to be more reliable than other common selection methods.2) The differences in results between candidates should reflect differences in their ability to perform in the job. This is known as criterion-related validity. As shown in Diagram 3, psychometric tools do predict job performance well, provided that the right tool has been chosen, for example, via a careful analysis of the attributes required for the job. Differences in results do therefore relate to differences in ability to perform well in the job. The importance of getting this right is one reason why most instruments are only sold to those who have been trained in their use.Reliability One of the main problems associated with psychometric testing is the issue of test reliability. For instanc e, if there is high competition for a jobthen there is strong incentive for candidates to present themselves favorably. Similarly candidates can be tempted to respond to personality questionnaires in a way they assume the employer wants. If we consider a construction related job, how many candidates will disagree with the statement I enjoy working in team environment?Edenbourgh (2005) identifies one way of increasing the reliability in personality questionnaires, this is to use forced-choice formats whereby candidates are presented with a combination of statements and must indicate a appreciation between them, this method of combining items is known as ipsative scaling. This can be contrasted with the normative scaling, in which the candidate is instructed to choose one statement from a selection of 2 or more.For example in an ipsative test, a question might ask a candidate to choose whether they are more hard working or creative. In this case the candidate cannot make themselves l ook good on both of the statements, it therefore can be said that this method can increase the reliability of certain tests and give the assessor a greater profile of the candidates personality.Disadvantages to Psychometric Testing In many cases, psychometric tests and questionnaires have been put together by people with little background in psychometrics and they may have very little actual utility and value for the purposes for which they are marketed.Although British Psychological Society (BPS) has a standard qualification system, it is not unusual for tests to be used by people who are not adequately trained to score them. Also just because a person attends a recognized training course it cannot be guaranteed that they will use tests and questionnaires correctly since some instruments, particularly personality questionnaires, require considerable experience and the possibility of poor interpretation of results is ever-present.Another disadvantage of psychometric testing is the u se of personality questionnaires to assess an individuals ability or skill in a particular area. For example, if a person scores highly on a test called Leadership, this does not mean that he or she will actually possess a high level of leadership skill, instead it means that the individual has the basic personality characteristics that are commonly found amongst effective leaders and, with sufficient experience and given the development of certain necessary skills, has the potential to become an effective leader. (Team Focus 2004)Cost The costs associated with these tests are often substantial. This implies that employers are unlikely to be using them merely in order to follow a management trend, but because they firmly believe that the tests are useful in recruiting job applicants with the right skills and attributes. According to a recent survey by Incomes Data Services (IDS 2000), the sums involved in testing can be quite substantial. Assuming that employers prefer to administer and interpret the tests themselves, rather than employing external consultants, then the costs will include initial training in test use, since it is necessary to be qualified in order to use tests. Further costs will include start-up kits such as manuals or computer software, and consumables such as question-and-answer booklets for test candidates. (Jenkins 2001)In order to become a trained assessor, a person needs to obtain certification from the British Psychological society (BPA), and requires the completion of two courses, Level A and Level B.The BPS Level A covers the use and interpretation of ability tests.The BPS Level B covers the use and interpretation of personality tests.In general the test companies will often provide courses leading to these qualifications. These courses usually take about five days for each of Level A and Level B.The average cost per trainee is about 1,900 for Level A and about 2,200 for Level B. It is possible to train some employees to be test admi nistrators, rather than test users, although at least one person in the organisation must be a qualified test user if the company is to be permitted to buy tests. Test administrators can brief candidates prior to testing, and hand out and collect test papers, but cannot score tests, except under supervision, nor interpret the results.Source IDS survey of British companiesTraining to become a test administrator is often cheaper than becoming a test user and a fee of perhaps 1000 would be charged for a test administrator course. However, it is likely that larger companies would want to have several people qualified to test user standard, as well as more employees qualified to administer the tests. According to Edenborough (2004) the major component of cost is the expense of training company staff to be able to obtain and utilize the tests properly, precise costs of psychometric tests will vary but say in a recruitment context it is unlikely that the expenses are to be more than a coup le of percent of a salary. The benefits concerned are also likely to dwarf such figure.Estimating the cost-benefit of psychometric instrumentsCompanies can examine the effect of a recruitment process on a companys performance by analyzing how well a candidate performs in the role and therefore how much they add to productivity, and balancing this against the investment in their recruitment. Research across a range of organisations suggests that the amount an employer can save, per employee recruited, per year, is(Validity of the test) multiplied by (Caliber of those selected) multiplied by (Standard deviation of job performance)Minus(Cost of the selection) divided by (Proportion of applicants selected)This formula, known as the utility equation, may look complex, but it has successfully been used by HR professionals in order to justify the use of psychometric instruments and other objective assessment methods. (McHenry 1990)Calculating the cost benefits of psychometric instrumentsTh e utility equation can be used to calculate the financial benefit of using psychometric testing as part of an organisations selection process.An example of this would be a company recruiting a person for a position with a 60,000 salary, is possible to compare the financial benefit achieved by using a recruitment process of unstructured interviews that have a validity of 0.18, compared to using personality questionnaires and ability tests that have a combined validity of 0.60. (See table in Appendix 1)Using the utility equation and a conservative estimate of the extent to which this position will impact on company productivity, it can be predicted that using psychometric tools would increase the organizations productivity by 8,520 compared to using unstructured interviews. This calculation assumes that the candidate remains in the job for one year if they remain for three years the productivity increase can be as much as 25,160.Source McHenry (1990)Current Usage within IndustriesAcco rding to Psychometric Success testing is now used by over 80% of the Fortune 500 companies in the USA and by over 75% of the Times Top 100 companies in the UK. Information technology companies, financial institutions, management consultancies, local authorities, the civil service, police forces, fire services and the armed forces all make extensive use of use psychometric testing. In 2006 a survey identified that well over 2,500 personality questionnaires are available on the market, this number is increasing each year as dozens of new companies appear with their own new products.The reasons for test use suggest that the perceived objectivity of tests, their predictive abilities, as well as their ability to filter out unsuitable candidates were important reasons for test use in both the public and private sectors, however according Jenkins (2001) equal opportunities legislation may have also encouraged employers to use tests as part of a drive to fairer selection. There are also a n umber of studies linking increases in test use to the spread of greater professionalism in the human resource management function, and to multi-national companies imposing standard selection procedures throughout their businesses. It has been estimated that it can cost organisations the equivalent of the whole of the first years costs (salary and any other benefits) to put right a wrong recruitment decision. Research reported in a number of test manuals shows that using good assessments professionally as part of the recruitment process dramatically increases the number of right decisions you make.In order to establish reasons for organisations use of psychometric testing, it was necessary to look at statistics carried on British organisations, due to the limited availability of published research in Ireland.Surveys carried out by Bevan and Fryatt (1988) and by
Subscribe to:
Post Comments (Atom)
No comments:
Post a Comment