Test Design Criteria

Similar documents
P(at least two students sharing the same birthday)

Problem 2: Interpreting Data and Identifying Linear Equations

Research on interaction and communication in English teaching

VOLUME 16 NUMBER 6 DECEMBER 2006 Summary of Results from Academic Profile General Education Assessment Academic Year

District of Columbia International School

SITE DEVELOPMENT PLAN

MMA Student Campus Climate Survey

Lei Bao a Edward F. Redish b

Transforming Cambridge Road Estate

ADMISSION AND REGISTRATION

A Parent s Guide to Understanding Your Child s Results

C HAPTER 2: DOCUMENTING S TUDENT-SPECIFIC P LANNING: T HE IEP

The study of the attitudes of the students at vocational training high school towards the internet through certain variables

Introducing pre-service education students to university experiences through an augmented reality game

Laws of Exponents Lesson Plan

ADMISSION AND REGISTRATION

Big Book 2 Best Friends! Big Book 2 Best Friends! Blackline Master 2.1 Activity Pad (page 17) crayons Preparation (TG page 74)

The ESPAD validity study in four countries in 2013

LAND LAW REGULATIONS COUNCIL OF MINISTERS. CHAPTER I General Provisions

International Students Perceptions of the Value of U.S. Higher Education

PLANNING DEPARTMENT TRANSMITTAL TO THE CITY CLERK S OFFICE

TRAILBLAZER SOLICITOR APPRENTICESHIPS

Carlette Jackson Hardin Effective Classroom Management Models and Strategies Third Edition

Urban educators have. New Schools, Overcrowding Relief, and Achievement Gains in Los Angeles Strong Returns from a $19.5 Billion Investment

HOUSING ELEMENT AND FAIR SHARE PLAN TOWNSHIP OF MILLBURN, NEW JERSEY

Narrative Reporting. A Framework & Guidance for Co-operatives

Agent for Executor Solutions

ockleston bailey 251 HIGH STREET, BANGOR LL57 1PB PRIME FREEHOLD NON VATTED RETAIL INVESTMENT LET TO GERRARDS CONFECTIONERS (NORTH WALES) LIMITED

Rackheath. Eco-community the facts

Sale of Surplus Property at Lots 5 and 6 Concession 5, Township of Norwich

AGREEMENT BETWEEN NORTH TEXAS MUNICIPAL WATER DISTRICT AND

MEMORANDUM MONTEREY COUNTY PLANNING AND BUILDING INSPECTION DEPARTMENT

PLANNING DEPARTMENT TRANSMITTAL TO THE CITY CLERK S OFFICE

President s Day 2015 ACADEMIC ADVISING NEWSLETTER FEBRUARY CampusConnection Hold Financial Aid Warning. Monday, February 16 DATES TO REMEMBER

This note deals in broad outline only with the requisitions on Value Added Tax. The

Company History. Domani Construction & Development Inc. is a privately-held construction company. established in 2003, owned and operated

Career Development Internship Guidelines

PLANNING DEPARTMENT TRANSMITTAL TO THE CITY CLERK S OFFICE

Why Have Housing Prices Gone Up?

Homebuilders Toolkit Guidance on how to comply with the Consumer Code for Homebuilders

Admission Requirements for Outgoing Students of Chung Chi College Exchange Programmes ( )

Assessing Student Conceptual Understanding of Force and Motion with Model Analysis

Location will determine whether county or municipal regulations restrict forestry activities. unified development

ANNUAL REPORT

LINES Haverford. Lear & S ile i the sa e la guage

Factors Related to Attrition and Retention of Under-Represented Minority Students: National and Regional Trends

NOW OPEN FOR ENTRIES GENERATION APPRENTICESHIP. COMPETITION 2019 SEEKING YOUR IDEAS LEADERSHIP PROBLEM-SOLVING

unit 1 I Am Special! by Joni Bowman

MINUTES OF REGULAR MEETING CITY OF SANTA CLARITA CITY COUNCll. 6:30P.M. NOVEMBER 14, 1995

Why Windermere? 2010 Windermere Services Company. All rights reserved. WORC 11/10 PM#800

Power Center DEMOGRAPHICS: 1 MILE 3 MILE 5 MILE

n Unobstructed corridors n No exposed hardware n Low life cycle costs n Integrated pocket cover door

ockleston bailey 48 MILL STREET, MACCLESFIELD SK11 6LT PRIME FREEHOLD RETAIL INVESTMENT LET TO TCCT RETAIL LIMITED Trading As CO-OP TRAVEL

SANS SOUCI OWNERS CORP ST Road FOREST HILLS, NEW YORK, 11375

Plots 1-3 Hilltop Farm, Kings Langley, WD4 8NS

DETERMINING TENANT ELIGIBILITY

MARKET REPORT SAN FRANCISCO BAY AREA

DESIGN CENTER CHENGDU. A global hub for creative people and companies for innovation and inspiration

The Spatial Variation Characteristics of Physical Conditions of College Students in Jiangsu Province

Quantitative study and analysis for English integrated teaching based on Matlab

RESORTS DECLARATION OF CONDOMINIUM FOR SURREY GRAND CROWNE RESORT

CITY OF WEST KELOWNA COUNCIL POLICY MANUAL

PLANNING DEPARTMENT TRANSMITTAL TO THE CITY CLERK S OFFICE

Tax Exempt School and Municipal Lease Financing

AREA MUNICIPALITY OF THE TOWN OF BRACEBRIDGE

Accounting Technician Apprenticeship

KINDERGARTEN. sample PLUS! Let the Journey Begin! BY JONI BOWMAN

EagleCrest. The Terrace Senior Apartments

INSTRUCTIONS FOR HOMEOWNER TAX BENEFITS APPLICATION

The Farmstead. The Terrace Senior Apartments

PLANNING DEPARTMENT TRANSMITTAL TO THE CITY CLERK S OFFICE

ACCOMMODATION GUIDE

Middleton-Cross Plains Area School District Community Growth & Projections Report. Community Growth & Projections Report

Constructability Analysis

FOR MORE INFORMATION, PLEASE CONTACT:

Forum House, Empire Way, Wembley

20 Business Activity Zone Rules

PLANNING DEPARTMENT TRANSMITTAL TO THE CITY CLERK S OFFICE

PLANNING DEPARTMENT TRANSMITTAL TO THE CITY CLERK S OFFICE

Architectural Design with Visualization Patterns

Growing Trend of Litigation re Student Self-Harm

2/8 Willowbrae Road, Edinburgh, EH8 7DB Fixed Price 144,995

9/8, Ardmillan Place, Edinburgh, EH11 2JU Offers Over 139,995

Setting the Standard. Windermere Real Estate

90 Caroline Terrace, Edinburgh, EH12 8QU Offers Over 360,000

Robert Thirsk High School Student Registration Checklist

RESOLUTION A RESOLUTION RELATING TO A SITE PLAN WITH DEVIATIONS; DETERMINING

ENERGY EFFICIENCY PROGRAMS IN MULTIFAMILY AFFORDABLE HOUSING

Student Handbook Regulations, Policies, and Procedures

Forecasting the development of leasing market (on the example of Ukraine)

Industrial Leasing Guide

Leah J. Konicki and Douglas Terpstra, MS. Submitted By: ASC Group, Inc Castlegate Drive Indianapolis, Indiana

MEDINA HOUSE 329 SILBURY BOULEVARD MILTON KEYNES MK9 2AE

The Daft.ie House Price Report. An analysis of recent trends in the Irish residential sales market 2013 Q3

Reversionary Industrial Investment with Annual RPI Reviews WESTON BODY HARDWARE CROSSGATE ROAD PARK FARM INDUSTRIAL ESTATE REDDITCH B98 7SN

Accounting for owner-occupied property: goldmine or landmine?

SITE LEASE. For all or a portion of the following Site:

Appraisal Value and Assessed Value in Italy

Sara A LaPorte. l n. Education

PLANNING DEPARTMENT TRANSMITTAL TO THE CITY CLERK S OFFICE

Transcription:

A E. Boehm, PhD The Boehm Test of Basic Cocepts, Thid Editio (Boehm 3) is a goup admiisteed assessmet fo studets i kidegate though secod gade. Boehm 3 was desiged to evaluate youg studet s udestadig of 50 impotat basic elatioal cocepts itegal fo success i school ad to idetify studets who may ot have had the leaig expeieces ecessay to develop a udestadig of key cocepts. The basic elatioal cocepts as defied by Boehm 3 iclude Oveview...1 Test Desig Citeia...1 Admiistatio ad Scoig...2 Stadadizatio Sample...2 Reliability & Validity...4 Spaish Editio...5 Summay...6 Oveview Test Desig Citeia size, diectio, ad positio i space, time, quatity, classificatio, ad geeal. Boehm 3 is a evisio of Boehm R, published i 1986. Ehacemets i the evisio iclude ew oms, colo illustatios, cocuet developmet of Spaish editio, tools to assist i commuicatio with paets, ad moe! The evisio will povide valuable ifomatio to elemetay educatos ad educatioal diagosticias, as well as speechlaguage pathologists, ad school psychologists. Sice the publicatio of Boehm R i 1986, thee have bee may chages i ealy school assessmet. This test was developed withi the cotext of the chagig eviomet ad was devised i a fomat that ca be taslated ito leaig objectives, as well as beig used fo cuiculum plaig ad wokig with paets. Outlied below ae the ehacemets that have bee icluded i Boehm 3: Fou measues povided Raw Scoes, Pecet Coect, Pefomace Rage, ad Pecetile The additio of a fouth espose choice fo each item to miimize guessig Modificatio ad the additio of colo i illustatios to appeal to studets takig the test Iceasig the divesity of people pictued i the illustatios by icludig divese acial goups, idividuals i o-steeotypical oles, ad diffeetly-abled idividuals Itoductio of a obsevatio fom that teaches ad cliicias ca use fo ogoig obsevatio of the geealized use of basic cocepts acoss cuiculum aeas Developmet of a paet epot fom to commuicate ifomatio to paets ad suggestios fo wokig with thei studets i the home eviomet Cocuet developmet of a Spaish editio with the Eglish editio Ehacemet of the tasitio fom Boehm 3 to Boehm-3 Peschool, the idividually admiisteed test of basic cocepts fo childe ages 3.0 to 5.11 1

ADMINISTRATION AND SCORING Thee ae two paallel foms of Boehm 3; ad. Each fom addesses the same 50 cocepts, i the same ode, usig diffeet cotexts. Admiisteig Boehm 3 Foms E ad F is simple ad staightfowad. Each fom cosists of a total of 50 pictoial items i oe test booklet. Thee pactice items ae peseted, followed by 25 test items. Thee is a beak poit afte the fist 25 items if you wish to admiiste the test i two sessios. Thee pactice items pecede the fial 25 items. iteested i the test ad ejoy takig it, so holdig the studet s attetio, eve at the kidegate level, is usually ot difficult. Boehm 3 esults ca be epoted as a aw scoe, pecet coect pefomace age, ad a pecetile. The aw scoe ca be detemied by summig the umbe of coect esposes. Usig the aw scoes, the pecet coect, pefomace age, ad pecetile ca be obtaied. Easie items ae itespesed with moe difficult items i ode to icease a studet s sese of success ad ehace attetio. Most studets become STANDARDIZATION SAMPLE Natioal fall oms wee developed fo the Boehm 3 by admiisteig Foms E ad F to studets i kidegate, fist- ad secod-gade i Octobe ad Novembe of 1999. Natioal spig testig to establish oms took place i Apil ad May of 2000. A attempt was made to test studets fom schools epesetative of the atio as a whole i tems of school distict size (betwee 600 to moe tha 20,000 studets), socioecoomic level of the esidets of the school distict, ubaicity by Gade ad Fom Testig Gade Kidegate Fist Gade Secod Gade 960 34.0 982 34.0 924 32.0 1,055 33.0 1,105 35.0 1,029 32.0 (uba, sububa, ual, o o-pubic), ad geogaphic egio. Studets who eceived special sevices, but wee maisteamed i egula classooms wee icluded i the stadadizatio. The Boehm 3 fall stadadizatio sample cosisted of ove 6,000 studets i kidegate, fist- ad secod-gade classooms ad the spig sample icluded moe tha 4,000 studets. by Gade ad Fom Spig Testig Gade Kidegate Fist Gade Secod Gade 813 34.6 829 35.3 706 30.1 748 34.1 731 33.3 717 32.6 by Gede ad Fom Testig Gede Female Male Not Repoted 1,180 41.2 1,653 57.7 33 1.1 1,623 50.9 1,522 47.7 44 1.4 by Gede ad Fom Spig Testig Gede Female Male 1,174 50.0 1,174 50.0 1,098 50.0 1,098 50.0 by Race/Ethicity ad Fom Testig Race/Ethicity Afica Ameica Hispaic Othe White Not Repoted 462 16.1 468 16.3 137 4.8 1,773 61.9 26 0.9 491 15.4 475 14.9 176 5.5 1,985 62.2 62 2.0 16.52 16.32 5.03 62.13 2 by Race/Ethicity ad Fom Testig Race/Ethicity Afica Ameica Hispaic Othe White 400 17.0 382 16.3 129 5.5 1,437 61.2 395 18.0 314 14.3 121 5.5 1,366 62.2 16.52 16.32 5.03 62.13 100.0 100.0

24 22.50 18.99 34.51 Regio Notheast Noth Cetal South West by Socioecoomic Level of the Paticipatig School Disticts ad Schools ad Fom Testig Socioecoomic Level Low Middle High 1,348 47.0 501 57.7 533 18.6 484 16.9 1,365 42.8 694 21.8 702 22.0 428 13.4 by Ubaicity ad Fom Testig Ubaicity Uba Sububa Rual by Regio ad Fom Testig 313 11.0 748 26.1 988 34.4 817 28.5 700 24.5 775 27.0 907 31.6 484 16.9 558 17.5 746 23.4 1,025 31.9 867 27.2 798 25.1 1,056 33.1 907 28.4 428 13.4 18.99 22.50 34.51 24.00 100.0 by Regio ad Fom Spig Testig Regio Notheast Noth Cetal South West by Socioecoomic Level of the Paticipatig School Disticts ad Schools ad Fom Spig Testig Socioecoomic Level Low Middle High 408 17.4 738 31.4 880 37.5 322 13.7 366 16.7 631 28.7 832 37.9 367 16.7 by Ubaicity ad Fom Spig Testig Ubaicity Uba Sububa Rual 445 19.0 504 21.5 802 34.1 597 25.4 61 2.6 1,407 59.9 558 23.8 322 13.7 415 18.9 496 22.6 757 34.5 528 24.0 86 3.9 1,219 55.5 524 23.9 367 16.7 18.99 22.50 34.51 24.00 100.0 Bueau of the Cesus. (1998). Cuet populatio suvey, Octobe 1998: School Eollmet Supplemetal File [Machie-eadable data file]. Washigto, DC: Bueau of the Cesus (Poduce/Distibuto). 3

The eliability of the Boehm 3 was detemied by checkig iteal cosistecy, stadad eo of measuemet, test-etest eliability, ad alteate foms eliability. A test with a high level of iteal cosistecy idicates that the iteal stuctue of the test is such that esults ae epeatable. The coefficiet RELIABILITY AND VALIDITY 4 alphas fo Boehm 3 aged fom.80 to.91. The Stadad Eo of Measuemet (SEM) povides a alteative measue of eliability. The smalle the SEM, the geate level of cofidece attibuted to the accuacy of test scoes. The SEM fo Boehm 3 aged fom 1.14 to 2.43, idicatig oveall low vaiability. Iteal Cosistecy Reliability Coefficiets (Coefficiet Alpha) ad Stadad Eo of Measuemet by Gade ad Fom Gade Kidegate SEM Fist Gade SEM Secod Gade SEM 960.00 2.42 982.00.85 1 924.00.80 1.35 1,055.00 2.43 1,055.00.87 1.87 1,029.00.80 1.39 Alteate fom eliability is eflected i coefficiets of coelatio betwee two foms of a test. It is impotat to ote that ealy 94 of the studets 216 Oveall test-etest eliability coefficiets by gade/fom aged fom.80 to.89. A test ca be said to have evidece of validity if it measues what it states that it measues. The Boehm 3 cotais evidece of validity based o test cotet ad elatios to othe vaiables. Reseach outlied i the Boehm 3 Examie s Maual suppots the claim that a child s ability to make elatioal judgmets usig the Boehm-3 cocept tems, plus thei syoyms ad atoyms, is basic to udestadig classoom istuctio, whethe i the fom of followig teache diectios, completig cuicula tasks. Validity evidece based o elatioships of othe vaiables was compiled i five sepaate studies. The fist study looked at the elatioship betwee Boehm 3 ad its pedecesso, Boehm R. The coelatio betwee Boehm 3 ad Boehm R aged fom.61 to.96. It is impotat to ote that while both the Boehm 3 ad its pedecesso test 50 basic cocepts, ew cocepts have bee added to Boehm 3. Secodly, a study was coducted to look at the elatioship betwee Boehm 3 ad the Metopolita Achievemet Tests, Eighth Editio ( Educatioal Measuemet, Stadadizatio Editio 1999), a test used to assess studet achievemet i the aeas of souds ad pit (emeget liteacy skills), Atemate Foms Reliability Mea SD Spig 813.00 2.16 829.00.83 1.62 706.00.82 1.14 748.00.88 2.12 731.00 1.63 717.00.91 1.16 paticipatig i the Boehm 3 alteate foms study had a diffeece of 4 o fewe aw scoe poits fom oe fom to the othe. Mea SD 46.5 3.5 46.6 3.8.83 mathematics, ad laguage. The coelatio betwee these two tests aged fom.58 to.88, idicatig that kowledge of basic cocepts is impotat fo studets to comply with admiistatio diectios ad pefomace o the test tasks. A thid study ivolved a goup of 75 kidegate studets who wee admiisteed the Metopolita Readiess Test, Sixth Editio (Nuss & McGuava, 1995). This test evaluates the ealy skills equied i emeget eadig ad math. The coelatio betwee this test ad Boehm-3 aged fom.48 to.63. The coelatio betwee Boehm 3 ad the Otis-Leo School Ability Test, Seveth Editio (Otis & Leo, 1996) aged fom.45 to.68. The OLSAT 7 is used to measue thikig ad easoig by checkig studet pefomace o tasks. The modeate coelatio ca be expected due to the vaied cotet of the umeous aeas assessed with the OLSAT 7, suggestig that kowledge of basic cocepts is stogly elated to studet pefomace ad is a essetial compoet of thikig ad easoig. This futhe demostates the eed to make sue studets kow basic cocepts pio to admiisteig tests. The fial study was a Logitudial Study to Spig. A goup of 273 kidegate studets took pat i a compaiso of thei pefomace i the fall with thei pefomace i the spig o Boehm 3. The coelatio fo both Foms E ad F is.78, idicatig that studets who did well i the fall also did well i the spig.

Natioal fall oms fo the Spaish vesio of Boehm 3 wee developed by admiisteig Foms E ad F to studets i kidegate, fist, ad secod gade i Octobe ad Novembe of 1999. Spig stadadizatio took place i Apil ad May of 2000. Biligual teaches who wee expeieced i test admiistatio wee ivited to paticipate i the stadadizatio testig. Moe tha 1,200 Spaish-speakig studets i the Uited States paticipated i the fall stadadizatio ad the elated eliability ad validity studies of the Boehm 3 Spaish editio. Moe tha 400 Spaish-speakig studets paticipated i the spig stadadizatio. Gede was closely divided with 51.2 male ad 48.3 female compisig the fall oms, ad 56.3 female ad 43.7 male compisig the spig oms. Although cosideable ecuitmet of examies fom all ove the Uited States occued, few esposes wee eceived fom cetai aeas of the Uited States, paticulaly the Notheast egio. As a esult, a lage Regio Notheast South West SPANISH EDITION Boehm 3 Spaish Stadadizatio Sample by Regio ad Fom ad Spig 159 45.8 188 54.2 29 6.3 245 53.5 184 40.2 Total 347 100.0 458 100.0 pecetage of the sample cosists of studets fom those egios of the Uited States that typically have lage populatios of Spaish-speakig studets. School disticts paticipatig i the stadadizatio study wee chaacteized by the socioecoomic level of the distict. Thee wee thee levels: low, middle ad high. The levels wee detemied by eviewig the icome level ad educatio of the esidets withi a defied school distict. These classificatios wee desiged to place 33 of the public school distict populatio ito each of the thee categoies. Studets paticipatig i the stadadizatio studies that atted o-public school wee placed i a fouth categoy. Ubaicity ca be defied as the school distict s sevice aea elative to the Metopolita Sevice Aea ad is based o zip code ifomatio of the distict. Thee ae thee pimay levels of ubaicity: uba, sububa, ad ual. 108 63.2 63 36.8 Spig 90 71.4 36 28.6 171 100.0 126 100.0 Boehm 3 Spaish Stadadizatio Sample by Socioecoomic Level of the School Distict ad Schools ad Fom ad Spig Socioecoomic Level Low Middle High 101 29.1 159 45.8 5 1.4 82 23.6 117 25.5 245 53.5 12 2.6 84 18.3 Total 347 100.0 458 100.0 21 12.3 76 44.4 74 43.3 Spig 16 12.7 75 59.5 35 27.8 171 100.0 126 100.0 Ubaicity Uba Sububa Rual Boehm 3 Spaish Stadadizatio Sample by Ubaicity ad Fom ad Spig 57 16.4 159 45.8 49 14.1 82 23.6 39 8.5 245 53.5 90 19.7 84 18.3 Total 347 100.0 458 100.0 Bueau of the Cesus. (1998). Cuet populatio suvey, Octobe 1998: School Eollmet Supplemetal File [Machie-eadable data file]. Washigto, DC: Bueau of the Cesus (Poduce/Distibuto). 5 35 20.5 67 39.2 69 40.4 Spig 16 12.7 54 42.9 56 44.4 171 100.0 126 100.0

6