Docstoc

innost odboru metodiky testovn roce

Document Sample
innost odboru metodiky testovn roce Powered By Docstoc
					Commercial vs. in-house language
 training and testing in the Czech
             Republic

           Vilnius, Lithuania
            10 May, 2011
              LTC Jan Šmíd




                                     1
                                Outline


1. Introduction
2. Czech training and testing system
3. In-the-field inspections
4. Findings
5. Steps taken
6. Research
7. Conclusion




                                          2
         Czech training and testing system

                             Czech DLI



         Language                           Methodology
         Teaching                               and
           Dept.                            Testing Dept.


 English             Other           English            Other
Language           Languages        Language          Languages


  + Contracted Instructors               + Contracted Examiners

                                                                  3
     Czech training and testing system

                   MoD and GS

     Czech DLI                     Sites


 MoD Training Centre            Outsourcing


  Defence University


MoD Secondary School


     Outsourcing

                                              4
                          Outsourcing + DLI
                   Number of Courses                       Number of Students
Year       2008   2009  2010    2011     Total     2008   2009  2010     2011   Total
Language
English     115   113    129    44        401      1788   1931   1792    713    6224
German        3    2      3                8         24    12     12             48
French       16    11     7               34        118    81     49             248
Russian       1    1      1                3          6     9      7             22
Albanian                  2                2                      39             39
Serbian                   1                1                      18             18
Arabic        1    1      1                3        7      4       4             15
Portuguese                1                1                       7              7
Pashto             1                       1                      10              10

Total       136   129    145    44        454      1943   2037   1928    713    6621

                                       Czech DLI
 English    62     61     46     ?                 536    496     381     ?
 Other L.   9      13     8      ?                  69    108     51      ?

                                                                                   5
              Success rate



Year         Institute        Level 2
       MoD Training Centres   62-68 %
2007
           Outsourcing        42-65 %
       MoD Training Centres   51-67 %
2008
           Outsourcing        32-52 %
       MoD Training Centres   56-65 %
2009
           Outsourcing        11-44 %



                                        6
                    In-the-field inspections


 Low awareness of STANAG 6001 descriptors
 Low awareness of exam format


 Frequent poor instructor preparation
 Textbooks not sufficiently/effectively supplemented
 90 minute lessons
 Lack of homework
 Lack of homework feedback



                                                        7
                              Research


General information:
 Years 2008 – 2010
 790 questionnaires distributed
 651 returned
 Research questions in Czech: closed –ended qs, open-ended qs
 43 questions + 9 sub questions in 3 sections
    General characteristics of a respondent
    Feedback on language training
    Feedback on language testing


                                                                 8
                  Part I – General characteristics


Motivation for studying English?

                                                     Position requirement
Position requirement          66.0%
Work-related reasons          0.5%                   Work-related reasons
Personal reasons              7.1%
Part of curriculum            4.6%                   Personal reasons

NATO position requirement     7.8%                   Part of curriculum
Studies abroad requirement    3.6%
Deployment                    9.5%                   NATO position
                                                     requirement
EU battle group               0.9%
                                                     Studies abroad
                                                     requirement
                                                     Deployment

                                                     EU battle group




                                                                     9
               Part I – General characteristics


What is the language requirement?

No SLP/other    3.0%                              No SLP

SLP 1100        1.5%                              SLP 1100
SLP 1111        31.0%
                                                  SLP 1111
SLP 2211        7.0%
                                                  SLP 2211
SLP 2222        46.8%
SLP 3322        1.8%                              SLP 2222

SLP 3333        8.9%                              SLP 3322

                                                  SLP 3333




                                                      10
               Part I – General characteristics


How do you perceive the requirement?

SLP 0

Low          43.8%
Adequate     37.5%
High         0.0%                                 Low
Irrelevant   18.7%
                                                  Adequate

                                                  Irrelevant




                                                        11
               Part I – General characteristics


How do you perceive the requirement?

SLP 1100

Low          0.0%
Adequate     25.0%
High         25.0%                                Low
Irrelevant   50.0%                                Adequate
                                                  High
                                                  Irrelevant




                                                           12
               Part I – General characteristics


How do you perceive the requirement?

SLP 1111

Low          11.8%
Adequate     71.7%
High         6.4%
                                                  Low
Irrelevant   10.1%
                                                  Adequate

                                                  High

                                                  Irrelevant




                                                         13
               Part I – General characteristics


How do you perceive the requirement?

SLP 2211

Low          5.4%
Adequate     27.1%
                                                  Low
High         37.8%
Irrelevant   29.7%                                Adequate

                                                  High

                                                  Irrelevant




                                                     14
               Part I – General characteristics


How do you perceive the requirement?

SLP 2222

Low          3.2%
Adequate     71.8%
High         18.7%                                Low
Irrelevant   6.3%                                 Adequate
                                                  High
                                                  Irrelevant




                                                         15
               Part I – General characteristics


How do you perceive the requirement?

SLP 3322

Low          0.0%
Adequate     63.6%                                Low
High         36.4%
                                                  Adequate
Irrelevant   0.0%
                                                  High

                                                  Irrelevant




                                                         16
               Part I – General characteristics


How do you perceive the requirement?

SLP 3333

Low          0.0%
Adequate     78.0%
High         22.0%
                                                  Low
Irrelevant   0.0%
                                                  Adequate

                                                  High

                                                  Irrelevant




                                                     17
                     Part II – Language Training


The course was taught by

DLI                   18.5%
Komorní Hrádek        3.3%
Defence University    1.1%
Outsourcing           74.6%
                                                   DLI
                                                   Komorní Hrádek
                                                   Defence University
                                                   Outsourcing




                                                                 18
                     Part II – Language Training


Satisfaction with instructors

Absolutely no     4.6%
No                23.3%
Yes               53.1%
Absolutely yes    19.0%

                                                   Absolutely no
                                                   No
                                                   Yes
                                                   Absolutely yes




                                                             19
                     Part II – Language Training

                                                   No information on
Absolutely no – reasons:                           the language exam


No info on the exam           25.0%                Poor instructor
Poor instructor preparation   40.0%                preparation
Unsuitable demeanour          5.0%
Not relevant education        5.0%                 Unsuitable
                                                   demeanour
Too many instructors          5.0%
Not specified                 20.0%                Not relevant
                                                   educational
                                                   background
                                                   Too many instructors



                                                   Not specified




                                                                  20
                    Part II – Language Training


No – reasons:                                     No info on the
                                                  exam

No info on the exam           12.8%               Poor instructor
                                                  preparation
Poor instructor preparation   22.1%               Unsuitable
Unsuitable demeanour          9.3%                demeanour
Not relevant education        3.5%                Not relevant
Too many instructors          7.0%                education
Too few instructors           1.1%                Too many
                                                  instructors
No native speaker             3.5%
                                                  Too few
Not specified                 40.7%               instructors
                                                  No native
                                                  speaker
                                                  Not specified




                                                          21
                  Part II – Language Training


Yes – reasons:

Appropriate methodology   9.3%
Suitable demeanour        8.8%
Not specified             81.9%
                                                Appropriate
                                                methodology

                                                Suitable
                                                demeanour

                                                Not specified




                                                     22
                   Part II – Language Training


Absolutely yes – reasons:

Appropriate methodology     20.0%
Suitable demeanour          36.3%
Not specified               43.8%
                                                 Appropriate
                                                 methodology
                                                 Suitable
                                                 demeanour
                                                 Not specified




                                                       23
                          Part II – Language Training


Satisfaction with course books used

Absolutely no              22.9%
(Face to face, Headway)


No                         34.9%                        Absolutely no
(Headway, Face to face)
                                                        No

Yes                        36.8%                        Yes
(Headway, ALC, Face to face)                            Absolutely yes


Absolutely yes             5.4%
(ALC, Headway)




                                                                24
                    Part III – Language Testing


Source of information on the STANAG 6001 exam

Czech DLI website    53.0%
Colleague, friend    10.0%
Instructor           28.1%                        Czech DLI
Examiner             1.0%                         website
No information       7.9%                         Colleague,
                                                  friend
                                                  Instructor

                                                  Examiner

                                                  No information




                                                           25
                    Part III – Language Testing


Was the information sufficient?

Yes     56.6%
No      43.4%


                                                  Yes

                                                  No




                                                        26
                  Part III – Language Testing


Have you read the STANAG 6001 descriptors?

Yes                28.7%
No                 25.9%
What are they?     45.4%

                                                Yes

                                                No

                                                What are
                                                they?




                                                      27
                               Conclusion


MoD level – suggestions:
 Selecting procedures
 On-site inspections


DLI level – steps taken:
 Frequent inspections
 More user-friendly DLI website
 STANAG 6001 exam familiarization guide
 Seminars for language instructors – both MoD and outsourcing



                                                                 28
Questions?

Thank you.



             29

				
DOCUMENT INFO
Shared By:
Categories:
Tags:
Stats:
views:4
posted:7/9/2011
language:English
pages:29