The effect of the e-mentoring-based education program on professional development of preschool teachers.

The qualification of a preschool teacher is one of the important factors that determine the quality of preschool education. To increase the quality in education, teachers should be equipped with the necessary knowledge starting from pre-service training, and in-service training should support the upgrading of their knowledge. Thus, the aim of this study was to develop an e-Mentoring-Based Education Program (e-MENTE:PT) for preschool teachers and to test its effectiveness on their professional development during the in-service support period. The study used a design-based research approach. First, focus group interviews were conducted with one-hundred-and-five preschool teachers to find out their needs. Then, an e-MENTE:PT Program was developed based on these needs and devised to be used on the Canvas learning management system (LMS), which involves all opportunities of e-learning and allows one-to-one e-mentoring. The e-MENTE:PT Program involved twelve modules related to the pedagogical content knowledge of the preschool education program. Each module included contents, goals, module materials, e-books, videos, pre- and post-module evaluation questions, discussion questions, live lessons and e-portfolios, all of which were integrated in the LMS. Next, eighteen full-time and nine substitute voluntary teachers from five different provinces were selected as mentees by means of criterion sampling. Nine academicians working in these provinces acted as mentors and implemented the application, each working with two mentees for two months. Qualitative data were analysed by means of descriptive analysis and quantitative data were analysed by means of the Wilcoxon signed rank test. The research concluded that the e-MENTE:PT program supported preschool teachers' professional knowledge, learning environments and classroom applications, and an e-mentoring based teaching management system was effective on professional development.

Introduction

The 2030 Agenda for Sustainable Development was launched in 2015 by one hundred and ninety-three members of the United Nations, including Turkey, to end poverty and set the world on a path of peace, prosperity and opportunity for all on a healthy planet (United Nations, 2015). One of the key instruments to achieve the Sustainable Development Goals (SDGs) is education for sustainable development (ESD) as it “empowers learners to take informed decisions and responsible actions for environmental integrity, economic viability and a just society for present and future generations” (UNESCO, 2017 p. 7). International recognition of ESD as a key enabler for sustainability has been growing steadily and expanding to different stakeholders, which encourages early childhood education (ECE) to be more active in the transformative process (Samuelsson et al., 2019).

Childhood is a critical period for learning to value all living and non-living things on earth, and teachers have a major role in supporting children to become environmentally responsible citizens (Pamuk & Olgan, 2020; Scott & Sulsberger, 2019). One of the important factors determining the preschool quality is the qualification of the teachers (Mother and Child Education Foundation (AÇEV) & Educational Reform Initiative (ERG), 2016). Therefore, necessary precautions need to be taken so that teachers gain adequate knowledge, as well as appropriate attitudes and behaviour starting from the pre-service training period.

In Turkey, as the population who needs education has increased, training for competent teachers has also become an increasingly important issue (Erdoğan et al., 2017). Further, the Turkish Ministry of Education (MoNE) published the Educational Vision Document for 2023, which targets the “establishment of a School Development Model in which all actors of child learning are involved in improving the school” under the title of schools and human resources (MoNE, 2018a).

To be able to reach the global objectives and local targets mentioned in the above paragraph, the competency of teachers become an important issue. Accordingly, the General Directorate of Teacher Training and Development of Turkish MoNE prepared a report on the general features of professional teaching competency, titled the General Competencies of Teaching Profession (MoNE, 2017). In this document, competencies are examined under three headings: Professional Knowledge (content knowledge / pedagogical content knowledge / knowledge of rules and regulations), Professional Competencies (planning education and training / creating learning environments / managing the learning process / assessment and evaluation) and Attitudes and Values ​​(national, moral and universal values ​​/ attitude towards students / communication and cooperation / personal and professional development). Given these competencies, when studies about the qualifications of preschool teachers were examined in terms of their personal characteristics and their knowledge and skills of being able to implement the MoNE program, it was found that they were incompetent in many areas, some of which can be listed as: child development, communication with families, family participation and family education (Bağ, 2015; Görür, 2020); planning, implementation and evaluation of the preschool / early education curriculum (Arslan, 2017; Aydemir, 2018; Düzgün, 2015; Gelebek, 2020; Haktanır et al., 2011; Haktanır, 2014a; Işık, 2015; Kılıç, 2019; Kılınç, 2019; Ünver, 2016); counselling / mentoring and supervision (Kılıç, 2019; Işık, 2015); communication with children, not implementing the education curriculum with a child-oriented approach (Kaya, 2012); children with disabilities, mainstreaming, classroom management (Kılınç, 2019; Tükel, 2017). This indicates that teachers experience problems in understanding the main principle of the program, arranging learning environments, and planning, implementing and assessing learning processes. The results of these studies, conducted at different time periods, have parallels with the problems dealt with in this paper. Almost all of them criticise in-service training programs in that they are based on theoretical knowledge, they are not implementation oriented and they are inadequate. Some studies recommended small group training, distance training and mentoring systems. Bümen et al. (2012)’s research focused on papers, doctorate theses and wide scope reports published in the last decade and examined effective professional development of teachers. The paper assessed the problems in Turkey and reported that professional development models other than courses, seminars and conferences were not utilized, and there were not continuous and systematic professional development applications that were planned in detail, extended over time and recorded (Bümen et al., 2012). In its 2009 report, ERG emphasized the necessity of presenting training opportunities that is far from the traditional educational approaches, that is continuous, and that can enable the development of personal knowledge and qualifications. MoNE’s Early Childhood Education Process Internal Audit Report also yielded similar results (MoNE, 2010). Bozkuş (2018) conducted an action research in which the state of application of a dynamic approach in teachers’ professional development was examined; the results were discussed in the light of many other studies, and it was concluded that an ideal professional development model should not only enable teachers to do reflective thinking, but also to get support and feedback from their colleagues in sharing meaningful learning experiences that they can apply in their classrooms. It was maintained that professional development techniques should be planned and applied in a way that would help teachers to solve the problems they face during implementation; if it must be remote learning, then it should not be in the form of a teleconference with hundreds of listeners at a time; and distance education methods and techniques should ensure active participation of teachers. Can (2019), Eroğlu and Özbek (2020), Hazar (2020), and Sıcak and Parmaksız (2016) also presented similar results and recommendations.

In-service training and education programs for teachers, which provide support for upgrading their knowledge, are usually performed by the MoNE in Turkey. Teachers who attend in-service training studies state that they try and apply the new knowledge they gain from such programs in their classes, but they experience difficulties at times as they are on their own to do so; however, if they stayed only in practice, then they would not have access to new knowledge and applications (ÖRAV, 2009). Therefore, teachers need accessible leaders who are experienced in the field so that they can keep their professional development up to date and can produce solutions for problems they might encounter during the education-teaching process (Erdoğan et al., 2017; Haktanır, 2014b). In this context, in addition to the traditional methods such as seminars, conferences and workshops, professional development models such as coaching and mentoring are needed, during which the development of a teacher is individually monitored by a leader and supported throughout the process (Guskey, 2000). As a matter of fact, in her research study on preschool teachers, Aras (2019) also pointed to the role of professional development designs in assessing learning and emphasized that professional development models needed to be improved for investigating teachers’ professional practices, meeting their needs and contributing to their practices.

A professional development model in this context is mentorship, which means sharing knowledge and experience; the person who transfers knowledge is called a “mentor” and the one who receives this knowledge to use in her/his own education and professional development is called a “mentee” (Guskey, 2000; Uysal & Sığrı, 2011). The primary objective is to enable the individual to improve her/his knowledge and skills in accordance with her/his personal development goals. There are various kinds of mentorship, but the fundamental models can be listed as follows: one to one mentoring, peer mentoring, group-team mentoring, reverse mentoring and self-mentoring (Crisp & Cruz, 2009). Among these approaches, one to one mentoring is the closest model to the one studied in our research.

One to one mentoring usually involves problems such as geographical obstacles, disasters, pandemics or epidemics, and troubles related to location and time (Single & Single, 2005). The electronic mentoring system, which started to be used with the advances in technology, can be a complementary approach for the traditional one to one mentoring practice. E-mentoring is important in that it enables users to share knowledge and experience independent of time and geographical location, and it offers easy and different interaction methods without any social prejudices. Single and Single (2005) examined e-mentoring programs from mid-1990s to 2007; they concluded that e-mentoring practices were facilitating as they were more flexible in terms of response time and more individuals could be reached through the opportunities it provided. They also emphasized that e-mentoring had two valuable gains, namely, “objectivity” and “ease of organisation through electronic interaction”. Nevertheless, those participating in an e-mentoring program should have a certain level of skills about the technology used.

Related work

It has been further stated in the literature that effective strategies should be developed to make e-mentoring practices suitable for use in the online environment (Ensher et al., 2003; Özdemir & Boydak Özan, 2013; Kuzu et al., 2012). According to Thompson et al. (2010)’s research, university academic staff deems e-mentoring as a promising practice for the development of online learning modules.

Generally, both online and offline interaction tools are used in e-mentoring applications. Yet, recently designed e-mentoring practices involve interactions through e-mails, forums and live lessons; thus, mentors and mentees can save the actualised interaction in the data base of the e-mentorship application module, which is important for research and development (Kuzu et al., 2012).

A teacher should be able to perform her/his career in a professional manner at her/his best. Moreover, it is important for a preschool teacher to follow the developments in the pedagogical field as educational process has a dynamic structure. When a teacher feels incompetent in knowledge and applicational issues, s/he should participate in conferences, seminars and in-service training, and s/he must share her/his experiences with colleagues (Dağlıoğlu & Genç, 2019). Studies in the literature indicate that e-mentoring influences teachers’ professional development positively in many respects (Anthony & Kritsonis, 2006; Burgstahler, 2006). Research proved that the modules prepared for professional development increased the knowledge and awareness of teachers (Çetin, 2013; Mcaleer & Bangert, 2011), provided social support (Brintnall, 2002), had positive impacts on formal education (Kahraman & Kuzu, 2016) and the groups who received e-mentoring had higher self-efficacy beliefs about their teaching than those who received one to one mentorship (Tolbert, 2008). Other studies reported that emotional support increased, feeling of loneliness decreased, reflective thinking skills were improved, willingness for teaching increased, and problem-solving skills were developed (Hew & Knapczyk, 2007; DeWert et al., 2003; McDiarmid, 2006). In addition, it was established that the technical, academic, pedagogical and professional skills of both mentors and mentees improved (Alemdağ & Erdem, 2017; Baran, 2016), and the support provided by the mentor was beneficial (Ligadu & Anthony, 2015; Dempsey & Christenson-Foggett, 2011; Ceven McNally, 2016). E-mentoring increased the motivation of teachers, developed creativity, and decreased their anxiety (Langhey, 2008; Simonsen et al., 2009). It was further demonstrated that the approach was influential on pedagogy and content knowledge, new and different teaching methods, learning resources and strategies, and leadership characteristics (Arkün-Kocadere & Kızılkaya Cumaoğlu, 2015; McAleer & Bangert, 2011). These studies suggest that e-mentoring can be used as an approach that will support professional development.

Given the research results about e-mentoring, it is notable that the studies in the literature are limited to the teachers in the fields of science, technology, maths and English language (Alemdağ & Erdem, 2017; Brintnall, 2002; Ceven McNally, 2016; Çetin, 2013; Çobanoğlu et al., 2017; DeWert et al., 2003; Kahraman, 2012). Furthermore, when the literature about early childhood education was examined, no research on e-mentoring could be found. Therefore, this study aimed at developing an “E-mentoring Based Education Program for Preschool Teachers (e-MENTE:PT)” to support their professional content knowledge, learning environments and educational practices, which include areas of incompetence determined as a result of a literature review, and studying the impacts of this program on preschool teachers.

Accordingly, the research questions were set as follows:

What are the needs of teachers for the e-MENTE:PT program and what method should be used to meet their needs?

In what way has the e-MENTE:PT program been reflected onto the educational practices of teachers?

Has the e-MENTE:PT program had any impact on the early education learning environment?

Has the e-MENTE:PT program had any impact on the professional content knowledge of teachers about the elements of Preschool Education Program?

In what way has the e-MENTE:PT program been reflected onto teachers’ individual professional development?

Method

Research design

The objective of this research study was to develop an e-MENTE:PT program, to determine problems encountered during implementation, to create new designs to eliminate the problems, to implement and test the new design, and finally to redesign and assess the program. Thus, design-based research model was chosen as the study method.

In a design-based research, the objective is to review and improve the analysis, design, development and realization processes of educational practices repeatedly, systematically and flexibly (Güler, 2010).

Design-based research can be most effectively applied in studies in which e-learning materials and environments are developed because its most fundamental property is that it can be used for a new learning environment, new educational application or developing a new theory. In this context, it can be asserted that the development of an e-learning system and design-based research are fit for each other. Design-based research focuses on design problems related to user control in e-learning environments and try to reach the best by redesigning in a cyclic manner, using the information about the impacts of user control on learning. This can be the reason why design-based research is preferred over experimental design methods in studies about e-learning environments (Anderson & Shattuck, 2012; Baltacı et al., 2016; Kuzu et al., 2011; Özyurt & Özyurt, 2017).

Results from design-based research and results from experimental studies differ (Scott et al., 2020). While the significance of intervention is prioritized in experimental research, describing learning outcomes within the context of learning processes is in the foreground in design-based studies. For this reason, in this study no control group was formed.

As this study aimed to produce designs to develop an e-MENTE:PT program, to implement and test it, and to assess it, and because of the reasons explained in the above paragraphs, design-based research model was determined to be the most appropriate method for the design of this study, which involved the following stages based on the fundamental steps of design-based research.

Design stage: creation of the contents of the e-MENTE:PT Program

The e-MENTE:PT Program is a professional development tool that has been created by means of a design-based model to support preschool teachers for early education curriculum. It is installed in the learning management system called Canvas. The Canvas learning management system is organized in such a way that each mentor can work with a mentee on a one-to-one basis. In our study, for example, every mentee saw only the sources provided by her/his own mentor, and they conducted the discussion questions process and live lessons on a private basis.

At the beginning, in order to form the contents of the modules and to get teachers’ opinions on how to present the content, focus group interviews were made. The data obtained from the focus group interviews were used to create the content pool for the program modules. Consequently, the program involved 12 modules with the following titles: Preschool Readiness, Learning Centres and Role of the Teacher, A Day of the Teacher: Planning, A Day of the Teacher: Implementation, A Day of the Teacher: Evaluation, Abuse and Neglect, Classroom Management I, Classroom Management II, Family Education, Inclusion, Child Recognition and Evaluation, and Family Participation. Every module included contents, objectives, module materials, videos, e-books, implemented and evaluated accurate sample documents, pre- and post- module evaluation questions, discussion forum questions and teacher development portfolio.

Analysis stage: Implementation of the design-based e-MENTE:PT Program

In this stage, the process analysis of the e-MENTE:PT Program was conducted. First, the mentors shared the prepared program modules with the mentees. Each mentor shared sources according to the needs of her/his mentee, which were based on the responses of each mentee to the pre-interview questions. The program sources, which were thought to support the Preschool Education Program, were prepared by the researchers and included the following: theoretical knowledge, books, articles, sample practices, presentations, photographs, example activities, voice records, teacher experiences and e-books. The way mentor’s source file was shared with the mentees complied with their individual needs within each topic. After the source sharing, discussion forum questions were presented to the mentees. The mentor administered the discussion process and conducted live lessons whenever needed so that the mentees development is supported. After each module was completed, the mentee was expected to create a “Teacher Development Portfolio” regarding the training throughout the module.

Redesigning stage: Redesigning the design-based e-MENTE:PT program taking into consideration the evaluations made after its implementation

In this stage, the analyses of views regarding the learning contents, learning materials, learning processes and learning environment were considered. As different needs of teachers were uncovered during the research period, it was decided that the e-MENTE:PT Program be presented to the teachers independently to meet their requirements.

Study group

Identification of the mentors

The selected mentors were university instructors from five universities in different provinces; all worked in the undergraduate program of early education teaching department and had at least five years of experience in teaching face-to-face educational practices. There were nine mentors with the following distribution: two mentors from each of the four provinces and one mentor from one province. Each mentor carried out the implementation with two mentees.

Identification of the focus group teachers

To determine the needs of preschool teachers for the e-MENTE:PT Program, purposeful sampling method was employed. Thus, five focus groups were formed from one hundred and five voluntary preschool teachers, who worked in the same provinces with the mentors, who were undergraduates of preschool teaching departments (provided they graduated from a different university than the one in the province they lived at the time of the study) and who had at least five years of experience.

Identification of mentees

The mentees from each province were identified on a voluntary basis by means of purposeful sampling method; the condition was that they graduated from a different university than the one in the province they lived at the time of the study. Furthermore, it was stated in the research participation form that the study would be carried out by way of distance education (via web environment), and consequently, as the research would involve e-mailing, online document sharing and online live lessons, the mentees should also have the necessary skills. Thus, the candidate participants were well informed about the conditions when they volunteered for the study. The mentee group was composed of eighteen full-time and nine substitute voluntary teachers from five different provinces. During the implementation process, two full-time teachers had to leave the research, one for health reasons, and the other for being appointed to another province. They were substituted by two substitute teachers.

Data collection tools

Qualitative and quantitative data collection tools were used for gathering data, which are the following:

Focus group interview form

The form was based on the current knowledge and skills status of teachers, as well as their needs, regarding the MoNE 2013 Preschool Education Curriculum. The researchers prepared open-ended questions that included the elements of the MoNE 2013 Preschool Education Curriculum and after getting expert views, the form was finalised. The form included 52 questions about what the teachers already knew about monthly education plan, daily education plan, activity plans, development observation form, development form, development portfolio and family support training guide; what they did in the implementation period; their training needs and what kind of training they wanted to receive.

In-class observation form

To determine the situation before the implementation of the e-MENTE:PT program, teachers were observed in their classrooms to see how they implemented the curriculum in their classes. An in-class observation form was prepared to identify the training requirements and after getting the expert views, the form was finalized. The in-class observation form includes the following topics: time to start the day, playing at learning centres, activity time, evaluation of the day, classroom management, individual traits of the teacher and communication skills. Under each topic, there are items and note sections for making notes of observation results about these items. The researchers observed the teachers related to the attitudes stated in the form and made their notes in the sections with the titles; observed, not observed, attitude-expression, comment. The form was applied twice; before and after the implementation of the e-MENTE:PT Program.

Document review checklist

A document review checklist was prepared to identify the situation of teachers regarding their planning, implementation and assessment of education periods, and after getting the expert views, the form was finalized. Documents, prepared by teachers, including the monthly education plans, activity plans, daily education plan, development observation form, development reports, development portfolios and family participation and education reports were reviewed, and the list was filled in twice, before and after the implementation of the e-MENTE:PT Program.

Early childhood education rating scale–revised (ECERS–R)

The scale developed by Tovim (1996) was adapted to Turkish by Yıldırım et al. (2009), and its validity and reliability was confirmed. The Cronbach Alpha value of the scale was calculated as α = 0.88. The Early Childhood Education Rating Scale consists of 43 items on the following categories: (1) space and furnishings, (2) personal care routines, (3) language-reasoning, (4) activities, (5) interaction, (6) program structure, (7) parents and staff. The scale was applied twice; before and after the implementation of the e-MENTE: PT Program.

Module activities pre-and post-evaluation questions

Evaluation questions were prepared to identify teachers’ practices of the MoNE Preschool Education Curriculum within the implementation period of the e-MENTE:PT Program and thus to determine their needs, and after getting the expert views, the form was finalized. The answer keys for the pre- and post- evaluation questions were prepared beforehand so that all mentors can evaluate mentees equally. The mentees were asked the questions before and after the implementation.

Discussion forum questions

Discussion forum questions were prepared for the e-MENTE:PT Program and after getting the expert views, the form was finalized. The questions consisted of the following topics: the objective of the module, problems (relating the module) that can be encountered in the field, offering recommendations suitable for the objective and process of the module, and providing an example situation of a teacher experience suitable for the objective and process of the module. The discussion forum questions were used during the implementation period.

Live lessons

The aim of the live lessons was to support the mentees in the required topics after s/he answered the discussion questions. Before starting the live lessons, the mentee’s responses were analysed by the mentor. The needs acknowledged as a result of the analysis were dealt with again in the live lessons and the mentee received the mentorship s/he required. The live lessons were conducted during the implementation period.

Teacher development portfolio

At the end of each module of the e-MENTE:PT Program, teachers were required to ask themselves the question “What have I learnt in this module?” and then prepare a self-assessment report. The teachers were expected to prepare and submit to the mentor a file containing concrete evidence such as an example activity, picture, photograph and other experiences.

Data collection process

The data was collected in the 2016–2017 academic year. Table 1 summarizes the data collection tools, process and analyses.

Table 1

Data collection and analyses processes

Type of Data	Research Question	Data Collection Tools	Design-Based Research Model
Qualitative	What are the needs of teachers for the e-MENTE:PT Program and what method is expected to meet their needs?	Focus Group Interview Form	Design
Qualitative	What are the reflections of the e-MENTE:PT Program onto the in-class practices?	In-class Observation Form	Design
Qualitative	What are the reflections of the e-MENTE:PT Program onto the activity plans, monthly education plans and child recognition and evaluation forms prepared by the teachers?	Document Examination Checklist	Analysis
Quantitative	Does the e-MENTE:PT Program have an impact on the preschool learning environment?	Early Childhood Education Rating Scale (ECERS – R)	Analysis
Quantitative	Is there a difference between the e-MENTE:PT Program’s module assessment pre- and post- test scores relating the Preschool Education Curriculum?	Module Activities Pre- and Post- Evaluation Questions	Analysis
Qualitative	In what way was the e-MENTE:PT Program reflected onto the teachers in each module?	Discussion Forum Questions	Redesign
Qualitative		Live Lessons	Redesign
Qualitative	In what way was the e-MENTE:PT Program reflected onto their professional development?	Teacher Development Portfolio	Redesign
Quantitative	How satisfactory was the learning management system which contained the e-MENTE:PT Program?	e-Mentoring Based Education (e-MENTE: PT) Program General Assessment Questionnaire

Treatment fidelity

Attendance of mentees to each module in the learning management system was followed by the mentors and the project coordinator. Assignments belong to the modules, module pre and post questions, participation to the discussion group questions and live lessons were controlled by the project coordinator. Although the content of the program structured, mentors were flexible regarding completion deadlines, given extensions and incompletes when it is needed. Besides, guidance given by the mentors were also checked by the project coordinator and mentors send biweekly reports to the project coordinator. Besides, observations and document analysis made by mentor in the class of mentees was carried out by research assistants too. The inter-observer reliability was realized by the formula of “Number of items with consensus / total number of items with consensus + disagreement × 100” and it was found 90%. Because of the criterion regarding the reliability of is 80%, the reliability of observations and document analysis was ensured (Tekin-İftar & Kırcaali-İftar, 2012).

Data analyses

Qualitative data obtained from In-class Observation Forms, Document Examination Checklists, Focus Group Interview Forms, Teacher Development Portfolios, Discussion Forum Questions and Live Lessons were analysed by means of descriptive analysis. Descriptive analysis process involves the correlation of the data according to pre-determined themes, explaining the meaning, interpretation, examining the reason-result relationships and achieving results (Yıldırım & Şimşek, 2013). A thematic framework was determined in line with the research objectives and interview questions. Within this framework, an "Interview Coding Key" was created by making use of the responses to the interview questions. The reliability of the research was verified by comparing the codings calculated by the researcher and a field expert using the following formula: Reliability = Consensus / Consensus + Disagreement (Miles & Huberman, 1994). Accordingly, the inter-coder reliability was found to be 92%.

The quantitative data obtained from the ECERS-R and Module Activities Pre- and Post- Evaluation Questions were analysed using the Wilcoxon Signed Ranks Test, which is one of the non-parametric tests, as sample size was small. Bonferroni adjustment was made to determine a stronger alpha level in order to reduce the possibility of finding meaningful results as multiple comparisons were made for the ECERS-R results in the same groups (Akbulut, 2010, p. 125). Therefore, the new alpha value was considered as 0.007 for the scale results. However, since the data from the module activities pre- and post- evaluation questions were obtained from different groups, no new alpha value was determined for this data.

Results

Results from the quantitative data

The impact of e-MENTE: PT Program on Preschool Learning Environments

In Table 2, there is a significant difference between the pre- and post-test scores. These results demonstrate that the e-MENTE: PT Program has been effective in supporting the professional development of preschool teachers and increasing the quality of early education learning environments.

Table 2

Wilcoxon Signed Rank Test results of the difference between the total ECERS-R scores of pre- and post-tests

Score	Ranks	N	Mean Rank	Sum of Ranks	z	p
Total pre-test	Negative rank	1	1	1.00	2.845*	0.004
	Positive rank	10	6.50	65.00
Total post-test	Ties	0
	Total	11

*Based on negative ranks.

In Table 3, there is a significant difference between the pre- and post-test scores of the subscales of space and furnishing, personal care routines, and activities. The results suggest that preschool teachers have improved in the following activities within a ‘daily education plan’: time to start the day, learning centres and play, activity time and daily evaluation time.

Table 3

Wilcoxon Signed Rank Test results of the difference between the ECERS-R subscale scores of pre- and post-tests

Score	Ranks	N	Mean Rank	Sum of Ranks	z	p
Space and furnishings_pre-test	Negative rank	0	0.00	0.00	2.807*	0.005
	Positive rank	10	5.50	55.00
Space and furnishings_post-test	Ties	1
	Total	11	0.00	0.00
Personal care routines_pre-test	Negative rank	0	5.00	45.00	2.675*	0.007
	Positive rank	9
Personal care routines_post-test	Ties	2
	Total	11	2.00	6.00
Language and reasoning_pre-test	Negative rank	3	6.50	39.00	1.958*	0.050
	Positive rank	6
Language and reasoning_post-test	Ties	2
	Total	11
Activities_pre-test	Negative rank	1	1.00	1.00	2.703*	0.007
	Positive rank	9	6.00	54.00
Activities_post-test	Ties	1
	Total	11
Interaction_pre-test	Negative rank	2	6.25	12.50	1.532*	0.126
	Positive rank	8	5.31	42.50
Interaction_post-test	Ties	1
	Total	11
Program structure_pre-test	Negative rank	2	4.75	9.50	1.836*	0.066
	Positive rank	8	5.69	45.50
Program structure_post-test	Ties	1
	Total	11
Parents and staff_pre-test	Negative rank	0	0.00	0.00	2.384*	0.017
	Positive rank	7	4.00	28.00
Parents and staff_post-test	Ties	4
	Total	11

* Based on negative ranks, p < 0.007.

The impact of e-MENTE: PT Program on Preschool Teachers’ Professional Content Knowledge

Table 4 shows that the e-MENTE: PT Program has improved the content knowledge of preschool teachers in the following modules: child recognition and evaluation, learning centres and role of the teacher, planning, implementation, evaluation and family participation.

Table 4

Wilcoxon Signed Rank Test results of the difference between the pre and post assessment scores of the modules

Score		Ranks	N	Mean rank	Sum of rank	z	p
Preschool Readiness	Pre-test	Negative rank	2	4.50	9.00	1.268*	0.205
		Positive rank	6	4.50	27.00
	Post-test	Ties	1
		Total	9
Child Recognition and Evaluation	Pre-test	Negative rank	2	1.50	3.00	2.310*	0.021
		Positive rank	7	6.00	42.00
	Post-test	Ties	1
		Total	10
Learning Centres and Role of the Teacher	Pre-test	Negative rank	1	1.00	1.00	1.992*	0.046
		Positive rank	5	4.00	20.00
	Post-test	Ties	2
		Total	8
A Day of the Teacher: Planning	Pre-test	Negative rank	0	0.00	0.00	2.207*	0.027
		Positive rank	6	3.50	21.00
	Post-test	Ties	2
		Total	8
A Day of the Teacher: Implementation	Pre-test	Negative rank	0	0.00	0.00	2.032*	0.042
		Positive rank	5	0.03	15.00
	Post-test	Ties	2
		Total	7
A Day of the Teacher: Evaluation	Pre-test	Negative rank	0	0.00	0.00	2.023	0.043
		Positive rank	5	0.03	15.00
	Post-test	Ties	2
		Total	7
Classroom Management 1	Pre-test	Negative rank	0	0.00	0.00	1.604*	0.109
		Positive rank	3	2.00	6.00
	Post-test	Ties	2
		Total	5
Classroom Management 2	Pre-test	Negative rank	2	1.75	3.50	0.272*	0.785
		Positive rank	1	2.50	2.50
	Post-test	Ties	2
		Total	5
Family Participation	Pre-test	Negative rank	0	0.00	0.00	2.207*	0.027
		Positive rank	6	3.50	21.00
	Post-test	Ties	1
		Total	7
Family Education	Pre-test	Negative rank	2	3.00	6.00	954*	0.340
		Positive rank	4	3.75	15.00
	Post-test	Ties	1
		Total	7
Abuse and Neglect	Pre-test	Negative rank	0	0.00	0.00	1.826*	0.068
		Positive rank	4	2.50	10.00
	Post-test	Ties	2
		Total	6

*Based on negative ranks, p < 0.05.

Results from the qualitative data

The needs of teachers for the e-MENTE: PT Program and its reflections onto their educational practices

Needs of teachers

Focus group interviews were carried out to determine the needs of teachers and design the e-MENTE: PT Program according to these needs. The interviews revealed that majority of the teachers lacked knowledge and experience in the planning, implementation and evaluation stages of the MoNE Preschool Education Curriculum; therefore, they needed support.

According to the initial observations, the weaknesses of teachers were in the fields of learning centres and role of the teacher, planning, implementation, classroom management, and abuse and neglect. Moreover, teachers needed more support for educational environments that they created, their perspectives for children, and their professional development. These results of the initial observations, made before implementing the program, showed consistency with the results obtained from the focus group interviews.

The document analysis results indicated that the monthly education plans were usually formed using already prepared plans. The chart on inclusion of concepts in monthly education plans and the chart on inclusion of gains and indicators were usually unfilled, and educational practices contained in the sections of the monthly education plan did not include gains and concepts adequately. Furthermore, the variety of group activities were not balanced, different methods and techniques emphasized in the evaluation stage of the program were not usually used, activities were not suitable enough for the developmental level of the children, and adjustments for the disabled children were not made. The teachers were willing to create the development observation form, development report and development portfolio, but they needed information and support about how to prepare them. The results related to benefiting from the Guide for Family Support Training Integrated with Preschool Education (OBADER) revealed that teachers did not prepare for the adaptation week, they did not make home visits, and individual meetings with families were held by only a few teachers.

Impacts of e-MENTE: PT Program on Teachers’ Practices

After the implementation of the education program, the researchers made a final class observation. The observations revealed that the program supported some of the teachers positively in these areas: preparation for school, planning and implementation of education, learning centres and role of the teacher, family participation and classroom management. Furthermore, teachers who did not use appropriate classroom management methods at the beginning started to use positive disciplinary approaches, they were careful about enhancing the learning centres, positive communication means with children were developed, and the quality of the daily education plan was improved.

The document examination conducted after the implementation of the education program indicated that the use of ready-made monthly education plans decreased, those who continued to use them did so to get help from it, and they re-arranged the ready-made monthly education plans taking the development of the child into consideration. Moreover, development observation forms and reports used to evaluate children and recommendations for families were prepared with a higher quality.

Results from discussion forum questions

Discussion questions were presented in the duration of e-mentoring between the mentor and the mentee after the teacher completed each relevant module in the system. Whether the acquired knowledge was implemented or not was checked through the discussion. As additional knowledge was supplied, the correction of inappropriate understandings and perceptions was ensured. The examination of the teaching management system showed that during the discussion process, the teachers corresponded mostly on the following modules: child recognition and evaluation, learning centres and role of the teacher, planning, implementation and evaluation of education, and classroom management.

The response of the teacher to the question about the module titled “A Day of the Teacher: Evaluation” revealed that she encountered problems with an activity. The mentor shared a sample observation record and some other examples of different evaluation methods. The related correspondence is presented below:

Could you please share a different activity that be included in the daily education plan and done in the daily evaluation time?

“I evaluate daily activities verbally during, and sometimes at the end of, the activity, but I have a problem about taking notes. The moment I catch the children’s interest, I try to move on to the next stage, and at the end of the day, evaluations get muddled up. I usually make evaluations based on the questions I asked after watching a drama, a field trip or an experiment.”

“All right. Have you ever tried getting to know and evaluating children by using a teacher’s notebook? Now, I’ll share an example of such a notebook with you. Please go over it and then study the source in the attachment.”

“I studied the materials. This week, we have a field trip to the milk factory. When we return, instead of asking questions for evaluation, I’m considering asking the children to draw pictures. In addition, I’ll have a slide show using the photographs I have taken to reinforce what they learnt. I find your “how was today” questions interesting, I’ll try them.

Following a discussion question in the “A Day of the Teacher: Planning” module, the mentee explained how s/he would prepare a daily education plan and share it with children in the class. The related correspondence is presented below:

What contributions do you think using images in the preparation of daily education plan would offer to children?

“While watching the video, I realized that it was a great loss not having done it so far. The child learns planning and monitoring the time, as well as cooperation; in short, s/he participates in the process and monitors it in person. What’s more, if we made it an erasable board, and gave the responsibility of marking to the child, then concepts such as ordering and time, as well as awareness of writing would be supported.”

“Did you have a chance to examine the materials I sent you?”

“I went over the planning materials. I thought that implementation would be easier if the daily education plan were prepared and monitored together with children… I prepared materials. I’m planning to try them in the class today.”

In the “Child Recognition and Evaluation” module, following the discussion question, a live lesson was conducted so that a lengthy conversation could be made on how to improve the development observation form and what the teacher did during the observation. The related correspondence is presented below:

What adversities could be faced if the teacher used words of judgement and labelling when they recorded their observations?

“Expressions that include judgement and labelling will not be reminders when a problem is encountered. Observation records should be about the content and reason of the behaviour.”

“What techniques should we use while observing children in the class? Please send me an observation form, we can discuss on the example better. We can start the live lesson after you send me the form.”

Results from Live Lessons

The live lessons were carried out according to the needs and willingness of the teachers. It can be stated that after discussing on various perspectives, the reservations of the mentees started disappearing and they were oriented towards appropriate methods.

The conversations of Mentee (teacher) 2 about the adaptation week indicated that s/he focused on families’ not preparing their kids for school. At this point, the mentor enabled the mentee to review the adaptation week practices and think about the issue by asking her/him questions. This helped the mentee to start changing her/his reservations about the adaptation week. The related correspondence is presented below:

“…the family doesn’t familiarize the child with school before the adaptation week at school or they don’t say anything about the school concept. I’m just thinking that they could be given a seminar when they come to school for registration with the counselling service. Or maybe, a social meeting could be held for everyone on a certain date to tell their children about what the school is and what it is not.”

1: “All right, do you think you could arrange a workshop, in the first week in the absence of children, explaining the parents what happens at school in the first week?

“Yes I believe this should be done (…)”

: “Then you think it is essential that the family informs the child correctly about the school concept during the adaptation period.”

“Yes, especially starting from the registration when the administration sees them… not only the teacher… a leaflet can be prepared for this purpose. The leaflet can orientate parents about the basics of how to make their children understand and like the school… this can be done before the first parents’ meeting. This can be done early, and finally, it can be reinforced through activities in the adaptation week.”

Another conversation, between Mentor (researcher) 2 and Mentee (teacher) 4, revealed that the records of a child kept by a teacher were not transferred to the following year, so all the information about the child remained with the teacher. In this case, Mentor 2 asked some questions and made the following recommendations:

“When my students go to another teacher in the following year, I don’t transfer my own development observation forms or development checklists or other information to the new teacher. They stay with me.”

: “I see, do you think it would be different if you did so, or you suggested?”

“Sometimes, when there is a problem about my ex-students, we exchange opinions. Not in a document but we always orally communicate, talk about them.”

: “I see. (…) Do you think you could try? You already communicate orally, but what if it were done through official documents?”

“Actually, yes, we should mention this in our meeting. It will be much better to communicate through documents too.”

This conversation exemplifies that Mentor 2 has offered a practice, which is new for the teacher, and enabled her/him to adopt it.

An example conversation between the mentor and mentee about the problem of a child involving a game in learning centres is as follows:

“This year, there is a child who just drags the blocks in the block centre, or s/he hits and breaks them, and later s/he can even be aggressive at other children.”

: “I see. I have a suggestion. If the child has not started to use the blocks to create a structure yet, and if s/he only drags them, use them like motor games, you can support them about how they would get to the structure making stage. You can sit at the block centre with the child, speak with her/him, and attract her/his attention by supporting or using miniature tools. For example, wooden characters, wild animals, miniature people…”

Results related to the reflections of the e-MENTE:PT Program onto the Professional Development of Teachers

The examination of the Teacher Development Portfolios revealed that the teachers found the program supportive in the modules of learning centres and role of the teacher, planning, implementation, assessment, classroom management I, classroom management II, family participation, family education, and abuse and neglect. Although their portfolios mainly reflected what they learnt in the modules, they also made evaluations about their social development through the modules and the program. The teachers stated that the program increased their motivation, improved their creativity, decreased their anxiety, and contributed to their sharing with other teachers. Furthermore, the teachers set targets for their future works and the program directed them to investigate on topics other than the modules too.

In the Planning of Education Module, some of the responses to the question “What have I learnt in this module?” are as follows:

“The images in this module have been prepared very nicely. Thanks to this information, I realised my shortcomings. I made notes of the issues that I need to take care. I shared my notes with my group colleagues. I found the answers to the questions in my mind in this module. I am thankful to all those who contributed.”

4: “I learnt about the benefits of making monthly education plans, preparing daily education plan, and further, preparing the daily education plan in a diagrammatic manner so that the children also understand them; benefits of preparing the activity plans in detail; the elements I should integrate in these plans; and the importance of having a daily evaluation time. We didn’t use to have enough time for evaluating the day, but I realised that I needed to spare more time for this.”

In the Classroom Management I Module, some of the responses to the question “What have I learnt in this module?” are as follows:

2: “I care a lot about classroom management. Here, an issue that I emphasize in my class most is the disciplinary methods. In my class I use place and line order, and in getting in the line, I care about being fair. Being just and honest is important, not competitive. I care for a child’s sharing and supporting the weaknesses of others in areas s/he is better. This module has reinforced all this, and I have seen that I was doing this right once again.”

4: “I have gone through my knowledge about classroom management, disciplinary understanding, making rules and their sustainability. I had the chance of assessing my practices. We reviewed the rules. We reinforced the rules with visuals, and we put them up at certain places of the classroom. When there were any violations of the rules in the day, the children stepped in themselves and showed the pictures.”

Conclusion, discussion and recommendations

The aim of this study was to develop a design-based e-mentoring program to support the professional development of preschool teachers and to test its effectiveness.

The focus group interviews indicated that majority of the teachers lacked knowledge about the planning, implementation and evaluation of the education program and they needed support. In addition, initial observations made in their classrooms showed that their weaknesses were in the following areas: learning centres and role of the teacher, planning the education, implementation, classroom management-I, classroom management-II, and abuse and neglect.

The document analyses concluded that the monthly education plans used were usually ready-made plans; therefore, the charts of gains and indicators and the inclusion of concepts in the monthly education plans were usually left unfilled, and activities and other works in different sections of the monthly education plan did not support gains and concepts sufficiently. Aras and Tantekin Erden (2020) proved that the pedagogical documentation method supported children’s meta-cognitive and self-organizational skills. Another study (Buldu et al., 2018), which was part of a large-scale design-based phenomenological research, established that high quality evaluation contributed to the individual, interpersonal relations and learning processes. Accordingly, it was determined that the participants of this study needed to get knowledge and support about creating a development observation form, a development report and a development portfolio.

The results obtained from the focus group interviews, observations and document analyses share similarities with other research results in the literature. Other studies also stated that teachers encountered problems in creating learning centres (Erden, 2010; Özsırkıntı et al., 2014). According to Kandır et al. (2009), preschool teachers mostly experienced difficulties in making daily plans and evaluating them. Erşan (2011)’s observations maintained that teachers saw free play time only as an aimless activity during which a child plays freely. In another study, it was notable that the number of teachers who used a portfolio to get to know and evaluate children was very few (Yılmaz Topuz & Erbil Kaya, 2016). The same study also revealed that teachers had problems with sparing time for child recognition and evaluation, and cooperation with the family. Bağ (2015)’s study also concludes that teachers see themselves less competent in the education curriculum field than other fields and they need to be supported through in-service training. Aysu and Aral (2016) also state that teachers need support in program planning and application. The e-MENTE: PT Program was prepared based on these findings and the recommendations presented after the focus group interviews; thus, it can be asserted that the program was created according to the needs of teachers in terms of its scope and content.

In the implementation stage, the teachers were supported by means of discussion questions and their inappropriate understandings and perceptions were corrected. In addition, their knowledge was improved. In the learning management system, the discussion questions were arranged in such a way that the correspondence was only between the related/matching mentor and mentee. In this way, each mentor saw the responses of her/his mentee only, which not only facilitated feedback but also contributed to the ethical management of the process. In the discussion questions stage, more correspondence was carried on through the learning management system about child recognition and evaluation, learning centres and role of the teacher, planning, implementing and evaluating the education, and classroom management. In a study, it was revealed that a discussion forum was an opportunity for teachers to discuss educational implementations among themselves and get guidance (Gareis & Nussbaum-Beach, 2007). Babinski et al. (2001) used e-mentoring to solve the problems of new teachers, and they found out that during the process, new teachers generally wrote messages about disabled students, policies, educational experiences, technical issues, teacher perception, classroom management, working with adults and teaching curriculum. In another study, in an asynchronous online platform, it was observed that the contents of messages between mentors and mentees involved pre-planning, teaching process, evaluation of learning, classroom management and professional responsibilities (Gareis & Nussbaum-Beach, 2007).

The implementation stage of this research revealed that different learning and personal traits of teachers influenced their professional development, and the e-mentoring period was affected accordingly. We believe that customising the learning management system for the matching mentor and mentee had positive impacts on teachers’ professional development because in this way, every mentor shared education modules in other topics that their mentee needed using the same learning management system, and they found the opportunity to steer the process through discussion questions. Moreover, live lessons and classroom visits were conducted with some of the mentees to meet their needs. The literature also suggested that mentoring processes could be varied as mentees had different experiences and pedagogical knowledge (Shpigelman & Gill, 2013). The live lessons were carried out according to the needs and willingness of the teachers. It can be stated that after discussing on various perspectives, the reservations of the mentees started disappearing and they were oriented towards appropriate methods. Furthermore, in the live lessons, recommendations were offered to the mentee to enable her/him to adjust the situation to her/his classroom so that the mentee finds the solution herself/himself.

The research results showed that there was a significant difference between the pre- and post- module evaluation scores of the teachers. Based on these results, it can be concluded that the program improved the knowledge of teachers especially in the following contents: child recognition and evaluation, learning centres and role of the teacher, planning of education, implementation of education, and family participation. Furthermore, it was observed that after the implementation of the e-mentoring program, the quality of early education learning environments increased. There is a meaningful difference between the pre- and post-test results of especially the physical environment, personal care routines and activities sub-scales. In other words, the training provided enabled not only the preschool class to improve physically but also the teacher to develop activity plans and to use the daily routines better. In their research study, Buldu et al. (2018) recommend that to be able to evaluate children effectively, learning environments should be socially and physically arranged, in- and out-of-class interactions should be supported, and teachers should be enabled to gain the necessary pedagogical knowledge and skills through pre-service and in-service training. The action research conducted by Çetin (2013) put forth that the e-mentoring program for the evaluation of structuring for English teachers working in disadvantaged areas improved their professional knowledge and awareness.

It was notable that the literature review related to the studies on supporting the professional development of teachers and teacher candidates did not include any evaluation about learning environments. Yet, this study proved that the e-mentoring program supported the quality of learning environments in the classrooms of the participating teachers. These results correspond to the qualitative results of our research. The classroom observations conducted after the implementation of the e-MENTE:PT Program indicated that the professional development of some of the teachers were positively influenced in the areas of preparation to school, planning and evaluation of education, learning centres and role of the teacher, family participation, and classroom management. Moreover, the teachers who did not use proper methods in the classroom management replaced them with positive attitudes, they were careful about enhancing the learning centres, they developed ways of positive communication with children, and they prepared and used the daily education plan as required. As a result of the document analyses made after the implementation, it was found that most of the teachers considered gains and indicators while preparing the monthly education plan, they prepared higher quality activity plans, the use of ready-made plans decreased, and they were mainly used as a reference. In addition, the quality of the development observation forms and reports used for the evaluation of children and the recommendations made for families increased.

In the Teacher Development Portfolios, the teachers stated that the program supported their professional development particularly in the modules of learning centres and role of the teacher, planning, implementation, assessment, classroom management I, classroom management II, family participation, family education, and abuse and neglect. The teachers stated that the program increased their motivation, improved their creativity, decreased their anxiety, and contributed to their sharing with other teachers. Furthermore, the teachers set targets for their future works and the program directed them to investigate on topics other than the modules too. In another study, e-mentoring was conducted to support the professional development of candidate teachers of information technologies, and interviews and researchers’ diaries proved that e-mentoring had positive impacts on teachers’ not only professional development but also the formal training process (Kahraman & Kuzu, 2016). Other research also established that thanks to the support from the mentor, teachers’ feelings of emotional support increased, feelings of loneliness decreased, teaching self-efficacy increased, reflective thinking skills improved, willingness for teaching increased, and problem-solving skills developed (Brintnall, 2002; DeWert et al., 2003; Hew & Knapczyk, 2007; Langhey, 2008; McDiarmid, 2006). In an action research, Aras (2019) also explained that even if difficulties were involved during the process, as a result of implementations carried out together, teachers made systematic observations, which they documented, and they started to use their assessment data for future planning.

When the qualitative and quantitative results of the research are assessed together, it can be established that teachers have developed their professional content knowledge and reflected it onto the implementation periods successfully with skill. The learning management system used in this study was effective in maintaining customised one-to-one mentorship on an individualised basis for each pair of mentor and mentee. Moreover, the e-mentorship program offered to the teachers included the seven factors that affected the quality of the professional development programs, which was taken from “Effective Teacher Professional Development Report (Darling-Hammond et al., 2017)”. These factors were content focus, active learning, supporting collaboration, using models and modelling for effective practice, providing coaching and expert support, offering feedback and reflection, and sustained duration. During our e-mentoring period, in addition to theoretical knowledge, the program included implementation examples, discussion questions, and live lessons, which may also have increased its effectiveness.

To conclude, it can be maintained that the e-MENTE:PT Program increased the preschool teachers’ professional content knowledge, the quality of learning environments and motivations for learning. Thus, the teachers have transferred what they learnt to their educational practices and improved themselves. When the literature was reviewed, it was noted that the number of studies on the use of e-mentorship for the professional development of teachers is quite limited, and there were not any studies involving the preschool teachers; still, it was stated that this method is an effective way of approaching teachers (Babinski et al., 2001; Baran, 2016; Çetin, 2013; Gareis & Nussbaum-Beach, 2007; Kahraman, 2012; Kahraman & Kuzu, 2016; Kovalchuck & Vorotnykova, 2017; Langhey, 2008; Ligadu & Anthony, 2015; McAleer & Bangert, 2011; Quintana & Zambrano, 2014; Simonsen et al., 2009).

It can further be asserted that the original aspects of this research are the use of a design-based model, the upgraded use of the design within the learning management system, and the assessment of teacher development by means of multiple measurement instruments. Moreover, being able to work on a customised learning management system for each mentor and mentee, the teachers were supported according to their own needs and learning paces by an expert on a one-to-one basis.

Given the Covid-19 pandemic we are in, it can be observed that both teachers and teacher trainers and academicians have become accustomed to using distance education and its relevant platforms, and that face-to-face professional development training environments are increasingly replaced by online environments. Therefore, it can be stated that the learning management system used in this research, the e-mentoring method and the developed training program can be used not only for the professional development of the teachers but also for the training of teacher candidates in case of another pandemic. Moreover, the research is significant in that it includes supportive elements of media and technology literacy (Partnership for 21st Century Skills, 2009), which is an important twenty-first century skill. Even though it was not assessed in the study, the researchers also believe that the research period facilitated the participating teachers’ and academicians’ adjustment to online environments during the pandemic.

Further research can be conducted to examine the impacts of the e-MENTE:PT Program on the development of children. Moreover, longitudinal studies can be carried out to monitor and evaluate the permanence of the positive effects of the program. E-mentoring can also be used to support the professional development of preschool teachers who will start to work for the first time, and the effectiveness of the program on the new teachers and on the experienced teachers can be compared. To ensure professional communication in the mentorship system, a professional development network can be established. Through the network, by reaching more teachers than the number of participants in this study, the practice in this research can be repeated and the results can be assessed. Mentoring can be used in studies with small groups, especially in teaching practice lessons of undergraduate programs of teaching departments, and the results can be evaluated for its effectiveness.

In the 2015 – 2019 Strategic Plan prepared by MoNE (MoNE, 2015), it was stated that some strategic steps were taken for teachers’ getting periodical training to increase quality in education and teaching, particularly on the following areas: leadership and classroom management, competence, teaching styles, measurement and evaluation, material preparation, establishing communication, using technology effectively and efficiently, foreign language, and professional ethics. Nevertheless, the research results have proved that these measures were not adequate, thus, it is recommended that the methods used in this research be additionally employed to support the professional development of teachers.