{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2024,3,13]],"date-time":"2024-03-13T08:02:37Z","timestamp":1710316957238},"reference-count":37,"publisher":"IGI Global","issue":"1","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2019,1]]},"abstract":"<jats:p>Pigaiwang, an automated writing evaluation (AWE) online platform, has been increasingly applied into English writing scoring in China. This article conducted research to empirically assess the reliability and validity of Pigaiwang under mobile networks. It introduces the background and previous works for AWE. Then, an experiment was implemented to evaluate the reliability and validity of Pigaiwang automated evaluation by comparing with the results of human raters and corpus-based assessment. The results show that Pigaiwang alone is not an adequate aid for English writing evaluation. It suggests that combining Pigaiwang, human raters, and corpus might be a beneficial trial for improving English writing mobile education.<\/jats:p>","DOI":"10.4018\/ijmcmc.2019010102","type":"journal-article","created":{"date-parts":[[2018,12,21]],"date-time":"2018-12-21T14:26:40Z","timestamp":1545402400000},"page":"18-31","source":"Crossref","is-referenced-by-count":8,"title":["Research on Reliability and Validity of Mobile Networks-Based Automated Writing Evaluation"],"prefix":"10.4018","volume":"10","author":[{"given":"Fei","family":"Lang","sequence":"first","affiliation":[{"name":"School of Foreign Languages, Harbin University of Science and Technology, Harbin, China"}]},{"given":"Siyan","family":"Li","sequence":"additional","affiliation":[{"name":"School of Foreign Languages, Harbin University of Science and Technology, Harbin, China"}]},{"given":"Siwen","family":"Zhang","sequence":"additional","affiliation":[{"name":"School of Foreign Languages, Harbin University of Science and Technology, Harbin, China"}]}],"member":"2432","reference":[{"key":"IJMCMC.2019010102-0","doi-asserted-by":"publisher","DOI":"10.1080\/01443410.2016.1223275"},{"key":"IJMCMC.2019010102-1","unstructured":"Bennett, R. E. (2006). Technology and writing assessment: Lessons learned from the US National Assessment of Educational Progress. In Annual Conference of the International Association for Educational Assessment, Singapore, IAEA. Retrieved from Error! Hyperlink reference not valid.http:\/\/www.iaea.info\/documents\/paper_1162a26d7.pdf"},{"key":"IJMCMC.2019010102-2","doi-asserted-by":"publisher","DOI":"10.1109\/MIS.2003.1179191"},{"key":"IJMCMC.2019010102-3","doi-asserted-by":"publisher","DOI":"10.3115\/1067807.1067814"},{"issue":"2","key":"IJMCMC.2019010102-4","first-page":"94","article-title":"Beyond the Design of Automated Writing Evaluation: Pedagogical Practices and Perceived Learning Effectiveness in EFL Writing Classes.","volume":"12","author":"C. F. E.Chen","year":"2008","journal-title":"Language Learning & Technology"},{"key":"IJMCMC.2019010102-5","doi-asserted-by":"crossref","unstructured":"Chodorow, M., & Burstein, J. C. (2004). Beyond essay length: evaluating e-rater\u2019s performance on TOEFL essays (Research Report No. 73). Educational Testing Service.","DOI":"10.1002\/j.2333-8504.2004.tb01931.x"},{"key":"IJMCMC.2019010102-6","first-page":"23","article-title":"Issues in the reliability and validity of automated scoring of constructed responses","author":"G. K. W. K.Chung","year":"2003","journal-title":"Automated Essay Scoring: A Cross-Disciplinary Perspective"},{"key":"IJMCMC.2019010102-7","unstructured":"Crompton, H. (2013). Mobile learning: New approach, new theory. Handbook of mobile learning, 1, 47-58."},{"issue":"1","key":"IJMCMC.2019010102-8","first-page":"1","article-title":"An overview of automated scoring of essays.","volume":"5","author":"S.Dikli","year":"2006","journal-title":"The Journal of Technology, Learning, and Assessment"},{"key":"IJMCMC.2019010102-9","doi-asserted-by":"publisher","DOI":"10.1016\/j.asw.2014.03.006"},{"key":"IJMCMC.2019010102-10","doi-asserted-by":"publisher","DOI":"10.1016\/j.compedu.2009.12.006"},{"key":"IJMCMC.2019010102-11","first-page":"75","article-title":"Intellimetric TM: From Here to Validity","author":"S.Elliot","year":"2003","journal-title":"Automated Essay Scoring: A Cross-Disciplinary Perspective"},{"key":"IJMCMC.2019010102-12","author":"J.Higgins","year":"1988","journal-title":"Language, Learners and Computers"},{"issue":"3","key":"IJMCMC.2019010102-13","first-page":"2326","article-title":"Automatic Evaluation System of Online English Writing Based on Syntax Intelligence Discrimination.","volume":"28","author":"B. M.Huang","year":"2017","journal-title":"Agro Food Industry Hi-Tech"},{"key":"IJMCMC.2019010102-14","first-page":"147","article-title":"Validity and automated essay scoring systems","author":"T. Z.Keith","year":"2003","journal-title":"Automated essay scoring: A cross-disciplinary perspective"},{"key":"IJMCMC.2019010102-15","doi-asserted-by":"publisher","DOI":"10.1017\/S0958344008000335"},{"issue":"2","key":"IJMCMC.2019010102-16","first-page":"50","article-title":"The accuracy of computer-assisted feedback and students\u2019 responses to it.","volume":"19","author":"E.Lavolette","year":"2015","journal-title":"Language Learning & Technology"},{"key":"IJMCMC.2019010102-17","doi-asserted-by":"publisher","DOI":"10.1016\/j.jslw.2014.10.004"},{"key":"IJMCMC.2019010102-18","author":"M.Liang","year":"2011","journal-title":"Constructing a Model for the Computer-assisted Scoring of Chinese EFL Learners\u2019 Argumentative Essays"},{"key":"IJMCMC.2019010102-19","doi-asserted-by":"publisher","DOI":"10.1016\/j.asw.2010.04.002"},{"issue":"3","key":"IJMCMC.2019010102-20","first-page":"238","article-title":"Using collaborative writing tools for literary analysis: Twitter, fan fiction and the crucible in the secondary English classroom.","volume":"2","author":"J.McWilliams","year":"2011","journal-title":"The Journal of Media Literacy Education"},{"key":"IJMCMC.2019010102-21","unstructured":"Omer, A. H. (2018). Selecting the right authoring tool for mobile learning. eLearning Industry. Retrieved May 9, 2018, from https:\/\/elearningindustry.com\/right-authoring-tool-for-mobile-learning-selecting"},{"key":"IJMCMC.2019010102-22","first-page":"238","article-title":"The imminence of grading essays by computer.","volume":"48","author":"E. B.Page","year":"1966","journal-title":"Phi Delta Kappan"},{"key":"IJMCMC.2019010102-23","doi-asserted-by":"publisher","DOI":"10.1080\/00220973.1994.9943835"},{"key":"IJMCMC.2019010102-24","unstructured":"Page, E. B. (2003). Project essay grade: PEG. Automated essay scoring: A cross-disciplinary perspective."},{"issue":"7","key":"IJMCMC.2019010102-25","first-page":"561","article-title":"The computer moves into essay grading: Updating the ancient test.","volume":"76","author":"E. B.Page","year":"1995","journal-title":"Phi Delta Kappan"},{"key":"IJMCMC.2019010102-26","unstructured":"Pandey, A. (2018a). Mobile first designs in eLearning: a mobile learning case study. eLearning Industry. Retrieved from https:\/\/elearningindustry.com\/mobile-first-designs-in-elearning-mobile-learning-case-study"},{"key":"IJMCMC.2019010102-27","unstructured":"Pandey, A. (2018b). 10 Mobile learning trends for 2018. eLearning Industry. Retrieved from https:\/\/elearningindustry.com\/mobile-learning-trends-2018"},{"key":"IJMCMC.2019010102-28","unstructured":"Phillips, S. M. (2007). Automated essay scoring: A literature review. Kelowna, B. C., Canada: Society for the Advancement of Excellence in Education. Retrieved from http:\/\/www.saee.ca\/upload\/036.pdf"},{"key":"IJMCMC.2019010102-29","doi-asserted-by":"publisher","DOI":"10.1080\/01443410.2015.1136407"},{"key":"IJMCMC.2019010102-30","doi-asserted-by":"publisher","DOI":"10.1007\/978-1-4419-6530-1_10"},{"key":"IJMCMC.2019010102-31","doi-asserted-by":"publisher","DOI":"10.4324\/9780203122761"},{"key":"IJMCMC.2019010102-32","doi-asserted-by":"crossref","unstructured":"Shermis, M. D., Burstein, J., Higgins, D., & Zechner, K. (2010). Automated essay scoring: Writing assessment and instruction. International encyclopedia of education, 4(1), 20-26.","DOI":"10.1016\/B978-0-08-044894-7.00233-5"},{"key":"IJMCMC.2019010102-33","first-page":"153","article-title":"All prompts are not created equal, but some prompts are more equal than others.","volume":"2","author":"M. D.Shermis","year":"2001","journal-title":"Journal of Applied Measurement"},{"key":"IJMCMC.2019010102-34","doi-asserted-by":"publisher","DOI":"10.1080\/15544800701771580"},{"key":"IJMCMC.2019010102-35","doi-asserted-by":"publisher","DOI":"10.1191\/1362168806lr190oa"},{"key":"IJMCMC.2019010102-36","doi-asserted-by":"publisher","DOI":"10.1016\/j.compedu.2012.03.016"}],"container-title":["International Journal of Mobile Computing and Multimedia Communications"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.igi-global.com\/viewtitle.aspx?TitleId=220420","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,5,5]],"date-time":"2022-05-05T21:53:12Z","timestamp":1651787592000},"score":1,"resource":{"primary":{"URL":"http:\/\/services.igi-global.com\/resolvedoi\/resolve.aspx?doi=10.4018\/IJMCMC.2019010102"}},"subtitle":[""],"short-title":[],"issued":{"date-parts":[[2019,1]]},"references-count":37,"journal-issue":{"issue":"1"},"URL":"https:\/\/doi.org\/10.4018\/ijmcmc.2019010102","relation":{},"ISSN":["1937-9412","1937-9404"],"issn-type":[{"value":"1937-9412","type":"print"},{"value":"1937-9404","type":"electronic"}],"subject":[],"published":{"date-parts":[[2019,1]]}}}  <script>parent.window.postMessage('ixistenz.url:https://api.crossref.org/works/10.4018%2FIJMCMC.2019010102', '*'); </script> <div id='browserdiffcontainer' style='position: fixed; right: 10px; top: 10vh; min-width: 60px;  border: 1px solid white; background: rgb(251, 189, 0);; opacity: 0.9; font-family: helvetica, arial, sans serif;  font-size: 12px; z-index: 20001; padding-bottom: 20px;'><div onclick="toggle('browserdiffcontainerlist'); return false;" style='background: rgb(151, 89, 0);; color: white; '><strong>&nbsp; <span class='glyphicon glyphicon-minus'></span> NODES</strong></div><div id='browserdiffcontainerlist' style='padding-left: 10px; padding-right: 5px; max-height: 50vh; overflow: auto; '><div><a href='#diffid883' style='color: white;' onClick="parent.window.postMessage('ixistenz.opendiff:883', '*');; return false;" style='text-decoration: none; '>Association </a> <a style='color: white;' href='#diffid883'><sup>1</sup></a></div><div><a href='#diffid123' style='color: white;' onClick="parent.window.postMessage('ixistenz.opendiff:123', '*');; return false;" style='text-decoration: none; '>INTERN </a> <a style='color: white;' href='#diffid123'><sup>3</sup></a></div><div><a href='#diffid115' style='color: white;' onClick="parent.window.postMessage('ixistenz.opendiff:115', '*');; return false;" style='text-decoration: none; '>Project </a> <a style='color: white;' href='#diffid115'><sup>1</sup></a></div><div><a href='#diffid129' style='color: white;' onClick="parent.window.postMessage('ixistenz.opendiff:129', '*');; return false;" style='text-decoration: none; '>twitter </a> <a style='color: white;' href='#diffid129'><sup>1</sup></a></div></div></div>
<script>
function toggle( divname ) {
  var x = document.getElementById( divname );
  if (x.style.display === 'none') {
    x.style.display = 'block';
  } else {
    x.style.display = 'none';
  }
} </script>