journal of biomedical informatics
All submissions of the EM system will be redirected to Online Manuscript Submission System. Authors are requested to submit articles directly to Online Manuscript Submission System of respective journal.

Study Report of using Web Crawling, Scraping, and Text Mining, Investigated the Medical Informatics Labour

Author(s): Rajia Khatun*

Employability is a major goal of higher education, according to the European University Association (EUA). As a result, a competency-based approach to education is critical. The representation of a standardized job profile in the field of medical informatics, based on the most common labour market criteria, is critical for identifying and communicating the learning goals associated with these capabilities. We took numerous job adverts from the job marketplace to find out what the most prevalent needs were. We used web crawling, web extraction, and text mining as part of a programme we wrote in R using the “rvest” library. Many job adverts remained after we removed duplicates and filtered for occupations that required a bachelor’s degree, from which we retrieved qualification terms. Professional competence, soft skills, teamwork, procedures, learning, and problem-solving abilities were divided into six categories. Employee soft skills studies have yielded comparable findings. Programming, experience, project, and server were the most often used terms. The value of experience is our second significant conclusion, emphasizing the importance of practical skills. Surveys and narrative accounts were employed in previous investigations. This is the first-time web crawling, web extraction, and text mining have been used in a study. Soft skills and specialist expertise are given equal weight in our studies. The findings of this study could be useful in the development of medical informatics curriculum.

Full-Text | PDF