Towards optimisation in surgical pathology – the potential of Artificial intelligence

Funding: This work was supported by French state funds managed within the “Plan Investissements d’Avenir” and by the ANR (reference ANR-10-IAHU-02).

https://doi.org/10.58974/bjss/azbc011

---

The ever-evolving environment of surgery continues to rely on pathology examination as a diagnostic pillar and fundamental guide for pre- and postoperative patient management, particularly in the field of multidisciplinary cancer treatment¹. For an accurate diagnosis, a comprehensive pathology report requires a thorough assessment of the surgical specimen, which routinely encompasses gross examination, microscopic evaluation and additional testing in order to provide the information needed for patient management ¹. In the current era of personalised medicine, disease entities and classifications are continuously amended in response to emerging molecular data, which are incorporated for novel therapies^{1, 2}.

Histopathology and surgery – expectations and timing

In the preoperative phase, histopathological information is required for multidisciplinary decision-making regarding the indication and timing of surgery within oncological treatment pathways. Intraoperatively, quick diagnostics allow the surgical strategy to be tailored (suspected malignancy, resection margin assessment, sentinel node strategy versus extended lymphadenectomy, synchronous versus skip lesions,) or provide fresh tissue for additional studies (molecular, electron microscopy, microbiology). Postoperatively, comprehensive specimen analysis orientates towards oncological surveillance versus adjuvant treatment, recommendations for genetic analyses and other profiling techniques for tailored patient management². To that end, numerous tasks stand to benefit from digitalisation and optimisation assisted by artificial intelligence (AI), especially in medical centres with high workloads³.

A full pathology report is based on a variety of tasks that fall under the responsibility of technicians, residents, and consultants⁴. Quality control of surgical biopsies is imperative to identify and correct potential errors such as a misidentified sample, inappropriate container, insufficient fixation, contamination, tissue adequacy⁵ and, for cytology samples, staining quality and determination of cellularity⁶. To minimise such errors, an active interdisciplinary exchange is mandatory to agree on specialty-specific terminology and technical considerations.

Prioritisation and automatic requests for complementary analyses can optimise the workflow and shorten the turnaround time to final diagnosis⁴. An optimised workflow in surgical pathology makes it possible to meet the challenge of keeping up with evolving guidelines and management protocols under time pressure and in sometimes understaffed departments. Time-sensitive procedures such as intraoperative frozen-section examination or biopsy examination in oncological settings have a strong impact on surgical decision-making and overall patient management⁷. An illustration of standard and digitally enhanced workflows is provided in Figure 1.

Intraoperative pathology consultation is a mainstay of surgical management in many subspecialities and requires speed and optimal communication between surgeons and pathologists. Frozen section examination is incorporated into surgical routine for lymph node status and surgical margin assessment. Nevertheless, in addition to the complexity of cancer biology and its impact on morphological assessment, some challenges remain.

Intraoperative synergism

A number of emerging real-time techniques such as radio-frequency spectroscopy, bioimpedance spectroscopy, ultraviolet photoacoustic microscopy, optical coherence tomography, chemistry‐based fluorescent probes, hyperspectral imaging and others have been proposed with the aim of replacing intraoperative pathological consultations⁸. Despite promising first results, most of these novel methods do not yet benefit from broad clinical validation and are not yet available outside of clinical studies, or even affordable for most surgical units.

Novel intraoperative imaging technologies in conjunction with computer-assisted surgery aim at real-time enhancement of the surgeons’ eye, including a microscopic view (Figure 2). The ideal solution is in high resolution and in real time, with little or no impact on surgical workflow, while being safe for the patient and easy to use⁹. Non-invasive contrast-free optical imaging technology such as hyperspectral imaging is promising as it acquires spatial and spectroscopic data in real time¹⁰. Since the light interactions depend on biochemical tissue properties, hyperspectral imaging provides quantitative information on parameters like oxygen saturation and water content¹⁰, and the different reflectance curves allow discrimination between anatomical structures as well as between normal and neoplastic tissue. This information, in conjunction with machine learning approaches, could automate intraoperative tissue recognition⁹.

Among the technologies that allow access to the microscopic optical domain in real time, confocal laser endomicroscopy (CLE) deserves special mention. It is a probe-based high resolution microscopic imaging system with a penetration depth of _~250μm, providing “virtual biopsies”¹¹. However, it involves injection of a fluorophore, and image interpretation is operator-dependent requiring dedicated training⁹. Machine learning can be used to generate automated detection of specific tissues and aid in the decision-making process, as seen in ex vivo studies on neoplastic skin disease, with its use in in vivo settings being highly anticipated¹².

Since its first description in 1991, non-invasive optical coherence tomography (OCT) has been used in ophthalmology and cardiology ⁸. Its capacity to generate instant images of tissue using reflected light without the need for specific staining or sample processing makes it a suitable method for both in vivo and ex vivo “optical biopsies”. Its use expanded across other surgical domains such as thoracic (bronchial tumour detection), abdominal (hepato-biliary and pancreatic, premalignant colorectal lesions), plastic surgery (malignant melanoma and basal cell carcinoma) ¹³. Technological progress improved image resolution (full-field OCT) and added functional parameters such as intracellular activity (dynamic full-field OCT), but also led to adaptation to flexible endoscopic and ultrasound exploration^{8, 9, 13, 14}. OCT imaging shows great promise in intraoperative tumour detection, surgical resection margin evaluation and lymph node status, but requires further validation in large-scale clinical studies.

Given the lack of widespread availability and the challenges of increased costs, staff training and equipment maintenance for modern image-guided intraoperative techniques, frozen section examination remains the gold standard for intraoperative tissue assessment. Contemporary approaches to time-sensitive intraoperative consultation, particularly for remote or understaffed medical centres, imply the use of telepathology, especially since the COVID pandemic facilitated the adoption of institutional teleconference systems. A recent study to validate telepathology has shown a promising concordance of 96.4% between digital slide evaluation and the classical light-microscopy examination. Such approaches pave the way for another version of the “intraoperative pathology laboratory”¹⁵. Developments in deep-learning algorithms have shown both noteworthy support of intraoperative pathology consultation and improvement in the accuracy and speed of frozen section examination¹⁶.

Post-surgical assessment

Radiology paved the way for computer-assisted diagnostic tools¹⁷, and digital pathology is following in its footsteps. Interdisciplinary collaboration can benefit from computer-assisted healthcare solutions by aiding in the orientation and macroscopic description of surgical specimens via automated localization, recognition, tracking of objects/areas of interest and topographic mapping of samples, with proven results in both minimally invasive and open approaches^{18, 19}. To this effect, whole-slide imaging (WSI) of tissue sections mounted on glass slides is demonstrating its usefulness¹⁷. AI systems can be assimilated into the pathology laboratory workflow to assist every step leading up to a complete pathology report, resulting in the emergence of a new field called computational pathology (cPath)^{2, 4}. The main features of this visionary healthcare-integrated approach include accuracy, productivity and discovery².

Recent years have seen the progression of the infrastructure for this endeavour and WSI can now benefit from more ergonomic solutions in scanning, storage of digital data, and various image management and processing technologies involved in routine diagnosis⁵. Following the four pillars of pathology-orientated AI assistance (detection, classification, segmentation, and quantification)², deep-learning techniques benefit the analysis of surgical specimens by shortening decision-making times and allowing for diagnosis optimisation⁵. Algorithm-assisted pathologists showed a significantly improved quality of work output in accuracy and sensitivity as compared to unassisted pathologists⁵ (Figure 3).

CPath applications for microscopy-orientated techniques include detection of tumour type, invasion patterns, metastatic dissemination, lymph node status, and spatial assessment of tumour heterogeneity including inflammatory infiltrate, vascularization patterns, histological grading and other types of scoring²⁰. Routine examination frequently implies several of these parameters. Deep learning architectures are utilised for training and applications in pathology in order to reduce human error rates and improve workflow⁵. Most of pathology AI-driven research is in the field of cancer, with promising emerging data on how computer-assisted detection can increase diagnostic accuracy in the case of gynaecological tumours²¹, bringing clarity to challenging issues such as histological grading of prostate carcinoma²² or providing better outcome estimates for gastrointestinal malignancies²³. Moreover, these concepts can be integrated into technological solutions for non-neoplastic pathologies. As recently demonstrated, AI techniques applied to histopathological samples can contribute to predictive models with high accuracy in anticipating disease activity in ulcerative colitis²⁴.

The “tumour tissue journey”, as coined by some experts, is not a fixed path, but an evolving one²⁵. Advances in research translated into medical practice bring new personalised decision-making based on patient-specific information provided by histopathology⁵. This comprises immunohistochemical evaluation of samples, a process that already benefits from technological advances through automated cell counting systems, and is increasingly optimised through deep learning approaches to provide accurate and rapid results².

In addition to histopathological diagnosis, the molecular profiling of cancers has proven indispensable in modern-day medicine for improving patient outcomes, and can be expanded to the generation of novel molecular biomarkers, tailoring of targeted therapies, and broader topics like intrafamilial risks and transmission of diseases evaluation. Most facilities in which molecular testing is available already benefit from advanced digital infrastructure to perform genomic analyses on formalin fixed paraffin embedded (FFPE) samples to characterise tumours and evaluate therapeutic schemes (including next-generation sequencing)²⁶. The samples are defined by tumour purity given as a percentage and are highly variable in terms of tumour size and laboratory equipment. This is another area in which WSI-analysis and computational assistance reduce error rate and timelapse²⁷. Furthermore, the convolutional neural networks employed by computer-assisted approaches can also be trained automatically to identify tumour varieties and accordingly order complementary tests. Optimised data collection and integration leads to a comprehensive diagnosis, a process currently demonstrated in the field of central nervous system tumours^{5, 28}.

After diagnosis, the integration of the pathology report into clinical management is done by the primary physician. Remote locations or understaffed laboratories can benefit from securely sharing WSI for diagnostic purposes, and expert opinion in difficult cases is more readily available through telepathology²³. Furthermore, AI algorithms can be employed as decision support tools for multidisciplinary tumour boards, ultimately serving as an orientation tool in the quest for personalised cancer treatment ^{26, 29}.

Special considerations

The introduction of WSI as part of the digitalisation movement in medicine has sparked numerous controversies, underlining the need for standardisation⁵. Accordingly, the College of American Pathologists (CAP) published the first guidelines for WSI systems validation in 2013, providing a basis for regulations that now surround the use of AI in anatomical pathology¹⁵. Professional organisations, such as the Digital Pathology Association, the Association of Pathology Informatics or the European Society for Digital and Integrative Pathology, rely on interdisciplinary communication to close the gap between different medical specialities in order to provide the best support for optimisation of patient care in accordance to the latest state of the art⁴. The collaboration between surgery and pathology aims not only to provide the best standard of care, but also to adjust currently existing procedures and to improve perioperative patient prognostication. Integrated approaches are crucial for further advances, such as the ones enabled using WSI and telepathology, allowing for expert consultation and unprecedented teaching opportunities^{2, 15}.

While complete workflow digitalisation requires a significant update of equipment, a stepwise approach can prove beneficial in integrating AI-based technology and optimise certain aspects of daily practice, particularly in relation to surgical departments²⁸. A recent study evaluating the opinion of an international expert panel points towards the certainty that specific pathology AI applications will be included in diagnostic routine by 2030⁴.

The use of AI in pathology has already facilitated the emergence of digital biomarkers, defined as indicators of disease progression (risk association, disease monitoring, response to therapy, prognosis), and their inclusion into medical practice is highly anticipated ².

Telepresence involves both remote mentoring and remote manipulation, and the establishment of a global connectivity infrastructure promotes the democratisation of expertise. Remote collaboration has the potential to support telepathology not only through telediagnosis, but also through remote control of a robotic system. The ground-breaking Lindbergh Operation, in which a laparoscopic cholecystectomy was performed remotely across a transatlantic distance, has already demonstrated the safety and feasibility of telesurgery³⁰. As digitised medicine is permeating into routine practice, the avenue of computational pathology integration into surgical robotics is only starting to unveil its potential.

Conclusions

Artificial Intelligence-based solutions applied to pathology have already penetrated the medical market and are increasingly used to optimise workflow, while also facilitating surgically oriented requests⁵. With the large amount of digitised data comes the need for structuring and standardisation centred around the human expertise. The current outlook of pathology laboratories is very likely to change in the coming years, much like the concept of the “operating room of the future”, while acknowledging the indispensable role of the physician for optimal patient care.