Meta-Research Innovation Center at Stanford
Meta-Research Innovation Center at Stanford
  • 59
  • 7 675
Are self-citations a normal feature of knowledge accumulation? - Vincent Larivière
Abstract: Science is a cumulative activity, which can manifest itself through the act of citing. Citations are also central to research evaluation, thus creating incentives for researchers to cite their own work. Using a dataset containing more than 63 million articles and 51 million disambiguated authors, this talk will examine the relative importance of self-citations and self-references in the scholarly communication landscape, their relationship with the age and gender of authors, as well as their effects on various research evaluation indicators. Results show that self-citations and self-references evolve in different directions throughout researchers' careers, and that men and older researchers are more likely to self-cite. Although self-citations have, on average, a small to moderate effect on author's citation rates, they highly inflate citations for a subset of researchers. Comparison of the abstracts of cited and citing papers to assess the relatedness of different types of citations shows that self-citations are more similar to each other than other types of citations, and therefore more relevant. However, researchers that self-reference more tend to include less relevant citations. The talk will conclude with a discussion of the role of self-citations in scholarly communication.
Bio: Vincent Larivière holds the UNESCO Chair on Open Science at the Université de Montréal, where he is professor of information science and associate vice-president (planning and communications). He is also scientific director of the Érudit journal platform, associate scientific director of the Observatoire des sciences et des technologies (OST), and regular member of the Centre interuniversitaire de recherche sur la science et la technologie (CIRST). He holds a B.A. in Science, Technology and Society (UQAM), an M.A. in history of science (UQAM) and a Ph.D. in information science (McGill), and has performed postdoctoral work at Indiana University’s Department of Information and Library Science.
มุมมอง: 47

วีดีโอ

What’s wrong with clinical trial registries? - Leeza Osipenko
มุมมอง 164หลายเดือนก่อน
Abstract: Clinical trials require significant resources: financing, logistics, management, scientific rigour, and many-many human beings: patients and carers, clinicians and nurses, administrators and managers, technicians and regulators, consultants and sponsors, scientists, couriers. Most clinical trials are registered these days, more and more trials are making results public on time. These ...
Explaining shrinkage and heterogeneity in large-scale replication projects - Rachel Heyard
มุมมอง 83หลายเดือนก่อน
Abstract: Recent large-scale replication projects (RPs) have estimated concerningly low reproducibility rates. Further, all reported substantial degrees of shrinkage of effect size, where the replication effect size was found to be, on average, much smaller than the original effect size. Within these RPs, the original-replication study pairs can vary substantially with respect to aspects of study ...
Errors and Misconduct in Biomedical Research - Elisabeth Bik
มุมมอง 1112 หลายเดือนก่อน
Abstract: Science builds upon science. Even after peer-review and publication, science papers could still contain images or other data of concern. If not addressed post-publication, papers containing incorrect or even falsified data could lead to wasted time and money spent by other researchers trying to reproduce those results. Several high-profile science misconduct cases have been described,...
Using null fields to quantify overall bias in the scientific literature - Matthew Sigurdson
มุมมอง 1084 หลายเดือนก่อน
Abstract: Null fields are fields of research that attempt to study a nonexistent phenomenon. Since no true effects are present, observed effects are therefore direct measurements of the total bias. As a result, null fields can be used as negative controls in order to correct for bias in the scientific process. This approach also offers several key advantages over existing methods of bias correc...
Bounded research ethicality - Lina Koppel
มุมมอง 564 หลายเดือนก่อน
Abstract: Bounded ethicality refers to people’s limited capacity to consistently behave in line with their ethical standards. Here, we present results from a pre-registered, large-scale (N = 11,050) survey of researchers in Sweden, suggesting that researchers too are boundedly ethical. Specifically, researchers on average rated themselves as better than other researchers in their field at follo...
Innovations in peer review policy and collaborative meta-research - Noah Haber
มุมมอง 6485 หลายเดือนก่อน
Abstract: The Registered Revisions meta trial aims to push the boundaries in evidence-based policy making for science. It is 1) A novel pre-commitment device for peer review called Registered Revisions, 2) The first randomized experiment of journal policies of its type, and 3) The first semi-centralized study-in-a-kit style prospective meta-analysis. The policy triggers when peer reviewers ask ...
How do biology researchers assess the credibility of research? - Iain Hrynaszkiewicz
มุมมอง 1725 หลายเดือนก่อน
Abstract: Researchers serving on committees need to assess the credibility (trustworthiness) of research when deciding which grants to fund and which researchers to hire. Through a survey of 485 biology researchers who have served on grant or hiring committees in the past 2 years, we found that assessing credibility is very important to most researchers (81%) but they are unable to assess credi...
Reality Checking Clinical Genetics and Genomics - Julie Eggington
มุมมอง 1815 หลายเดือนก่อน
Abstract: The genomic revolution promised a new era of "Precision Medicine", where treatments would be precisely tailored to the individual's genetic makeup. This paradigm hinges on the assumption that one's genome can directly inform optimal therapeutic strategies. However, as the field of clinical genetics and genomics has evolved, a growing body of research is illuminating significant concer...
Paper mills: challenges, current understanding and unanswered questions - Anna Abalkina
มุมมอง 2296 หลายเดือนก่อน
Abstract: Paper mills represent for-profit entities that sell papers and co-authorships, guaranteeing publication. Because knowledge about paper mills remains fragmented and varies depending on the discipline or country, the presentation will discuss what we know about paper mills from the perspectives of their origin, the number of papers they produce, their patterns, and the gaps that exist i...
Supporting registration for higher quality and impact of ecological research - Antica Čulina
มุมมอง 386 หลายเดือนก่อน
Abstract: This talk is about our recent projects to estimate the unused potential of ecological research. This unused potential stems from a) the research waste that accumulates over the classical research cycle b) the potential contained within unpublished datasets and analytical codes/methods (but which is difficult to quantify). Biography: Antica Culina is a research scientist at the NIOO-KN...
Comparison of effect estimates of preprint and journal article of COVID-19 RCTs - Mauricia Davidson
มุมมอง 837 หลายเดือนก่อน
Full title: Comparison of effect estimates between preprints and peer-reviewed journal articles of COVID-19 trials Abstract: Preprints are increasingly used to disseminate research results, providing multiple sources of information for the same study. We assessed the consistency in effect estimates between preprint and subsequent journal article of COVID-19 randomized controlled trials. The stu...
Gender Differences in Leaving Science Forever - Marek Kwiek
มุมมอง 1067 หลายเดือนก่อน
Abstract: In this presentation, the scale of leaving academic science in 38 OECD countries is explored: how attrition differs across genders, disciplines, and over time. The details of careers of STEMM scientists who started publishing in different points in time (11 cohorts between 2000 and 2010, N=2,127,803) are examined. Survival analysis shows that attrition is currently amazingly high, and...
Perspectives from the Peerspectives peer-review training program for ERCs - Jess Rohmann
มุมมอง 917 หลายเดือนก่อน
Abstract: Though not without its problems, peer review remains an essential component of today's academic publishing landscape. However, the vast majority of scientists receive no formal training on how to conduct such reviews. In this talk, I will argue why the doctoral studies period is the ideal time to teach the theoretical foundations and to exercise the practical skills needed for high-qu...
GPT for RCT? Using A.I. to check for adherence to reporting guidelines - James Wrightson
มุมมอง 1018 หลายเดือนก่อน
Abstract: Poor reporting of clinical trials threatens the reliability and credibility of medical research and affects patient care. Adherence to reporting guidelines can improve reporting standards, but few tools are available to help researchers, editors, or other stakeholders quickly determine compliance with reporting guidelines. Artificial Intelligence Large Language Models (AI) might be ab...
Spurious Precision in Meta-Analysis - Tomas Havranek
มุมมอง 1248 หลายเดือนก่อน
Spurious Precision in Meta-Analysis - Tomas Havranek
External Validity for Social Inquiry - Michael Denly
มุมมอง 478 หลายเดือนก่อน
External Validity for Social Inquiry - Michael Denly
Clinical trials reporting at Nordic medical universities and university hospitals - Gustav Nilsonne
มุมมอง 1408 หลายเดือนก่อน
Clinical trials reporting at Nordic medical universities and university hospitals - Gustav Nilsonne
Vibration of effects resulting from network geometry in mixed-treatment comparisons - Florian Naudet
มุมมอง 1178 หลายเดือนก่อน
Vibration of effects resulting from network geometry in mixed-treatment comparisons - Florian Naudet
Computational reproducibility checks in scientific publishing - Lucija Batinovic & Rickard Carlsson
มุมมอง 538 หลายเดือนก่อน
Computational reproducibility checks in scientific publishing - Lucija Batinovic & Rickard Carlsson
‘Identify the Expert’: an Experimental Study in Economic Advice - Zacharias Maniadis
มุมมอง 298 หลายเดือนก่อน
‘Identify the Expert’: an Experimental Study in Economic Advice - Zacharias Maniadis
Generalized Decision Curve Analysis for individualized decision-making - Benjamin Djulbegovic
มุมมอง 1048 หลายเดือนก่อน
Generalized Decision Curve Analysis for individualized decision-making - Benjamin Djulbegovic
Willingness to review after switching from Single to Double-Blind Peer Review - Pertti Saloheimo
มุมมอง 398 หลายเดือนก่อน
Willingness to review after switching from Single to Double-Blind Peer Review - Pertti Saloheimo
Meta-Research Metrics of Misleading Evidence - Tom Stanley
มุมมอง 978 หลายเดือนก่อน
Meta-Research Metrics of Misleading Evidence - Tom Stanley
Statistical reporting errors in economics - Stephan Bruns
มุมมอง 678 หลายเดือนก่อน
Statistical reporting errors in economics - Stephan Bruns
Development of a new risk of bias tool for network meta-analysis (RoB NMA Tool) - Carole Lunny
มุมมอง 4611 หลายเดือนก่อน
Development of a new risk of bias tool for network meta-analysis (RoB NMA Tool) - Carole Lunny
How do guideline panels decide
มุมมอง 332 ปีที่แล้ว
How do guideline panels decide
Two Studies on Peer Review Citation Bias and arXiv Bias
มุมมอง 792 ปีที่แล้ว
Two Studies on Peer Review Citation Bias and arXiv Bias
METRICS Forum: Transparency and Reproducibility in Economics Research
มุมมอง 1658 ปีที่แล้ว
METRICS Forum: Transparency and Reproducibility in Economics Research
METRICS Forum: Public Trust and Twisted Science- Dr. Tim Caulfield
มุมมอง 1208 ปีที่แล้ว
METRICS Forum: Public Trust and Twisted Science- Dr. Tim Caulfield