{"found":55740,"hits":[{"document":{"authors":[{"contributor_roles":[],"family":"Rogel-Salazar","given":"Rosario"},{"contributor_roles":[],"family":"Li","given":"Xiuqi"},{"contributor_roles":[],"family":"Do\u011fan","given":"G\u00fcleda"}],"blog":{"authors":null,"community_id":"b56ef314-34f7-4c7f-b0e2-d0bf13bfe83b","created":1673568000,"current_feed_url":"https://upstream.force11.org/atom/","description":"The community blog for all things Open Research.","doi":"https://doi.org/10.54900/upstream","favicon":"https://rogue-scholar.org/api/communities/b56ef314-34f7-4c7f-b0e2-d0bf13bfe83b/logo","feed_format":"application/atom+xml","feed_url":"https://upstream.force11.org/atom-complete/","filter":null,"generator":"Ghost","home_page_url":"https://upstream.force11.org","issn":null,"language":"eng","license":"https://creativecommons.org/licenses/by/4.0/legalcode","prefix":"10.54900","relative_url":null,"secure":true,"slug":"upstream","status":"active","subfield":"1802","title":"Upstream","updated":1788858023,"use_api":true},"blog_name":"Upstream","blog_slug":"upstream","content_html":"<p>Over the past decade, Open Science has transformed the way we create, share, and evaluate research. Among the many domains of Open Science (Bertram et al. 2023), two have received growing attention: open data and open peer review.</p><p>Yet these two worlds do not often meet.</p><p>We regularly discuss the importance of sharing data to support transparency, reproducibility, and reuse (Wilkinson et al. 2016). We also explore new approaches to peer review that are more open, inclusive, and collaborative (Ross-Hellauer et al. 2023). But we rarely stop to ask what happens when datasets themselves become the subject of review.</p><p>Recent initiatives have begun exploring ways to connect open data and open peer review (Modular Peer Review; Sansing and Wilkinson 2025). One notable development came in&nbsp; November 2025, when <a href=\"https://prereview.org\" rel=\"noreferrer\">PREreview</a> introduced support on their platform for reviewing datasets deposited in <a href=\"https://datadryad.org/\"><u>Dryad</u></a>, an open-access general-purpose data repository. It is in this context that the <a href=\"https://prereview.org/clubs/force11\"><u>FORCE11 PREreview Club</u></a> was invited to pilot a collaborative and structured dataset review process. Our review of the dataset, \"Leverage metrics to drive data sharing at the Science journals\" by Valda Vinson and Lauren Kmec (2025), is now posted on PREreview and archived on Zenodo (Akuma et al. 2026). It is the first open review of a dataset shared on PREreview.</p><p>In this blog post, we reflect on that experience, discuss what we learned, and consider the opportunities of dataset review as an emerging scholarly practice.</p><h2 id=\"reviewing-more-than-results\">Reviewing More Than Results</h2><p>The Vinson and Kmec dataset (2025) focuses on data and code-sharing practices in articles published by Science. At first glance, it seemed like an ideal case study: data deposited in an open repository, documentation available for users, and a topic closely connected to Open Science itself.</p><p>As our discussion unfolded, however, it became clear that reviewing a dataset involves different questions from those we typically ask when reviewing a preprint or a journal article. Rather than focusing solely on findings or conclusions, we found ourselves examining the processes behind the data. How were key variables constructed? How transparent were the classification methods? What assumptions shaped the dataset? How reproducible was the workflow? And what limitations should future users keep in mind when reusing the data?</p><p>Very quickly, the conversation moved into topics such as <a href=\"https://www.go-fair.org/fair-principles/\"><u>FAIR</u></a> and <a href=\"https://www.gida-global.org/careprinciples\"><u>CARE</u></a> principles, metadata quality, methodological transparency, provenance, responsible reuse, and the implications of using automated systems to measure Open Science practices.</p><p>In a sense, the review became a metascientific exercise: a group of researchers evaluating a dataset designed to measure behaviors associated with Open Science itself. What began as a discussion about a dataset soon became a broader conversation about trust, transparency, and how we assess research outputs beyond traditional publications.</p><h2 id=\"a-conversation-across-research-communities\">A Conversation Across Research Communities</h2><p>One of the most rewarding aspects of the experience was the diversity of perspectives involved in the review. The review brought together researchers based in India, Mexico, T\u00fcrkiye, the United Kingdom, and the United States, with backgrounds spanning scholarly communication, research assessment, bibliometrics, data management, and Open Science.</p><p>Although we were all reviewing the same dataset, we examined it through vastly different lenses. Some participants focused on reproducibility and workflow validation. Others paid closer attention to metadata quality, cross-publisher comparisons, methodological transparency, or the broader ethical and geopolitical implications of data reuse.</p><p>&nbsp;These different and diverse perspectives enriched the discussion. Together, they helped us develop a more nuanced understanding of the dataset, its strengths, and its limitations than any one of us could likely have achieved alone.</p><p>This collaborative process also highlighted one of the strengths of open, collaborative peer review. When reviewers bring different experiences, disciplinary backgrounds, and regional perspectives to the table, evaluation becomes more than quality control\u2014it becomes a form of collegial discourse and collective learning.</p><h2 id=\"open-data-is-not-the-end-of-the-story\">Open Data Is Not the End of the Story</h2><p>Perhaps the most important lesson for us was seeing how open review can help bridge the distance between data producers and data users.</p><p>One of the greatest challenges in data reuse is not simply gaining access to data, but understanding the context in which the data were created, the decisions that shaped them, and the limitations that accompany their use. Datasets rarely speak entirely for themselves. Even well-documented data often leave room for questions about methods, assumptions, and interpretation.</p><p>Open review creates a space where those questions can be raised collectively, transparently, and constructively. It also provides an opportunity for data producers and data users to engage in dialogue, helping to clarify uncertainties, identify issues that may affect reuse, and strengthen future versions of a dataset.&nbsp;</p><p>The experience also reminded us that making data available is not the same as making data understandable, reusable, or trustworthy for every purpose. Openness requires infrastructure, but it also requires documentation, clear licensing, robust metadata, methodological transparency, and ongoing dialogue with the communities that may eventually reuse the data. As datasets evolve through updates, corrections, and new versions, community feedback can play an important role in supporting their long-term reusability.</p><p>In other words, depositing a dataset in a repository is not the end of the story.&nbsp; Rather, it marks the beginning of a new phase for data to become part of the broader scientific discourse. Once shared, datasets can be scrutinized, debated, and critiqued, just like preprints and journal articles. Through review and reuse, datasets can contribute to the refinement of existing knowledge, the generation of new insights, and the advancement of future research.</p><p>This experience also reminded us that Open Science extends beyond open access to publications. While open access remains one of its most visible achievements, practices such as open data, open peer review, and responsible data reuse are equally important for building a more transparent and collaborative research ecosystem.</p><h2 id=\"open-data-and-open-review-better-together\">Open Data and Open Review: Better Together</h2><p>Our open dataset review pilot for PREreview does not answer every question about how research data should be evaluated. But it does demonstrate something important: open data and open review are not separate practices.</p><p>When combined, they create new opportunities to strengthen transparency, accountability, and reuse across the research ecosystem. Open data makes reuse possible. Open review helps us understand what we are reusing, how it was created, and what limitations we should keep in mind. Together, they move us closer to a vision of Open Science that extends beyond access alone\u2014one that values not only the availability of research outputs, but also the conversations, feedback, and collective stewardship that help make those outputs meaningful and reusable.</p><p>Finally, we would like to thank Jennifer M. Miller for her thoughtful coordination of the review and collaborative writing process, as well as Daniela Saderi and the PREreview team for creating and continuously improving spaces where open and community-driven approaches to research assessment can flourish.</p><p>Perhaps that is the most valuable lesson from this experience: opening data matters, but opening the conversation around data can be just as transformative.</p><h2 id=\"references\">References</h2><ol><li>Akuma, I., Dogan, G., Spick, M., Rogel-Salazar, R., &amp; Li, X. (2026, June 5). Structured PREreview of \"Leveraging metrics to drive data sharing at the Science journals.\" <a href=\"https://prereview.org/reviews/1d1731cb-e9b9-4bb4-b636-98c235379cc6\"><u>https://prereview.org/reviews/1d1731cb-e9b9-4bb4-b636-98c235379cc6</u></a></li><li>Bertram, M. G., Sundin, J., Roche, D. G., S\u00e1nchez-T\u00f3jar, A., Thor\u00e9, E. S. J., &amp; Brodin, T. (2023). Open science. Current Biology: CB, 33(15), R792\u2013R797. <a href=\"https://doi.org/10.1016/j.cub.2023.05.036\"><u>https://doi.org/10.1016/j.cub.2023.05.036</u></a>&nbsp;</li><li>Modular Peer Review. (n.d.). Continuous Science Foundation. Retrieved June 6, 2026, from <a href=\"https://continuousfoundation.org/peer-review\"><u>https://continuousfoundation.org/peer-review</u></a>&nbsp;</li><li>Ross-Hellauer, T., Bouter, L. M., &amp; Horbach, S. P. J. M. (2023). Open peer review urgently requires evidence: A call to action. PLoS Biology, 21(10), e3002255. <a href=\"https://doi.org/10.1371/journal.pbio.3002255\"><u>https://doi.org/10.1371/journal.pbio.3002255</u></a>&nbsp;</li><li>Sansing, C., &amp; Wilkinson, C. (2025, October 15). Now you can review datasets on PREreview.org. PREreview Blog. <a href=\"https://content.prereview.org/now-you-can-review-datasets-on-prereview-org/\"><u>https://content.prereview.org/now-you-can-review-datasets-on-prereview-org/</u></a>&nbsp;</li><li>Vinson, V., &amp; Kmec, L. (2025). Leveraging metrics to drive data sharing at the Science journals [Dataset]. Dryad. <a href=\"https://doi.org/10.5061/DRYAD.ZKH1893QT\"><u>https://doi.org/10.5061/DRYAD.ZKH1893QT</u></a>&nbsp;</li><li>Wilkinson, M. D., Dumontier, M., Aalbersberg, I. J. J., Appleton, G., Axton, M., Baak, A., Blomberg, N., Boiten, J.-W., da Silva Santos, L. B., Bourne, P. E., Bouwman, J., Brookes, A. J., Clark, T., Crosas, M., Dillo, I., Dumon, O., Edmunds, S., Evelo, C. T., Finkers, R., \u2026 Mons, B. (2016). The FAIR Guiding Principles for scientific data management and stewardship. Scientific Data, 3, 160018. <a href=\"https://doi.org/10.1038/sdata.2016.18\"><u>https://doi.org/10.1038/sdata.2016.18</u></a>&nbsp;</li></ol>","doi":"https://doi.org/10.54900/kfqec-0ne44","guid":"https://doi.org/10.54900/kfqec-0ne44","image":"https://images.unsplash.com/photo-1562564055-71e051d33c19?crop=entropy&cs=tinysrgb&fit=max&fm=jpg&ixid=M3wxMTc3M3wwfDF8c2VhcmNofDM0N3x8cGVlciUyMHJldmlld3xlbnwwfHx8fDE3ODg1NzEwNDF8MA&ixlib=rb-4.1.0&q=80&w=2000","language":"en","license":"https://creativecommons.org/licenses/by/4.0/legalcode","published_at":1788825600,"reference":[{"id":"https://prereview.org/reviews/1d1731cb-e9b9-4bb4-b636-98c235379cc6","unstructured":"Akuma, I., Dogan, G., Spick, M., Rogel-Salazar, R., & Li, X. (2026, June 5). Structured PREreview of \"Leveraging metrics to drive data sharing at the Science journals.\""},{"id":"https://doi.org/10.1016/j.cub.2023.05.036","unstructured":"Bertram, M. G., Sundin, J., Roche, D. G., S\u00e1nchez-T\u00f3jar, A., Thor\u00e9, E. S. J., & Brodin, T. (2023). Open science. Current Biology: CB, 33(15), R792\u2013R797."},{"id":"https://continuousfoundation.org/peer-review","unstructured":"Modular Peer Review. (n.d.). Continuous Science Foundation. Retrieved June 6, 2026, from"},{"id":"https://doi.org/10.1371/journal.pbio.3002255","unstructured":"Ross-Hellauer, T., Bouter, L. M., & Horbach, S. P. J. M. (2023). Open peer review urgently requires evidence: A call to action. PLoS Biology, 21(10), e3002255."},{"id":"https://content.prereview.org/now-you-can-review-datasets-on-prereview-org/","unstructured":"Sansing, C., & Wilkinson, C. (2025, October 15). Now you can review datasets on PREreview.org. PREreview Blog."},{"id":"https://doi.org/10.5061/dryad.zkh1893qt","unstructured":"Vinson, V., & Kmec, L. (2025). Leveraging metrics to drive data sharing at the Science journals [Dataset]. Dryad. https://doi.org/10.5061/DRYAD.ZKH1893QT"},{"id":"https://doi.org/10.1038/sdata.2016.18","unstructured":"Wilkinson, M. D., Dumontier, M., Aalbersberg, I. J. J., Appleton, G., Axton, M., Baak, A., Blomberg, N., Boiten, J.-W., da Silva Santos, L. B., Bourne, P. E., Bouwman, J., Brookes, A. J., Clark, T., Crosas, M., Dillo, I., Dumon, O., Edmunds, S., Evelo, C. T., Finkers, R., \u2026 Mons, B. (2016). The FAIR Guiding Principles for scientific data management and stewardship. Scientific Data, 3, 160018."}],"rid":"ff18x-dmv18","summary":"Over the past decade, Open Science has transformed the way we create, share, and evaluate research. Among the many domains of Open Science (Bertram et al. 2023), two have received growing attention: open data and open peer review. Yet these two worlds do not often meet.","tags":["Insights"],"title":"When Data Meets Review: Reflections on PREreview's First Open Dataset Review","updated_at":1788858078,"url":"https://upstream.force11.org/when-data-meets-review-reflections-on-prereviews-first-open-dataset-review-2/","version":"v1"}},{"document":{"authors":[{"affiliation":[{"id":"https://ror.org/0153tk833","name":"University of Virginia"}],"contributor_roles":[],"family":"Turner","given":"Stephen","url":"https://orcid.org/0000-0001-9140-9028"}],"blog":{"authors":[{"name":"Stephen Turner"}],"community_id":"382941a7-2ffa-41df-8bbb-5f772188517f","created":1780876800,"current_feed_url":null,"description":"A practicing data scientist's take on AI, genomics, biosecurity, and the ways AI is reshaping how science gets done. Weekly updates from the field. Occasional notes on programming.","doi":"https://doi.org/10.59350/stephenturner","favicon":"https://rogue-scholar.org/api/communities/382941a7-2ffa-41df-8bbb-5f772188517f/logo","feed_format":"application/rss+xml","feed_url":"https://blog.stephenturner.us/feed","filter":null,"generator":"Substack","home_page_url":"https://blog.stephenturner.us","issn":null,"language":"eng","license":"https://creativecommons.org/licenses/by/4.0/legalcode","prefix":"10.59350","relative_url":null,"secure":true,"slug":"stephenturner","status":"active","subfield":"1311","title":"Paired Ends","updated":1788792247,"use_api":null},"blog_name":"Paired Ends","blog_slug":"stephenturner","content_html":"<div class=\"captioned-image-container\"><figure><a class=\"image-link image2 is-viewable-img\" target=\"_blank\" href=\"https://substackcdn.com/image/fetch/$s_!-M8z!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fbd8809ce-86ff-4726-a1a4-1e9bc1c14c9f_2591x1135.png\" data-component-name=\"Image2ToDOM\"><div class=\"image2-inset\"><picture><source type=\"image/webp\" srcset=\"https://substackcdn.com/image/fetch/$s_!-M8z!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fbd8809ce-86ff-4726-a1a4-1e9bc1c14c9f_2591x1135.png 424w, https://substackcdn.com/image/fetch/$s_!-M8z!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fbd8809ce-86ff-4726-a1a4-1e9bc1c14c9f_2591x1135.png 848w, https://substackcdn.com/image/fetch/$s_!-M8z!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fbd8809ce-86ff-4726-a1a4-1e9bc1c14c9f_2591x1135.png 1272w, https://substackcdn.com/image/fetch/$s_!-M8z!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fbd8809ce-86ff-4726-a1a4-1e9bc1c14c9f_2591x1135.png 1456w\" sizes=\"100vw\"><img src=\"https://substackcdn.com/image/fetch/$s_!-M8z!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fbd8809ce-86ff-4726-a1a4-1e9bc1c14c9f_2591x1135.png\" width=\"1456\" height=\"638\" data-attrs=\"{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/bd8809ce-86ff-4726-a1a4-1e9bc1c14c9f_2591x1135.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:638,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:673160,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:false,&quot;topImage&quot;:true,&quot;internalRedirect&quot;:&quot;https://blog.stephenturner.us/i/206299798?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fbd8809ce-86ff-4726-a1a4-1e9bc1c14c9f_2591x1135.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}\" class=\"sizing-normal\" alt=\"\" srcset=\"https://substackcdn.com/image/fetch/$s_!-M8z!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fbd8809ce-86ff-4726-a1a4-1e9bc1c14c9f_2591x1135.png 424w, https://substackcdn.com/image/fetch/$s_!-M8z!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fbd8809ce-86ff-4726-a1a4-1e9bc1c14c9f_2591x1135.png 848w, https://substackcdn.com/image/fetch/$s_!-M8z!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fbd8809ce-86ff-4726-a1a4-1e9bc1c14c9f_2591x1135.png 1272w, https://substackcdn.com/image/fetch/$s_!-M8z!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fbd8809ce-86ff-4726-a1a4-1e9bc1c14c9f_2591x1135.png 1456w\" sizes=\"100vw\" fetchpriority=\"high\"></picture><div class=\"image-link-expand\"><div class=\"pencraft pc-display-flex pc-gap-8 pc-reset\"><button tabindex=\"0\" type=\"button\" class=\"pencraft pc-reset pencraft icon-container restack-image\"><svg aria-hidden=\"true\" width=\"20\" height=\"20\" viewBox=\"0 0 20 20\" fill=\"none\" stroke-width=\"1.5\" stroke=\"var(--color-fg-primary)\" stroke-linecap=\"round\" stroke-linejoin=\"round\" xmlns=\"http://www.w3.org/2000/svg\"><g><path d=\"M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882\"></path></g></svg></button><button tabindex=\"0\" type=\"button\" class=\"pencraft pc-reset pencraft icon-container view-image\"><svg xmlns=\"http://www.w3.org/2000/svg\" width=\"20\" height=\"20\" viewBox=\"0 0 24 24\" fill=\"none\" stroke=\"currentColor\" stroke-width=\"2\" stroke-linecap=\"round\" stroke-linejoin=\"round\" class=\"lucide lucide-maximize2 lucide-maximize-2\"><polyline points=\"15 3 21 3 21 9\"></polyline><polyline points=\"9 21 3 21 3 15\"></polyline><line x1=\"21\" x2=\"14\" y1=\"3\" y2=\"10\"></line><line x1=\"3\" x2=\"10\" y1=\"21\" y2=\"14\"></line></svg></button></div></div></div></a></figure></div><p>After I <a href=\"https://blog.stephenturner.us/p/ai-dry-july-aborted\">abandoned the no-AI-for-a-month thing</a>, I'm making up for lost time here. Only thing is now that I'm doing some fairly long-horizon multiagent work in Claude Code and Cowork, I'm frequently blowing through my session limit with just one or two prompts. I've written about this session limit anxiety before. </p><div class=\"digest-post-embed\" data-attrs=\"{&quot;nodeId&quot;:&quot;fee52fa3-dca3-47a6-9fde-a755b7ca4717&quot;,&quot;caption&quot;:&quot;Claude Code can erode your work-life balance if you're not careful. I'm generally pretty good about turning off and not working at home in the evenings. But Claude Code has opened up a loophole in my own discipline. Typing a few prompts and walking away doesn't feel like working. It's not like sitting down to write code for an hour. You fire off a plann\u2026&quot;,&quot;cta&quot;:null,&quot;showBylines&quot;:true,&quot;showDescription&quot;:true,&quot;showImage&quot;:true,&quot;size&quot;:&quot;sm&quot;,&quot;isEditorNode&quot;:true,&quot;title&quot;:&quot;The Four-Hour Session Treadmill&quot;,&quot;publishedBylines&quot;:[{&quot;id&quot;:1536121,&quot;name&quot;:&quot;Stephen D. Turner&quot;,&quot;bio&quot;:&quot;https://stephenturner.us/&quot;,&quot;photo_url&quot;:&quot;https://substackcdn.com/image/fetch/$s_!WGQE!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd1706730-c948-4acf-9c45-b14b4e3da1b9_651x651.jpeg&quot;,&quot;is_guest&quot;:false,&quot;bestseller_tier&quot;:null}],&quot;post_date&quot;:&quot;2026-03-16T09:08:41.323Z&quot;,&quot;cover_image&quot;:&quot;https://substackcdn.com/image/fetch/$s_!IrpV!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd83dbdd0-7a10-494b-ae53-460c3ae62990_1823x957.jpeg&quot;,&quot;cover_image_alt&quot;:null,&quot;canonical_url&quot;:&quot;https://blog.stephenturner.us/p/the-four-hour-session-treadmill-claude&quot;,&quot;section_name&quot;:null,&quot;video_upload_id&quot;:null,&quot;id&quot;:190748764,&quot;type&quot;:&quot;newsletter&quot;,&quot;reaction_count&quot;:5,&quot;comment_count&quot;:0,&quot;publication_id&quot;:161890,&quot;publication_name&quot;:&quot;Paired Ends&quot;,&quot;publication_logo_url&quot;:&quot;https://substackcdn.com/image/fetch/$s_!hfDI!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F894081de-334e-4173-8a0c-e64762c2c838_1030x1030.png&quot;,&quot;belowTheFold&quot;:false,&quot;youtube_url&quot;:null,&quot;show_links&quot;:null,&quot;feed_url&quot;:null}\"></div><p>I'm an early morning person. My typical morning will start with a run or ride or sauna at 5am, and some work (<a href=\"https://bsky.app/profile/stephenturner.us/post/3muwp4upvzc2u\">personal projects</a> and day-job work) at around ~6-7 before the camp/school shuffle, and the bike into work. If I do some work with Claude at around 7:00am, my five-hour session limit starts and I typically hit my session limit quickly, which locks me into extra usage at API rates until 12:00pm. Assuming I start another session around noon, that'll extend until 5pm, when I'm normally wrapping things up and heading home. I.e., I'll get two five-hour sessions at most over the course of a normal workday.</p><p>I'm short-circuiting that with a little hack. I set my Mac to wake up every morning at 3:58am, and at 4:00am it'll run <code>claude -p \"hey\"</code>. That <code>-p</code> flag just tells Claude to print the output of running the prompt, which in this case is \"hey\". It barely uses any tokens, with Claude responding with something like \"hey what's up?\". </p><p>But the point is, now my session starts at 4am (instead of 7am), and resets at 9am (instead of 12pm), right about the time I'm settling into the office and getting back to work. Assuming I kick off another session-consuming prompt at 9am, that opens the door to a third session that starts at 2pm. The whole point is now I can get three full 5 hour sessions in a single workday instead of two if I kick off a session very early, effectively shortening my first \"session\" to 2 hours instead of 5.<a class=\"footnote-anchor\" data-component-name=\"FootnoteAnchorToDOM\" id=\"footnote-anchor-1\" href=\"#footnote-1\" target=\"_self\">1</a></p><p class=\"button-wrapper\" data-attrs=\"{&quot;url&quot;:&quot;https://blog.stephenturner.us/subscribe?&quot;,&quot;text&quot;:&quot;Subscribe now&quot;,&quot;action&quot;:null,&quot;class&quot;:null}\" data-component-name=\"ButtonCreateButton\"><a class=\"button primary\" href=\"https://blog.stephenturner.us/subscribe?\"><span>Subscribe now</span></a></p><h2>How to do it (on a Mac)</h2><p>I haven't used a Windows computer since Windows 98, so if you're not on Mac, ask Claude how to do this on Windows (Linux is easy with cron). On MacOS I'm using a Launch Agent.</p><p>First, set your mac to automatically wake up at 3:58am. Or whenever. Move this forward or backward depending on your daily routine. Point is to have this kick off a prompt a few hours before you really get to work.</p><div class=\"highlighted_code_block\" data-attrs=\"{&quot;language&quot;:&quot;shell&quot;,&quot;nodeId&quot;:null}\" data-component-name=\"HighlightedCodeBlockToDOM\"><pre class=\"shiki\"><code class=\"language-shell\"># Set an automatic wake every day at 3:58am\nsudo pmset repeat wake MTWRFSU 03:58:00\n# Test - make sure it works\npmset -g sched</code></pre></div><p>Then add a launch agent (like a cron job). </p><div class=\"highlighted_code_block\" data-attrs=\"{&quot;language&quot;:&quot;plaintext&quot;,&quot;nodeId&quot;:null}\" data-component-name=\"HighlightedCodeBlockToDOM\"><pre class=\"shiki\"><code class=\"language-plaintext\">vim ~Library/LaunchAgents/us.stephenturner.claudeping.plist</code></pre></div><p>Copy the text below into this file. Replace <code>/Users/sdt5z/.local/bin/claude</code> on line 11 with whatever is returned when you run <code>which claude</code>. You'll need to use a full path for this to work. </p><div class=\"highlighted_code_block\" data-attrs=\"{&quot;language&quot;:&quot;xml&quot;,&quot;nodeId&quot;:null}\" data-component-name=\"HighlightedCodeBlockToDOM\"><pre class=\"shiki\"><code class=\"language-xml\">&lt;?xml version=\"1.0\" encoding=\"UTF-8\"?&gt;\n&lt;!DOCTYPE plist PUBLIC \"-//Apple//DTD PLIST 1.0//EN\" \"http://www.apple.com/DTDs/PropertyList-1.0.dtd\"&gt;\n&lt;plist version=\"1.0\"&gt;\n&lt;dict&gt;\n    &lt;key&gt;Label&lt;/key&gt;\n    &lt;string&gt;us.stephenturner.claudeping&lt;/string&gt;\n    &lt;key&gt;ProgramArguments&lt;/key&gt;\n    &lt;array&gt;\n        &lt;string&gt;/bin/bash&lt;/string&gt;\n        &lt;string&gt;-lc&lt;/string&gt;\n        &lt;string&gt;/Users/sdt5z/.local/bin/claude -p \"hey\"&lt;/string&gt;\n    &lt;/array&gt;\n    &lt;key&gt;StartCalendarInterval&lt;/key&gt;\n    &lt;dict&gt;\n        &lt;key&gt;Hour&lt;/key&gt;&lt;integer&gt;4&lt;/integer&gt;\n        &lt;key&gt;Minute&lt;/key&gt;&lt;integer&gt;0&lt;/integer&gt;\n    &lt;/dict&gt;\n    &lt;key&gt;StandardOutPath&lt;/key&gt;\n    &lt;string&gt;/tmp/claudeping.log&lt;/string&gt;\n    &lt;key&gt;StandardErrorPath&lt;/key&gt;\n    &lt;string&gt;/tmp/claudeping.err&lt;/string&gt;\n&lt;/dict&gt;\n&lt;/plist&gt;\n</code></pre></div><p>Test, make sure it works (replace paths/filenames with whatever you called them).</p><div class=\"highlighted_code_block\" data-attrs=\"{&quot;language&quot;:&quot;shell&quot;,&quot;nodeId&quot;:null}\" data-component-name=\"HighlightedCodeBlockToDOM\"><pre class=\"shiki\"><code class=\"language-shell\"># Tear down the service if it already exists\nlaunchctl bootout gui/$(id -u)/us.stephenturner.claudeping 2&gt;/dev/null\n# Build it again\nlaunchctl bootstrap gui/$(id -u) ~/Library/LaunchAgents/us.stephenturner.claudeping.plist\n# Force the service to start\nlaunchctl kickstart -k gui/$(id -u)/us.stephenturner.claudeping\n# You're looking for an exit code 0\nlaunchctl print gui/$(id -u)/us.stephenturner.claudeping | grep -iE 'last exit|runs'\n# See the logs\ncat /tmp/claudeping.log /tmp/claudeping.err</code></pre></div><p>That's it. Enjoy that extra session while subscription-based subsidized usage lasts!</p><p class=\"button-wrapper\" data-attrs=\"{&quot;url&quot;:&quot;https://blog.stephenturner.us/subscribe?&quot;,&quot;text&quot;:&quot;Subscribe now&quot;,&quot;action&quot;:null,&quot;class&quot;:null}\" data-component-name=\"ButtonCreateButton\"><a class=\"button primary\" href=\"https://blog.stephenturner.us/subscribe?\"><span>Subscribe now</span></a></p><div class=\"footnote\" data-component-name=\"FootnoteToDOM\"><a id=\"footnote-1\" href=\"#footnote-anchor-1\" class=\"footnote-number\" contenteditable=\"false\" target=\"_self\">1</a><div class=\"footnote-content\"><p>Yes, I fully realize that I sound like a tokenmaxxing workaholic writing it out this way. I'm not using Claude Code 15 hours per day. In reality while using Opus or Fable you're going to hit a session limit on a $20 plan very quickly. This essentially gives me 3 windows to use Claude at subscription rates instead of 2 windows. Soon enough I'm sure everything's going to be metered at API rates, but for now I'm just trying to take advantage of those VC token subsidies while I can.</p></div></div>","doi":"https://doi.org/10.59350/tetv4-ynb16","guid":"206299798","image":"https://substack-post-media.s3.amazonaws.com/public/images/ce8299d1-8e5e-4f9d-bd8c-54d6f1474695_2596x1363.jpeg","language":"en","license":"https://creativecommons.org/licenses/by/4.0/legalcode","published_at":1788739200,"rid":"sw9z3-43v90","summary":"I automate a prompt to Claude Code very early, kicking off a session while I'm sleeping, effectively giving me three five hour sessions in a day for the price of two.","tags":["TIL","AI"],"title":"Sessionmaxxing Claude Code","updated_at":1788852610,"url":"https://blog.stephenturner.us/p/sessionmaxxing","version":"v1"}},{"document":{"authors":[{"contributor_roles":[],"family":"Rubin","given":"Mark"}],"blog":{"authors":[{"name":"Mark Rubin"}],"community_id":"3bd0dcf5-7d43-47f1-b260-87d9f30bdcd6","created":1681948800,"current_feed_url":null,"description":"Critical metascience takes a step back to question some common assumptions, approaches, problems, and solutions in metascience.","doi":"https://doi.org/10.59350/markrubin","favicon":"https://rogue-scholar.org/api/communities/3bd0dcf5-7d43-47f1-b260-87d9f30bdcd6/logo","feed_format":"application/rss+xml","feed_url":"https://markrubin.substack.com/feed","filter":null,"generator":"Substack","home_page_url":"https://markrubin.substack.com","issn":null,"language":"eng","license":"https://creativecommons.org/licenses/by/4.0/legalcode","prefix":"10.59350","relative_url":null,"secure":true,"slug":"markrubin","status":"active","subfield":"1207","title":"Critical Metascience","updated":1788777722,"use_api":null},"blog_name":"Critical Metascience","blog_slug":"markrubin","content_html":"<div class=\"captioned-image-container\"><figure><a class=\"image-link image2\" target=\"_blank\" href=\"https://substackcdn.com/image/fetch/$s_!CFBM!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F2d1077fd-c0ac-42e3-a2d2-72f50e1c86fe_935x8.png\" data-component-name=\"Image2ToDOM\"><div class=\"image2-inset\"><picture><source type=\"image/webp\" srcset=\"https://substackcdn.com/image/fetch/$s_!CFBM!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F2d1077fd-c0ac-42e3-a2d2-72f50e1c86fe_935x8.png 424w, https://substackcdn.com/image/fetch/$s_!CFBM!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F2d1077fd-c0ac-42e3-a2d2-72f50e1c86fe_935x8.png 848w, https://substackcdn.com/image/fetch/$s_!CFBM!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F2d1077fd-c0ac-42e3-a2d2-72f50e1c86fe_935x8.png 1272w, https://substackcdn.com/image/fetch/$s_!CFBM!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F2d1077fd-c0ac-42e3-a2d2-72f50e1c86fe_935x8.png 1456w\" sizes=\"100vw\"><img src=\"https://substackcdn.com/image/fetch/$s_!CFBM!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F2d1077fd-c0ac-42e3-a2d2-72f50e1c86fe_935x8.png\" width=\"935\" height=\"8\" data-attrs=\"{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/2d1077fd-c0ac-42e3-a2d2-72f50e1c86fe_935x8.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:8,&quot;width&quot;:935,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:12010,&quot;alt&quot;:&quot;&quot;,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:false,&quot;topImage&quot;:true,&quot;internalRedirect&quot;:&quot;https://markrubin.substack.com/i/202452147?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F2d1077fd-c0ac-42e3-a2d2-72f50e1c86fe_935x8.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}\" class=\"sizing-normal\" alt=\"\" title=\"\" srcset=\"https://substackcdn.com/image/fetch/$s_!CFBM!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F2d1077fd-c0ac-42e3-a2d2-72f50e1c86fe_935x8.png 424w, https://substackcdn.com/image/fetch/$s_!CFBM!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F2d1077fd-c0ac-42e3-a2d2-72f50e1c86fe_935x8.png 848w, https://substackcdn.com/image/fetch/$s_!CFBM!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F2d1077fd-c0ac-42e3-a2d2-72f50e1c86fe_935x8.png 1272w, https://substackcdn.com/image/fetch/$s_!CFBM!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F2d1077fd-c0ac-42e3-a2d2-72f50e1c86fe_935x8.png 1456w\" sizes=\"100vw\" fetchpriority=\"high\"></picture><div></div></div></a></figure></div><h2>Is Replication Rare?</h2><div class=\"captioned-image-container\"><figure><a class=\"image-link image2 is-viewable-img\" target=\"_blank\" href=\"https://substackcdn.com/image/fetch/$s_!M-CA!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F22c27cee-2a5d-43b7-9ca2-5e924e2f80df_1124x539.png\" data-component-name=\"Image2ToDOM\"><div class=\"image2-inset\"><picture><source type=\"image/webp\" srcset=\"https://substackcdn.com/image/fetch/$s_!M-CA!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F22c27cee-2a5d-43b7-9ca2-5e924e2f80df_1124x539.png 424w, https://substackcdn.com/image/fetch/$s_!M-CA!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F22c27cee-2a5d-43b7-9ca2-5e924e2f80df_1124x539.png 848w, https://substackcdn.com/image/fetch/$s_!M-CA!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F22c27cee-2a5d-43b7-9ca2-5e924e2f80df_1124x539.png 1272w, https://substackcdn.com/image/fetch/$s_!M-CA!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F22c27cee-2a5d-43b7-9ca2-5e924e2f80df_1124x539.png 1456w\" sizes=\"100vw\"><img src=\"https://substackcdn.com/image/fetch/$s_!M-CA!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F22c27cee-2a5d-43b7-9ca2-5e924e2f80df_1124x539.png\" width=\"546\" height=\"261.8274021352313\" data-attrs=\"{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/22c27cee-2a5d-43b7-9ca2-5e924e2f80df_1124x539.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:539,&quot;width&quot;:1124,&quot;resizeWidth&quot;:546,&quot;bytes&quot;:44097,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:false,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://markrubin.substack.com/i/212517182?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F22c27cee-2a5d-43b7-9ca2-5e924e2f80df_1124x539.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}\" class=\"sizing-normal\" alt=\"\" srcset=\"https://substackcdn.com/image/fetch/$s_!M-CA!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F22c27cee-2a5d-43b7-9ca2-5e924e2f80df_1124x539.png 424w, https://substackcdn.com/image/fetch/$s_!M-CA!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F22c27cee-2a5d-43b7-9ca2-5e924e2f80df_1124x539.png 848w, https://substackcdn.com/image/fetch/$s_!M-CA!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F22c27cee-2a5d-43b7-9ca2-5e924e2f80df_1124x539.png 1272w, https://substackcdn.com/image/fetch/$s_!M-CA!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F22c27cee-2a5d-43b7-9ca2-5e924e2f80df_1124x539.png 1456w\" sizes=\"100vw\"></picture><div class=\"image-link-expand\"><div class=\"pencraft pc-display-flex pc-gap-8 pc-reset\"><button tabindex=\"0\" type=\"button\" class=\"pencraft pc-reset pencraft icon-container restack-image\"><svg aria-hidden=\"true\" width=\"20\" height=\"20\" viewBox=\"0 0 20 20\" fill=\"none\" stroke-width=\"1.5\" stroke=\"var(--color-fg-primary)\" stroke-linecap=\"round\" stroke-linejoin=\"round\" xmlns=\"http://www.w3.org/2000/svg\"><g><path d=\"M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882\"></path></g></svg></button><button tabindex=\"0\" type=\"button\" class=\"pencraft pc-reset pencraft icon-container view-image\"><svg xmlns=\"http://www.w3.org/2000/svg\" width=\"20\" height=\"20\" viewBox=\"0 0 24 24\" fill=\"none\" stroke=\"currentColor\" stroke-width=\"2\" stroke-linecap=\"round\" stroke-linejoin=\"round\" class=\"lucide lucide-maximize2 lucide-maximize-2\"><polyline points=\"15 3 21 3 21 9\"></polyline><polyline points=\"9 21 3 21 3 15\"></polyline><line x1=\"21\" x2=\"14\" y1=\"3\" y2=\"10\"></line><line x1=\"3\" x2=\"10\" y1=\"21\" y2=\"14\"></line></svg></button></div></div></div></a></figure></div><p><a href=\"https://www.kcl.ac.uk/people/tim-rakow\">Tim Rakow</a> recently published <a href=\"https://doi.org/10.1177/17456916261452961\">work </a>that \"investigates the claim that psychological scientists have published only a small quantity of replication research (Chambers, 2017; Ioannidis, 2012).\"  He found that 19% of the 1,224 psychology articles examined explicitly referred to \"replication\" in their studies, although \"direct replications were less common than conceptual replications and replications with extension.\"</p><div class=\"captioned-image-container\"><figure><a class=\"image-link image2 is-viewable-img\" target=\"_blank\" href=\"https://substackcdn.com/image/fetch/$s_!rq09!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fbc506360-eb5b-4ddd-a05b-b6e2ce0ac437_540x540.webp\" data-component-name=\"Image2ToDOM\"><div class=\"image2-inset\"><picture><source type=\"image/webp\" srcset=\"https://substackcdn.com/image/fetch/$s_!rq09!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fbc506360-eb5b-4ddd-a05b-b6e2ce0ac437_540x540.webp 424w, https://substackcdn.com/image/fetch/$s_!rq09!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fbc506360-eb5b-4ddd-a05b-b6e2ce0ac437_540x540.webp 848w, https://substackcdn.com/image/fetch/$s_!rq09!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fbc506360-eb5b-4ddd-a05b-b6e2ce0ac437_540x540.webp 1272w, https://substackcdn.com/image/fetch/$s_!rq09!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fbc506360-eb5b-4ddd-a05b-b6e2ce0ac437_540x540.webp 1456w\" sizes=\"100vw\"><img src=\"https://substackcdn.com/image/fetch/$s_!rq09!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fbc506360-eb5b-4ddd-a05b-b6e2ce0ac437_540x540.webp\" width=\"282\" height=\"282\" data-attrs=\"{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/bc506360-eb5b-4ddd-a05b-b6e2ce0ac437_540x540.webp&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:540,&quot;width&quot;:540,&quot;resizeWidth&quot;:282,&quot;bytes&quot;:16600,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/webp&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:false,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://markrubin.substack.com/i/212517182?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fbc506360-eb5b-4ddd-a05b-b6e2ce0ac437_540x540.webp&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}\" class=\"sizing-normal\" alt=\"\" srcset=\"https://substackcdn.com/image/fetch/$s_!rq09!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fbc506360-eb5b-4ddd-a05b-b6e2ce0ac437_540x540.webp 424w, https://substackcdn.com/image/fetch/$s_!rq09!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fbc506360-eb5b-4ddd-a05b-b6e2ce0ac437_540x540.webp 848w, https://substackcdn.com/image/fetch/$s_!rq09!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fbc506360-eb5b-4ddd-a05b-b6e2ce0ac437_540x540.webp 1272w, https://substackcdn.com/image/fetch/$s_!rq09!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fbc506360-eb5b-4ddd-a05b-b6e2ce0ac437_540x540.webp 1456w\" sizes=\"100vw\"></picture><div class=\"image-link-expand\"><div class=\"pencraft pc-display-flex pc-gap-8 pc-reset\"><button tabindex=\"0\" type=\"button\" class=\"pencraft pc-reset pencraft icon-container restack-image\"><svg aria-hidden=\"true\" width=\"20\" height=\"20\" viewBox=\"0 0 20 20\" fill=\"none\" stroke-width=\"1.5\" stroke=\"var(--color-fg-primary)\" stroke-linecap=\"round\" stroke-linejoin=\"round\" xmlns=\"http://www.w3.org/2000/svg\"><g><path d=\"M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882\"></path></g></svg></button><button tabindex=\"0\" type=\"button\" class=\"pencraft pc-reset pencraft icon-container view-image\"><svg xmlns=\"http://www.w3.org/2000/svg\" width=\"20\" height=\"20\" viewBox=\"0 0 24 24\" fill=\"none\" stroke=\"currentColor\" stroke-width=\"2\" stroke-linecap=\"round\" stroke-linejoin=\"round\" class=\"lucide lucide-maximize2 lucide-maximize-2\"><polyline points=\"15 3 21 3 21 9\"></polyline><polyline points=\"9 21 3 21 3 15\"></polyline><line x1=\"21\" x2=\"14\" y1=\"3\" y2=\"10\"></line><line x1=\"3\" x2=\"10\" y1=\"21\" y2=\"14\"></line></svg></button></div></div></div></a><figcaption class=\"image-caption\">Tim Rakow</figcaption></figure></div><p>Rakow's work reminds me of a theoretical paper by Stephan Guttinger (2018) arguing that <a href=\"https://doi.org/10.1002/bies.201800055\">replications are everywhere</a>. Guttinger identified what he called \"micro-replications\" in which researchers \"reproduce an earlier finding of another group using their own materials and methods.\" Critically, however, authors do not label these micro-replications as \"replications\" in their work. Hence, they do not tend to be picked up in surveys of the prevalence of replications. As Guttinger explained,</p><blockquote><p>the current debate about the reproducibility crisis is completely blind to the additional level of micro-replications, as the analytic framework used only thinks of replications as add-ons and not as part of regular experimentation.</p></blockquote><div class=\"captioned-image-container\"><figure><a class=\"image-link image2 is-viewable-img\" target=\"_blank\" href=\"https://substackcdn.com/image/fetch/$s_!T-Qe!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fbfa0e4ca-fba7-4937-bab9-69f2801e7964_1811x583.png\" data-component-name=\"Image2ToDOM\"><div class=\"image2-inset\"><picture><source type=\"image/webp\" srcset=\"https://substackcdn.com/image/fetch/$s_!T-Qe!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fbfa0e4ca-fba7-4937-bab9-69f2801e7964_1811x583.png 424w, https://substackcdn.com/image/fetch/$s_!T-Qe!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fbfa0e4ca-fba7-4937-bab9-69f2801e7964_1811x583.png 848w, https://substackcdn.com/image/fetch/$s_!T-Qe!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fbfa0e4ca-fba7-4937-bab9-69f2801e7964_1811x583.png 1272w, https://substackcdn.com/image/fetch/$s_!T-Qe!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fbfa0e4ca-fba7-4937-bab9-69f2801e7964_1811x583.png 1456w\" sizes=\"100vw\"><img src=\"https://substackcdn.com/image/fetch/$s_!T-Qe!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fbfa0e4ca-fba7-4937-bab9-69f2801e7964_1811x583.png\" width=\"1456\" height=\"469\" data-attrs=\"{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/bfa0e4ca-fba7-4937-bab9-69f2801e7964_1811x583.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:469,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:59214,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:false,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://markrubin.substack.com/i/212517182?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fbfa0e4ca-fba7-4937-bab9-69f2801e7964_1811x583.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}\" class=\"sizing-normal\" alt=\"\" srcset=\"https://substackcdn.com/image/fetch/$s_!T-Qe!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fbfa0e4ca-fba7-4937-bab9-69f2801e7964_1811x583.png 424w, https://substackcdn.com/image/fetch/$s_!T-Qe!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fbfa0e4ca-fba7-4937-bab9-69f2801e7964_1811x583.png 848w, https://substackcdn.com/image/fetch/$s_!T-Qe!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fbfa0e4ca-fba7-4937-bab9-69f2801e7964_1811x583.png 1272w, https://substackcdn.com/image/fetch/$s_!T-Qe!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fbfa0e4ca-fba7-4937-bab9-69f2801e7964_1811x583.png 1456w\" sizes=\"100vw\"></picture><div class=\"image-link-expand\"><div class=\"pencraft pc-display-flex pc-gap-8 pc-reset\"><button tabindex=\"0\" type=\"button\" class=\"pencraft pc-reset pencraft icon-container restack-image\"><svg aria-hidden=\"true\" width=\"20\" height=\"20\" viewBox=\"0 0 20 20\" fill=\"none\" stroke-width=\"1.5\" stroke=\"var(--color-fg-primary)\" stroke-linecap=\"round\" stroke-linejoin=\"round\" xmlns=\"http://www.w3.org/2000/svg\"><g><path d=\"M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882\"></path></g></svg></button><button tabindex=\"0\" type=\"button\" class=\"pencraft pc-reset pencraft icon-container view-image\"><svg xmlns=\"http://www.w3.org/2000/svg\" width=\"20\" height=\"20\" viewBox=\"0 0 24 24\" fill=\"none\" stroke=\"currentColor\" stroke-width=\"2\" stroke-linecap=\"round\" stroke-linejoin=\"round\" class=\"lucide lucide-maximize2 lucide-maximize-2\"><polyline points=\"15 3 21 3 21 9\"></polyline><polyline points=\"9 21 3 21 3 15\"></polyline><line x1=\"21\" x2=\"14\" y1=\"3\" y2=\"10\"></line><line x1=\"3\" x2=\"10\" y1=\"21\" y2=\"14\"></line></svg></button></div></div></div></a></figure></div><p>Guttinger concluded that:</p><blockquote><p>There might be less need to fundamentally revise the experimental sciences than current talk of a 'crisis' often implies. There is good reason to assume that (successful) replications are much more prevalent</p></blockquote><p>Rakow's work adds to Guttinger's by showing that, in addition to unmentioned micro-replications, researchers also often explicitly report what they term \"replications.\" Hence, Rakow concluded that:</p><blockquote><p>Many researchers are not shy about conducting and reporting replication. Plausibly, at least 20% of psychology articles include author-identified replication; and replication could be considered to be a mainstream practice in experimental psychology. Nonetheless, recommendations for improving replication practices remain relevant because psychology might not be leveraging the full range of benefits afforded by different kinds of replication study (H\u00fcffmeier et al., 2016; Schmidt, 2009). Because conceptual replications appear to be far more common than direct replications, the priority likely lies with greater use of direct replications.</p></blockquote><p>Rakow's point about the rarity of <em>direct replications </em>is well taken. <a href=\"https://beth-clarke.com/\">Beth Clarke</a> and colleagues (2026) recently analysed 100 top psychology journals and found that \"only 0.2% of articles (169 articles out of 84,834) were direct replication articles.\"</p><div class=\"captioned-image-container\"><figure><a class=\"image-link image2 is-viewable-img\" target=\"_blank\" href=\"https://substackcdn.com/image/fetch/$s_!Ha_1!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F1a5a05c5-eff8-4539-91de-2f5db577b120_2010x2018.jpeg\" data-component-name=\"Image2ToDOM\"><div class=\"image2-inset\"><picture><source type=\"image/webp\" srcset=\"https://substackcdn.com/image/fetch/$s_!Ha_1!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F1a5a05c5-eff8-4539-91de-2f5db577b120_2010x2018.jpeg 424w, https://substackcdn.com/image/fetch/$s_!Ha_1!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F1a5a05c5-eff8-4539-91de-2f5db577b120_2010x2018.jpeg 848w, https://substackcdn.com/image/fetch/$s_!Ha_1!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F1a5a05c5-eff8-4539-91de-2f5db577b120_2010x2018.jpeg 1272w, https://substackcdn.com/image/fetch/$s_!Ha_1!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F1a5a05c5-eff8-4539-91de-2f5db577b120_2010x2018.jpeg 1456w\" sizes=\"100vw\"><img src=\"https://substackcdn.com/image/fetch/$s_!Ha_1!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F1a5a05c5-eff8-4539-91de-2f5db577b120_2010x2018.jpeg\" width=\"282\" height=\"283.1620879120879\" data-attrs=\"{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/1a5a05c5-eff8-4539-91de-2f5db577b120_2010x2018.jpeg&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:1462,&quot;width&quot;:1456,&quot;resizeWidth&quot;:282,&quot;bytes&quot;:1103514,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/jpeg&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://markrubin.substack.com/i/212517182?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F1a5a05c5-eff8-4539-91de-2f5db577b120_2010x2018.jpeg&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}\" class=\"sizing-normal\" alt=\"\" srcset=\"https://substackcdn.com/image/fetch/$s_!Ha_1!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F1a5a05c5-eff8-4539-91de-2f5db577b120_2010x2018.jpeg 424w, https://substackcdn.com/image/fetch/$s_!Ha_1!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F1a5a05c5-eff8-4539-91de-2f5db577b120_2010x2018.jpeg 848w, https://substackcdn.com/image/fetch/$s_!Ha_1!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F1a5a05c5-eff8-4539-91de-2f5db577b120_2010x2018.jpeg 1272w, https://substackcdn.com/image/fetch/$s_!Ha_1!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F1a5a05c5-eff8-4539-91de-2f5db577b120_2010x2018.jpeg 1456w\" sizes=\"100vw\" loading=\"lazy\"></picture><div class=\"image-link-expand\"><div class=\"pencraft pc-display-flex pc-gap-8 pc-reset\"><button tabindex=\"0\" type=\"button\" class=\"pencraft pc-reset pencraft icon-container restack-image\"><svg aria-hidden=\"true\" width=\"20\" height=\"20\" viewBox=\"0 0 20 20\" fill=\"none\" stroke-width=\"1.5\" stroke=\"var(--color-fg-primary)\" stroke-linecap=\"round\" stroke-linejoin=\"round\" xmlns=\"http://www.w3.org/2000/svg\"><g><path d=\"M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882\"></path></g></svg></button><button tabindex=\"0\" type=\"button\" class=\"pencraft pc-reset pencraft icon-container view-image\"><svg xmlns=\"http://www.w3.org/2000/svg\" width=\"20\" height=\"20\" viewBox=\"0 0 24 24\" fill=\"none\" stroke=\"currentColor\" stroke-width=\"2\" stroke-linecap=\"round\" stroke-linejoin=\"round\" class=\"lucide lucide-maximize2 lucide-maximize-2\"><polyline points=\"15 3 21 3 21 9\"></polyline><polyline points=\"9 21 3 21 3 15\"></polyline><line x1=\"21\" x2=\"14\" y1=\"3\" y2=\"10\"></line><line x1=\"3\" x2=\"10\" y1=\"21\" y2=\"14\"></line></svg></button></div></div></div></a><figcaption class=\"image-caption\">Beth Clarke</figcaption></figure></div><p>So, are replications rare? It depends how you define a \"replication\"! If you mean <em>any </em>case in which researchers replicate a phenomenon, potentially using somewhat different methods (i.e., in conceptual replications and extensions), then no, they're not that rare. But if you restrict your definition to cases in which researchers deliberately set out to conduct direct replication attempts using what they presume to be the same methods and to report their results in dedicated direct replication articles, then yes, they're rare, at least in top journals.</p><p>Finally, it is interesting to see Clarke et al. step back to considered the more critical question: What direct replication rate do we actually want?</p><blockquote><p>We recommend that each journal consider what replicability rate they are aiming for, advertise this as one of the journal's aims, and invest in or solicit enough replication studies to assess whether they are meeting their goal. For example, is the journal's aim to publish results that are very definitive (low risk of false positives/negatives) or groundbreaking (high risk of false positives/negatives)? As Srivastava (2011) has argued, articles can rarely be both. We believe that most journals have at least an implicit goal for balancing this trade-off. We encourage journals to make this goal explicit and to invest in replication studies to gauge how well they are meeting their goals.</p></blockquote><p>As I've <a href=\"https://markrubin.substack.com/p/is-a-55-replication-rate-too-low\">discussed previously</a>, determining desired replication rates is tricky! But it's encouraging to see metascientists starting to grapple with this important issue (for recent work, see <a href=\"https://osf.io/preprints/metaarxiv/x7n9h_v1\">Harper &amp; Sch\u00f6nbrodt, 2026</a>).</p><div class=\"callout-block\" data-callout=\"true\"><p>Clarke, B., Lee, P. Y. (K.), Schiavone, S. R., Rhemtulla, M., &amp; Vazire, S. (2026). The prevalence of direct replication articles in top-ranking psychology journals. <em>American Psychologist, 81</em>(2), 238\u2013253. <a href=\"https://doi.org/10.1037/amp0001385\">https://doi.org/10.1037/amp0001385</a></p><p></p><p>Guttinger, S. (2018). Replications everywhere: Why the replication crisis might be less severe than it seems at first. <em>BioEssays, 40</em>, Article 1800055. <a href=\"https://doi.org/10.1002/bies.201800055\">https://doi.org/10.1002/bies.201800055 </a></p><p></p><p>Rakow, T. (2026). Estimating the prevalence of replication research Is challenging, not least because even a thorough database search can be shallow. <em>Perspectives on Psychological Science.</em> <a href=\"https://doi.org/10.1177/17456916261452961\">https://doi.org/10.1177/17456916261452961</a></p></div><div class=\"captioned-image-container\"><figure><a class=\"image-link image2\" target=\"_blank\" href=\"https://substackcdn.com/image/fetch/$s_!CFBM!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F2d1077fd-c0ac-42e3-a2d2-72f50e1c86fe_935x8.png\" data-component-name=\"Image2ToDOM\"><div class=\"image2-inset\"><picture><source type=\"image/webp\" srcset=\"https://substackcdn.com/image/fetch/$s_!CFBM!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F2d1077fd-c0ac-42e3-a2d2-72f50e1c86fe_935x8.png 424w, https://substackcdn.com/image/fetch/$s_!CFBM!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F2d1077fd-c0ac-42e3-a2d2-72f50e1c86fe_935x8.png 848w, https://substackcdn.com/image/fetch/$s_!CFBM!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F2d1077fd-c0ac-42e3-a2d2-72f50e1c86fe_935x8.png 1272w, https://substackcdn.com/image/fetch/$s_!CFBM!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F2d1077fd-c0ac-42e3-a2d2-72f50e1c86fe_935x8.png 1456w\" sizes=\"100vw\"><img src=\"https://substackcdn.com/image/fetch/$s_!CFBM!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F2d1077fd-c0ac-42e3-a2d2-72f50e1c86fe_935x8.png\" width=\"935\" height=\"8\" data-attrs=\"{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/2d1077fd-c0ac-42e3-a2d2-72f50e1c86fe_935x8.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:8,&quot;width&quot;:935,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:12010,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://markrubin.substack.com/i/202452147?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F2d1077fd-c0ac-42e3-a2d2-72f50e1c86fe_935x8.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}\" class=\"sizing-normal\" alt=\"\" srcset=\"https://substackcdn.com/image/fetch/$s_!CFBM!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F2d1077fd-c0ac-42e3-a2d2-72f50e1c86fe_935x8.png 424w, https://substackcdn.com/image/fetch/$s_!CFBM!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F2d1077fd-c0ac-42e3-a2d2-72f50e1c86fe_935x8.png 848w, https://substackcdn.com/image/fetch/$s_!CFBM!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F2d1077fd-c0ac-42e3-a2d2-72f50e1c86fe_935x8.png 1272w, https://substackcdn.com/image/fetch/$s_!CFBM!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F2d1077fd-c0ac-42e3-a2d2-72f50e1c86fe_935x8.png 1456w\" sizes=\"100vw\" loading=\"lazy\"></picture><div></div></div></a></figure></div><h2>Registered Report Timelines</h2><p><a href=\"https://aaronerlich.com/?lang=en\">Aaron Erlich</a> wrote a <a href=\"https://aaronerlich.com/posts/2026-08-registered-reports/?lang=en\">blog post </a>questioning whether the time it takes to publish Registered Reports is longer than that for standard articles. As he explains:</p><blockquote><p><span>There is no published study comparing time-to-publication for registered reports against standard articles. The literature has measured the format's quality (</span><a href=\"https://doi.org/10.1038/s41562-021-01142-4\">reviewers rated registered reports higher on all nineteen criteria tested</a><span>), its rate of null results (about 44 per cent of registered-report hypotheses supported, against roughly 96 per cent of results in standard psychology articles), its citations, and how many journals offer it. Nobody has measured the clock. The nearest work asks researchers what they </span><em>think</em><span> the cost is: </span><a href=\"https://doi.org/10.1098/rsos.211997\">Sarafoglou and colleagues</a><span> surveyed 355 researchers on preregistration and got \"better science but more work\"; </span><a href=\"https://docs.iza.org/dp17821.pdf\">Imai and colleagues</a><span> surveyed 519 experimental economists and found that more than 80 per cent know what a registered report is, most approve of them \u2014 and adoption is near zero. Neither asked anyone for a date.</span></p></blockquote><p>He concludes, \"if anyone is interested in trying to collect this data more systematically for political science, please let me know.\"</p><p>You can contact Aaron at aaron.erlich@mcgill.ca</p><div class=\"captioned-image-container\"><figure><a class=\"image-link image2 is-viewable-img\" target=\"_blank\" href=\"https://substackcdn.com/image/fetch/$s_!J7v2!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F4e41d61d-db0a-4524-b345-b810026c0522_800x800.jpeg\" data-component-name=\"Image2ToDOM\"><div class=\"image2-inset\"><picture><source type=\"image/webp\" srcset=\"https://substackcdn.com/image/fetch/$s_!J7v2!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F4e41d61d-db0a-4524-b345-b810026c0522_800x800.jpeg 424w, https://substackcdn.com/image/fetch/$s_!J7v2!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F4e41d61d-db0a-4524-b345-b810026c0522_800x800.jpeg 848w, https://substackcdn.com/image/fetch/$s_!J7v2!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F4e41d61d-db0a-4524-b345-b810026c0522_800x800.jpeg 1272w, https://substackcdn.com/image/fetch/$s_!J7v2!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F4e41d61d-db0a-4524-b345-b810026c0522_800x800.jpeg 1456w\" sizes=\"100vw\"><img src=\"https://substackcdn.com/image/fetch/$s_!J7v2!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F4e41d61d-db0a-4524-b345-b810026c0522_800x800.jpeg\" width=\"284\" height=\"284\" data-attrs=\"{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/4e41d61d-db0a-4524-b345-b810026c0522_800x800.jpeg&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:800,&quot;width&quot;:800,&quot;resizeWidth&quot;:284,&quot;bytes&quot;:776868,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/jpeg&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://markrubin.substack.com/i/212517182?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F4e41d61d-db0a-4524-b345-b810026c0522_800x800.jpeg&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}\" class=\"sizing-normal\" alt=\"\" srcset=\"https://substackcdn.com/image/fetch/$s_!J7v2!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F4e41d61d-db0a-4524-b345-b810026c0522_800x800.jpeg 424w, https://substackcdn.com/image/fetch/$s_!J7v2!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F4e41d61d-db0a-4524-b345-b810026c0522_800x800.jpeg 848w, https://substackcdn.com/image/fetch/$s_!J7v2!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F4e41d61d-db0a-4524-b345-b810026c0522_800x800.jpeg 1272w, https://substackcdn.com/image/fetch/$s_!J7v2!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F4e41d61d-db0a-4524-b345-b810026c0522_800x800.jpeg 1456w\" sizes=\"100vw\" loading=\"lazy\"></picture><div class=\"image-link-expand\"><div class=\"pencraft pc-display-flex pc-gap-8 pc-reset\"><button tabindex=\"0\" type=\"button\" class=\"pencraft pc-reset pencraft icon-container restack-image\"><svg aria-hidden=\"true\" width=\"20\" height=\"20\" viewBox=\"0 0 20 20\" fill=\"none\" stroke-width=\"1.5\" stroke=\"var(--color-fg-primary)\" stroke-linecap=\"round\" stroke-linejoin=\"round\" xmlns=\"http://www.w3.org/2000/svg\"><g><path d=\"M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882\"></path></g></svg></button><button tabindex=\"0\" type=\"button\" class=\"pencraft pc-reset pencraft icon-container view-image\"><svg xmlns=\"http://www.w3.org/2000/svg\" width=\"20\" height=\"20\" viewBox=\"0 0 24 24\" fill=\"none\" stroke=\"currentColor\" stroke-width=\"2\" stroke-linecap=\"round\" stroke-linejoin=\"round\" class=\"lucide lucide-maximize2 lucide-maximize-2\"><polyline points=\"15 3 21 3 21 9\"></polyline><polyline points=\"9 21 3 21 3 15\"></polyline><line x1=\"21\" x2=\"14\" y1=\"3\" y2=\"10\"></line><line x1=\"3\" x2=\"10\" y1=\"21\" y2=\"14\"></line></svg></button></div></div></div></a><figcaption class=\"image-caption\">Aaron Erlich</figcaption></figure></div><div class=\"callout-block\" data-callout=\"true\"><p>Erlich, A. (2026, August 28). Registered reports are available in political science and used almost nowhere. <em>Blog.</em> <a href=\"https://aaronerlich.com/posts/2026-08-registered-reports/?lang=en\">https://aaronerlich.com/posts/2026-08-registered-reports/?lang=en</a></p></div><div class=\"captioned-image-container\"><figure><a class=\"image-link image2\" target=\"_blank\" href=\"https://substackcdn.com/image/fetch/$s_!ryOv!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fefb7690f-1076-48b0-a819-707482a5775d_935x8.png\" data-component-name=\"Image2ToDOM\"><div class=\"image2-inset\"><picture><source type=\"image/webp\" srcset=\"https://substackcdn.com/image/fetch/$s_!ryOv!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fefb7690f-1076-48b0-a819-707482a5775d_935x8.png 424w, https://substackcdn.com/image/fetch/$s_!ryOv!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fefb7690f-1076-48b0-a819-707482a5775d_935x8.png 848w, https://substackcdn.com/image/fetch/$s_!ryOv!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fefb7690f-1076-48b0-a819-707482a5775d_935x8.png 1272w, https://substackcdn.com/image/fetch/$s_!ryOv!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fefb7690f-1076-48b0-a819-707482a5775d_935x8.png 1456w\" sizes=\"100vw\"><img src=\"https://substackcdn.com/image/fetch/$s_!ryOv!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fefb7690f-1076-48b0-a819-707482a5775d_935x8.png\" width=\"935\" height=\"8\" data-attrs=\"{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/efb7690f-1076-48b0-a819-707482a5775d_935x8.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:8,&quot;width&quot;:935,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:12010,&quot;alt&quot;:&quot;&quot;,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://markrubin.substack.com/i/202452147?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fefb7690f-1076-48b0-a819-707482a5775d_935x8.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}\" class=\"sizing-normal\" alt=\"\" title=\"\" srcset=\"https://substackcdn.com/image/fetch/$s_!ryOv!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fefb7690f-1076-48b0-a819-707482a5775d_935x8.png 424w, https://substackcdn.com/image/fetch/$s_!ryOv!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fefb7690f-1076-48b0-a819-707482a5775d_935x8.png 848w, https://substackcdn.com/image/fetch/$s_!ryOv!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fefb7690f-1076-48b0-a819-707482a5775d_935x8.png 1272w, https://substackcdn.com/image/fetch/$s_!ryOv!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fefb7690f-1076-48b0-a819-707482a5775d_935x8.png 1456w\" sizes=\"100vw\" loading=\"lazy\"></picture><div></div></div></a></figure></div><h2>Open Science and Trust</h2><p><a href=\"https://graz-openscience.uni-graz.at/en/gosi-team/hilmar-brohmer/\">Hilmar Brohmer</a> and colleagues investigated the myside bias, general trust in science, and the communication of open science practices as predictors of public trust in scientific findings that are communicated through popular-scientific media articles. They found that \"general trust in science and myside bias strongly predicted trust in certain popular-scientific summaries, while explicit Open Science cues did not show an effect.\" Perhaps this is because open science \"practices are perceived as the default, [and so] explicitly mentioning them may offer little additional benefit in terms of increasing trust (Anvari &amp; Lakens, 2018)\"? </p><div class=\"captioned-image-container\"><figure><a class=\"image-link image2 is-viewable-img\" target=\"_blank\" href=\"https://substackcdn.com/image/fetch/$s_!9YHj!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F79d359fd-79e9-4bce-8f61-7d866e141ed9_581x509.jpeg\" data-component-name=\"Image2ToDOM\"><div class=\"image2-inset\"><picture><source type=\"image/webp\" srcset=\"https://substackcdn.com/image/fetch/$s_!9YHj!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F79d359fd-79e9-4bce-8f61-7d866e141ed9_581x509.jpeg 424w, https://substackcdn.com/image/fetch/$s_!9YHj!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F79d359fd-79e9-4bce-8f61-7d866e141ed9_581x509.jpeg 848w, https://substackcdn.com/image/fetch/$s_!9YHj!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F79d359fd-79e9-4bce-8f61-7d866e141ed9_581x509.jpeg 1272w, https://substackcdn.com/image/fetch/$s_!9YHj!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F79d359fd-79e9-4bce-8f61-7d866e141ed9_581x509.jpeg 1456w\" sizes=\"100vw\"><img src=\"https://substackcdn.com/image/fetch/$s_!9YHj!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F79d359fd-79e9-4bce-8f61-7d866e141ed9_581x509.jpeg\" width=\"281\" height=\"246.17728055077453\" data-attrs=\"{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/79d359fd-79e9-4bce-8f61-7d866e141ed9_581x509.jpeg&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:509,&quot;width&quot;:581,&quot;resizeWidth&quot;:281,&quot;bytes&quot;:89671,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/jpeg&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://markrubin.substack.com/i/212517182?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F79d359fd-79e9-4bce-8f61-7d866e141ed9_581x509.jpeg&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}\" class=\"sizing-normal\" alt=\"\" srcset=\"https://substackcdn.com/image/fetch/$s_!9YHj!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F79d359fd-79e9-4bce-8f61-7d866e141ed9_581x509.jpeg 424w, https://substackcdn.com/image/fetch/$s_!9YHj!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F79d359fd-79e9-4bce-8f61-7d866e141ed9_581x509.jpeg 848w, https://substackcdn.com/image/fetch/$s_!9YHj!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F79d359fd-79e9-4bce-8f61-7d866e141ed9_581x509.jpeg 1272w, https://substackcdn.com/image/fetch/$s_!9YHj!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F79d359fd-79e9-4bce-8f61-7d866e141ed9_581x509.jpeg 1456w\" sizes=\"100vw\" loading=\"lazy\"></picture><div class=\"image-link-expand\"><div class=\"pencraft pc-display-flex pc-gap-8 pc-reset\"><button tabindex=\"0\" type=\"button\" class=\"pencraft pc-reset pencraft icon-container restack-image\"><svg aria-hidden=\"true\" width=\"20\" height=\"20\" viewBox=\"0 0 20 20\" fill=\"none\" stroke-width=\"1.5\" stroke=\"var(--color-fg-primary)\" stroke-linecap=\"round\" stroke-linejoin=\"round\" xmlns=\"http://www.w3.org/2000/svg\"><g><path d=\"M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882\"></path></g></svg></button><button tabindex=\"0\" type=\"button\" class=\"pencraft pc-reset pencraft icon-container view-image\"><svg xmlns=\"http://www.w3.org/2000/svg\" width=\"20\" height=\"20\" viewBox=\"0 0 24 24\" fill=\"none\" stroke=\"currentColor\" stroke-width=\"2\" stroke-linecap=\"round\" stroke-linejoin=\"round\" class=\"lucide lucide-maximize2 lucide-maximize-2\"><polyline points=\"15 3 21 3 21 9\"></polyline><polyline points=\"9 21 3 21 3 15\"></polyline><line x1=\"21\" x2=\"14\" y1=\"3\" y2=\"10\"></line><line x1=\"3\" x2=\"10\" y1=\"21\" y2=\"14\"></line></svg></button></div></div></div></a><figcaption class=\"image-caption\">Hilmar Brohmer</figcaption></figure></div><p>As the authors explained:</p><blockquote><p>We found that OS [open science] practices did not affect trust in the scientific findings, neither individually, nor in interaction with other variables, implying no evidence for either tested hypothesis. This calls into question whether it is necessary to comprehensively report in layperson texts whether or not OS was applied.</p></blockquote><div class=\"callout-block\" data-callout=\"true\"><p>Brohmer, H., Gehm, F., &amp; von G\u00f6tz, S. (2026). Believing what we want? Myside bias and the role of open science practices in public trust in science. <em>Science Communication.</em> <a href=\"https://doi.org/10.1177/10755470261475540\">https://doi.org/10.1177/10755470261475540</a></p></div><div class=\"captioned-image-container\"><figure><a class=\"image-link image2\" target=\"_blank\" href=\"https://substackcdn.com/image/fetch/$s_!QRuO!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F864e527e-11a3-4cc1-8f4d-85fe9f0d6198_935x8.png\" data-component-name=\"Image2ToDOM\"><div class=\"image2-inset\"><picture><source type=\"image/webp\" srcset=\"https://substackcdn.com/image/fetch/$s_!QRuO!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F864e527e-11a3-4cc1-8f4d-85fe9f0d6198_935x8.png 424w, https://substackcdn.com/image/fetch/$s_!QRuO!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F864e527e-11a3-4cc1-8f4d-85fe9f0d6198_935x8.png 848w, https://substackcdn.com/image/fetch/$s_!QRuO!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F864e527e-11a3-4cc1-8f4d-85fe9f0d6198_935x8.png 1272w, https://substackcdn.com/image/fetch/$s_!QRuO!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F864e527e-11a3-4cc1-8f4d-85fe9f0d6198_935x8.png 1456w\" sizes=\"100vw\"><img src=\"https://substackcdn.com/image/fetch/$s_!QRuO!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F864e527e-11a3-4cc1-8f4d-85fe9f0d6198_935x8.png\" width=\"935\" height=\"8\" data-attrs=\"{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/864e527e-11a3-4cc1-8f4d-85fe9f0d6198_935x8.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:8,&quot;width&quot;:935,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:null,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:null,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:null,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}\" class=\"sizing-normal\" alt=\"\" srcset=\"https://substackcdn.com/image/fetch/$s_!QRuO!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F864e527e-11a3-4cc1-8f4d-85fe9f0d6198_935x8.png 424w, https://substackcdn.com/image/fetch/$s_!QRuO!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F864e527e-11a3-4cc1-8f4d-85fe9f0d6198_935x8.png 848w, https://substackcdn.com/image/fetch/$s_!QRuO!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F864e527e-11a3-4cc1-8f4d-85fe9f0d6198_935x8.png 1272w, https://substackcdn.com/image/fetch/$s_!QRuO!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F864e527e-11a3-4cc1-8f4d-85fe9f0d6198_935x8.png 1456w\" sizes=\"100vw\" loading=\"lazy\"></picture><div></div></div></a></figure></div><h3><em>P</em>-hacking and Publication Bias</h3><p>Based on <a href=\"https://datacolada.org/91\">Simonsohn (2020)</a>, <a href=\"https://econ.wisc.edu/staff/cai-yong/\">Yong Cai</a> and colleagues distinguish between \"slow\" <em>p</em>-hacking (e.g., selective data transformation and outlier identification in the same data set) and \"fast\"<em> p</em>-hacking (e.g., file-drawering and then using a new data set). They argue that <em>fast</em> <em>p</em>-hacking exacerbates both <em>strong </em>and <em>weak </em>publication bias, and <em>slow p</em>-hacking exacerbates <em>weak </em>publication bias. However, <em>slow p</em>-hacking may also operate as a form of self-correction by mitigating the effects of <em>strong </em>publication bias (see also <a href=\"https://doi.org/10.1037/met0000246\">Friese &amp; Frankenbach, 2020</a>).</p><div class=\"captioned-image-container\"><figure><a class=\"image-link image2 is-viewable-img\" target=\"_blank\" href=\"https://substackcdn.com/image/fetch/$s_!hI6L!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe94c935a-535a-45b5-b61b-8bc65d1f56c6_810x849.png\" data-component-name=\"Image2ToDOM\"><div class=\"image2-inset\"><picture><source type=\"image/webp\" srcset=\"https://substackcdn.com/image/fetch/$s_!hI6L!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe94c935a-535a-45b5-b61b-8bc65d1f56c6_810x849.png 424w, https://substackcdn.com/image/fetch/$s_!hI6L!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe94c935a-535a-45b5-b61b-8bc65d1f56c6_810x849.png 848w, https://substackcdn.com/image/fetch/$s_!hI6L!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe94c935a-535a-45b5-b61b-8bc65d1f56c6_810x849.png 1272w, https://substackcdn.com/image/fetch/$s_!hI6L!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe94c935a-535a-45b5-b61b-8bc65d1f56c6_810x849.png 1456w\" sizes=\"100vw\"><img src=\"https://substackcdn.com/image/fetch/$s_!hI6L!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe94c935a-535a-45b5-b61b-8bc65d1f56c6_810x849.png\" width=\"728\" height=\"763.0518518518519\" data-attrs=\"{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/e94c935a-535a-45b5-b61b-8bc65d1f56c6_810x849.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:849,&quot;width&quot;:810,&quot;resizeWidth&quot;:728,&quot;bytes&quot;:113655,&quot;alt&quot;:&quot;Abstract This paper studies the effects of p-hacking on the bias of published estimates when papers with statistically significant results are selectively published. We show that fast p-hacking\u2014actions that lead to large changes in p-values\u2014always exacerbates the bias from selective publication. On the other hand, slow p-hacking\u2014actions that lead to small changes in p-values\u2014exacerbates bias when selection is weak, but mitigates it when selection is strong. In a model featuring both types of p-hacking, we show that a normality assumption identifies the true distribution of effects as well as the counterfactual mean that would obtain under selective publication without p-hacking. Applying the model to meta-analyses on the effects of behavioral nudges and development aid, we find suggestive evidence that both mitigation and exacerbation can arise in practice.&quot;,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://markrubin.substack.com/i/212517182?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe94c935a-535a-45b5-b61b-8bc65d1f56c6_810x849.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}\" class=\"sizing-normal\" alt=\"Abstract This paper studies the effects of p-hacking on the bias of published estimates when papers with statistically significant results are selectively published. We show that fast p-hacking\u2014actions that lead to large changes in p-values\u2014always exacerbates the bias from selective publication. On the other hand, slow p-hacking\u2014actions that lead to small changes in p-values\u2014exacerbates bias when selection is weak, but mitigates it when selection is strong. In a model featuring both types of p-hacking, we show that a normality assumption identifies the true distribution of effects as well as the counterfactual mean that would obtain under selective publication without p-hacking. Applying the model to meta-analyses on the effects of behavioral nudges and development aid, we find suggestive evidence that both mitigation and exacerbation can arise in practice.\" title=\"Abstract This paper studies the effects of p-hacking on the bias of published estimates when papers with statistically significant results are selectively published. We show that fast p-hacking\u2014actions that lead to large changes in p-values\u2014always exacerbates the bias from selective publication. On the other hand, slow p-hacking\u2014actions that lead to small changes in p-values\u2014exacerbates bias when selection is weak, but mitigates it when selection is strong. In a model featuring both types of p-hacking, we show that a normality assumption identifies the true distribution of effects as well as the counterfactual mean that would obtain under selective publication without p-hacking. Applying the model to meta-analyses on the effects of behavioral nudges and development aid, we find suggestive evidence that both mitigation and exacerbation can arise in practice.\" srcset=\"https://substackcdn.com/image/fetch/$s_!hI6L!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe94c935a-535a-45b5-b61b-8bc65d1f56c6_810x849.png 424w, https://substackcdn.com/image/fetch/$s_!hI6L!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe94c935a-535a-45b5-b61b-8bc65d1f56c6_810x849.png 848w, https://substackcdn.com/image/fetch/$s_!hI6L!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe94c935a-535a-45b5-b61b-8bc65d1f56c6_810x849.png 1272w, https://substackcdn.com/image/fetch/$s_!hI6L!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe94c935a-535a-45b5-b61b-8bc65d1f56c6_810x849.png 1456w\" sizes=\"100vw\" loading=\"lazy\"></picture><div class=\"image-link-expand\"><div class=\"pencraft pc-display-flex pc-gap-8 pc-reset\"><button tabindex=\"0\" type=\"button\" class=\"pencraft pc-reset pencraft icon-container restack-image\"><svg aria-hidden=\"true\" width=\"20\" height=\"20\" viewBox=\"0 0 20 20\" fill=\"none\" stroke-width=\"1.5\" stroke=\"var(--color-fg-primary)\" stroke-linecap=\"round\" stroke-linejoin=\"round\" xmlns=\"http://www.w3.org/2000/svg\"><g><path d=\"M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882\"></path></g></svg></button><button tabindex=\"0\" type=\"button\" class=\"pencraft pc-reset pencraft icon-container view-image\"><svg xmlns=\"http://www.w3.org/2000/svg\" width=\"20\" height=\"20\" viewBox=\"0 0 24 24\" fill=\"none\" stroke=\"currentColor\" stroke-width=\"2\" stroke-linecap=\"round\" stroke-linejoin=\"round\" class=\"lucide lucide-maximize2 lucide-maximize-2\"><polyline points=\"15 3 21 3 21 9\"></polyline><polyline points=\"9 21 3 21 3 15\"></polyline><line x1=\"21\" x2=\"14\" y1=\"3\" y2=\"10\"></line><line x1=\"3\" x2=\"10\" y1=\"21\" y2=\"14\"></line></svg></button></div></div></div></a></figure></div><div class=\"captioned-image-container\"><figure><a class=\"image-link image2 is-viewable-img\" target=\"_blank\" href=\"https://substackcdn.com/image/fetch/$s_!VBiZ!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F63c8260b-fa89-4405-8cfd-f436383aef94_1200x1200.jpeg\" data-component-name=\"Image2ToDOM\"><div class=\"image2-inset\"><picture><source type=\"image/webp\" srcset=\"https://substackcdn.com/image/fetch/$s_!VBiZ!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F63c8260b-fa89-4405-8cfd-f436383aef94_1200x1200.jpeg 424w, https://substackcdn.com/image/fetch/$s_!VBiZ!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F63c8260b-fa89-4405-8cfd-f436383aef94_1200x1200.jpeg 848w, https://substackcdn.com/image/fetch/$s_!VBiZ!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F63c8260b-fa89-4405-8cfd-f436383aef94_1200x1200.jpeg 1272w, https://substackcdn.com/image/fetch/$s_!VBiZ!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F63c8260b-fa89-4405-8cfd-f436383aef94_1200x1200.jpeg 1456w\" sizes=\"100vw\"><img src=\"https://substackcdn.com/image/fetch/$s_!VBiZ!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F63c8260b-fa89-4405-8cfd-f436383aef94_1200x1200.jpeg\" width=\"282\" height=\"282\" data-attrs=\"{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/63c8260b-fa89-4405-8cfd-f436383aef94_1200x1200.jpeg&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:1200,&quot;width&quot;:1200,&quot;resizeWidth&quot;:282,&quot;bytes&quot;:167006,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/jpeg&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://markrubin.substack.com/i/212517182?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F63c8260b-fa89-4405-8cfd-f436383aef94_1200x1200.jpeg&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}\" class=\"sizing-normal\" alt=\"\" srcset=\"https://substackcdn.com/image/fetch/$s_!VBiZ!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F63c8260b-fa89-4405-8cfd-f436383aef94_1200x1200.jpeg 424w, https://substackcdn.com/image/fetch/$s_!VBiZ!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F63c8260b-fa89-4405-8cfd-f436383aef94_1200x1200.jpeg 848w, https://substackcdn.com/image/fetch/$s_!VBiZ!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F63c8260b-fa89-4405-8cfd-f436383aef94_1200x1200.jpeg 1272w, https://substackcdn.com/image/fetch/$s_!VBiZ!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F63c8260b-fa89-4405-8cfd-f436383aef94_1200x1200.jpeg 1456w\" sizes=\"100vw\" loading=\"lazy\"></picture><div class=\"image-link-expand\"><div class=\"pencraft pc-display-flex pc-gap-8 pc-reset\"><button tabindex=\"0\" type=\"button\" class=\"pencraft pc-reset pencraft icon-container restack-image\"><svg aria-hidden=\"true\" width=\"20\" height=\"20\" viewBox=\"0 0 20 20\" fill=\"none\" stroke-width=\"1.5\" stroke=\"var(--color-fg-primary)\" stroke-linecap=\"round\" stroke-linejoin=\"round\" xmlns=\"http://www.w3.org/2000/svg\"><g><path d=\"M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882\"></path></g></svg></button><button tabindex=\"0\" type=\"button\" class=\"pencraft pc-reset pencraft icon-container view-image\"><svg xmlns=\"http://www.w3.org/2000/svg\" width=\"20\" height=\"20\" viewBox=\"0 0 24 24\" fill=\"none\" stroke=\"currentColor\" stroke-width=\"2\" stroke-linecap=\"round\" stroke-linejoin=\"round\" class=\"lucide lucide-maximize2 lucide-maximize-2\"><polyline points=\"15 3 21 3 21 9\"></polyline><polyline points=\"9 21 3 21 3 15\"></polyline><line x1=\"21\" x2=\"14\" y1=\"3\" y2=\"10\"></line><line x1=\"3\" x2=\"10\" y1=\"21\" y2=\"14\"></line></svg></button></div></div></div></a><figcaption class=\"image-caption\">Yong Cai</figcaption></figure></div><p>Cai et al. conclude:</p><blockquote><p>Our results show that it is important to understand <em>p</em>-hacking in the context of the selection environment that produced it. That <em>p</em>-hacking could mitigate the effects of publication bias under extreme selection also hints at a self-correcting tendency in the scientific process.</p></blockquote><div class=\"callout-block\" data-callout=\"true\"><p><span>Cai, Y., Pernoud, A., &amp; Xu, B. (2026). Does </span><em><span>p</span></em><span>-hacking mitigate or exacerbate the effects of publication bias? </span><em><span>ArXiv</span></em><span>. </span><a href=\"https://doi.org/10.48550/arXiv.2609.05372\"><span>https://doi.org/10.48550/arXiv.2609.05372</span></a></p></div><div class=\"captioned-image-container\"><figure><a class=\"image-link image2\" target=\"_blank\" href=\"https://substackcdn.com/image/fetch/$s_!QRuO!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F864e527e-11a3-4cc1-8f4d-85fe9f0d6198_935x8.png\" data-component-name=\"Image2ToDOM\"><div class=\"image2-inset\"><picture><source type=\"image/webp\" srcset=\"https://substackcdn.com/image/fetch/$s_!QRuO!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F864e527e-11a3-4cc1-8f4d-85fe9f0d6198_935x8.png 424w, https://substackcdn.com/image/fetch/$s_!QRuO!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F864e527e-11a3-4cc1-8f4d-85fe9f0d6198_935x8.png 848w, https://substackcdn.com/image/fetch/$s_!QRuO!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F864e527e-11a3-4cc1-8f4d-85fe9f0d6198_935x8.png 1272w, https://substackcdn.com/image/fetch/$s_!QRuO!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F864e527e-11a3-4cc1-8f4d-85fe9f0d6198_935x8.png 1456w\" sizes=\"100vw\"><img src=\"https://substackcdn.com/image/fetch/$s_!QRuO!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F864e527e-11a3-4cc1-8f4d-85fe9f0d6198_935x8.png\" width=\"935\" height=\"8\" data-attrs=\"{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/864e527e-11a3-4cc1-8f4d-85fe9f0d6198_935x8.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:8,&quot;width&quot;:935,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:null,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:null,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:null,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}\" class=\"sizing-normal\" alt=\"\" srcset=\"https://substackcdn.com/image/fetch/$s_!QRuO!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F864e527e-11a3-4cc1-8f4d-85fe9f0d6198_935x8.png 424w, https://substackcdn.com/image/fetch/$s_!QRuO!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F864e527e-11a3-4cc1-8f4d-85fe9f0d6198_935x8.png 848w, https://substackcdn.com/image/fetch/$s_!QRuO!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F864e527e-11a3-4cc1-8f4d-85fe9f0d6198_935x8.png 1272w, https://substackcdn.com/image/fetch/$s_!QRuO!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F864e527e-11a3-4cc1-8f4d-85fe9f0d6198_935x8.png 1456w\" sizes=\"100vw\" loading=\"lazy\"></picture><div></div></div></a></figure></div><p class=\"button-wrapper\" data-attrs=\"{&quot;url&quot;:&quot;https://markrubin.substack.com/subscribe?&quot;,&quot;text&quot;:&quot;Subscribe now&quot;,&quot;action&quot;:null,&quot;class&quot;:null}\" data-component-name=\"ButtonCreateButton\"><a class=\"button primary\" href=\"https://markrubin.substack.com/subscribe?\"><span>Subscribe now</span></a></p><p class=\"button-wrapper\" data-attrs=\"{&quot;url&quot;:&quot;https://markrubin.substack.com/p/is-replication-rare-registered-report?utm_source=substack&utm_medium=email&utm_content=share&action=share&quot;,&quot;text&quot;:&quot;Share&quot;,&quot;action&quot;:null,&quot;class&quot;:null}\" data-component-name=\"ButtonCreateButton\"><a class=\"button primary\" href=\"https://markrubin.substack.com/p/is-replication-rare-registered-report?utm_source=substack&utm_medium=email&utm_content=share&action=share\"><span>Share</span></a></p>","doi":"https://doi.org/10.59350/fsrdg-q0q44","guid":"212517182","image":"https://substackcdn.com/image/fetch/$s_!M-CA!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F22c27cee-2a5d-43b7-9ca2-5e924e2f80df_1124x539.png","language":"en","license":"https://creativecommons.org/licenses/by/4.0/legalcode","published_at":1788739200,"rid":"ny7yq-zsf22","summary":"Critical Metascience","tags":["Replication Crisis","Critical Metascience","TOP2025","Metascience","Publication Bias"],"title":"Is Replication Rare? \ud83d\udd38 Registered Report Timelines \ud83d\udd38 Open Science and Trust \ud83d\udd38 P-Hacking and Publication Bias","updated_at":1788852608,"url":"https://markrubin.substack.com/p/is-replication-rare-registered-report","version":"v1"}},{"document":{"authors":[{"affiliation":[{"id":"https://ror.org/046ak2485","name":"Freie Universit\u00e4t Berlin"}],"contributor_roles":[],"family":"Fischer","given":"Georg","url":"https://orcid.org/0000-0001-5620-5759"}],"blog":{"authors":null,"community_id":"52aefd81-f405-4349-b080-754395a5d8b2","created":1694476800,"current_feed_url":null,"description":null,"doi":"https://doi.org/10.59350/oaberlin","favicon":"https://rogue-scholar.org/api/communities/52aefd81-f405-4349-b080-754395a5d8b2/logo","feed_format":"application/atom+xml","feed_url":"https://blogs.fu-berlin.de/open-research-berlin/feed/atom/","filter":null,"generator":"WordPress","home_page_url":"https://blogs.fu-berlin.de/open-research-berlin","issn":null,"language":"deu","license":"https://creativecommons.org/licenses/by/4.0/legalcode","prefix":"10.59350","relative_url":null,"secure":true,"slug":"oaberlin","status":"active","subfield":"1802","title":"Open Research Blog Berlin","updated":1788851356,"use_api":true},"blog_name":"Open Research Blog Berlin","blog_slug":"oaberlin","content_html":"<p>Unsere monatliche Rubrik zu aktuellen Veranstaltungen rund um Open Research.</p>\n<pre>Anmerkung zu dieser Rubrik: Das Open Research Office Berlin erstellt monatlich eine \u00dcbersicht \u00fcber Termine und Veranstaltungen zu Open Access und Open Research in Berlin bzw. an Berliner Einrichtungen. Der Fokus liegt dabei auf unseren Partnereinrichtungen und auf Veranstaltungen, die sich an die \u00d6ffentlichkeit richten bzw. die offen sind f\u00fcr Angeh\u00f6rige der Wissenschafts- und Kulturerbeeinrichtungen in Berlin. Wir erg\u00e4nzen diese Liste gerne (Info bitte via <a href=\"mailto:team@open-research-berlin.de\">Mail</a> ans OROB).</pre>\n<p><!--more--></p>\n<h2>31. August, KI-assistierte Datenarbeit in GLAM-Einrichtungen, online</h2>\n<p><em>LLMs k\u00f6nnen die Nutzung fortgeschrittener Funktionen und Tools erleichtern oder \u00fcberhaupt erst erm\u00f6glichen. Sie helfen dabei, anspruchsvolle Excel-Funktionen zu schreiben, SQL- und SPARQL-Queries zu formulieren, mit komplexen regul\u00e4ren Ausdr\u00fccken zu arbeiten, Dateien \u00fcber die Kommandozeile zu verwalten oder kleine Code-Schnipsel zu generieren. LLMs k\u00f6nnen z.B. auch in OpenRefine eingebunden werden und bei der Strukturierung von Information helfen. LLMs k\u00f6nnen hier helfen, es bedarf jedoch grundlegender Kenntnisse der zu Gebote stehenden Werkzeuge. Dar\u00fcber soll im Workshop gesprochen werden. Ebenso werden wir uns \u00fcber die Grenzen und Risiken des Einsatzes von LLMs unterhalten.</em></p>\n<ul>\n<li><strong>Termin: </strong>31.08.2026, 10:00 bis 13:00 Uhr, online via Zoom</li>\n<li><strong>Organisiert von</strong>: digiS Berlib; Referent: Alexander Winkler</li>\n<li>[<a href=\"https://www.digis-berlin.de/machine-learning-montag-iii-am-31-august-ki-assistierte-datenarbeit-in-glam-einrichtungen/\">Information und Anmeldung</a>]</li>\n</ul>\n<h2>3.-4. September, Forschungsdatenmanagement und Open Science in den qualitativen Sozialwissenschaften, online</h2>\n<p><em>Dieser Workshop zielt darauf ab, in die besonderen ethischen, rechtlichen und praktischen Herausforderungen im Management qualitativer Forschungsdaten einzuf\u00fchren \u2013 z. B. in Bezug auf Datenschutz, informierte Einwilligung, Anonymisierung, Dokumentation und Data Sharing \u2013 und zeigt dabei bew\u00e4hrte Praktiken sowie Beispiele f\u00fcr ein erfolgreiches FDM auf. Die Veranstaltung richtet sich insbesondere an Sozialwissenschaftler*innen, die mit qualitativen Methoden und Daten arbeiten.</em></p>\n<ul>\n<li><strong>Termin: </strong>03.-04.09.2026, online</li>\n<li><strong>Organisiert von</strong>: FID Soziologie (SocioHub) und Qualiservice; Vortragende: Dr. Viola Logemann und Dr. Greta Hartmann</li>\n<li>[<a href=\"https://www.sociohub-fid.de/p/Veranstaltungen\">Information und Anmeldung</a>]</li>\n</ul>\n<h2>3. September, Sind wir im Kulturbereich eigentlich noch digital souver\u00e4n?, Berliner Museumsinsel</h2>\n<p><em>Die Kultur im KI-Zeitalter. Wird der Traum vom niedrigschwelligen digitalen Zugang zu Bibliotheken, Archiven und Museen nun Realit\u00e4t \u2013 oder entstehen neue Abh\u00e4ngigkeiten? Und welche Verantwortung tragen Staat, Kulturinstitutionen und die gro\u00dfen Technologieunternehmen?</em></p>\n<ul>\n<li><strong>Termin: </strong>03.09.2026, 17:00 Uhr, James-Simon-Galerie, Bodestra\u00dfe 1\u20133, 10178 Berlin (Museumsinsel)</li>\n<li><strong>Organisiert von</strong>: Stiftung Preu\u00dfischer Kulturbesitz, der Deutsche Kulturrat und 3sat</li>\n<li>[<a href=\"https://www.preussischer-kulturbesitz.de/meldung/artikel/2026/09/03/sind-wir-im-kulturbereich-eigentlich-noch-digital-souveraen.html\">Information und Anmeldung</a>]</li>\n</ul>\n<h2>3. September, Wissenschaftspolitisches Wahlforum der GEW Berlin, HU Berlin</h2>\n<p><em>Wie geht es weiter mit den Berliner Hochschulen? Welche wissenschaftspolitischen Schwerpunkte setzen die Parteien nach der Abgeordnetenhauswahl? Und wie wollen sie gute Arbeits- und Studienbedingungen sowie eine zukunftsf\u00e4hige Hochschullandschaft sichern? Vertreter*innen der demokratischen Parteien im Berliner Abgeordnetenhaus diskutieren ihre Konzepte f\u00fcr die n\u00e4chste Legislaturperiode und stellen sich den Fragen aus Wissenschaft und Hochschule.</em></p>\n<ul>\n<li><strong>Termin: </strong>03.09.2026, 19:00 bis 21:30 Uhr, Senatssaal der HU Berlin, Unter den Linden 6, 10099 Berlin</li>\n<li><strong>Organisiert von</strong>: Gewerkschaft f\u00fcr Erziehung und Wissenschaft (GEW)</li>\n<li>[<a href=\"https://www.gew-berlin.de/veranstaltungen/detailseite/wissenschaftspolitisches-wahlforum-der-gew-berlin\">Information und Anmeldung</a>]</li>\n</ul>\n<h2>10. September, Open Research in History, Cultural Heritage and the Humanities, online</h2>\n<p>The webinar brings together three scholars whose work engages critically and theoretically with openness in history, cultural heritage and the humanities, addressing questions of data governance, research reproducibility, open infrastructures, and the epistemological challenges of working with historical and cultural heritage data. While the emphasis is on theoretical and conceptual perspectives, the presentations also draw on examples and case studies from the speakers' own research. We see this webinar as a space to think together about the tensions and opportunities of openness in the humanities: not only what open research standards call for, but what they mean in practice for historical and heritage scholarship, where sources, data and interpretation are entangled in particular ways.</p>\n<ul>\n<li><strong>Termin: </strong>10.09.2026, 15:00 bis 16:30 Uhr, online via Zoom</li>\n<li><strong>Organisiert von</strong>: Humanities, Data Science &amp; Methodology, TU Darmstadt (HDSM)</li>\n<li>[<a href=\"https://hdsm.hypotheses.org/8122\">Information und Anmeldung</a>]</li>\n</ul>\n<h2>11.-13. September, Berlin FediDay, c-base Berlin</h2>\n<p><em>Vielleicht bist Du bereits auf Mastodon, Pixelfed oder PeerTube unterwegs. Vielleicht entwickelst Du selbst Anwendungen oder besch\u00e4ftigst Dich mit dezentralen sozialen Netzen aus aktivistischen Gr\u00fcnden, in der Forschung oder als Verbreitungsweg f\u00fcr Deine Kunst. Egal, ob Du Poweruser bist oder komplett #neuhier: Das Programm bietet vom Einsteigerworkshop bis zu Panels und Party alles, was zu einer guten Hackerkonferenz dazugeh\u00f6rt.</em></p>\n<ul>\n<li><strong>Termin: </strong>11.-13.09.2026, c-base Berlin</li>\n<li><strong>Organisiert von</strong>: digiGes, c-base und Freund*innen</li>\n<li>[<a href=\"https://berlinfedi.day/\">Information und Anmeldung</a>]</li>\n</ul>\n<h2>21.-22. September, Beyond the Book: Digital Research, Presentation, and Sustainability, FU Berlin</h2>\n<p><em>This 1.5-day workshop explores how digital research, particularly in the context of non-Latin script languages, can move beyond the constraints of traditional scholarly formats. While books and articles remain central to academic knowledge production, many forms of computational research generate data, models, workflows, and analytical results that cannot be adequately represented through static text, images, or tables alone.</em></p>\n<ul>\n<li><strong>Termin: </strong>21.-22.09.2026, Freie Universit\u00e4t Berlin, Otto-von-Simson-Stra\u00dfe 7, 14195 Berlin</li>\n<li><strong>Organisiert von</strong>: Projekt Closing the Gap in Non-Latin Script Data</li>\n<li>[<a href=\"https://www.berlin-university-alliance.de/en/commitments/research-quality/events/2026/20260921-workshop-beyond-books.html\">Information und Anmeldung</a>]</li>\n</ul>\n<h2>23. September, Nicht per\u00adfekt. Aber lern\u00adf\u00e4\u00adhig. Fehlerkultur als Grundlage f\u00fcr neue Entwicklungen im Bibliothekswesen, Bezirkszentralbibliothek Pablo Neruda</h2>\n<p><em>Bibliotheken stehen mitten im Spannungsfeld aus Digitalisierung, KI und gesellschaftlichem Wandel. Doch genauso herausfordernd wie neue Technologien ist der Umgang mit dem eigenen Handeln \u2013 mit Erfolgen, aber vor allem auch mit Fehlentscheidungen. Diese Veranstaltung l\u00e4dt dazu ein, genau dort hinzuschauen: Wie k\u00f6nnen wir aus Erfahrungen \u2013 inklusive Scheitern \u2013 lernen, um aktiv die Zukunft von Bibliotheken zu gestalten?</em></p>\n<ul>\n<li><strong>Termin: </strong>23.09.2026, 11:00 bis 17:00 Uhr, Bezirkszentralbibliothek Pablo Neruda, WerkRaum, Frankfurter Allee 14 A, 10247 Berlin Friedrichshain-Kreuzberg</li>\n<li><strong>Organisiert von</strong>: TH Wildau, Berliner Arbeitskreis Information (BAK) und Deutscher Bibliotheksverband (dbv)</li>\n<li>[<a href=\"https://www.bibliotheksverband.de/nicht-perfekt-aber-lernfaehig\">Information und Anmeldung</a>]</li>\n</ul>\n<h2>24. September, Library Carpentries workshop on Open Source Hardware, HU Berlin</h2>\n<p>Interested in open source and open science? Looking to improve your open science training curriculum?\u00a0Join us for an in-person workshop to test a new Library Carpentries course on open source hardware in research settings, and give feedback on how to make it more useful for you.</p>\n<ul>\n<li><strong>Termin: </strong>24.09.2026, 9:00 bis 12:00 Uhr, Jacob-und-Wilhelm-Grimm-Zentrum library, Humboldt-Universit\u00e4t zu Berlin, Geschwister-Scholl-Stra\u00dfe 1/3, 10117 Berlin</li>\n<li><strong>Organisiert von</strong>: Pen-Yuan Hsing</li>\n<li>[<a href=\"https://events.tu-berlin.de/en/events/01a03e23-b54f-7ec8-b7a4-a0b535804379\">Information und Anmeldung</a>]</li>\n</ul>\n<h2>28.-30. September, Open-Access-Tage, Linz (\u00d6sterreich)</h2>\n<p><em>Die Open-Access-Tage sind die zentrale j\u00e4hrliche Konferenz zum Thema Open Access im deutschsprachigen Raum. Sie richtet sich an alle, die sich intensiv mit den M\u00f6glichkeiten, Bedingungen und Perspektiven des wissenschaftlichen Publizierens befassen. Dazu geh\u00f6ren Wissenschaftler*innenInnen sowie Mitarbeiter*innenInnen von Bibliotheken und anderen Einrichtungen der Wissenschaftsinfrastruktur ebenso wie Mitglieder der Wissenschaftsadministration und Verlage.</em></p>\n<ul>\n<li><strong>Termin: </strong>28.-30.09.2026, Johannes Kepler Universit\u00e4t Linz</li>\n<li><strong>Organisiert von</strong>: Programm- und Ortskommitees der OAT (<a href=\"https://open-access-tage.de/open-access-tage-2026-linz/default-5569ab164b0e3da842edfabdd52a27c8\">\u00dcbersicht</a>)</li>\n<li>[<a href=\"https://open-access-tage.de/open-access-tage-2026-linz\">Information und Anmeldung</a>]</li>\n</ul>\n<p>weiter zu <a href=\"https://blogs.fu-berlin.de/open-research-berlin/2026/09/01/veranstaltungshinweise-oktober-2026/\">Oktober 2026</a></p>","doi":"https://doi.org/10.59350/7147g-z9s75","guid":"https://blogs.fu-berlin.de/open-research-berlin/?p=4271","language":"de","license":"https://creativecommons.org/licenses/by/4.0/legalcode","published_at":1786924800,"rid":"tj4rj-qf489","summary":"Unsere monatliche Rubrik zu aktuellen Veranstaltungen rund um Open Research. Anmerkung zu dieser Rubrik: Das Open Research Office Berlin erstellt monatlich eine \u00dcbersicht \u00fcber Termine und Veranstaltungen zu Open Access und Open Research in Berlin bzw. an Berliner Einrichtungen.","tags":["Allgemein","Veranstaltungshinweise"],"title":"Veranstaltungshinweise September 2026","updated_at":1788852607,"url":"https://blogs.fu-berlin.de/open-research-berlin/2026/08/17/veranstaltungshinweise-september-2026/","version":"v1"}},{"document":{"authors":[{"contributor_roles":[],"family":"Hare","given":"Maddie"}],"blog":{"authors":[{"name":"Bibliomagician Staff"}],"community_id":"f5c1522e-c8de-4681-a317-e32ddb61b26a","created":1780876800,"current_feed_url":null,"description":"Comment & practical guidance from the LIS-Bibliometrics community","doi":"https://doi.org/10.59350/bibliomagician","favicon":"https://rogue-scholar.org/api/communities/f5c1522e-c8de-4681-a317-e32ddb61b26a/logo","feed_format":"application/atom+xml","feed_url":"https://thebibliomagician.wordpress.com/feed/atom","filter":null,"generator":"WordPress.com","home_page_url":"https://thebibliomagician.wordpress.com","issn":null,"language":"eng","license":"https://creativecommons.org/licenses/by/4.0/legalcode","prefix":"10.59350","relative_url":null,"secure":true,"slug":"bibliomagician","status":"active","subfield":"3309","title":"The Bibliomagician","updated":1788797687,"use_api":true},"blog_name":"The Bibliomagician","blog_slug":"bibliomagician","content_html":"<p class=\"wp-block-paragraph\"><em>Nathalie Corn\u00e9e &amp; Kat Hart</em></p>\n\n\n\n<p class=\"has-text-align-justify wp-block-paragraph\"><em>Citations aren&#8217;t the only way research shows up in policy. Sometimes it&#8217;s a named researcher, a nod to &#8220;the evidence,&#8221; or a reference tucked into the text with no formal citation at all. Kat Hart and Nathalie Corn\u00e9e dug into Overton&#8217;s data to find out how often that happens, and what it means for how we understand research&#8217;s reach into policy.</em></p>\n\n\n\n<p class=\"has-text-align-justify wp-block-paragraph\">When we want to know if research has influenced policy, we usually turn to citations. They&#8217;re easy to spot and easy to count, so it makes sense that they&#8217;ve become the go-to signal for research influence.</p>\n\n\n\n<p class=\"has-text-align-justify wp-block-paragraph\">But citations are only <em>part</em> of the story. Policymakers don&#8217;t always follow academic conventions. Sometimes they name a researcher directly, reference a report rather than the paper behind it, or they simply gesture at &#8220;the evidence&#8221; without pointing to anything specific at all.</p>\n\n\n\n<p class=\"has-text-align-justify wp-block-paragraph\">So, we set out to ask a simple question: if we look past formal citations, what else might be going on? Using Overton&#8217;s data, we compared the scale of formal citations against these more informal mentions and tried to get a sense of what the gap between them might look like. This is an exploratory pilot rather than a definitive study, as the sample is far too small to draw firm conclusions. We hope its value lies more in how it reframes the question of what counts as 'research engaging with policy' (and vice versa) in the first place.</p>\n\n\n\n<h1 class=\"wp-block-heading\">Why this matters right now</h1>\n\n\n\n<p class=\"has-text-align-justify wp-block-paragraph\">Definitions of research impact are shifting. A <a href=\"https://blogs.lse.ac.uk/impactofsocialsciences/2026/03/23/we-should-focus-less-on-research-impact-and-more-on-research-value/\">recent Australian study</a> published on LSE's impact blog made a useful point on this: institutional definitions of impact often don&#8217;t match how researchers actually work (O'Connor et al., 2026). Instead of asking &#8220;did this have impact?&#8221;, the authors suggest asking &#8220;what value does this create, and for whom?&#8221; It&#8217;s a small shift in framing, but it moves the conversation from proving impact to understanding it.</p>\n\n\n\n<blockquote class=\"wp-block-quote is-layout-flow wp-block-quote-is-layout-flow\">\n<p class=\"wp-block-paragraph\">If citation counts alone don&#8217;t capture the full picture, what other signals should we be paying attention to?</p>\n</blockquote>\n\n\n\n<h1 class=\"wp-block-heading\">How we approached it</h1>\n\n\n\n<p class=\"has-text-align-justify wp-block-paragraph\">We used the <a href=\"https://www.overton.io/overton-index\">Overton Index</a> as our starting point. At the time of the study, Overton indexed over 27 million policy documents from more than 190 countries and 3,100 sources, spanning everything from intergovernmental organisations like the UN and WHO to NGOs, think tanks, national governments, as well as regional and local bodies like Canadian provinces and UK devolved nations.</p>\n\n\n\n<p class=\"has-text-align-justify wp-block-paragraph\">For the pilot itself, we kept things deliberately focused. We took a random sample of 50 UK government policy documents from 2025 and used Overton&#8217;s AI classification to pull out document type, length, and authorship. Then came the manual part: we&nbsp;read and coded every single document by hand.</p>\n\n\n\n<p class=\"has-text-align-justify wp-block-paragraph\">This was a conscious choice. Automated tools are good at catching formal citations, but they miss the less obvious ways research shows up in policy text. We wanted to capture all of it, so we built a coding framework covering two broad categories:</p>\n\n\n\n<ol start=\"1\" class=\"wp-block-list\">\n<li><strong>Objects</strong>: the types of evidence referenced, such as peer-reviewed publications, policy evidence, or informal knowledge transmission material like blog posts and policy briefs.</li>\n\n\n\n<li><strong>Actors:</strong> the people and organisations referenced, such as research organisations, named researchers, funders, or in-house policy experts.</li>\n</ol>\n\n\n<div class=\"wp-block-image\">\n<figure class=\"aligncenter size-large is-resized\"><img data-attachment-id=\"5650\" data-permalink=\"https://thebibliomagician.wordpress.com/2026/09/07/cited-or-mentioned-what-we-learned-about-how-research-actually-shows-up-in-policy/image-29/\" data-orig-file=\"https://thebibliomagician.wordpress.com/wp-content/uploads/2026/09/image.png\" data-orig-size=\"770,723\" data-comments-opened=\"1\" data-image-meta=\"{&quot;aperture&quot;:&quot;0&quot;,&quot;credit&quot;:&quot;&quot;,&quot;camera&quot;:&quot;&quot;,&quot;caption&quot;:&quot;&quot;,&quot;created_timestamp&quot;:&quot;0&quot;,&quot;copyright&quot;:&quot;&quot;,&quot;focal_length&quot;:&quot;0&quot;,&quot;iso&quot;:&quot;0&quot;,&quot;shutter_speed&quot;:&quot;0&quot;,&quot;title&quot;:&quot;&quot;,&quot;orientation&quot;:&quot;0&quot;,&quot;alt&quot;:&quot;&quot;}\" data-image-title=\"image\" data-image-description=\"\" data-image-caption=\"\" data-large-file=\"https://thebibliomagician.wordpress.com/wp-content/uploads/2026/09/image.png?w=770\" loading=\"lazy\" width=\"770\" height=\"723\" src=\"https://thebibliomagician.wordpress.com/wp-content/uploads/2026/09/image.png?w=770\" alt=\"\" class=\"wp-image-5650\" style=\"aspect-ratio:1.0650338254900993;width:444px;height:auto\" srcset=\"https://thebibliomagician.wordpress.com/wp-content/uploads/2026/09/image.png 770w, https://thebibliomagician.wordpress.com/wp-content/uploads/2026/09/image.png?w=150 150w, https://thebibliomagician.wordpress.com/wp-content/uploads/2026/09/image.png?w=300 300w\" sizes=\"auto, (max-width: 770px) 100vw, 770px\" /></figure>\n</div>\n\n\n<p class=\"has-text-align-center wp-block-paragraph\"><em>Figure 1. Workflow for identifying and classifying attention to actors and objects in UK government policy documents.</em></p>\n\n\n\n<p class=\"has-text-align-justify wp-block-paragraph\">For each one, we recorded whether it was a <strong>citation</strong> (a formal, traceable reference) or a <strong>mention</strong> (an informal acknowledgement with no formal citation attached). Where a document referenced several things together, we logged each one individually rather than lumping them into a single entry. Across just 50 documents, that added up to over 2,200 individual references, which gave us plenty to work with despite the small sample size.</p>\n\n\n\n<h1 class=\"wp-block-heading\">What we found</h1>\n\n\n\n<h2 class=\"wp-block-heading\">Policy talks to policy more than it talks to academic research</h2>\n\n\n\n<p class=\"has-text-align-justify wp-block-paragraph\">Across our sample, we identified 2,244 objects and actors in total. Policy actors (think tanks, government bodies, IGOs) and policy evidence (past reports, transcripts, consultation outputs) were by far the most common categories in our data, together with in-house research accounting for around 75% of everything referenced.</p>\n\n\n\n<p class=\"has-text-align-justify wp-block-paragraph\">Peer-reviewed publications, by comparison, made up just under 5% of all references. Generic, non-specific nods to &#8220;experts&#8221; or &#8220;previous research&#8221; &nbsp;outnumbered them, at around 9%. In other words, plenty of documents acknowledge that evidence exists somewhere, without pointing to anything specific.</p>\n\n\n\n<h2 class=\"wp-block-heading\">Citations and mentions tell different stories depending on what&#8217;s being referenced.</h2>\n\n\n\n<p class=\"has-text-align-justify wp-block-paragraph\">Peer-reviewed articles were the type of evidence most likely to receive a full, formal citation. Commissioned research told a different story: it often got absorbed into the narrative (&#8220;the data suggests&#8221;, &#8220;interviews found&#8221;) with no formal attribution at all. Policy outputs sat somewhere in between, appearing as both citations and mentions in meaningful numbers.</p>\n\n\n\n<p class=\"has-text-align-justify wp-block-paragraph\">Across the whole sample, mentions were consistently more common than citations.</p>\n\n\n\n<h2 class=\"wp-block-heading\">Who wrote the document matters as much as what it says</h2>\n\n\n\n<p class=\"has-text-align-justify wp-block-paragraph\">Referencing patterns varied a lot depending on who authored the document. Our five most prolific authors in the sample were the Department for Education, the Law Commission, UK Government more broadly, the Ministry of Justice, and the Department for Environment, Food and Rural Affairs (DEFRA) together with the Animal and Plant Health Agency (APHA). Each had a distinct pattern of what they referenced and how often.</p>\n\n\n\n<p class=\"has-text-align-justify wp-block-paragraph\">A working paper from the Foreign and Commonwealth Office, written by commissioned academics, leaned heavily on peer-reviewed citations, as you&#8217;d expect. A similar paper from Technopolis, a consultancy commissioned by the Department for Science, Innovation and Technology (DSIT), leaned instead on funder acknowledgements and commissioned research. Same document type, same broad government context, very different citation behaviour.</p>\n\n\n\n<h2 class=\"wp-block-heading\">Longer documents don&#8217;t necessarily cite more</h2>\n\n\n\n<p class=\"has-text-align-justify wp-block-paragraph\">We also tested the intuitive assumption that longer documents would contain more citations. They don&#8217;t, at least not cleanly. Some of the highest citation counts did appear in longer documents, but plenty of short documents cited heavily too, and plenty of long ones cited very little. There&#8217;s no straightforward relationship between page count and citation volume in this sample.</p>\n\n\n\n<h2 class=\"wp-block-heading\">Even formal citations don&#8217;t always make it into a bibliography</h2>\n\n\n\n<p class=\"has-text-align-justify wp-block-paragraph\">Most documents in our sample didn&#8217;t have a formal bibliography at all, relying on footnotes instead. And even where a reference qualified as a formal citation, it only had roughly a 50/50 chance of actually appearing in a bibliography rather than just the body text. Citation habits clearly vary a lot from one policymaker to another.</p>\n\n\n\n<p class=\"has-text-align-justify wp-block-paragraph\">The research being cited mostly comes from a small number of places</p>\n\n\n\n<p class=\"has-text-align-justify wp-block-paragraph\">Of the peer-reviewed research we identified, half came from UK universities alone, 43% came from international institutions, and the rest reflected UK and international collaborations.</p>\n\n\n\n<h2 class=\"wp-block-heading\">What this means</h2>\n\n\n\n<p class=\"wp-block-paragraph\">A few things stood out consistently across the sample:</p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>Policy actors and policy evidence dominate what gets referenced in policy documents, well ahead of peer-reviewed academic research.</li>\n\n\n\n<li>Some documents and document types are far richer sources of citations than others, and a handful of outliers account for a disproportionate share of all references.</li>\n\n\n\n<li>Mentions turned out to be the more common form of attention across nearly all reference types.</li>\n</ul>\n\n\n\n<p class=\"has-text-align-justify wp-block-paragraph\">Taken together, these early findings suggest that citation counts alone may only capture <em>a part</em> of how research reaches policy.</p>\n\n\n\n<p class=\"has-text-align-justify wp-block-paragraph\">Where we think this work is genuinely useful is in how it reframes the question. Right now, most tools only ask <em>whether</em> a policy document cited a piece of research or not. Splitting that into citations and mentions lets us ask a more useful question: <em>how is research actually showing up, even when there&#8217;s no formal reference at all?</em> That feels like a real gap worth exploring.</p>\n\n\n\n<p class=\"has-text-align-justify wp-block-paragraph\">The coding framework itself, sorting references into different types of evidence and different types of actors, and tagging each one as a citation or a mention, is a first step towards making that visible. It gives us a way to describe the kinds of engagement that citation counts alone may miss, so it&#8217;s a starting point for more work.</p>\n\n\n\n<p class=\"has-text-align-justify wp-block-paragraph\">This also fits with a broader pattern often noted in research impact literature: that scholarly expertise tends to reach policy indirectly, through reviews, consultations, and expert commentary, rather than through direct citation. That raises a genuinely open question: how much of what we&#8217;re seeing is a passing reference, and how much reflects real engagement with the research itself?</p>\n\n\n\n<blockquote class=\"wp-block-quote is-layout-flow wp-block-quote-is-layout-flow\">\n<blockquote class=\"wp-block-quote is-layout-flow wp-block-quote-is-layout-flow\">\n<p class=\"wp-block-paragraph\">Being able to tell the difference matters if we want to understand not just whether research is being used, but how and why. </p>\n</blockquote>\n</blockquote>\n\n\n\n<h2 class=\"wp-block-heading\">Where we go from here</h2>\n\n\n\n<p class=\"wp-block-paragraph\"><a id=\"_msocom_1\"></a></p>\n\n\n\n<p class=\"has-text-align-justify wp-block-paragraph\">This was a small, exploratory pilot, and we&#8217;re upfront about its limits. Fifty documents from one country over one year is a start, not a conclusion.</p>\n\n\n\n<p class=\"has-text-align-justify wp-block-paragraph\">Next, we&#8217;d like to scale up the sample across a wider, more representative set of countries using an LLM to help with the coding. We&#8217;d also like to track whether the balance between citations and mentions is shifting over time and compare document types more systematically to understand whether citation behaviour is driven more by document function or by the authoring body. Beyond that, we want to develop ways to assess the depth of engagement behind a reference, not just whether it exists, and look at whether these patterns differ across policy domains, comparing something like health policy against education policy.</p>\n\n\n\n<p class=\"wp-block-paragraph\"><em>If you have thoughts on this work, or you&#8217;re doing something similar, we&#8217;d love to hear from you. Get in touch at</em> <a href=\"mailto:nathalie@overton.io\"><em>nathalie@overton.io</em></a> <em>or</em> <a href=\"mailto:kat@overton.io\"><em>kat@overton.io</em></a>.</p>\n\n\n\n<h1 class=\"wp-block-heading\">References</h1>\n\n\n\n<ol class=\"wp-block-list\">\n<li>O'Connor, R., Malde, S., Russell, W., &amp; Haviland, M. (2026, March 23). <em>We should focus less on research impact and more on research value</em>. LSE Impact Blog. <a href=\"https://blogs.lse.ac.uk/impactofsocialsciences/2026/03/23/we-should-focus-less-on-research-impact-and-more-on-research-value/\">https://blogs.lse.ac.uk/impactofsocialsciences/2026/03/23/we-should-focus-less-on-research-impact-and-more-on-research-value/</a></li>\n</ol>\n\n\n\n<h1 class=\"wp-block-heading\">About the Authors</h1>\n\n\n\n<div class=\"wp-block-media-text is-stacked-on-mobile\" style=\"grid-template-columns:29% auto\"><figure class=\"wp-block-media-text__media\"><img data-attachment-id=\"5662\" data-permalink=\"https://thebibliomagician.wordpress.com/2026/09/07/cited-or-mentioned-what-we-learned-about-how-research-actually-shows-up-in-policy/nathalie/\" data-orig-file=\"https://thebibliomagician.wordpress.com/wp-content/uploads/2026/09/nathalie.png\" data-orig-size=\"704,924\" data-comments-opened=\"1\" data-image-meta=\"{&quot;aperture&quot;:&quot;0&quot;,&quot;credit&quot;:&quot;&quot;,&quot;camera&quot;:&quot;&quot;,&quot;caption&quot;:&quot;&quot;,&quot;created_timestamp&quot;:&quot;0&quot;,&quot;copyright&quot;:&quot;&quot;,&quot;focal_length&quot;:&quot;0&quot;,&quot;iso&quot;:&quot;0&quot;,&quot;shutter_speed&quot;:&quot;0&quot;,&quot;title&quot;:&quot;&quot;,&quot;orientation&quot;:&quot;0&quot;,&quot;alt&quot;:&quot;&quot;}\" data-image-title=\"Nathalie\" data-image-description=\"\" data-image-caption=\"\" data-large-file=\"https://thebibliomagician.wordpress.com/wp-content/uploads/2026/09/nathalie.png?w=704\" loading=\"lazy\" width=\"704\" height=\"924\" src=\"https://thebibliomagician.wordpress.com/wp-content/uploads/2026/09/nathalie.png?w=704\" alt=\"\" class=\"wp-image-5662 size-full\" srcset=\"https://thebibliomagician.wordpress.com/wp-content/uploads/2026/09/nathalie.png 704w, https://thebibliomagician.wordpress.com/wp-content/uploads/2026/09/nathalie.png?w=114 114w, https://thebibliomagician.wordpress.com/wp-content/uploads/2026/09/nathalie.png?w=229 229w\" sizes=\"auto, (max-width: 704px) 100vw, 704px\" /></figure><div class=\"wp-block-media-text__content\">\n<p class=\"has-text-align-justify wp-block-paragraph\"><strong>Nathalie Corn\u00e9e</strong> helps the research and policy community around the world get the most out of Overton. She joined in 2023, bringing more than 20 years of experience across the pharma, research, and academic library sectors, always focused on highlighting the significance of research and supporting the researchers behind it, including through bibliometric analysis. She takes a practical, hands-on approach to helping users find the data they need and make sense of research impact.</p>\n</div></div>\n\n\n\n<div class=\"wp-block-media-text is-stacked-on-mobile\" style=\"grid-template-columns:29% auto\"><figure class=\"wp-block-media-text__media\"><img data-attachment-id=\"5663\" data-permalink=\"https://thebibliomagician.wordpress.com/2026/09/07/cited-or-mentioned-what-we-learned-about-how-research-actually-shows-up-in-policy/kat/\" data-orig-file=\"https://thebibliomagician.wordpress.com/wp-content/uploads/2026/09/kat.png\" data-orig-size=\"200,200\" data-comments-opened=\"1\" data-image-meta=\"{&quot;aperture&quot;:&quot;0&quot;,&quot;credit&quot;:&quot;&quot;,&quot;camera&quot;:&quot;&quot;,&quot;caption&quot;:&quot;&quot;,&quot;created_timestamp&quot;:&quot;0&quot;,&quot;copyright&quot;:&quot;&quot;,&quot;focal_length&quot;:&quot;0&quot;,&quot;iso&quot;:&quot;0&quot;,&quot;shutter_speed&quot;:&quot;0&quot;,&quot;title&quot;:&quot;&quot;,&quot;orientation&quot;:&quot;0&quot;,&quot;alt&quot;:&quot;&quot;}\" data-image-title=\"Kat\" data-image-description=\"\" data-image-caption=\"\" data-large-file=\"https://thebibliomagician.wordpress.com/wp-content/uploads/2026/09/kat.png?w=200\" loading=\"lazy\" width=\"200\" height=\"200\" src=\"https://thebibliomagician.wordpress.com/wp-content/uploads/2026/09/kat.png?w=200\" alt=\"\" class=\"wp-image-5663 size-full\" srcset=\"https://thebibliomagician.wordpress.com/wp-content/uploads/2026/09/kat.png 200w, https://thebibliomagician.wordpress.com/wp-content/uploads/2026/09/kat.png?w=150 150w\" sizes=\"auto, (max-width: 200px) 100vw, 200px\" /></figure><div class=\"wp-block-media-text__content\">\n<p class=\"has-text-align-justify wp-block-paragraph\"><strong>Kat Hart </strong>is a Senior Analyst at Overton, where she curates policy data and uses bibliometrics to explore evidence-use patterns worldwide. Alongside this, she&#8217;s a PhD researcher at the University of Nottingham, studying UK water governance. She previously worked as a knowledge broker in UK higher education, focused on &#8216;what works&#8217; in connecting academic research with public policy.&nbsp;&nbsp;</p>\n</div></div>\n\n\n\n<p class=\"wp-block-paragraph\"><img data-attachment-id=\"3128\" data-permalink=\"https://thebibliomagician.wordpress.com/2019/07/10/knowledge-is-global-expanding-the-awareness-and-impact-of-research-from-the-global-south-guest-post-by-monica-ihli/c-cby-2/\" data-orig-file=\"https://thebibliomagician.wordpress.com/wp-content/uploads/2019/07/c-cby-1.png\" data-orig-size=\"88,31\" data-comments-opened=\"1\" data-image-meta=\"{&quot;aperture&quot;:&quot;0&quot;,&quot;credit&quot;:&quot;&quot;,&quot;camera&quot;:&quot;&quot;,&quot;caption&quot;:&quot;&quot;,&quot;created_timestamp&quot;:&quot;0&quot;,&quot;copyright&quot;:&quot;&quot;,&quot;focal_length&quot;:&quot;0&quot;,&quot;iso&quot;:&quot;0&quot;,&quot;shutter_speed&quot;:&quot;0&quot;,&quot;title&quot;:&quot;&quot;,&quot;orientation&quot;:&quot;0&quot;}\" data-image-title=\"C CBY\" data-image-description=\"\" data-image-caption=\"\" data-large-file=\"https://thebibliomagician.wordpress.com/wp-content/uploads/2019/07/c-cby-1.png?w=88\" loading=\"lazy\" width=\"88\" height=\"31\" class=\"wp-image-3128\" style=\"width:88px\" src=\"https://thebibliomagician.wordpress.com/wp-content/uploads/2019/07/c-cby-1.png\" alt=\"\"> Unless it states otherwise, the content of the Bibliomagician is licensed under a <a href=\"http://creativecommons.org/licenses/by/4.0/\">Creative Commons Attribution 4.0 International License</a>.</p>\n\n\n\n<p class=\"wp-block-paragraph\"><strong>DOI:</strong> <a href=\"https://doi.org/10.59350/74r3r-67451\">https://doi.org/10.59350/74r3r-67451</a></p>\n\n\n\n<p class=\"wp-block-paragraph\"></p>","doi":"https://doi.org/10.59350/a3dpx-knp02","guid":"https://thebibliomagician.wordpress.com/?p=5646","image":"https://thebibliomagician.wordpress.com/wp-content/uploads/2026/09/image.png?w=770","language":"en","license":"https://creativecommons.org/licenses/by/4.0/legalcode","published_at":1788739200,"reference":[{"id":"https://blogs.lse.ac.uk/impactofsocialsciences/2026/03/23/we-should-focus-less-on-research-impact-and-more-on-research-value/","unstructured":"O'Connor, R., Malde, S., Russell, W., & Haviland, M. (2026, March 23). We should focus less on research impact and more on research value. LSE Impact Blog."}],"rid":"xx8x7-m3t11","summary":"Nathalie Corn\u00e9e &amp; Kat Hart Citations aren't the only way research shows up in policy. Sometimes it's a named researcher, a nod to \"the evidence,\" or a reference tucked into the text with no formal citation at all.","tags":["Altmetrics","Policy"],"title":"Cited or mentioned? What we learned about how research actually shows up in policy","updated_at":1788852606,"url":"https://thebibliomagician.wordpress.com/2026/09/07/cited-or-mentioned-what-we-learned-about-how-research-actually-shows-up-in-policy/","version":"v1"}},{"document":{"authors":[{"contributor_roles":[],"family":"Jehn","given":"Florian Ulrich","url":"https://orcid.org/0000-0002-7296-8008"}],"blog":{"authors":null,"community_id":"86cf2e28-4644-41b0-9d6d-66444a612b18","created":1751500800,"current_feed_url":null,"description":"Thoughts about existential risk, history, climate, food security and societal collapse.","doi":"https://doi.org/10.59350/existentialcrunch","favicon":"https://rogue-scholar.org/api/communities/86cf2e28-4644-41b0-9d6d-66444a612b18/logo","feed_format":"application/rss+xml","feed_url":"https://existentialcrunch.substack.com/feed","filter":null,"generator":"Substack","home_page_url":"https://existentialcrunch.substack.com","issn":null,"language":"eng","license":"https://creativecommons.org/licenses/by/4.0/legalcode","prefix":"10.59350","relative_url":null,"secure":true,"slug":"existentialcrunch","status":"active","subfield":"2306","title":"Existential Crunch","updated":1788851190,"use_api":null},"blog_name":"Existential Crunch","blog_slug":"existentialcrunch","content_html":"<div class=\"captioned-image-container\"><figure><a class=\"image-link image2 is-viewable-img\" target=\"_blank\" href=\"https://substackcdn.com/image/fetch/$s_!N-_c!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd2c2347c-adc2-4961-b88e-98e1804912ec_1065x790.png\" data-component-name=\"Image2ToDOM\"><div class=\"image2-inset\"><picture><source type=\"image/webp\" srcset=\"https://substackcdn.com/image/fetch/$s_!N-_c!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd2c2347c-adc2-4961-b88e-98e1804912ec_1065x790.png 424w, https://substackcdn.com/image/fetch/$s_!N-_c!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd2c2347c-adc2-4961-b88e-98e1804912ec_1065x790.png 848w, https://substackcdn.com/image/fetch/$s_!N-_c!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd2c2347c-adc2-4961-b88e-98e1804912ec_1065x790.png 1272w, https://substackcdn.com/image/fetch/$s_!N-_c!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd2c2347c-adc2-4961-b88e-98e1804912ec_1065x790.png 1456w\" sizes=\"100vw\"><img src=\"https://substackcdn.com/image/fetch/$s_!N-_c!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd2c2347c-adc2-4961-b88e-98e1804912ec_1065x790.png\" width=\"1065\" height=\"790\" data-attrs=\"{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/d2c2347c-adc2-4961-b88e-98e1804912ec_1065x790.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:790,&quot;width&quot;:1065,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:2064417,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:false,&quot;topImage&quot;:true,&quot;internalRedirect&quot;:&quot;https://existentialcrunch.substack.com/i/206492588?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd2c2347c-adc2-4961-b88e-98e1804912ec_1065x790.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}\" class=\"sizing-normal\" alt=\"\" srcset=\"https://substackcdn.com/image/fetch/$s_!N-_c!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd2c2347c-adc2-4961-b88e-98e1804912ec_1065x790.png 424w, https://substackcdn.com/image/fetch/$s_!N-_c!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd2c2347c-adc2-4961-b88e-98e1804912ec_1065x790.png 848w, https://substackcdn.com/image/fetch/$s_!N-_c!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd2c2347c-adc2-4961-b88e-98e1804912ec_1065x790.png 1272w, https://substackcdn.com/image/fetch/$s_!N-_c!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd2c2347c-adc2-4961-b88e-98e1804912ec_1065x790.png 1456w\" sizes=\"100vw\" fetchpriority=\"high\"></picture><div class=\"image-link-expand\"><div class=\"pencraft pc-display-flex pc-gap-8 pc-reset\"><button tabindex=\"0\" type=\"button\" class=\"pencraft pc-reset pencraft icon-container restack-image\"><svg aria-hidden=\"true\" width=\"20\" height=\"20\" viewBox=\"0 0 20 20\" fill=\"none\" stroke-width=\"1.5\" stroke=\"var(--color-fg-primary)\" stroke-linecap=\"round\" stroke-linejoin=\"round\" xmlns=\"http://www.w3.org/2000/svg\"><g><path d=\"M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882\"></path></g></svg></button><button tabindex=\"0\" type=\"button\" class=\"pencraft pc-reset pencraft icon-container view-image\"><svg xmlns=\"http://www.w3.org/2000/svg\" width=\"20\" height=\"20\" viewBox=\"0 0 24 24\" fill=\"none\" stroke=\"currentColor\" stroke-width=\"2\" stroke-linecap=\"round\" stroke-linejoin=\"round\" class=\"lucide lucide-maximize2 lucide-maximize-2\"><polyline points=\"15 3 21 3 21 9\"></polyline><polyline points=\"9 21 3 21 3 15\"></polyline><line x1=\"21\" x2=\"14\" y1=\"3\" y2=\"10\"></line><line x1=\"3\" x2=\"10\" y1=\"21\" y2=\"14\"></line></svg></button></div></div></div></a><figcaption class=\"image-caption\">Castelnau, Paul. (1917). Reims, Marne. Ruines d'une imprimerie, rue des Trois Raisinets [Autochrome]. Public Domain (CC-0). Inventory number: A11472.</figcaption></figure></div><p><em>This post is part of a <a href=\"https://existentialcrunch.substack.com/p/introducing-a-living-literature-review\">living literature review</a> on societal collapse. You can find an indexed archive <a href=\"https://florianjehn.github.io/Societal_Collapse/\">here</a>.</em></p><p>After reading dozens and dozens of scientific papers about societal collapse, I wanted a new perspective on the topic. So, I read a lot of novels about societal collapse, as stories shape how we see the world and thus the action we take (1) (2). To my surprise, it turned out to be pretty hard to find books that actually take collapse seriously instead of just using it as a backdrop.</p><p>Collapse is a topic people like to tell stories about, as it grasps the imagination with what might be and how everything we have now might be gone in the future. I found the books by searching the internet and asking friends and colleagues for recommendations. This means there is no coherent set of criteria that makes a book collapse relevant, more a vibes based approach on what I and other people felt could be a collapse relevant book. Obviously, this is also not a complete list, so I'd be happy to hear further suggestions in the comments.</p><p>This post gives an overview of the books I have read, makes some recommendations on which ones are worth reading and describes what I have learned from reading them.</p><p class=\"button-wrapper\" data-attrs=\"{&quot;url&quot;:&quot;https://existentialcrunch.substack.com/subscribe?&quot;,&quot;text&quot;:&quot;Subscribe now&quot;,&quot;action&quot;:null,&quot;class&quot;:null}\" data-component-name=\"ButtonCreateButton\"><a class=\"button primary\" href=\"https://existentialcrunch.substack.com/subscribe?\"><span>Subscribe now</span></a></p><h1>Books covered so far</h1><p>First, I will give a short overview of the books and what I thought about them. The list is roughly ordered by how much I would recommend reading them, starting with the ones I liked least and ending with my favorites.</p><h2><a href=\"https://en.wikipedia.org/wiki/The_Years_of_Rice_and_Salt\">The Years of Rice and Salt</a></h2><p>The book starts with a great premise: How would the world have developed if the Black Death would have killed 99 % of the European population? And the first few chapters really hammer that home, as they tell the story of a lone warrior trying to survive, only ever finding ruins and death wherever he goes. But after that the book mostly forgets about what got it started, never really mentions that super plague again and instead tells an alternate history story of a monumental battle of cultures between China and an Islamized rest of the world in a connected set of short stories. Don't get me wrong, the book is not bad, but it was quite disappointing to me, as it does not really say anything about collapse, even though the premise would have been great for that. The alternate history of it is interesting, although it sometimes felt like he took the actual history and just replaced all entries of Europe with China. Some of the short stories were quite good and if you like alternate history, this one is still worth checking out.</p><h2><a href=\"https://en.wikipedia.org/wiki/Parable_of_the_Sower_(novel)\">The Parable of the Sower</a></h2><p>This story follows the life of a young girl that grows up in a world that is in a slow collapse, likely induced by escalating climate change. Social order is breaking down and people revert more and more to barbarism. The main character is trying to create a new ideology of positive change to counteract this and over the length of the book gathers a ragtag group of other survivors. The world it describes is interesting, but remains quite vague, as the book really wants to focus on the thoughts and feelings of the main character. This makes the collapse element seem more like the backdrop in what is actually a coming of age story. So, it was an okay read for me, but ultimately not that interesting.</p><h2><a href=\"https://en.wikipedia.org/wiki/Oryx_and_Crake\">Oryx and Crake</a></h2><p>The world of this novel is one ravaged by climate change and rampant resource overuse. This has destabilized the world, which humanity tried to counteract by going all in on manipulating biology. Creating pigs to harvest human organs or brainless flesh tubes to produce meat, quickly and cheaply. The story is told from the perspective of Snowman, on of the few survivors of an engineered pandemic. Over the length of the book, it is slowly revealed that Snowman's childhood friend Crake is responsible for this. According to the Wikipedia entry Crake did this to save Earth from humanity, but while reading the book this did not become super clear to me and the whole release of the engineered pandemic felt somewhat random and unearned given the setup. The book is nicely written and good to read, but I did not find the characters super interesting and the societal collapse itself is only described very vaguely.</p><h2><a href=\"https://en.wikipedia.org/wiki/Last_and_First_Men\">Last and First Men</a></h2><p>Here the attempt is to tell the story of humanity from the 1930s until the extinction of the last descendant of humankind. This happens via the last men contacting the author of the book from the future to write down the whole history. It is a very weird book. It reads less like fiction and more like a historical treatise from the future. And the author imagines a very wide variety of future humans ranging from flying humans, to ape humans and also humans that are only giant brains in a vat. You also really notice that this book was written by someone from the 1930s, because oh boy does Olaf Stapledon love eugenics. So many pages in this book are spent on describing how better versions of humanity are bred purposefully. Still, it is quite interesting as an historical document, as it shows how people in the 1930s envisioned the future. Also, it is interesting in how he describes how all the different past civilizations perished, some from resource overuse, some from moral failures or others by just being unlucky. Overall, a fascinating book, but not really that great to actually read.</p><h2><a href=\"https://craphound.com/overclocked/Cory_Doctorow_-_Overclocked_-_When_Sysadmins_Ruled_the_Earth.html\">When Sysadmins ruled the Earth</a></h2><p>Not really a book, but a longer short story. The idea is that Earth is suddenly hit by a super deadly pandemic, likely introduced by bioterrorism. Most people die within days, but large groups of sysadmins survive in their data centers, as a large cyber attack just before the pandemic hit all made them gather in their fortress-like data centers, where they are safe for a while due to filtered air and backup power. From those data centers they try to coordinate a response, but have a hard time going anywhere due to never ending discussions. The story itself is just fine, but I liked the focus on infrastructure and its importance. Also, it is always nice if people like sysadmins, who work on maintaining our current world, without ever being seen, get some recognition.</p><h2><a href=\"https://en.wikipedia.org/wiki/The_Death_of_Grass\">The Death of Grass</a></h2><p>This book wants to tell a story about how human morality is only something rich countries can have, because we live in abundance. This abundance is disrupted by a new kind of virus that kills all grass species in the world. As this includes most of the major food crops, the result is global famine. The book follows a pretty normal English family and how they try to navigate a world that quickly goes from abundance to scarcity. I think the premise of the book is good, as I also think that without food humans might quickly get more aggressive and violent. However, the book does not really tell this change in a convincing manner. The main protagonist of the book just takes a few days to go from polite, boring dad to being completely fine with robbing and killing innocent people to advance his position. Also, it is super misogynistic for no reason. Still, I really liked the idea of what this book could have been, if it would have been better.</p><h2><a href=\"https://en.wikipedia.org/wiki/The_Windup_Girl\">The Windup Girl</a></h2><p>A post contraction world. Fossil fuel capitalism has run its course and left the Earth broken. There are only scarce reserves of oil and gas left and so society has reverted again to more mechanical labor. However, this is enhanced by massive bioengineering and there are many new species to take on some of the burden. However, this massive focus on bioengineering also has released many new diseases into the world and food crops have to be continuously adapted to stay valid. Due to this power is concentrated in a few bioengineering corporations that control most of the world. One of the remaining independent countries is Thailand. The book focuses on a set of characters that try to steer their life in better directions, while around them the country slowly degrades into civil war.</p><p>I think this book did a pretty good job in describing a plausible future. Everything seems alien, but you can see how today's society could end up in such a scenario. It also goes into a good amount of detail how such a society would work and how it would set different priorities that we do today. What stops this book from being more of a favorite is that the actual story it tells is somewhat meandering, forgets its own strands and then results in a very mid ending. Still, worth checking out just for world building.</p><h2><a href=\"https://en.wikipedia.org/wiki/World_War_Z\">World War Z</a></h2><p>This one was recommended to me by several people and I get why. I would not have expected this from a book about a global war against zombies, but this book is pretty good at thinking through how such a collapse would look like and what the consequences might be. It is told through interviews with survivors of the zombie war and describes what happened throughout the war in chronological order.</p><p>I am not sure how much I can actually learn from this about \"normal\" collapse, but it certainly was quite interesting to see how the author manages to describe how politics, military tactics or economics change if suddenly the biggest threat to humanity are millions upon millions of zombies.</p><p>The reason why this did not make it further in the ranking is that the writing seemed pretty repetitive to me. While the book claims to interview a large group of different people from very different backgrounds, they all sound and feel very similarly, which gets a bit exhausting over the length of the book.</p><h2><a href=\"https://en.wikipedia.org/wiki/The_Sheep_Look_Up\">The Sheep Look Up</a></h2><p>This is essentially Silent Spring, the novel. It is set in a near-future USA where environmental pollution has reached unprecedented heights. In most places you cannot go outside without a filter mask, children are born deformed because of the toxins they are exposed to before birth, and social discontent is brewing because people are no longer willing to tolerate this. The story follows a wide cast of characters: people who just want to make a living and ignore how dysfunctional society is getting around them, regenerative farmers who want to build their own isolated commune, and a reporter trying to push for better governance with the help of an activist leader. Around them society crumbles as people's health declines and the social fabric frays, because nobody believes in a better world anymore.</p><p>The book feels a bit like an artifact from another timeline. I can clearly see how somebody writing this in 1972 would see this kind of environmental degradation as the logical end point of the trajectory the USA was on. But it turned out differently, and while the USA is still pretty good at polluting the environment, laws and regulations hemmed it in and made the future in the book much less likely. So in a way it is a positive experience to read this, as it describes a bad future we managed to avoid. The way the book describes society slowly falling apart also felt like a good description to me, as it does not rush the way Death of Grass does. The writing, though, feels a bit janky and took me time to get used to. After the first few chapters I almost decided to skip the book, but now I am happy that I finished it.</p><h2><a href=\"https://en.wikipedia.org/wiki/The_Ministry_for_the_Future\">The Ministry for the Future</a></h2><p>Climate change, its consequences and possible solutions are the theme here. In the near future the ministry for the future is founded, which has the task of representing future generations and pushing for projects that allow those future generations a better life. The book mostly follows the head of the ministry and her struggles to actually get things done while facing massive resistance and a former aid worker who gets traumatized by having to live through a deadly heat wave and tries to understand his fate.</p><p>This seems to be the most well known collapse relevant novel. If you haven't read it, it is very worth picking up. If you have little time, just read the first chapters about the Indian heat wave. This is the best part of the book and also the most haunting one. The book is very detailed and drills down into the details of what proposals could actually stop climate change and the consequences of us failing to do so in time.</p><h2><a href=\"https://en.wikipedia.org/wiki/Children_of_Memory_(novel)\">Children of Memory</a></h2><p>This book is part of a longer series about species uplifting, but it can be read on its own. The plot revolves around a new colony on an exoplanet that is quite hostile to life. It follows the colonizers in their struggle to wrestle a life from the hostile environment. The book is really good in highlighting how hard agriculture is and how much can go wrong, especially in an environment that is not well suited to it. As the situation of the colony gets more and more dire the book shows how the settlers get less and less trusting and putting ever more force into law and order.</p><p>I feel like this book does well what Death of Grass tried and failed. Showing that food is the foundation of society and how humans that start trusting and cooperative quickly cease to do so when food gets really scarce. The book also has quite some interesting turns and twists, but I don't want to spoil too much.</p><h2><a href=\"https://en.wikipedia.org/wiki/The_Dispossessed\">The Dispossessed</a></h2><p>Really loved this book. It is the story of two societies and how they organize their political and economic life, told through the eyes of a scientist who visits both of them, but is originally from the anarchist society. The first society is organized as an aristocratic, capitalist society, seeming like a mixture of the UK during the industrial revolution and Cold War USA. The rich suppress the poor, the latter ultimately stage an anarchist revolution and to find peace, they are allowed to resettle to a nearby moon, which is barely habitable. On this moon they start a new society focussed on sharing, consent and ending suppression. Just as the colony in Children of Memory they struggle with the environment and face hunger, but ultimately make it through by the strength of their shared solidarity. Still, this society is not safe from problems either, as even if there is no formal governance, humans easily fall back into power hierarchies and work against the shared solidarity.</p><p>The book is really good in contrasting the anarchist society with the capitalist one. Both work as the mirror for the other, showing their shortcomings and where they fail their own values. Ultimately, the anarchist one seems like the much more liveable place, but it is constantly in danger of failing, as it is a constant negotiation between everyone involved. But at least discussion is possible, while in the hierarchy all dissent is violently suppressed.</p><p>While none of the societies involved collapses, I think this book is still relevant, as it is so good in contrasting different forms of governance, where they fail and where they succeed, plus the bonus of again highlighting the importance of food. Only in this book the societal bonds are only strained and not broken.</p><h2><a href=\"https://en.wikipedia.org/wiki/A_Canticle_for_Leibowitz\">A Canticle for Leibowitz</a></h2><p>If society collapsed and we found the remains of our modern world decades later, would we be able to decipher what those remains even meant? What would we do with them? Could we still use it to rebuild? These are the questions this book tries to answer. It follows a group of monks over thousands of years as society tries to rebuild after a nuclear war. The monks have made it their task to preserve artifacts and books from the past, even though they do not know how to understand them. They merely keep on copying them, because they think they might prove valuable again in the future.</p><p>I enjoyed this book because I feel like it gives a realistic vision of how the world might look after a nuclear war. Humanity would be shattered, but probably not broken. Given enough time, it might restart, especially if some of the previous knowledge is conserved. However, the book also asks the question if humanity would learn from something like that, or if we would simply start to prepare for the next annihilation by our own hands.</p><h2><a href=\"https://en.wikipedia.org/wiki/The_Road\">The Road</a></h2><p>The Road does not even mention which catastrophe befell humanity, though it very much seems like nuclear winter. The only thing we know is that things are really, really bad. The book follows a father and a son on their trek through a totally devastated America. They are aiming to find a place where life is better, all while trying to not sacrifice their own morals for their survival.</p><p>This book is bleak. Likely the bleakest book I have ever read. But it is so extremely well written that I could not put it down. While it does not teach you anything about how a society might collapse, it teaches you a lot about how horrible it would be if it happened, which is also an important lesson. And still, through all this darkness, it manages to always keep a sliver of hope going, that a better life might still be possible, even in the worst of times.</p><h2><a href=\"https://www.goodreads.com/book/show/60806778-the-deluge\">The Deluge</a></h2><p>Wow, what a book. The Deluge explores the next few decades of how climate change might shape our world. It tells a story of activists, corporate advertisers, scientists, government officials and many more, and how all of them try to make sense of an ever more chaotic world and push their agendas forward in it. Everybody has their own ideas of what should be done to steer the USA through the turbulent times of more storms, more heat, more violence, more war, more misinformation. These range from eco-socialism and green growth capitalism to a fascist theocracy.</p><p>I was really impressed by how this book handled so many parallel storylines at once and how it braided them together into a very scary, yet always plausible narrative of how the coming decades will play out. I also really liked how it dug deep into how this all shifts and disrupts society and its narratives. It does this deep dive while also managing to be a very good read throughout, with many relatable and three dimensional characters. I think this is my favorite so far, because it explores changes on a societal level, while at the same time being simply a very good and engaging book that tells a cautionary tale of what might await us all quite soon.</p><h1>Conclusion</h1><p>While I enjoyed reading all these books about collapse and catastrophe, I am a bit unsure how much I have actually learned while doing so. I started a project to have a new angle on the topics I usually cover. But I had to start wondering if many of these authors take collapse as a topic seriously. For me this would mean that the book really tackles the problems that collapse causes. How do people adapt? How do institutions shift? How are morals under pressure?</p><p>For many of the books, you have this one big, defining catastrophe that ends the world or at least completely whacks it out of balance. The book focuses on the catastrophe in some detail in the first few chapters, but then many kind of forget the catastrophe they started the book with? Take Years of Rice and Salt; it starts with the premise of a super deadly pandemic that wipes out all of Europe and the descriptions in some of the earlier chapters are haunting and interesting, but for the following ~700 pages it just is not really a topic anymore.</p><p>It seems to me that many of the books here just use the catastrophe as a kind of motivator for the plot. The books are not really about collapse, instead they want to tell a specific story and they want to place it in a collapse scenario, as this gives their protagonists a reason to do stuff. Most often they seem to want to tell a kind of cautionary tale, along the lines of: \"Do humans really have morality or is this just something we can have now, because we are not on the verge of dying?\". And this is not an uninteresting question and some books, especially The Road, really try to answer this on a deep level, but then we have a story about human nature and not a story about how a society might cope with catastrophic conditions.</p><p>Maybe I just approached this the wrong way, because I wanted to learn something about collapse using fiction? I do not think so, as there are some books that at least gave a glimpse of what I was looking for. I think the book that did this best was The Deluge.The detailed story over decades in a world reeling under climate really felt like I was learning how we might cope or fail to do so. A Canticle for Leibowitz was also great. It really tries to think through how a society after a nuclear war could cope and how over time even the simplest artifacts from the past could seem like magic, as the reset society does not have the same understanding of the world anymore. Also pretty good in this regard were World War Z and The Sheep Look Up, as they cleanly describes what happens in reaction to this big catastrophe on many levels of society. Though, both are a bit lacking in how they tell their stories.</p><p>Looking at which books worked for me and which did not, the best predictor seems to be how much a book focuses on individual actors versus institutions and movements. A narrative usually wants to focus on one or few main protagonists, but collapse happens at the scale of systems. The books that gave me the most insight are exactly the ones that found ways around this. A Canticle for Leibowitz follows an institution over centuries instead of a person, The Deluge tells a decades long story about many characters, each embedded in different institutions and circumstances World War Z replaces protagonists with dozens of interview voices, The Sheep Look Up also has a large cast of characters and The Dispossessed is built around comparing two whole societies. At first The Road looks like it breaks this pattern, as it only ever focuses on two people and still felt quite valuable to me. But I think it provides a different kind of insight. It does not teach you anything about how collapse works, it teaches you why it matters and how horrible it would be. So maybe there are two things fiction can offer here: insight into the dynamics of collapse and insight into its stakes. The systems focused books provide the former, The Road the latter.</p><p>The timeline of a book also plays a role. Collapse of a society and the subsequent adaptation necessarily takes longer than a week and if this is the amount of time a book covers, well the collapse insights can only ever be surface level. So, this likely has to be months or rather years or decades. Though, you can also lose the plot in the other direction, as Last and First Men shows. If you are looking at billions of years, everything can only be a fantasy.</p><p>Still, I think this project was worth it and I will keep on reading these kinds of fiction books. They might not have been what I was originally looking for, but it certainly was interesting reading them (or at least most of them). And maybe there are more of the kinds of books I am looking for out there? If you know any, please let me know in the comments, I would love to put them on my reading list. Especially books that cover topics besides climate change, pandemics and nuclear war.</p><p><em>Thanks for reading! If you want to talk about this post or societal collapse in general, I'd be happy to have a chat. Just send me a mail to existential_crunch at posteo.de and we can schedule something.</em></p><p class=\"button-wrapper\" data-attrs=\"{&quot;url&quot;:&quot;https://existentialcrunch.substack.com/subscribe?&quot;,&quot;text&quot;:&quot;Subscribe now&quot;,&quot;action&quot;:null,&quot;class&quot;:null}\" data-component-name=\"ButtonCreateButton\"><a class=\"button primary\" href=\"https://existentialcrunch.substack.com/subscribe?\"><span>Subscribe now</span></a></p><h1>Further books I plan to read</h1><ul><li><p><a href=\"https://en.wikipedia.org/wiki/Always_Coming_Home\">Always Coming Home</a></p></li><li><p><a href=\"https://www.goodreads.com/book/show/60869319-auf-see\">Auf See</a></p></li><li><p><a href=\"https://www.goodreads.com/book/show/59023013-blackout\">Blackout</a></p></li><li><p><a href=\"https://en.wikipedia.org/wiki/Earth_Abides\">Earth Abides</a></p></li><li><p><a href=\"https://www.goodreads.com/book/show/217729729-hyphen\">Hyphen</a></p></li><li><p><a href=\"https://en.wikipedia.org/wiki/I_Am_Legend_(novel)\">I am Legend</a></p></li><li><p><a href=\"https://en.wikipedia.org/wiki/Life_and_Fate\">Life and Fate</a></p></li><li><p><a href=\"https://en.wikipedia.org/wiki/On_the_Beach_(novel)\">On the Beach</a></p></li><li><p><a href=\"https://en.wikipedia.org/wiki/Riddley_Walker\">Riddley Walker</a></p></li><li><p><a href=\"https://en.wikipedia.org/wiki/Station_Eleven\">Station Eleven</a></p></li><li><p><a href=\"https://en.wikipedia.org/wiki/Termination_Shock_(novel)\">Termination Shock</a></p></li></ul><h1>Endnotes</h1><p>(1) See <a href=\"https://existentialcrunch.substack.com/p/how-environmental-politics-lost-the\">this post</a> for a detailed argument on why visions of the future are so important for the present.</p><p>(2) If you want yet another perspective on the topics, I can also recommend checking out <a href=\"https://www.youtube.com/watch?v=5uN5btgxsfI\">this excellent reading</a> of Lord Byron's Darkness.</p><h1>How to cite</h1><p>Jehn, F. U. (2026, September 8). Learning about collapse from novels. Existential Crunch. https://doi.org/10.59350/ekqqw-80e32</p><h1>References</h1><ul><li><p>Atwood, M. (2009). Oryx And Crake. Virago.</p></li><li><p>Bacigalupi, P. (2009). The Windup Girl. Orbit.</p></li><li><p>Brooks, M. (2006). World War Z: An Oral History of the Zombie War. Del Rey.</p></li><li><p>Brunner, J. (1972). The Sheep Look Up. Harper &amp; Row.</p></li><li><p>Butler, O. E. (1993). Parable of the sower. </p></li><li><p>Christopher, J. (1956). The Death of Grass. </p></li><li><p>Doctorow, C. (2007). When the Sysadmins ruled the Earth.</p></li><li><p>Markley, S. (2023). The Deluge. Simon &amp; Schuster.</p></li><li><p>Le Guin, U. K. (1974). The dispossessed.</p></li><li><p>McCarthy, C. (2006). The Road.</p></li><li><p>Miller, W. (1959). A Canticle for Leibowitz.</p></li><li><p>Robinson, K. S. (2002). The Years of Rice and Salt. Del Rey.</p></li><li><p>Robinson, K. S. (2020). The ministry for the future. Orbit.</p></li><li><p>Stapledon, O. (1930). Last and first men.</p></li><li><p><span>Tchaikovsky, A. (2023). Children of memory. Orbit.</span></p></li></ul>","doi":"https://doi.org/10.59350/ekqqw-80e32","guid":"206492588","image":"https://substackcdn.com/image/fetch/$s_!N-_c!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd2c2347c-adc2-4961-b88e-98e1804912ec_1065x790.png","language":"en","license":"https://creativecommons.org/licenses/by/4.0/legalcode","published_at":1788825600,"reference":[{"unstructured":"Atwood, M. (2009). Oryx And Crake. Virago."},{"unstructured":"Bacigalupi, P. (2009). The Windup Girl. Orbit."},{"unstructured":"Brooks, M. (2006). World War Z: An Oral History of the Zombie War. Del Rey."},{"unstructured":"Brunner, J. (1972). The Sheep Look Up. Harper & Row."},{"unstructured":"Butler, O. E. (1993). Parable of the sower."},{"unstructured":"Christopher, J. (1956). The Death of Grass."},{"unstructured":"Doctorow, C. (2007). When the Sysadmins ruled the Earth."},{"unstructured":"Markley, S. (2023). The Deluge. Simon & Schuster."},{"unstructured":"Le Guin, U. K. (1974). The dispossessed."},{"unstructured":"McCarthy, C. (2006). The Road."},{"unstructured":"Miller, W. (1959). A Canticle for Leibowitz."},{"unstructured":"Robinson, K. S. (2002). The Years of Rice and Salt. Del Rey."},{"unstructured":"Robinson, K. S. (2020). The ministry for the future. Orbit."},{"unstructured":"Stapledon, O. (1930). Last and first men."},{"unstructured":"Tchaikovsky, A. (2023). Children of memory. Orbit."}],"rid":"cbz1r-4at56","summary":"Reviews, rankings and recommendations","title":"Learning about collapse from novels","updated_at":1788852606,"url":"https://existentialcrunch.substack.com/p/can-you-learn-about-collapse-from","version":"v1"}},{"document":{"authors":[{"affiliation":[{"id":"https://ror.org/04g6bbq64","name":"Adam Mickiewicz University in Pozna\u0144"}],"contributor_roles":[],"family":"Nowosad","given":"Jakub","url":"https://orcid.org/0000-0002-1057-3721"}],"blog":{"authors":null,"community_id":"2b9a0f79-8a25-47c4-a4ea-acb250754f4c","created":1739059200,"current_feed_url":null,"description":"Hi! I'm Jakub Nowosad, an Associate Professor at Adam Mickiewicz University and a Visiting Scientist at the University of M\u00fcnster. My work focuses on developing spatial methods to better understand environmental processes. Here, I present my","doi":"https://doi.org/10.59350/jakubnowosad","favicon":"https://rogue-scholar.org/api/communities/2b9a0f79-8a25-47c4-a4ea-acb250754f4c/logo","feed_format":"application/rss+xml","feed_url":"https://jakubnowosad.com/posts.xml","filter":null,"generator":"Quarto","home_page_url":"https://jakubnowosad.com/posts.html","issn":null,"language":"eng","license":"https://creativecommons.org/licenses/by/4.0/legalcode","prefix":"10.59350","relative_url":null,"secure":true,"slug":"jakubnowosad","status":"active","subfield":"1908","title":"Thinking in spatial patterns","updated":1788825600,"use_api":null},"blog_name":"Thinking in spatial patterns","blog_slug":"jakubnowosad","content_html":"<p>Spatial machine learning has become a standard tool for producing environmental and geographic prediction maps. It is now relatively (technically) easy to combine field observations with remote sensing, climate, terrain, or other predictor layers and fit a strong machine learning model. The harder question is whether the resulting map is reliable, transferable, and reproducible.</p>\n<p>In our paper, <a href=\"https://doi.org/10.3112/erdkunde.2026.04.01\"><em>Navigating challenges in spatial machine learning: validation, uncertainty, algorithms, and reproducibility</em></a>, we discuss this question from several connected angles. The paper was written by Jakub Nowosad, Carmelo Bonannella, Darius G\u00f6rgen, Marta Jemeljanova, Teja Kattenborn, Jan Linnenbrink, Hanna Meyer, Madlene Nussbaum, Luca Patelli, Rolf Simoes, and Evelyn Uuemaa<sup>1</sup>, and published in <em>Erdkunde</em>.</p>\n<p>The main argument is that spatial machine learning cannot simply reuse standard machine learning habits without modification. Spatial dependence, clustered and biased sampling, heterogeneous landscapes, and domain transfer all affect how models should be evaluated and interpreted. A model can appear accurate under a standard validation approach and still be unreliable where predictions are needed.</p>\n<p>We structure the paper around six themes:</p>\n<div class=\"quarto-figure quarto-figure-center\">\n<figure class=\"figure\">\n<p><img class=\"img-fluid figure-img\" src=\"https://jakubnowosad.com/posts/2026-09-08-erdkunde/fig1.png\"/></p>\n<figcaption>The main themes of the paper</figcaption>\n</figure>\n</div>\n<p>Several practical messages follow from this. Validation should match the intended prediction scenario, and prediction-domain adaptive evaluation approaches can help when sticking just to simple random or spatial cross-validation is not appropriate. When training data do not represent the prediction domain, areas outside the model's area of applicability should be identified, masked, or at least communicated clearly. Performance should not be reduced to a single global number: residual maps, spatial patterns of error, uncertainty, and thinking of the goal of the analysis are all important.</p>\n<p>The paper also highlights that algorithmic progress alone is not enough. We need benchmark datasets with different spatial properties, clearer comparisons against baseline methods, better uncertainty frameworks, and software that makes robust spatial workflows easier to apply. R currently has several dedicated tools for spatial machine learning workflows, while Python has a strong general-purpose machine learning ecosystem but fewer mature implementations of spatial-specific methods. In both languages, reproducibility still depends heavily on careful reporting of data preparation, resampling, prediction, software versions, and computational choices.</p>\n<p>The final part of the paper argues for standardized reporting protocols for spatial machine learning. Such protocols could help researchers document modeling aims, spatial characteristics of the data, validation design, uncertainty treatment, computational requirements, and reproducibility materials. This is also connected to ongoing work on the <a href=\"https://github.com/LOEK-RS/STeMP\">Spatio-Temporal Modelling Protocol (STeMP)</a>.</p>\n<blockquote class=\"blockquote\">\n<p>The short version is this: spatial machine learning needs to move beyond performance-driven mapping toward workflows that are spatially explicit, uncertainty-aware, and reproducible. Better models are useful, but better evaluation, clearer uncertainty communication, stronger software, and transparent reporting are equally important.</p>\n</blockquote>\n<div class=\"default\" id=\"quarto-appendix\"><section class=\"footnotes footnotes-end-of-document\" id=\"footnotes\"><h2 class=\"anchored quarto-appendix-heading\">Footnotes</h2>\n<ol>\n<li id=\"fn1\"><p>And builds partly on discussions from the <a href=\"https://jakubnowosad.com/advsml_2025/\">Advances in Spatial Machine Learning 2025 workshop</a>. Many thanks to the workshop participants for their feedback and ideas!\u21a9\ufe0e</p></li>\n</ol>\n</section><section class=\"quarto-appendix-contents\" id=\"quarto-citation\"><h2 class=\"anchored quarto-appendix-heading\">Citation</h2><div><div class=\"quarto-appendix-secondary-label\">BibTeX citation:</div><pre class=\"sourceCode code-with-copy quarto-appendix-bibtex\"><code class=\"sourceCode bibtex\">@online{nowosad2026,\n  author = {Nowosad, Jakub},\n  title = {Navigating {Challenges} in {Spatial} {Machine} {Learning}},\n  date = {2026-09-08},\n  url = {https://jakubnowosad.com/posts/2026-09-08-erdkunde/},\n  langid = {en}\n}\n</code></pre><div class=\"quarto-appendix-secondary-label\">For attribution, please cite this work as:</div><div class=\"csl-entry quarto-appendix-citeas\" id=\"ref-nowosad2026\">\nNowosad, Jakub. 2026. <span>\"Navigating Challenges in Spatial Machine\nLearning.\"</span> September 8. <a href=\"https://jakubnowosad.com/posts/2026-09-08-erdkunde/\">https://jakubnowosad.com/posts/2026-09-08-erdkunde/</a>.\n</div></div></section></div>","doi":"https://doi.org/10.59350/kba53-aqt33","guid":"https://jakubnowosad.com/posts/2026-09-08-erdkunde/","image":"https://jakubnowosad.com/posts/2026-09-08-erdkunde/fig1.png","language":"en","license":"https://creativecommons.org/licenses/by/4.0/legalcode","published_at":1788825600,"rid":"v7d7h-5zb63","summary":"Spatial machine learning has become a standard tool for producing environmental and geographic prediction maps. It is now relatively (technically) easy to combine field observations with remote sensing, climate, terrain, or other predictor layers and fit a strong machine learning model. The harder question is whether the resulting map is reliable, transferable, and reproducible.","tags":["Spatial","Spatial-machine-learning","Spatial-patterns","Rstats","Python"],"title":"Navigating Challenges in Spatial Machine Learning","updated_at":1788852606,"url":"https://jakubnowosad.com/posts/2026-09-08-erdkunde/","version":"v1"}},{"document":{"authors":[{"affiliation":[{"name":"Front Matter"}],"contributor_roles":[],"family":"Fenner","given":"Martin","url":"https://orcid.org/0000-0003-1419-2405"}],"blog":{"authors":[{"name":"Martin Fenner","url":"https://orcid.org/0000-0003-1419-2405"}],"community_id":"15a362ea-8138-42b8-917f-1840a92addf8","created":1672531200,"current_feed_url":null,"description":"The Front Matter Blog covers the intersection of science and technology since 2007.","doi":"https://doi.org/10.53731/front_matter","favicon":"https://rogue-scholar.org/api/communities/15a362ea-8138-42b8-917f-1840a92addf8/logo","feed_format":"application/atom+xml","feed_url":"https://blog.front-matter.de/atom","filter":null,"generator":"Ghost","home_page_url":"https://blog.front-matter.de/","issn":"2749-9952","language":"eng","license":"https://creativecommons.org/licenses/by/4.0/legalcode","prefix":"10.53731","relative_url":null,"secure":true,"slug":"front_matter","status":"active","subfield":"1710","title":"Front Matter","updated":1788787489,"use_api":true},"blog_name":"Front Matter","blog_slug":"front_matter","content_html":"<p>The <a href=\"https://rogue-scholar.org\" rel=\"noreferrer\">Rogue Scholar science blog archive</a> has now archived all its currently 55,730 blog posts as PDF files. These PDF files use the archival PDF/A-3A format and include the full-text HTML blog post with metadata embedded as Schema.org attachment, and their PDF URLs are included in the Crossref metadata.</p><p>Blog posts are published as web pages in HTML format and often authored in Markdown format. So why PDF? I <a href=\"https://doi.org/10.53731/fy8ppqw-wctn03p\" rel=\"noreferrer\">have been struggling with PDF for a long time</a>, as it is a horrible authoring format, made famous by Peter Murray-Rust:</p><blockquote>PDF is a hamburger, and we're trying to turn it back into a cow.</blockquote><p>At the same time PDF is an excellent archiving format. The <a href=\"https://doi.org/10.53731/fy8ppqw-wctn03p\" rel=\"noreferrer\">reference manager Papers</a> pioneered the idea of managing reference metadata together with PDF attachments, and <a href=\"https://doi.org/10.53731/r294649-6f79289-8cw42\" rel=\"noreferrer\">other reference managers </a>did something similar. This reference manager \u2013 PDF integration was further enhanced when more scholarly content became available as Open Access and reference manager Zotero added a <strong>Find Available PDF</strong> integration.</p><p>At the same time <a href=\"https://en.wikipedia.org/wiki/PDF/A\" rel=\"noreferrer\">PDF/A</a> became an official ISO standard for long-term preservation of PDF documents, making it an archiving option for digital repositories such as Rogue Scholar and complementing web-archiving standards such as <a href=\"https://archive-it.org/blog/the-stack-warc-file/\" rel=\"noreferrer\">WARC</a> developed by the Internet Archive, which <a href=\"https://doi.org/10.53731/hhtx0-wb293\" rel=\"noreferrer\">Rogue Scholar uses since October 2023</a>. </p><p>PDF/A comes in several flavors and Rogue Scholar uses PDF/A-3A that allows attachments of files in any format, in this case the full-text HTML with embedded schema.org metadata. These metadata are embedded similar how this is done on web pages crawled by Google and others, but is added from the blog post metadata on PDF generation. This makes extraction of metadata and full-text HTML from PDF files much easier and faster and doesn't require machine learning tools such as <a href=\"https://github.com/grobidOrg/grobid\" rel=\"noreferrer\">GROBID</a>. The latest versions of the <a href=\"https://pypi.org/project/commonmeta-py/\" rel=\"noreferrer\">commonmeta-py</a> library can open these PDF files and extract the full-text and metadata, and for example convert to other formats.</p><p>The link to the PDF file is included in the metadata of every Rogue Scholar DOI, enabling downstream workflows to automatically fetch the PDF (all blog posts in Rogue Scholar are open access with a CC-BY license). One of the important use cases is of course reference managers, and the Zotero browser integration will now automatically not only fetch metadata from Rogue Scholar, but also the full-text PDF:</p><figure class=\"kg-card kg-image-card\"><img src=\"https://storage.ghost.io/c/c5/33/c533c955-b5f3-4ff1-ae2d-6b52a212e602/content/images/2026/09/Bildschirmfoto-2026-09-07-um-15.23.22.png\" class=\"kg-image\" alt=\"\" loading=\"lazy\" width=\"2000\" height=\"1266\" srcset=\"https://storage.ghost.io/c/c5/33/c533c955-b5f3-4ff1-ae2d-6b52a212e602/content/images/size/w600/2026/09/Bildschirmfoto-2026-09-07-um-15.23.22.png 600w, https://storage.ghost.io/c/c5/33/c533c955-b5f3-4ff1-ae2d-6b52a212e602/content/images/size/w1000/2026/09/Bildschirmfoto-2026-09-07-um-15.23.22.png 1000w, https://storage.ghost.io/c/c5/33/c533c955-b5f3-4ff1-ae2d-6b52a212e602/content/images/size/w1600/2026/09/Bildschirmfoto-2026-09-07-um-15.23.22.png 1600w, https://storage.ghost.io/c/c5/33/c533c955-b5f3-4ff1-ae2d-6b52a212e602/content/images/size/w2400/2026/09/Bildschirmfoto-2026-09-07-um-15.23.22.png 2400w\" sizes=\"(min-width: 720px) 720px\"></figure><p>Another interesting use case of these archival PDF files is blog platform migration, e.g. from WordPress to <a href=\"https://www.11ty.dev/\" rel=\"noreferrer\">Eleventy</a>, or from Blogger to <a href=\"https://quarto.org/\" rel=\"noreferrer\">Quarto</a>. While import scripts from other popular platforms exist, this generic archiving format should make it easier to migrate to any blogging platform. More work is of course needed to write import filters for specific platforms, but this is a big step forward.</p><p>Finally, the archival PDFs should make it easier to upload full-text content and metadata to other repository platforms, and the obvious starting point is other repositories also using the InvenioRDM platform.</p><p>Please reach out via&nbsp;<a href=\"https://join.slack.com/t/rogue-scholar/shared_invite/zt-2ylpq1yoy-o~TkxDarfz5LSMhGSCYtiA\" rel=\"noreferrer\">Slack</a>,&nbsp;<a href=\"mailto:info@rogue-scholar.org\" rel=\"noreferrer\">email</a>,&nbsp;<a href=\"https://wisskomm.social/@rogue_scholar\" rel=\"noreferrer\">Mastodon</a>, or&nbsp;<a href=\"https://bsky.app/profile/rogue-scholar.bsky.social\" rel=\"noreferrer\">Bluesky</a>&nbsp;if you have any questions or comments</p><div class=\"kg-card kg-callout-card kg-callout-card-blue\"><div class=\"kg-callout-text\">Rogue Scholar is a scholarly infrastructure that is free for all authors and readers. You can support Rogue Scholar with a one-time or recurring&nbsp;<a href=\"https://ko-fi.com/rogue_scholar\" rel=\"noreferrer\">donation</a>&nbsp;or by becoming a sponsor.</div></div><h2 id=\"references\">References</h2><ol><li>Fenner, M. (2010, December 5). Blogging Beyond the PDF. <em>Front Matter</em>. <a href=\"https://doi.org/10.53731/r294649-6f79289-8cw7p\">https://doi.org/10.53731/r294649-6f79289-8cw7p</a></li><li>Fenner, M. (2008, October 3). Papers: Interview with Alexander Griekspoor. <em>Front Matter</em>. <a href=\"https://doi.org/10.53731/fy8ppqw-wctn03p\">https://doi.org/10.53731/fy8ppqw-wctn03p</a></li><li>Fenner, M. (2009, March 15). Reference Manager Overview. <em>Front Matter</em>. <a href=\"https://doi.org/10.53731/r294649-6f79289-8cw42\">https://doi.org/10.53731/r294649-6f79289-8cw42</a></li><li>Fenner, M. (2023, October 30). Starting November, all Rogue Scholar blog posts will be archived by the Internet Archive. <em>Front Matter</em>. <a href=\"https://doi.org/10.53731/hhtx0-wb293\">https://doi.org/10.53731/hhtx0-wb293</a></li></ol>","doi":"https://doi.org/10.53731/apaab-tkq88","guid":"https://doi.org/10.53731/apaab-tkq88","image":"https://storage.ghost.io/c/c5/33/c533c955-b5f3-4ff1-ae2d-6b52a212e602/content/images/2026/09/3367901850_3875429813.jpg","language":"en","license":"https://creativecommons.org/licenses/by/4.0/legalcode","published_at":1788739200,"reference":[{"id":"https://doi.org/10.53731/r294649-6f79289-8cw7p","unstructured":"Fenner, M. (2010, December 5). Blogging Beyond the PDF. <i>Front Matter</i>."},{"id":"https://doi.org/10.53731/fy8ppqw-wctn03p","unstructured":"Fenner, M. (2008, October 3). Papers: Interview with Alexander Griekspoor. <i>Front Matter</i>."},{"id":"https://doi.org/10.53731/r294649-6f79289-8cw42","unstructured":"Fenner, M. (2009, March 15). Reference Manager Overview. <i>Front Matter</i>."},{"id":"https://doi.org/10.53731/hhtx0-wb293","unstructured":"Fenner, M. (2023, October 30). Starting November, all Rogue Scholar blog posts will be archived by the Internet Archive. <i>Front Matter</i>."}],"rid":"91f7b-03c45","summary":"The Rogue Scholar science blog archive has now archived all its currently 55,730 blog posts as PDF files. These PDF files use the archival PDF/A-3A format and include the full-text HTML blog post with metadata embedded as Schema.org attachment, and their PDF URLs are included in the Crossref metadata. Blog posts are published as web pages in HTML format and often authored in Markdown format. So why PDF?","tags":["Rogue Scholar","Commonmeta","InvenioRDM"],"title":"Rogue Scholar has archived all blog posts as PDF","updated_at":1788852605,"url":"https://blog.front-matter.de/posts/rogue-scholar-has-archived-all-blog-posts-as-pdf/","version":"v1"}},{"document":{"authors":[{"contributor_roles":[],"family":"Chachereau","given":"Nicolas"}],"blog":{"authors":null,"community_id":"310eb31b-74ce-47d8-9f4f-7ae4dae66b49","created":1708300800,"current_feed_url":null,"description":null,"doi":"https://doi.org/10.59350/zotero_fr","favicon":"https://rogue-scholar.org/api/communities/310eb31b-74ce-47d8-9f4f-7ae4dae66b49/logo","feed_format":"application/atom+xml","feed_url":"https://zotero.hypotheses.org/feed/atom/","filter":null,"generator":"WordPress","home_page_url":"https://zotero.hypotheses.org","issn":null,"language":"fra","license":"https://creativecommons.org/licenses/by/4.0/legalcode","prefix":"10.59350","relative_url":null,"secure":true,"slug":"zotero_fr","status":"active","subfield":"1710","title":"Le blog Zotero francophone","updated":1788191754,"use_api":true},"blog_name":"Le blog Zotero francophone","blog_slug":"zotero_fr","content_html":"<p>Il y a deux ans environ, le projet Zotero a obtenu une bourse pour <a\nhref=\"http://zotero.hypotheses.org/630\">\u00e9valuer l'usage de Zotero pour\ndes mesures bibliom\u00e9triques alternatives</a> (<em>altmetrics</em>),\nattentives notamment \u00e0 l'impact des recherches dans les m\u00e9dias sociaux.\nDans le cadre de cette recherche, un sondage en ligne est ouvert en ce\nmoment concernant les pratiques des utilisateurs Zotero et leurs\nattentes et opinions en mati\u00e8re de mesures bibliom\u00e9triques. Les\nr\u00e9sultats permettront d'affiner les futurs d\u00e9veloppements de Zotero dans\nce domaine.</p>\n<p>Nous relayons ici <a\nhref=\"https://www.zotero.org/blog/indiana-university-survey-of-zotero-users/\">la\nnouvelle du blog Zotero officiel</a> et encourageons toutes les\nlectrices et lecteurs du blog \u00e0 <a\nhref=\"https://iu.co1.qualtrics.com/jfe5/form/SV_d6iQgfyRaPBBHgh\">participer\n\u00e0 ce sondage</a> (en anglais). C'est un sondage anonyme sur une base\nvolontaire. Il ne prend que peu de temps \u00e0 remplir.</p>\n<p><strong><a\nhref=\"https://iu.co1.qualtrics.com/jfe5/form/SV_d6iQgfyRaPBBHgh\">Participer\nau sondage\u00a0!</a></strong></p>","doi":"https://doi.org/10.59350/ghg3m-40872","guid":"http://zotero.hypotheses.org/?p=1040","language":"fr","license":"https://creativecommons.org/licenses/by/4.0/legalcode","published_at":1460937600,"rid":"51dvr-gmf84","summary":"Il y a deux ans environ, le projet Zotero a obtenu une bourse pour \u00e9valuer l'usage de Zotero pour des mesures bibliom\u00e9triques alternatives ( <em> altmetrics </em> ), attentives notamment \u00e0 l'impact des recherches dans les m\u00e9dias sociaux. Dans le cadre de cette recherche, un sondage en ligne est ouvert en ce moment concernant les pratiques des utilisateurs Zotero et leurs attentes et opinions en mati\u00e8re de mesures bibliom\u00e9triques.","tags":["Actualit\u00e9s"],"title":"Sondage sur les usages de Zotero","updated_at":1788839599,"url":"https://zotero.hypotheses.org/1040","version":"v1"}},{"document":{"authors":[{"contributor_roles":[],"name":"Collectif"}],"blog":{"authors":null,"community_id":"310eb31b-74ce-47d8-9f4f-7ae4dae66b49","created":1708300800,"current_feed_url":null,"description":null,"doi":"https://doi.org/10.59350/zotero_fr","favicon":"https://rogue-scholar.org/api/communities/310eb31b-74ce-47d8-9f4f-7ae4dae66b49/logo","feed_format":"application/atom+xml","feed_url":"https://zotero.hypotheses.org/feed/atom/","filter":null,"generator":"WordPress","home_page_url":"https://zotero.hypotheses.org","issn":null,"language":"fra","license":"https://creativecommons.org/licenses/by/4.0/legalcode","prefix":"10.59350","relative_url":null,"secure":true,"slug":"zotero_fr","status":"active","subfield":"1710","title":"Le blog Zotero francophone","updated":1788191754,"use_api":true},"blog_name":"Le blog Zotero francophone","blog_slug":"zotero_fr","content_html":"<p>Nous vous l'annoncions il y a quelques mois: le nouveau bouton de\ncapture, <a href=\"https://zotero.hypotheses.org/696\">qui venait d'\u00eatre\nmis en place sur Firefox</a>, allait \u00eatre mis en place pour d'autres\nnavigateurs. C'est d\u00e9sormais chose faite pour Google Chrome\u00a0! (Les\nutilisateurs de Safari doivent encore patienter un peu.)</p>\n<p>\u00c0 noter: Ce billet est une adaptation de l'<a\nhref=\"https://www.zotero.org/blog/a-better-save-to-zotero-button-in-chrome/\">annonce\nofficielle sur le blog Zotero</a>.</p>\n<p>Petit rappel : jusque-l\u00e0, si l'extension Zotero pour Chrome d\u00e9tectait\nune r\u00e9f\u00e9rence sur une page web, il affichait une ic\u00f4ne dans la barre\nd'adresse. Pour les pages sur lesquelles l'extension ne pouvait pas\ntrouver de r\u00e9f\u00e9rences, on pouvait faire un clic droit sur la page et\nchoisir \u00ab<em>Save Page to Zotero</em>\u00bb, pour ajouter un document Page\nWeb et une capture dans sa biblioth\u00e8que.</p>\n<p>Depuis la derni\u00e8re version de l'extension Chrome, il est possible\nd'utiliser <strong>le m\u00eame bouton, qui figure en permanence dans la\nbarre d'outils, pour enregistrer un document depuis n'importe quelle\npage</strong> :</p>\n<p><img\nsrc=\"http://zotero.hypotheses.org/files/2016/04/chrome-button.png\"\nclass=\"aligncenter size-full wp-image-1050\" decoding=\"async\"\nloading=\"lazy\"\nsrcset=\"https://zotero.hypotheses.org/files/2016/04/chrome-button.png 565w, https://zotero.hypotheses.org/files/2016/04/chrome-button-300x57.png 300w\"\nsizes=\"(max-width: 565px) 100vw, 565px\" width=\"565\" height=\"108\"\nalt=\"Exemple du nouveau bouton Chrome sur la page lemonde.fr\" /></p>\n<p>Si l'extension d\u00e9tecte une r\u00e9f\u00e9rence, le bouton affiche la m\u00eame ic\u00f4ne\nque par le pass\u00e9: un livre, un journal, un article de revue, un dossier,\netc. Sur toute autre page, vous verrez une ic\u00f4ne grise qui permettra\nl'enregistrement d'un document Page Web, avec une capture et les\ninformations les plus basiques la concernant (titre, URL, date de\nconsultation).</p>\n<p>Ce bouton unique et simplifi\u00e9 constitue l'avantage principal apport\u00e9\npar cette mise \u00e0 jour. Deux autres nouveaut\u00e9s font leur apparition.</p>\n<p>D'une part, un menu d\u00e9roulant permet de <strong>choisir d'autres\nmani\u00e8res d'importer les r\u00e9f\u00e9rences</strong>. En g\u00e9n\u00e9ral, le clic sur le\nbouton reste la meilleure solution. Dans certains cas, le menu d\u00e9roulant\napporte quelques avantages, que vous pouvez d\u00e9couvrir dans le billet que\nnous avions consacr\u00e9 \u00e0 la version Firefox: <a\nhref=\"http://zotero.hypotheses.org/865\">Ajouter une r\u00e9f\u00e9rence avec le\nnouveau menu</a>.</p>\n<p>D'autre part, il est d\u00e9sormais possible d'<strong>enregistrer un PDF\ndans Zotero par un seul clic</strong>.</p>\n<p><img\nsrc=\"http://zotero.hypotheses.org/files/2016/04/chrome_toolbar_button_pdf-300x188.png\"\nclass=\"aligncenter size-medium wp-image-1051\" decoding=\"async\"\nloading=\"lazy\"\nsrcset=\"https://zotero.hypotheses.org/files/2016/04/chrome_toolbar_button_pdf-300x188.png 300w, https://zotero.hypotheses.org/files/2016/04/chrome_toolbar_button_pdf.png 664w\"\nsizes=\"(max-width: 300px) 100vw, 300px\" width=\"300\" height=\"188\"\nalt=\"Sauvegarder un PDF avec le nouveau bouton\" /></p>\n<p>Jusque-l\u00e0, l'enregistrement d'un PDF n\u00e9cessitait de le faire glisser\ndepuis la barre d'adresse pour le d\u00e9poser dans Zotero ou de\nl'enregistrer en local, puis de l'ajouter manuellement dans Zotero.\nD\u00e9sormais, lorsque vous affichez un fichier PDF dans Chrome, il vous\nsuffit de cliquer sur le nouveau bouton de capture dans la barre\nd'outils pour enregistrer le PDF dans Zotero.<a href=\"#fn1\" id=\"refn1\"\ntitle=\"\u00c0 condition toutefois que vous disposiez de la version 4.0.29 ou sup\u00e9rieure de Zotero Standalone.\"><sup>1</sup></a>\nIl est cependant import\u00e9 comme simple fichier PDF, sans \u00eatre attach\u00e9 \u00e0\nune r\u00e9f\u00e9rence bibliographique plus compl\u00e8te. Pour cr\u00e9er une telle\nr\u00e9f\u00e9rence, vous pouvez soit tenter de \u00abR\u00e9cup\u00e9rer les m\u00e9tadonn\u00e9es du\nPDF\u00bb, soit \u00abCr\u00e9er un document parent\u00bb \u00e0 remplir manuellement. Ces deux\noptions sont accessibles par un clic-droit sur le PDF. Dans une\nprochaine version, Zotero tentera de cr\u00e9er un \u00e9l\u00e9ment parent\nautomatiquement.</p>\n<p><img\nsrc=\"http://zotero.hypotheses.org/files/2016/04/PDF-metadata.png\"\nclass=\"aligncenter size-full wp-image-1052\" decoding=\"async\"\nloading=\"lazy\"\nsrcset=\"https://zotero.hypotheses.org/files/2016/04/PDF-metadata.png 648w, https://zotero.hypotheses.org/files/2016/04/PDF-metadata-300x194.png 300w\"\nsizes=\"(max-width: 648px) 100vw, 648px\" width=\"648\" height=\"420\"\nalt=\"Clic-droit sur un PDF, montrant l&#39;option \u00abR\u00e9cup\u00e9rer les m\u00e9tadonn\u00e9es du PDF\u00bb\" /></p>\n<p>En d\u00e9pit du nouveau bouton, <strong>certaines limitations\npersistent</strong>. Notons en deux. Premi\u00e8rement, tant que la page web\nn'a pas fini de charger dans Chrome, l'extension Zotero n'affiche que\nl'ic\u00f4ne grise de capture de page web, m\u00eame si la page contient une ou\nplusieurs r\u00e9f\u00e9rences bibliographiques. Deuxi\u00e8mement, la capture de page\nweb ne fonctionne pas si Zotero Standalone n'est pas ouvert. L\u00e0 aussi,\nune am\u00e9lioration est pr\u00e9vue et une future version permettra\nd'enregistrer des pages web directement dans votre compte zotero.org\nquand Standalone n'est pas ouvert (comme c'est d\u00e9j\u00e0 le cas pour les\nautres types de r\u00e9f\u00e9rences).</p>\n<p>Si vous avez install\u00e9 la derni\u00e8re version de Chrome, votre extension\nZotero devrait \u00eatre mise \u00e0 jour automatiquement. Si vous n'utilisez pas\nactuellement Zotero avec Chrome, vous pouvez <a\nhref=\"https://chrome.google.com/webstore/detail/zotero-connector/ekhagklcjbdpajgpjgmbionohlpdbjgc\">installer\nl'extension depuis le Chrome Web Store</a>. Dans un cas comme dans\nl'autre, pour b\u00e9n\u00e9ficier de la meilleure exp\u00e9rience, assurez-vous\nd'avoir install\u00e9 <a href=\"https://www.zotero.org/download/\">Zotero\nStandalone</a>\u00a0!</p>\n<p><span id=\"fn1\">1.</span> \u00c0 condition toutefois que vous disposiez de\nla version 4.0.29 ou sup\u00e9rieure de Zotero Standalone. <a\nhref=\"#refn1\">\u21a9\ufe0e</a></p>","doi":"https://doi.org/10.59350/3jnpb-zrw59","guid":"http://zotero.hypotheses.org/?p=1039","image":"http://zotero.hypotheses.org/files/2016/04/chrome-button.png","language":"fr","license":"https://creativecommons.org/licenses/by/4.0/legalcode","published_at":1461283200,"rid":"dn6mh-cw521","summary":"Nous vous l'annoncions il y a quelques mois: le nouveau bouton de capture, qui venait d'\u00eatre mis en place sur Firefox, allait \u00eatre mis en place pour d'autres navigateurs. C'est d\u00e9sormais chose faite pour Google Chrome ! (Les utilisateurs de Safari doivent encore patienter un peu.) \u00c0 noter: Ce billet est une adaptation de l'annonce officielle sur le blog Zotero.","tags":["Actualit\u00e9s"],"title":"Un enregistrement plus facile sur Chrome !","updated_at":1788839597,"url":"https://zotero.hypotheses.org/1039","version":"v1"}}],"items":[{"authors":[{"contributor_roles":[],"family":"Rogel-Salazar","given":"Rosario"},{"contributor_roles":[],"family":"Li","given":"Xiuqi"},{"contributor_roles":[],"family":"Do\u011fan","given":"G\u00fcleda"}],"blog":{"authors":null,"community_id":"b56ef314-34f7-4c7f-b0e2-d0bf13bfe83b","created":1673568000,"current_feed_url":"https://upstream.force11.org/atom/","description":"The community blog for all things Open Research.","doi":"https://doi.org/10.54900/upstream","favicon":"https://rogue-scholar.org/api/communities/b56ef314-34f7-4c7f-b0e2-d0bf13bfe83b/logo","feed_format":"application/atom+xml","feed_url":"https://upstream.force11.org/atom-complete/","filter":null,"generator":"Ghost","home_page_url":"https://upstream.force11.org","issn":null,"language":"eng","license":"https://creativecommons.org/licenses/by/4.0/legalcode","prefix":"10.54900","relative_url":null,"secure":true,"slug":"upstream","status":"active","subfield":"1802","title":"Upstream","updated":1788858023,"use_api":true},"blog_name":"Upstream","blog_slug":"upstream","content_html":"<p>Over the past decade, Open Science has transformed the way we create, share, and evaluate research. Among the many domains of Open Science (Bertram et al. 2023), two have received growing attention: open data and open peer review.</p><p>Yet these two worlds do not often meet.</p><p>We regularly discuss the importance of sharing data to support transparency, reproducibility, and reuse (Wilkinson et al. 2016). We also explore new approaches to peer review that are more open, inclusive, and collaborative (Ross-Hellauer et al. 2023). But we rarely stop to ask what happens when datasets themselves become the subject of review.</p><p>Recent initiatives have begun exploring ways to connect open data and open peer review (Modular Peer Review; Sansing and Wilkinson 2025). One notable development came in&nbsp; November 2025, when <a href=\"https://prereview.org\" rel=\"noreferrer\">PREreview</a> introduced support on their platform for reviewing datasets deposited in <a href=\"https://datadryad.org/\"><u>Dryad</u></a>, an open-access general-purpose data repository. It is in this context that the <a href=\"https://prereview.org/clubs/force11\"><u>FORCE11 PREreview Club</u></a> was invited to pilot a collaborative and structured dataset review process. Our review of the dataset, \"Leverage metrics to drive data sharing at the Science journals\" by Valda Vinson and Lauren Kmec (2025), is now posted on PREreview and archived on Zenodo (Akuma et al. 2026). It is the first open review of a dataset shared on PREreview.</p><p>In this blog post, we reflect on that experience, discuss what we learned, and consider the opportunities of dataset review as an emerging scholarly practice.</p><h2 id=\"reviewing-more-than-results\">Reviewing More Than Results</h2><p>The Vinson and Kmec dataset (2025) focuses on data and code-sharing practices in articles published by Science. At first glance, it seemed like an ideal case study: data deposited in an open repository, documentation available for users, and a topic closely connected to Open Science itself.</p><p>As our discussion unfolded, however, it became clear that reviewing a dataset involves different questions from those we typically ask when reviewing a preprint or a journal article. Rather than focusing solely on findings or conclusions, we found ourselves examining the processes behind the data. How were key variables constructed? How transparent were the classification methods? What assumptions shaped the dataset? How reproducible was the workflow? And what limitations should future users keep in mind when reusing the data?</p><p>Very quickly, the conversation moved into topics such as <a href=\"https://www.go-fair.org/fair-principles/\"><u>FAIR</u></a> and <a href=\"https://www.gida-global.org/careprinciples\"><u>CARE</u></a> principles, metadata quality, methodological transparency, provenance, responsible reuse, and the implications of using automated systems to measure Open Science practices.</p><p>In a sense, the review became a metascientific exercise: a group of researchers evaluating a dataset designed to measure behaviors associated with Open Science itself. What began as a discussion about a dataset soon became a broader conversation about trust, transparency, and how we assess research outputs beyond traditional publications.</p><h2 id=\"a-conversation-across-research-communities\">A Conversation Across Research Communities</h2><p>One of the most rewarding aspects of the experience was the diversity of perspectives involved in the review. The review brought together researchers based in India, Mexico, T\u00fcrkiye, the United Kingdom, and the United States, with backgrounds spanning scholarly communication, research assessment, bibliometrics, data management, and Open Science.</p><p>Although we were all reviewing the same dataset, we examined it through vastly different lenses. Some participants focused on reproducibility and workflow validation. Others paid closer attention to metadata quality, cross-publisher comparisons, methodological transparency, or the broader ethical and geopolitical implications of data reuse.</p><p>&nbsp;These different and diverse perspectives enriched the discussion. Together, they helped us develop a more nuanced understanding of the dataset, its strengths, and its limitations than any one of us could likely have achieved alone.</p><p>This collaborative process also highlighted one of the strengths of open, collaborative peer review. When reviewers bring different experiences, disciplinary backgrounds, and regional perspectives to the table, evaluation becomes more than quality control\u2014it becomes a form of collegial discourse and collective learning.</p><h2 id=\"open-data-is-not-the-end-of-the-story\">Open Data Is Not the End of the Story</h2><p>Perhaps the most important lesson for us was seeing how open review can help bridge the distance between data producers and data users.</p><p>One of the greatest challenges in data reuse is not simply gaining access to data, but understanding the context in which the data were created, the decisions that shaped them, and the limitations that accompany their use. Datasets rarely speak entirely for themselves. Even well-documented data often leave room for questions about methods, assumptions, and interpretation.</p><p>Open review creates a space where those questions can be raised collectively, transparently, and constructively. It also provides an opportunity for data producers and data users to engage in dialogue, helping to clarify uncertainties, identify issues that may affect reuse, and strengthen future versions of a dataset.&nbsp;</p><p>The experience also reminded us that making data available is not the same as making data understandable, reusable, or trustworthy for every purpose. Openness requires infrastructure, but it also requires documentation, clear licensing, robust metadata, methodological transparency, and ongoing dialogue with the communities that may eventually reuse the data. As datasets evolve through updates, corrections, and new versions, community feedback can play an important role in supporting their long-term reusability.</p><p>In other words, depositing a dataset in a repository is not the end of the story.&nbsp; Rather, it marks the beginning of a new phase for data to become part of the broader scientific discourse. Once shared, datasets can be scrutinized, debated, and critiqued, just like preprints and journal articles. Through review and reuse, datasets can contribute to the refinement of existing knowledge, the generation of new insights, and the advancement of future research.</p><p>This experience also reminded us that Open Science extends beyond open access to publications. While open access remains one of its most visible achievements, practices such as open data, open peer review, and responsible data reuse are equally important for building a more transparent and collaborative research ecosystem.</p><h2 id=\"open-data-and-open-review-better-together\">Open Data and Open Review: Better Together</h2><p>Our open dataset review pilot for PREreview does not answer every question about how research data should be evaluated. But it does demonstrate something important: open data and open review are not separate practices.</p><p>When combined, they create new opportunities to strengthen transparency, accountability, and reuse across the research ecosystem. Open data makes reuse possible. Open review helps us understand what we are reusing, how it was created, and what limitations we should keep in mind. Together, they move us closer to a vision of Open Science that extends beyond access alone\u2014one that values not only the availability of research outputs, but also the conversations, feedback, and collective stewardship that help make those outputs meaningful and reusable.</p><p>Finally, we would like to thank Jennifer M. Miller for her thoughtful coordination of the review and collaborative writing process, as well as Daniela Saderi and the PREreview team for creating and continuously improving spaces where open and community-driven approaches to research assessment can flourish.</p><p>Perhaps that is the most valuable lesson from this experience: opening data matters, but opening the conversation around data can be just as transformative.</p><h2 id=\"references\">References</h2><ol><li>Akuma, I., Dogan, G., Spick, M., Rogel-Salazar, R., &amp; Li, X. (2026, June 5). Structured PREreview of \"Leveraging metrics to drive data sharing at the Science journals.\" <a href=\"https://prereview.org/reviews/1d1731cb-e9b9-4bb4-b636-98c235379cc6\"><u>https://prereview.org/reviews/1d1731cb-e9b9-4bb4-b636-98c235379cc6</u></a></li><li>Bertram, M. G., Sundin, J., Roche, D. G., S\u00e1nchez-T\u00f3jar, A., Thor\u00e9, E. S. J., &amp; Brodin, T. (2023). Open science. Current Biology: CB, 33(15), R792\u2013R797. <a href=\"https://doi.org/10.1016/j.cub.2023.05.036\"><u>https://doi.org/10.1016/j.cub.2023.05.036</u></a>&nbsp;</li><li>Modular Peer Review. (n.d.). Continuous Science Foundation. Retrieved June 6, 2026, from <a href=\"https://continuousfoundation.org/peer-review\"><u>https://continuousfoundation.org/peer-review</u></a>&nbsp;</li><li>Ross-Hellauer, T., Bouter, L. M., &amp; Horbach, S. P. J. M. (2023). Open peer review urgently requires evidence: A call to action. PLoS Biology, 21(10), e3002255. <a href=\"https://doi.org/10.1371/journal.pbio.3002255\"><u>https://doi.org/10.1371/journal.pbio.3002255</u></a>&nbsp;</li><li>Sansing, C., &amp; Wilkinson, C. (2025, October 15). Now you can review datasets on PREreview.org. PREreview Blog. <a href=\"https://content.prereview.org/now-you-can-review-datasets-on-prereview-org/\"><u>https://content.prereview.org/now-you-can-review-datasets-on-prereview-org/</u></a>&nbsp;</li><li>Vinson, V., &amp; Kmec, L. (2025). Leveraging metrics to drive data sharing at the Science journals [Dataset]. Dryad. <a href=\"https://doi.org/10.5061/DRYAD.ZKH1893QT\"><u>https://doi.org/10.5061/DRYAD.ZKH1893QT</u></a>&nbsp;</li><li>Wilkinson, M. D., Dumontier, M., Aalbersberg, I. J. J., Appleton, G., Axton, M., Baak, A., Blomberg, N., Boiten, J.-W., da Silva Santos, L. B., Bourne, P. E., Bouwman, J., Brookes, A. J., Clark, T., Crosas, M., Dillo, I., Dumon, O., Edmunds, S., Evelo, C. T., Finkers, R., \u2026 Mons, B. (2016). The FAIR Guiding Principles for scientific data management and stewardship. Scientific Data, 3, 160018. <a href=\"https://doi.org/10.1038/sdata.2016.18\"><u>https://doi.org/10.1038/sdata.2016.18</u></a>&nbsp;</li></ol>","doi":"https://doi.org/10.54900/kfqec-0ne44","guid":"https://doi.org/10.54900/kfqec-0ne44","image":"https://images.unsplash.com/photo-1562564055-71e051d33c19?crop=entropy&cs=tinysrgb&fit=max&fm=jpg&ixid=M3wxMTc3M3wwfDF8c2VhcmNofDM0N3x8cGVlciUyMHJldmlld3xlbnwwfHx8fDE3ODg1NzEwNDF8MA&ixlib=rb-4.1.0&q=80&w=2000","language":"en","license":"https://creativecommons.org/licenses/by/4.0/legalcode","published_at":1788825600,"reference":[{"id":"https://prereview.org/reviews/1d1731cb-e9b9-4bb4-b636-98c235379cc6","unstructured":"Akuma, I., Dogan, G., Spick, M., Rogel-Salazar, R., & Li, X. (2026, June 5). Structured PREreview of \"Leveraging metrics to drive data sharing at the Science journals.\""},{"id":"https://doi.org/10.1016/j.cub.2023.05.036","unstructured":"Bertram, M. G., Sundin, J., Roche, D. G., S\u00e1nchez-T\u00f3jar, A., Thor\u00e9, E. S. J., & Brodin, T. (2023). Open science. Current Biology: CB, 33(15), R792\u2013R797."},{"id":"https://continuousfoundation.org/peer-review","unstructured":"Modular Peer Review. (n.d.). Continuous Science Foundation. Retrieved June 6, 2026, from"},{"id":"https://doi.org/10.1371/journal.pbio.3002255","unstructured":"Ross-Hellauer, T., Bouter, L. M., & Horbach, S. P. J. M. (2023). Open peer review urgently requires evidence: A call to action. PLoS Biology, 21(10), e3002255."},{"id":"https://content.prereview.org/now-you-can-review-datasets-on-prereview-org/","unstructured":"Sansing, C., & Wilkinson, C. (2025, October 15). Now you can review datasets on PREreview.org. PREreview Blog."},{"id":"https://doi.org/10.5061/dryad.zkh1893qt","unstructured":"Vinson, V., & Kmec, L. (2025). Leveraging metrics to drive data sharing at the Science journals [Dataset]. Dryad. https://doi.org/10.5061/DRYAD.ZKH1893QT"},{"id":"https://doi.org/10.1038/sdata.2016.18","unstructured":"Wilkinson, M. D., Dumontier, M., Aalbersberg, I. J. J., Appleton, G., Axton, M., Baak, A., Blomberg, N., Boiten, J.-W., da Silva Santos, L. B., Bourne, P. E., Bouwman, J., Brookes, A. J., Clark, T., Crosas, M., Dillo, I., Dumon, O., Edmunds, S., Evelo, C. T., Finkers, R., \u2026 Mons, B. (2016). The FAIR Guiding Principles for scientific data management and stewardship. Scientific Data, 3, 160018."}],"rid":"ff18x-dmv18","summary":"Over the past decade, Open Science has transformed the way we create, share, and evaluate research. Among the many domains of Open Science (Bertram et al. 2023), two have received growing attention: open data and open peer review. Yet these two worlds do not often meet.","tags":["Insights"],"title":"When Data Meets Review: Reflections on PREreview's First Open Dataset Review","updated_at":1788858078,"url":"https://upstream.force11.org/when-data-meets-review-reflections-on-prereviews-first-open-dataset-review-2/","version":"v1"},{"authors":[{"affiliation":[{"id":"https://ror.org/0153tk833","name":"University of Virginia"}],"contributor_roles":[],"family":"Turner","given":"Stephen","url":"https://orcid.org/0000-0001-9140-9028"}],"blog":{"authors":[{"name":"Stephen Turner"}],"community_id":"382941a7-2ffa-41df-8bbb-5f772188517f","created":1780876800,"current_feed_url":null,"description":"A practicing data scientist's take on AI, genomics, biosecurity, and the ways AI is reshaping how science gets done. Weekly updates from the field. Occasional notes on programming.","doi":"https://doi.org/10.59350/stephenturner","favicon":"https://rogue-scholar.org/api/communities/382941a7-2ffa-41df-8bbb-5f772188517f/logo","feed_format":"application/rss+xml","feed_url":"https://blog.stephenturner.us/feed","filter":null,"generator":"Substack","home_page_url":"https://blog.stephenturner.us","issn":null,"language":"eng","license":"https://creativecommons.org/licenses/by/4.0/legalcode","prefix":"10.59350","relative_url":null,"secure":true,"slug":"stephenturner","status":"active","subfield":"1311","title":"Paired Ends","updated":1788792247,"use_api":null},"blog_name":"Paired Ends","blog_slug":"stephenturner","content_html":"<div class=\"captioned-image-container\"><figure><a class=\"image-link image2 is-viewable-img\" target=\"_blank\" href=\"https://substackcdn.com/image/fetch/$s_!-M8z!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fbd8809ce-86ff-4726-a1a4-1e9bc1c14c9f_2591x1135.png\" data-component-name=\"Image2ToDOM\"><div class=\"image2-inset\"><picture><source type=\"image/webp\" srcset=\"https://substackcdn.com/image/fetch/$s_!-M8z!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fbd8809ce-86ff-4726-a1a4-1e9bc1c14c9f_2591x1135.png 424w, https://substackcdn.com/image/fetch/$s_!-M8z!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fbd8809ce-86ff-4726-a1a4-1e9bc1c14c9f_2591x1135.png 848w, https://substackcdn.com/image/fetch/$s_!-M8z!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fbd8809ce-86ff-4726-a1a4-1e9bc1c14c9f_2591x1135.png 1272w, https://substackcdn.com/image/fetch/$s_!-M8z!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fbd8809ce-86ff-4726-a1a4-1e9bc1c14c9f_2591x1135.png 1456w\" sizes=\"100vw\"><img src=\"https://substackcdn.com/image/fetch/$s_!-M8z!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fbd8809ce-86ff-4726-a1a4-1e9bc1c14c9f_2591x1135.png\" width=\"1456\" height=\"638\" data-attrs=\"{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/bd8809ce-86ff-4726-a1a4-1e9bc1c14c9f_2591x1135.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:638,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:673160,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:false,&quot;topImage&quot;:true,&quot;internalRedirect&quot;:&quot;https://blog.stephenturner.us/i/206299798?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fbd8809ce-86ff-4726-a1a4-1e9bc1c14c9f_2591x1135.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}\" class=\"sizing-normal\" alt=\"\" srcset=\"https://substackcdn.com/image/fetch/$s_!-M8z!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fbd8809ce-86ff-4726-a1a4-1e9bc1c14c9f_2591x1135.png 424w, https://substackcdn.com/image/fetch/$s_!-M8z!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fbd8809ce-86ff-4726-a1a4-1e9bc1c14c9f_2591x1135.png 848w, https://substackcdn.com/image/fetch/$s_!-M8z!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fbd8809ce-86ff-4726-a1a4-1e9bc1c14c9f_2591x1135.png 1272w, https://substackcdn.com/image/fetch/$s_!-M8z!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fbd8809ce-86ff-4726-a1a4-1e9bc1c14c9f_2591x1135.png 1456w\" sizes=\"100vw\" fetchpriority=\"high\"></picture><div class=\"image-link-expand\"><div class=\"pencraft pc-display-flex pc-gap-8 pc-reset\"><button tabindex=\"0\" type=\"button\" class=\"pencraft pc-reset pencraft icon-container restack-image\"><svg aria-hidden=\"true\" width=\"20\" height=\"20\" viewBox=\"0 0 20 20\" fill=\"none\" stroke-width=\"1.5\" stroke=\"var(--color-fg-primary)\" stroke-linecap=\"round\" stroke-linejoin=\"round\" xmlns=\"http://www.w3.org/2000/svg\"><g><path d=\"M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882\"></path></g></svg></button><button tabindex=\"0\" type=\"button\" class=\"pencraft pc-reset pencraft icon-container view-image\"><svg xmlns=\"http://www.w3.org/2000/svg\" width=\"20\" height=\"20\" viewBox=\"0 0 24 24\" fill=\"none\" stroke=\"currentColor\" stroke-width=\"2\" stroke-linecap=\"round\" stroke-linejoin=\"round\" class=\"lucide lucide-maximize2 lucide-maximize-2\"><polyline points=\"15 3 21 3 21 9\"></polyline><polyline points=\"9 21 3 21 3 15\"></polyline><line x1=\"21\" x2=\"14\" y1=\"3\" y2=\"10\"></line><line x1=\"3\" x2=\"10\" y1=\"21\" y2=\"14\"></line></svg></button></div></div></div></a></figure></div><p>After I <a href=\"https://blog.stephenturner.us/p/ai-dry-july-aborted\">abandoned the no-AI-for-a-month thing</a>, I'm making up for lost time here. Only thing is now that I'm doing some fairly long-horizon multiagent work in Claude Code and Cowork, I'm frequently blowing through my session limit with just one or two prompts. I've written about this session limit anxiety before. </p><div class=\"digest-post-embed\" data-attrs=\"{&quot;nodeId&quot;:&quot;fee52fa3-dca3-47a6-9fde-a755b7ca4717&quot;,&quot;caption&quot;:&quot;Claude Code can erode your work-life balance if you're not careful. I'm generally pretty good about turning off and not working at home in the evenings. But Claude Code has opened up a loophole in my own discipline. Typing a few prompts and walking away doesn't feel like working. It's not like sitting down to write code for an hour. You fire off a plann\u2026&quot;,&quot;cta&quot;:null,&quot;showBylines&quot;:true,&quot;showDescription&quot;:true,&quot;showImage&quot;:true,&quot;size&quot;:&quot;sm&quot;,&quot;isEditorNode&quot;:true,&quot;title&quot;:&quot;The Four-Hour Session Treadmill&quot;,&quot;publishedBylines&quot;:[{&quot;id&quot;:1536121,&quot;name&quot;:&quot;Stephen D. Turner&quot;,&quot;bio&quot;:&quot;https://stephenturner.us/&quot;,&quot;photo_url&quot;:&quot;https://substackcdn.com/image/fetch/$s_!WGQE!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd1706730-c948-4acf-9c45-b14b4e3da1b9_651x651.jpeg&quot;,&quot;is_guest&quot;:false,&quot;bestseller_tier&quot;:null}],&quot;post_date&quot;:&quot;2026-03-16T09:08:41.323Z&quot;,&quot;cover_image&quot;:&quot;https://substackcdn.com/image/fetch/$s_!IrpV!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd83dbdd0-7a10-494b-ae53-460c3ae62990_1823x957.jpeg&quot;,&quot;cover_image_alt&quot;:null,&quot;canonical_url&quot;:&quot;https://blog.stephenturner.us/p/the-four-hour-session-treadmill-claude&quot;,&quot;section_name&quot;:null,&quot;video_upload_id&quot;:null,&quot;id&quot;:190748764,&quot;type&quot;:&quot;newsletter&quot;,&quot;reaction_count&quot;:5,&quot;comment_count&quot;:0,&quot;publication_id&quot;:161890,&quot;publication_name&quot;:&quot;Paired Ends&quot;,&quot;publication_logo_url&quot;:&quot;https://substackcdn.com/image/fetch/$s_!hfDI!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F894081de-334e-4173-8a0c-e64762c2c838_1030x1030.png&quot;,&quot;belowTheFold&quot;:false,&quot;youtube_url&quot;:null,&quot;show_links&quot;:null,&quot;feed_url&quot;:null}\"></div><p>I'm an early morning person. My typical morning will start with a run or ride or sauna at 5am, and some work (<a href=\"https://bsky.app/profile/stephenturner.us/post/3muwp4upvzc2u\">personal projects</a> and day-job work) at around ~6-7 before the camp/school shuffle, and the bike into work. If I do some work with Claude at around 7:00am, my five-hour session limit starts and I typically hit my session limit quickly, which locks me into extra usage at API rates until 12:00pm. Assuming I start another session around noon, that'll extend until 5pm, when I'm normally wrapping things up and heading home. I.e., I'll get two five-hour sessions at most over the course of a normal workday.</p><p>I'm short-circuiting that with a little hack. I set my Mac to wake up every morning at 3:58am, and at 4:00am it'll run <code>claude -p \"hey\"</code>. That <code>-p</code> flag just tells Claude to print the output of running the prompt, which in this case is \"hey\". It barely uses any tokens, with Claude responding with something like \"hey what's up?\". </p><p>But the point is, now my session starts at 4am (instead of 7am), and resets at 9am (instead of 12pm), right about the time I'm settling into the office and getting back to work. Assuming I kick off another session-consuming prompt at 9am, that opens the door to a third session that starts at 2pm. The whole point is now I can get three full 5 hour sessions in a single workday instead of two if I kick off a session very early, effectively shortening my first \"session\" to 2 hours instead of 5.<a class=\"footnote-anchor\" data-component-name=\"FootnoteAnchorToDOM\" id=\"footnote-anchor-1\" href=\"#footnote-1\" target=\"_self\">1</a></p><p class=\"button-wrapper\" data-attrs=\"{&quot;url&quot;:&quot;https://blog.stephenturner.us/subscribe?&quot;,&quot;text&quot;:&quot;Subscribe now&quot;,&quot;action&quot;:null,&quot;class&quot;:null}\" data-component-name=\"ButtonCreateButton\"><a class=\"button primary\" href=\"https://blog.stephenturner.us/subscribe?\"><span>Subscribe now</span></a></p><h2>How to do it (on a Mac)</h2><p>I haven't used a Windows computer since Windows 98, so if you're not on Mac, ask Claude how to do this on Windows (Linux is easy with cron). On MacOS I'm using a Launch Agent.</p><p>First, set your mac to automatically wake up at 3:58am. Or whenever. Move this forward or backward depending on your daily routine. Point is to have this kick off a prompt a few hours before you really get to work.</p><div class=\"highlighted_code_block\" data-attrs=\"{&quot;language&quot;:&quot;shell&quot;,&quot;nodeId&quot;:null}\" data-component-name=\"HighlightedCodeBlockToDOM\"><pre class=\"shiki\"><code class=\"language-shell\"># Set an automatic wake every day at 3:58am\nsudo pmset repeat wake MTWRFSU 03:58:00\n# Test - make sure it works\npmset -g sched</code></pre></div><p>Then add a launch agent (like a cron job). </p><div class=\"highlighted_code_block\" data-attrs=\"{&quot;language&quot;:&quot;plaintext&quot;,&quot;nodeId&quot;:null}\" data-component-name=\"HighlightedCodeBlockToDOM\"><pre class=\"shiki\"><code class=\"language-plaintext\">vim ~Library/LaunchAgents/us.stephenturner.claudeping.plist</code></pre></div><p>Copy the text below into this file. Replace <code>/Users/sdt5z/.local/bin/claude</code> on line 11 with whatever is returned when you run <code>which claude</code>. You'll need to use a full path for this to work. </p><div class=\"highlighted_code_block\" data-attrs=\"{&quot;language&quot;:&quot;xml&quot;,&quot;nodeId&quot;:null}\" data-component-name=\"HighlightedCodeBlockToDOM\"><pre class=\"shiki\"><code class=\"language-xml\">&lt;?xml version=\"1.0\" encoding=\"UTF-8\"?&gt;\n&lt;!DOCTYPE plist PUBLIC \"-//Apple//DTD PLIST 1.0//EN\" \"http://www.apple.com/DTDs/PropertyList-1.0.dtd\"&gt;\n&lt;plist version=\"1.0\"&gt;\n&lt;dict&gt;\n    &lt;key&gt;Label&lt;/key&gt;\n    &lt;string&gt;us.stephenturner.claudeping&lt;/string&gt;\n    &lt;key&gt;ProgramArguments&lt;/key&gt;\n    &lt;array&gt;\n        &lt;string&gt;/bin/bash&lt;/string&gt;\n        &lt;string&gt;-lc&lt;/string&gt;\n        &lt;string&gt;/Users/sdt5z/.local/bin/claude -p \"hey\"&lt;/string&gt;\n    &lt;/array&gt;\n    &lt;key&gt;StartCalendarInterval&lt;/key&gt;\n    &lt;dict&gt;\n        &lt;key&gt;Hour&lt;/key&gt;&lt;integer&gt;4&lt;/integer&gt;\n        &lt;key&gt;Minute&lt;/key&gt;&lt;integer&gt;0&lt;/integer&gt;\n    &lt;/dict&gt;\n    &lt;key&gt;StandardOutPath&lt;/key&gt;\n    &lt;string&gt;/tmp/claudeping.log&lt;/string&gt;\n    &lt;key&gt;StandardErrorPath&lt;/key&gt;\n    &lt;string&gt;/tmp/claudeping.err&lt;/string&gt;\n&lt;/dict&gt;\n&lt;/plist&gt;\n</code></pre></div><p>Test, make sure it works (replace paths/filenames with whatever you called them).</p><div class=\"highlighted_code_block\" data-attrs=\"{&quot;language&quot;:&quot;shell&quot;,&quot;nodeId&quot;:null}\" data-component-name=\"HighlightedCodeBlockToDOM\"><pre class=\"shiki\"><code class=\"language-shell\"># Tear down the service if it already exists\nlaunchctl bootout gui/$(id -u)/us.stephenturner.claudeping 2&gt;/dev/null\n# Build it again\nlaunchctl bootstrap gui/$(id -u) ~/Library/LaunchAgents/us.stephenturner.claudeping.plist\n# Force the service to start\nlaunchctl kickstart -k gui/$(id -u)/us.stephenturner.claudeping\n# You're looking for an exit code 0\nlaunchctl print gui/$(id -u)/us.stephenturner.claudeping | grep -iE 'last exit|runs'\n# See the logs\ncat /tmp/claudeping.log /tmp/claudeping.err</code></pre></div><p>That's it. Enjoy that extra session while subscription-based subsidized usage lasts!</p><p class=\"button-wrapper\" data-attrs=\"{&quot;url&quot;:&quot;https://blog.stephenturner.us/subscribe?&quot;,&quot;text&quot;:&quot;Subscribe now&quot;,&quot;action&quot;:null,&quot;class&quot;:null}\" data-component-name=\"ButtonCreateButton\"><a class=\"button primary\" href=\"https://blog.stephenturner.us/subscribe?\"><span>Subscribe now</span></a></p><div class=\"footnote\" data-component-name=\"FootnoteToDOM\"><a id=\"footnote-1\" href=\"#footnote-anchor-1\" class=\"footnote-number\" contenteditable=\"false\" target=\"_self\">1</a><div class=\"footnote-content\"><p>Yes, I fully realize that I sound like a tokenmaxxing workaholic writing it out this way. I'm not using Claude Code 15 hours per day. In reality while using Opus or Fable you're going to hit a session limit on a $20 plan very quickly. This essentially gives me 3 windows to use Claude at subscription rates instead of 2 windows. Soon enough I'm sure everything's going to be metered at API rates, but for now I'm just trying to take advantage of those VC token subsidies while I can.</p></div></div>","doi":"https://doi.org/10.59350/tetv4-ynb16","guid":"206299798","image":"https://substack-post-media.s3.amazonaws.com/public/images/ce8299d1-8e5e-4f9d-bd8c-54d6f1474695_2596x1363.jpeg","language":"en","license":"https://creativecommons.org/licenses/by/4.0/legalcode","published_at":1788739200,"rid":"sw9z3-43v90","summary":"I automate a prompt to Claude Code very early, kicking off a session while I'm sleeping, effectively giving me three five hour sessions in a day for the price of two.","tags":["TIL","AI"],"title":"Sessionmaxxing Claude Code","updated_at":1788852610,"url":"https://blog.stephenturner.us/p/sessionmaxxing","version":"v1"},{"authors":[{"contributor_roles":[],"family":"Rubin","given":"Mark"}],"blog":{"authors":[{"name":"Mark Rubin"}],"community_id":"3bd0dcf5-7d43-47f1-b260-87d9f30bdcd6","created":1681948800,"current_feed_url":null,"description":"Critical metascience takes a step back to question some common assumptions, approaches, problems, and solutions in metascience.","doi":"https://doi.org/10.59350/markrubin","favicon":"https://rogue-scholar.org/api/communities/3bd0dcf5-7d43-47f1-b260-87d9f30bdcd6/logo","feed_format":"application/rss+xml","feed_url":"https://markrubin.substack.com/feed","filter":null,"generator":"Substack","home_page_url":"https://markrubin.substack.com","issn":null,"language":"eng","license":"https://creativecommons.org/licenses/by/4.0/legalcode","prefix":"10.59350","relative_url":null,"secure":true,"slug":"markrubin","status":"active","subfield":"1207","title":"Critical Metascience","updated":1788777722,"use_api":null},"blog_name":"Critical Metascience","blog_slug":"markrubin","content_html":"<div class=\"captioned-image-container\"><figure><a class=\"image-link image2\" target=\"_blank\" href=\"https://substackcdn.com/image/fetch/$s_!CFBM!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F2d1077fd-c0ac-42e3-a2d2-72f50e1c86fe_935x8.png\" data-component-name=\"Image2ToDOM\"><div class=\"image2-inset\"><picture><source type=\"image/webp\" srcset=\"https://substackcdn.com/image/fetch/$s_!CFBM!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F2d1077fd-c0ac-42e3-a2d2-72f50e1c86fe_935x8.png 424w, https://substackcdn.com/image/fetch/$s_!CFBM!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F2d1077fd-c0ac-42e3-a2d2-72f50e1c86fe_935x8.png 848w, https://substackcdn.com/image/fetch/$s_!CFBM!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F2d1077fd-c0ac-42e3-a2d2-72f50e1c86fe_935x8.png 1272w, https://substackcdn.com/image/fetch/$s_!CFBM!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F2d1077fd-c0ac-42e3-a2d2-72f50e1c86fe_935x8.png 1456w\" sizes=\"100vw\"><img src=\"https://substackcdn.com/image/fetch/$s_!CFBM!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F2d1077fd-c0ac-42e3-a2d2-72f50e1c86fe_935x8.png\" width=\"935\" height=\"8\" data-attrs=\"{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/2d1077fd-c0ac-42e3-a2d2-72f50e1c86fe_935x8.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:8,&quot;width&quot;:935,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:12010,&quot;alt&quot;:&quot;&quot;,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:false,&quot;topImage&quot;:true,&quot;internalRedirect&quot;:&quot;https://markrubin.substack.com/i/202452147?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F2d1077fd-c0ac-42e3-a2d2-72f50e1c86fe_935x8.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}\" class=\"sizing-normal\" alt=\"\" title=\"\" srcset=\"https://substackcdn.com/image/fetch/$s_!CFBM!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F2d1077fd-c0ac-42e3-a2d2-72f50e1c86fe_935x8.png 424w, https://substackcdn.com/image/fetch/$s_!CFBM!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F2d1077fd-c0ac-42e3-a2d2-72f50e1c86fe_935x8.png 848w, https://substackcdn.com/image/fetch/$s_!CFBM!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F2d1077fd-c0ac-42e3-a2d2-72f50e1c86fe_935x8.png 1272w, https://substackcdn.com/image/fetch/$s_!CFBM!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F2d1077fd-c0ac-42e3-a2d2-72f50e1c86fe_935x8.png 1456w\" sizes=\"100vw\" fetchpriority=\"high\"></picture><div></div></div></a></figure></div><h2>Is Replication Rare?</h2><div class=\"captioned-image-container\"><figure><a class=\"image-link image2 is-viewable-img\" target=\"_blank\" href=\"https://substackcdn.com/image/fetch/$s_!M-CA!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F22c27cee-2a5d-43b7-9ca2-5e924e2f80df_1124x539.png\" data-component-name=\"Image2ToDOM\"><div class=\"image2-inset\"><picture><source type=\"image/webp\" srcset=\"https://substackcdn.com/image/fetch/$s_!M-CA!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F22c27cee-2a5d-43b7-9ca2-5e924e2f80df_1124x539.png 424w, https://substackcdn.com/image/fetch/$s_!M-CA!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F22c27cee-2a5d-43b7-9ca2-5e924e2f80df_1124x539.png 848w, https://substackcdn.com/image/fetch/$s_!M-CA!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F22c27cee-2a5d-43b7-9ca2-5e924e2f80df_1124x539.png 1272w, https://substackcdn.com/image/fetch/$s_!M-CA!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F22c27cee-2a5d-43b7-9ca2-5e924e2f80df_1124x539.png 1456w\" sizes=\"100vw\"><img src=\"https://substackcdn.com/image/fetch/$s_!M-CA!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F22c27cee-2a5d-43b7-9ca2-5e924e2f80df_1124x539.png\" width=\"546\" height=\"261.8274021352313\" data-attrs=\"{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/22c27cee-2a5d-43b7-9ca2-5e924e2f80df_1124x539.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:539,&quot;width&quot;:1124,&quot;resizeWidth&quot;:546,&quot;bytes&quot;:44097,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:false,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://markrubin.substack.com/i/212517182?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F22c27cee-2a5d-43b7-9ca2-5e924e2f80df_1124x539.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}\" class=\"sizing-normal\" alt=\"\" srcset=\"https://substackcdn.com/image/fetch/$s_!M-CA!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F22c27cee-2a5d-43b7-9ca2-5e924e2f80df_1124x539.png 424w, https://substackcdn.com/image/fetch/$s_!M-CA!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F22c27cee-2a5d-43b7-9ca2-5e924e2f80df_1124x539.png 848w, https://substackcdn.com/image/fetch/$s_!M-CA!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F22c27cee-2a5d-43b7-9ca2-5e924e2f80df_1124x539.png 1272w, https://substackcdn.com/image/fetch/$s_!M-CA!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F22c27cee-2a5d-43b7-9ca2-5e924e2f80df_1124x539.png 1456w\" sizes=\"100vw\"></picture><div class=\"image-link-expand\"><div class=\"pencraft pc-display-flex pc-gap-8 pc-reset\"><button tabindex=\"0\" type=\"button\" class=\"pencraft pc-reset pencraft icon-container restack-image\"><svg aria-hidden=\"true\" width=\"20\" height=\"20\" viewBox=\"0 0 20 20\" fill=\"none\" stroke-width=\"1.5\" stroke=\"var(--color-fg-primary)\" stroke-linecap=\"round\" stroke-linejoin=\"round\" xmlns=\"http://www.w3.org/2000/svg\"><g><path d=\"M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882\"></path></g></svg></button><button tabindex=\"0\" type=\"button\" class=\"pencraft pc-reset pencraft icon-container view-image\"><svg xmlns=\"http://www.w3.org/2000/svg\" width=\"20\" height=\"20\" viewBox=\"0 0 24 24\" fill=\"none\" stroke=\"currentColor\" stroke-width=\"2\" stroke-linecap=\"round\" stroke-linejoin=\"round\" class=\"lucide lucide-maximize2 lucide-maximize-2\"><polyline points=\"15 3 21 3 21 9\"></polyline><polyline points=\"9 21 3 21 3 15\"></polyline><line x1=\"21\" x2=\"14\" y1=\"3\" y2=\"10\"></line><line x1=\"3\" x2=\"10\" y1=\"21\" y2=\"14\"></line></svg></button></div></div></div></a></figure></div><p><a href=\"https://www.kcl.ac.uk/people/tim-rakow\">Tim Rakow</a> recently published <a href=\"https://doi.org/10.1177/17456916261452961\">work </a>that \"investigates the claim that psychological scientists have published only a small quantity of replication research (Chambers, 2017; Ioannidis, 2012).\"  He found that 19% of the 1,224 psychology articles examined explicitly referred to \"replication\" in their studies, although \"direct replications were less common than conceptual replications and replications with extension.\"</p><div class=\"captioned-image-container\"><figure><a class=\"image-link image2 is-viewable-img\" target=\"_blank\" href=\"https://substackcdn.com/image/fetch/$s_!rq09!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fbc506360-eb5b-4ddd-a05b-b6e2ce0ac437_540x540.webp\" data-component-name=\"Image2ToDOM\"><div class=\"image2-inset\"><picture><source type=\"image/webp\" srcset=\"https://substackcdn.com/image/fetch/$s_!rq09!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fbc506360-eb5b-4ddd-a05b-b6e2ce0ac437_540x540.webp 424w, https://substackcdn.com/image/fetch/$s_!rq09!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fbc506360-eb5b-4ddd-a05b-b6e2ce0ac437_540x540.webp 848w, https://substackcdn.com/image/fetch/$s_!rq09!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fbc506360-eb5b-4ddd-a05b-b6e2ce0ac437_540x540.webp 1272w, https://substackcdn.com/image/fetch/$s_!rq09!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fbc506360-eb5b-4ddd-a05b-b6e2ce0ac437_540x540.webp 1456w\" sizes=\"100vw\"><img src=\"https://substackcdn.com/image/fetch/$s_!rq09!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fbc506360-eb5b-4ddd-a05b-b6e2ce0ac437_540x540.webp\" width=\"282\" height=\"282\" data-attrs=\"{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/bc506360-eb5b-4ddd-a05b-b6e2ce0ac437_540x540.webp&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:540,&quot;width&quot;:540,&quot;resizeWidth&quot;:282,&quot;bytes&quot;:16600,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/webp&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:false,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://markrubin.substack.com/i/212517182?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fbc506360-eb5b-4ddd-a05b-b6e2ce0ac437_540x540.webp&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}\" class=\"sizing-normal\" alt=\"\" srcset=\"https://substackcdn.com/image/fetch/$s_!rq09!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fbc506360-eb5b-4ddd-a05b-b6e2ce0ac437_540x540.webp 424w, https://substackcdn.com/image/fetch/$s_!rq09!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fbc506360-eb5b-4ddd-a05b-b6e2ce0ac437_540x540.webp 848w, https://substackcdn.com/image/fetch/$s_!rq09!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fbc506360-eb5b-4ddd-a05b-b6e2ce0ac437_540x540.webp 1272w, https://substackcdn.com/image/fetch/$s_!rq09!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fbc506360-eb5b-4ddd-a05b-b6e2ce0ac437_540x540.webp 1456w\" sizes=\"100vw\"></picture><div class=\"image-link-expand\"><div class=\"pencraft pc-display-flex pc-gap-8 pc-reset\"><button tabindex=\"0\" type=\"button\" class=\"pencraft pc-reset pencraft icon-container restack-image\"><svg aria-hidden=\"true\" width=\"20\" height=\"20\" viewBox=\"0 0 20 20\" fill=\"none\" stroke-width=\"1.5\" stroke=\"var(--color-fg-primary)\" stroke-linecap=\"round\" stroke-linejoin=\"round\" xmlns=\"http://www.w3.org/2000/svg\"><g><path d=\"M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882\"></path></g></svg></button><button tabindex=\"0\" type=\"button\" class=\"pencraft pc-reset pencraft icon-container view-image\"><svg xmlns=\"http://www.w3.org/2000/svg\" width=\"20\" height=\"20\" viewBox=\"0 0 24 24\" fill=\"none\" stroke=\"currentColor\" stroke-width=\"2\" stroke-linecap=\"round\" stroke-linejoin=\"round\" class=\"lucide lucide-maximize2 lucide-maximize-2\"><polyline points=\"15 3 21 3 21 9\"></polyline><polyline points=\"9 21 3 21 3 15\"></polyline><line x1=\"21\" x2=\"14\" y1=\"3\" y2=\"10\"></line><line x1=\"3\" x2=\"10\" y1=\"21\" y2=\"14\"></line></svg></button></div></div></div></a><figcaption class=\"image-caption\">Tim Rakow</figcaption></figure></div><p>Rakow's work reminds me of a theoretical paper by Stephan Guttinger (2018) arguing that <a href=\"https://doi.org/10.1002/bies.201800055\">replications are everywhere</a>. Guttinger identified what he called \"micro-replications\" in which researchers \"reproduce an earlier finding of another group using their own materials and methods.\" Critically, however, authors do not label these micro-replications as \"replications\" in their work. Hence, they do not tend to be picked up in surveys of the prevalence of replications. As Guttinger explained,</p><blockquote><p>the current debate about the reproducibility crisis is completely blind to the additional level of micro-replications, as the analytic framework used only thinks of replications as add-ons and not as part of regular experimentation.</p></blockquote><div class=\"captioned-image-container\"><figure><a class=\"image-link image2 is-viewable-img\" target=\"_blank\" href=\"https://substackcdn.com/image/fetch/$s_!T-Qe!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fbfa0e4ca-fba7-4937-bab9-69f2801e7964_1811x583.png\" data-component-name=\"Image2ToDOM\"><div class=\"image2-inset\"><picture><source type=\"image/webp\" srcset=\"https://substackcdn.com/image/fetch/$s_!T-Qe!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fbfa0e4ca-fba7-4937-bab9-69f2801e7964_1811x583.png 424w, https://substackcdn.com/image/fetch/$s_!T-Qe!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fbfa0e4ca-fba7-4937-bab9-69f2801e7964_1811x583.png 848w, https://substackcdn.com/image/fetch/$s_!T-Qe!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fbfa0e4ca-fba7-4937-bab9-69f2801e7964_1811x583.png 1272w, https://substackcdn.com/image/fetch/$s_!T-Qe!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fbfa0e4ca-fba7-4937-bab9-69f2801e7964_1811x583.png 1456w\" sizes=\"100vw\"><img src=\"https://substackcdn.com/image/fetch/$s_!T-Qe!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fbfa0e4ca-fba7-4937-bab9-69f2801e7964_1811x583.png\" width=\"1456\" height=\"469\" data-attrs=\"{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/bfa0e4ca-fba7-4937-bab9-69f2801e7964_1811x583.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:469,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:59214,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:false,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://markrubin.substack.com/i/212517182?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fbfa0e4ca-fba7-4937-bab9-69f2801e7964_1811x583.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}\" class=\"sizing-normal\" alt=\"\" srcset=\"https://substackcdn.com/image/fetch/$s_!T-Qe!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fbfa0e4ca-fba7-4937-bab9-69f2801e7964_1811x583.png 424w, https://substackcdn.com/image/fetch/$s_!T-Qe!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fbfa0e4ca-fba7-4937-bab9-69f2801e7964_1811x583.png 848w, https://substackcdn.com/image/fetch/$s_!T-Qe!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fbfa0e4ca-fba7-4937-bab9-69f2801e7964_1811x583.png 1272w, https://substackcdn.com/image/fetch/$s_!T-Qe!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fbfa0e4ca-fba7-4937-bab9-69f2801e7964_1811x583.png 1456w\" sizes=\"100vw\"></picture><div class=\"image-link-expand\"><div class=\"pencraft pc-display-flex pc-gap-8 pc-reset\"><button tabindex=\"0\" type=\"button\" class=\"pencraft pc-reset pencraft icon-container restack-image\"><svg aria-hidden=\"true\" width=\"20\" height=\"20\" viewBox=\"0 0 20 20\" fill=\"none\" stroke-width=\"1.5\" stroke=\"var(--color-fg-primary)\" stroke-linecap=\"round\" stroke-linejoin=\"round\" xmlns=\"http://www.w3.org/2000/svg\"><g><path d=\"M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882\"></path></g></svg></button><button tabindex=\"0\" type=\"button\" class=\"pencraft pc-reset pencraft icon-container view-image\"><svg xmlns=\"http://www.w3.org/2000/svg\" width=\"20\" height=\"20\" viewBox=\"0 0 24 24\" fill=\"none\" stroke=\"currentColor\" stroke-width=\"2\" stroke-linecap=\"round\" stroke-linejoin=\"round\" class=\"lucide lucide-maximize2 lucide-maximize-2\"><polyline points=\"15 3 21 3 21 9\"></polyline><polyline points=\"9 21 3 21 3 15\"></polyline><line x1=\"21\" x2=\"14\" y1=\"3\" y2=\"10\"></line><line x1=\"3\" x2=\"10\" y1=\"21\" y2=\"14\"></line></svg></button></div></div></div></a></figure></div><p>Guttinger concluded that:</p><blockquote><p>There might be less need to fundamentally revise the experimental sciences than current talk of a 'crisis' often implies. There is good reason to assume that (successful) replications are much more prevalent</p></blockquote><p>Rakow's work adds to Guttinger's by showing that, in addition to unmentioned micro-replications, researchers also often explicitly report what they term \"replications.\" Hence, Rakow concluded that:</p><blockquote><p>Many researchers are not shy about conducting and reporting replication. Plausibly, at least 20% of psychology articles include author-identified replication; and replication could be considered to be a mainstream practice in experimental psychology. Nonetheless, recommendations for improving replication practices remain relevant because psychology might not be leveraging the full range of benefits afforded by different kinds of replication study (H\u00fcffmeier et al., 2016; Schmidt, 2009). Because conceptual replications appear to be far more common than direct replications, the priority likely lies with greater use of direct replications.</p></blockquote><p>Rakow's point about the rarity of <em>direct replications </em>is well taken. <a href=\"https://beth-clarke.com/\">Beth Clarke</a> and colleagues (2026) recently analysed 100 top psychology journals and found that \"only 0.2% of articles (169 articles out of 84,834) were direct replication articles.\"</p><div class=\"captioned-image-container\"><figure><a class=\"image-link image2 is-viewable-img\" target=\"_blank\" href=\"https://substackcdn.com/image/fetch/$s_!Ha_1!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F1a5a05c5-eff8-4539-91de-2f5db577b120_2010x2018.jpeg\" data-component-name=\"Image2ToDOM\"><div class=\"image2-inset\"><picture><source type=\"image/webp\" srcset=\"https://substackcdn.com/image/fetch/$s_!Ha_1!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F1a5a05c5-eff8-4539-91de-2f5db577b120_2010x2018.jpeg 424w, https://substackcdn.com/image/fetch/$s_!Ha_1!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F1a5a05c5-eff8-4539-91de-2f5db577b120_2010x2018.jpeg 848w, https://substackcdn.com/image/fetch/$s_!Ha_1!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F1a5a05c5-eff8-4539-91de-2f5db577b120_2010x2018.jpeg 1272w, https://substackcdn.com/image/fetch/$s_!Ha_1!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F1a5a05c5-eff8-4539-91de-2f5db577b120_2010x2018.jpeg 1456w\" sizes=\"100vw\"><img src=\"https://substackcdn.com/image/fetch/$s_!Ha_1!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F1a5a05c5-eff8-4539-91de-2f5db577b120_2010x2018.jpeg\" width=\"282\" height=\"283.1620879120879\" data-attrs=\"{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/1a5a05c5-eff8-4539-91de-2f5db577b120_2010x2018.jpeg&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:1462,&quot;width&quot;:1456,&quot;resizeWidth&quot;:282,&quot;bytes&quot;:1103514,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/jpeg&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://markrubin.substack.com/i/212517182?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F1a5a05c5-eff8-4539-91de-2f5db577b120_2010x2018.jpeg&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}\" class=\"sizing-normal\" alt=\"\" srcset=\"https://substackcdn.com/image/fetch/$s_!Ha_1!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F1a5a05c5-eff8-4539-91de-2f5db577b120_2010x2018.jpeg 424w, https://substackcdn.com/image/fetch/$s_!Ha_1!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F1a5a05c5-eff8-4539-91de-2f5db577b120_2010x2018.jpeg 848w, https://substackcdn.com/image/fetch/$s_!Ha_1!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F1a5a05c5-eff8-4539-91de-2f5db577b120_2010x2018.jpeg 1272w, https://substackcdn.com/image/fetch/$s_!Ha_1!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F1a5a05c5-eff8-4539-91de-2f5db577b120_2010x2018.jpeg 1456w\" sizes=\"100vw\" loading=\"lazy\"></picture><div class=\"image-link-expand\"><div class=\"pencraft pc-display-flex pc-gap-8 pc-reset\"><button tabindex=\"0\" type=\"button\" class=\"pencraft pc-reset pencraft icon-container restack-image\"><svg aria-hidden=\"true\" width=\"20\" height=\"20\" viewBox=\"0 0 20 20\" fill=\"none\" stroke-width=\"1.5\" stroke=\"var(--color-fg-primary)\" stroke-linecap=\"round\" stroke-linejoin=\"round\" xmlns=\"http://www.w3.org/2000/svg\"><g><path d=\"M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882\"></path></g></svg></button><button tabindex=\"0\" type=\"button\" class=\"pencraft pc-reset pencraft icon-container view-image\"><svg xmlns=\"http://www.w3.org/2000/svg\" width=\"20\" height=\"20\" viewBox=\"0 0 24 24\" fill=\"none\" stroke=\"currentColor\" stroke-width=\"2\" stroke-linecap=\"round\" stroke-linejoin=\"round\" class=\"lucide lucide-maximize2 lucide-maximize-2\"><polyline points=\"15 3 21 3 21 9\"></polyline><polyline points=\"9 21 3 21 3 15\"></polyline><line x1=\"21\" x2=\"14\" y1=\"3\" y2=\"10\"></line><line x1=\"3\" x2=\"10\" y1=\"21\" y2=\"14\"></line></svg></button></div></div></div></a><figcaption class=\"image-caption\">Beth Clarke</figcaption></figure></div><p>So, are replications rare? It depends how you define a \"replication\"! If you mean <em>any </em>case in which researchers replicate a phenomenon, potentially using somewhat different methods (i.e., in conceptual replications and extensions), then no, they're not that rare. But if you restrict your definition to cases in which researchers deliberately set out to conduct direct replication attempts using what they presume to be the same methods and to report their results in dedicated direct replication articles, then yes, they're rare, at least in top journals.</p><p>Finally, it is interesting to see Clarke et al. step back to considered the more critical question: What direct replication rate do we actually want?</p><blockquote><p>We recommend that each journal consider what replicability rate they are aiming for, advertise this as one of the journal's aims, and invest in or solicit enough replication studies to assess whether they are meeting their goal. For example, is the journal's aim to publish results that are very definitive (low risk of false positives/negatives) or groundbreaking (high risk of false positives/negatives)? As Srivastava (2011) has argued, articles can rarely be both. We believe that most journals have at least an implicit goal for balancing this trade-off. We encourage journals to make this goal explicit and to invest in replication studies to gauge how well they are meeting their goals.</p></blockquote><p>As I've <a href=\"https://markrubin.substack.com/p/is-a-55-replication-rate-too-low\">discussed previously</a>, determining desired replication rates is tricky! But it's encouraging to see metascientists starting to grapple with this important issue (for recent work, see <a href=\"https://osf.io/preprints/metaarxiv/x7n9h_v1\">Harper &amp; Sch\u00f6nbrodt, 2026</a>).</p><div class=\"callout-block\" data-callout=\"true\"><p>Clarke, B., Lee, P. Y. (K.), Schiavone, S. R., Rhemtulla, M., &amp; Vazire, S. (2026). The prevalence of direct replication articles in top-ranking psychology journals. <em>American Psychologist, 81</em>(2), 238\u2013253. <a href=\"https://doi.org/10.1037/amp0001385\">https://doi.org/10.1037/amp0001385</a></p><p></p><p>Guttinger, S. (2018). Replications everywhere: Why the replication crisis might be less severe than it seems at first. <em>BioEssays, 40</em>, Article 1800055. <a href=\"https://doi.org/10.1002/bies.201800055\">https://doi.org/10.1002/bies.201800055 </a></p><p></p><p>Rakow, T. (2026). Estimating the prevalence of replication research Is challenging, not least because even a thorough database search can be shallow. <em>Perspectives on Psychological Science.</em> <a href=\"https://doi.org/10.1177/17456916261452961\">https://doi.org/10.1177/17456916261452961</a></p></div><div class=\"captioned-image-container\"><figure><a class=\"image-link image2\" target=\"_blank\" href=\"https://substackcdn.com/image/fetch/$s_!CFBM!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F2d1077fd-c0ac-42e3-a2d2-72f50e1c86fe_935x8.png\" data-component-name=\"Image2ToDOM\"><div class=\"image2-inset\"><picture><source type=\"image/webp\" srcset=\"https://substackcdn.com/image/fetch/$s_!CFBM!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F2d1077fd-c0ac-42e3-a2d2-72f50e1c86fe_935x8.png 424w, https://substackcdn.com/image/fetch/$s_!CFBM!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F2d1077fd-c0ac-42e3-a2d2-72f50e1c86fe_935x8.png 848w, https://substackcdn.com/image/fetch/$s_!CFBM!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F2d1077fd-c0ac-42e3-a2d2-72f50e1c86fe_935x8.png 1272w, https://substackcdn.com/image/fetch/$s_!CFBM!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F2d1077fd-c0ac-42e3-a2d2-72f50e1c86fe_935x8.png 1456w\" sizes=\"100vw\"><img src=\"https://substackcdn.com/image/fetch/$s_!CFBM!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F2d1077fd-c0ac-42e3-a2d2-72f50e1c86fe_935x8.png\" width=\"935\" height=\"8\" data-attrs=\"{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/2d1077fd-c0ac-42e3-a2d2-72f50e1c86fe_935x8.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:8,&quot;width&quot;:935,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:12010,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://markrubin.substack.com/i/202452147?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F2d1077fd-c0ac-42e3-a2d2-72f50e1c86fe_935x8.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}\" class=\"sizing-normal\" alt=\"\" srcset=\"https://substackcdn.com/image/fetch/$s_!CFBM!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F2d1077fd-c0ac-42e3-a2d2-72f50e1c86fe_935x8.png 424w, https://substackcdn.com/image/fetch/$s_!CFBM!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F2d1077fd-c0ac-42e3-a2d2-72f50e1c86fe_935x8.png 848w, https://substackcdn.com/image/fetch/$s_!CFBM!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F2d1077fd-c0ac-42e3-a2d2-72f50e1c86fe_935x8.png 1272w, https://substackcdn.com/image/fetch/$s_!CFBM!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F2d1077fd-c0ac-42e3-a2d2-72f50e1c86fe_935x8.png 1456w\" sizes=\"100vw\" loading=\"lazy\"></picture><div></div></div></a></figure></div><h2>Registered Report Timelines</h2><p><a href=\"https://aaronerlich.com/?lang=en\">Aaron Erlich</a> wrote a <a href=\"https://aaronerlich.com/posts/2026-08-registered-reports/?lang=en\">blog post </a>questioning whether the time it takes to publish Registered Reports is longer than that for standard articles. As he explains:</p><blockquote><p><span>There is no published study comparing time-to-publication for registered reports against standard articles. The literature has measured the format's quality (</span><a href=\"https://doi.org/10.1038/s41562-021-01142-4\">reviewers rated registered reports higher on all nineteen criteria tested</a><span>), its rate of null results (about 44 per cent of registered-report hypotheses supported, against roughly 96 per cent of results in standard psychology articles), its citations, and how many journals offer it. Nobody has measured the clock. The nearest work asks researchers what they </span><em>think</em><span> the cost is: </span><a href=\"https://doi.org/10.1098/rsos.211997\">Sarafoglou and colleagues</a><span> surveyed 355 researchers on preregistration and got \"better science but more work\"; </span><a href=\"https://docs.iza.org/dp17821.pdf\">Imai and colleagues</a><span> surveyed 519 experimental economists and found that more than 80 per cent know what a registered report is, most approve of them \u2014 and adoption is near zero. Neither asked anyone for a date.</span></p></blockquote><p>He concludes, \"if anyone is interested in trying to collect this data more systematically for political science, please let me know.\"</p><p>You can contact Aaron at aaron.erlich@mcgill.ca</p><div class=\"captioned-image-container\"><figure><a class=\"image-link image2 is-viewable-img\" target=\"_blank\" href=\"https://substackcdn.com/image/fetch/$s_!J7v2!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F4e41d61d-db0a-4524-b345-b810026c0522_800x800.jpeg\" data-component-name=\"Image2ToDOM\"><div class=\"image2-inset\"><picture><source type=\"image/webp\" srcset=\"https://substackcdn.com/image/fetch/$s_!J7v2!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F4e41d61d-db0a-4524-b345-b810026c0522_800x800.jpeg 424w, https://substackcdn.com/image/fetch/$s_!J7v2!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F4e41d61d-db0a-4524-b345-b810026c0522_800x800.jpeg 848w, https://substackcdn.com/image/fetch/$s_!J7v2!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F4e41d61d-db0a-4524-b345-b810026c0522_800x800.jpeg 1272w, https://substackcdn.com/image/fetch/$s_!J7v2!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F4e41d61d-db0a-4524-b345-b810026c0522_800x800.jpeg 1456w\" sizes=\"100vw\"><img src=\"https://substackcdn.com/image/fetch/$s_!J7v2!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F4e41d61d-db0a-4524-b345-b810026c0522_800x800.jpeg\" width=\"284\" height=\"284\" data-attrs=\"{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/4e41d61d-db0a-4524-b345-b810026c0522_800x800.jpeg&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:800,&quot;width&quot;:800,&quot;resizeWidth&quot;:284,&quot;bytes&quot;:776868,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/jpeg&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://markrubin.substack.com/i/212517182?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F4e41d61d-db0a-4524-b345-b810026c0522_800x800.jpeg&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}\" class=\"sizing-normal\" alt=\"\" srcset=\"https://substackcdn.com/image/fetch/$s_!J7v2!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F4e41d61d-db0a-4524-b345-b810026c0522_800x800.jpeg 424w, https://substackcdn.com/image/fetch/$s_!J7v2!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F4e41d61d-db0a-4524-b345-b810026c0522_800x800.jpeg 848w, https://substackcdn.com/image/fetch/$s_!J7v2!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F4e41d61d-db0a-4524-b345-b810026c0522_800x800.jpeg 1272w, https://substackcdn.com/image/fetch/$s_!J7v2!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F4e41d61d-db0a-4524-b345-b810026c0522_800x800.jpeg 1456w\" sizes=\"100vw\" loading=\"lazy\"></picture><div class=\"image-link-expand\"><div class=\"pencraft pc-display-flex pc-gap-8 pc-reset\"><button tabindex=\"0\" type=\"button\" class=\"pencraft pc-reset pencraft icon-container restack-image\"><svg aria-hidden=\"true\" width=\"20\" height=\"20\" viewBox=\"0 0 20 20\" fill=\"none\" stroke-width=\"1.5\" stroke=\"var(--color-fg-primary)\" stroke-linecap=\"round\" stroke-linejoin=\"round\" xmlns=\"http://www.w3.org/2000/svg\"><g><path d=\"M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882\"></path></g></svg></button><button tabindex=\"0\" type=\"button\" class=\"pencraft pc-reset pencraft icon-container view-image\"><svg xmlns=\"http://www.w3.org/2000/svg\" width=\"20\" height=\"20\" viewBox=\"0 0 24 24\" fill=\"none\" stroke=\"currentColor\" stroke-width=\"2\" stroke-linecap=\"round\" stroke-linejoin=\"round\" class=\"lucide lucide-maximize2 lucide-maximize-2\"><polyline points=\"15 3 21 3 21 9\"></polyline><polyline points=\"9 21 3 21 3 15\"></polyline><line x1=\"21\" x2=\"14\" y1=\"3\" y2=\"10\"></line><line x1=\"3\" x2=\"10\" y1=\"21\" y2=\"14\"></line></svg></button></div></div></div></a><figcaption class=\"image-caption\">Aaron Erlich</figcaption></figure></div><div class=\"callout-block\" data-callout=\"true\"><p>Erlich, A. (2026, August 28). Registered reports are available in political science and used almost nowhere. <em>Blog.</em> <a href=\"https://aaronerlich.com/posts/2026-08-registered-reports/?lang=en\">https://aaronerlich.com/posts/2026-08-registered-reports/?lang=en</a></p></div><div class=\"captioned-image-container\"><figure><a class=\"image-link image2\" target=\"_blank\" href=\"https://substackcdn.com/image/fetch/$s_!ryOv!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fefb7690f-1076-48b0-a819-707482a5775d_935x8.png\" data-component-name=\"Image2ToDOM\"><div class=\"image2-inset\"><picture><source type=\"image/webp\" srcset=\"https://substackcdn.com/image/fetch/$s_!ryOv!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fefb7690f-1076-48b0-a819-707482a5775d_935x8.png 424w, https://substackcdn.com/image/fetch/$s_!ryOv!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fefb7690f-1076-48b0-a819-707482a5775d_935x8.png 848w, https://substackcdn.com/image/fetch/$s_!ryOv!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fefb7690f-1076-48b0-a819-707482a5775d_935x8.png 1272w, https://substackcdn.com/image/fetch/$s_!ryOv!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fefb7690f-1076-48b0-a819-707482a5775d_935x8.png 1456w\" sizes=\"100vw\"><img src=\"https://substackcdn.com/image/fetch/$s_!ryOv!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fefb7690f-1076-48b0-a819-707482a5775d_935x8.png\" width=\"935\" height=\"8\" data-attrs=\"{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/efb7690f-1076-48b0-a819-707482a5775d_935x8.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:8,&quot;width&quot;:935,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:12010,&quot;alt&quot;:&quot;&quot;,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://markrubin.substack.com/i/202452147?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fefb7690f-1076-48b0-a819-707482a5775d_935x8.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}\" class=\"sizing-normal\" alt=\"\" title=\"\" srcset=\"https://substackcdn.com/image/fetch/$s_!ryOv!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fefb7690f-1076-48b0-a819-707482a5775d_935x8.png 424w, https://substackcdn.com/image/fetch/$s_!ryOv!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fefb7690f-1076-48b0-a819-707482a5775d_935x8.png 848w, https://substackcdn.com/image/fetch/$s_!ryOv!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fefb7690f-1076-48b0-a819-707482a5775d_935x8.png 1272w, https://substackcdn.com/image/fetch/$s_!ryOv!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fefb7690f-1076-48b0-a819-707482a5775d_935x8.png 1456w\" sizes=\"100vw\" loading=\"lazy\"></picture><div></div></div></a></figure></div><h2>Open Science and Trust</h2><p><a href=\"https://graz-openscience.uni-graz.at/en/gosi-team/hilmar-brohmer/\">Hilmar Brohmer</a> and colleagues investigated the myside bias, general trust in science, and the communication of open science practices as predictors of public trust in scientific findings that are communicated through popular-scientific media articles. They found that \"general trust in science and myside bias strongly predicted trust in certain popular-scientific summaries, while explicit Open Science cues did not show an effect.\" Perhaps this is because open science \"practices are perceived as the default, [and so] explicitly mentioning them may offer little additional benefit in terms of increasing trust (Anvari &amp; Lakens, 2018)\"? </p><div class=\"captioned-image-container\"><figure><a class=\"image-link image2 is-viewable-img\" target=\"_blank\" href=\"https://substackcdn.com/image/fetch/$s_!9YHj!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F79d359fd-79e9-4bce-8f61-7d866e141ed9_581x509.jpeg\" data-component-name=\"Image2ToDOM\"><div class=\"image2-inset\"><picture><source type=\"image/webp\" srcset=\"https://substackcdn.com/image/fetch/$s_!9YHj!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F79d359fd-79e9-4bce-8f61-7d866e141ed9_581x509.jpeg 424w, https://substackcdn.com/image/fetch/$s_!9YHj!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F79d359fd-79e9-4bce-8f61-7d866e141ed9_581x509.jpeg 848w, https://substackcdn.com/image/fetch/$s_!9YHj!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F79d359fd-79e9-4bce-8f61-7d866e141ed9_581x509.jpeg 1272w, https://substackcdn.com/image/fetch/$s_!9YHj!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F79d359fd-79e9-4bce-8f61-7d866e141ed9_581x509.jpeg 1456w\" sizes=\"100vw\"><img src=\"https://substackcdn.com/image/fetch/$s_!9YHj!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F79d359fd-79e9-4bce-8f61-7d866e141ed9_581x509.jpeg\" width=\"281\" height=\"246.17728055077453\" data-attrs=\"{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/79d359fd-79e9-4bce-8f61-7d866e141ed9_581x509.jpeg&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:509,&quot;width&quot;:581,&quot;resizeWidth&quot;:281,&quot;bytes&quot;:89671,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/jpeg&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://markrubin.substack.com/i/212517182?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F79d359fd-79e9-4bce-8f61-7d866e141ed9_581x509.jpeg&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}\" class=\"sizing-normal\" alt=\"\" srcset=\"https://substackcdn.com/image/fetch/$s_!9YHj!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F79d359fd-79e9-4bce-8f61-7d866e141ed9_581x509.jpeg 424w, https://substackcdn.com/image/fetch/$s_!9YHj!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F79d359fd-79e9-4bce-8f61-7d866e141ed9_581x509.jpeg 848w, https://substackcdn.com/image/fetch/$s_!9YHj!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F79d359fd-79e9-4bce-8f61-7d866e141ed9_581x509.jpeg 1272w, https://substackcdn.com/image/fetch/$s_!9YHj!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F79d359fd-79e9-4bce-8f61-7d866e141ed9_581x509.jpeg 1456w\" sizes=\"100vw\" loading=\"lazy\"></picture><div class=\"image-link-expand\"><div class=\"pencraft pc-display-flex pc-gap-8 pc-reset\"><button tabindex=\"0\" type=\"button\" class=\"pencraft pc-reset pencraft icon-container restack-image\"><svg aria-hidden=\"true\" width=\"20\" height=\"20\" viewBox=\"0 0 20 20\" fill=\"none\" stroke-width=\"1.5\" stroke=\"var(--color-fg-primary)\" stroke-linecap=\"round\" stroke-linejoin=\"round\" xmlns=\"http://www.w3.org/2000/svg\"><g><path d=\"M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882\"></path></g></svg></button><button tabindex=\"0\" type=\"button\" class=\"pencraft pc-reset pencraft icon-container view-image\"><svg xmlns=\"http://www.w3.org/2000/svg\" width=\"20\" height=\"20\" viewBox=\"0 0 24 24\" fill=\"none\" stroke=\"currentColor\" stroke-width=\"2\" stroke-linecap=\"round\" stroke-linejoin=\"round\" class=\"lucide lucide-maximize2 lucide-maximize-2\"><polyline points=\"15 3 21 3 21 9\"></polyline><polyline points=\"9 21 3 21 3 15\"></polyline><line x1=\"21\" x2=\"14\" y1=\"3\" y2=\"10\"></line><line x1=\"3\" x2=\"10\" y1=\"21\" y2=\"14\"></line></svg></button></div></div></div></a><figcaption class=\"image-caption\">Hilmar Brohmer</figcaption></figure></div><p>As the authors explained:</p><blockquote><p>We found that OS [open science] practices did not affect trust in the scientific findings, neither individually, nor in interaction with other variables, implying no evidence for either tested hypothesis. This calls into question whether it is necessary to comprehensively report in layperson texts whether or not OS was applied.</p></blockquote><div class=\"callout-block\" data-callout=\"true\"><p>Brohmer, H., Gehm, F., &amp; von G\u00f6tz, S. (2026). Believing what we want? Myside bias and the role of open science practices in public trust in science. <em>Science Communication.</em> <a href=\"https://doi.org/10.1177/10755470261475540\">https://doi.org/10.1177/10755470261475540</a></p></div><div class=\"captioned-image-container\"><figure><a class=\"image-link image2\" target=\"_blank\" href=\"https://substackcdn.com/image/fetch/$s_!QRuO!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F864e527e-11a3-4cc1-8f4d-85fe9f0d6198_935x8.png\" data-component-name=\"Image2ToDOM\"><div class=\"image2-inset\"><picture><source type=\"image/webp\" srcset=\"https://substackcdn.com/image/fetch/$s_!QRuO!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F864e527e-11a3-4cc1-8f4d-85fe9f0d6198_935x8.png 424w, https://substackcdn.com/image/fetch/$s_!QRuO!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F864e527e-11a3-4cc1-8f4d-85fe9f0d6198_935x8.png 848w, https://substackcdn.com/image/fetch/$s_!QRuO!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F864e527e-11a3-4cc1-8f4d-85fe9f0d6198_935x8.png 1272w, https://substackcdn.com/image/fetch/$s_!QRuO!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F864e527e-11a3-4cc1-8f4d-85fe9f0d6198_935x8.png 1456w\" sizes=\"100vw\"><img src=\"https://substackcdn.com/image/fetch/$s_!QRuO!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F864e527e-11a3-4cc1-8f4d-85fe9f0d6198_935x8.png\" width=\"935\" height=\"8\" data-attrs=\"{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/864e527e-11a3-4cc1-8f4d-85fe9f0d6198_935x8.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:8,&quot;width&quot;:935,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:null,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:null,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:null,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}\" class=\"sizing-normal\" alt=\"\" srcset=\"https://substackcdn.com/image/fetch/$s_!QRuO!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F864e527e-11a3-4cc1-8f4d-85fe9f0d6198_935x8.png 424w, https://substackcdn.com/image/fetch/$s_!QRuO!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F864e527e-11a3-4cc1-8f4d-85fe9f0d6198_935x8.png 848w, https://substackcdn.com/image/fetch/$s_!QRuO!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F864e527e-11a3-4cc1-8f4d-85fe9f0d6198_935x8.png 1272w, https://substackcdn.com/image/fetch/$s_!QRuO!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F864e527e-11a3-4cc1-8f4d-85fe9f0d6198_935x8.png 1456w\" sizes=\"100vw\" loading=\"lazy\"></picture><div></div></div></a></figure></div><h3><em>P</em>-hacking and Publication Bias</h3><p>Based on <a href=\"https://datacolada.org/91\">Simonsohn (2020)</a>, <a href=\"https://econ.wisc.edu/staff/cai-yong/\">Yong Cai</a> and colleagues distinguish between \"slow\" <em>p</em>-hacking (e.g., selective data transformation and outlier identification in the same data set) and \"fast\"<em> p</em>-hacking (e.g., file-drawering and then using a new data set). They argue that <em>fast</em> <em>p</em>-hacking exacerbates both <em>strong </em>and <em>weak </em>publication bias, and <em>slow p</em>-hacking exacerbates <em>weak </em>publication bias. However, <em>slow p</em>-hacking may also operate as a form of self-correction by mitigating the effects of <em>strong </em>publication bias (see also <a href=\"https://doi.org/10.1037/met0000246\">Friese &amp; Frankenbach, 2020</a>).</p><div class=\"captioned-image-container\"><figure><a class=\"image-link image2 is-viewable-img\" target=\"_blank\" href=\"https://substackcdn.com/image/fetch/$s_!hI6L!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe94c935a-535a-45b5-b61b-8bc65d1f56c6_810x849.png\" data-component-name=\"Image2ToDOM\"><div class=\"image2-inset\"><picture><source type=\"image/webp\" srcset=\"https://substackcdn.com/image/fetch/$s_!hI6L!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe94c935a-535a-45b5-b61b-8bc65d1f56c6_810x849.png 424w, https://substackcdn.com/image/fetch/$s_!hI6L!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe94c935a-535a-45b5-b61b-8bc65d1f56c6_810x849.png 848w, https://substackcdn.com/image/fetch/$s_!hI6L!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe94c935a-535a-45b5-b61b-8bc65d1f56c6_810x849.png 1272w, https://substackcdn.com/image/fetch/$s_!hI6L!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe94c935a-535a-45b5-b61b-8bc65d1f56c6_810x849.png 1456w\" sizes=\"100vw\"><img src=\"https://substackcdn.com/image/fetch/$s_!hI6L!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe94c935a-535a-45b5-b61b-8bc65d1f56c6_810x849.png\" width=\"728\" height=\"763.0518518518519\" data-attrs=\"{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/e94c935a-535a-45b5-b61b-8bc65d1f56c6_810x849.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:849,&quot;width&quot;:810,&quot;resizeWidth&quot;:728,&quot;bytes&quot;:113655,&quot;alt&quot;:&quot;Abstract This paper studies the effects of p-hacking on the bias of published estimates when papers with statistically significant results are selectively published. We show that fast p-hacking\u2014actions that lead to large changes in p-values\u2014always exacerbates the bias from selective publication. On the other hand, slow p-hacking\u2014actions that lead to small changes in p-values\u2014exacerbates bias when selection is weak, but mitigates it when selection is strong. In a model featuring both types of p-hacking, we show that a normality assumption identifies the true distribution of effects as well as the counterfactual mean that would obtain under selective publication without p-hacking. Applying the model to meta-analyses on the effects of behavioral nudges and development aid, we find suggestive evidence that both mitigation and exacerbation can arise in practice.&quot;,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://markrubin.substack.com/i/212517182?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe94c935a-535a-45b5-b61b-8bc65d1f56c6_810x849.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}\" class=\"sizing-normal\" alt=\"Abstract This paper studies the effects of p-hacking on the bias of published estimates when papers with statistically significant results are selectively published. We show that fast p-hacking\u2014actions that lead to large changes in p-values\u2014always exacerbates the bias from selective publication. On the other hand, slow p-hacking\u2014actions that lead to small changes in p-values\u2014exacerbates bias when selection is weak, but mitigates it when selection is strong. In a model featuring both types of p-hacking, we show that a normality assumption identifies the true distribution of effects as well as the counterfactual mean that would obtain under selective publication without p-hacking. Applying the model to meta-analyses on the effects of behavioral nudges and development aid, we find suggestive evidence that both mitigation and exacerbation can arise in practice.\" title=\"Abstract This paper studies the effects of p-hacking on the bias of published estimates when papers with statistically significant results are selectively published. We show that fast p-hacking\u2014actions that lead to large changes in p-values\u2014always exacerbates the bias from selective publication. On the other hand, slow p-hacking\u2014actions that lead to small changes in p-values\u2014exacerbates bias when selection is weak, but mitigates it when selection is strong. In a model featuring both types of p-hacking, we show that a normality assumption identifies the true distribution of effects as well as the counterfactual mean that would obtain under selective publication without p-hacking. Applying the model to meta-analyses on the effects of behavioral nudges and development aid, we find suggestive evidence that both mitigation and exacerbation can arise in practice.\" srcset=\"https://substackcdn.com/image/fetch/$s_!hI6L!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe94c935a-535a-45b5-b61b-8bc65d1f56c6_810x849.png 424w, https://substackcdn.com/image/fetch/$s_!hI6L!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe94c935a-535a-45b5-b61b-8bc65d1f56c6_810x849.png 848w, https://substackcdn.com/image/fetch/$s_!hI6L!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe94c935a-535a-45b5-b61b-8bc65d1f56c6_810x849.png 1272w, https://substackcdn.com/image/fetch/$s_!hI6L!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe94c935a-535a-45b5-b61b-8bc65d1f56c6_810x849.png 1456w\" sizes=\"100vw\" loading=\"lazy\"></picture><div class=\"image-link-expand\"><div class=\"pencraft pc-display-flex pc-gap-8 pc-reset\"><button tabindex=\"0\" type=\"button\" class=\"pencraft pc-reset pencraft icon-container restack-image\"><svg aria-hidden=\"true\" width=\"20\" height=\"20\" viewBox=\"0 0 20 20\" fill=\"none\" stroke-width=\"1.5\" stroke=\"var(--color-fg-primary)\" stroke-linecap=\"round\" stroke-linejoin=\"round\" xmlns=\"http://www.w3.org/2000/svg\"><g><path d=\"M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882\"></path></g></svg></button><button tabindex=\"0\" type=\"button\" class=\"pencraft pc-reset pencraft icon-container view-image\"><svg xmlns=\"http://www.w3.org/2000/svg\" width=\"20\" height=\"20\" viewBox=\"0 0 24 24\" fill=\"none\" stroke=\"currentColor\" stroke-width=\"2\" stroke-linecap=\"round\" stroke-linejoin=\"round\" class=\"lucide lucide-maximize2 lucide-maximize-2\"><polyline points=\"15 3 21 3 21 9\"></polyline><polyline points=\"9 21 3 21 3 15\"></polyline><line x1=\"21\" x2=\"14\" y1=\"3\" y2=\"10\"></line><line x1=\"3\" x2=\"10\" y1=\"21\" y2=\"14\"></line></svg></button></div></div></div></a></figure></div><div class=\"captioned-image-container\"><figure><a class=\"image-link image2 is-viewable-img\" target=\"_blank\" href=\"https://substackcdn.com/image/fetch/$s_!VBiZ!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F63c8260b-fa89-4405-8cfd-f436383aef94_1200x1200.jpeg\" data-component-name=\"Image2ToDOM\"><div class=\"image2-inset\"><picture><source type=\"image/webp\" srcset=\"https://substackcdn.com/image/fetch/$s_!VBiZ!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F63c8260b-fa89-4405-8cfd-f436383aef94_1200x1200.jpeg 424w, https://substackcdn.com/image/fetch/$s_!VBiZ!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F63c8260b-fa89-4405-8cfd-f436383aef94_1200x1200.jpeg 848w, https://substackcdn.com/image/fetch/$s_!VBiZ!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F63c8260b-fa89-4405-8cfd-f436383aef94_1200x1200.jpeg 1272w, https://substackcdn.com/image/fetch/$s_!VBiZ!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F63c8260b-fa89-4405-8cfd-f436383aef94_1200x1200.jpeg 1456w\" sizes=\"100vw\"><img src=\"https://substackcdn.com/image/fetch/$s_!VBiZ!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F63c8260b-fa89-4405-8cfd-f436383aef94_1200x1200.jpeg\" width=\"282\" height=\"282\" data-attrs=\"{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/63c8260b-fa89-4405-8cfd-f436383aef94_1200x1200.jpeg&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:1200,&quot;width&quot;:1200,&quot;resizeWidth&quot;:282,&quot;bytes&quot;:167006,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/jpeg&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://markrubin.substack.com/i/212517182?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F63c8260b-fa89-4405-8cfd-f436383aef94_1200x1200.jpeg&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}\" class=\"sizing-normal\" alt=\"\" srcset=\"https://substackcdn.com/image/fetch/$s_!VBiZ!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F63c8260b-fa89-4405-8cfd-f436383aef94_1200x1200.jpeg 424w, https://substackcdn.com/image/fetch/$s_!VBiZ!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F63c8260b-fa89-4405-8cfd-f436383aef94_1200x1200.jpeg 848w, https://substackcdn.com/image/fetch/$s_!VBiZ!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F63c8260b-fa89-4405-8cfd-f436383aef94_1200x1200.jpeg 1272w, https://substackcdn.com/image/fetch/$s_!VBiZ!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F63c8260b-fa89-4405-8cfd-f436383aef94_1200x1200.jpeg 1456w\" sizes=\"100vw\" loading=\"lazy\"></picture><div class=\"image-link-expand\"><div class=\"pencraft pc-display-flex pc-gap-8 pc-reset\"><button tabindex=\"0\" type=\"button\" class=\"pencraft pc-reset pencraft icon-container restack-image\"><svg aria-hidden=\"true\" width=\"20\" height=\"20\" viewBox=\"0 0 20 20\" fill=\"none\" stroke-width=\"1.5\" stroke=\"var(--color-fg-primary)\" stroke-linecap=\"round\" stroke-linejoin=\"round\" xmlns=\"http://www.w3.org/2000/svg\"><g><path d=\"M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882\"></path></g></svg></button><button tabindex=\"0\" type=\"button\" class=\"pencraft pc-reset pencraft icon-container view-image\"><svg xmlns=\"http://www.w3.org/2000/svg\" width=\"20\" height=\"20\" viewBox=\"0 0 24 24\" fill=\"none\" stroke=\"currentColor\" stroke-width=\"2\" stroke-linecap=\"round\" stroke-linejoin=\"round\" class=\"lucide lucide-maximize2 lucide-maximize-2\"><polyline points=\"15 3 21 3 21 9\"></polyline><polyline points=\"9 21 3 21 3 15\"></polyline><line x1=\"21\" x2=\"14\" y1=\"3\" y2=\"10\"></line><line x1=\"3\" x2=\"10\" y1=\"21\" y2=\"14\"></line></svg></button></div></div></div></a><figcaption class=\"image-caption\">Yong Cai</figcaption></figure></div><p>Cai et al. conclude:</p><blockquote><p>Our results show that it is important to understand <em>p</em>-hacking in the context of the selection environment that produced it. That <em>p</em>-hacking could mitigate the effects of publication bias under extreme selection also hints at a self-correcting tendency in the scientific process.</p></blockquote><div class=\"callout-block\" data-callout=\"true\"><p><span>Cai, Y., Pernoud, A., &amp; Xu, B. (2026). Does </span><em><span>p</span></em><span>-hacking mitigate or exacerbate the effects of publication bias? </span><em><span>ArXiv</span></em><span>. </span><a href=\"https://doi.org/10.48550/arXiv.2609.05372\"><span>https://doi.org/10.48550/arXiv.2609.05372</span></a></p></div><div class=\"captioned-image-container\"><figure><a class=\"image-link image2\" target=\"_blank\" href=\"https://substackcdn.com/image/fetch/$s_!QRuO!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F864e527e-11a3-4cc1-8f4d-85fe9f0d6198_935x8.png\" data-component-name=\"Image2ToDOM\"><div class=\"image2-inset\"><picture><source type=\"image/webp\" srcset=\"https://substackcdn.com/image/fetch/$s_!QRuO!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F864e527e-11a3-4cc1-8f4d-85fe9f0d6198_935x8.png 424w, https://substackcdn.com/image/fetch/$s_!QRuO!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F864e527e-11a3-4cc1-8f4d-85fe9f0d6198_935x8.png 848w, https://substackcdn.com/image/fetch/$s_!QRuO!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F864e527e-11a3-4cc1-8f4d-85fe9f0d6198_935x8.png 1272w, https://substackcdn.com/image/fetch/$s_!QRuO!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F864e527e-11a3-4cc1-8f4d-85fe9f0d6198_935x8.png 1456w\" sizes=\"100vw\"><img src=\"https://substackcdn.com/image/fetch/$s_!QRuO!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F864e527e-11a3-4cc1-8f4d-85fe9f0d6198_935x8.png\" width=\"935\" height=\"8\" data-attrs=\"{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/864e527e-11a3-4cc1-8f4d-85fe9f0d6198_935x8.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:8,&quot;width&quot;:935,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:null,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:null,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:null,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}\" class=\"sizing-normal\" alt=\"\" srcset=\"https://substackcdn.com/image/fetch/$s_!QRuO!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F864e527e-11a3-4cc1-8f4d-85fe9f0d6198_935x8.png 424w, https://substackcdn.com/image/fetch/$s_!QRuO!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F864e527e-11a3-4cc1-8f4d-85fe9f0d6198_935x8.png 848w, https://substackcdn.com/image/fetch/$s_!QRuO!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F864e527e-11a3-4cc1-8f4d-85fe9f0d6198_935x8.png 1272w, https://substackcdn.com/image/fetch/$s_!QRuO!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F864e527e-11a3-4cc1-8f4d-85fe9f0d6198_935x8.png 1456w\" sizes=\"100vw\" loading=\"lazy\"></picture><div></div></div></a></figure></div><p class=\"button-wrapper\" data-attrs=\"{&quot;url&quot;:&quot;https://markrubin.substack.com/subscribe?&quot;,&quot;text&quot;:&quot;Subscribe now&quot;,&quot;action&quot;:null,&quot;class&quot;:null}\" data-component-name=\"ButtonCreateButton\"><a class=\"button primary\" href=\"https://markrubin.substack.com/subscribe?\"><span>Subscribe now</span></a></p><p class=\"button-wrapper\" data-attrs=\"{&quot;url&quot;:&quot;https://markrubin.substack.com/p/is-replication-rare-registered-report?utm_source=substack&utm_medium=email&utm_content=share&action=share&quot;,&quot;text&quot;:&quot;Share&quot;,&quot;action&quot;:null,&quot;class&quot;:null}\" data-component-name=\"ButtonCreateButton\"><a class=\"button primary\" href=\"https://markrubin.substack.com/p/is-replication-rare-registered-report?utm_source=substack&utm_medium=email&utm_content=share&action=share\"><span>Share</span></a></p>","doi":"https://doi.org/10.59350/fsrdg-q0q44","guid":"212517182","image":"https://substackcdn.com/image/fetch/$s_!M-CA!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F22c27cee-2a5d-43b7-9ca2-5e924e2f80df_1124x539.png","language":"en","license":"https://creativecommons.org/licenses/by/4.0/legalcode","published_at":1788739200,"rid":"ny7yq-zsf22","summary":"Critical Metascience","tags":["Replication Crisis","Critical Metascience","TOP2025","Metascience","Publication Bias"],"title":"Is Replication Rare? \ud83d\udd38 Registered Report Timelines \ud83d\udd38 Open Science and Trust \ud83d\udd38 P-Hacking and Publication Bias","updated_at":1788852608,"url":"https://markrubin.substack.com/p/is-replication-rare-registered-report","version":"v1"},{"authors":[{"affiliation":[{"id":"https://ror.org/046ak2485","name":"Freie Universit\u00e4t Berlin"}],"contributor_roles":[],"family":"Fischer","given":"Georg","url":"https://orcid.org/0000-0001-5620-5759"}],"blog":{"authors":null,"community_id":"52aefd81-f405-4349-b080-754395a5d8b2","created":1694476800,"current_feed_url":null,"description":null,"doi":"https://doi.org/10.59350/oaberlin","favicon":"https://rogue-scholar.org/api/communities/52aefd81-f405-4349-b080-754395a5d8b2/logo","feed_format":"application/atom+xml","feed_url":"https://blogs.fu-berlin.de/open-research-berlin/feed/atom/","filter":null,"generator":"WordPress","home_page_url":"https://blogs.fu-berlin.de/open-research-berlin","issn":null,"language":"deu","license":"https://creativecommons.org/licenses/by/4.0/legalcode","prefix":"10.59350","relative_url":null,"secure":true,"slug":"oaberlin","status":"active","subfield":"1802","title":"Open Research Blog Berlin","updated":1788851356,"use_api":true},"blog_name":"Open Research Blog Berlin","blog_slug":"oaberlin","content_html":"<p>Unsere monatliche Rubrik zu aktuellen Veranstaltungen rund um Open Research.</p>\n<pre>Anmerkung zu dieser Rubrik: Das Open Research Office Berlin erstellt monatlich eine \u00dcbersicht \u00fcber Termine und Veranstaltungen zu Open Access und Open Research in Berlin bzw. an Berliner Einrichtungen. Der Fokus liegt dabei auf unseren Partnereinrichtungen und auf Veranstaltungen, die sich an die \u00d6ffentlichkeit richten bzw. die offen sind f\u00fcr Angeh\u00f6rige der Wissenschafts- und Kulturerbeeinrichtungen in Berlin. Wir erg\u00e4nzen diese Liste gerne (Info bitte via <a href=\"mailto:team@open-research-berlin.de\">Mail</a> ans OROB).</pre>\n<p><!--more--></p>\n<h2>31. August, KI-assistierte Datenarbeit in GLAM-Einrichtungen, online</h2>\n<p><em>LLMs k\u00f6nnen die Nutzung fortgeschrittener Funktionen und Tools erleichtern oder \u00fcberhaupt erst erm\u00f6glichen. Sie helfen dabei, anspruchsvolle Excel-Funktionen zu schreiben, SQL- und SPARQL-Queries zu formulieren, mit komplexen regul\u00e4ren Ausdr\u00fccken zu arbeiten, Dateien \u00fcber die Kommandozeile zu verwalten oder kleine Code-Schnipsel zu generieren. LLMs k\u00f6nnen z.B. auch in OpenRefine eingebunden werden und bei der Strukturierung von Information helfen. LLMs k\u00f6nnen hier helfen, es bedarf jedoch grundlegender Kenntnisse der zu Gebote stehenden Werkzeuge. Dar\u00fcber soll im Workshop gesprochen werden. Ebenso werden wir uns \u00fcber die Grenzen und Risiken des Einsatzes von LLMs unterhalten.</em></p>\n<ul>\n<li><strong>Termin: </strong>31.08.2026, 10:00 bis 13:00 Uhr, online via Zoom</li>\n<li><strong>Organisiert von</strong>: digiS Berlib; Referent: Alexander Winkler</li>\n<li>[<a href=\"https://www.digis-berlin.de/machine-learning-montag-iii-am-31-august-ki-assistierte-datenarbeit-in-glam-einrichtungen/\">Information und Anmeldung</a>]</li>\n</ul>\n<h2>3.-4. September, Forschungsdatenmanagement und Open Science in den qualitativen Sozialwissenschaften, online</h2>\n<p><em>Dieser Workshop zielt darauf ab, in die besonderen ethischen, rechtlichen und praktischen Herausforderungen im Management qualitativer Forschungsdaten einzuf\u00fchren \u2013 z. B. in Bezug auf Datenschutz, informierte Einwilligung, Anonymisierung, Dokumentation und Data Sharing \u2013 und zeigt dabei bew\u00e4hrte Praktiken sowie Beispiele f\u00fcr ein erfolgreiches FDM auf. Die Veranstaltung richtet sich insbesondere an Sozialwissenschaftler*innen, die mit qualitativen Methoden und Daten arbeiten.</em></p>\n<ul>\n<li><strong>Termin: </strong>03.-04.09.2026, online</li>\n<li><strong>Organisiert von</strong>: FID Soziologie (SocioHub) und Qualiservice; Vortragende: Dr. Viola Logemann und Dr. Greta Hartmann</li>\n<li>[<a href=\"https://www.sociohub-fid.de/p/Veranstaltungen\">Information und Anmeldung</a>]</li>\n</ul>\n<h2>3. September, Sind wir im Kulturbereich eigentlich noch digital souver\u00e4n?, Berliner Museumsinsel</h2>\n<p><em>Die Kultur im KI-Zeitalter. Wird der Traum vom niedrigschwelligen digitalen Zugang zu Bibliotheken, Archiven und Museen nun Realit\u00e4t \u2013 oder entstehen neue Abh\u00e4ngigkeiten? Und welche Verantwortung tragen Staat, Kulturinstitutionen und die gro\u00dfen Technologieunternehmen?</em></p>\n<ul>\n<li><strong>Termin: </strong>03.09.2026, 17:00 Uhr, James-Simon-Galerie, Bodestra\u00dfe 1\u20133, 10178 Berlin (Museumsinsel)</li>\n<li><strong>Organisiert von</strong>: Stiftung Preu\u00dfischer Kulturbesitz, der Deutsche Kulturrat und 3sat</li>\n<li>[<a href=\"https://www.preussischer-kulturbesitz.de/meldung/artikel/2026/09/03/sind-wir-im-kulturbereich-eigentlich-noch-digital-souveraen.html\">Information und Anmeldung</a>]</li>\n</ul>\n<h2>3. September, Wissenschaftspolitisches Wahlforum der GEW Berlin, HU Berlin</h2>\n<p><em>Wie geht es weiter mit den Berliner Hochschulen? Welche wissenschaftspolitischen Schwerpunkte setzen die Parteien nach der Abgeordnetenhauswahl? Und wie wollen sie gute Arbeits- und Studienbedingungen sowie eine zukunftsf\u00e4hige Hochschullandschaft sichern? Vertreter*innen der demokratischen Parteien im Berliner Abgeordnetenhaus diskutieren ihre Konzepte f\u00fcr die n\u00e4chste Legislaturperiode und stellen sich den Fragen aus Wissenschaft und Hochschule.</em></p>\n<ul>\n<li><strong>Termin: </strong>03.09.2026, 19:00 bis 21:30 Uhr, Senatssaal der HU Berlin, Unter den Linden 6, 10099 Berlin</li>\n<li><strong>Organisiert von</strong>: Gewerkschaft f\u00fcr Erziehung und Wissenschaft (GEW)</li>\n<li>[<a href=\"https://www.gew-berlin.de/veranstaltungen/detailseite/wissenschaftspolitisches-wahlforum-der-gew-berlin\">Information und Anmeldung</a>]</li>\n</ul>\n<h2>10. September, Open Research in History, Cultural Heritage and the Humanities, online</h2>\n<p>The webinar brings together three scholars whose work engages critically and theoretically with openness in history, cultural heritage and the humanities, addressing questions of data governance, research reproducibility, open infrastructures, and the epistemological challenges of working with historical and cultural heritage data. While the emphasis is on theoretical and conceptual perspectives, the presentations also draw on examples and case studies from the speakers' own research. We see this webinar as a space to think together about the tensions and opportunities of openness in the humanities: not only what open research standards call for, but what they mean in practice for historical and heritage scholarship, where sources, data and interpretation are entangled in particular ways.</p>\n<ul>\n<li><strong>Termin: </strong>10.09.2026, 15:00 bis 16:30 Uhr, online via Zoom</li>\n<li><strong>Organisiert von</strong>: Humanities, Data Science &amp; Methodology, TU Darmstadt (HDSM)</li>\n<li>[<a href=\"https://hdsm.hypotheses.org/8122\">Information und Anmeldung</a>]</li>\n</ul>\n<h2>11.-13. September, Berlin FediDay, c-base Berlin</h2>\n<p><em>Vielleicht bist Du bereits auf Mastodon, Pixelfed oder PeerTube unterwegs. Vielleicht entwickelst Du selbst Anwendungen oder besch\u00e4ftigst Dich mit dezentralen sozialen Netzen aus aktivistischen Gr\u00fcnden, in der Forschung oder als Verbreitungsweg f\u00fcr Deine Kunst. Egal, ob Du Poweruser bist oder komplett #neuhier: Das Programm bietet vom Einsteigerworkshop bis zu Panels und Party alles, was zu einer guten Hackerkonferenz dazugeh\u00f6rt.</em></p>\n<ul>\n<li><strong>Termin: </strong>11.-13.09.2026, c-base Berlin</li>\n<li><strong>Organisiert von</strong>: digiGes, c-base und Freund*innen</li>\n<li>[<a href=\"https://berlinfedi.day/\">Information und Anmeldung</a>]</li>\n</ul>\n<h2>21.-22. September, Beyond the Book: Digital Research, Presentation, and Sustainability, FU Berlin</h2>\n<p><em>This 1.5-day workshop explores how digital research, particularly in the context of non-Latin script languages, can move beyond the constraints of traditional scholarly formats. While books and articles remain central to academic knowledge production, many forms of computational research generate data, models, workflows, and analytical results that cannot be adequately represented through static text, images, or tables alone.</em></p>\n<ul>\n<li><strong>Termin: </strong>21.-22.09.2026, Freie Universit\u00e4t Berlin, Otto-von-Simson-Stra\u00dfe 7, 14195 Berlin</li>\n<li><strong>Organisiert von</strong>: Projekt Closing the Gap in Non-Latin Script Data</li>\n<li>[<a href=\"https://www.berlin-university-alliance.de/en/commitments/research-quality/events/2026/20260921-workshop-beyond-books.html\">Information und Anmeldung</a>]</li>\n</ul>\n<h2>23. September, Nicht per\u00adfekt. Aber lern\u00adf\u00e4\u00adhig. Fehlerkultur als Grundlage f\u00fcr neue Entwicklungen im Bibliothekswesen, Bezirkszentralbibliothek Pablo Neruda</h2>\n<p><em>Bibliotheken stehen mitten im Spannungsfeld aus Digitalisierung, KI und gesellschaftlichem Wandel. Doch genauso herausfordernd wie neue Technologien ist der Umgang mit dem eigenen Handeln \u2013 mit Erfolgen, aber vor allem auch mit Fehlentscheidungen. Diese Veranstaltung l\u00e4dt dazu ein, genau dort hinzuschauen: Wie k\u00f6nnen wir aus Erfahrungen \u2013 inklusive Scheitern \u2013 lernen, um aktiv die Zukunft von Bibliotheken zu gestalten?</em></p>\n<ul>\n<li><strong>Termin: </strong>23.09.2026, 11:00 bis 17:00 Uhr, Bezirkszentralbibliothek Pablo Neruda, WerkRaum, Frankfurter Allee 14 A, 10247 Berlin Friedrichshain-Kreuzberg</li>\n<li><strong>Organisiert von</strong>: TH Wildau, Berliner Arbeitskreis Information (BAK) und Deutscher Bibliotheksverband (dbv)</li>\n<li>[<a href=\"https://www.bibliotheksverband.de/nicht-perfekt-aber-lernfaehig\">Information und Anmeldung</a>]</li>\n</ul>\n<h2>24. September, Library Carpentries workshop on Open Source Hardware, HU Berlin</h2>\n<p>Interested in open source and open science? Looking to improve your open science training curriculum?\u00a0Join us for an in-person workshop to test a new Library Carpentries course on open source hardware in research settings, and give feedback on how to make it more useful for you.</p>\n<ul>\n<li><strong>Termin: </strong>24.09.2026, 9:00 bis 12:00 Uhr, Jacob-und-Wilhelm-Grimm-Zentrum library, Humboldt-Universit\u00e4t zu Berlin, Geschwister-Scholl-Stra\u00dfe 1/3, 10117 Berlin</li>\n<li><strong>Organisiert von</strong>: Pen-Yuan Hsing</li>\n<li>[<a href=\"https://events.tu-berlin.de/en/events/01a03e23-b54f-7ec8-b7a4-a0b535804379\">Information und Anmeldung</a>]</li>\n</ul>\n<h2>28.-30. September, Open-Access-Tage, Linz (\u00d6sterreich)</h2>\n<p><em>Die Open-Access-Tage sind die zentrale j\u00e4hrliche Konferenz zum Thema Open Access im deutschsprachigen Raum. Sie richtet sich an alle, die sich intensiv mit den M\u00f6glichkeiten, Bedingungen und Perspektiven des wissenschaftlichen Publizierens befassen. Dazu geh\u00f6ren Wissenschaftler*innenInnen sowie Mitarbeiter*innenInnen von Bibliotheken und anderen Einrichtungen der Wissenschaftsinfrastruktur ebenso wie Mitglieder der Wissenschaftsadministration und Verlage.</em></p>\n<ul>\n<li><strong>Termin: </strong>28.-30.09.2026, Johannes Kepler Universit\u00e4t Linz</li>\n<li><strong>Organisiert von</strong>: Programm- und Ortskommitees der OAT (<a href=\"https://open-access-tage.de/open-access-tage-2026-linz/default-5569ab164b0e3da842edfabdd52a27c8\">\u00dcbersicht</a>)</li>\n<li>[<a href=\"https://open-access-tage.de/open-access-tage-2026-linz\">Information und Anmeldung</a>]</li>\n</ul>\n<p>weiter zu <a href=\"https://blogs.fu-berlin.de/open-research-berlin/2026/09/01/veranstaltungshinweise-oktober-2026/\">Oktober 2026</a></p>","doi":"https://doi.org/10.59350/7147g-z9s75","guid":"https://blogs.fu-berlin.de/open-research-berlin/?p=4271","language":"de","license":"https://creativecommons.org/licenses/by/4.0/legalcode","published_at":1786924800,"rid":"tj4rj-qf489","summary":"Unsere monatliche Rubrik zu aktuellen Veranstaltungen rund um Open Research. Anmerkung zu dieser Rubrik: Das Open Research Office Berlin erstellt monatlich eine \u00dcbersicht \u00fcber Termine und Veranstaltungen zu Open Access und Open Research in Berlin bzw. an Berliner Einrichtungen.","tags":["Allgemein","Veranstaltungshinweise"],"title":"Veranstaltungshinweise September 2026","updated_at":1788852607,"url":"https://blogs.fu-berlin.de/open-research-berlin/2026/08/17/veranstaltungshinweise-september-2026/","version":"v1"},{"authors":[{"contributor_roles":[],"family":"Hare","given":"Maddie"}],"blog":{"authors":[{"name":"Bibliomagician Staff"}],"community_id":"f5c1522e-c8de-4681-a317-e32ddb61b26a","created":1780876800,"current_feed_url":null,"description":"Comment & practical guidance from the LIS-Bibliometrics community","doi":"https://doi.org/10.59350/bibliomagician","favicon":"https://rogue-scholar.org/api/communities/f5c1522e-c8de-4681-a317-e32ddb61b26a/logo","feed_format":"application/atom+xml","feed_url":"https://thebibliomagician.wordpress.com/feed/atom","filter":null,"generator":"WordPress.com","home_page_url":"https://thebibliomagician.wordpress.com","issn":null,"language":"eng","license":"https://creativecommons.org/licenses/by/4.0/legalcode","prefix":"10.59350","relative_url":null,"secure":true,"slug":"bibliomagician","status":"active","subfield":"3309","title":"The Bibliomagician","updated":1788797687,"use_api":true},"blog_name":"The Bibliomagician","blog_slug":"bibliomagician","content_html":"<p class=\"wp-block-paragraph\"><em>Nathalie Corn\u00e9e &amp; Kat Hart</em></p>\n\n\n\n<p class=\"has-text-align-justify wp-block-paragraph\"><em>Citations aren&#8217;t the only way research shows up in policy. Sometimes it&#8217;s a named researcher, a nod to &#8220;the evidence,&#8221; or a reference tucked into the text with no formal citation at all. Kat Hart and Nathalie Corn\u00e9e dug into Overton&#8217;s data to find out how often that happens, and what it means for how we understand research&#8217;s reach into policy.</em></p>\n\n\n\n<p class=\"has-text-align-justify wp-block-paragraph\">When we want to know if research has influenced policy, we usually turn to citations. They&#8217;re easy to spot and easy to count, so it makes sense that they&#8217;ve become the go-to signal for research influence.</p>\n\n\n\n<p class=\"has-text-align-justify wp-block-paragraph\">But citations are only <em>part</em> of the story. Policymakers don&#8217;t always follow academic conventions. Sometimes they name a researcher directly, reference a report rather than the paper behind it, or they simply gesture at &#8220;the evidence&#8221; without pointing to anything specific at all.</p>\n\n\n\n<p class=\"has-text-align-justify wp-block-paragraph\">So, we set out to ask a simple question: if we look past formal citations, what else might be going on? Using Overton&#8217;s data, we compared the scale of formal citations against these more informal mentions and tried to get a sense of what the gap between them might look like. This is an exploratory pilot rather than a definitive study, as the sample is far too small to draw firm conclusions. We hope its value lies more in how it reframes the question of what counts as 'research engaging with policy' (and vice versa) in the first place.</p>\n\n\n\n<h1 class=\"wp-block-heading\">Why this matters right now</h1>\n\n\n\n<p class=\"has-text-align-justify wp-block-paragraph\">Definitions of research impact are shifting. A <a href=\"https://blogs.lse.ac.uk/impactofsocialsciences/2026/03/23/we-should-focus-less-on-research-impact-and-more-on-research-value/\">recent Australian study</a> published on LSE's impact blog made a useful point on this: institutional definitions of impact often don&#8217;t match how researchers actually work (O'Connor et al., 2026). Instead of asking &#8220;did this have impact?&#8221;, the authors suggest asking &#8220;what value does this create, and for whom?&#8221; It&#8217;s a small shift in framing, but it moves the conversation from proving impact to understanding it.</p>\n\n\n\n<blockquote class=\"wp-block-quote is-layout-flow wp-block-quote-is-layout-flow\">\n<p class=\"wp-block-paragraph\">If citation counts alone don&#8217;t capture the full picture, what other signals should we be paying attention to?</p>\n</blockquote>\n\n\n\n<h1 class=\"wp-block-heading\">How we approached it</h1>\n\n\n\n<p class=\"has-text-align-justify wp-block-paragraph\">We used the <a href=\"https://www.overton.io/overton-index\">Overton Index</a> as our starting point. At the time of the study, Overton indexed over 27 million policy documents from more than 190 countries and 3,100 sources, spanning everything from intergovernmental organisations like the UN and WHO to NGOs, think tanks, national governments, as well as regional and local bodies like Canadian provinces and UK devolved nations.</p>\n\n\n\n<p class=\"has-text-align-justify wp-block-paragraph\">For the pilot itself, we kept things deliberately focused. We took a random sample of 50 UK government policy documents from 2025 and used Overton&#8217;s AI classification to pull out document type, length, and authorship. Then came the manual part: we&nbsp;read and coded every single document by hand.</p>\n\n\n\n<p class=\"has-text-align-justify wp-block-paragraph\">This was a conscious choice. Automated tools are good at catching formal citations, but they miss the less obvious ways research shows up in policy text. We wanted to capture all of it, so we built a coding framework covering two broad categories:</p>\n\n\n\n<ol start=\"1\" class=\"wp-block-list\">\n<li><strong>Objects</strong>: the types of evidence referenced, such as peer-reviewed publications, policy evidence, or informal knowledge transmission material like blog posts and policy briefs.</li>\n\n\n\n<li><strong>Actors:</strong> the people and organisations referenced, such as research organisations, named researchers, funders, or in-house policy experts.</li>\n</ol>\n\n\n<div class=\"wp-block-image\">\n<figure class=\"aligncenter size-large is-resized\"><img data-attachment-id=\"5650\" data-permalink=\"https://thebibliomagician.wordpress.com/2026/09/07/cited-or-mentioned-what-we-learned-about-how-research-actually-shows-up-in-policy/image-29/\" data-orig-file=\"https://thebibliomagician.wordpress.com/wp-content/uploads/2026/09/image.png\" data-orig-size=\"770,723\" data-comments-opened=\"1\" data-image-meta=\"{&quot;aperture&quot;:&quot;0&quot;,&quot;credit&quot;:&quot;&quot;,&quot;camera&quot;:&quot;&quot;,&quot;caption&quot;:&quot;&quot;,&quot;created_timestamp&quot;:&quot;0&quot;,&quot;copyright&quot;:&quot;&quot;,&quot;focal_length&quot;:&quot;0&quot;,&quot;iso&quot;:&quot;0&quot;,&quot;shutter_speed&quot;:&quot;0&quot;,&quot;title&quot;:&quot;&quot;,&quot;orientation&quot;:&quot;0&quot;,&quot;alt&quot;:&quot;&quot;}\" data-image-title=\"image\" data-image-description=\"\" data-image-caption=\"\" data-large-file=\"https://thebibliomagician.wordpress.com/wp-content/uploads/2026/09/image.png?w=770\" loading=\"lazy\" width=\"770\" height=\"723\" src=\"https://thebibliomagician.wordpress.com/wp-content/uploads/2026/09/image.png?w=770\" alt=\"\" class=\"wp-image-5650\" style=\"aspect-ratio:1.0650338254900993;width:444px;height:auto\" srcset=\"https://thebibliomagician.wordpress.com/wp-content/uploads/2026/09/image.png 770w, https://thebibliomagician.wordpress.com/wp-content/uploads/2026/09/image.png?w=150 150w, https://thebibliomagician.wordpress.com/wp-content/uploads/2026/09/image.png?w=300 300w\" sizes=\"auto, (max-width: 770px) 100vw, 770px\" /></figure>\n</div>\n\n\n<p class=\"has-text-align-center wp-block-paragraph\"><em>Figure 1. Workflow for identifying and classifying attention to actors and objects in UK government policy documents.</em></p>\n\n\n\n<p class=\"has-text-align-justify wp-block-paragraph\">For each one, we recorded whether it was a <strong>citation</strong> (a formal, traceable reference) or a <strong>mention</strong> (an informal acknowledgement with no formal citation attached). Where a document referenced several things together, we logged each one individually rather than lumping them into a single entry. Across just 50 documents, that added up to over 2,200 individual references, which gave us plenty to work with despite the small sample size.</p>\n\n\n\n<h1 class=\"wp-block-heading\">What we found</h1>\n\n\n\n<h2 class=\"wp-block-heading\">Policy talks to policy more than it talks to academic research</h2>\n\n\n\n<p class=\"has-text-align-justify wp-block-paragraph\">Across our sample, we identified 2,244 objects and actors in total. Policy actors (think tanks, government bodies, IGOs) and policy evidence (past reports, transcripts, consultation outputs) were by far the most common categories in our data, together with in-house research accounting for around 75% of everything referenced.</p>\n\n\n\n<p class=\"has-text-align-justify wp-block-paragraph\">Peer-reviewed publications, by comparison, made up just under 5% of all references. Generic, non-specific nods to &#8220;experts&#8221; or &#8220;previous research&#8221; &nbsp;outnumbered them, at around 9%. In other words, plenty of documents acknowledge that evidence exists somewhere, without pointing to anything specific.</p>\n\n\n\n<h2 class=\"wp-block-heading\">Citations and mentions tell different stories depending on what&#8217;s being referenced.</h2>\n\n\n\n<p class=\"has-text-align-justify wp-block-paragraph\">Peer-reviewed articles were the type of evidence most likely to receive a full, formal citation. Commissioned research told a different story: it often got absorbed into the narrative (&#8220;the data suggests&#8221;, &#8220;interviews found&#8221;) with no formal attribution at all. Policy outputs sat somewhere in between, appearing as both citations and mentions in meaningful numbers.</p>\n\n\n\n<p class=\"has-text-align-justify wp-block-paragraph\">Across the whole sample, mentions were consistently more common than citations.</p>\n\n\n\n<h2 class=\"wp-block-heading\">Who wrote the document matters as much as what it says</h2>\n\n\n\n<p class=\"has-text-align-justify wp-block-paragraph\">Referencing patterns varied a lot depending on who authored the document. Our five most prolific authors in the sample were the Department for Education, the Law Commission, UK Government more broadly, the Ministry of Justice, and the Department for Environment, Food and Rural Affairs (DEFRA) together with the Animal and Plant Health Agency (APHA). Each had a distinct pattern of what they referenced and how often.</p>\n\n\n\n<p class=\"has-text-align-justify wp-block-paragraph\">A working paper from the Foreign and Commonwealth Office, written by commissioned academics, leaned heavily on peer-reviewed citations, as you&#8217;d expect. A similar paper from Technopolis, a consultancy commissioned by the Department for Science, Innovation and Technology (DSIT), leaned instead on funder acknowledgements and commissioned research. Same document type, same broad government context, very different citation behaviour.</p>\n\n\n\n<h2 class=\"wp-block-heading\">Longer documents don&#8217;t necessarily cite more</h2>\n\n\n\n<p class=\"has-text-align-justify wp-block-paragraph\">We also tested the intuitive assumption that longer documents would contain more citations. They don&#8217;t, at least not cleanly. Some of the highest citation counts did appear in longer documents, but plenty of short documents cited heavily too, and plenty of long ones cited very little. There&#8217;s no straightforward relationship between page count and citation volume in this sample.</p>\n\n\n\n<h2 class=\"wp-block-heading\">Even formal citations don&#8217;t always make it into a bibliography</h2>\n\n\n\n<p class=\"has-text-align-justify wp-block-paragraph\">Most documents in our sample didn&#8217;t have a formal bibliography at all, relying on footnotes instead. And even where a reference qualified as a formal citation, it only had roughly a 50/50 chance of actually appearing in a bibliography rather than just the body text. Citation habits clearly vary a lot from one policymaker to another.</p>\n\n\n\n<p class=\"has-text-align-justify wp-block-paragraph\">The research being cited mostly comes from a small number of places</p>\n\n\n\n<p class=\"has-text-align-justify wp-block-paragraph\">Of the peer-reviewed research we identified, half came from UK universities alone, 43% came from international institutions, and the rest reflected UK and international collaborations.</p>\n\n\n\n<h2 class=\"wp-block-heading\">What this means</h2>\n\n\n\n<p class=\"wp-block-paragraph\">A few things stood out consistently across the sample:</p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>Policy actors and policy evidence dominate what gets referenced in policy documents, well ahead of peer-reviewed academic research.</li>\n\n\n\n<li>Some documents and document types are far richer sources of citations than others, and a handful of outliers account for a disproportionate share of all references.</li>\n\n\n\n<li>Mentions turned out to be the more common form of attention across nearly all reference types.</li>\n</ul>\n\n\n\n<p class=\"has-text-align-justify wp-block-paragraph\">Taken together, these early findings suggest that citation counts alone may only capture <em>a part</em> of how research reaches policy.</p>\n\n\n\n<p class=\"has-text-align-justify wp-block-paragraph\">Where we think this work is genuinely useful is in how it reframes the question. Right now, most tools only ask <em>whether</em> a policy document cited a piece of research or not. Splitting that into citations and mentions lets us ask a more useful question: <em>how is research actually showing up, even when there&#8217;s no formal reference at all?</em> That feels like a real gap worth exploring.</p>\n\n\n\n<p class=\"has-text-align-justify wp-block-paragraph\">The coding framework itself, sorting references into different types of evidence and different types of actors, and tagging each one as a citation or a mention, is a first step towards making that visible. It gives us a way to describe the kinds of engagement that citation counts alone may miss, so it&#8217;s a starting point for more work.</p>\n\n\n\n<p class=\"has-text-align-justify wp-block-paragraph\">This also fits with a broader pattern often noted in research impact literature: that scholarly expertise tends to reach policy indirectly, through reviews, consultations, and expert commentary, rather than through direct citation. That raises a genuinely open question: how much of what we&#8217;re seeing is a passing reference, and how much reflects real engagement with the research itself?</p>\n\n\n\n<blockquote class=\"wp-block-quote is-layout-flow wp-block-quote-is-layout-flow\">\n<blockquote class=\"wp-block-quote is-layout-flow wp-block-quote-is-layout-flow\">\n<p class=\"wp-block-paragraph\">Being able to tell the difference matters if we want to understand not just whether research is being used, but how and why. </p>\n</blockquote>\n</blockquote>\n\n\n\n<h2 class=\"wp-block-heading\">Where we go from here</h2>\n\n\n\n<p class=\"wp-block-paragraph\"><a id=\"_msocom_1\"></a></p>\n\n\n\n<p class=\"has-text-align-justify wp-block-paragraph\">This was a small, exploratory pilot, and we&#8217;re upfront about its limits. Fifty documents from one country over one year is a start, not a conclusion.</p>\n\n\n\n<p class=\"has-text-align-justify wp-block-paragraph\">Next, we&#8217;d like to scale up the sample across a wider, more representative set of countries using an LLM to help with the coding. We&#8217;d also like to track whether the balance between citations and mentions is shifting over time and compare document types more systematically to understand whether citation behaviour is driven more by document function or by the authoring body. Beyond that, we want to develop ways to assess the depth of engagement behind a reference, not just whether it exists, and look at whether these patterns differ across policy domains, comparing something like health policy against education policy.</p>\n\n\n\n<p class=\"wp-block-paragraph\"><em>If you have thoughts on this work, or you&#8217;re doing something similar, we&#8217;d love to hear from you. Get in touch at</em> <a href=\"mailto:nathalie@overton.io\"><em>nathalie@overton.io</em></a> <em>or</em> <a href=\"mailto:kat@overton.io\"><em>kat@overton.io</em></a>.</p>\n\n\n\n<h1 class=\"wp-block-heading\">References</h1>\n\n\n\n<ol class=\"wp-block-list\">\n<li>O'Connor, R., Malde, S., Russell, W., &amp; Haviland, M. (2026, March 23). <em>We should focus less on research impact and more on research value</em>. LSE Impact Blog. <a href=\"https://blogs.lse.ac.uk/impactofsocialsciences/2026/03/23/we-should-focus-less-on-research-impact-and-more-on-research-value/\">https://blogs.lse.ac.uk/impactofsocialsciences/2026/03/23/we-should-focus-less-on-research-impact-and-more-on-research-value/</a></li>\n</ol>\n\n\n\n<h1 class=\"wp-block-heading\">About the Authors</h1>\n\n\n\n<div class=\"wp-block-media-text is-stacked-on-mobile\" style=\"grid-template-columns:29% auto\"><figure class=\"wp-block-media-text__media\"><img data-attachment-id=\"5662\" data-permalink=\"https://thebibliomagician.wordpress.com/2026/09/07/cited-or-mentioned-what-we-learned-about-how-research-actually-shows-up-in-policy/nathalie/\" data-orig-file=\"https://thebibliomagician.wordpress.com/wp-content/uploads/2026/09/nathalie.png\" data-orig-size=\"704,924\" data-comments-opened=\"1\" data-image-meta=\"{&quot;aperture&quot;:&quot;0&quot;,&quot;credit&quot;:&quot;&quot;,&quot;camera&quot;:&quot;&quot;,&quot;caption&quot;:&quot;&quot;,&quot;created_timestamp&quot;:&quot;0&quot;,&quot;copyright&quot;:&quot;&quot;,&quot;focal_length&quot;:&quot;0&quot;,&quot;iso&quot;:&quot;0&quot;,&quot;shutter_speed&quot;:&quot;0&quot;,&quot;title&quot;:&quot;&quot;,&quot;orientation&quot;:&quot;0&quot;,&quot;alt&quot;:&quot;&quot;}\" data-image-title=\"Nathalie\" data-image-description=\"\" data-image-caption=\"\" data-large-file=\"https://thebibliomagician.wordpress.com/wp-content/uploads/2026/09/nathalie.png?w=704\" loading=\"lazy\" width=\"704\" height=\"924\" src=\"https://thebibliomagician.wordpress.com/wp-content/uploads/2026/09/nathalie.png?w=704\" alt=\"\" class=\"wp-image-5662 size-full\" srcset=\"https://thebibliomagician.wordpress.com/wp-content/uploads/2026/09/nathalie.png 704w, https://thebibliomagician.wordpress.com/wp-content/uploads/2026/09/nathalie.png?w=114 114w, https://thebibliomagician.wordpress.com/wp-content/uploads/2026/09/nathalie.png?w=229 229w\" sizes=\"auto, (max-width: 704px) 100vw, 704px\" /></figure><div class=\"wp-block-media-text__content\">\n<p class=\"has-text-align-justify wp-block-paragraph\"><strong>Nathalie Corn\u00e9e</strong> helps the research and policy community around the world get the most out of Overton. She joined in 2023, bringing more than 20 years of experience across the pharma, research, and academic library sectors, always focused on highlighting the significance of research and supporting the researchers behind it, including through bibliometric analysis. She takes a practical, hands-on approach to helping users find the data they need and make sense of research impact.</p>\n</div></div>\n\n\n\n<div class=\"wp-block-media-text is-stacked-on-mobile\" style=\"grid-template-columns:29% auto\"><figure class=\"wp-block-media-text__media\"><img data-attachment-id=\"5663\" data-permalink=\"https://thebibliomagician.wordpress.com/2026/09/07/cited-or-mentioned-what-we-learned-about-how-research-actually-shows-up-in-policy/kat/\" data-orig-file=\"https://thebibliomagician.wordpress.com/wp-content/uploads/2026/09/kat.png\" data-orig-size=\"200,200\" data-comments-opened=\"1\" data-image-meta=\"{&quot;aperture&quot;:&quot;0&quot;,&quot;credit&quot;:&quot;&quot;,&quot;camera&quot;:&quot;&quot;,&quot;caption&quot;:&quot;&quot;,&quot;created_timestamp&quot;:&quot;0&quot;,&quot;copyright&quot;:&quot;&quot;,&quot;focal_length&quot;:&quot;0&quot;,&quot;iso&quot;:&quot;0&quot;,&quot;shutter_speed&quot;:&quot;0&quot;,&quot;title&quot;:&quot;&quot;,&quot;orientation&quot;:&quot;0&quot;,&quot;alt&quot;:&quot;&quot;}\" data-image-title=\"Kat\" data-image-description=\"\" data-image-caption=\"\" data-large-file=\"https://thebibliomagician.wordpress.com/wp-content/uploads/2026/09/kat.png?w=200\" loading=\"lazy\" width=\"200\" height=\"200\" src=\"https://thebibliomagician.wordpress.com/wp-content/uploads/2026/09/kat.png?w=200\" alt=\"\" class=\"wp-image-5663 size-full\" srcset=\"https://thebibliomagician.wordpress.com/wp-content/uploads/2026/09/kat.png 200w, https://thebibliomagician.wordpress.com/wp-content/uploads/2026/09/kat.png?w=150 150w\" sizes=\"auto, (max-width: 200px) 100vw, 200px\" /></figure><div class=\"wp-block-media-text__content\">\n<p class=\"has-text-align-justify wp-block-paragraph\"><strong>Kat Hart </strong>is a Senior Analyst at Overton, where she curates policy data and uses bibliometrics to explore evidence-use patterns worldwide. Alongside this, she&#8217;s a PhD researcher at the University of Nottingham, studying UK water governance. She previously worked as a knowledge broker in UK higher education, focused on &#8216;what works&#8217; in connecting academic research with public policy.&nbsp;&nbsp;</p>\n</div></div>\n\n\n\n<p class=\"wp-block-paragraph\"><img data-attachment-id=\"3128\" data-permalink=\"https://thebibliomagician.wordpress.com/2019/07/10/knowledge-is-global-expanding-the-awareness-and-impact-of-research-from-the-global-south-guest-post-by-monica-ihli/c-cby-2/\" data-orig-file=\"https://thebibliomagician.wordpress.com/wp-content/uploads/2019/07/c-cby-1.png\" data-orig-size=\"88,31\" data-comments-opened=\"1\" data-image-meta=\"{&quot;aperture&quot;:&quot;0&quot;,&quot;credit&quot;:&quot;&quot;,&quot;camera&quot;:&quot;&quot;,&quot;caption&quot;:&quot;&quot;,&quot;created_timestamp&quot;:&quot;0&quot;,&quot;copyright&quot;:&quot;&quot;,&quot;focal_length&quot;:&quot;0&quot;,&quot;iso&quot;:&quot;0&quot;,&quot;shutter_speed&quot;:&quot;0&quot;,&quot;title&quot;:&quot;&quot;,&quot;orientation&quot;:&quot;0&quot;}\" data-image-title=\"C CBY\" data-image-description=\"\" data-image-caption=\"\" data-large-file=\"https://thebibliomagician.wordpress.com/wp-content/uploads/2019/07/c-cby-1.png?w=88\" loading=\"lazy\" width=\"88\" height=\"31\" class=\"wp-image-3128\" style=\"width:88px\" src=\"https://thebibliomagician.wordpress.com/wp-content/uploads/2019/07/c-cby-1.png\" alt=\"\"> Unless it states otherwise, the content of the Bibliomagician is licensed under a <a href=\"http://creativecommons.org/licenses/by/4.0/\">Creative Commons Attribution 4.0 International License</a>.</p>\n\n\n\n<p class=\"wp-block-paragraph\"><strong>DOI:</strong> <a href=\"https://doi.org/10.59350/74r3r-67451\">https://doi.org/10.59350/74r3r-67451</a></p>\n\n\n\n<p class=\"wp-block-paragraph\"></p>","doi":"https://doi.org/10.59350/a3dpx-knp02","guid":"https://thebibliomagician.wordpress.com/?p=5646","image":"https://thebibliomagician.wordpress.com/wp-content/uploads/2026/09/image.png?w=770","language":"en","license":"https://creativecommons.org/licenses/by/4.0/legalcode","published_at":1788739200,"reference":[{"id":"https://blogs.lse.ac.uk/impactofsocialsciences/2026/03/23/we-should-focus-less-on-research-impact-and-more-on-research-value/","unstructured":"O'Connor, R., Malde, S., Russell, W., & Haviland, M. (2026, March 23). We should focus less on research impact and more on research value. LSE Impact Blog."}],"rid":"xx8x7-m3t11","summary":"Nathalie Corn\u00e9e &amp; Kat Hart Citations aren't the only way research shows up in policy. Sometimes it's a named researcher, a nod to \"the evidence,\" or a reference tucked into the text with no formal citation at all.","tags":["Altmetrics","Policy"],"title":"Cited or mentioned? What we learned about how research actually shows up in policy","updated_at":1788852606,"url":"https://thebibliomagician.wordpress.com/2026/09/07/cited-or-mentioned-what-we-learned-about-how-research-actually-shows-up-in-policy/","version":"v1"},{"authors":[{"contributor_roles":[],"family":"Jehn","given":"Florian Ulrich","url":"https://orcid.org/0000-0002-7296-8008"}],"blog":{"authors":null,"community_id":"86cf2e28-4644-41b0-9d6d-66444a612b18","created":1751500800,"current_feed_url":null,"description":"Thoughts about existential risk, history, climate, food security and societal collapse.","doi":"https://doi.org/10.59350/existentialcrunch","favicon":"https://rogue-scholar.org/api/communities/86cf2e28-4644-41b0-9d6d-66444a612b18/logo","feed_format":"application/rss+xml","feed_url":"https://existentialcrunch.substack.com/feed","filter":null,"generator":"Substack","home_page_url":"https://existentialcrunch.substack.com","issn":null,"language":"eng","license":"https://creativecommons.org/licenses/by/4.0/legalcode","prefix":"10.59350","relative_url":null,"secure":true,"slug":"existentialcrunch","status":"active","subfield":"2306","title":"Existential Crunch","updated":1788851190,"use_api":null},"blog_name":"Existential Crunch","blog_slug":"existentialcrunch","content_html":"<div class=\"captioned-image-container\"><figure><a class=\"image-link image2 is-viewable-img\" target=\"_blank\" href=\"https://substackcdn.com/image/fetch/$s_!N-_c!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd2c2347c-adc2-4961-b88e-98e1804912ec_1065x790.png\" data-component-name=\"Image2ToDOM\"><div class=\"image2-inset\"><picture><source type=\"image/webp\" srcset=\"https://substackcdn.com/image/fetch/$s_!N-_c!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd2c2347c-adc2-4961-b88e-98e1804912ec_1065x790.png 424w, https://substackcdn.com/image/fetch/$s_!N-_c!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd2c2347c-adc2-4961-b88e-98e1804912ec_1065x790.png 848w, https://substackcdn.com/image/fetch/$s_!N-_c!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd2c2347c-adc2-4961-b88e-98e1804912ec_1065x790.png 1272w, https://substackcdn.com/image/fetch/$s_!N-_c!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd2c2347c-adc2-4961-b88e-98e1804912ec_1065x790.png 1456w\" sizes=\"100vw\"><img src=\"https://substackcdn.com/image/fetch/$s_!N-_c!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd2c2347c-adc2-4961-b88e-98e1804912ec_1065x790.png\" width=\"1065\" height=\"790\" data-attrs=\"{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/d2c2347c-adc2-4961-b88e-98e1804912ec_1065x790.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:790,&quot;width&quot;:1065,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:2064417,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:false,&quot;topImage&quot;:true,&quot;internalRedirect&quot;:&quot;https://existentialcrunch.substack.com/i/206492588?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd2c2347c-adc2-4961-b88e-98e1804912ec_1065x790.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}\" class=\"sizing-normal\" alt=\"\" srcset=\"https://substackcdn.com/image/fetch/$s_!N-_c!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd2c2347c-adc2-4961-b88e-98e1804912ec_1065x790.png 424w, https://substackcdn.com/image/fetch/$s_!N-_c!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd2c2347c-adc2-4961-b88e-98e1804912ec_1065x790.png 848w, https://substackcdn.com/image/fetch/$s_!N-_c!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd2c2347c-adc2-4961-b88e-98e1804912ec_1065x790.png 1272w, https://substackcdn.com/image/fetch/$s_!N-_c!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd2c2347c-adc2-4961-b88e-98e1804912ec_1065x790.png 1456w\" sizes=\"100vw\" fetchpriority=\"high\"></picture><div class=\"image-link-expand\"><div class=\"pencraft pc-display-flex pc-gap-8 pc-reset\"><button tabindex=\"0\" type=\"button\" class=\"pencraft pc-reset pencraft icon-container restack-image\"><svg aria-hidden=\"true\" width=\"20\" height=\"20\" viewBox=\"0 0 20 20\" fill=\"none\" stroke-width=\"1.5\" stroke=\"var(--color-fg-primary)\" stroke-linecap=\"round\" stroke-linejoin=\"round\" xmlns=\"http://www.w3.org/2000/svg\"><g><path d=\"M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882\"></path></g></svg></button><button tabindex=\"0\" type=\"button\" class=\"pencraft pc-reset pencraft icon-container view-image\"><svg xmlns=\"http://www.w3.org/2000/svg\" width=\"20\" height=\"20\" viewBox=\"0 0 24 24\" fill=\"none\" stroke=\"currentColor\" stroke-width=\"2\" stroke-linecap=\"round\" stroke-linejoin=\"round\" class=\"lucide lucide-maximize2 lucide-maximize-2\"><polyline points=\"15 3 21 3 21 9\"></polyline><polyline points=\"9 21 3 21 3 15\"></polyline><line x1=\"21\" x2=\"14\" y1=\"3\" y2=\"10\"></line><line x1=\"3\" x2=\"10\" y1=\"21\" y2=\"14\"></line></svg></button></div></div></div></a><figcaption class=\"image-caption\">Castelnau, Paul. (1917). Reims, Marne. Ruines d'une imprimerie, rue des Trois Raisinets [Autochrome]. Public Domain (CC-0). Inventory number: A11472.</figcaption></figure></div><p><em>This post is part of a <a href=\"https://existentialcrunch.substack.com/p/introducing-a-living-literature-review\">living literature review</a> on societal collapse. You can find an indexed archive <a href=\"https://florianjehn.github.io/Societal_Collapse/\">here</a>.</em></p><p>After reading dozens and dozens of scientific papers about societal collapse, I wanted a new perspective on the topic. So, I read a lot of novels about societal collapse, as stories shape how we see the world and thus the action we take (1) (2). To my surprise, it turned out to be pretty hard to find books that actually take collapse seriously instead of just using it as a backdrop.</p><p>Collapse is a topic people like to tell stories about, as it grasps the imagination with what might be and how everything we have now might be gone in the future. I found the books by searching the internet and asking friends and colleagues for recommendations. This means there is no coherent set of criteria that makes a book collapse relevant, more a vibes based approach on what I and other people felt could be a collapse relevant book. Obviously, this is also not a complete list, so I'd be happy to hear further suggestions in the comments.</p><p>This post gives an overview of the books I have read, makes some recommendations on which ones are worth reading and describes what I have learned from reading them.</p><p class=\"button-wrapper\" data-attrs=\"{&quot;url&quot;:&quot;https://existentialcrunch.substack.com/subscribe?&quot;,&quot;text&quot;:&quot;Subscribe now&quot;,&quot;action&quot;:null,&quot;class&quot;:null}\" data-component-name=\"ButtonCreateButton\"><a class=\"button primary\" href=\"https://existentialcrunch.substack.com/subscribe?\"><span>Subscribe now</span></a></p><h1>Books covered so far</h1><p>First, I will give a short overview of the books and what I thought about them. The list is roughly ordered by how much I would recommend reading them, starting with the ones I liked least and ending with my favorites.</p><h2><a href=\"https://en.wikipedia.org/wiki/The_Years_of_Rice_and_Salt\">The Years of Rice and Salt</a></h2><p>The book starts with a great premise: How would the world have developed if the Black Death would have killed 99 % of the European population? And the first few chapters really hammer that home, as they tell the story of a lone warrior trying to survive, only ever finding ruins and death wherever he goes. But after that the book mostly forgets about what got it started, never really mentions that super plague again and instead tells an alternate history story of a monumental battle of cultures between China and an Islamized rest of the world in a connected set of short stories. Don't get me wrong, the book is not bad, but it was quite disappointing to me, as it does not really say anything about collapse, even though the premise would have been great for that. The alternate history of it is interesting, although it sometimes felt like he took the actual history and just replaced all entries of Europe with China. Some of the short stories were quite good and if you like alternate history, this one is still worth checking out.</p><h2><a href=\"https://en.wikipedia.org/wiki/Parable_of_the_Sower_(novel)\">The Parable of the Sower</a></h2><p>This story follows the life of a young girl that grows up in a world that is in a slow collapse, likely induced by escalating climate change. Social order is breaking down and people revert more and more to barbarism. The main character is trying to create a new ideology of positive change to counteract this and over the length of the book gathers a ragtag group of other survivors. The world it describes is interesting, but remains quite vague, as the book really wants to focus on the thoughts and feelings of the main character. This makes the collapse element seem more like the backdrop in what is actually a coming of age story. So, it was an okay read for me, but ultimately not that interesting.</p><h2><a href=\"https://en.wikipedia.org/wiki/Oryx_and_Crake\">Oryx and Crake</a></h2><p>The world of this novel is one ravaged by climate change and rampant resource overuse. This has destabilized the world, which humanity tried to counteract by going all in on manipulating biology. Creating pigs to harvest human organs or brainless flesh tubes to produce meat, quickly and cheaply. The story is told from the perspective of Snowman, on of the few survivors of an engineered pandemic. Over the length of the book, it is slowly revealed that Snowman's childhood friend Crake is responsible for this. According to the Wikipedia entry Crake did this to save Earth from humanity, but while reading the book this did not become super clear to me and the whole release of the engineered pandemic felt somewhat random and unearned given the setup. The book is nicely written and good to read, but I did not find the characters super interesting and the societal collapse itself is only described very vaguely.</p><h2><a href=\"https://en.wikipedia.org/wiki/Last_and_First_Men\">Last and First Men</a></h2><p>Here the attempt is to tell the story of humanity from the 1930s until the extinction of the last descendant of humankind. This happens via the last men contacting the author of the book from the future to write down the whole history. It is a very weird book. It reads less like fiction and more like a historical treatise from the future. And the author imagines a very wide variety of future humans ranging from flying humans, to ape humans and also humans that are only giant brains in a vat. You also really notice that this book was written by someone from the 1930s, because oh boy does Olaf Stapledon love eugenics. So many pages in this book are spent on describing how better versions of humanity are bred purposefully. Still, it is quite interesting as an historical document, as it shows how people in the 1930s envisioned the future. Also, it is interesting in how he describes how all the different past civilizations perished, some from resource overuse, some from moral failures or others by just being unlucky. Overall, a fascinating book, but not really that great to actually read.</p><h2><a href=\"https://craphound.com/overclocked/Cory_Doctorow_-_Overclocked_-_When_Sysadmins_Ruled_the_Earth.html\">When Sysadmins ruled the Earth</a></h2><p>Not really a book, but a longer short story. The idea is that Earth is suddenly hit by a super deadly pandemic, likely introduced by bioterrorism. Most people die within days, but large groups of sysadmins survive in their data centers, as a large cyber attack just before the pandemic hit all made them gather in their fortress-like data centers, where they are safe for a while due to filtered air and backup power. From those data centers they try to coordinate a response, but have a hard time going anywhere due to never ending discussions. The story itself is just fine, but I liked the focus on infrastructure and its importance. Also, it is always nice if people like sysadmins, who work on maintaining our current world, without ever being seen, get some recognition.</p><h2><a href=\"https://en.wikipedia.org/wiki/The_Death_of_Grass\">The Death of Grass</a></h2><p>This book wants to tell a story about how human morality is only something rich countries can have, because we live in abundance. This abundance is disrupted by a new kind of virus that kills all grass species in the world. As this includes most of the major food crops, the result is global famine. The book follows a pretty normal English family and how they try to navigate a world that quickly goes from abundance to scarcity. I think the premise of the book is good, as I also think that without food humans might quickly get more aggressive and violent. However, the book does not really tell this change in a convincing manner. The main protagonist of the book just takes a few days to go from polite, boring dad to being completely fine with robbing and killing innocent people to advance his position. Also, it is super misogynistic for no reason. Still, I really liked the idea of what this book could have been, if it would have been better.</p><h2><a href=\"https://en.wikipedia.org/wiki/The_Windup_Girl\">The Windup Girl</a></h2><p>A post contraction world. Fossil fuel capitalism has run its course and left the Earth broken. There are only scarce reserves of oil and gas left and so society has reverted again to more mechanical labor. However, this is enhanced by massive bioengineering and there are many new species to take on some of the burden. However, this massive focus on bioengineering also has released many new diseases into the world and food crops have to be continuously adapted to stay valid. Due to this power is concentrated in a few bioengineering corporations that control most of the world. One of the remaining independent countries is Thailand. The book focuses on a set of characters that try to steer their life in better directions, while around them the country slowly degrades into civil war.</p><p>I think this book did a pretty good job in describing a plausible future. Everything seems alien, but you can see how today's society could end up in such a scenario. It also goes into a good amount of detail how such a society would work and how it would set different priorities that we do today. What stops this book from being more of a favorite is that the actual story it tells is somewhat meandering, forgets its own strands and then results in a very mid ending. Still, worth checking out just for world building.</p><h2><a href=\"https://en.wikipedia.org/wiki/World_War_Z\">World War Z</a></h2><p>This one was recommended to me by several people and I get why. I would not have expected this from a book about a global war against zombies, but this book is pretty good at thinking through how such a collapse would look like and what the consequences might be. It is told through interviews with survivors of the zombie war and describes what happened throughout the war in chronological order.</p><p>I am not sure how much I can actually learn from this about \"normal\" collapse, but it certainly was quite interesting to see how the author manages to describe how politics, military tactics or economics change if suddenly the biggest threat to humanity are millions upon millions of zombies.</p><p>The reason why this did not make it further in the ranking is that the writing seemed pretty repetitive to me. While the book claims to interview a large group of different people from very different backgrounds, they all sound and feel very similarly, which gets a bit exhausting over the length of the book.</p><h2><a href=\"https://en.wikipedia.org/wiki/The_Sheep_Look_Up\">The Sheep Look Up</a></h2><p>This is essentially Silent Spring, the novel. It is set in a near-future USA where environmental pollution has reached unprecedented heights. In most places you cannot go outside without a filter mask, children are born deformed because of the toxins they are exposed to before birth, and social discontent is brewing because people are no longer willing to tolerate this. The story follows a wide cast of characters: people who just want to make a living and ignore how dysfunctional society is getting around them, regenerative farmers who want to build their own isolated commune, and a reporter trying to push for better governance with the help of an activist leader. Around them society crumbles as people's health declines and the social fabric frays, because nobody believes in a better world anymore.</p><p>The book feels a bit like an artifact from another timeline. I can clearly see how somebody writing this in 1972 would see this kind of environmental degradation as the logical end point of the trajectory the USA was on. But it turned out differently, and while the USA is still pretty good at polluting the environment, laws and regulations hemmed it in and made the future in the book much less likely. So in a way it is a positive experience to read this, as it describes a bad future we managed to avoid. The way the book describes society slowly falling apart also felt like a good description to me, as it does not rush the way Death of Grass does. The writing, though, feels a bit janky and took me time to get used to. After the first few chapters I almost decided to skip the book, but now I am happy that I finished it.</p><h2><a href=\"https://en.wikipedia.org/wiki/The_Ministry_for_the_Future\">The Ministry for the Future</a></h2><p>Climate change, its consequences and possible solutions are the theme here. In the near future the ministry for the future is founded, which has the task of representing future generations and pushing for projects that allow those future generations a better life. The book mostly follows the head of the ministry and her struggles to actually get things done while facing massive resistance and a former aid worker who gets traumatized by having to live through a deadly heat wave and tries to understand his fate.</p><p>This seems to be the most well known collapse relevant novel. If you haven't read it, it is very worth picking up. If you have little time, just read the first chapters about the Indian heat wave. This is the best part of the book and also the most haunting one. The book is very detailed and drills down into the details of what proposals could actually stop climate change and the consequences of us failing to do so in time.</p><h2><a href=\"https://en.wikipedia.org/wiki/Children_of_Memory_(novel)\">Children of Memory</a></h2><p>This book is part of a longer series about species uplifting, but it can be read on its own. The plot revolves around a new colony on an exoplanet that is quite hostile to life. It follows the colonizers in their struggle to wrestle a life from the hostile environment. The book is really good in highlighting how hard agriculture is and how much can go wrong, especially in an environment that is not well suited to it. As the situation of the colony gets more and more dire the book shows how the settlers get less and less trusting and putting ever more force into law and order.</p><p>I feel like this book does well what Death of Grass tried and failed. Showing that food is the foundation of society and how humans that start trusting and cooperative quickly cease to do so when food gets really scarce. The book also has quite some interesting turns and twists, but I don't want to spoil too much.</p><h2><a href=\"https://en.wikipedia.org/wiki/The_Dispossessed\">The Dispossessed</a></h2><p>Really loved this book. It is the story of two societies and how they organize their political and economic life, told through the eyes of a scientist who visits both of them, but is originally from the anarchist society. The first society is organized as an aristocratic, capitalist society, seeming like a mixture of the UK during the industrial revolution and Cold War USA. The rich suppress the poor, the latter ultimately stage an anarchist revolution and to find peace, they are allowed to resettle to a nearby moon, which is barely habitable. On this moon they start a new society focussed on sharing, consent and ending suppression. Just as the colony in Children of Memory they struggle with the environment and face hunger, but ultimately make it through by the strength of their shared solidarity. Still, this society is not safe from problems either, as even if there is no formal governance, humans easily fall back into power hierarchies and work against the shared solidarity.</p><p>The book is really good in contrasting the anarchist society with the capitalist one. Both work as the mirror for the other, showing their shortcomings and where they fail their own values. Ultimately, the anarchist one seems like the much more liveable place, but it is constantly in danger of failing, as it is a constant negotiation between everyone involved. But at least discussion is possible, while in the hierarchy all dissent is violently suppressed.</p><p>While none of the societies involved collapses, I think this book is still relevant, as it is so good in contrasting different forms of governance, where they fail and where they succeed, plus the bonus of again highlighting the importance of food. Only in this book the societal bonds are only strained and not broken.</p><h2><a href=\"https://en.wikipedia.org/wiki/A_Canticle_for_Leibowitz\">A Canticle for Leibowitz</a></h2><p>If society collapsed and we found the remains of our modern world decades later, would we be able to decipher what those remains even meant? What would we do with them? Could we still use it to rebuild? These are the questions this book tries to answer. It follows a group of monks over thousands of years as society tries to rebuild after a nuclear war. The monks have made it their task to preserve artifacts and books from the past, even though they do not know how to understand them. They merely keep on copying them, because they think they might prove valuable again in the future.</p><p>I enjoyed this book because I feel like it gives a realistic vision of how the world might look after a nuclear war. Humanity would be shattered, but probably not broken. Given enough time, it might restart, especially if some of the previous knowledge is conserved. However, the book also asks the question if humanity would learn from something like that, or if we would simply start to prepare for the next annihilation by our own hands.</p><h2><a href=\"https://en.wikipedia.org/wiki/The_Road\">The Road</a></h2><p>The Road does not even mention which catastrophe befell humanity, though it very much seems like nuclear winter. The only thing we know is that things are really, really bad. The book follows a father and a son on their trek through a totally devastated America. They are aiming to find a place where life is better, all while trying to not sacrifice their own morals for their survival.</p><p>This book is bleak. Likely the bleakest book I have ever read. But it is so extremely well written that I could not put it down. While it does not teach you anything about how a society might collapse, it teaches you a lot about how horrible it would be if it happened, which is also an important lesson. And still, through all this darkness, it manages to always keep a sliver of hope going, that a better life might still be possible, even in the worst of times.</p><h2><a href=\"https://www.goodreads.com/book/show/60806778-the-deluge\">The Deluge</a></h2><p>Wow, what a book. The Deluge explores the next few decades of how climate change might shape our world. It tells a story of activists, corporate advertisers, scientists, government officials and many more, and how all of them try to make sense of an ever more chaotic world and push their agendas forward in it. Everybody has their own ideas of what should be done to steer the USA through the turbulent times of more storms, more heat, more violence, more war, more misinformation. These range from eco-socialism and green growth capitalism to a fascist theocracy.</p><p>I was really impressed by how this book handled so many parallel storylines at once and how it braided them together into a very scary, yet always plausible narrative of how the coming decades will play out. I also really liked how it dug deep into how this all shifts and disrupts society and its narratives. It does this deep dive while also managing to be a very good read throughout, with many relatable and three dimensional characters. I think this is my favorite so far, because it explores changes on a societal level, while at the same time being simply a very good and engaging book that tells a cautionary tale of what might await us all quite soon.</p><h1>Conclusion</h1><p>While I enjoyed reading all these books about collapse and catastrophe, I am a bit unsure how much I have actually learned while doing so. I started a project to have a new angle on the topics I usually cover. But I had to start wondering if many of these authors take collapse as a topic seriously. For me this would mean that the book really tackles the problems that collapse causes. How do people adapt? How do institutions shift? How are morals under pressure?</p><p>For many of the books, you have this one big, defining catastrophe that ends the world or at least completely whacks it out of balance. The book focuses on the catastrophe in some detail in the first few chapters, but then many kind of forget the catastrophe they started the book with? Take Years of Rice and Salt; it starts with the premise of a super deadly pandemic that wipes out all of Europe and the descriptions in some of the earlier chapters are haunting and interesting, but for the following ~700 pages it just is not really a topic anymore.</p><p>It seems to me that many of the books here just use the catastrophe as a kind of motivator for the plot. The books are not really about collapse, instead they want to tell a specific story and they want to place it in a collapse scenario, as this gives their protagonists a reason to do stuff. Most often they seem to want to tell a kind of cautionary tale, along the lines of: \"Do humans really have morality or is this just something we can have now, because we are not on the verge of dying?\". And this is not an uninteresting question and some books, especially The Road, really try to answer this on a deep level, but then we have a story about human nature and not a story about how a society might cope with catastrophic conditions.</p><p>Maybe I just approached this the wrong way, because I wanted to learn something about collapse using fiction? I do not think so, as there are some books that at least gave a glimpse of what I was looking for. I think the book that did this best was The Deluge.The detailed story over decades in a world reeling under climate really felt like I was learning how we might cope or fail to do so. A Canticle for Leibowitz was also great. It really tries to think through how a society after a nuclear war could cope and how over time even the simplest artifacts from the past could seem like magic, as the reset society does not have the same understanding of the world anymore. Also pretty good in this regard were World War Z and The Sheep Look Up, as they cleanly describes what happens in reaction to this big catastrophe on many levels of society. Though, both are a bit lacking in how they tell their stories.</p><p>Looking at which books worked for me and which did not, the best predictor seems to be how much a book focuses on individual actors versus institutions and movements. A narrative usually wants to focus on one or few main protagonists, but collapse happens at the scale of systems. The books that gave me the most insight are exactly the ones that found ways around this. A Canticle for Leibowitz follows an institution over centuries instead of a person, The Deluge tells a decades long story about many characters, each embedded in different institutions and circumstances World War Z replaces protagonists with dozens of interview voices, The Sheep Look Up also has a large cast of characters and The Dispossessed is built around comparing two whole societies. At first The Road looks like it breaks this pattern, as it only ever focuses on two people and still felt quite valuable to me. But I think it provides a different kind of insight. It does not teach you anything about how collapse works, it teaches you why it matters and how horrible it would be. So maybe there are two things fiction can offer here: insight into the dynamics of collapse and insight into its stakes. The systems focused books provide the former, The Road the latter.</p><p>The timeline of a book also plays a role. Collapse of a society and the subsequent adaptation necessarily takes longer than a week and if this is the amount of time a book covers, well the collapse insights can only ever be surface level. So, this likely has to be months or rather years or decades. Though, you can also lose the plot in the other direction, as Last and First Men shows. If you are looking at billions of years, everything can only be a fantasy.</p><p>Still, I think this project was worth it and I will keep on reading these kinds of fiction books. They might not have been what I was originally looking for, but it certainly was interesting reading them (or at least most of them). And maybe there are more of the kinds of books I am looking for out there? If you know any, please let me know in the comments, I would love to put them on my reading list. Especially books that cover topics besides climate change, pandemics and nuclear war.</p><p><em>Thanks for reading! If you want to talk about this post or societal collapse in general, I'd be happy to have a chat. Just send me a mail to existential_crunch at posteo.de and we can schedule something.</em></p><p class=\"button-wrapper\" data-attrs=\"{&quot;url&quot;:&quot;https://existentialcrunch.substack.com/subscribe?&quot;,&quot;text&quot;:&quot;Subscribe now&quot;,&quot;action&quot;:null,&quot;class&quot;:null}\" data-component-name=\"ButtonCreateButton\"><a class=\"button primary\" href=\"https://existentialcrunch.substack.com/subscribe?\"><span>Subscribe now</span></a></p><h1>Further books I plan to read</h1><ul><li><p><a href=\"https://en.wikipedia.org/wiki/Always_Coming_Home\">Always Coming Home</a></p></li><li><p><a href=\"https://www.goodreads.com/book/show/60869319-auf-see\">Auf See</a></p></li><li><p><a href=\"https://www.goodreads.com/book/show/59023013-blackout\">Blackout</a></p></li><li><p><a href=\"https://en.wikipedia.org/wiki/Earth_Abides\">Earth Abides</a></p></li><li><p><a href=\"https://www.goodreads.com/book/show/217729729-hyphen\">Hyphen</a></p></li><li><p><a href=\"https://en.wikipedia.org/wiki/I_Am_Legend_(novel)\">I am Legend</a></p></li><li><p><a href=\"https://en.wikipedia.org/wiki/Life_and_Fate\">Life and Fate</a></p></li><li><p><a href=\"https://en.wikipedia.org/wiki/On_the_Beach_(novel)\">On the Beach</a></p></li><li><p><a href=\"https://en.wikipedia.org/wiki/Riddley_Walker\">Riddley Walker</a></p></li><li><p><a href=\"https://en.wikipedia.org/wiki/Station_Eleven\">Station Eleven</a></p></li><li><p><a href=\"https://en.wikipedia.org/wiki/Termination_Shock_(novel)\">Termination Shock</a></p></li></ul><h1>Endnotes</h1><p>(1) See <a href=\"https://existentialcrunch.substack.com/p/how-environmental-politics-lost-the\">this post</a> for a detailed argument on why visions of the future are so important for the present.</p><p>(2) If you want yet another perspective on the topics, I can also recommend checking out <a href=\"https://www.youtube.com/watch?v=5uN5btgxsfI\">this excellent reading</a> of Lord Byron's Darkness.</p><h1>How to cite</h1><p>Jehn, F. U. (2026, September 8). Learning about collapse from novels. Existential Crunch. https://doi.org/10.59350/ekqqw-80e32</p><h1>References</h1><ul><li><p>Atwood, M. (2009). Oryx And Crake. Virago.</p></li><li><p>Bacigalupi, P. (2009). The Windup Girl. Orbit.</p></li><li><p>Brooks, M. (2006). World War Z: An Oral History of the Zombie War. Del Rey.</p></li><li><p>Brunner, J. (1972). The Sheep Look Up. Harper &amp; Row.</p></li><li><p>Butler, O. E. (1993). Parable of the sower. </p></li><li><p>Christopher, J. (1956). The Death of Grass. </p></li><li><p>Doctorow, C. (2007). When the Sysadmins ruled the Earth.</p></li><li><p>Markley, S. (2023). The Deluge. Simon &amp; Schuster.</p></li><li><p>Le Guin, U. K. (1974). The dispossessed.</p></li><li><p>McCarthy, C. (2006). The Road.</p></li><li><p>Miller, W. (1959). A Canticle for Leibowitz.</p></li><li><p>Robinson, K. S. (2002). The Years of Rice and Salt. Del Rey.</p></li><li><p>Robinson, K. S. (2020). The ministry for the future. Orbit.</p></li><li><p>Stapledon, O. (1930). Last and first men.</p></li><li><p><span>Tchaikovsky, A. (2023). Children of memory. Orbit.</span></p></li></ul>","doi":"https://doi.org/10.59350/ekqqw-80e32","guid":"206492588","image":"https://substackcdn.com/image/fetch/$s_!N-_c!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd2c2347c-adc2-4961-b88e-98e1804912ec_1065x790.png","language":"en","license":"https://creativecommons.org/licenses/by/4.0/legalcode","published_at":1788825600,"reference":[{"unstructured":"Atwood, M. (2009). Oryx And Crake. Virago."},{"unstructured":"Bacigalupi, P. (2009). The Windup Girl. Orbit."},{"unstructured":"Brooks, M. (2006). World War Z: An Oral History of the Zombie War. Del Rey."},{"unstructured":"Brunner, J. (1972). The Sheep Look Up. Harper & Row."},{"unstructured":"Butler, O. E. (1993). Parable of the sower."},{"unstructured":"Christopher, J. (1956). The Death of Grass."},{"unstructured":"Doctorow, C. (2007). When the Sysadmins ruled the Earth."},{"unstructured":"Markley, S. (2023). The Deluge. Simon & Schuster."},{"unstructured":"Le Guin, U. K. (1974). The dispossessed."},{"unstructured":"McCarthy, C. (2006). The Road."},{"unstructured":"Miller, W. (1959). A Canticle for Leibowitz."},{"unstructured":"Robinson, K. S. (2002). The Years of Rice and Salt. Del Rey."},{"unstructured":"Robinson, K. S. (2020). The ministry for the future. Orbit."},{"unstructured":"Stapledon, O. (1930). Last and first men."},{"unstructured":"Tchaikovsky, A. (2023). Children of memory. Orbit."}],"rid":"cbz1r-4at56","summary":"Reviews, rankings and recommendations","title":"Learning about collapse from novels","updated_at":1788852606,"url":"https://existentialcrunch.substack.com/p/can-you-learn-about-collapse-from","version":"v1"},{"authors":[{"affiliation":[{"id":"https://ror.org/04g6bbq64","name":"Adam Mickiewicz University in Pozna\u0144"}],"contributor_roles":[],"family":"Nowosad","given":"Jakub","url":"https://orcid.org/0000-0002-1057-3721"}],"blog":{"authors":null,"community_id":"2b9a0f79-8a25-47c4-a4ea-acb250754f4c","created":1739059200,"current_feed_url":null,"description":"Hi! I'm Jakub Nowosad, an Associate Professor at Adam Mickiewicz University and a Visiting Scientist at the University of M\u00fcnster. My work focuses on developing spatial methods to better understand environmental processes. Here, I present my","doi":"https://doi.org/10.59350/jakubnowosad","favicon":"https://rogue-scholar.org/api/communities/2b9a0f79-8a25-47c4-a4ea-acb250754f4c/logo","feed_format":"application/rss+xml","feed_url":"https://jakubnowosad.com/posts.xml","filter":null,"generator":"Quarto","home_page_url":"https://jakubnowosad.com/posts.html","issn":null,"language":"eng","license":"https://creativecommons.org/licenses/by/4.0/legalcode","prefix":"10.59350","relative_url":null,"secure":true,"slug":"jakubnowosad","status":"active","subfield":"1908","title":"Thinking in spatial patterns","updated":1788825600,"use_api":null},"blog_name":"Thinking in spatial patterns","blog_slug":"jakubnowosad","content_html":"<p>Spatial machine learning has become a standard tool for producing environmental and geographic prediction maps. It is now relatively (technically) easy to combine field observations with remote sensing, climate, terrain, or other predictor layers and fit a strong machine learning model. The harder question is whether the resulting map is reliable, transferable, and reproducible.</p>\n<p>In our paper, <a href=\"https://doi.org/10.3112/erdkunde.2026.04.01\"><em>Navigating challenges in spatial machine learning: validation, uncertainty, algorithms, and reproducibility</em></a>, we discuss this question from several connected angles. The paper was written by Jakub Nowosad, Carmelo Bonannella, Darius G\u00f6rgen, Marta Jemeljanova, Teja Kattenborn, Jan Linnenbrink, Hanna Meyer, Madlene Nussbaum, Luca Patelli, Rolf Simoes, and Evelyn Uuemaa<sup>1</sup>, and published in <em>Erdkunde</em>.</p>\n<p>The main argument is that spatial machine learning cannot simply reuse standard machine learning habits without modification. Spatial dependence, clustered and biased sampling, heterogeneous landscapes, and domain transfer all affect how models should be evaluated and interpreted. A model can appear accurate under a standard validation approach and still be unreliable where predictions are needed.</p>\n<p>We structure the paper around six themes:</p>\n<div class=\"quarto-figure quarto-figure-center\">\n<figure class=\"figure\">\n<p><img class=\"img-fluid figure-img\" src=\"https://jakubnowosad.com/posts/2026-09-08-erdkunde/fig1.png\"/></p>\n<figcaption>The main themes of the paper</figcaption>\n</figure>\n</div>\n<p>Several practical messages follow from this. Validation should match the intended prediction scenario, and prediction-domain adaptive evaluation approaches can help when sticking just to simple random or spatial cross-validation is not appropriate. When training data do not represent the prediction domain, areas outside the model's area of applicability should be identified, masked, or at least communicated clearly. Performance should not be reduced to a single global number: residual maps, spatial patterns of error, uncertainty, and thinking of the goal of the analysis are all important.</p>\n<p>The paper also highlights that algorithmic progress alone is not enough. We need benchmark datasets with different spatial properties, clearer comparisons against baseline methods, better uncertainty frameworks, and software that makes robust spatial workflows easier to apply. R currently has several dedicated tools for spatial machine learning workflows, while Python has a strong general-purpose machine learning ecosystem but fewer mature implementations of spatial-specific methods. In both languages, reproducibility still depends heavily on careful reporting of data preparation, resampling, prediction, software versions, and computational choices.</p>\n<p>The final part of the paper argues for standardized reporting protocols for spatial machine learning. Such protocols could help researchers document modeling aims, spatial characteristics of the data, validation design, uncertainty treatment, computational requirements, and reproducibility materials. This is also connected to ongoing work on the <a href=\"https://github.com/LOEK-RS/STeMP\">Spatio-Temporal Modelling Protocol (STeMP)</a>.</p>\n<blockquote class=\"blockquote\">\n<p>The short version is this: spatial machine learning needs to move beyond performance-driven mapping toward workflows that are spatially explicit, uncertainty-aware, and reproducible. Better models are useful, but better evaluation, clearer uncertainty communication, stronger software, and transparent reporting are equally important.</p>\n</blockquote>\n<div class=\"default\" id=\"quarto-appendix\"><section class=\"footnotes footnotes-end-of-document\" id=\"footnotes\"><h2 class=\"anchored quarto-appendix-heading\">Footnotes</h2>\n<ol>\n<li id=\"fn1\"><p>And builds partly on discussions from the <a href=\"https://jakubnowosad.com/advsml_2025/\">Advances in Spatial Machine Learning 2025 workshop</a>. Many thanks to the workshop participants for their feedback and ideas!\u21a9\ufe0e</p></li>\n</ol>\n</section><section class=\"quarto-appendix-contents\" id=\"quarto-citation\"><h2 class=\"anchored quarto-appendix-heading\">Citation</h2><div><div class=\"quarto-appendix-secondary-label\">BibTeX citation:</div><pre class=\"sourceCode code-with-copy quarto-appendix-bibtex\"><code class=\"sourceCode bibtex\">@online{nowosad2026,\n  author = {Nowosad, Jakub},\n  title = {Navigating {Challenges} in {Spatial} {Machine} {Learning}},\n  date = {2026-09-08},\n  url = {https://jakubnowosad.com/posts/2026-09-08-erdkunde/},\n  langid = {en}\n}\n</code></pre><div class=\"quarto-appendix-secondary-label\">For attribution, please cite this work as:</div><div class=\"csl-entry quarto-appendix-citeas\" id=\"ref-nowosad2026\">\nNowosad, Jakub. 2026. <span>\"Navigating Challenges in Spatial Machine\nLearning.\"</span> September 8. <a href=\"https://jakubnowosad.com/posts/2026-09-08-erdkunde/\">https://jakubnowosad.com/posts/2026-09-08-erdkunde/</a>.\n</div></div></section></div>","doi":"https://doi.org/10.59350/kba53-aqt33","guid":"https://jakubnowosad.com/posts/2026-09-08-erdkunde/","image":"https://jakubnowosad.com/posts/2026-09-08-erdkunde/fig1.png","language":"en","license":"https://creativecommons.org/licenses/by/4.0/legalcode","published_at":1788825600,"rid":"v7d7h-5zb63","summary":"Spatial machine learning has become a standard tool for producing environmental and geographic prediction maps. It is now relatively (technically) easy to combine field observations with remote sensing, climate, terrain, or other predictor layers and fit a strong machine learning model. The harder question is whether the resulting map is reliable, transferable, and reproducible.","tags":["Spatial","Spatial-machine-learning","Spatial-patterns","Rstats","Python"],"title":"Navigating Challenges in Spatial Machine Learning","updated_at":1788852606,"url":"https://jakubnowosad.com/posts/2026-09-08-erdkunde/","version":"v1"},{"authors":[{"affiliation":[{"name":"Front Matter"}],"contributor_roles":[],"family":"Fenner","given":"Martin","url":"https://orcid.org/0000-0003-1419-2405"}],"blog":{"authors":[{"name":"Martin Fenner","url":"https://orcid.org/0000-0003-1419-2405"}],"community_id":"15a362ea-8138-42b8-917f-1840a92addf8","created":1672531200,"current_feed_url":null,"description":"The Front Matter Blog covers the intersection of science and technology since 2007.","doi":"https://doi.org/10.53731/front_matter","favicon":"https://rogue-scholar.org/api/communities/15a362ea-8138-42b8-917f-1840a92addf8/logo","feed_format":"application/atom+xml","feed_url":"https://blog.front-matter.de/atom","filter":null,"generator":"Ghost","home_page_url":"https://blog.front-matter.de/","issn":"2749-9952","language":"eng","license":"https://creativecommons.org/licenses/by/4.0/legalcode","prefix":"10.53731","relative_url":null,"secure":true,"slug":"front_matter","status":"active","subfield":"1710","title":"Front Matter","updated":1788787489,"use_api":true},"blog_name":"Front Matter","blog_slug":"front_matter","content_html":"<p>The <a href=\"https://rogue-scholar.org\" rel=\"noreferrer\">Rogue Scholar science blog archive</a> has now archived all its currently 55,730 blog posts as PDF files. These PDF files use the archival PDF/A-3A format and include the full-text HTML blog post with metadata embedded as Schema.org attachment, and their PDF URLs are included in the Crossref metadata.</p><p>Blog posts are published as web pages in HTML format and often authored in Markdown format. So why PDF? I <a href=\"https://doi.org/10.53731/fy8ppqw-wctn03p\" rel=\"noreferrer\">have been struggling with PDF for a long time</a>, as it is a horrible authoring format, made famous by Peter Murray-Rust:</p><blockquote>PDF is a hamburger, and we're trying to turn it back into a cow.</blockquote><p>At the same time PDF is an excellent archiving format. The <a href=\"https://doi.org/10.53731/fy8ppqw-wctn03p\" rel=\"noreferrer\">reference manager Papers</a> pioneered the idea of managing reference metadata together with PDF attachments, and <a href=\"https://doi.org/10.53731/r294649-6f79289-8cw42\" rel=\"noreferrer\">other reference managers </a>did something similar. This reference manager \u2013 PDF integration was further enhanced when more scholarly content became available as Open Access and reference manager Zotero added a <strong>Find Available PDF</strong> integration.</p><p>At the same time <a href=\"https://en.wikipedia.org/wiki/PDF/A\" rel=\"noreferrer\">PDF/A</a> became an official ISO standard for long-term preservation of PDF documents, making it an archiving option for digital repositories such as Rogue Scholar and complementing web-archiving standards such as <a href=\"https://archive-it.org/blog/the-stack-warc-file/\" rel=\"noreferrer\">WARC</a> developed by the Internet Archive, which <a href=\"https://doi.org/10.53731/hhtx0-wb293\" rel=\"noreferrer\">Rogue Scholar uses since October 2023</a>. </p><p>PDF/A comes in several flavors and Rogue Scholar uses PDF/A-3A that allows attachments of files in any format, in this case the full-text HTML with embedded schema.org metadata. These metadata are embedded similar how this is done on web pages crawled by Google and others, but is added from the blog post metadata on PDF generation. This makes extraction of metadata and full-text HTML from PDF files much easier and faster and doesn't require machine learning tools such as <a href=\"https://github.com/grobidOrg/grobid\" rel=\"noreferrer\">GROBID</a>. The latest versions of the <a href=\"https://pypi.org/project/commonmeta-py/\" rel=\"noreferrer\">commonmeta-py</a> library can open these PDF files and extract the full-text and metadata, and for example convert to other formats.</p><p>The link to the PDF file is included in the metadata of every Rogue Scholar DOI, enabling downstream workflows to automatically fetch the PDF (all blog posts in Rogue Scholar are open access with a CC-BY license). One of the important use cases is of course reference managers, and the Zotero browser integration will now automatically not only fetch metadata from Rogue Scholar, but also the full-text PDF:</p><figure class=\"kg-card kg-image-card\"><img src=\"https://storage.ghost.io/c/c5/33/c533c955-b5f3-4ff1-ae2d-6b52a212e602/content/images/2026/09/Bildschirmfoto-2026-09-07-um-15.23.22.png\" class=\"kg-image\" alt=\"\" loading=\"lazy\" width=\"2000\" height=\"1266\" srcset=\"https://storage.ghost.io/c/c5/33/c533c955-b5f3-4ff1-ae2d-6b52a212e602/content/images/size/w600/2026/09/Bildschirmfoto-2026-09-07-um-15.23.22.png 600w, https://storage.ghost.io/c/c5/33/c533c955-b5f3-4ff1-ae2d-6b52a212e602/content/images/size/w1000/2026/09/Bildschirmfoto-2026-09-07-um-15.23.22.png 1000w, https://storage.ghost.io/c/c5/33/c533c955-b5f3-4ff1-ae2d-6b52a212e602/content/images/size/w1600/2026/09/Bildschirmfoto-2026-09-07-um-15.23.22.png 1600w, https://storage.ghost.io/c/c5/33/c533c955-b5f3-4ff1-ae2d-6b52a212e602/content/images/size/w2400/2026/09/Bildschirmfoto-2026-09-07-um-15.23.22.png 2400w\" sizes=\"(min-width: 720px) 720px\"></figure><p>Another interesting use case of these archival PDF files is blog platform migration, e.g. from WordPress to <a href=\"https://www.11ty.dev/\" rel=\"noreferrer\">Eleventy</a>, or from Blogger to <a href=\"https://quarto.org/\" rel=\"noreferrer\">Quarto</a>. While import scripts from other popular platforms exist, this generic archiving format should make it easier to migrate to any blogging platform. More work is of course needed to write import filters for specific platforms, but this is a big step forward.</p><p>Finally, the archival PDFs should make it easier to upload full-text content and metadata to other repository platforms, and the obvious starting point is other repositories also using the InvenioRDM platform.</p><p>Please reach out via&nbsp;<a href=\"https://join.slack.com/t/rogue-scholar/shared_invite/zt-2ylpq1yoy-o~TkxDarfz5LSMhGSCYtiA\" rel=\"noreferrer\">Slack</a>,&nbsp;<a href=\"mailto:info@rogue-scholar.org\" rel=\"noreferrer\">email</a>,&nbsp;<a href=\"https://wisskomm.social/@rogue_scholar\" rel=\"noreferrer\">Mastodon</a>, or&nbsp;<a href=\"https://bsky.app/profile/rogue-scholar.bsky.social\" rel=\"noreferrer\">Bluesky</a>&nbsp;if you have any questions or comments</p><div class=\"kg-card kg-callout-card kg-callout-card-blue\"><div class=\"kg-callout-text\">Rogue Scholar is a scholarly infrastructure that is free for all authors and readers. You can support Rogue Scholar with a one-time or recurring&nbsp;<a href=\"https://ko-fi.com/rogue_scholar\" rel=\"noreferrer\">donation</a>&nbsp;or by becoming a sponsor.</div></div><h2 id=\"references\">References</h2><ol><li>Fenner, M. (2010, December 5). Blogging Beyond the PDF. <em>Front Matter</em>. <a href=\"https://doi.org/10.53731/r294649-6f79289-8cw7p\">https://doi.org/10.53731/r294649-6f79289-8cw7p</a></li><li>Fenner, M. (2008, October 3). Papers: Interview with Alexander Griekspoor. <em>Front Matter</em>. <a href=\"https://doi.org/10.53731/fy8ppqw-wctn03p\">https://doi.org/10.53731/fy8ppqw-wctn03p</a></li><li>Fenner, M. (2009, March 15). Reference Manager Overview. <em>Front Matter</em>. <a href=\"https://doi.org/10.53731/r294649-6f79289-8cw42\">https://doi.org/10.53731/r294649-6f79289-8cw42</a></li><li>Fenner, M. (2023, October 30). Starting November, all Rogue Scholar blog posts will be archived by the Internet Archive. <em>Front Matter</em>. <a href=\"https://doi.org/10.53731/hhtx0-wb293\">https://doi.org/10.53731/hhtx0-wb293</a></li></ol>","doi":"https://doi.org/10.53731/apaab-tkq88","guid":"https://doi.org/10.53731/apaab-tkq88","image":"https://storage.ghost.io/c/c5/33/c533c955-b5f3-4ff1-ae2d-6b52a212e602/content/images/2026/09/3367901850_3875429813.jpg","language":"en","license":"https://creativecommons.org/licenses/by/4.0/legalcode","published_at":1788739200,"reference":[{"id":"https://doi.org/10.53731/r294649-6f79289-8cw7p","unstructured":"Fenner, M. (2010, December 5). Blogging Beyond the PDF. <i>Front Matter</i>."},{"id":"https://doi.org/10.53731/fy8ppqw-wctn03p","unstructured":"Fenner, M. (2008, October 3). Papers: Interview with Alexander Griekspoor. <i>Front Matter</i>."},{"id":"https://doi.org/10.53731/r294649-6f79289-8cw42","unstructured":"Fenner, M. (2009, March 15). Reference Manager Overview. <i>Front Matter</i>."},{"id":"https://doi.org/10.53731/hhtx0-wb293","unstructured":"Fenner, M. (2023, October 30). Starting November, all Rogue Scholar blog posts will be archived by the Internet Archive. <i>Front Matter</i>."}],"rid":"91f7b-03c45","summary":"The Rogue Scholar science blog archive has now archived all its currently 55,730 blog posts as PDF files. These PDF files use the archival PDF/A-3A format and include the full-text HTML blog post with metadata embedded as Schema.org attachment, and their PDF URLs are included in the Crossref metadata. Blog posts are published as web pages in HTML format and often authored in Markdown format. So why PDF?","tags":["Rogue Scholar","Commonmeta","InvenioRDM"],"title":"Rogue Scholar has archived all blog posts as PDF","updated_at":1788852605,"url":"https://blog.front-matter.de/posts/rogue-scholar-has-archived-all-blog-posts-as-pdf/","version":"v1"},{"authors":[{"contributor_roles":[],"family":"Chachereau","given":"Nicolas"}],"blog":{"authors":null,"community_id":"310eb31b-74ce-47d8-9f4f-7ae4dae66b49","created":1708300800,"current_feed_url":null,"description":null,"doi":"https://doi.org/10.59350/zotero_fr","favicon":"https://rogue-scholar.org/api/communities/310eb31b-74ce-47d8-9f4f-7ae4dae66b49/logo","feed_format":"application/atom+xml","feed_url":"https://zotero.hypotheses.org/feed/atom/","filter":null,"generator":"WordPress","home_page_url":"https://zotero.hypotheses.org","issn":null,"language":"fra","license":"https://creativecommons.org/licenses/by/4.0/legalcode","prefix":"10.59350","relative_url":null,"secure":true,"slug":"zotero_fr","status":"active","subfield":"1710","title":"Le blog Zotero francophone","updated":1788191754,"use_api":true},"blog_name":"Le blog Zotero francophone","blog_slug":"zotero_fr","content_html":"<p>Il y a deux ans environ, le projet Zotero a obtenu une bourse pour <a\nhref=\"http://zotero.hypotheses.org/630\">\u00e9valuer l'usage de Zotero pour\ndes mesures bibliom\u00e9triques alternatives</a> (<em>altmetrics</em>),\nattentives notamment \u00e0 l'impact des recherches dans les m\u00e9dias sociaux.\nDans le cadre de cette recherche, un sondage en ligne est ouvert en ce\nmoment concernant les pratiques des utilisateurs Zotero et leurs\nattentes et opinions en mati\u00e8re de mesures bibliom\u00e9triques. Les\nr\u00e9sultats permettront d'affiner les futurs d\u00e9veloppements de Zotero dans\nce domaine.</p>\n<p>Nous relayons ici <a\nhref=\"https://www.zotero.org/blog/indiana-university-survey-of-zotero-users/\">la\nnouvelle du blog Zotero officiel</a> et encourageons toutes les\nlectrices et lecteurs du blog \u00e0 <a\nhref=\"https://iu.co1.qualtrics.com/jfe5/form/SV_d6iQgfyRaPBBHgh\">participer\n\u00e0 ce sondage</a> (en anglais). C'est un sondage anonyme sur une base\nvolontaire. Il ne prend que peu de temps \u00e0 remplir.</p>\n<p><strong><a\nhref=\"https://iu.co1.qualtrics.com/jfe5/form/SV_d6iQgfyRaPBBHgh\">Participer\nau sondage\u00a0!</a></strong></p>","doi":"https://doi.org/10.59350/ghg3m-40872","guid":"http://zotero.hypotheses.org/?p=1040","language":"fr","license":"https://creativecommons.org/licenses/by/4.0/legalcode","published_at":1460937600,"rid":"51dvr-gmf84","summary":"Il y a deux ans environ, le projet Zotero a obtenu une bourse pour \u00e9valuer l'usage de Zotero pour des mesures bibliom\u00e9triques alternatives ( <em> altmetrics </em> ), attentives notamment \u00e0 l'impact des recherches dans les m\u00e9dias sociaux. Dans le cadre de cette recherche, un sondage en ligne est ouvert en ce moment concernant les pratiques des utilisateurs Zotero et leurs attentes et opinions en mati\u00e8re de mesures bibliom\u00e9triques.","tags":["Actualit\u00e9s"],"title":"Sondage sur les usages de Zotero","updated_at":1788839599,"url":"https://zotero.hypotheses.org/1040","version":"v1"},{"authors":[{"contributor_roles":[],"name":"Collectif"}],"blog":{"authors":null,"community_id":"310eb31b-74ce-47d8-9f4f-7ae4dae66b49","created":1708300800,"current_feed_url":null,"description":null,"doi":"https://doi.org/10.59350/zotero_fr","favicon":"https://rogue-scholar.org/api/communities/310eb31b-74ce-47d8-9f4f-7ae4dae66b49/logo","feed_format":"application/atom+xml","feed_url":"https://zotero.hypotheses.org/feed/atom/","filter":null,"generator":"WordPress","home_page_url":"https://zotero.hypotheses.org","issn":null,"language":"fra","license":"https://creativecommons.org/licenses/by/4.0/legalcode","prefix":"10.59350","relative_url":null,"secure":true,"slug":"zotero_fr","status":"active","subfield":"1710","title":"Le blog Zotero francophone","updated":1788191754,"use_api":true},"blog_name":"Le blog Zotero francophone","blog_slug":"zotero_fr","content_html":"<p>Nous vous l'annoncions il y a quelques mois: le nouveau bouton de\ncapture, <a href=\"https://zotero.hypotheses.org/696\">qui venait d'\u00eatre\nmis en place sur Firefox</a>, allait \u00eatre mis en place pour d'autres\nnavigateurs. C'est d\u00e9sormais chose faite pour Google Chrome\u00a0! (Les\nutilisateurs de Safari doivent encore patienter un peu.)</p>\n<p>\u00c0 noter: Ce billet est une adaptation de l'<a\nhref=\"https://www.zotero.org/blog/a-better-save-to-zotero-button-in-chrome/\">annonce\nofficielle sur le blog Zotero</a>.</p>\n<p>Petit rappel : jusque-l\u00e0, si l'extension Zotero pour Chrome d\u00e9tectait\nune r\u00e9f\u00e9rence sur une page web, il affichait une ic\u00f4ne dans la barre\nd'adresse. Pour les pages sur lesquelles l'extension ne pouvait pas\ntrouver de r\u00e9f\u00e9rences, on pouvait faire un clic droit sur la page et\nchoisir \u00ab<em>Save Page to Zotero</em>\u00bb, pour ajouter un document Page\nWeb et une capture dans sa biblioth\u00e8que.</p>\n<p>Depuis la derni\u00e8re version de l'extension Chrome, il est possible\nd'utiliser <strong>le m\u00eame bouton, qui figure en permanence dans la\nbarre d'outils, pour enregistrer un document depuis n'importe quelle\npage</strong> :</p>\n<p><img\nsrc=\"http://zotero.hypotheses.org/files/2016/04/chrome-button.png\"\nclass=\"aligncenter size-full wp-image-1050\" decoding=\"async\"\nloading=\"lazy\"\nsrcset=\"https://zotero.hypotheses.org/files/2016/04/chrome-button.png 565w, https://zotero.hypotheses.org/files/2016/04/chrome-button-300x57.png 300w\"\nsizes=\"(max-width: 565px) 100vw, 565px\" width=\"565\" height=\"108\"\nalt=\"Exemple du nouveau bouton Chrome sur la page lemonde.fr\" /></p>\n<p>Si l'extension d\u00e9tecte une r\u00e9f\u00e9rence, le bouton affiche la m\u00eame ic\u00f4ne\nque par le pass\u00e9: un livre, un journal, un article de revue, un dossier,\netc. Sur toute autre page, vous verrez une ic\u00f4ne grise qui permettra\nl'enregistrement d'un document Page Web, avec une capture et les\ninformations les plus basiques la concernant (titre, URL, date de\nconsultation).</p>\n<p>Ce bouton unique et simplifi\u00e9 constitue l'avantage principal apport\u00e9\npar cette mise \u00e0 jour. Deux autres nouveaut\u00e9s font leur apparition.</p>\n<p>D'une part, un menu d\u00e9roulant permet de <strong>choisir d'autres\nmani\u00e8res d'importer les r\u00e9f\u00e9rences</strong>. En g\u00e9n\u00e9ral, le clic sur le\nbouton reste la meilleure solution. Dans certains cas, le menu d\u00e9roulant\napporte quelques avantages, que vous pouvez d\u00e9couvrir dans le billet que\nnous avions consacr\u00e9 \u00e0 la version Firefox: <a\nhref=\"http://zotero.hypotheses.org/865\">Ajouter une r\u00e9f\u00e9rence avec le\nnouveau menu</a>.</p>\n<p>D'autre part, il est d\u00e9sormais possible d'<strong>enregistrer un PDF\ndans Zotero par un seul clic</strong>.</p>\n<p><img\nsrc=\"http://zotero.hypotheses.org/files/2016/04/chrome_toolbar_button_pdf-300x188.png\"\nclass=\"aligncenter size-medium wp-image-1051\" decoding=\"async\"\nloading=\"lazy\"\nsrcset=\"https://zotero.hypotheses.org/files/2016/04/chrome_toolbar_button_pdf-300x188.png 300w, https://zotero.hypotheses.org/files/2016/04/chrome_toolbar_button_pdf.png 664w\"\nsizes=\"(max-width: 300px) 100vw, 300px\" width=\"300\" height=\"188\"\nalt=\"Sauvegarder un PDF avec le nouveau bouton\" /></p>\n<p>Jusque-l\u00e0, l'enregistrement d'un PDF n\u00e9cessitait de le faire glisser\ndepuis la barre d'adresse pour le d\u00e9poser dans Zotero ou de\nl'enregistrer en local, puis de l'ajouter manuellement dans Zotero.\nD\u00e9sormais, lorsque vous affichez un fichier PDF dans Chrome, il vous\nsuffit de cliquer sur le nouveau bouton de capture dans la barre\nd'outils pour enregistrer le PDF dans Zotero.<a href=\"#fn1\" id=\"refn1\"\ntitle=\"\u00c0 condition toutefois que vous disposiez de la version 4.0.29 ou sup\u00e9rieure de Zotero Standalone.\"><sup>1</sup></a>\nIl est cependant import\u00e9 comme simple fichier PDF, sans \u00eatre attach\u00e9 \u00e0\nune r\u00e9f\u00e9rence bibliographique plus compl\u00e8te. Pour cr\u00e9er une telle\nr\u00e9f\u00e9rence, vous pouvez soit tenter de \u00abR\u00e9cup\u00e9rer les m\u00e9tadonn\u00e9es du\nPDF\u00bb, soit \u00abCr\u00e9er un document parent\u00bb \u00e0 remplir manuellement. Ces deux\noptions sont accessibles par un clic-droit sur le PDF. Dans une\nprochaine version, Zotero tentera de cr\u00e9er un \u00e9l\u00e9ment parent\nautomatiquement.</p>\n<p><img\nsrc=\"http://zotero.hypotheses.org/files/2016/04/PDF-metadata.png\"\nclass=\"aligncenter size-full wp-image-1052\" decoding=\"async\"\nloading=\"lazy\"\nsrcset=\"https://zotero.hypotheses.org/files/2016/04/PDF-metadata.png 648w, https://zotero.hypotheses.org/files/2016/04/PDF-metadata-300x194.png 300w\"\nsizes=\"(max-width: 648px) 100vw, 648px\" width=\"648\" height=\"420\"\nalt=\"Clic-droit sur un PDF, montrant l&#39;option \u00abR\u00e9cup\u00e9rer les m\u00e9tadonn\u00e9es du PDF\u00bb\" /></p>\n<p>En d\u00e9pit du nouveau bouton, <strong>certaines limitations\npersistent</strong>. Notons en deux. Premi\u00e8rement, tant que la page web\nn'a pas fini de charger dans Chrome, l'extension Zotero n'affiche que\nl'ic\u00f4ne grise de capture de page web, m\u00eame si la page contient une ou\nplusieurs r\u00e9f\u00e9rences bibliographiques. Deuxi\u00e8mement, la capture de page\nweb ne fonctionne pas si Zotero Standalone n'est pas ouvert. L\u00e0 aussi,\nune am\u00e9lioration est pr\u00e9vue et une future version permettra\nd'enregistrer des pages web directement dans votre compte zotero.org\nquand Standalone n'est pas ouvert (comme c'est d\u00e9j\u00e0 le cas pour les\nautres types de r\u00e9f\u00e9rences).</p>\n<p>Si vous avez install\u00e9 la derni\u00e8re version de Chrome, votre extension\nZotero devrait \u00eatre mise \u00e0 jour automatiquement. Si vous n'utilisez pas\nactuellement Zotero avec Chrome, vous pouvez <a\nhref=\"https://chrome.google.com/webstore/detail/zotero-connector/ekhagklcjbdpajgpjgmbionohlpdbjgc\">installer\nl'extension depuis le Chrome Web Store</a>. Dans un cas comme dans\nl'autre, pour b\u00e9n\u00e9ficier de la meilleure exp\u00e9rience, assurez-vous\nd'avoir install\u00e9 <a href=\"https://www.zotero.org/download/\">Zotero\nStandalone</a>\u00a0!</p>\n<p><span id=\"fn1\">1.</span> \u00c0 condition toutefois que vous disposiez de\nla version 4.0.29 ou sup\u00e9rieure de Zotero Standalone. <a\nhref=\"#refn1\">\u21a9\ufe0e</a></p>","doi":"https://doi.org/10.59350/3jnpb-zrw59","guid":"http://zotero.hypotheses.org/?p=1039","image":"http://zotero.hypotheses.org/files/2016/04/chrome-button.png","language":"fr","license":"https://creativecommons.org/licenses/by/4.0/legalcode","published_at":1461283200,"rid":"dn6mh-cw521","summary":"Nous vous l'annoncions il y a quelques mois: le nouveau bouton de capture, qui venait d'\u00eatre mis en place sur Firefox, allait \u00eatre mis en place pour d'autres navigateurs. C'est d\u00e9sormais chose faite pour Google Chrome ! (Les utilisateurs de Safari doivent encore patienter un peu.) \u00c0 noter: Ce billet est une adaptation de l'annonce officielle sur le blog Zotero.","tags":["Actualit\u00e9s"],"title":"Un enregistrement plus facile sur Chrome !","updated_at":1788839597,"url":"https://zotero.hypotheses.org/1039","version":"v1"}],"out_of":55740,"page":1,"per_page":10,"total-results":55740}
