Declining Value of Papers in Academia

แชร์
ฝัง
  • เผยแพร่เมื่อ 28 พ.ค. 2024
  • The value of papers in academia is a very sensitive topic that I have been thinking about for quite some time. Yes, writing a paper is a great way to study the topic and advance your knowledge. Yes, papers are generally considered the best tool for disseminating scientific results. Papers are the structure and the soul of any research.
    But the value of a single paper can be very low sometimes. To become a successful researcher, you should produce dozens of papers per year. This eventually decreases the value of publications and creates other publishing problems. In this video, I want to share my vision of this trend and discuss some recent insights that may be useful to other young researchers and academics.
    00:00 Intro
    00:33 Your career = your papers
    03:46 The value of one paper is low
    07:30 How much to publish (minimum)
    08:43 Publishing pressure
    12:37 How much to publish (optimistic)
    16:29 Publishing paradox
    18:51 What to do?
    Andrey Churkin (Андрей Чуркин) 2023
    andreychurkin.ru/
  • วิทยาศาสตร์และเทคโนโลยี

ความคิดเห็น • 958

  • @kw1ksh0t
    @kw1ksh0t 3 หลายเดือนก่อน +2377

    For me the contradiction is as follows: huge pressure to publish, papers are king, and yet no one reads them, because they are too busy publishing, and hence your papers are worthless. So there's just an endless stream of wasted effort, since no one is reading each others' papers. Hence the value of each paper is now almost zero, even if a huge amount of effort has gone into it. As you say, there is no feedback at all. I published what is, imo, a very important breakthrough in fundamental quantum systems with applications for all high-precision measurements. But, basically no one has read it, barely even my own PhD supervisor. Why? They don't have time, in fact they're incentivised *not to*! Now I'm a postdoc and it's very lonely, I barely did any work for 2 years because I had zero support since everyone in my research group cares only about their own work. Even within the research group there is zero feedback.

    • @chuscience
      @chuscience  3 หลายเดือนก่อน +283

      Good point! I did not mention it in the video: academics are very busy and do not read many papers. Some of them are just tired of reading about similar trendy ideas and minor improvements in their field. So we have millions of students publishing papers, but who actually reads them? According to my statistics, my papers are usually cited by other PhD students and sometimes postdocs.

    • @kw1ksh0t
      @kw1ksh0t 3 หลายเดือนก่อน +184

      @@chuscience The truth is that very few people are going to read your paper unless it is relevant to their own career. Therefore, we are effectively punished for doing pioneer work, since it requires a huge effort to advertise it and convince people they should learn it. I miss the days when it was actually excusible to just spend time simply learning without feeling bad about it

    • @the11382
      @the11382 3 หลายเดือนก่อน +19

      Would AI analysis of papers help? There are LLMs that gobble up papers in minutes, spitting out only what you need of them.

    • @WetPig
      @WetPig 3 หลายเดือนก่อน +33

      Just like any business with it's KPI's..... This is not science, it's a business, the educational business. Im most parts of the world it doesn't even pay well... I would have loved to be a researcher, but all of these things made me not want to do it.

    • @mrcrapforyou
      @mrcrapforyou 3 หลายเดือนก่อน +5

      @kw1ksh0t care to share a link to your paper here & stíck it to the Man ?

  • @emmanuelameyaw9735
    @emmanuelameyaw9735 7 หลายเดือนก่อน +1952

    That's why single authored articles should carry much weight in promotions. Some professors are gaming the system with co-authors.

    • @reginayfavors
      @reginayfavors 6 หลายเดือนก่อน +247

      They are gaming the system by using graduate students too.

    • @sunway1374
      @sunway1374 3 หลายเดือนก่อน +98

      That will become problematic too. They will find ways to have more single-authored papers.
      How? There are ways. For examples, keep recycling old ideas and old papers; and dig up those old abandoned ideas and papers (even as a mid-career researcher, I have a huge number of these, maybe as many as my published first-authored papers). Nothing will get discarded now.
      Also, you can cut up the results to create more papers. Maybe you used to write one or two papers for an idea before. Now, you cut up your research into more smallest publishable units.
      Having too many single-authored may also be a sign that the authors have difficult personality in the work environment, dislike team work, do not collaborate, etc.
      What is rare will be considered valuable. Then in the future, someone in a YT comment will write that's why we need to put more weight to coauthored papers.

    • @realGBx64
      @realGBx64 3 หลายเดือนก่อน +16

      Most places only count corresponding author and first author in promotions and hiring. Being a simple co-author is absolutely meaningless these days.

    • @grdfhrghrggrtwqqu
      @grdfhrghrggrtwqqu 3 หลายเดือนก่อน +13

      @@sunway1374 Single author papers are BAD. Everything NEEDS to be peer reviewed, which means you NEED co authors. Saying otherwise is ignororant. No you are not Einstein. If you don't like team work, get out of college, and go teach it and read the textbook yourself. If you don't like it, STOP COMPLAINING AND GROW UP. Something this generation needs to DO.

    • @sunway1374
      @sunway1374 3 หลายเดือนก่อน +41

      @@grdfhrghrggrtwqqu Did you reply to the wrong person? Read my comment again. I didn't say single-authored papers are good. In fact, quite the opposite could be what I have meant, although even then I didn't say papers with multiple authors are good.
      Also, you don't know me, why do you think I am in a college and of "this generation"?
      I don't know you... But from your comment, I guess you are not very experienced in the journal paper publication process.

  • @Dr_ahmadian1
    @Dr_ahmadian1 4 วันที่ผ่านมา +13

    Great video. This video has garnered 240k views, which is more than the total citations an academic could receive even if they published 200 papers, each cited 1,000 times. Tremendous impact, high value.

  • @ellielikesmath
    @ellielikesmath 3 หลายเดือนก่อน +777

    the decline in value of academic papers means a rise in the value of youtube comments. you can read all about it in this youtube comment

    • @JimTheCurator
      @JimTheCurator 3 หลายเดือนก่อน +34

      According to me, I agree with this sentiment!

    • @suey1690
      @suey1690 3 หลายเดือนก่อน

      I like searching ArXiv to see if there are any papers that have already explored solutions to some random math problem I came up with. As long as the submitted papers have correct math, more is better for that specific use case.

    • @successmaker9258
      @successmaker9258 3 หลายเดือนก่อน +49

      Seconded, this comment is now peer reviewed

    • @Codysdab
      @Codysdab หลายเดือนก่อน +3

      I saw this comment, but have read no scientific papers today.
      That's science! 🤣

    • @Darkjnr5
      @Darkjnr5 หลายเดือนก่อน

      🤣

  • @millamulisha
    @millamulisha 4 หลายเดือนก่อน +1203

    I was working on a problem for around 6 months, had read a few thousand pages of advanced physics and mathematics, searched far and wide for research literature out there to help me find a solution, spent a few sleepless nights trying to work out solutions to this problem, came up with a fairly sophisticated model (system of nonlinear PDEs, solved using perturbation theory), etc… Long story short, I actually found the answer in two papers published in the 1960s (from NASA and another from a university in Germany) together which solved my problem. These two papers together had less than 4 citations (in 60+ years!). So I will say, don’t lose motivation. The work researchers do is very important, even if only realized by one person in the very far future. Stick with it folks, the system is a bit broken probably so I agree with much from what you have said in the video. 😅

    • @MarkRuvald
      @MarkRuvald 3 หลายเดือนก่อน +95

      Your perseverance here should be rewarded, but sadly the audience may be so limited that it won't be. In the 60s those researchers probably felt less publishing pressure than now.
      I wouldn't know if competition and prestige has changed since then also.

    • @lucaxtshotting2378
      @lucaxtshotting2378 3 หลายเดือนก่อน +9

      wait, so the work is important because in the future someone will realize it is already done? what a ponzi scheme
      Edit: it is a ponzi scheme because its existance is only justified by its existance. Didnt think I had to clarify this.
      Please dont answer it is not, im reducing to absurd. Not a big reduction though, as of today

    • @gsuekbdhsidbdhd
      @gsuekbdhsidbdhd 3 หลายเดือนก่อน +8

      ​@lucaxtshotting2378 They probably solved an internal problem and then published the results

    • @lucaxtshotting2378
      @lucaxtshotting2378 3 หลายเดือนก่อน +3

      @@gsuekbdhsidbdhd even more strict of a ponzi scheme then.
      I'm sure they make some progress, it's hard to believe it is worth the money and other resources. It's not like Open AI and not university of Toronto is king of Rohan

    • @lucaxtshotting2378
      @lucaxtshotting2378 3 หลายเดือนก่อน +2

      the other way around*. Open AI is indeed king of Rohan

  • @prism223
    @prism223 3 หลายเดือนก่อน +1092

    I said "no" to academia after a revealing experience at the very beginning. Without giving away identifiable information, here's what happened:
    - I worked for a few years on a new method of extracting data from physics experiments.
    - The results were excellent and allowed extraction of new results from old and new data sets.
    - I got a PhD on the results and submitted a paper.
    - The paper kept getting sent back from the review committee, but with strange comments, the things you would say if you didn't understand the material. Neither me nor my advisor understood why they would say what they said if they understood the material.
    Eventually I learned something that solved the mystery: Some of the people on the review committee were actively working on a competing approach to the one I developed and presented in the paper. So, there was an obvious conflict of interest between the paper and the committee, which made the mysterious negative comments suddenly make sense.

    • @snared_
      @snared_ 3 หลายเดือนก่อน +71

      no, that doesn't make your negative comments suddenly make sense. If they were actively developing a competing approach, then they would have the knowledge to understand the material. It seems far more likely that the negative comments were left there to gaslight you into wasting your time while they developed a superior approach or at least a copy cat of your own approach. By the way, that isn't 100% at all. So I plainly disagree that the intent behind their comments got cleared up, UNLESS you're assuming they have bad intentions from the get-go. But that is a very specific line of thinking and you are missing several other potential motivators leading to the same outcome you experienced.. But anyway, I get you. You should paste your paper onto the net somehow though, so they can't claim they came up with your idea before you published.

    • @prism223
      @prism223 3 หลายเดือนก่อน +165

      @@snared_ Yes I was assuming bad faith

    • @Rust_Rust_Rust
      @Rust_Rust_Rust 3 หลายเดือนก่อน +31

      ​@@snared_No, that doesn't necessarily mean that they were developing a superior method or copying his techniques. At the end of the day you and OP are just speculating. Whatever their intentions were it most likely wasn't good.

    • @choppergamer
      @choppergamer 3 หลายเดือนก่อน +11

      @@Rust_Rust_Rust too many smart people in this comment section. for once everything i wanna say have already been said

    • @sergev6632
      @sergev6632 3 หลายเดือนก่อน +10

      ​@snared_ and that's why preprints exist...

  • @thorebergmann1986
    @thorebergmann1986 7 หลายเดือนก่อน +806

    When you learnt your job at 5-star restaurant, and realize you ended up in a fast food restaurant instead

    • @chuscience
      @chuscience  7 หลายเดือนก่อน +61

      😂

    • @snared_
      @snared_ 3 หลายเดือนก่อน +3

      @@MorTobXD civilized, vegan, cheap. For restaurants, Pick two, should be doable.

    • @LethalBubbles
      @LethalBubbles 3 หลายเดือนก่อน

      classist statements like that are why it is so bad. the only cure is full freedom of all information. transparency is the only way.
      classism, assuming the fast food eater must be an uneducated hoard, and that the academia goer isnt some nepotism yacht club scholarship is the exact reason why this happens.
      theres good people who are privleged and theres good people who are not.
      when someone denies the "fast food eaters" an education, equal access, they've created classist slavery. when they put the privlege folk into a position theyre born into, they are also robbed of their potential expertise. we're all equal and creating a system of illusions to say otherwise creates lies about cancer.

    • @Ekornpro
      @Ekornpro 3 หลายเดือนก่อน +3

      Let me fix that statement
      "When you learnt your job at 5-star restaurant, and realize you ended up in a fast food restaurant instead cause your not a 5-star restaurant chef"

    • @thorebergmann1986
      @thorebergmann1986 3 หลายเดือนก่อน

      @@Ekornpro So, you wanna say, 5-star restaurants do exist in science?

  • @kyaume21
    @kyaume21 7 หลายเดือนก่อน +554

    The problem stems from University admin culture: it wants facile criteria to judge something which is beyond them to understand. So they take refuge in cheap numerical data, which has no connection to the actual reality.
    Compare it to art, for the sake of making a point: suppose the value of a composer (say Bach, Mozart, Beethoven) was judged by a numerical value (eg. the number of downloads of their music clips) : it would be a good 'objective'measure to use for the tone-deaf. But would it capture the true value of the output of those composers?

    • @chuscience
      @chuscience  7 หลายเดือนก่อน +55

      Nice analogy with composers😅 Will remember it for future discussions!

    • @tjppercussion
      @tjppercussion 5 หลายเดือนก่อน +46

      Exactly. Mozart wrote 41 symphonies but for the most part the first 30 or so are ignored compared to the study of his later ones like no. 39 or no. 41. Same for Haydn, he wrote 100+ but many haven't even heard any of the first 90. Meanwhile Beethoven wrote 9, all of which are highly revered. Many music scholars don't fall into the "your papers are your career" category, anyway, considering the additional achievements of performances, clinics, and masterclasses. Though publications of course are part of it

    • @moumouzel
      @moumouzel 3 หลายเดือนก่อน +2

      Spot on

    • @ColdNavigator
      @ColdNavigator 3 หลายเดือนก่อน +7

      Research may also take centuries to result in huge pay off. Any value that can be measured have a huge lag in the signal.
      I doubt many of the ancient people who studied number theory and early differential geometry would have known that it would lead to a language to describe quantum physicis and general relativity.

    • @alioshax7797
      @alioshax7797 2 หลายเดือนก่อน +1

      What would be the alternative solution ? You think a university has the time, the energy or the ability to read the work of every single one of their workforce ? Going from Mayan history to particule physics through the biology of the shrimp or the sociology of birthday parties ? And even then, measuring the quality of a paper is quite subjective.
      Of course they need easy, understandable metrics to make a choice. No matter how flawed their are.

  • @bhaskartripathi
    @bhaskartripathi 4 หลายเดือนก่อน +463

    Coming from industry, I learnt these rules in Academia:
    1. Publish or perish.
    2. Novelty is not enough. Novelty should be valuable.
    3. Never reveal your code, until you are done with 2-3 variant papers on the same or similar topic.
    4. No one cares on the quality of code.
    5. Keep writing. Writing is thinking.
    6. Be more resourceful than more honest.

    • @yee6365
      @yee6365 3 หลายเดือนก่อน +8

      It's a shame

    • @GuyMichaely
      @GuyMichaely 3 หลายเดือนก่อน +3

      Why #3?

    • @jeanc6306
      @jeanc6306 3 หลายเดือนก่อน +25

      ​@@GuyMichaelyit gives you competitive advantage when developing the new methods/new experiments. Don't want to release code and then get scooped on some idea extension. Sort of trading off impact for paper quantity

    • @vNCAwizard
      @vNCAwizard 3 หลายเดือนก่อน +13

      I agree with 1, 2, and 3. I am a programmer, so no on 4. 5 is good only with endless editing and revision. I do not agree with the willingness to sacrifice honesty.

    • @runnerup15
      @runnerup15 3 หลายเดือนก่อน

      What an abomination of a system we have made. Research is made only in the name of making enough money to barely scrape by and if you get any inkling of an idea sprouting from research you need to hide it to yourself so you can hopefully continue to have medical insurance and maybe money left over for a bag of rice

  • @SoroushRabiei
    @SoroushRabiei 3 หลายเดือนก่อน +156

    In my line of research, I found more than 90% of published papers to be either nonesense, repeating the known in a different way, or even outright academic fraud in some cases. You often find "paper gangs"... A group of people who cite each others papers repeatedly and even review each other in lower quality publications with no "associations" checks!
    There is very little value in most of the published papers I encounter. This makes doing research a very difficult endeavour for me. I think the main reason for this is "publish or perish" situation in academia.

    • @amir-ng6jv
      @amir-ng6jv 2 หลายเดือนก่อน +1

      جسارتا در چه حوزه ای؟

    • @faithlesshound5621
      @faithlesshound5621 11 วันที่ผ่านมา

      @@amir-ng6jv If he replied truthfully, he would indeed be brave (and also stupid).

    • @dmitry5319
      @dmitry5319 4 วันที่ผ่านมา

      in my field it is pretty much the same

    • @Bvic3
      @Bvic3 3 วันที่ผ่านมา

      Academia is a giant scam with an insane noise to signal ratio. 80-90% of papers can't even be replicated.
      The reality is that a tiny amount of paper are great and have huge impact.
      It's a winner takes all field. Like all information fields where the best/most popular can capture the entire market.
      Academia is just another Hollywood.

    • @bluemacaroons
      @bluemacaroons 2 วันที่ผ่านมา

      I wrote a paper for school just to get some experience and while i was researching found out the main papers i was citing were from a field with that kind of peer reviewing done mostly to make money. It was kind of sickening bc it was supposed to be research on how to improve ppls mental health and instead was just a waste of the public’s money and created a lot of misconceptions in the field that ppl still believe today

  • @plazma5343
    @plazma5343 3 หลายเดือนก่อน +46

    My sister is a science loving phd micro biologist. Her thesis is a wonderfull small improvement in the understanding of AIDS, something that most likely will have very positive future applications.
    The shit she goes through on a daily basis is horrifying.
    Everyone tells her to go private, but she still believes she can have an impact in public research..... she works endless hours, for a mediocre salary (a criminal one hourly) for game of thrones schemer bosses. It is so infuriating.

    • @Lifeonthefastlane007
      @Lifeonthefastlane007 หลายเดือนก่อน +1

      What small improvements? How do you know it's an improvement?

  • @BS-jw7nf
    @BS-jw7nf 4 หลายเดือนก่อน +412

    I don’t think many people realise what the job of an academic is these days. Your job is to get funding to your university. It’s not research, it’s not even papers, it is all about getting money to the university and to that end. You need to optimise for this. Having good friends gives you better resources to get more money to your institute. Better paper metrics give you better chances at getting funding. It is ALL about getting money to your university. If you want to be a successful researcher, you need to optimise to that goal.

    • @YourCapybaraAmigo_17yrsago
      @YourCapybaraAmigo_17yrsago 4 หลายเดือนก่อน

      Yeah and this is bad. Why would you justify this? Academia is supposed to have a higher goal than personal profit. I think we're in sorry times where colleges are just another greedy business.
      I think it's sad as fuk, why don't you?
      All this money that comes in, and then where does it go? Don't we see a problem with this? Tuition is rising steeply, more and more students are being priced out and unable to meet the shortfalls with other forms of assistance, all while the PhDs are being dutiful little slaves trying to bring in the money, and plenty of other sources of money are rolling in and yet.......what? Are all the universes employees then paid comfortably and fairly and his tuition kept reasonable? Not in most places.
      So the university is nothing but a profit seeking machine then? Just another business? Well isn't that just so enlightened.
      I have a lot of problems with this. Apparently you don't. Again I ask you, where the hell does all this money go???
      Are you aware that according to more and more reports that have surfaced the majority of staff and support staff at universities are poorly paid???
      Apparently postdocs have a shameful record of job security because they're given appallingly short work contracts from their superiors, from 2 mos to 3 years tops. I should think this would be unacceptable. Most people want some security in their job, it doesn't have to be set in stone, but it is completely unfair to any worker especially a professional credentialed staff worker to provide them next to no predictability and longer-term contract so they can plan their life accordingly.
      I mean this shit sounds exploitative af don't you see it???
      About the money - so basically the University president is your pimp and you're supposed to be their loyal bitch and if you're not bringing in enough money your career is going to go down the toilet- yeah? A crass but apt analogy yes???
      Also are you aware that the presence of medium and large and universities has a disastrous knock-on effect of local rent prices? now local city councils are to blame for this because they refuse to enact rent control because they're corrupt trolls, but yes, universities do this whether they intend to or not. Also, are you aware that many colleges and universities pay zero taxes and contribute very little to their surrounding economy? I wonder if you're aware of any of this.
      I know we've all been trained to view the university as this august refined altruistic institution that is nothing but beatific and a positive in every way but unfortunately, whether they intend to or not, they bring a lot of negative with them.
      Looks like there's a lot of crookedness that goes on at the top level of university management. Because right now I don't see anything that they're doing as ethical.
      Not sure if greater regulation (specific laws) would change this. Still looking into that.

    • @sunway1374
      @sunway1374 3 หลายเดือนก่อน +59

      Yes, that's what I observed and concluded too. People still talk about publish or perish, like having papers is sufficient. No, no, no.
      You need to have grants. The more the better, the larger the better. And that is sufficient. It's been "Grants or perish" for at least 2 decades now.

    • @YourCapybaraAmigo_17yrsago
      @YourCapybaraAmigo_17yrsago 3 หลายเดือนก่อน +24

      And yet you're paid shit for this. Or at least not very well apparently. Lol. Ok well I think it's awesome that universities have become nothing but small corporations today.

    • @praphael
      @praphael 3 หลายเดือนก่อน +7

      @@sunway1374 This is true. However without the papers you don't get the grants
      Now it may be that someone has superior journal output and doesn't get the grant vs. someone who only has average journal output who doesnt
      This can also come down to how well the grant was written and novelty, etc.

    • @sunway1374
      @sunway1374 3 หลายเดือนก่อน +2

      @@praphael
      OK. But papers are much easier to get than grants. And you don't need great papers to get a grant.
      I know people who have many papers but never get a tenure (inc. me), and others who have many papers and even written books but never rise above associate prof.
      All because we have never been PI of a large enough grant.

  • @heartsofiron4ever
    @heartsofiron4ever 3 หลายเดือนก่อน +67

    A trick my supervisor gave me to get extra citations is to attend a lot of conferences. 6 per year, but not to publish conference papers, rather to give presentations, citing or using your own work, because when 500 scholars from your field are watching your research, and also find it interesting, they'll take a note, and likely cite it in the future.

    • @Lifeonthefastlane007
      @Lifeonthefastlane007 หลายเดือนก่อน +4

      Not surprised. Most papers are buried. The more you discuss about your work, the more people know about it.

    • @dmitry5319
      @dmitry5319 4 วันที่ผ่านมา +1

      Well, partially, this is true. However
      1. Travelling, preparing and giving talks takes time from research
      2. To be invited to a conference you need resources. If your supervisor has resources to give you many opportunities to speak is one thing. Otherwise, it is hard to be invited to speak anywhere.
      3. Conferences are no longer as they are supposed to be. Nobody listens, everyone is typing their own papers during talks. Or sleeping, or watching football.
      Actually, as I got permanent job in academia I almost stopped going to conferences. I don't quite see the point except tourism. I almost never get any valuable feedback. Concerning the other talks, usually, people are just recycling the old stuff. There is nothing interesting and speakers behave as sales managers. In case there is anything interesting I'd rather read a paper my self, not wasting time one useless sales interprises.

    • @blancosal
      @blancosal 5 ชั่วโมงที่ผ่านมา

      @@dmitry5319 that's the catch

  • @yassengorbounov
    @yassengorbounov 3 หลายเดือนก่อน +81

    A very brave video containing a lot of truth. Few people dare to say this, although many true researchers feel and think it. Publishing a scientific product has become a business model.
    I visited the ATLAS Experiment at CERN and made the following observations:
    1. One of the top authors has published 1,816 papers.
    If one's professional career lasts 40 years, the calculation says:
    40 years X 365 days = 14600 days; 14600 / 1816 = 8 days to publish a paper
    That means 1 paper is published every 8 days during the entire professional life! That's about 45 papers a year... every year!
    2. The same author has an h-index of 167.
    "The h-index is defined as the maximum value of h such that the given author/journal has published at least h papers that have each been cited at least h times."
    The top author has 167 papers each one cited 167 times!
    3. A paper published by researchers had 78 authors!
    I realize that CERN is something "big" and quite complex. But... there are 78 authors anyway...
    Probably all those people are high-level scientists. But... what makes them hyperprolific? Is it real? How is it possible? Is it more for the benefit of science or is it a kind of business?

    • @MiauZi69
      @MiauZi69 2 หลายเดือนก่อน

      Ponzi sceme

    • @samchs222
      @samchs222 หลายเดือนก่อน +1

      MLM?

    • @faithlesshound5621
      @faithlesshound5621 11 วันที่ผ่านมา +3

      I think somebody* has a "Law" to the effect that once any particular measure is selected as an index of quality and used to give rewards, people in that field work to maximise that one measure, and it stops being a useful index.
      That's where "Number of publications to your name" falls down, because of the formation of publishing cartels. Three people in one lab chop up every experiment or study into three, and spread the data and analysis over three papers under their names in a different order, plus of course the head of department and a few people. So to make sense of it you have to read all three papers.
      The big boss has his name on all of them, and gets a bigger citation number: but that's OK, because editors see his name and accept the paper, though he may not even have read it.
      This system works to the benefit of the "big bosses" who run laboratories or research groups, so they are not going to change it. What does it measure in reality? The ability to organise a group of researchers and crack the whip to keep them both working and publishing. That's what the University Grants Committee wants, and what the university's own own hierarchy is monitoring.
      No one person can evaluate the worth of an Assyriologist, a Molecular Biologist and a Health Economist, but the committee members can all look at the numbers and compare them with those of similar academic rank elsewhere.
      * Goodhart's Law.

  • @sunway1374
    @sunway1374 3 หลายเดือนก่อน +116

    This is the result when universities are run by the business types.
    Have they asked themselves what values do they bring? Have they evaluated themselves similarly in their appointment, promotion, and salary increment?
    When the universities need to save money, who are the first persons to get laid off, their salaries becoming stagnant, and their pension contributions reduced? Yep, the academics!
    Why is it that most universities in the UK now have more administrative staff than academic staff?

    • @silphonym
      @silphonym 3 หลายเดือนก่อน +16

      Yes, universities should be almost entirely public institutions, with two primary goals: 1. To educate 2. To create new knowledge

    • @Lifeonthefastlane007
      @Lifeonthefastlane007 หลายเดือนก่อน

      But that's stupid. Why would a business wants to waste money on useless research? Why would they want to compromise the only product they're trying to sell?

    • @sunway1374
      @sunway1374 หลายเดือนก่อน +4

      ​@Lifeonthefastlane007 I think you misunderstand what i am saying. Could it be that you are not aware that universities in english speaking countries are run more and more by people with a business, finance, or corporate background?
      They don't intentionally jeopardise their products. But they put money making as a priority to the detriment of all else. Eg. Boeing.

    • @jgw9990
      @jgw9990 22 วันที่ผ่านมา

      ​@@Lifeonthefastlane007Why would they allocate so many funds to useless administrative staff

    • @colbyboucher6391
      @colbyboucher6391 3 วันที่ผ่านมา

      ​@@Lifeonthefastlane007Why do they get do deem it useless? Why is the only useful research the research that makes a line go up?

  • @A3racada3ra
    @A3racada3ra 9 หลายเดือนก่อน +292

    The whole academic system is basically rotten in its core. As a young researcher its extremely hard to actually make it because nothing works in your favor. Just to name a few: 1. You are extremely dependent on senior researchers / professors, because they are the gatekeepers. Many of them see you as their workhorse who will publish with minimum effort from their side (if you are a postdoc). To top it off, many of them even insist on being put as the lead scientist on any paper you publish (even if their contribution was miniscule). And sometimes they even delegate a lot of extra work (teaching or administration) to you. It is very difficult to argue against this because they hold so much power and potentially can end your career before it even started ... 2. With the increased pressure to publish many papers, it's not just the quality of the papers but also the metrics themselves which get scewed. Lots of papers means lots of citations of older work, which again works in favor for more senior scientists. The side effect is that their metrics will ramp up significantly whilst junior scientists bite the dust. This is especially true if you are not working with a high profile professor. 3. The whole "open science" concept as it is introduced these days makes it even worse for young group leaders or whole institutions, which don't have as many financial ressources to fund open access publications (which cost thousands of dollars). Again OA leads to more citations, and statistically established researchers with a big name have the most ressources to make their work accessible. There are of course also many good sides to an academic career and there are good professors and senior scientists who really want to make a change, however it is best to be realistic and don't have any illusions about it.

    • @dxq3647
      @dxq3647 4 หลายเดือนก่อน +14

      Yup, a young academic has to compete with someone with 40+ years and still produce an interesting paper. How is that fair in any normal field?

    • @davecrupel2817
      @davecrupel2817 3 หลายเดือนก่อน +8

      There are few things i detest more than an "old boys club" situation. Which this sounds very much like.

    • @Lifeonthefastlane007
      @Lifeonthefastlane007 หลายเดือนก่อน

      If a "professor" is gatekeeping shit, use various sources. Be upfront about it. Tell them that they're the only experts about it. Don't give it up and whine how they're gatekeeping and stuff. Convince them to give you an answer. Sometimes professors really didn't know the answer either, they're humans who are simply labelled as "professor". You can't blame everything on them. Sure, they hold power, of course they do. But it doesn't mean that you'll give up just like that. You have to convince them you're worth listening to.
      I am not a professor but in my experience, you have to convince them whatever you're concerning about required their attention. Sometimes you worry about the most mundane stuff and brings it to them and realized you could just get the answer on Google. Also, for 3, I have mixed feelings, yes, we need as much access to information including those behind a paywall but we have to hear in mind, it's the internet, you can get good information for cheap and free, plus, you have public libraries and also archives. Obviously I advocate for free information than having to pay it but you gotta understand that it's not about you and your laziness but your willingness to find good information. You gotta show people that you're capable as a student/researcher and not just whine about how professor X is possibly Satan in a lab coat.

    • @Lifeonthefastlane007
      @Lifeonthefastlane007 หลายเดือนก่อน

      ​@@dxq3647so you want to compete with who then? A kindergartner?

  • @fcolecumberri
    @fcolecumberri 3 หลายเดือนก่อน +173

    The worst thing is when you see cases of clearly frauds, I remember a researcher's google scholar profile that had 200+ entries on the same year...
    Like the year has 365 days, was he publishing once every 3 days including weekends?
    Is not that I doubt he contributed somehow to those papers, I doubt he read half of them.
    (Also topics were extremely varied, from security based on blockchain to biotechnology using AI)

    • @mysteryman480
      @mysteryman480 3 หลายเดือนก่อน +24

      I once stumbled upon a paper that had claims in the abstract that were not included or even mentioned elsewhere in the paper. It made me wonder about the quality control standards at that journal (I can't remember the name of the journal).

    • @fcolecumberri
      @fcolecumberri 3 หลายเดือนก่อน

      @@mysteryman480 Wanna see something fun? search for a classic method and a new technology (example: Bellman-Ford and Cuda) and watch the countless papers claiming to have "novel approach of the classic method with the new technology" no one has ever done.

    • @choppergamer
      @choppergamer 3 หลายเดือนก่อน +21

      100% hes taking obscure journals and yanking them to publish in high impact journals

    • @Marvelous771
      @Marvelous771 3 หลายเดือนก่อน +1

      Fraud

    • @fergalhennessy775
      @fergalhennessy775 หลายเดือนก่อน

      Rockstar professor with many grad students in a fast moving field, it is possible

  • @richardengelhardt582
    @richardengelhardt582 หลายเดือนก่อน +14

    So true. After 50 successful years at the top of academia, I now nouce that 80% of papers submitted for publication are simply rehash of old research by yourself and others, which peer reviewers are so unfamilar with the history of the discipline (due to the avalanche of largely irrelevant papers,) they frequently don't even notice.

  • @SiMyt848
    @SiMyt848 7 หลายเดือนก่อน +136

    Congratulations on the video. I stumbled on it from the YT algo. What you are saying is totally true. I just quit my postdoc for a job in the industry and you cannot imagine how the past months have been so relaxing not having to worry anymore about publishing new papers every second of my free time. I never worked on weekends nor evenings but I was always thinking in my free times about coming up with the next great paper and how to milk more the same models. This is coming from someone that had more than 2x the average paper output during the PhD in my department and have just published my last paper in Nature. I am so glad that I no longer need to worry about checking my citation count on ADS when I turn on the computer in the morning...

    • @chuscience
      @chuscience  7 หลายเดือนก่อน +43

      Congrats on getting a normal job! I am currently the last postdoc remaining in my team. The other 4 postdocs I knew have already left for industry, and feel happy. We'll see how long I will last🙂

    • @ryanelam4472
      @ryanelam4472 2 หลายเดือนก่อน

      What is your field, and does your job in industry also involve research?

  • @joelfenner
    @joelfenner 3 หลายเดือนก่อน +71

    My experience in academia (broadly) was that only 2 things matter to the "administrative" tier:
    1. How much research money are you bringing in?
    2. See 1.
    There is very little actual consideration of the quality of your papers, or the relevance of your research topic or field. They don't even really care that much about the quantity of papers, unless you aren't publishing much, in which case they'll give you the "side-eye" about it. If the incoming money is large enough, even this can be forgiven, at least temporarily. Controversial/moral objections are often swept aside as long as the money is coming in - they only start to care if a public scandal arises (because this hurts donations or grants). But if you are bringing in the money, they really don't care about anything else.
    You would not believe some of the stories I acquired, sometimes firsthand, during my years in academia (across many institutions).
    As a student, I never thought academia was THAT mercenary. Maybe it wasn't always. It certainly is now.
    Your own research colleagues are the only people who care about the substance of your work. In general, "the department" and upwards really only cares about the grant money. And it's soul-crushing to the researchers who are actually trying to do something worthwhile or relevant.

  • @lorteauerwan8686
    @lorteauerwan8686 3 หลายเดือนก่อน +51

    It is indeed a problem that has been discussed for years, but its just an extension of Goodhart's law at the end. Any other metric than publications or citations will eventually lead to the same result where researchers are incentivized to optimize the given metric rather than producing anything else

    • @michaeltorrisi7289
      @michaeltorrisi7289 3 หลายเดือนก่อน +2

      Bad metrics become a more significant problem as entities (because this is a problem in the corporate world, not just in academia) try to quantify performance more and more. There are, of course, incentives for them to do so - it avoids the potential for accusations of favoritism or bias. But it does lead to a lower quality of worker than simply letting managers make their own decisions. That's true even if you take into account the favoritism, bias, and blind spots of managers. The increase in efficiency is small enough that it doesn't outweigh the risk of lawsuits, so metric-based evaluation wins. Or at least, that's the case for large companies. Small companies still rely heavily on their management team to make judgment calls instead of turning them into functionaries. One of the reasons that I'm happier now managing for a smaller company where people would look at me like I was speaking a foreign language if I used terms like "KPI".

    • @SeattlePioneer
      @SeattlePioneer 3 หลายเดือนก่อน +1

      What about just frankly and honestly measuring how much MONEY someone is brings in?
      That would be one metric that would be hard to fudge.

  • @Aaron-lp3zt
    @Aaron-lp3zt 3 หลายเดือนก่อน +75

    "good luck with your papers" - I grinned as I turned back to my overleaf tab

    • @and_I_am_Life_the_fixer_of_all
      @and_I_am_Life_the_fixer_of_all 2 วันที่ผ่านมา

      I can see this happening.. I've seen departments where some people are very serious about their work while others are there to just work on something as an excuse to just fuck around

  • @pixeljames
    @pixeljames 3 หลายเดือนก่อน +48

    I feel your pain. Went through that at some point. The worst part is you work really hard on something, get somewhere and then you can't even get a conversation about it. Even if you give talks on your paper you will likely never get more than superficial comments. It has to do with how the system is set up, around rock stars, egos and popularity contests. It is fundamentally rigged for people that are narcissistic. It should be about real collaboration, joint discovery and human advancement... but it is a strange system that isn't designed by the people who are actually in it.

    • @snesjkksdnuesjjsj
      @snesjkksdnuesjjsj 3 หลายเดือนก่อน +1

      become anarchist. all is hopeless. the masses are hopeless. there are two species of humans.

    • @JaayyRo
      @JaayyRo 3 หลายเดือนก่อน +2

      What are the two species?

  • @khangau4844
    @khangau4844 3 หลายเดือนก่อน +131

    if Einstein were to live in this era, he would be the lowest-ranked professor lmaooo

    • @gauravtejpal8901
      @gauravtejpal8901 3 หลายเดือนก่อน +36

      I would be surprised if he finished his PhD, let alone get a tenure

    • @ColdNavigator
      @ColdNavigator 2 หลายเดือนก่อน +23

      We do have a modern Einstein. Yitang Zhang's career trajectory was very similar to Einstein. Failed his PhD, worked in some minimum wage jobs, but ironically, being outside of academia allowed him time to think and develop one of the most groundbreaking results in recent mathematical history. Basically he was a nobody until he produced one amazing paper after decades of private work.

    • @MiauZi69
      @MiauZi69 2 หลายเดือนก่อน

      @@ColdNavigatorand before that he lived as a delivery driver. Great. He also has no kids, because he never could have been able to afford them. So his bloodline is already dead and our human genome more dominated by imbeciles.

    • @gauravtejpal8901
      @gauravtejpal8901 หลายเดือนก่อน +8

      @@ColdNavigator This example shows that our current academic system in not suitable for the creative people with unconventional thinking

    • @YazminM2222
      @YazminM2222 28 วันที่ผ่านมา +2

      He wouldn't even be a professor 😔 but let's hope for things to get better than this

  • @henriknielsen1662
    @henriknielsen1662 หลายเดือนก่อน +11

    The problem is aggravated by the fact that it is often difficult for editors to find qualified academics who are willing to act as peer reviewers. They aren't paid and often remain anonymous afterwards so that they get neither remuneration nor credit for their work. No wonder many academics are unwilling to take on this unpaid work when they already have so much else to do. It is not easy to see a solution to this. Paying peer reviewers would obviously create all sorts of new problems.

    • @SuperFalcoFalco
      @SuperFalcoFalco 19 วันที่ผ่านมา +2

      Not being paid is actually quite the essence of maintaining quality of peer review.

  • @profdc9501
    @profdc9501 3 หลายเดือนก่อน +19

    Papers are no longer created to be read, they are created to be counted. The fact that citations, and not its contents, are how a paper is evaluated is the problem.

    • @M-dv1yj
      @M-dv1yj 12 วันที่ผ่านมา

      And that’s why I’m just gonna twitter any new papers 🤷🏽‍♂️. The ideas need to spread to be talked about and tested not added to and lost in a checklist of the scientist publishing /study industrial complex 😮‍💨

    • @M-dv1yj
      @M-dv1yj 12 วันที่ผ่านมา

      For what it’s worth I am writing to be read but also know in the current climate no one will read it 😂.
      And this is how the Fermi paradox really happens

  • @mranderson0075
    @mranderson0075 3 หลายเดือนก่อน +10

    I am very glad that my phd advisor is more old-school and doesnt really care if I only publish a single paper before my dissertation as long as my research is sound. I also find the trend to push towards publishing more and more papers (of mediocre quality and questionable novelty) that is coming from the anglosphere quite worrying (I work in Germany). Personally, I don't really see a benefit (for science overall) of publishing every single small incremental step rather than a longer journal article with more meat on the bone (if not even a patent). This also leads to a ridiculous workload being placed on reviewers who do their work pro-bono (and there are 3-4 reviewers per paper). I also don't think that researchers being bogged down with writing papers rather than doing (actual) research is really something academia should strive towards.

  • @modallas2
    @modallas2 3 หลายเดือนก่อน +36

    One paper with a 1000 citations, is better than 1000 papers with 1 citation each.
    Until the system changes to reflect the decline will continue.
    PS: I belong to the first category. I would not have a chance if I were to apply for a tenure-track position in academia.

    • @moumouzel
      @moumouzel 3 หลายเดือนก่อน +27

      you just substituted one bullshit metric for another

    • @albaniaalban
      @albaniaalban 3 หลายเดือนก่อน +13

      I partially disagree with this notion. While I agree with what I assume is the core sentiment - a bigger focus on quality rather than quantity - focusing on the amount of citations carries much of the same issues. Senior researchers, who often are co-authors of papers, will still see their citations skyrocket compared to their younger peers. Niche research and negative results will be disfavored. Systematic reviews and meta-analyses will be given outsized importance.
      I don't believe we can ever fully escape the fact that judging researcher performance is always going to be flawed and subjective no matter which metrics you use.

    • @Lifeonthefastlane007
      @Lifeonthefastlane007 หลายเดือนก่อน +1

      ​@@moumouzel Well, research is full of bullshit metrics. It's what we do, we draw the line.

  • @arlieferguson7442
    @arlieferguson7442 25 วันที่ผ่านมา +3

    I can remember professors talking about the study decline in the value and importance of papers as the volume has increased about 20 years ago. They also discussed the decline in the quality of teaching that went along with it.

  • @llothar68
    @llothar68 3 หลายเดือนก่อน +72

    I'm out of my german university (Technical University Berlin) since 1998 but what you are telling me was already normal back then.

    • @chuscience
      @chuscience  3 หลายเดือนก่อน +44

      Interesting. I discussed this with my professor, a very senior and respected academic. He says that he built his career 30 years ago, but he is not sure how I could succeed nowadays. He admits that academia has become much more competitive since then, with many more publications, grants, students, etc. Young researchers still have to publish a lot of papers in high-quality journals, but this is no longer a guarantee of a good career and impact.

    • @kw1ksh0t
      @kw1ksh0t 3 หลายเดือนก่อน +18

      @@chuscience Famously also Peter Higgs said that he would not have been able to manage in today's academic landscape

    • @Lifeonthefastlane007
      @Lifeonthefastlane007 หลายเดือนก่อน

      ​@@chuscienceI think things have to do with political climate too. Innovation and science wasn't as good as it now than back then, so your professor was right about him being needed because they're needed to get science to where it is today. On today's climate, I don't think it's impossible. It's up for young people like you to stop whining and just do whatever work needed. Sure, complaining is fun, it made you feel less guilty, however, I'm pretty sure we're aware that in the end, we simply just have to know many things, we need to work on our skills. What skills can you do in research? What are your ideas? If you have decent answer to this, I'm pretty sure you're alright.

    • @Lifeonthefastlane007
      @Lifeonthefastlane007 หลายเดือนก่อน

      ​@@kw1ksh0t honestly, I don't see the problem.

    • @thefaramith8876
      @thefaramith8876 24 วันที่ผ่านมา

      @@Lifeonthefastlane007 How does it feel to have -110 IQ ?

  • @ibozum1
    @ibozum1 ปีที่แล้ว +44

    As an early career researcher I totally agree every word you said. You have summarized and explained very well. I enjoyed listening you. I hope I can see you as a one of the top scientists in the near future. Good luck bro.

  • @afanasymarinov2236
    @afanasymarinov2236 3 หลายเดือนก่อน +8

    At times, even when they're referenced, papers go unread. People simply require material to cite in their papers and may extract a few lines from the abstract without fully grasping the content. My most cited paper has garnered over 2000 citations, but I doubt all those authors have actually read it in its entirety.

  • @reginayfavors
    @reginayfavors 6 หลายเดือนก่อน +76

    Academia really judge your ability to obtain funding and grant-based resources. Academia will promote someone who can get money over someone with skills. Great video. New subscriber.

    • @sunway1374
      @sunway1374 3 หลายเดือนก่อน +4

      It promotes someone who can get money over someone who has a lot of papers too.

    • @reginayfavors
      @reginayfavors 3 หลายเดือนก่อน

      @@sunway1374 Exactly.

    • @doghat1619
      @doghat1619 3 หลายเดือนก่อน +1

      Someone who can get money has been successful in convincing an organisation to fund them, that their research would be valuable.
      A very good researcher who's hyper specialised in a very niche interest that nobody sees the value in will of course struggle to get funding.
      Funding has to provide some value, simply being good at research isnt providing value.

    • @sunway1374
      @sunway1374 3 หลายเดือนก่อน +5

      @@doghat1619 I agree partly with you.
      One challenge is we often do not know what will become useful (or valuable) or not.
      Also, what is useful or valuable is debatable in general, and debatable under the condition of limited resources.

    • @Talleyhoooo
      @Talleyhoooo 2 หลายเดือนก่อน

      Increase grant money, problem solved.

  • @qweewqqweewq31313131
    @qweewqqweewq31313131 3 หลายเดือนก่อน +8

    I left the academic path just because the pressure and the over hours I used on “writing papers” are just too huge. Nobody is going to read the paper I wrote then why I am putting so much effort with minimum PhD wages. I left and I am glad I made the choice. My salary is 5 times higher now

  • @danielfigueroa371
    @danielfigueroa371 4 หลายเดือนก่อน +14

    Hi friend, I feel very identified with your video, it really touched me deeply, I just finished a master in High Voltage, published in IEEE top journals and I have the same feeling as you, what a relief to know that there are people who are experiencing the same as one. I really appreciate your video, it would be great to chat one day.

  • @kakabudi
    @kakabudi 3 หลายเดือนก่อน +10

    Thank you for making this video. You explained the dilemma beautifully. I am in my junior year of undergrad and I had 1 year of experience working in a lab. The dread that I felt over publishing some paper that barely interested me and still required tons of hours of programming, research of other papers, writing the paper, was exhausting. I respect the decision of someone to want to stay in academia, but I will run far, far away from it.

  • @andrewcgs
    @andrewcgs 3 หลายเดือนก่อน +48

    I always wanted to be a researcher all my life. I quit just before applying for PhD positions when I realized that nothing matters in academia outside of generating revenue, with an out-of-scale competition even for short crappy academic positions, and it is mostly based on publishing papers with no real impact on the world. Every PhD student I know has quit academia as of now.
    Can academia get more depressing than this?

    • @Lifeonthefastlane007
      @Lifeonthefastlane007 หลายเดือนก่อน +1

      Of course it can get more depressing. With the emergence of AI, many questions in academia will be solved. Possibly, they don't need you and me anymore.
      But, the bright side is that maybe we do need help from AI, and that's alright. It's old topic now that AI helps more than it didn't.
      Needless to say, if you're really interested in solving the world's problems you would just solve it even without recognition or payment. But that won't makes sense, because if you look closely, academia, corporations, government still needs researchers, despite AI. It's pretty interesting if you think about it. More innovation simply means more brainwork instead of the opposite.
      I myself quit research because of lack of grant, but my own hindsight is that I don't even know what to research on in the first place without it sounding stupid. So I just continue studying valuable courses instead of research itself.

    • @warpedweft9004
      @warpedweft9004 28 วันที่ผ่านมา +1

      It depends on your motivation. Some want to do a PhD to satisfy their own quest for knowledge and don't intend to buy into academia at all. They are there for the quest, not the glory.

  • @AsusMemopad-us5lk
    @AsusMemopad-us5lk 3 หลายเดือนก่อน +6

    "Of writing many books, there is no end; and much study wearies the mind." - Solomon. Congratulations, modern academia has re-achieved that point.

  • @ClickBeetleTV
    @ClickBeetleTV 3 หลายเดือนก่อน +7

    It also shows what a low premium is placed on teaching and developing students at research universities

  • @timng9104
    @timng9104 11 หลายเดือนก่อน +37

    i am a postdoc in materials, and very similar observations. I feel like a writer more than a scientist sometimes

    • @mechatronicsfun4467
      @mechatronicsfun4467 3 หลายเดือนก่อน +5

      Go to industry. Nobody will ask you for journal publications there.

  • @bennetm9498
    @bennetm9498 หลายเดือนก่อน +3

    I did my PhD 20+ years ago. I didn't like this game of publishing, so never sought a career in academia. I just curiously opened my Google scholar profile, I got total 2650 citations and still have a steady 100/per year citations. Considering I haven't published anything in last 20 years, so it is not too bad 😀

  • @moradbali5858
    @moradbali5858 3 หลายเดือนก่อน +2

    Thank you for this video dear colleague!
    There is definitely a need for change.
    Worth part in all of this is that if you want to have a chance to work in academia, not only you need to publish, but also you need to publish in high ranked journals.

  • @johannystrom-persson2966
    @johannystrom-persson2966 3 หลายเดือนก่อน +1

    I couldn't agree more with your points. Thank you so much for speaking up.

  • @coach_tae_
    @coach_tae_ หลายเดือนก่อน +3

    I never lost so much faith in research papers as I did when I first started interacting with people in academia during my PhD studies. Not only are papers pushed out and seemingly rushed because more is better, but the quality is demoralizing as well. The amount of times I've heard senior advisors make assumptions, I ask them why they can make that assumption, they say "it HAS to be that way" or "why wouldn't that be right" as if the burden of proof was on me when they made the claim. I would then go on to show demonstrably why these assumptions were bad and they just act like it never happened. Like what if I wasn't there to force them to prove their assumptions? We'd just be assuming our way to the next paper??
    I hate it.

  • @leonardodossantosferreira3496
    @leonardodossantosferreira3496 3 หลายเดือนก่อน +16

    As a first year PhD student, I relate a lot with what you said in the last comments of the "Publishing pressure" section. The will to be creative and to develop my own identity as a scientist is always trimmed by the pressure to publish in order to advance and achieve "relevant" positions as a scientist.
    Once I heard a scientist say that our evalutation of academic and scientific merit should not be a process that a computer could do alone, by merely counting some numbers and parameters. I absolutely agree with that idea, but it seems that without a major change, thing will converge exactly to the point where adimissions to post docs, PhDs and even to permanent positions will be made merely through numbers.
    Great video.

  • @promer4690
    @promer4690 26 วันที่ผ่านมา

    Thanks for sharing. I am not in academia but found the topic very interesting and started to watch. Your concerns are spot on.

  • @MohamedTarek-vt4lb
    @MohamedTarek-vt4lb 3 หลายเดือนก่อน +1

    Very informative! Thank you and hope things got better for you❤

  • @georgezakusilo1584
    @georgezakusilo1584 3 หลายเดือนก่อน +9

    at least in biomedical sciences the problem is worse. not only certain labs pushing a lot of papers, but often times you start reading an article and realize instantly that it comes from a paper mill and it is an utter and complete BS. What you are learning to do is to go to conferences and see who is actually doing great, breakthrough science and you follow them and their work

  • @0xnika
    @0xnika 3 หลายเดือนก่อน +18

    Thank you for sharing you opinions on this sensitive point! The only way to win in Academia is by playing the game, until the game breaks..

  • @mitchumsport
    @mitchumsport 3 หลายเดือนก่อน +1

    i loved your explanation of the impact on creativity. it has been hard for me to state in the past.

  • @noone-dv1jo
    @noone-dv1jo 4 หลายเดือนก่อน +15

    I’m not in academia and not sure how this got recommended - very interesting talk about the nuances of academia and how it works. My professor tried to give me a rough summary of industry vs. academia/ professor when I was thinking about my future, but honestly don’t think I’m smart enough for pure academia - but to your point it seems it can be stressful and hard to become successful in academia and not always to focus on developing the models or whatever the paper itself is about

  • @jasonl3254
    @jasonl3254 ปีที่แล้ว +4

    I enjoy listening to your insights into academia

  • @TheAmazingMooCow2
    @TheAmazingMooCow2 3 หลายเดือนก่อน +4

    Once I started my PhD it was quite eye-opening to see how many of my colleagues and other academics in my department had parents/grandparents/other family in academia; not to say there's anything wrong with that of course but with the academic landscape as it is it seems that its a lot harder to succeed without pre-existing connections that know how the game works

  • @feifeizhang7757
    @feifeizhang7757 2 วันที่ผ่านมา

    Thanks for sharing your experience

  • @Avento8
    @Avento8 8 วันที่ผ่านมา +1

    I also left academia after being thoroughly disappointed with the system. As a Ph.D. I realized that no one actually reads papers/theses because they're so hard to understand. So I wrote my Ph.D. thesis as a textbook: starting from master-course level, building up with examples, exercises, background appendices, and so on, up to the level of my own published papers. My students loved it. My thesis committee didn't: it was rejected. I had to write my thesis as paper-style: condensed and incomprehensible to anyone but a veteran in the field.
    What followed was a year of evening-time rewriting (without getting paid) merging all my papers into a very dense thesis. This was in the end accepted and I got my Ph.D. degree. Now, six years later, I still get regular emails from random people thanking me for my free introductory textbook thesis. It helped them a ton to get familiar with the field. I never got a single email about any of my papers or my rewritten Ph.D. thesis.
    Conclusion: no one needs papers. (Sure, with a very few exceptions.) We generally need clear and high-quality educational materials. But the system only forces us to write papers and rejects anything else. The system is broken.
    The above video also shows really well how the system is broken. Sadly the solutions provided are "How to survive and thrive within this broken system" and not "How to actually fix this system, so science can start making an impact and improving the world again."

  • @wojpaw5362
    @wojpaw5362 3 หลายเดือนก่อน +2

    Very insightful, thank you. I am considering doing a PHD but this made me a realise that perhaps working as a research assistant might be better.

  • @olivermechling7975
    @olivermechling7975 3 หลายเดือนก่อน +4

    very interesting perspective I have never thought about research in this way before (don't have any experience yet just a masters student). thanks for making the video and best of luck for your future.

    • @rituparn1
      @rituparn1 3 หลายเดือนก่อน +1

      Better not get into this grind while you still have time. When you really have something novel, the motivation to publish will automatically come. Only then you publish. Until then, get an actual job

  • @Biondis_Okul
    @Biondis_Okul 3 หลายเดือนก่อน +1

    Without any interruptions he spoke for 21 minutes, such a talent 👏
    Know I start reconsidering my goals in the future. Thank you very much Andrey.

  • @meamzcs
    @meamzcs 3 หลายเดือนก่อน +12

    Imo my main problem with citation count as a metric is mainly two things:
    1. if you look at the most cited papers in a field more often than not you will find some overview papers that just summarize prior research at the very top. I mean, yes, those papers are fine and important but without the original research before them they are nothing.
    2. Sometimes there's research that is so advanced that only a small handful of other very top notch research groups on earth can make good use of those results even though they might allow for much better results than everything else.

  • @parkerstroh6586
    @parkerstroh6586 3 หลายเดือนก่อน +2

    Awesome video, this is exactly the kind of things I’ve been wondering

  • @MarkRuvald
    @MarkRuvald 3 หลายเดือนก่อน +14

    Stress, prestige, grants, pressure, pay-walls. No to change the world in a meaningful way, you have to have an audience. For long-form content that means blogs.

  • @trucksanddirt1506
    @trucksanddirt1506 3 หลายเดือนก่อน +4

    Excellent contribution. I have thousands of citations, but I know people who never did any work, they don't even understand what is in the paper. They find people who put their names on papers and them. Then they turn around and brag that they are great.

  • @fractal_gate
    @fractal_gate 2 หลายเดือนก่อน

    Thank you for bringing this topic to light.

  • @friendlyboylulea
    @friendlyboylulea 3 หลายเดือนก่อน +7

    Great videa. It's so good that yoy are sharing your thoughts with the public. Having been going through similar thoughts and challenges myself, I have a few points that helped me grab my hand around this whole paper problem:
    -I saw many equations and I think you work on modelling/simulation. In such mathematical fields, much fewer citations are common because people tend less to rely on other people's models. In contrast, in psychology and human sciences, a lot more citations occur because they have to make their points by citing other qualitative arguments. So, 4 citations for a psychology paper published in 2021 is bad but maybe it is not that bad for your paper given the mathematical nature of your field.
    - At the end of the day, the number of citations, h-index, etc. do not matter that much. A serious hiring committee often hires experts in your field who read your papers and judge the scientific quality of them.

    • @chuscience
      @chuscience  3 หลายเดือนก่อน +2

      Thanks for the comment. Indeed, I had a few academic interviews recently and noticed that clever academics avoid suspicious researchers with tons of publications. They would rather invite an adequate person with a team mentality.

  • @niconeuman
    @niconeuman 4 หลายเดือนก่อน +5

    Very interesting video! I agree with what you say. The measurements have become the objectives

    • @carpediemcotidiem
      @carpediemcotidiem 3 หลายเดือนก่อน +1

      Goodhart's Law: "When a measure becomes a target, it ceases to be a good measure."

  • @alcyonecrucis
    @alcyonecrucis 3 หลายเดือนก่อน

    Excellent, hope you get to discuss your paper with others soon 😊

  • @bestpakistan1478
    @bestpakistan1478 3 หลายเดือนก่อน +1

    Dear Sir, I totally agree from your entire discussion. The malpractices are actually common in the academia and lethally crushing the impact factor standards that could produce a change in society. Regards,

  • @nickh7681
    @nickh7681 3 หลายเดือนก่อน +18

    This is precisely why I wanted to go into industry despite my love of math. As long as you can create value for your company doing what you love, then you can be as creative and diligent as you would like

    • @danimaster6647
      @danimaster6647 3 หลายเดือนก่อน +8

      You face similar challenges in the industry. The issue with founding is even more accelerated there and your project can be canceled at any time. Everything is about money (your solution has to be cost effective and easy to implement). Also selling your solutions to stakeholders is even more important than in academia

    • @nickh7681
      @nickh7681 3 หลายเดือนก่อน +1

      @danimaster6647 I agree to some extent. It's highly position dependent. If I can fulfill everything my employer asks of me and also generate value with my math projects, then, over time, I can spend an increasing amount of time on such math projects. In fact, I can eventually create a new team within the business. If it's all about money and I generate revenue which we otherwise wouldn't generate, then I earn greater freedom to do what I want to. With regards to stakeholders, that depends on the structure of the company. I've never worked somewhere so small or been so senior such that I'm actively interacting with stakeholders to the extent that they are aware of how I spend my time each month

    • @danimaster6647
      @danimaster6647 3 หลายเดือนก่อน

      @@nickh7681 I also agree to some extend since it's very true that the more value you create the more freedom you have. With "stakeholder" I meant the person who has an interest in your project and is involved in the founding part. In our company there is politics involved where sometimes great ideas are lost and others (which in my opinion) are dead ends are followed because of the opinion of some board members. The ressources which are allocated is also a matter of politics in our company. This isn't to say working in the industry is a bad joice. Above all you get proper money

    • @jacksonsmith2955
      @jacksonsmith2955 3 หลายเดือนก่อน +4

      mannn this stuff is terrifying. i'm a high schooler with a tentative love of math, but i don't actually know enough math to know exactly where my interests lie or if I'm even good at it, and everything i hear about academia and industry sounds horrific. maybe i should just grab an electrical engineering degree or something instead.

    • @nickh7681
      @nickh7681 3 หลายเดือนก่อน +3

      @jacksonsmith2955 If you love math and are good at it, then you have nothing to worry about. Stay humble, work diligently, and don't neglect practical skills like programming, machine learning, data science, etc. Also, don't forget to do the normal career stuff like networking and internships. If you're bright, you'll figure it out. Again, stay humble, be patient, and work diligently

  • @Elkatar
    @Elkatar 5 หลายเดือนก่อน +24

    here is a likely solution: If you hold a position in academia while also working part-time in another field, such as industry, you'll find yourself less reliant on academic metrics. The citation system follows an exponential pattern, where older works gain popularity and significantly contribute to an individual's H-index, explaining around 80% of it.

  • @mohammedyaya0
    @mohammedyaya0 3 หลายเดือนก่อน +2

    I wish someone told me this before I joined academia!! Well said Dr. Andrey

  • @NewWorldCricket
    @NewWorldCricket 9 ชั่วโมงที่ผ่านมา

    great, insightful video

  • @cocs88715
    @cocs88715 3 หลายเดือนก่อน +11

    Got off this academia treadmill two years ago and never regretted. All my fancy high impact factor papers mean absolutely nothing outside of academia.

  • @neelotpaldas5616
    @neelotpaldas5616 3 หลายเดือนก่อน +8

    Everyone in academia wants their research to have an impact in the real world. Unfortunately impact in real world cannot be measured by citations or impact factor, which academia does.

  • @ax5344
    @ax5344 26 วันที่ผ่านมา

    As a practitioner in the field, I do wish there were fewer papers and each could carry higher values. There are just tooooooo many papers for me even to glimpse from. Thanks for opening discussing this issue and sharing your insider observation!

  • @testboga5991
    @testboga5991 3 หลายเดือนก่อน +1

    Very wise insights!

  • @strayorion2031
    @strayorion2031 3 หลายเดือนก่อน +5

    I think its time to start discussing alternatives to the metrics used today, actual material things that we can ask institutions to do, to start to walk away to the horrible state of academia today. I havent tought of alternatives but i would like to see the discussion turning into what should academia be, and how do we get there

  • @modalmixture
    @modalmixture 3 หลายเดือนก่อน +4

    Thanks for sharing your perspective on this. I have noted the overall quality of papers going down the toilet over the last ten years. Even when the research itself is good, the writing is badly in need of an editor; captions contain typos; figures are poorly designed and sloppy. And your comments suggest why this might be - the incentives at work in academia seem to be producing increasingly sloppy science communication as researchers prioritize quantity over quality.

  • @metalslegend
    @metalslegend 2 หลายเดือนก่อน +2

    Thank you for this reality check. I see some researchers in Psychology cope with this by for example dissect the same dataset multiple times, for different research questions each time. I saw one Post Doc publishing about 20 papers a year, all with the same dataset. Its a weird system.

  • @davip116
    @davip116 3 หลายเดือนก่อน +2

    Good points for such a young researcher. One thing I suggest is to avoid focusing too much on tools. Research is not programming nor visualization.

  • @freeman1379
    @freeman1379 3 หลายเดือนก่อน +3

    This is exactly why I quit my Ph.D. I have the utmost sympathy for you and anyone finding themselves in this situation.

    • @kanao2007
      @kanao2007 2 หลายเดือนก่อน +1

      Congrats!! I've been under constant publishing pressure and useless reportings since 1st yr, in the 2nd yr I started a job secretly so I safely quit . Now in the 3rd yr I am leaving this hell

  • @KuopassaTv
    @KuopassaTv 4 หลายเดือนก่อน +12

    The answer is to do soft sciences -- easier to meet quantity over quality criteria

    • @chuscience
      @chuscience  4 หลายเดือนก่อน +14

      😂😂 I heard some academic discussions that “it is the computer scientists who have spoilt academia. They published a lot, so other researchers had to follow”.

    • @leohuang990
      @leohuang990 3 หลายเดือนก่อน +4

      @@chuscience Even in computer sciences, different subareas have drastically different life cycles for publishing a paper. It typically takes 3 months or less to finish a deep learning project while a year or more to finish an operating systems one.

    • @erroredhacker
      @erroredhacker 3 หลายเดือนก่อน +2

      its just the age of the science. more mature fields have longer history of established practices, higher barrier of entry in terms of novel contribution

  • @roderickdewar1064
    @roderickdewar1064 3 หลายเดือนก่อน +1

    Bravo. This needs to be discussed more openly within and without academia. The rot set in with the marketisation of universities, meaning only $$ matters. Universities no longer prioritise scholarship. They prioritise $$.

  • @ahmedamanibrahim192
    @ahmedamanibrahim192 3 หลายเดือนก่อน

    Thanks so much for this video! I'm planning to start PhD soon, and this was very eye opening

    • @chuscience
      @chuscience  3 หลายเดือนก่อน +2

      Hi! Don't get me wrong, there are many benefits of doing a PhD. But be prepared for the paper game and the limited impact of your publications. Good luck!

  • @RobinTheBot
    @RobinTheBot 3 หลายเดือนก่อน +6

    Wow! Who could have known trying to force fundamental research into a profit system could have downsides.

  • @realGBx64
    @realGBx64 3 หลายเดือนก่อน +14

    60 citations in 3 years is amazing. What I found very dishartening when I saw that all the citations I get are just general citations in introduction like [12-24] and mine is 18 😂

    • @chuscience
      @chuscience  3 หลายเดือนก่อน +16

      True. I also noticed that my papers got cited in that way, which means that they were selected just because of their titles or abstract/figures, without a thoughtful intention to use/develop my work.

    • @erroredhacker
      @erroredhacker 3 หลายเดือนก่อน

      ​@@chuscienceis this the reason why people are so anal about """"good"""" abstracts/conclusions?

    • @dizgil6881
      @dizgil6881 หลายเดือนก่อน

      Same here. Out of about 30 citations, probably 5 are from my other work and 20 from general sentences. Then i get the researchgate notification "youve been cited!" Go to read said paper, and im like sooo why did they cite me? Just because it says bayesian in the title i guess

  • @a_bar8579
    @a_bar8579 3 หลายเดือนก่อน +2

    Specifically the academic field needs as many creative geniuses as you have in 6 years you have discovered all this and this is amazing

  • @hosszu2010
    @hosszu2010 27 วันที่ผ่านมา

    Your creativity point is so true. People love milking out many papers from the same idea. Find a goldmine to make tenure. Other point is p-hacking, very prevalent in social sciences, and the non-publication of null results. Make the whole exercise questionable.

  • @AcesAndNates
    @AcesAndNates 3 หลายเดือนก่อน +5

    LOVE the shirt

  • @L4wr3nc3810
    @L4wr3nc3810 3 หลายเดือนก่อน +4

    Why do i have a feeling that every single person in our society is totally exhausted

  • @user-wr4yl7tx3w
    @user-wr4yl7tx3w 4 หลายเดือนก่อน +1

    This is really informative

  • @iancoleman6352
    @iancoleman6352 3 หลายเดือนก่อน +1

    Thank you for putting your experience on display. It's apparent that you have thought about this and care significantly.
    I've just started a Master's program and this has given me a lot to think about.
    If you got a chance to do it over, would you forgo your career in academia to make progress in industry? What is the percentage of published papers not from academia? i.e., people doing research in industry who wish to publish a paper.

    • @chuscience
      @chuscience  3 หลายเดือนก่อน +1

      Hi Ian!
      I would go for PhD again. During my PhD I travelled a lot and met many interesting people. Eventually, I got to the UK because of my academic work. However, the next question is "Should I stay in academia". And if staying, for how long?
      There are enthusiasts working in industry and publishing papers. But I see very few such works in my field. My estimation is that in Energy and Power Systems Research only 1% of papers are coming purely from industry.
      Andrey

  • @hooh5479
    @hooh5479 10 หลายเดือนก่อน +12

    You seem to have opened your eyes on the old paradigm: "publish or perish". The issues that you discuss have been known to poison academia for decades. Bureaucrats lead academia and academics let them do that. Note that among bureaucrats you have a bunch of low-level scientists who managed to stay in academia and make the life of good scientists a nightmare. What you call "successful professors" are those who, for some reason, enjoy the benefits of a large network. Together with the volume of publications, the volume of coauthors should be considered to better see that "successful authors" are those who make tiny scientific contributions in papers. They "supervise" the work, which means they get the grants and pay PhD students and postdocs to do the real scientific work: research. Best of luck to you.

  • @mrhelli105
    @mrhelli105 2 หลายเดือนก่อน +3

    I am a PhD student at the second year of course. Generally I don't write comments on social media, nor I expose myself as I'm about to do.
    Because of this "publish or perish" mechanism I already lost the opportunity to became a professor in the future. The philosophy of my tutor (and so of the research group I joined) is old style: focus on the application, on the project, on the code, make everything work as best as possible, and finally (after many months or a year sometimes) prepare the paper. In the last months I realised that such philosophy doesn't create succesfull academics nor even professors. When I realised that I felt really bad, because I knew a pretty important door was closing for my future. I'm pretty sure I will not be able to became a professor, and that still bothers me a lot.
    Your video has been shocking for me. I suddenly realised that maybe the philosophy of my professor is not that wrong. Ok I have to forget the academic career, but still the knowledge and skills that I'm building are precious and valuable. You video changed my mind and my approach.
    Thank you so much

    • @chuscience
      @chuscience  2 หลายเดือนก่อน +3

      Thanks for sharing your story. You still might be able to get academic positions if you show other things on your CV, for example, various projects you worked on, collaborations with industry, patents, etc. But yeah, it will be difficult. You will be competing with other researchers who have dozens of journal papers. Talk to academics who you know. Maybe they can give you better advice on whether or not to stay in academia. Good luck with your PhD!

    • @mrhelli105
      @mrhelli105 2 หลายเดือนก่อน

      @@chuscience Thank you so much for the advices.
      You just obtained a new subscriber!
      You seem a very professional and capable researcher. Good luck for your career

  • @y.t1670
    @y.t1670 หลายเดือนก่อน +2

    I work in the industry and occasionally publish conference papers with PhD students we cooperate with. Our papers are more industrial and engineering oriented. And I’m proud to say our papers do provide valuable insights for industry at least, and we got some follow up query from industrial partners. And in my daily engineering role, I also often search for prior art and read carefully the most relevant papers. Mostly conference papers, almost never journal papers. And I do ignore the only academia oriented papers, because they are too theoretical and no practical engineering implementation mentioned, and of course very often too difficult for me to even read through the formulas in the academic papers, let alone understanding them.
    For the papers I coauthored, most of the time I’m responsible for most part of the implementation and validation experiments, and also 70% of the whole draft of the papers. And yes, when I’m writing a paper with a submission deadline, I work till midnight and on weekends.
    And when we look for conferences to submit to, we prefer IEEE or ACM as the basic requirements. Then we look at the committee. We’d like to see committee members from the industry, preferably from our customer companies. If the committee consists of only professors, the conference won’t be at the top of our list. And yes, we often got the comment from our professors partners that our paper is not academic enough. But I also want to mention, the professors cooperate with our company, are smart and very knowledgeable people. The professors ask good questions and provide good insights and help us sharpen our research direction and experiment design.
    In short, I love working with academias as an engineer in Industry. I guess I won’t be happy in a die hard academic environment. I love engineering and I love to have some good academic guidance for my industrial research. I love writing papers to present my industrial research results.

    • @chuscience
      @chuscience  หลายเดือนก่อน

      Thank you for sharing your story! Sounds like a great balance between publishing and implementation.
      May I ask you how many papers you write or co-author per year?
      Andrey

  • @athulshaji1754
    @athulshaji1754 3 หลายเดือนก่อน

    What ever you have mentioned is very true.

  • @semsomify
    @semsomify 3 หลายเดือนก่อน +9

    I regret starting my PhD, it now all feels like a scam. The university wants me to publish 3 journal papers to be able to graduate, one of them has to be in a reputable journal, and all my supervisor cares about is those papers. The university wants to increase its global rank so it can attract more students and my supervisor as well. It doesn’t matter what the topics of these papers are.
    Publication is a nasty business too.
    I regret this path and so happy that I kept my job and my other career path. I probably will never return to academia after I graduate.

  • @sirmclovin9184
    @sirmclovin9184 3 หลายเดือนก่อน +8

    I think there are two main problems to understand this:
    1) Everyone can count, but few can read. Too often those people make hiring decisions.
    2) Capitalist overproduction: The companies owning the journals extract wealth from the public sphere and they do that by selling papers written by publicly funded researchers. The more papers, the more they can sell. So they then lobby the government to implement policies that maximize their profit. It does not matter that the extreme output of papers does not necessarily translate to good science, as long as the money machine is alive and well.

  • @martin128
    @martin128 3 หลายเดือนก่อน +2

    My friend was also in Phd and he said also that he was quite unmotivated writing papers since nobody will read them. He also had problems with supervisor that had problems with his papers.

  • @shahmaruf45
    @shahmaruf45 3 วันที่ผ่านมา

    Excellent!

  • @xhivo97
    @xhivo97 3 หลายเดือนก่อน +3

    What kind of (impactful) research only takes a year? This is kinda insane to me to have a minimum