Software Engineer jobs (Mid-Senior) can NEVER be replaced by a Coding AI like Devin Internet of Bugs 2024-03-16 | The primary function of a Software Engineer is not just writing the code. Our primary function CANNOT be replaced by "AI" code generators (if it could, we wouldn't have needed all the Agile/ProjectManagement overhead for all these decades).I said what I said.The video I mentioned at 5:49 about how software is getting worse (and explaining the graph towards the end of this video) is here: Software is bad, and it's been getting worse. But it's still worth doing.youtu.be/U-IhIqmCHlcNOTE: (Not that anyone will read this, but) When this video uses the term "AI." it (like most of the current discourse these days) means current and near future "Generative AI" a.k.a. Large Language Models. If you're thinking about the Agents from the Matrix or the Robots from Terminator, that's DIFFERENT. That's the OTHER AI, the Human-Intelligence General AI, Sometimes called "AGI." That DOES NOT EXIST. For the time being it's PURE FICTION. It may get here soon, although I (and a lot of people smarter than me) seriously doubt it, but we'll see.
How Programmer Jobs get created and destroyed, & how AI might change that. Internet of Bugs 2024-11-14 | The economics of how tech jobs get created and how layoffs happen is worth understanding if you're not sure how AI might fit into it.00:00 Previously on @InternetOfBugs vs AI01:50 Caveats: US Only, not Gaming02:33 Building vs Maintaining03:46 How Projects get funded05:08 Hiring process07:42 How the last decade or so has been unusual10:26 How AI might change that11:19 Enter the Stock Market12:47 How Layoffs get decided on15:58 How to ride out the apparent downturn21:37 Bad advice from people who have never experienced a downturn24:38 Resources on How to look for a jobResources:My video on job hunting vs AI resume bots:youtu.be/NQmN6xSorusMy video on starting your own project (more of these to come):youtu.be/iMDiYX7P4dsBooks for job hunting:amazon.com/Your-Well-Before-Youre-Thirsty/dp/0385485468amazon.com/Never-Eat-Alone-Expanded-Updated/dp/0385346654amazon.com/What-Color-Your-Parachute-Meaningful/dp/1984861204 #Articles on AI Powered job applications:404media.co/i-applied-to-2-843-roles-the-rise-of-ai-powered-job-application-botsfastcompany.com/3069166/i-built-a-bot-to-apply-to-thousands-of-jobs-at-once-heres-what-i-learnedwired.com/story/this-ai-bot-fills-out-job-applications-for-you-while-you-sleepsemafor.com/article/09/12/2024/linkedins-have-nots-and-have-botsbusinessinsider.com/job-applications-hiring-ai-bots-spam-resume-cover-letter-2024-3hactarai.substack.com/p/how-an-ai-bot-transformed-job-applications# How the stock market is reacting to AI from @NobodySpecialFinance money.usnews.com/investing/articles/are-we-in-an-ai-bubbleyoutube.com/watch?v=ESDDFUAAPxg [Big Tech is Now Trapped in a Cash-Burning AI Dumpster Fire]# On Stock Buybacksmarketwatch.com/livecoverage/stock-market-today-dow-futures-take-a-pause-after-sell-off/card/corporate-stock-buybacks-on-track-for-a-fresh-record-in-2024-GaC3nlZqsi1rIEDdYTgq]schwab.com/learn/story/with-rate-cuts-ahead-stock-buybacks-may-continuepress.spglobal.com/2024-06-17-S-P-500-Q1-2024-Buybacks-Increase-8-1-from-Q4-20 23-12-month-Expenditure-Declines-4-8-from-Previous-Year,-Earnings-Per-Share-Impact-Reverses-Showing-First-Gain-in-Five-Quarters-Buybacks-Tax-Results-in-a-0-47-Reduction-in-Q1-Operating-Earnings-an# On professional Networking:https://careers.umbc.edu/students/network/networking101/https://moody.utexas.edu/sites/default/files/Networking%20-%2017-18.pdflinkedin.com/pulse/new-survey-reveals-85-all-jobs-filled-via-networking-lou-adlercore.ac.uk/download/pdf/326045591.pdf# Charts of tech jobs over timestlouisfed.org/-/media/project/frbstl/stlouisfed/publications/regional-economist/2017/second_quarter_2017/industry_profile.pdfstlouisfed.org/publications/regional-economist/second-quarter-2017/growth-in-tech-sector-returns-to-glory-days-of-the-1990sstlouisfed.org/publications/regional-economist/2024/feb/labor-market-conditions-eased-state-level-viewwolfstreet.com/2024/01/07/which-industries-lost-jobs-which-gained-jobs-including-government-jobs-longer-term-employment-trends-in-chartsbls.gov/charts/employment-situation/employment-levels-by-industry.htmfred.stlouisfed.org/graph/?g=1gFn7fredblog.stlouisfed.org/2023/03/was-there-a-tech-hiring-bubblestlouisfed.org/publications/regional-economist/second-quarter-2017/growth-in-tech-sector-returns-to-glory-days-of-the-1990sstatista.com/statistics/200003/number-of-job-openings-in-the-us-information-sector
ChatGPT-O1 Changes Programming as a Profession. I really hated saying that. Internet of Bugs 2024-10-14 | AI's have not been able to do as well as professional programmers up until now. For a small subset of entry-level programmer jobs, that's no longer true (at least until the new hire becomes more experienced).It still doesn't have the judgement a programmer needs (or anything close to it), and it can't do the communication parts of the job (and is still awful at writing tests). But it's starting to live up to the capabilities of this form of Machine Learning.If your only programming experience is homework assignments, or If you're programming workflow primarily consists of copying and pasting from Stack Overflow, then I've got some bad news for you.00:00 ChatGPT-O1 is different02:00 What I've been testing03:03 Coding RegExes is Rust05:19 Incorrect Assumptions and Expectations06:22 Rechecking ChatGPT-4o. Still bad06:59 The specific case where it might replace a programmer job07:11 But, it's a stupid job that shouldn't exist08:03 Many C.S. programs don't prepare for useful skills09:24 O1 Still has a lot of limitations10:48 Just as bad at tests as Claude 3.511:16 Still bad at picking between alternatives11:51 O1 couldn't even make this compile13:40 "Human-like reasoning" claim is nonsense14:22 Don't panic - tools obsolete skills every few years15:23 But, things are going to be bumpy15:35 Advantage to smaller, nimble companies for a while16:01 Still going to be plenty of programmer jobs17:35 But you need to learn how to use these tools, and wellReferences:CodeCrafters (affiliate link) if you want to see how you measure up to 4o:https://iob.fyi/CodeCraftersThat nightmare regular expression:emailregex.com/index.htmlMy video with Proof News on the AI judgement problem, and Claude 3.5's poor test writing:youtu.be/x0y1JWKSUp0?si=Yxn1UxDWzko7OeytMy video comparing 4 AI tools using CodeCrafters' HTTP in Python challenge:youtu.be/-ONQvxqLXqE?si=-Dz0zJiu3vHhe5R7My video on Agile paving the way for AI to hurt programmers:youtu.be/9C1Rxa9DMfI?si=U9yTT6kHpnUDdRp2My video on Software Testing in an AI world:youtu.be/02FD59whT5A?si=yJZukC5R7W95s5Fc
ChatGPT O1 Preliminary test comparison with previous model test videos Internet of Bugs 2024-09-21 | I ran ChatGPT O1 through the same test I ran on other models in youtu.be/-ONQvxqLXqEandyoutu.be/x0y1JWKSUp0and this video summarizes what I found.The raw screencast of O1 code interactions is at youtu.be/7zpFMtfkuvA00:00 Intro00:30 Comparison to tests I ran with @Proof_news 01:10 ECM Prime Number Attempt01:56 CodeCrafters HTTP Server challenge02:47 Still can't do a developer job03:14 But, an increase in code quality03:40 More to come03:55 Usability issues04:14 About comparisons to a "smart PhD"
Starting a side-project: Why you (and most developers) should, and how AI can help. Internet of Bugs 2024-09-16 | Info at youtu.be/l9Z7KPnP0-c on my ideas about where the channel is going, including channel memberships.You can join the channel here: youtube.com/channel/UCfJRkBBiPtKZyZn_3PxWaiQ/join # Other references from the video:# Articles from the last week about a potential recession starting in the US:thinkadvisor.com/2024/09/11/jeffrey-gundlach-6-signs-recession-is-near-or-heremarketplace.org/2024/09/12/inverted-yield-curve-recession-predictor-indicatorfred.stlouisfed.org/series/SAHMREALTIME# Book Resources to get you started:theleanstartup.com/bookleanproductplaybook.com# The best source I know on A/B testingkalzumeus.com/2009/12/31/engineering-your-way-to-marketing-success# Sites/Communities where other people are doing this - WARNING: be wary of rip-offs!!indiehackers.commicroconf.com00:00 Not a get-rich-quick scheme01:20 Who this is for - or not. (Hint: for Developers)02:01 Why I'm making this video03:53 Why you should consider it now07:24 Pivoting: how ideas become projects08:28 Where AI comes in09:24 Why this isn't quick: trading time for money09:35 Don't quit your day job10:57 More videos on this topic to come11:24 Books to get you started11:37 Learn about A/B Testing12:04 Example online communities
AI Coding Comparison Challenge. 4 AIs build an HTTP Server in Python. See how they do. Internet of Bugs 2024-09-06 | Company provided demo videos are awful, and I'm tired of them lying, glossing over errors and hiding what the AIs got wrong.So I made my own. The full, unredacted video is at youtube.com/watch?v=mikK5MoApQM where you can watch everything each AI did right and wrong.This video is a summarization of what happened, what I learned, what the different AIs did well or did poorly, who "won" and what recommendations I have based on these results.If you want to learn more about how Internet Software works, sharpen your skills, and have some fun, you can use this link: https://iob.fyi/CodeCrafters to sign up for CodeCrafters free and if you do decide to upgrade later, you'll get 40% off.00:00 Why this AI demo video is different02:24 The competitors 03:13 Caveat: Current Point in Time. Current versions of products Sept 202403:33 The Challenge06:27 Problem One: "200 OK"07:43 Problem Two: "404 Not Found"09:33 Problem Three: Echo/Request Body10:30 Summary So Far11:25 Problem Four: User-Agent/Headers13:02 Problem Five: Adding a Loop13:15 Problem Six: Returning a File14:10 Discussion of Results15:14 Recommendations15:19 Observations on Companies16:19 Thanks to CodeCrafters.io for the playing field16:34 ClosingMy video on Software Testing in an AI world, mentioned in this video: youtu.be/02FD59whT5AMy video on Devin's Upwork demo: youtu.be/tNmgmwEtoWEMy video on the Claude 3.5 Sonnet coding demo: youtu.be/x0y1JWKSUp0
Code Generation (Not the AI kind): The D.R.Y. meets K.I.S.S. Tool that Time Forgot Internet of Bugs 2024-08-29 | Thanks to @BookOverflowPod for inspiring this video!00:00 The Secret Technique THEY don't want you to know about00:18 K.I.S.S. meets D.R.Y.02:04 Go check out @BookOverflowPod 02:19 The Chapter Removed from The Practical Programmer's 20th anniversary edition02:52 Why THEY (wrongly) think you don't need it anymore04:42 Why this is worth learning06:21 Not getting into Code so I won't lose half the viewers06:46 The Concept08:08 Where to find more InformationBookOverFlow Podcast:bookoverflow.ioPodcast Episode I'm in:youtu.be/GL0EE_cv9T0Audio-Only Versions (If you're so inclined):podcasts.apple.com/us/podcast/book-overflow/id1745257325open.spotify.com/show/5kj6DLCEWR5nHShlSYJI5L?si=b3ee969d69934dadhttps://anchor.fm/s/f5bbb69c/podcast/rssBooks:The Pragmatic Programmer: From Journeyman to Master [First Edition - with good chapter]by Andrew Hunt and David Thomas | Jan 1, 1999amazon.com/Pragmatic-Programmer-Journeyman-Master/dp/020161622XThe Pragmatic Programmer: 20th Anniversary Edition, 2nd Edition: Your Journey to Masteryby David Thomas, Andrew Hunt, et al.amazon.com/Pragmatic-Programmer-journey-mastery-Anniversary/dp/0135957052Code Generation in Actionby Jack Herrington | Jul 1, 2003amazon.com/Code-Generation-Action-Jack-Herrington/dp/1930110979Paul Graham Article on Programming Language Features:paulgraham.com/avg.htmlOpen Source Code Generator Projects:[Not an Endorsement - I haven't used these, but they'll give you an idea of how Code Generation should be implemented. But if they work for you - cool]yellicode.comtelosys.org
AI Coding Crap: More Examples. Claude 3.5 Sonnet Demo & more - with @Proof_news Internet of Bugs 2024-08-13 | AI Generated code is bad. But the demos do their best to hide that fact. Even Claude 3.5 Sonnet, which the company says "raises the industry bar for intelligence" But in their demo video, they gave Claude a REALLY easy problem to fix, it did a lousy job, and their video glossed over the bad parts.But, it's not just Claude. In conjunction with @Proof_news and a new AI tool they've built for creators, I've broken down some different problems that human Software Developers can do, but - despite being trained on all the information and having near total recall - AI's just cannot get right.Video Interview with Proof News about this investigation:youtube.com/watch?v=xmnRpW7psQc 00:00 AI Code is still not good00:45 Work with @Proof_news 01:39 Intro to the Claude 3.5 Sonnet Demo video02:26 Transferring code from video to an editor so I can demo it02:50 What Claude thinks the bug is - and why it's wrong03:45 The 3-character fix Claude missed04:03 But Claude's test code is even worse04:07 Hey, Claude - that's a square, not a circle04:34 Don't test by starting with the answer05:24 Bad demo practices contribute to the hype cycle05:33 Collaborating with @Proof_news06:06 Generalizing from "Claude got this wrong" to "AI's in general get this wrong"06:58 Other kinds of Software problems AI does a poor job of07:51 A classic problem, with a modern solution the AI's can't code09:47 When AI's replace human programmers, this is what is lost10:17 Planning and Estimation - or the lack thereof11:16 AI coders fail at even small stuff, but the AI companies talk big11:58 Companies are probably going to get better at not getting caught in poor demos12:13 More videos about things AI's can't seem to get right12:27 Wrap upLinks:# Video Interview with Proof News about this investigation:youtube.com/watch?v=xmnRpW7psQc # Claude 3.5 Sonnet Coding Demo Videoyoutube.com/watch?v=A598ESCoC70# Source of "raises the industry bar for intelligence" quoteanthropic.com/news/claude-3-5-sonnet# Proof News Resourcesproofnews.orgyoutube.com/watch?v=od9lve4SvqIyoutube.com/watch?v=XZkOcjS5PLMyoutube.com/watch?v=DVRcfNBNKtY&list=PLbMJ7_0Smt89RdLTF6HUsC7HsK8x0uz0G
AI Safety is a scam. Internet of Bugs 2024-08-09 | It's time we stop letting AI companies use "we're the only thing standing between the world and the AIs that are going to kill us all" as an excuse.There are real people being harmed every day by AI. And the companies should be held responsible.Don't let them fool you that "AI Safety" should be about SkyNet. It should be about preventing DeepFake porn and artists having their work, their voices and their likenesses stolen. It's about resume filtering extortion and AI autopilots crashing Teslas and Boeing 737Max's. Don't ever let them forget it.00:00 Is AI *Really* as serious as nuclear war?00:26 Changing the subject01:36 Topic Statement01:43 Disclaimer - the future is impossible to predict perfectly02:48 Perverse Incentives and Moral Hazard04:06 US Government missing the point on AI Safety04:40 The points they missed, that we need to pay attention to05:56 AI is here to stay (in some form)06:19 We can't keep letting them do this07:33 The dumbest way to do what they're claiming they're doing07:57 The Software Development Life Cycles models as they apply to AI10:02 OpenAI doubles down on "Only we can save the world!!!"10:42 The dystopian hellscape we're Actually on track for11:27 Wrap Up.Resources and Links:# "AI Safety" according to the industrysafe.ai/work/statement-on-ai-riskaiimpacts.org/wp-content/uploads/2023/04/Thousands_of_AI_authors_on_the_future_of_AI.pdf# AI harm they don't want to talk aboutnbcnews.com/tech/tech-news/taylor-swift-nude-deepfake-ai-photos-images-rcna135913insideevs.com/news/671861/tesla-autopilot-736-crashes-17-deaths-nhtsanytimes.com/2024/05/20/technology/scarlett-johannson-openai-voice.htmlaxios.com/2018/05/17/google-ai-demo-questionsyoutu.be/tNmgmwEtoWEgeekwire.com/2024/microsoft-ai-engineer-says-company-thwarted-attempt-expose-dall-e-3-safety-problemproofnews.org/how-we-investigated-the-youtube-videos-swiped-to-train-aicnn.com/2021/04/29/tech/nijeer-parks-facial-recognition-police-arrest/index.htmlbloomberg.com/graphics/2024-openai-gpt-hiring-racial-discriminationyoutu.be/NQmN6xSorusmashable.com/article/lapd-warns-that-navigation-apps-are-steering-people-to-neighborhoods-on-firehttps://www.politico.eu/newsletter/ai-decoded/a-dutch-algorithm-scandal-serves-a-warning-to-europe-the-ai-act-wont-save-us-2/mashable.com/article/boeing-737-max-aggressive-risky-aibusinessinsider.com/ai-return-investment-disappointing-goldman-sachs-report-2024-6# US Government proposal for AIwhitehouse.gov/briefing-room/statements-releases/2024/07/26/fact-sheet-biden-harris-administration-announces-new-ai-actions-and-receives-additional-major-voluntary-commitment-on-ai# Software Development Life Cycle (SDLC) researchresearchgate.net/publication/379652502_A_Comprehensive_Review_of_Software_Development_Life_Cycle_methodologies_Pros_Cons_and_Future_Directionsjournals.plos.org/plosone/article?id=10.1371/journal.pone.0264420researchgate.net/publication/319716548_SOFTWARE_DEVELOPMENT_LIFE_CYCLE_SDLC_ANALYTICAL_COMPARISON_AND_SURVEY_ON_TRADITIONAL_AND_AGILE_METHODOLOGY# Baby steps on understanding how to actually understand AIhttps://transformer-circuits.pub/2024/scaling-monosemanticity/index.htmlcdn.openai.com/papers/sparse-autoencoders.pdf# Open AI disbands the team that did the Baby Step understanding paper right above thiswired.com/story/openai-offers-a-peek-inside-the-guts-of-chatgpt# The new, even worse supposed existential AI riskaxios.com/2024/07/25/axios-interview-altman-urges-us-action-to-beat-china-in-ai-race
Crowdstrike Internet Outage: development techniques that could have prevented it. Internet of Bugs 2024-07-22 | In my last video. early last week, we talked about how a study showed that 90% of all catastrophic software failures were caused by poor error handling code.This week let's see if we might be able to think about some event that we might be able to use as an example of poor error handling, and talk about the kinds of endemic problems in our industry that allow such things to happen, and talk about a number of strategies (Seventeen of them, to be specific) that should have been used to prevent this kind of nightmare from happening, but obviously weren't.00:00 Clown (Crowd?) Strike fail00:45 After Channel Intro01:22 What we know happened03:28 Business reasons this can happen06:28 Technical reasons this can happen07:12 Who this video is for07:56 Error Handling techniques08:23 "Works on MY machine!"09:11 Unit Tests are USELESS10:01 Web programmers can learn from this, too11:09 How do you test for this kind of thing?12:12 What if those tests don't catch it?12:59 Phased/Slow Roll-out13:33 Centralized software log collection14:48 Sanity check files before you execute them15:17 Pay attention to weird behavior, don't just "see if it happens again"15:58 Separate high-risk code like parsing new drivers files into a different process16:18 Minimize the code that runs in kernel space, at boot, or with elevated permissions18:15 Why didn't the update get rolled back when the boot failed?19:54 Recap22:26 These skills can't be replaced by A.I.Links:Wikipedia Article on outage (in case you're watching this in the future and don't know which outage we're talking about):en.wikipedia.org/wiki/2024_CrowdStrike_incidentOpen Source group that knows how to rollback a bad update - unlike Microsoft - and how they do it:slimbootloader.github.io/security/firmware-resiliency-and-recovery.htmlMy previous video on Why businesses let this happen:youtube.com/watch?v=hKqqU1J-WXkMy video from Early last week about how "Software Design" should, but doesn't, include Error Handling:youtube.com/watch?v=4xqkI953K6YPaper (and presentation) on how 90% of al catastrophic software failures are caused by poor error handling code:usenix.org/conference/osdi14/technical-sessions/presentation/yuanThumbnail Images from:By Smishra1 - Own work, CC BY-SA 4.0, commons.wikimedia.org/w/index.php?curid=150535443and/orflickr.com/photos/84539227@N00/53867936421
Book Club: A Philosophy Of Software by John Ousterhout. At least its better than Clean Code Internet of Bugs 2024-07-15 | In this edition of Book Club, we talk about A Philosophy of Software Design, 2nd Editionby John K. Ousterhout.It's MUCH better than "Clean Code." But it still leaves a lot to be desired.What's more important,. though, is what this book doesn't say, and what those omissions say about our industry.Links from the video:@coffeecodeandchat podcast I was on:youtube.com/watch?v=f9bO9aTXog0 My video on Clean Code, and why that book is trash:youtube.com/watch?v=8ncQrGuunHYMy video on Software Testing that no one wants to watch:youtube.com/watch?v=02FD59whT5A00:00 A Philosophy of Software Design01:16 Chapter 1 & 202:58 RE: Google and VMWare - LOLOL03:17 Abstractions and what's "important"04:03 Unix and TCP/IP04:55 Classitis05:14 Chapter 10: Error Handling 😡06:34 Second System Syndrome07:02 On comments07:22 Naming and Renaming08:46 More about comments09:17 Chapter 19: Why even bother?10:04 Chapter 20: Design vs Performance11:29 What the book doesn't cover11:51 An industry wide problem12:01 Don't be these guys13:27 Delusions programmers want to believe15:50 The vicious cycle of bugs, willful ignorance and doom16:50 Should you read this book?18:13 Prioritizing your time
AI Hype is completely out of control - especially since ChatGPT-4o Internet of Bugs 2024-06-10 | Now that ChatGPT4o is out, it's time to revisit my previous thoughts on AI, and discuss what might be happening in the future, and what evidence we have of what might happen.00:00 Current brief status of AI03:21 ChatGPT-4o is faster. at least03:30 The Multi-modal interface isn't new04:00 What matters for disruption?04:48 Science and measurement05:46 What counts as evidence?07:54 ChatGPT-4o benchmarks10:39 Psychology of Humans and AI11:28 Dark Patterns12:35 History of AI demos18:40 New article about AI Hype19:54 ConclusionSources from Video have been moved to a pinned comment, since the description field ran out of characters.youtube.com/watch?v=VctsqOo8wsc&lc=UgxfeL871kHWrc5-S154AaABAg
Learning AI, PyTorch and How to Program with Github Copilot, but I HATE Python! Internet of Bugs 2024-05-22 | Being a professional programmer is all about learning new things and keeping up with the changes in technology. Periodically, you have to stop and look around and decide what to learn next.I've been through a dozen or so phases of my career so far, and at present, I've decided to learn more about PyTorch and LLMs. In this video, I'll explain why, what resources I'm using, how having a coding LLM copilot changes the process, how advice I got decades ago makes working with Github CoPilot much more efficient, and thoughts on the future of programming languages.Also some thoughts on how web searching is changing for me (much to the better), how that's impacting my thinking on AI (with help from Steve Jobs) and initial impressions of ChatGPT-4o.00:00 Introduction02:36 Various tech I've used (much abandoned)06:22 How I've decided what to study07:07 Recommendations here not for working on existing codebases07:41 Advice I got on being interruptible vs "In the Zone"10:04 "Literate Programming" is a more formal way of doing it10:45 Literate Programming technique is perfect for working with CoPilot11:16 Clarification - this is NOT sponsored - just stuff I really use11:42 Pros and Cons of using CoPilot/LLM/AI to help you code14:32 Choice of Programming languages (or lack thereof)16:32 Programming Languages are tools - don't get attached16:57 Soon, I expect languages to matter much less17:56 Resources I'm using to learn PyTorch/LLMs18:49 How I recommend learning a new language/framework21:09 My current side project (if you care)22:28 Coursera course on Machine Learning22:33 YouTube Channels I'm learning a lot from:22:43 @3blue1brown 22:58 @AndrejKarpathy 23:14 @borismeinardus 23:46 @ArtemKirsanov 24:06 @MachineLearningStreetTalk 24:34 @Computerphile and @davidbombal (for Dr Mike Pound)24:55 New Web "Search" with perplexity.ai (not sponsored - I just like it)25:34 Changing my mindset on Search Agents vs Search Engines26:17 First impressions of ChatGPT-4o26:26 ChatGPT-4o vs Perplexity.ai26:36 ChatGPT-4o multimodal (disappointing, but at least it's fast)27:45 Wrap upLinks to resources from video:# interruptible programmerstevestreeting.com/2010/09/04/work-2-0# Literate Programmingthenewstack.io/why-literate-programming-might-help-you-write-better-codeblog.bitsrc.io/literate-programming-a-radical-approach-to-writing-code-with-documentation-ebb5dc892cd7 http://web.stanford.edu/group/cslipublications/cslipublications/site/0937073806.shtmlprogramminghistorian.org/en/lessons/jupyter-notebooks#literate-computing # Sprint Internet Project I was on (If you're curious)archive.org/details/SprintInternetPassportadweek.com/brand-marketing/iq-news-sprint-internet-passport-aim-high-end-users-internet-access-race-41121corporate.findlaw.com/contracts/corporate/governance-agreement-sprint-corp-and-earthlink-network-inc.html # Coursera course I'm takingcoursera.org/specializations/machine-learning-introduction # Youtuber resources# 3Blue1Brown Neural Netsyoutube.com/playlist?list=PLZHQObOWTQDNU6R1_67000Dx_ZCJB-3pi# Great channels with learning about LLMs/AI content:youtube.com/@UCXUPKJO5MZQN11PqgIvyuvQ youtube.com/@borismeinardusyoutube.com/@ArtemKirsanov youtu.be/hmtQPrH-gC4 # Comment on my channel where I learned about Artem Kirsanov:youtube.com/watch?v=nkdZRBFtqSs&lc=UgxOLJUBIRuLIsC2bB94AaABAg.A368v-3D9ivA3I7kWnSgPj# Machine Learning Street Talk interview with Deep Learning Expert:youtube.com/watch?v=sJXn4Cl4oww# Comment on my channel where I learned about this Machine Learning Street Talk video:youtube.com/watch?v=UqYSaAuKwjU&lc=UgyLF2aBOdwUXgcc3CN4AaABAg# Videos from Dr Mike Pound - on two different channels he frequentsyoutube.com/watch?v=dDUC-LqVrPUyoutube.com/watch?v=x1TqLcz_ug0# Search tool I've been using lately (not sponsored):perplexity.ai# Source for Steve Jobs Quoteyoutu.be/ptXJjI-l2mk?t=710
Clean Code is bad. What makes code maintainable? part 1 of n Internet of Bugs 2024-05-13 | In my "Top 10 Software Developer Books" video, there was a lot of discussion about "Clean Code."It's horrible. It's based on flawed assumptions, and it makes code harder to maintain. In this video I'm going to talk about some specific examples that Clean Code gets wrong, the workflows it prevents, and a bug that took me days to find that Clean Code's STUPID recommendations can cause.I'll also discuss what "maintainable" really should mean.There's no way I can cover everything wrong with this book (or everything you need to know to write maintainable code) in one video - so expect more of these.00:00 Most "clean coding" advice is bad01:24 "Clean Code" is trash02:13 Thing like "Clean Code" only serve to create arguments02:42 "Maintainable" is judged by people other than the programmer writing it03:25 "Maintainable" code is useful when you do something else for a while and then come back03:35 Code is not read top to bottom like a book05:13 Real programmers read code from the bottom up07:00 "Clean" codebases tend to obfuscate bottom-up reading08:43 Vertical slices of code09:40 Root of much programming advice10:09 Welcome to Whack-A-Mole11:38 Specific Example - Real Bug (details changed, yada yada)14:26 The bad assumption in most coding advice: Bugs are preventable15:28 A bug that's hard to reproduce means the code is bad16:43 The real point of maintainable code17:11 Rant17:55 Wrap up
How Developers might stop worrying about AI taking software jobs and Learn to Profit from LLMs Internet of Bugs 2024-05-06 | Right now, the software industry is kind of stuck, where no one wants to hire non-AI developers because the hype is claiming that all the jobs are about to get replaced by garbage like Devin.But new evidence indicates that the pace of AI growth is slowing down, and that two years of GitHub CoPilot has been creating a 'Downward Pressure on Code Quality.'The future is never certain, but it looks like there's a path for the next few years to be a new boom in software development, and it might start soon.00:00 Intro03:49 Ezra Klein's interview of Anthropic's CEO from April 12th04:06 There are no Exponentials in the real world05:10 Research showing LLMs are reaching the point of diminishing returns06:28 Article on the stagnation of LLM growth06:57 Stanford AI Index Report07:18 Research showing that LLMs are running out of training data07:28 Research on "Model Collapse"08:13 Research showing AI reducing overall Code Quality09:04 Quick Recap09:27 Implications to Software Developers10:56 Parallels to 2008/2009 and the App boom11:44 How and when we might know12:07 Wrap upPapers and references from this video:# The complexity of the human mindmindmatters.ai/2022/03/yes-the-human-brain-is-the-most-complex-thing-in-the-universepsychologytoday.com/us/blog/consciousness-and-beyond/202309/the-staggering-complexity-of-the-human-brain# Ezra Klein's interview of Anthropic's CEOnytimes.com/2024/04/12/podcasts/transcript-ezra-klein-interviews-dario-amodei.html# 3Blue1Brown Video on Logistics and Exponentialsyoutube.com/watch?v=Kas0tIxDvrg# Research showing LLMs are reaching the point of diminishing returnsgarymarcus.substack.com/p/evidence-that-llms-are-reaching-a arxiv.org/pdf/2403.05812paperswithcode.com/sota/multi-task-language-understanding-on-mmlu# Research showing that Data Availability is likely the bottlenecken.wikipedia.org/wiki/Chinchilla_(language_model)lesswrong.com/posts/6Fpvch8RR29qLEWNH/chinchilla-s-wild-implicationsalignmentforum.org/posts/6Fpvch8RR29qLEWNH/chinchilla-s-wild-implications # The 2024 Stanford AI Index Report with section on running out of datahttps://aiindex.stanford.edu/report/# Research showing we're running out of LLM Training Dataepochai.org/blog/will-we-run-out-of-ml-data-evidence-from-projecting-dataset# Research showing "Model Collapse" when training data contains LLM outputarxiv.org/pdf/2305.17493 # Research showing AI Code Generation reducing code qualityvisualstudiomagazine.com/articles/2022/09/13/copilot-impact.aspxvisualstudiomagazine.com/Articles/2024/01/25/copilot-research.aspx gitclear.com/coding_on_copilot_data_shows_ais_downward_pressure_on_code_quality # Release Hype about GPT-5tech.co/news/gpt-5-preview-release-rumors
Freelance Developer Books for building your software consulting business Internet of Bugs 2024-04-30 | By Popular demand, I'm doing a video on Software Freelancing - which may become a series if enough people want that.This video - in order to give you the most information as quickly as possible, is a series of book recommendations for books I've found helpful in the freelancing parts of my career.NOTE: This is NOT a video about software or programming books. This books about the freelancing part (leads, process, business, communication, etc) that you need to know to do that kind of work effectively. These books aren't software/programming specific, and are likely useful to other kinds of freelancers.This video also explains some about how I got into freelancing, and how I lucked into some experiences that won't be available to everyone.00:00 What this video is about01:21 Caveats - Freelancing is difficult02:17 How I got into freelancing - short version03:59 Different kinds of freelancing04:58 Project Based Work05:38 Subcontracting is much like being an employee06:34 Upwork and Fiverr and such sites08:52 Getting freelance jobs is like selling yourself09:45 Most freelancing comes from leads from your network10:18 Books on networking (people/business, not TCP/IP)11:46 Free Agent Nation - about the "Gig Economy"12:36 Two "How-To" Consulting books13:24 You need a book on fiance/taxes for your country14:06 Books about Project Management - estimating for bids18:20 "Back of the Napkin" - client communication19:16 "We Got Fired" - Turning unemployement to your benefit20:42 Wrap upBooks mentioned (some links are to newer editions than the ones I have):amazon.com/Never-Eat-Alone-Expanded-Updated/dp/0385346654amazon.com/Your-Well-Before-Youre-Thirsty/dp/0385485468amazon.com/Free-Agent-Nation-Working-Yourself/dp/0446678791amazon.com/Getting-Started-Consulting-Alan-Weiss/dp/1119542154amazon.com/Flawless-Consulting-Guide-Getting-Expertise/dp/1394177305amazon.com/Managing-Projects-Microsoft-Project-4-0/dp/0442017685amazon.com/Managing-Projects-Microsoft-Project-2000/dp/0471397407amazon.com/Effective-Project-Management-Traditional-Extreme/dp/1119562805amazon.com/Essentials-Finance-Accounting-Nonfinancial-Managers/dp/0814436943amazon.com/Back-Napkin-Expanded-Problems-Pictures/dp/1591842697amazon.com/We-Got-Fired-Thing-Happened/dp/0345471865Alternatives to Microsoft Project for planning and estimation:OmniPlan for the Mac (What I use and Prefer these days):omnigroup.com/omniplanFree/OpenSource/CrossPlatform:ProjectLibre:projectlibre.com/product/1-alternative-microsoft-project-open-sourceOpenProject Community Edition:openproject.org/community-edition
Top 10 Programming Books-Dead Tree Edition: Internet of Bugs Book Club + I prove(?) Im not AI!! Internet of Bugs 2024-04-26 | As requested: This is volume one of my programming book recommendations: Dead Tree Edition: The 10 books (or book categories) that have been the most valuable to me over the last 35 years:00:00 Intro00:43 Channel Intro00:53 Book Relocation and proof(?) I'm not an AI...02:34 The Pragmatic Programmer by Andrew Hunt and Bob Thomas03:40 The Mythical Man-Month by Fred Brooks04:20 Working Effectively with Legacy Code by Michael Feathers04:42 SQL for Smarties by Joe Celko05:39 Get a book on Assembler for your processor of choice06:44 Get a textbook on Algorithms you can look stuff up in07:46 Transaction Processing by Jim Gray and Andreas Reuter 09:05 TCP/IP Illustrated Volume 1 by W Richard Stevens10:35 Advanced Programming in the Unix Environment by W Richard Stevens11:56 Firewalls and Internet Security by Cheswick and Bellovin13:39 Find the new technology (LLMs?) for your time that Firewalls were for me, and learn it.14:49 The theme: Learn the underlying tech your code lives on, not just the surface level16:52 Sign offBooks (in no particular order - mostly):amazon.com/Pragmatic-Programmer-journey-mastery-Anniversary/dp/0135957052amazon.com/Mythical-Man-Month-Software-Engineering-Anniversary/dp/0201835959amazon.com/Working-Effectively-Legacy-Michael-Feathers/dp/0131177052amazon.com/Joe-Celkos-SQL-Smarties-Programming/dp/0128007613amazon.com/x64-Assembly-Language-Step-Step/dp/1394155247amazon.com/Introduction-Algorithms-fourth-Thomas-Cormen/dp/026204630Xamazon.com/Transaction-Processing-Concepts-Techniques-Management/dp/1558601902amazon.com/TCP-Illustrated-Vol-Addison-Wesley-Professional/dp/0201633469amazon.com/Advanced-Programming-UNIX-Environment-3rd/dp/0321637739amazon.com/Firewalls-Internet-Security-Repelling-Hacker/dp/020163466X
Ai Agents will be coming for your Internet. And everyone elses. Will you be ready? Can you be? Internet of Bugs 2024-04-19 | We don't have to wait for SkyNet. We don't even have to wait for AGI. The generative AI Large Language Models that we have right now are plenty powerful enough to wreck the Internet when combined with existing social media, ubiquitous video, and a twist.There's about to be a war. Not a "Robots Kill All Humans" war, but an "iPhone vs Android" war: and it's for who gets to have the winning AI Agent. And what those Agents will be able to do... They might not be as scary as the Agents from The Matrix, but they'll be bad enough, and they're a billion billion times more likely.And if the Agent's capabilities weren't sufficiently frightening already - in a race to be first to market, the winner is *always* the Bugs. Careless people write exploitable code, rushing makes people careless, and incentives make people rush. If we're not careful, this is going to be a nightmare...00:00 Intro01:37 Channel Intro01:58 List of components03:52 Phase 1: Al Agents05:21 Phase 2: Add Video07:15 Phase 2b: JOI08:04 Phase 2c: Checkpoint10:17 Phase 3: Don't Google This11:33 Phase 3b: Enter Biometrics12:16 Now with even less reality13:14 Viral Conspiracy Hallucinations13:54 The two corners15:22 In the race to be first, the Bugs Always Win!!15:53 A bright side? Maybe not?UPDATE: I did't see this until after I posted this video, but this dropped in the last couple of days (assuming it isn't faked):microsoft.com/en-us/research/project/vasa-1Things are moving fast...# Links from the video:## Warning about AI Agentsvox.com/future-perfect/24114582/artificial-intelligence-agents-openai-chatgpt-microsoft-google-ai-safety-risk-anthropic-claude# Rise of Videopewresearch.org/short-read/2023/11/15/more-americans-are-getting-news-on-tiktok-bucking-the-trend-seen-on-most-other-social-media-sites# ChatGPT leaks data if you ask it to repeat stupid thingsnot-just-memorization.github.io/extracting-training-data-from-chatgpt.htmlarxiv.org/abs/2311.17035404media.co/asking-chatgpt-to-repeat-words-forever-is-now-a-terms-of-service-violation# Cool game with blinking as a control schemebeforeyoureyesgame.com# AI-generated videoopenai.com/soraengadget.com/tcls-first-original-movie-is-an-absurd-looking-ai-generated-love-story-154142740.html# CAREFUL WITH THESE: You can't unsee or unlearn what you might see or learn here.# GREAT reporting - disturbing topics:vice.com/en/contributor/samantha-cole404media.co/author/samantha-cole
Myth of the 10x Developer: Technical Interviews are Broken, (part 2 of n) Internet of Bugs 2024-04-16 | One of the reasons the code-test LeetCode HackerRank style interview process started was because of the myth that there were 10x developers, and that, by interviewing well, you could fill your big tech company with just those top performers.And that's how we got here.And, chances are, most companies will stay here.But, if your company interviews differently, then in my experience, you can get a huge productivity advantage.00:00 Video Intro00:20 Channel Intro00:34 Categories of programmers for our purposes04:16 The Original. Flawed, 1960s Experiment06:00 A few truths underlying the myth07:48 Context for the argument in the video08:29 My argument against 10x developers in corp settings09:49 Not a skill issue, and not something LeetCode can detect12:00 What LeetCode might select for at many companies13:03 The advantage companies can have without LeetCode14:21 A better focus, according to me, not that it will matter16:03 This one neat trick for better productivity17:28 Back full circle to where we startedLinks from the video:The Mythical Man Month:en.wikipedia.org/wiki/The_Mythical_Man-MonthGreat book - highly recommended. I didn't talk much about it in this video, but i'm sure it will come up in the future.Original Paper that used toy programs to invent the 10x myth:https://web.eecs.umich.edu/~weimerw/481/readings/productivity-performance.pdfModern paper dispelling the 10x myth:https://insights.sei.cmu.edu/blog/programmer-moneyball-challenging-the-myth-of-individual-programmer-productivity/
Tech Interviewing is Broken (Part 1 of n), How we got here and why were still stuck here. Internet of Bugs 2024-04-14 | Tech Interviewing is so broken. My first dry run at this topic clocked in at 73 minutes, so it's getting chopped into several videos.This video talks about how interviewing is broken, and some of the history about how we got here, why companies KEEP interviewing like we do even though they should know better, and a bit of job hunting advice - to go along with the last jobs video I made at youtu.be/NQmN6xSorus Remember - no politics in the comments, or I'll delete them.00:00 Intro00:18 I am not trying to sell you anything related to this video02:00 Advice for job seekers on how not to get ripped off03:30 Book recommendation 04:29 What I do spend money on in between jobs05:38 My Amazon Interviewing experience10:04 My history/experience with 35 years of professional interviewing12:43 My opinion on the effectiveness of companies that use LeetCode interviews14:36 Live whiteboard coding and take home tests have roughly the same effectiveness15:24 How did we get here?20:32 Why do companies keep doing this?25:52 Consequences for companies of this poor interview process28:43 Somewhat off-topic rant I couldn't bring myself to cut out29:47 Choices while job hunting30:36 SignoffLinks from the video:#Book about Microsoft's STUPID old hiring methods that started this whole nightmare:amazon.com/How-Would-Move-Mount-Fuji/dp/0316778494# Origins of "SuperStar Candidate" obsessions, as well as Stack Overflow:joelonsoftware.com/2006/10/25/the-guerrilla-guide-to-interviewing-version-30thenewstack.io/joel-spolsky-on-stack-overflow-inclusion-and-how-he-broke-it-recruiting# Note: I do not believe in the concept of a Super Star candidate. Subscribe and stay tuned for my upcoming video, tentatively titled "The Myth of the 10x Developer"# This article from 2007 was SO dumb, but everyone teated it like Gospel.web.archive.org/web/20080430105038/http://imranontech.com/2007/01/24/using-fizzbuzz-to-find-developers-who-grok-coding# Interviews do no correlate with job performance, says GOOGLE, in 2013:nytimes.com/2013/06/20/business/in-head-hunting-big-data-may-not-be-such-a-big-deal.html ("what they scored the candidate, and how that person ultimately performed in their job. We found zero relationship. It’s a complete random mess")The book I would actually recommend for job seekers (you can probably find it used):parachutebook.com
Debunking Devin: First AI Software Engineer Upwork lie exposed! Internet of Bugs 2024-04-09 | Recently, Devin the supposed "First AI Software Engineer" was announced. The company lied and said that their video showed Devin completing and getting paid for freelance jobs on Upwork, but it didn't show that at all.UPDATE!!: The original job poster of the Upwork task has made his own video!! Go watch it here: youtube.com/watch?v=xE2fxcETP5E ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^I'm not kidding! Go watch the original poster's video! I broke down the Devin Upwork video frame by frame, and here I show what Devin was supposed to do, what it actually managed to do instead, and how bad a job of that it did.On the whole that's not surprising given the current state of Generative AI, and I wouldn't be bothering to debunk it, except:1) The company lied about what Devin could do in the video description, and2) a lot of people uncritically parroted the lie all over the Internet, and 3) That caused a lot of non-technical people to believe that AI might replace programmers soon.00:00 Intro00:30 The claim and the problem03:47 What the job actually would have required05:50 Requirements that needed to be determined07:32 How a human compensates for Upwork's lack of RFP process10:11 What Devin did instead, and how poorly13:03 Devin seems to be fixing code from Github14:19 But Devin is actually making up errors, and then fixing them15:40 All Devin had to do was run the command from the README16:23 But Devin couldn't figure that out16:26 So it created this nightmare 'C'-style low-level buffer append loop in Python17:25 My replication of what Devin tried to do18:15 It took me about 36 minutes20:16 It took Devin at least six hours, and maybe more than a day20:48 more bad Devin code22:08 List of useless things that make Devin look competent23:48 Conclusion, and a PleaVideo falsely claiming "Watch Devin make money taking on messy Upwork tasks!" that I'm debunking:youtube.com/watch?v=UTS2Hz96HYQRaw, uncut, boring video of me replicating Devin's results in 1/12th the time: youtu.be/TMl_82eavHoMy video about communication being the most important part of software work: youtu.be/7-f7rPdj6tI My video about why Devin isn't really a "Software Engineer":youtu.be/Mj6zQUWw6j4
How Testing Software will need to change in an AI-driven World Internet of Bugs 2024-04-02 | As the use of Generative AI as a tool proliferates, the amount of code that will need tests will dramatically increase, and the quality of that code will go down. Generative AIs like Devin or ChatGPT won't be able to replace Software Engineers. They will however, both make us more productive and make more work for us.The best book I know on Software testing is "Working Effectively with Legacy Code"by Michael Feathers (informit.com/store/working-effectively-with-legacy-code-9780131177055). Unfortunately, it was written in 2005, and the techniques that were best practices then just aren't going to cut it in a world writing code at an AI-driven pace.00:00 Intro04:16 Flashback to NetSpend -200006:31 Book recommendation, with reservations08:37 These Days We Can Do Better11:41 Developers Need to Do Better, too15:35 What about Ul Tests?16:27 The new minimum standard20:55 The Challenge25:07 Recap27:09 Until next time...
AGILE & Scrum Failures stuck us with AI hype like Devin Internet of Bugs 2024-03-28 | How did we get to the point where so many people believe that an "AI" like Devin will completely replace the jobs of most, if not all, Software Engineers? Why is the work of Software Development so poorly valued?The question here isn't "is it true Devin could replace Software Engineers?" Because it can't, and I already made a video on that.The question here is: "Why is it so easy for people do believe it could?" and "What does that mean for the future employment of Software Developers in a pervasive-LLM world?"I think I have an answer, and, just like much of the problems we've had in the last 20 years, it all starts with AGILE's failures.00:00 Intro & Question00:30 The 1990s and Gantt Charts00:55 Extreme Programming01:44 Branding FAIL01:53 AGILE Manifesto02:15 Scrum Alliance03:14 Perception of term "Engineer" 03:55 Perception of term "Software Engineer"04:34 What do people think Software Engineers do?05:21 What can we start doing about it?Links from the video:Extreme Programming (XP):http://www.extremeprogramming.orghttp://www.extremeprogramming.org/rules.htmlAGILE Manifesto"agilemanifesto.orgScrum:scrum.org/resources/introduction-scrum-eventsthedigitalprojectmanager.com/projects/pm-methodology/scrum-ceremonies-made-simpleStochastic Parrot:dl.acm.org/doi/pdf/10.1145/3442188.3445922LLMs helping to Document Software:arxiv.org/pdf/2310.16673.pdfEngineer Sample Deliverables:projectengineer.net/25-example-project-deliverables NOTE: (Not that anyone will read this, but) When this video uses the term "AI." it (like most of the current discourse these days) means current and near future "Generative AI" a.k.a. Large Language Models. If you're thinking about the Agents from the Matrix or the Robots from Terminator, that's DIFFERENT. That's the OTHER AI, the Human-Intelligence General AI, Sometimes called "AGI." That DOES NOT EXIST. For the time being it's PURE FICTION. It may get here soon, although I (and a lot of people smarter than me) seriously doubt it, but we'll see.
5 new Software Engineer Jobs that AI will make (that arent for ML specialists) Internet of Bugs 2024-03-22 | Not only with "AI" LLMs like Devin not take all the Developer Jobs, but there will be new Software Engineering opportunities made by "AI" in the future. And i'm not talking about "AI" Jobs like Machine Learning Experts. These are jobs for Existing Developers and Software Engineers living in a world full or ChatGPT and Claude and Gemini.Don't believe the hype about there being no human programmers left in five years. "AI" Models are software, and ALL SOFTWARE HAS BUGS, and with bugs come opportunities.Chapters:00:00 Intro01:57 Number One: New Startups02:02 Number One Part 1: No-Code Web History03:45 Number One Part 2: LLM Startups, Likewise05:24 Number Two: Automation created more products08:20 Number Three: Customizing LLM Models10:15 Lora and ControlNet Demo11:19 Number Four: Debugging LLM Generated Code12:23 Number Four Part 1: What was it thinking?15:23 Number Four part 2: Regression Bugs16:37 Number Four part 3: LLMs have Bugs in their own code17:30 Part Five: Adversarial Attacks20:12 Adversarial Attack Examples20:31 Hope that wasn't depressing, too.20:39 SignOffLinks from the video:For more on ComfyUI/StableDiffusion (This guy is great):youtube.com/@sedetweilerPaper on LoRAs: huggingface.co/papers/2106.09685Info on ControlNets: docs.nvidia.com/nemo-framework/user-guide/latest/multimodalmodels/controlnet/index.htmlDebugging Quote: en.wikiquote.org/wiki/Brian_KernighanTop 25 worst kinds of bugs: cwe.mitre.org/top25/archive/2023/2023_top25_list.htmlThe design that allowed for buffer overflow bugs:infoq.com/presentations/Null-References-The-Billion-Dollar-Mistake-Tony-HoareAnd these are the kinds of bugs that will make Buffer Overflows seem like child's play:vox.com/future-perfect/2019/4/8/18297410/ai-tesla-self-driving-cars-adversarial-machine-learningwired.com/story/tesla-speed-up-adversarial-example-mgm-breach-ransomwaretechnologyreview.com/2019/04/01/65915/hackers-trick-teslas-autopilot-into-veering-towards-oncoming-trafficopenai.com/research/attacking-machine-learning-with-adversarial-exampleswired.com/story/ai-adversarial-attackspcmag.com/news/this-silly-attack-reveals-snippets-of-chatgpts-secretive-source-dataNOTE: (Not that anyone will read this, but) When this video uses the term "AI." it (like most of the current discourse these days) means current and near future "Generative AI" a.k.a. Large Language Models. If you're thinking about the Agents from the Matrix or the Robots from Terminator, that's DIFFERENT. That's the OTHER AI, the Human-Intelligence General AI, Sometimes called "AGI." That DOES NOT EXIST. For the time being it's PURE FICTION. It may get here soon, although I (and a lot of people smarter than me) seriously doubt it, but we'll see.
Software Engineers REAL problem with AI and Jobs Internet of Bugs 2024-03-19 | "AI" isn't going to replace all developer, programming or software engineer jobs. Devin is not an "AI Software Engineer" at all, much less the first one.But "AI" is destroying developer jobs in another way. It's making it almost impossible for competent software engineers to have their resumes seen by hiring managers by flooding all the programming job postings with ChatPGT-generated spam cover letters and auto-submitted resumes with buzzwords added to match the job posting list. And it's doing that hundreds of times an hour.You can't beat the "AI" at job postings, so the best thing to do is go back to the old ways. At least until the industry figures out how to get around the job posting nightmare AI has created for us.Let me tell you how we used to do it, and what I'm guessing we'll fall back on for the time being, and I'll give you some advice from someone who has been doing this a long time.Links mentioned in video:forbes.com/sites/jodiecook/2023/12/08/outsmarting-ai-the-new-challenge-for-job-seekers-and-employers/?sh=3dea19275a91theconversation.com/computer-says-no-more-employers-are-using-ai-to-recruit-increasing-the-risk-of-discrimination-218598linkedin.com/feed/update/urn:li:activity:7171609999943647232/?updateEntityUrn=urn%3Ali%3Afs_feedUpdate%3A%28V2%2Curn%3Ali%3Aactivity%3A7171609999943647232%29Although you can just do a google search:google.com/search?q=ai+job+postings+ruining+hiring+recruitment+job+searchNOTE: (Not that anyone will read this, but) When this video uses the term "AI." it (like most of the current discourse these days) means current and near future "Generative AI" a.k.a. Large Language Models. If you're thinking about the Agents from the Matrix or the Robots from Terminator, that's DIFFERENT. That's the OTHER AI, the Human-Intelligence General AI, Sometimes called "AGI." That DOES NOT EXIST. For the time being it's PURE FICTION. It may get here soon, although I (and a lot of people smarter than me) seriously doubt it, but we'll see.
No, Devin is not a Software Engineer. but it *is* really cool. Internet of Bugs 2024-03-13 | An experienced software engineer's take on @Cognition-Labs's new "Devin" offering. It's not really a Software Engineer, for reason's I'll explain. It's a tool, but it's a really cool ai tool, and I look forward to using it and other LLM code generation and problems solving tools like it.But I'm not worried about it replacing all software engineering jobs. And you shouldn't worry about the question of "can ai replace software engineers?" either.NOTE: (Not that anyone will read this, but) When this video uses the term "AI." it (like most of the current discourse these days) means current and near future "Generative AI" a.k.a. Large Language Models. If you're thinking about the Agents from the Matrix or the Robots from Terminator, that's DIFFERENT. That's the OTHER AI, the Human-Intelligence General AI, Sometimes called "AGI." That DOES NOT EXIST. For the time being it's PURE FICTION. It may get here soon, although I (and a lot of people smarter than me) seriously doubt it, but we'll see.
Could AI replace all programmers in 5 years? Internet of Bugs 2024-03-09 | * Educated, professional explanation of the state of the benchmarks used to test Generative AI code generation.* What those benchmarks do (or don't) tell us about the gap between LLMs and programmer jobs.* Advice about what traditional programmers should focus on in the next year or two. Links from the video:Article with benchmarks for a new LLM with supposedly "Near Human Abilities" (LOL):arstechnica.com/information-technology/2024/03/the-ai-wars-heat-up-with-claude-3-claimed-to-have-near-human-abilitiesHumanEval Benchmark:github.com/openai/human-evalgithub.com/openai/human-eval/blob/master/data/HumanEval.jsonl.gzMIT Intro to Python class (for comparison:https://ocw.mit.edu/courses/6-189-a-gentle-introduction-to-programming-using-python-january-iap-2011/https://ocw.mit.edu/courses/6-189-a-gentle-introduction-to-programming-using-python-january-iap-2011/pages/assignments/https://ocw.mit.edu/courses/6-189-a-gentle-introduction-to-programming-using-python-january-iap-2011/resources/mit6_189iap11_final_proj/CEO of Stability AI claiming "No (Human) Programmers in Five Years" (LOL):decrypt.co/147191/no-human-programmers-five-years-ai-stability-ceoMy video on Incentives for managers in Software:youtube.com/watch?v=hKqqU1J-WXkNOTE: (Not that anyone will read this, but) When this video uses the term "AI." it (like most of the current discourse these days) means current and near future "Generative AI" a.k.a. Large Language Models. If you're thinking about the Agents from the Matrix or the Robots from Terminator, that's DIFFERENT. That's the OTHER AI, the Human-Intelligence General AI, Sometimes called "AGI." That DOES NOT EXIST. For the time being it's PURE FICTION. It may get here soon, although I (and a lot of people smarter than me) seriously doubt it, but we'll see.
Software is bad, and its been getting worse. But its still worth doing. Internet of Bugs 2024-03-04 | Welcome to the Internet of Bugs.I've been a software professional for 35 years, and I'm the father of a child who is now a College Freshman majoring in Computer Science.I started this channel to answer the questions I've been getting recently from College CS students about what a career in computing is like.Maybe someone else will find it useful, too.Link for data for bug count graph (Retrieved Feb 2024):cve.org/About/Metrics
AI wont replace all programmers. Weve heard this before. Internet of Bugs 2024-03-04 | Generative AI won't replace all programmers. These panics happen every few years, and Generative AI isn't any more likely to replace all the programmer jobs than the many previous things. Here's the story of what was supposed to kill the IT industry in 2000-2004, what actually happened, why that situation is similar to today's, and why surviving that one can give us confidence we'll survive this one.References from this video:Ridiculous "No programmers in 5 years" quote:youtu.be/ciX_iFGyS0M?t=830Forrester Research forecast from 2002 about millions of jobs being "lost":forrester.com/about-us/forrester-timeline/#year2000cnet.com/culture/study-supports-controversial-offshore-numberscomputerworld.com/article/2564099/more-it-jobs-to-go-offshore--controversial-itaa-report-says.htmlBad "advice" for programmers who want to remain employed from 2004:computerworld.com/article/2563305/how-to-prevent-offshoring-from-taking-your-job.htmlArticle about robotaxi accident, and how the "AI" made the situation worse:reuters.com/business/autos-transportation/how-gms-cruise-robotaxi-tech-failures-led-it-drag-pedestrian-20-feet-2024-01-26NOTE: (Not that anyone will read this, but) When this video uses the term "AI." it (like most of the current discourse these days) means current and near future "Generative AI" a.k.a. Large Language Models. If you're thinking about the Agents from the Matrix or the Robots from Terminator, that's DIFFERENT. That's the OTHER AI, the Human-Intelligence General AI, Sometimes called "AGI." That DOES NOT EXIST. For the time being it's PURE FICTION. It may get here soon, although I (and a lot of people smarter than me) seriously doubt it, but we'll see.
Programmers Worst Problem in 2024 (for professional Software Engineers) Internet of Bugs 2024-03-04 | This is the biggest problem with being a software professional in early 2024. It's not "AI", it's not layoffs, and it's not even Microsoft (although I use them as an illustration in this video).Links to articles used in this timeline:npr.org/2023/07/12/1187208383/china-hack-us-government-microsofttechcrunch.com/2023/07/17/microsoft-lost-keys-government-hackedsecurityweek.com/us-senator-wyden-accuses-microsoft-of-cybersecurity-negligencesecurityweek.com/microsoft-ai-researchers-expose-38tb-of-data-including-keys-passwords-and-internal-messagesbleepingcomputer.com/news/security/microsoft-exchange-gets-better-patch-to-mitigate-critical-bugtomshardware.com/software/windows/34-windows-device-drivers-vulnerable-to-exploits-that-grant-full-system-controlbleepingcomputer.com/news/microsoft/russian-hackers-exploiting-outlook-bug-to-hijack-exchange-accountstech.co/news/microsoft-outlook-update-exploitnytimes.com/2024/01/19/technology/microsoft-executive-emails-hacked.htmlcyberscoop.com/microsoft-critics-accuse-the-firm-of-negligence-in-latest-breach404media.co/ai-generated-taylor-swift-porn-twitter404media.co/email/ed513582-08d4-44d0-b54d-9f5aac5de354thestatesman.com/business/microsoft-ends-week-with-3-125-tn-mcap-becomes-most-valuable-company-ever-1503268556.htmlNumber of bugs is increasing dramatically (retrieved Feb 2024):cve.org/About/MetricsEncryption regulation change from the 1990s:en.wikipedia.org/wiki/Export_of_cryptography_from_the_United_States
