Abhishek Thakur
AutoNLP Preview: Auto model-selection, fine-tuning and deployment of state-of-the-art NLP models
updated
Here's a quick TL;DR of what Arcee Conductor is all about:
🌟 Choice and flexibility: Get access to multiple models, including our powerful SLMs and third-party LLMs, to choose the best one for your specific use case
🤖 Intelligent routing: Our platform evaluates which model is best-suited for each of your queries, ensuring you get the most accurate results
📈 Cost savings: Reduce your AI costs with our affordable SLMs, while still having access to leading LLMs when needed
🚀 Easy to get started: Sign up now and try Arcee Conductor today, with 400 million tokens (a $200 value) on us! 🎁
📊 Proven track record: Our SLMs have already racked up 222K+ downloads on Hugging Face, with customers seeing significant cost savings and improved accuracy
For a limited time, you can get $200 credits to use with Conductor for FREE. Check it out here: conductor.arcee.ai
Please subscribe and like the video to help me keep motivated to make awesome videos like this one. :)
My book, Approaching (Almost) Any Machine Learning problem, is available for free here: bit.ly/approachingml
Follow me on:
Twitter: twitter.com/abhi1thakur
LinkedIn: linkedin.com/in/abhi1thakur
Kaggle: kaggle.com/abhishek
Please subscribe and like the video to help me keep motivated to make awesome videos like this one. :)
My book, Approaching (Almost) Any Machine Learning problem, is available for free here: bit.ly/approachingml
Follow me on:
Twitter: twitter.com/abhi1thakur
LinkedIn: linkedin.com/in/abhi1thakur
Kaggle: kaggle.com/abhishek
You can play with the app here: huggingface.co/spaces/abhishek/sketch-to-image
Please subscribe and like the video to help me keep motivated to make awesome videos like this one. :)
My book, Approaching (Almost) Any Machine Learning problem, is available for free here: bit.ly/approachingml
Follow me on:
Twitter: twitter.com/abhi1thakur
LinkedIn: linkedin.com/in/abhi1thakur
Kaggle: kaggle.com/abhishek
The commands used for training in this video are as follows:
!pip install -U autotrain-advanced
!autotrain setup --update-torch
!autotrain dreambooth \
--model stabilityai/stable-diffusion-xl-base-1.0 \
--output output/ \
--image-path images/ \
--prompt "photo of sks dog" \
--resolution 1024 \
--batch-size 1 \
--num-steps 500 \
--fp16 \
--gradient-accumulation 4 \
--lr 1e-4
On google colab, you can add --use-8bit-adam parameter and change resolution to 512 if you are on free version of google colab.
Inference code:
Please subscribe and like the video to help me keep motivated to make awesome videos like this one. :)
My book, Approaching (Almost) Any Machine Learning problem, is available for free here: bit.ly/approachingml
Follow me on:
Twitter: twitter.com/abhi1thakur
LinkedIn: linkedin.com/in/abhi1thakur
Kaggle: kaggle.com/abhishek
Please subscribe and like the video to help me keep motivated to make awesome videos like this one. :)
My book, Approaching (Almost) Any Machine Learning problem, is available for free here: bit.ly/approachingml
Follow me on:
Twitter: twitter.com/abhi1thakur
LinkedIn: linkedin.com/in/abhi1thakur
Kaggle: kaggle.com/abhishek
AutoTrain Advanced github repo: github.com/huggingface/autotrain-advanced
Steps:
Install autotrain-advanced using pip:
- pip install autotrain-advanced
Setup (optional, required on google colab):
- autotrain setup --update-torch
Train:
autotrain llm --train --project_name my-llm --model meta-llama/Llama-2-7b-hf --data_path . --use_peft --use_int4 --learning_rate 2e-4 --train_batch_size 12 --num_train_epochs 3 --trainer sft
If you are on free version of colab, use this model instead: huggingface.co/abhishek/llama-2-7b-hf-small-shards. This is a smaller sharded version of llama-2-7b-hf by meta.
Please subscribe and like the video to help me keep motivated to make awesome videos like this one. :)
My book, Approaching (Almost) Any Machine Learning problem, is available for free here: bit.ly/approachingml
Follow me on:
Twitter: twitter.com/abhi1thakur
LinkedIn: linkedin.com/in/abhi1thakur
Kaggle: kaggle.com/abhishek
Please subscribe and like the video to help me keep motivated to make awesome videos like this one. :)
My book, Approaching (Almost) Any Machine Learning problem, is available for free here: bit.ly/approachingml
Follow me on:
Twitter: twitter.com/abhi1thakur
LinkedIn: linkedin.com/in/abhi1thakur
Kaggle: kaggle.com/abhishek
Inference Endpoints Docs: huggingface.co/docs/inference-endpoints/index
Please subscribe and like the video to help me keep motivated to make awesome videos like this one. :)
My book, Approaching (Almost) Any Machine Learning problem, is available for free here: bit.ly/approachingml
Follow me on:
Twitter: twitter.com/abhi1thakur
LinkedIn: linkedin.com/in/abhi1thakur
Kaggle: kaggle.com/abhishek
Code: gist.github.com/abhishekkrthakur/401c39d422fb6beff1600effe81f498a
Please subscribe and like the video to help me keep motivated to make awesome videos like this one. :)
My book, Approaching (Almost) Any Machine Learning problem, is available for free here: bit.ly/approachingml
Follow me on:
Twitter: twitter.com/abhi1thakur
LinkedIn: linkedin.com/in/abhi1thakur
Kaggle: kaggle.com/abhishek
For the video, we will be using text-generation-inference: github.com/huggingface/text-generation-inference
And chat-ui: github.com/huggingface/chat-ui
Please subscribe and like the video to help me keep motivated to make awesome videos like this one. :)
My book, Approaching (Almost) Any Machine Learning problem, is available for free here: bit.ly/approachingml
Follow me on:
Twitter: twitter.com/abhi1thakur
LinkedIn: linkedin.com/in/abhi1thakur
Kaggle: kaggle.com/abhishek
For the coding part, we will be using torch, transformers, peft and trl libraries.
For the no-code solution, we will be using autotrain-advanced. You can install autotrain-advanced using pip: "pip install autotrain-advanced"
I'll be using my home machine. No cloud needed!
Please subscribe and like the video to help me keep motivated to make awesome videos like this one. :)
My book, Approaching (Almost) Any Machine Learning problem, is available for free here: bit.ly/approachingml
Follow me on:
Twitter: twitter.com/abhi1thakur
LinkedIn: linkedin.com/in/abhi1thakur
Kaggle: kaggle.com/abhishek
Please subscribe and like the video to help me keep motivated to make awesome videos like this one. :)
My book, Approaching (Almost) Any Machine Learning problem, is available for free here: bit.ly/approachingml
Follow me on:
Twitter: twitter.com/abhi1thakur
LinkedIn: linkedin.com/in/abhi1thakur
Kaggle: kaggle.com/abhishek
Please subscribe and like the video to help me keep motivated to make awesome videos like this one. :)
My book, Approaching (Almost) Any Machine Learning problem, is available for free here: bit.ly/approachingml
Follow me on:
Twitter: twitter.com/abhi1thakur
LinkedIn: linkedin.com/in/abhi1thakur
Kaggle: kaggle.com/abhishek
Check out the Gradio demo here: huggingface.co/spaces/huggingface-projects/QR-code-AI-art-generator
Please subscribe and like the video to help me keep motivated to make awesome videos like this one. :)
My book, Approaching (Almost) Any Machine Learning problem, is available for free here: bit.ly/approachingml
Follow me on:
Twitter: twitter.com/abhi1thakur
LinkedIn: linkedin.com/in/abhi1thakur
Kaggle: kaggle.com/abhishek
The competition is organized by Data Driven Science (datadrivenscience.com)
Competition link: huggingface.co/spaces/competitions/movie-genre-prediction
Please subscribe and like the video to help me keep motivated to make awesome videos like this one. :)
My book, Approaching (Almost) Any Machine Learning problem, is available for free here: bit.ly/approachingml
Follow me on:
Twitter: twitter.com/abhi1thakur
LinkedIn: linkedin.com/in/abhi1thakur
Kaggle: kaggle.com/abhishek
Please subscribe and like the video to help me keep motivated to make awesome videos like this one. :)
My book, Approaching (Almost) Any Machine Learning problem, is available for free here: bit.ly/approachingml
Follow me on:
Twitter: twitter.com/abhi1thakur
LinkedIn: linkedin.com/in/abhi1thakur
Kaggle: kaggle.com/abhishek
#huggingface #nocode #autotrain
---
Please subscribe and like the video to help me keep motivated to make awesome videos like this one. :)
My book, Approaching (Almost) Any Machine Learning problem, is available for free here: bit.ly/approachingml
Follow me on:
Twitter: twitter.com/abhi1thakur
LinkedIn: linkedin.com/in/abhi1thakur
Kaggle: kaggle.com/abhishek
Please subscribe and like the video to help me keep motivated to make awesome videos like this one. :)
My book, Approaching (Almost) Any Machine Learning problem, is available for free here: bit.ly/approachingml
Follow me on:
Twitter: twitter.com/abhi1thakur
LinkedIn: linkedin.com/in/abhi1thakur
Kaggle: kaggle.com/abhishek
Please subscribe and like the video to help me keep motivated to make awesome videos like this one. :)
My book, Approaching (Almost) Any Machine Learning problem, is available for free here: bit.ly/approachingml
Follow me on:
Twitter: twitter.com/abhi1thakur
LinkedIn: linkedin.com/in/abhi1thakur
Kaggle: kaggle.com/abhishek
Demo link will be pasted here when its available
Example image comes from here: github.com/CompVis/latent-diffusion/blob/main/data/inpainting_examples/6458524847_2f4c361183_k.png
#stablediffusion #sam
Please subscribe and like the video to help me keep motivated to make awesome videos like this one. :)
My book, Approaching (Almost) Any Machine Learning problem, is available for free here: bit.ly/approachingml
Follow me on:
Twitter: twitter.com/abhi1thakur
LinkedIn: linkedin.com/in/abhi1thakur
Kaggle: kaggle.com/abhishek
Please subscribe and like the video to help me keep motivated to make awesome videos like this one. :)
#gpt #chatgpt #python
My book, Approaching (Almost) Any Machine Learning problem, is available for free here: bit.ly/approachingml
Follow me on:
Twitter: twitter.com/abhi1thakur
LinkedIn: linkedin.com/in/abhi1thakur
Kaggle: kaggle.com/abhishek
#shorts
Please subscribe and like the video to help me keep motivated to make awesome videos like this one. :)
My book, Approaching (Almost) Any Machine Learning problem, is available for free here: bit.ly/approachingml
Follow me on:
Twitter: twitter.com/abhi1thakur
LinkedIn: linkedin.com/in/abhi1thakur
Kaggle: kaggle.com/abhishek
Transfer learning is a research problem in ML that focuses on storing knowledge gained while solving one problem and applying it to a different but related problem. IT has enabled progress in areas with limited data availability in both CV and NLP domains. Several modern applications of machine learning are built around TL, so it's only natural that people would start thinking about using this approach to time series: while less obvious to formulate (what does it mean to learn time series features across domains), the idea of transfer learning for time series has huge potential. In this notebook we explore the idea in some more detail.
.
.
.
.
.
.
.
The secret is to stop watching these kinds of videos and start learning and doing.
Please subscribe and like the video to help me keep motivated to make awesome videos like this one. :)
My book, Approaching (Almost) Any Machine Learning problem, is available for free here: bit.ly/approachingml
Follow me on:
Twitter: twitter.com/abhi1thakur
LinkedIn: linkedin.com/in/abhi1thakur
Kaggle: kaggle.com/abhishek
Every ML practitioner knows that validation matters: while it is common knowledge for classification and regression models, time series models have received less attention on that front. In this episode we will walk through different manners of assessing performance of time series models without breaking the arrow of time.
Abstract: Time series analysis has both vintage approaches (like ARIMA) and modern ones (LSTM). Over time, many people started mixing the two just to see what would happen - in this umbrella episode we will look at three examples of such hybrid models.
Notebook: kaggle.com/code/konradb/ts-8-hierarchical-time-series
v2
Please subscribe and like the video to help me keep motivated to make awesome videos like this one. :)
My book, Approaching (Almost) Any Machine Learning problem, is available for free here: bit.ly/approachingml
Follow me on:
Twitter: twitter.com/abhi1thakur
LinkedIn: linkedin.com/in/abhi1thakur
Kaggle: kaggle.com/abhishek
Please subscribe and like the video to help me keep motivated to make awesome videos like this one. :)
My book, Approaching (Almost) Any Machine Learning problem, is available for free here: bit.ly/approachingml
Follow me on:
Twitter: twitter.com/abhi1thakur
LinkedIn: linkedin.com/in/abhi1thakur
Kaggle: kaggle.com/abhishek
Join MLSpace Discord for discussions: discord.gg/sb9HFZwKMR
Please subscribe and like the video to help me keep motivated to make awesome videos like this one. :)
My book, Approaching (Almost) Any Machine Learning problem, is available for free here: bit.ly/approachingml
Follow me on:
Twitter: twitter.com/abhi1thakur
LinkedIn: linkedin.com/in/abhi1thakur
Kaggle: kaggle.com/abhishek
Check out the competition here: kaggle.com/datasets/headsortails/notebooks-of-the-week-hidden-gems/discussion/317098
In this talk, Lewis will discuss various techniques you can use to optimize Transformer models for production environments. He will cover knowledge distillation and weight quantization, as well as frameworks like ONNX Runtime.
This talk is based on a chapter from the upcoming O’“Reilly book on “Natural Language Processing with Transformers” — we’ll be giving away 5 copies of the book as part of this event!
If you want to take part in the competition, use this invite link: kaggle.com/t/df24a2b9ddc94bbcad6badeacab7f1f5
Speaker Bio: After finishing his PhD in statistics, Konrad has been crunching numbers for a living for years and have dabbled in just about everything along the way (credit risk analysis, trading commodities, predictive maintenance). These days he leads the central data science team at eClassifiedsGroup (part of Adevinta), where they optimize the e-commerce experience so people actually get what they need, and not merely what they clicked upon
---
Please subscribe and like the video to help me keep motivated to make awesome videos like this one. :)
My book, Approaching (Almost) Any Machine Learning problem, is available for free here: bit.ly/approachingml
Follow me on:
Twitter: twitter.com/abhi1thakur
LinkedIn: linkedin.com/in/abhi1thakur
Kaggle: kaggle.com/abhishek
Instagram: instagram.com/abhi1thakur
Speaker Bio : I studied fundamental mathematics in Paris, and statistics in engineering school. I came across data science by chance, and mostly thanks to Kaggle ! I am currently Kaggle Competitions Master and just starting as Actuary Data Scientist at SCOR. I work on everything statistics-related in the life insurance sector : predicting survival times of cancer patients, etc.
---
Please subscribe and like the video to help me keep motivated to make awesome videos like this one. :)
My book, Approaching (Almost) Any Machine Learning problem, is available for free here: bit.ly/approachingml
Follow me on:
Twitter: twitter.com/abhi1thakur
LinkedIn: linkedin.com/in/abhi1thakur
Kaggle: kaggle.com/abhishek
Instagram: instagram.com/abhi1thakur
Abstract: working with Scikit-optimize (skopt), we program custom procedures in order to suit complex hyper-parameter setting problems, control for time and cost of computation, extension to neural architecture search.
Speaker Bio: Luca Massaron is a Google Developer Expert in machine learning with more than a decade of experience in data science. He is also the author of several best-selling books on AI and a Kaggle master who reached number 7 for his performance in data science competitions.
---
Please subscribe and like the video to help me keep motivated to make awesome videos like this one. :)
My book, Approaching (Almost) Any Machine Learning problem, is available for free here: bit.ly/approachingml
Follow me on:
Twitter: twitter.com/abhi1thakur
LinkedIn: linkedin.com/in/abhi1thakur
Kaggle: kaggle.com/abhishek
Instagram: instagram.com/abhi1thakur
Speaker Bio: Lavanya is the Head of Growth at Weights and Biases, an experiment tracking platform for deep learning. She began working on AI 10 years ago when she founded ACM SIGAI at Purdue University as a sophomore. In a past life, she taught herself to code at age 10, and founded the machine learning startup Dataland. You can find her on twitter: @lavanyaai
---
Please subscribe and like the video to help me keep motivated to make awesome videos like this one. :)
To buy my book, Approaching (Almost) Any Machine Learning problem, please visit: bit.ly/buyaaml
Follow me on:
Twitter: twitter.com/abhi1thakur
LinkedIn: linkedin.com/in/abhi1thakur
Kaggle: kaggle.com/abhishek
Instagram: instagram.com/abhi1thakur
Note: this video is not sponsored by #Kaggle!
Please subscribe and like the video to help me keep motivated to make awesome videos like this one. :)
My book, Approaching (Almost) Any Machine Learning problem, is available for free here: bit.ly/approachingml
Follow me on:
Twitter: twitter.com/abhi1thakur
LinkedIn: linkedin.com/in/abhi1thakur
Kaggle: kaggle.com/abhishek
Bio: Merve is a Machine Learning Engineer at iamyiam, making chatbots for living. She’s also a Google Developer Expert in Machine Learning and a graduate student in data science. Her main research interests are natural language processing and conversational AI.
---
Please subscribe and like the video to help me keep motivated to make awesome videos like this one. :)
To buy my book, Approaching (Almost) Any Machine Learning problem, please visit: bit.ly/buyaaml
Follow me on:
Twitter: twitter.com/abhi1thakur
LinkedIn: linkedin.com/in/abhi1thakur
Kaggle: kaggle.com/abhishek
Instagram: instagram.com/abhi1thakur
Notebook:
Note: this video is not sponsored by #Kaggle!
Please subscribe and like the video to help me keep motivated to make awesome videos like this one. :)
To get my book, Approaching (Almost) Any Machine Learning Problem, for free, please visit: bit.ly/approachingml
Follow me on:
Twitter: twitter.com/abhi1thakur
LinkedIn: linkedin.com/in/abhi1thakur
Kaggle: kaggle.com/abhishek
Notebook: kaggle.com/abhishek/competition-part-5-blending-101
Note: this video is not sponsored by #Kaggle!
Please subscribe and like the video to help me keep motivated to make awesome videos like this one. :)
To get my book, Approaching (Almost) Any Machine Learning Problem, for free, please visit: bit.ly/approachingml
Follow me on:
Twitter: twitter.com/abhi1thakur
LinkedIn: linkedin.com/in/abhi1thakur
Kaggle: kaggle.com/abhishek


