ð, I'm Vasudev Gupta
Currently,
- I lead the behaviorGPT project at Unbox AI.
- I head the AI & data team at Unbox AI.
- I am a Google Developer Expert in Machine Learning.
You can read more about Unbox AI here.
Past Work / Experience
- I did a Dual Degree (B.Tech. + M.Tech.) from IIT Madras.
- I contributed BigBird (RoBERTA & Pegasus) to HuggingFace Transformers in PyTorch & Jax/Flax. I got featured in HuggingFaceâs newsletter for my contributions to Transformers.
- I was a mentor at Google Summer of Code @TensorFlow for the project titled: âDeveloping NLP examples using HuggingFace Transformersâ.
- I build a package for training the wav2vec2 model in TensorFlow as part of Google Summer of Code 2021. My work was featured in TensorFlow blog post. You can read the final report of my work here.
Open Source Contributions
| Description | Repository | Link |
|---|---|---|
Script for training FlaxBigBird on natural-questions | ð€Transformers | #12233 |
Added Flax/Jax BigBird-RoBERTa | ð€Transformers | #11967 |
Added PyTorch BigBird-Pegasus | ð€Transformers | #10991 |
Added PyTorch BigBird-RoBERTa | ð€Transformers | #10183 |
Integrated Microsoft's DeepSpeed with Accelerate | ð€Accelerate | #82 |
Added ModelHubMixin in Hub | ð€hub | #9 |
| Implement & train Wav2Vec2 model in TensorFlow | thevasudevgupta/gsoc-wav2vec2 | Commits |
| Export fine-tuned Wav2Vec2 model to TFHub | tensorflow/tfhub.dev | #68 |
| Export pre-trained Wav2Vec2 model to TFHub | tensorflow/tfhub.dev | #65 |
| Add notebook for demonstrating Wav2Vec2 fine-tuning | tensorflow/hub | #788 |