Hi guys, I am a TEDx talker and CEO who wants to use AI in my companies BUT I am having a hard time understanding the stuff on this forum - I am not a programmer (although I did code some JS in the 90s).
I am interested in AI chat bots made from TRANSFORMERS like BERT (I think?)
I am already very knowledgeable in GPT3 - i want to make something from scratch and not pay API fees…
Can someone point me in the direction of a turtorial or book for BEGINNERS? Not even coding per se, but what open source AI is (are they all transformers or more?), what is available, what it can do, who i should i hire to work on it, what we can accomplish, how much will that cost, what should i expect? Etc.
If no book or online resource for managers exists, or even if it does, can I pay someone $100 per hour to tutor me on it? Or more if you want, I just need someone to get me grounded here I promise to learn fast!!! and not be a pain
thanks very much for your time! sorry in advance if this is not the right forum for this kind of question
Hi @joshbachynski, I’m not aware of a single resource that has answers to all your questions (especially the ones about who to hire, costs, expectations etc), but here’s a few resources I found useful when trying to grok Transformers at a conceptual level:
The TopBots research summaries. Since you’re interested in chat bots, you could look at the conversational AI section here. They also have a lot of content aimed at enterprises, which might help answer your broader questions
Regarding these questions
what open source AI is (are they all transformers or more?), what is available, what it can do
the short, but incomplete answer is that open source AI/ML is a HUGE ecosystem of libraries and communities (e.g. PyTorch / TensorFlow / HuggingFace / spaCy / fastai / scikit-learn / …) and applications involving Transformers are mostly in the NLP domain, but quickly growing to computer vision, reinforcement learning, and other fields.
Thanks for the offer @joshbachynski but I’m not in a position right now to take on new projects
In the meantime, feel free to post any questions you have in the forum - I don’t think anything is “off-limits” as long as it’s broadly about Transformers / NLP (which raises the chance someone in the community will know the answer).
You posted it a while ago, is the topic still relevant?
I’m not qualified to give you the kind of help you are looking for. I’m new to transformers, although I have 3 years in ML. I am an entrepreneur myself and I totally totally understand your pain. If you are still interested, we can talk. I will not charge you anything. And I might only be useful with some relatively general directions. As I said, I am new to transformers.
Hi @joshbachynski
As an answer to your " GPT3 - i want to make something from scratch and not pay API fees…"
I can suggest a more elegant and free model , namely iPET, as an alternative to GPT3. According to the article, it is more successful than GPT3, and you can train any model you want with very few examples, I mean few shot learning,
I promise to learn fast!!! 