Skip to content
Navigation menu
Search
Powered by Algolia
Search
Log in
Create account
DEV Community
Close
#
tokenizer
Follow
Hide
Posts
Left menu
👋
Sign in
for the ability to sort posts by
relevant
,
latest
, or
top
.
Right menu
The Hidden Cost of Making AI Speak Indian Languages
Gnananvesh reddy
Gnananvesh reddy
Gnananvesh reddy
Follow
Sep 19
The Hidden Cost of Making AI Speak Indian Languages
#
ai
#
nlp
#
llm
#
tokenizer
Comments
Add Comment
8 min read
What Actually Gets Tokenized in SFT
Jessie Jia
Jessie Jia
Jessie Jia
Follow
Aug 13
What Actually Gets Tokenized in SFT
#
ai
#
technical
#
sft
#
tokenizer
Comments
1
 comment
7 min read
👋
Sign in
for the ability to sort posts by
relevant
,
latest
, or
top
.
We're a place where coders share, stay up-to-date and grow their careers.
Log in
Create account
