Michał Chromiak's blog

About
Categorisation
Contact detail
Links
Resources

Archives for July 2019

Tue, 30 Jul 2019: ERNIE 2.0: A continual pre-training framework for language understanding

About Michał Chromiak
PhD in Computer Science by Polish Academy of Sciences (PAS). Focus research on understanding chaos of data. Deeply understanding the phenomena makes it easy, but first you need to learn. Holds two MScs, in Mathematics and in Computer Science.

Social
- LinkedIn
- GitHub
- Twitter
- ResearchGate
- Google Scholar
- RSS
Recent Posts
- ERNIE 2.0: A continual pre-training framework for language understanding
Categories
Tags
- application
- Attention model
- Autoencoder
- basics
- BERT
- CV
- ELMo
- ERNIE 1.0
- GPT
- k-NN
- language model
- Machine translation
- Markov Decision Process
- MDP
- MLP
- ngram
- NLP
- NMT
- OpenAI GPT
- PatternRecognition
- perplexity
- Reinforcement Learning
- Representation Learning
- RL
- Scalability
- Self-Supervision (SSL)
- seq2seq
- Sequence transduction
- smoothing
- Transformer
- Vision Transformer
- ViT
- Weak-supervision
- WSL
- XLNet
Links
Archive
- July 2019 (1)

© 2019 Michał Chromiak · Powered by pelican-bootstrap3, Pelican, Bootstrap

Content licensed under a Creative Commons Attribution-ShareAlike 4.0 International License, except where indicated otherwise.