Jian Tang Profile picture
Jan 21 8 tweets 4 min read
Five papers have been accepted to #ICLR2013 in my group (including one oral presentation), covering topics from combining pretrained LMs with GNNs, deep generative models and pretraining methods for drug discovery.
1) An oral presentation. We proposed an effective and efficient method for combining pretrained LLMs and GNNs on large-scale text-attributed graphs via variational EM. The first place on 3 tasks of node property prediction on OGB leaderboards.

Paper: openreview.net/pdf?id=q0nmYci….
2) An end-to-end diffusion model for protein sequence and structure co-design, which iteratively refines sequences and structures through a denoising network.

Paper: openreview.net/pdf?id=pRCMXcf…
3) An encoder-decoder framework for protein-ligand docking. An encoder is used to encode the representations of protein 3D structure and molecular graph and their interactions, and a diffusion network for predicting the complex structure.

Paper: openreview.net/pdf?id=sO1QiAf…
4) We pretrained a geometry protein encoder based on the experimental structures in PDB and the predicted structures by AlphaFold 2. It outperforms the sequence-based pretraining methods with protein LMs.

Paper: openreview.net/pdf?id=to3qCB3…
5) We proposed a SE(3)-invariant denoising score matching approach for pretraining molecular geometry representation. State-of-the-art performance on existing molecular pretraining benchmarks.
Oops, should be #ICLR2023

• • •

Missing some Tweet in this thread? You can try to force a refresh
 

Keep Current with Jian Tang

Jian Tang Profile picture

Stay in touch and get notified when new unrolls are available from this author!

Read all threads

This Thread may be Removed Anytime!

PDF

Twitter may remove this content at anytime! Save it as PDF for later use!

Try unrolling a thread yourself!

how to unroll video
  1. Follow @ThreadReaderApp to mention us!

  2. From a Twitter thread mention us with a keyword "unroll"
@threadreaderapp unroll

Practice here first or read more on our help page!

More from @tangjianpku

Oct 6, 2021
Five papers related to GNNs are accepted to #NeurIPS2021 in my group, ranging from knowledge graph reasoning, drug discovery, scene graph generation and algorithmic reasoning. Congrats to all my students and collaborators.
1) Zhu et al. Neural Bellman-Ford Networks: A General Graph Neural Network Framework for Link Prediction. arxiv.org/abs/2106.06935

A state-of-the-art algorithm for link prediction based on GNNs in both transductive and inductive settings.
2) Luo and Shi et al. Predicting Molecular Conformation via Dynamic Graph Score Matching.

A new approach for molecular conformation generation by modeling both short- and long-range interactions between atoms.
Read 6 tweets

Did Thread Reader help you today?

Support us! We are indie developers!


This site is made by just two indie developers on a laptop doing marketing, support and development! Read more about the story.

Become a Premium Member ($3/month or $30/year) and get exclusive features!

Become Premium

Don't want to be a Premium member but still want to support us?

Make a small donation by buying us coffee ($5) or help with server cost ($10)

Donate via Paypal

Or Donate anonymously using crypto!

Ethereum

0xfe58350B80634f60Fa6Dc149a72b4DFbc17D341E copy

Bitcoin

3ATGMxNzCUFzxpMCHL5sWSt4DVtS8UqXpi copy

Thank you for your support!

Follow Us on Twitter!

:(