NAPS

Natural Program Synthesis Dataset

What is NAPS?


NAtural Program Synthesis Dataset is a dataset of natural language descriptions of problems and programs solving them. The problem statements were collected via crowdsourcing and the program solutions were extracted from human-written solutions in programming competitions, accompanied by input/output examples. We propose using this dataset for the program synthesistasks aimed for working with real user-generated data.

NAPS paper (Zavershynskyi et al. '18)

Getting Started


We've built a few resources to help you get started with the dataset.

Download dataset

For baseline models, evaluation and other tools check out GitHub.

Program Synthesis - NAPS

Have questions?


Ask us questions at contact@near.ai

Leaderboard

ModelAcc50% Acc
Seq2Tree

NEAR.ai

(Zavershynskyi et al. '18)
8.811.2
Seq2Seq4.77.0