Yes, you can train your own GPT-3 with custome data.

To get started, just run a single command in the OpenAI command line tool with a file you provide. Your custom version will start training and then be available immediately in their API.

Please read the official report here:
https://openai.com/blog/customized-gpt-3/