Tools like #chatgpt & github #copilot can help debug complex code and replace Googling + Stack Overflowing for common scripting.
Key skill: ChatGPT prompting (more on this in my free ChatGPT for Data Scientists)
2. Code Quality & Documentation
Great products have great documentation. AI can help produce documentation, comment code, and replace time-consuming manual documentation with automated AI docs.
🚨BREAKING: New Python library for agentic data processing and ETL with AI
Introducing DocETL.
Here's what you need to know:
1. What is DocETL?
It's a tool for creating and executing data processing pipelines, especially suited for complex document processing tasks.
It offers:
- An interactive UI playground
- A Python package for running production pipelines
2. DocWrangler
DocWrangler helps you iteratively develop your pipeline:
- Experiment with different prompts and see results in real-time
- Build your pipeline step by step
- Export your finalized pipeline configuration for production use