Looks like this is going to be a fun read..expect a summary soon! We got this.
If a self-driving car makes it 90% of the way to the finish line but is washed into a ditch by a rainstorm, it would hardly be appropriate to say that the autonomous car doesn’t work.
Priorities: knowledge first, technology second, opinions third-I use it to help settle disputes in the never-ending battle between the various concerns of every data science project—
for example, software versus statistics, changing business need versus project timeline, data quality versus accuracy of results
Often people are blinded by what they think is possible, and they forget to consider that it might not be possible or that it might be much more expensive than estimated. GUILTY!!!
Some key things to try and incorporate as a DS.
a. Documentation- for future self and others that may work on your project
b. Code repository and versioning.
c. Code organization - Useful especially for Cove re-use
d. Ask questions- from business,Software guys , PMs.
Lastly,
a. Documentation- for future self and others that may work on your project
b. Code repository and versioning.
c. Code organization - Useful especially for Cove re-use
d. Ask questions- from business,Software guys , PMs.
Lastly,
e. Stay close to the data- Sometimes simple algorithm is all you need.
On Project Goals and Client expectations:
A notable difference between many fields and data science is that in data science, if a customer has a wish, even an experienced data scientist may not know whether it’s possible.
A notable difference between many fields and data science is that in data science, if a customer has a wish, even an experienced data scientist may not know whether it’s possible.
Ensuring a data scientist communicate uncertainties to expect in a project should be one of the early TODOs.
Treat goal discussions between a client and yourself as somewhat finding common grounds. Since expectations can be high but may be unrealistic considering many factors.
Sometimes, it is good to lay the foundation of final products on suggestions of what it will look like.
Important to keep and distinguish facts from opinions. Judgements should be based on facts.
You will need to learn how to manage the Salesman claims of your in-development projects, It will offen happen that client will be selling the project in development which you are not even sure will work 100%.
-No one ever wants to declare failure, but data science is a risky business, and to pretend that failure never happens is a failure in itself-Brian Godsey
Two Dangerous pitfalls from Data you may want to avoid:
a.Expecting data to answer questions it can't
b. Asking questions from data that doesn't solve original problem.
a.Expecting data to answer questions it can't
b. Asking questions from data that doesn't solve original problem.
The beauty of negative results: It probably forces you to rethink your project towards a more informed solution.
Litmus test for the goal of a DS project:
-What is possible
-What is valuable
-What is efficient.
-What is possible
-What is valuable
-What is efficient.
@threadreaderapp unroll
