12,399 views

, 13 tweets, 8 min read

What's the difference between a data engineer, a data analyst and a data scientist?

If you want to make sure you don’t lose your job in the next five years, you probably want to know something about Big Data, or even switch to a data-related career.
#Thread
#DataScience #Data

You don’t need to be an excellent statistician or a high-class mathematician to work in data science or analytics, nor do you need a lot of prior programming knowledge.
- Dr. Rebecca Pope (head of data science and engineering at KPMG)
#DataScience #Data #DataAnalyst #Statistics

However, you do need an interest in statistics, you do need to be willing to learn how to code, and you do need to know how to do some high level mathematical operations. Data scientists are not just statisticians.

#DataScience #Data #DataAnalyst #Statistics

"A statistician is interested in building a model that builds a relationship between a variable and an outcome"
A data scientist wants to do something more: predict. Data scientists train models on data so that models can PREDICT the future as accurately as possible.
#DataScience

What does a Data Engineer do?
Data Engineer's job is "the representation and movement of data so that it is consumable and usable".
They needs to take the raw data, clean it, move it into a database, tag it, make sure it's ready for the next stage of the process.
#DataEngineer

Data Engineer develops, constructs, test and maintains architectures, such as Databases, large-scale processing system
Pope said the #programming #languages & platforms you'll need for data engineering jobs are:
1 Apache Spark
2 Scala
3 Docker
3 Java
4 Hadoop &
5 Kubernetes NiFI

What does a data analyst do?

There job is about interpreting current information to make it useful for the business.They interface with the business to find out what's required of the data & developing visualizations that allow the business to easily interpret what the data says

If you want this role, Pope said, it will help if you understand how to use RapidMiner predictive analytics software and Postgresql, an open-source relational database.

#DataAnalytics ##RapidMiner #Analytics #Postgrasql

What Does a Data Scientist Do?

Data scientist interfaces heavily with the business and works with engineers.
They train machine learning programs on specially prepared datasets in order to provide easy-to-use visualizations that suit the needs of the business

#DataScience #Data

Data scientists also "create models and advise executives on strategic decisions", Pope said.
"A data scientists need to understand statistics, but most machine learning algorithms are based on multivariable calculus, as well as linear and non-linear algebra....
#Data

...This is the level of mathematics you need to know,” she added.

You’ll also need good data-visualization and people skills so that you can present your model and its findings to the business and encourage them to use it.

#DataScience #DataScientist

Getting a Job

Pope is hiring at KPMG.
And she isn’t just looking for PhDs and highly accomplished graduates with a master’s degree.
Being a good data scientist is all about being the “Swiss Army knife” who can operate across the spectrum of the above-mentioned roles.
#Data