Complete Life Cycle of a Data Science Project - Deepstash
Complete Life Cycle of a Data Science Project

Complete Life Cycle of a Data Science Project

Curated from: Krish Naik

Ideas, facts & insights covering these topics:

7 ideas

·

62 reads

Explore the World's Best Ideas

Join today and uncover 100+ curated journeys from 50+ topics. Unlock access to our mobile app with extensive features.

ARTHUR CONAN DOYLE

“Data!data!data!" he cried impatiently. "I can't make bricks without clay.” -

SHERLOCK HOLMES on "Data Gathering"

ARTHUR CONAN DOYLE

1

13 reads

1. Data Gathering

1. Data Gathering

  • 3rd party API's
  • web scraping
  • Big Data Engineering

1

10 reads

2. Feature Engineering

2. Feature Engineering

  • handle NaN values
  • handle imbalance of datasets
  • remove noise from data
  • format the data in a proper way
  • clean the data
  • normalization
  • handle categorical features

1

8 reads

3. Feature Selection

3. Feature Selection

  • "curse of dimensionality"
  • pearson correlation
  • heat map
  • extra tree classifier

1

8 reads

4. Model Creation

4. Model Creation

  • select the right model suitable for the data
  • train the model
  • hyper-parameter tuning
  • hyper-parameter optimization

1

8 reads

5. Model Testing

5. Model Testing

  • test the accuracy part
  • accuracy and confusion matrix
  • if it works good accuracy on test sets, go to next step and
  • if not good, back to data gathering or feature engineering as needed

1

8 reads

6. Production Deployment

6. Production Deployment

  • end point, rest API
  • aws
  • azure
  • gcp
  • monitor the model, how it works on real life uses, if changes are needed?

1

7 reads

IDEAS CURATED BY

anivana

Improve the process

CURATOR'S NOTE

For the love of machine learning!

Anirban Chatterjee 's ideas are part of this journey:

Machine Learning With Google

Learn more about artificialintelligence with this collection

Understanding machine learning models

Improving data analysis and decision-making

How Google uses logic in machine learning

Related collections

Read & Learn

20x Faster

without
deepstash

with
deepstash

with

deepstash

Personalized microlearning

100+ Learning Journeys

Access to 200,000+ ideas

Access to the mobile app

Unlimited idea saving

Unlimited history

Unlimited listening to ideas

Downloading & offline access

Supercharge your mind with one idea per day

Enter your email and spend 1 minute every day to learn something new.

Email

I agree to receive email updates