ML Systems in the Real World: Guidelines

This lesson summarizes the guidelines learned from these real-world examples.

Real World Guidelines

  • Keep the first model simple
  • Keep the first model simple
  • Focus on ensuring data pipeline correctness
  • Keep the first model simple
  • Focus on ensuring data pipeline correctness
  • Use a simple, observable metric for training & evaluation
  • Keep the first model simple
  • Focus on ensuring data pipeline correctness
  • Use a simple, observable metric for training & evaluation
  • Own and monitor your input features
  • Keep the first model simple
  • Focus on ensuring data pipeline correctness
  • Use a simple, observable metric for training & evaluation
  • Own and monitor your input features
  • Treat your model configuration as code: review it, check it in
  • Keep the first model simple
  • Focus on ensuring data pipeline correctness
  • Use a simple, observable metric for training & evaluation
  • Own and monitor your input features
  • Treat your model configuration as code: review it, check it in
  • Write down the results of all experiments, especially "failures"

Video Lecture Summary

Here's a quick synopsis of effective ML guidelines:

  • Keep your first model simple.
  • Focus on ensuring data pipeline correctness.
  • Use a simple, observable metric for training & evaluation.
  • Own and monitor your input features.
  • Treat your model configuration as code: review it, check it in.
  • Write down the results of all experiments, especially "failures."

Other Resources

Rules of Machine Learning contains additional guidance.

Previous
Literature (5 min)
Next
Next Steps