Sign Up

Sign Up to our social questions and Answers Engine to ask questions, answer people’s questions, and connect with other people.

Have an account? Sign In

Have an account? Sign In Now

Sign In

Login to our social questions & Answers Engine to ask questions answer people’s questions & connect with other people.

Sign Up Here

Forgot Password?

Don't have account, Sign Up Here

Forgot Password

Lost your password? Please enter your email address. You will receive a link and will create a new password via email.

Have an account? Sign In Now

You must login to ask question.(5)

Forgot Password?

Need An Account, Sign Up Here

Please briefly explain why you feel this question should be reported.

Please briefly explain why you feel this answer should be reported.

Please briefly explain why you feel this user should be reported.

Sign InSign Up

ITtutoria

ITtutoria Logo ITtutoria Logo

ITtutoria Navigation

  • Python
  • Java
  • Reactjs
  • JavaScript
  • R
  • PySpark
  • MYSQL
  • Pandas
  • QA
  • C++
Ask A Question

Mobile menu

Close
Ask a Question
  • Home
  • Python
  • Science
  • Java
  • JavaScript
  • Reactjs
  • Nodejs
  • Tools
  • QA
Home/ Questions/What is the difference between tf.nn.sparse_softmax_cross_entropy_with_logits vs tf.nn.softmax_cross_entropy_with_logits?
Next
Answered
Marley White
  • 33
Marley White
Asked: May 18, 20222022-05-18T15:36:36+00:00 2022-05-18T15:36:36+00:00In: Programs

What is the difference between tf.nn.sparse_softmax_cross_entropy_with_logits vs tf.nn.softmax_cross_entropy_with_logits?

  • 33

. Advertisement .

..3..

. Advertisement .

..4..

The difference between tf.nn.sparse_softmax_cross_entropy_with_logits vs tf.nn.softmax_cross_entropy_with_logits? I am learning about it. Can someone share with me your knowledge and experience?

softmax_cross_entropy_with_logits
  • 2 2 Answers
  • 45 Views
  • 0 Followers
  • 0
Answer
Share
  • Facebook
  • Report

2 Answers

  • Voted
  • Oldest
  • Recent
  • Random
  1. Best Answer
    hdtutoria Expert
    2022-06-10T05:01:14+00:00Added an answer on June 10, 2022 at 5:01 am

    It’s convenient to have two separate functions that yield the same result.

    The distinction is straightforward:

    • Labels must have the shape [batch_size] and the dtype int32 or int64 for sparse_softmax_cross_entropy_with_logits. Each label is an int in range [0, num_classes-1].
    • Labels must be of the shape [batch_size, num_classes] and dtype float32 or float64 for softmax_cross_entropy_with_logits.

    softmax_cross_entropy_with_logits labels are the hottest form of sparse_softmax_cross_entropy_with_logits labels.

    Another minor distinction is that you can use -1 as a label with sparse_softmax_cross_entropy_with_logits to have loss 0 on this label.

    • 22
    • Reply
    • Share
      Share
      • Share on Facebook
      • Share on Twitter
      • Share on LinkedIn
      • Share on WhatsApp
      • Report
  2. Julia Rey
    2022-05-25T20:24:21+00:00Added an answer on May 25, 2022 at 8:24 pm

    To add to the accepted answer, I’d like to add two things that you can also find within TF documentation.

    First:

    tf.nn.softmax_cross_entropy_with_logits

    NOTE: While the classes are mutually exclusive, their probabilities
    need not be. All that is required is that each row of labels is a
    valid probability distribution. If they are not, the computation of
    the gradient will be incorrect.

    Second:

    tf.nn.sparse_softmax_cross_entropy_with_logits

    NOTE: For this operation, the probability of a given label is
    considered exclusive. That is, soft classes are not allowed, and the
    labels vector must provide a single specific index for the true class
    for each row of logits (each minibatch entry).

    • 12
    • Reply
    • Share
      Share
      • Share on Facebook
      • Share on Twitter
      • Share on LinkedIn
      • Share on WhatsApp
      • Report

Leave an answer
Cancel reply

You must login to add an answer.

Forgot Password?

Need An Account, Sign Up Here

Sidebar

Ask A Question
  • How to Split String by space in C++
  • How To Convert A Pandas DataFrame Column To A List
  • How to Replace Multiple Characters in A String in Python?
  • How To Remove Special Characters From String Python

Explore

  • Home
  • Tutorial

Footer

ITtutoria

ITtutoria

This website is user friendly and will facilitate transferring knowledge. It would be useful for a self-initiated learning process.

@ ITTutoria Co Ltd.

Tutorial

  • Home
  • Python
  • Science
  • Java
  • JavaScript
  • Reactjs
  • Nodejs
  • Tools
  • QA

Legal Stuff

  • About Us
  • Terms of Use
  • Privacy Policy
  • Contact Us

DMCA.com Protection Status

Help

  • Knowledge Base
  • Support

Follow

© 2022 Ittutoria. All Rights Reserved.

Insert/edit link

Enter the destination URL

Or link to existing content

    No search term specified. Showing recent items. Search or use up and down arrow keys to select an item.