English
Hindi

Question

Download Solution PDF

An event has two possible outcomes with probability , and  The rate of information with 16 outcomes per second is:

This question was previously asked in
ESE Electronics 2013 Paper 2: Official Paper
Attempt in App
View all UPSC IES Papers >
  1. (38/4) bits/sec
  2. (38/64) bits/sec
  3. (38/2) bits/sec
  4. (38/32) bits/sec

Answer (Detailed Solution Below)

Option 1 : (38/4) bits/sec
Free Tests
View all Free tests >
Free
ST 1: UPSC ESE (IES) Civil - Building Materials
20 Qs. 40 Marks 24 Mins
Start Now

Detailed Solution

Download Solution PDF

Concept:

Information associated with the event is “inversely” proportional to the probability of occurrence.

Entropy: The average amount of information is called the “Entropy”.

Rate of information = r.H

Calculation:

Given: r = 16 outcomes/sec

, and  

∴ Rate of information = r.H

Rs = 16 x 19/32

Rs = 19/2 or 38/4 bits/sec

Download Solution PDF
Latest UPSC IES Updates

Last updated on May 28, 2025

->  UPSC ESE admit card 2025 for the prelims exam has been released. 

-> The UPSC IES Prelims 2025 will be held on 8th June 2025.

-> The selection process includes a Prelims and a Mains Examination, followed by a Personality Test/Interview.

-> Candidates should attempt the UPSC IES mock tests to increase their efficiency. The UPSC IES previous year papers can be downloaded here.

Exams Tests Super Practice

More Information Content of a Discrete Memoryless System Questions

Q1.500 Bits of data needs to be transmitted from a UART every 100 ms. What should be the minimum transmission baud rate of UART, assuming 1 start bit, 8 data bits, and 2 stop bits?
Q2.An analog signal is band limited to 4 kHz. It is sampled at the Nyquist rate and samples are quantized into 4 levels. The quantization levels have probabilities 1/8, 1/8, 3/8 and 3/8. The information rate of the source is:
Q3.A source produces 4 symbols with probabilities 1/2, 1/4, 1/8 and 1/8. For this source, a practical coding scheme has an average code word length of 2 bits / symbol. The efficiency of the code is:
Q4.Conveniently information I(x) is expressed as:
Q5.An event has two possible outcomes with probability \(P_1=\frac{1}{2}\), and \(P_2=\frac{1}{64}\) The rate of information with 16 outcomes per second is:
Q6.A fair coin is tossed repeatedly until a ‘Head’ appears for the first time. Let L be the number of tosses to get this first ‘Head’. The entropy H(L) in bits is _________.
Q7.A binary random variable X takes the value +2 or -2. The probability P(X = +2) = α. The value of α (rounded off to one decimal place), for which the entropy of X is maximum, is
Q8.Consider identical four, 3-faced dice. When the dice are rolled, the faces of the dice appear with probabilities given below. Which distribution has the maximum entropy?
Q9.A source generates three symbols with probability 0.25, 0.25, 0.50 at a rate of 3000 symbols per second. Assuming independent generation of symbols, the most efficient source encoder would have average bit rate of

More Information Theory Questions

Q1.Noise factor of a system is defined as:
Q2.The main processing functions of information system are given below. Arrange them in sequencing order: (A) Process transaction (B) Maintain master file (C) Process enquiry (D) Process report (E) Process interactive supper applications Choose the correct answer from the options given below:
Q3.Given below are two statements: Statement I: Turbo codes exhibits performance, in terms of bit error probability. that is very close to the Shannon limit and can be efficiently implemented for high speed use Statement II: Convolutional codes provide worst performance in noisy channels where a high proportion of the bits are in error In the light of the above statements, choose the correct answer from the options given below:
Q4.Match List I with List II: List I List II (A) Shannon's theorem (I) Capacity of Gaussian Noise channel (B) Shannon-Hartley theorem (II) Rate of Information (C) Bayes theorem (III) Energy of a signal (D) Parseval's theorem (IV) Conditional probabilities Choose the correct answer from the options given below:
Q5.The maximum rate at which nearly error-free data can be theoretically transmitted over a communication channel is defined as
Q6. _______ tells if the transmission rate is less than channel capacity, then there exists _______ that permit error free transmission.
Q7.What is the capacity of an additive white Gaussian noise channel with bandwidth of 1 MHz, power of 10W and noise power spectral density of No/2 = 10(−9) W/Hz?
Q8.Which of the following is the property of mutual information? S1: Mutual information of the channel is symmetric; that is, I (X; Y) = I (Y; X) S2: Mutual information of the channel is always non-negative; that is, I (X; Y) ≥ 0 S3: Mutual information of a channel is related to the joint entropy of the channel input and channel output by I(X; Y) = H(X) + H(Y) − H(X, Y) S4: H(X, Y) = H(X) + H(Y/X)
Q9.A memoryless source has symbols S = {−3, −1, 0, 1, 3} with corresponding probabilities {0.3, 0.2, 0.1, 0.2, 0.2}. The entropy of the source is:
Q10.Consider a source with four symbols. The entropy of the source will be maximum when probabilities of occurrence of symbols are:
Suggested Test Series
View All >
UPSC ESE (IES) Civil Mock Test Series
116 Total Tests with 1 Free Tests
Start Free Test
UPSC ESE (IES) Prelims Paper 1 Mock Test Series
54 Total Tests with   1 Free Tests
Start Free Test

DFCCIL Executive Important Links

ResultEligibility CriteriaSyllabus and Exam PatternAdmit CardBooksAnswer Key

More Communication Systems Questions

Q1.Which of the following components is required to detect (demodulate) Pulse Position Modulation (PPM)? a) Pulse Generator b) RS Flip-Flop c) PWM Demodulator
Q2.Which of the following statements about the AM detection using PLL circuit is/are correct? S1: It has higher noise immunity than the conventional peak detector type AM detector. S2: The PLL is locked to the carrier frequency of the AM signal.
Q3.In a 100% modulated AM signal with a carrier power of 100 W, what is the power in the lower sideband?
Q4.Which of the following is NOT a commonly used pulse-shaping filter in communication systems?
Q5.In which modulation technique is the carrier modulated using phase shifts of 0°, 90°, 180°, and 270°?
Q6.What is another name for PWM in communication engineering?
Q7.Which of the following statements about FM detection using PLL circuit are correct? S1: At the error amplifier output, we get demodulated FM output. S2: FM signal is applied to the input of the PLL.
Q8.In PLL as frequency synthesizer, if the crystal oscillator having frequency 500 MHz is passed through divide by 2 network, then the input frequency to PLL is _______ MHz.
Q9.The following block diagram represents which type of signal generation in communication?
Q10.What is a primary application of VSB (Vestigial Sideband) modulation?
Testbook Edu Solutions Pvt. Ltd.
1st & 2nd Floor, Zion Building,
Plot No. 273, Sector 10, Kharghar,
Navi Mumbai - 410210
support@testbook.com
Toll Free:1800 833 0800
Office Hours: 10 AM to 7 PM (all 7 days)
Company
About usCareers We are hiringTeach Online on TestbookPartnersMediaSitemap
Products
Test SeriesTestbook PassOnline CoursesOnline VideosPracticeBlogRefer & EarnBooks
Copyright © 2014-2022 Testbook Edu Solutions Pvt. Ltd.: All rights reserved
User PolicyTermsPrivacy
Hot Links： teen patti yas teen patti all games teen patti master teen patti list teen patti baaz